JP2004110411A - Document display system, document display method, and document display program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a system for displaying a folded document image without using a letter slicing method. <P>SOLUTION: A sentence block extraction means 2 outputs the location and the dimension of a block of letter strings (sentence block) arranged in the document image, and a line rectangle extraction means 3 outputs the locations and the dimensions of respective lines inside the sentence block. A user instructs the sentence block desired to be displayed by means of a user instruction means 6, and a folded image formation means 4 forms a folded image of the sentence block along a display area according to the locations and the dimensions of the lines inside the instructed sentence block. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a document display system, a document display method, and a document display program, and more particularly, to a document display system, a document display method, and a document display program for rearranging and displaying a character string according to the size of a display area.
[0002]
[Prior art]
In a conventional system for displaying a document image (a document obtained by digitizing a document as a set of pixels), up, down, left, and right scrolls are used to display a document image that does not fit in the display area. FIG. 15 shows an example of the relationship between the document image and the display area. When the display area 101 is small with respect to the document image 102 to be displayed as shown in FIG. 15, the user has to grasp the contents while frequently scrolling in the horizontal and vertical directions, which is very inconvenient. For example, when browsing a document stored as a digital image on a personal computer or the like in an electronic library or the like, if the amount of the browsed document is large, the burden on the user becomes very large.
[0003]
On the other hand, an editor or viewer that handles a document using character codes instead of images displays lines in a folded manner in accordance with the display area 101 as shown in FIG. The contents can be grasped (for example, refer to Patent Document 1). Here, the wording display means that, when the display area is small with respect to the document block to be displayed, the text block is returned to a new line from the middle of the line and displayed. In the example of FIG. 15, the first line of the text block of the document image 102 is composed of “Aioe, Kikukukeko, Sashi”, whereas the display area 101 is small and one line is displayed on one screen. Can not. Therefore, as shown in FIG. 16, the display of the first line is set to “Aioeoka” according to the size of the display area 101, and “Kikukeko, Sashi” is folded back to the next line and displayed. . In other words, even when the size of the display area changes due to a difference in the display device or a difference in the use form (for example, browsing two documents at the same time), the character string in the document is folded back to suit the display area. Display.
[0004]
Separately, there is an apparatus that performs wrap-around display using the result of layout analysis of a document image (for example, see Patent Document 2). Through layout analysis, it is possible to obtain the type, position, and size of each element that constitutes a document image, such as text blocks, lines, and characters, and use that information to rearrange the image in character units. The folded display can be realized in the same manner as the editor or the viewer.
[0005]
[Patent Document 1]
JP-A-7-261736 (page 3-5, FIG. 6)
[Patent Document 2]
JP 2001-216292 A (Pages 4-5, FIG. 2)
[0006]
[Problems to be solved by the invention]
However, folded display in the enlarged display device according to the invention described in Patent Literature 1 can be performed because a document is handled by character codes, and cannot be applied to a document image. Even if a character code is used, a wrapping display is performed in a document format (PDF (Portable Document Format) or some HTML (Hypertext Markup Language)) in which the character arrangement is fixed at the time of document creation. I can't.
[0007]
A first problem of the layout image editing apparatus and the layout image editing method according to the invention described in Patent Document 2 is that it depends on a character cutout process for extracting an image for each character. Although character segmentation is a task as difficult as character recognition, it is difficult to perform this without errors, but no response to analysis errors has been made.
[0008]
A second problem is that it does not consider the efficiency of document distribution via a network. Since a document image has a huge amount of data, an efficient method is required to distribute the document image via a low-speed network such as the Internet.
[0009]
The third problem is that it does not support document formats other than document images. Therefore, it is impossible to respond to a request to display a document that is not an image in a folded manner. On the other hand, each document format has a display device (or display program) corresponding to it, but in order to realize folded display with them, each device (or program) must be modified.
[0010]
SUMMARY OF THE INVENTION It is an object of the present invention to provide a system and a program for displaying a document image by folding back without performing character segmentation.
[0011]
Another object of the present invention is to provide a system capable of efficiently distributing a document image via a network.
[0012]
Still another object of the present invention is to provide a system that can convert a document in a different format into a unified format and display the content on a single display device (or display program).
[0013]
[Means for Solving the Problems]
A document display system according to claim 1, wherein a text block extracting means for outputting a position and a size of a text block which is a group of character strings arranged in the document image, and each line in the extracted text block. Line rectangle extracting means for extracting a position and a size of a character string, and outputting a line rectangle which is a character string in an area surrounding a line of characters in a rectangular shape in the text block, and indicating a text block to be displayed by the user And a folded image generating means for generating a folded image by folding the sentence block in accordance with the display area based on the position and size of the line in the sentence block designated by the user. Features.
[0014]
The document display system according to the invention according to claim 2, further comprising: a dividing position extracting unit that extracts a dividing position of the line rectangle when dividing the line rectangle extracted by the line rectangle extracting unit. The method is characterized in that a line rectangle is divided at the extracted break positions.
[0015]
A document display system according to a third aspect of the present invention includes a reduced image generating unit that generates a reduced image obtained by reducing the entire document image, displays the reduced image and the folded image simultaneously, and the folded image generating unit includes the reduced image generating unit. A folded image is generated for a display area avoiding the reduced image generated by the method.
[0016]
According to a fourth aspect of the present invention, there is provided a document display system for transmitting and receiving a document image, a text block, and information on a line rectangle via a network according to a user's instruction. A multi-resolution tiled image storage memory that holds each tile at a plurality of resolutions while dividing the tile into tiles that are partial images.
[0017]
According to a fifth aspect of the present invention, there is provided a document display system comprising a plurality of format conversion units for converting a specific document format into an image.
[0018]
According to the document display method of the present invention, the position and size of a sentence block arranged in a document image and the position and size of each line in the sentence block are extracted, and the position and size of the sentence block designated by the user are extracted. It is characterized in that a folded image is generated by folding the text block in accordance with the display area from the position and size of the line.
[0019]
According to a seventh aspect of the present invention, there is provided a document display program, comprising: a text block extracting means for outputting a position and a size of a text block which is a group of text strings arranged in a document image; A line rectangle extracting means for outputting a line rectangle which is a character string of a region surrounded by the shape, and a folded image generating means for folding a text block in accordance with a display area from a position and a size of a line selected by a user by a user instruction means The function of the computer is characterized by the following.
[0020]
BEST MODE FOR CARRYING OUT THE INVENTION
Next, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a first embodiment of a document display system according to the present invention. As shown in FIG. 1, the document display system includes an image storage memory 1 for storing a document image, a text block extraction unit 2 for extracting a text block from the document image, and a rectangle in which a row of characters in the text block is enclosed. A line rectangle extracting unit 3 for extracting a line rectangle, a folded image generating unit 4 for generating a folded image from a line rectangle in a text block, and a reduced image generating unit 5 for generating a reduced image obtained by reducing the entire document image. A user instructing unit 6 by which a user gives an instruction to the system using a mouse, a keyboard, or the like; a display selecting unit 7 for selecting one of a reduced display and a folded display of a document image; and an image display device 8 for displaying an image. It is composed of
[0021]
The image storage memory 1 holds a document image to be displayed at a resolution sufficient to read characters. In the present embodiment, it is assumed that the document image to be displayed exists in the image storage memory 1 in advance, but the document image may be transferred according to a user's instruction from a separately existing document image database.
[0022]
The sentence block extracting means 2 analyzes the layout of the document image stored in the image storage memory 1 by image understanding, and extracts constituent elements (sentence blocks) that form a unit of characters, for example, as one paragraph. Then, the position and size of each of the extracted text blocks are output. However, in the present embodiment, the sentence block is automatically extracted by the sentence block extracting unit 2, but the sentence block that the user wants to wrap and display may be extracted.
[0023]
The line rectangle extracting means 3 determines whether the character string inside each sentence block is vertical writing or horizontal writing, and then extracts a line by using a space between lines as a clue. Then, the position and size of each of the extracted rows are output.
[0024]
The wrapped image generation unit 4 generates a wrapped image in which each line in the text block specified by the user instruction unit 6 is cut and pasted. If the text block is horizontal writing, generate a vertically long image that extends from top to bottom according to the display area, and if it is vertical writing, generate a horizontal image that extends from right to left according to the vertical width according to the display area .
[0025]
The reduced image generation means 5 not only reduces the document image stored in the image storage memory 1 but also generates an image in which the text block frame extracted by the text block extraction means 2 is superimposed thereon. However, in the present embodiment, an image in which the frame of the text block is superimposed is generated to emphasize the portion of the text block, but other expressions such as changing the color in the text block may be used. .
[0026]
The user instructing means 6 informs the display selecting means 7 which of the reduced image and the folded image is to be displayed when the user presses a button or the like. When the user selects a text block frame superimposed and displayed on the reduced image, the text block desired to be displayed in a loop is transmitted to the loop image generation unit 4. Further, it instructs the image display device 8 to change the display magnification of the reduced display, scroll up, down, left and right, and scroll the folded image up and down (in the case of vertical writing, left and right).
[0027]
The display selection means 7 selects which of the reduced image and the folded image is to be displayed in accordance with a user instruction from the user instruction means 6. The image display device 8 displays the image selected by the display selection means 7, and changes or scrolls the display magnification of the image in response to a user instruction from the user instruction means 6. The sentence block extracting means 2, the line rectangle extracting means 3, the folded image generating means 4, the reduced image generating means 5, and the display selecting means 7 can be processed by a CPU such as a personal computer. This embodiment can be implemented by a personal computer or the like.
[0028]
Next, the operation of this embodiment will be described with reference to the flowcharts of FIGS. 2, 3, and 4. First, the text block extracting means 2 analyzes the layout of the document image stored in the image storage memory 1 by image understanding, and extracts a text block (step A11). At this time, the sentence block extracting unit 2 divides the document image into blocks of character lines or blocks such as figures described in, for example, JP-A-4-44185, and analyzes the layout of the document image based on the division result. Techniques can be used. Further, the line rectangle extracting means 3 determines whether each sentence block is written vertically or horizontally, and then extracts a line by using a space between lines as a clue (step A12). At this time, the row rectangle extracting unit 3 obtains, for example, a rectangular feature circumscribing the text block, a histogram feature on the vertical axis and the horizontal axis of the pixel, and the like. It can be determined whether the document is written vertically or horizontally.
[0029]
Next, the reduced image generation means 5 reduces the document image stored in the image storage memory 1, generates an image in which a text block frame is superimposed thereon (step A21), and the image display device 8 is generated. A reduced image is displayed (step A22). Then, the system enters a loop waiting for an instruction from the user instruction means 6 (steps A23, A25, A27). When scrolling is instructed by operating a scroll bar or the like (step A23), the image display device 8 scrolls the reduced image (step A24). For the scrolling operation, a method of moving the page by the size of the display area at a time may be used. If an instruction to enlarge or reduce the image is made by pressing an enlargement or reduction button (step A25), the image enlarged or reduced by the reduced image generation means 5 is generated again (step A26). When the superimposed sentence block frame is selected, the display selection means 7 switches to the display of the folded image (step A27).
[0030]
When the display is switched to the return image, the generation (step A31), the display (step A32), the scroll (steps A33 and A34), and the enlargement or reduction (steps A35 and A36) of the return image are performed similarly to the case of the reduced image. Do. The difference from the reduced image is that the reduced image can be scrolled in four directions, up, down, left, and right, whereas the folded image is generated according to the size of the display area regardless of any enlargement or reduction. Therefore, scrolling of a folded image is possible only in two directions, up and down or left and right. Then, the display is switched to the reduced image display by pressing a button or the like (step A37).
[0031]
The operation of generating a folded image (step A31) will be described with reference to the flowchart of FIG. Here, the description is given for horizontal writing, but the same operation is performed when the target is vertical writing. First, a variable called the remaining width is set to the width of the display area (step A41). Next, one first line rectangle is extracted (step A42), and it is compared whether the line width of the line rectangle does not exceed the remaining width (step A43). If the line width is larger than the remaining width, the current line rectangle is divided into the remaining width from the beginning and the remaining portion, and both are regarded as the line rectangles, and the process returns to step A42 (step A44). If the line width is equal to or smaller than the remaining width, the line rectangle is pasted on the folded image (step A45). When pasting the line rectangle, adjustments may be made to make the characters easier to read, such as leaving a space between lines or increasing the contrast between the characters and the background. If no unprocessed row rectangles remain, the process ends (step A46). Otherwise, the remaining width is reduced by the width of the pasted row rectangle (step A47). If the remaining width is larger than 0, the process returns to step A42, and if it is 0, the process returns to step A41 to reset the remaining width (step A48).
[0032]
Next, a specific example is shown in FIG. 6, and the operation of this embodiment will be described. FIG. 6A shows an example of a target document image. The text block extraction unit 2 extracts two text blocks 112 and 113 from the reduced image 111 displayed in the display area 101 (step A11). Then, the line rectangle extracting means 3 extracts a line in each sentence block (step A12). Next, the reduced image generating means 5 generates a reduced image 111 in which a text block frame is superimposed on the reduced text image (step A21), and the image display device 8 displays it (step A22). The initial value of the display magnification of the reduced image is determined by the reduced image generation unit 5 so that the entire image fits in the display area. When the user selects the text block 112, the display is switched to the display of the folded image (step A27). Then, the folded image generating means 4 generates the folded image 114 shown in FIG. 6B according to the width of the display area (Step A31), and the image display device 8 displays it (Step A32). The entire folded image 114 can be displayed only by scrolling up and down.
[0033]
In the present embodiment, since character display is performed using only line extraction without using character extraction, the display area can be displayed for any enlargement or reduction without confusing the user due to an error in character extraction. A folded image can be generated according to. Line extraction is a much less error-prone process than character segmentation. Since the folded image generated in this manner can be read only by scrolling up and down or left and right, the amount of operation is smaller than in the case where the folded image is not folded, and the sentence can be read comfortably.
[0034]
Next, a second embodiment of the present invention will be described with reference to the drawings.
FIG. 7 is a block diagram showing a second embodiment of the document display system according to the present invention. Referring to FIG. 7, in a second embodiment of the present invention, a delimiter position extracting unit 11 for extracting a delimiter position when dividing a line rectangle, and generating a folded image from the line rectangle and the delimiter position in the text block The second embodiment is different from the first embodiment in that the second embodiment has a second folded image generating unit 12 for performing the operation, a second image display device 13 for simultaneously displaying the reduced image and the folded image, and does not have the display selecting unit 7. .
[0035]
When dividing the line rectangle by the second folded image generation unit 12, the division position extraction unit 11 extracts division division positions in advance so that division is not performed in the middle of one character. For example, as shown in FIG. 8, the delimiter position extracting unit 11 sets, as the delimiter position 122, the middle of a blank section in the row rectangle 121 where there is no character pixel in the row rectangle when viewed in the vertical direction. In addition, a more advanced character segmentation method using a character pitch or the like may be used. In that case, it is important that the division is not caused in the middle of the character in generating the folded image. Therefore, when character extraction is difficult due to a variable pitch or the like, the character is more reliable than excessively dividing the character. It is better to extract only the break positions.
[0036]
In FIG. 5 showing the operation of the folded image generating means 4, the second folded image generating means 12 divides the row rectangle at step A44 only at the dividing positions extracted by the dividing position extracting means 11. This is different from the folded image generating means 4 in this point. Further, as shown in the example of FIG. 9, in order to simultaneously display the reduced image and the folded image, the width of the display area set to the remaining width in step A41 is not constant, which is different from the folded image generating means 4. . Other operations are the same as those of the folded image generation unit 4.
[0037]
The second image display device 13 simultaneously displays the reduced image and the folded image, and changes the display magnification of the image or scrolls the image according to an instruction from the user using the user instruction unit 6. In addition, the user can instruct the movement of the reduced image. In this case, a new folded image is generated so as to avoid the reduced image, and both are displayed at the same time.
[0038]
Next, FIGS. 10, 11 and 12 show flowcharts of this embodiment, and the operation will be described with reference to the drawings. First, a text block is extracted, a line rectangle is extracted, and a break position is extracted (steps A11, A12, A101). Next, after generating a reduced image, a folded image is generated so as to avoid it, and both are displayed simultaneously as shown in the example of FIG. 9 (steps A21, A102, A103). Then, the process enters a loop waiting for an instruction to move and scale the reduced image, select a text block frame, scroll the folded image, and scale (steps A104, A25, A27, A33, and A35). Since the folded image is generated avoiding the reduced image, the folded image is generated again even when the folded image is scrolled (step A34).
[0039]
Next, effects of the present embodiment will be described. In the first embodiment, when a folded image is generated, the folded position is determined in accordance with the display area and the folded display is performed. In the present embodiment, the dividing position is extracted and extracted. Since the used return image is generated, the return display can be performed in units of one character. The extraction of the delimiter position is different from the character segmentation, in that it is only necessary to extract the one having a high degree of certainty. Further, in the present embodiment, since the reduced image and the wrapped image are displayed at the same time, the position of the wrapped displayed text block in the text image can be easily grasped. At this time, since the folded image is generated so as to avoid the reduced image, the entire display area can be effectively used while avoiding the problem that the area below the reduced image cannot be seen.
[0040]
Next, a third embodiment of the present invention will be described with reference to the drawings. FIG. 13 is a block diagram showing a third embodiment of the document display system according to the present invention. Referring to FIG. 13, according to a third embodiment of the present invention, a server communication unit 201 and a client communication unit 202 for controlling communication between a server unit 204 and a client unit 205 via a network, And a multi-resolution tiled image storage memory 203 that holds each tile at a plurality of resolutions while dividing the image into partial images of a fixed size called tiles. The server unit 204 includes a sentence block extracting unit 2 and a line rectangle extracting unit 3.
[0041]
Next, the operation of the present embodiment will be described with reference to FIG. In the server unit 204, the sentence block extracting unit 2 extracts a sentence block from a document held as an image in the multi-resolution tiled image storage memory 203, and the line rectangle extracting unit 3 extracts a line rectangle. Information on the extracted sentence block is sent to the client unit 205 via the server communication unit 201. Further, the multi-resolution tiled image storage memory 203 divides the entire held document image into partial images of a fixed size to be tiled, and transmits the tiled image to the client unit 205 via the server communication unit 201. Here, the tile is formed such that the resolution of the tile including the text block is higher than the resolution of the tile not including the text block. The information of the text block and the document image received by the client communication unit 202 of the client unit 205 is sent to the reduced image generation unit 5. The reduced image generation means 5 reduces the document image, generates an image in which a text block frame is superimposed on the reduced document image, and outputs the generated image to the image display device 8 via the display selection means 7.
[0042]
Here, when the user instructing means 6 selects a text block and gives an instruction to display a folded image by pressing a button or the like by the user, the information of the text block and the line rectangle is sent to the server unit 204 via the client communication means 202. Make a request. The server communication unit 201 transmits information in response to a request from the client communication unit 202. The client communication unit 202 outputs the information sent from the server communication unit 201 to the return image generation unit 4. The return image generation means generates a return image from the transmitted information and outputs the generated return image to the display selection means 7. The display selection unit 7 selects display of a folded image, and outputs the generated folded image to the image display device 8. The image display device 8 displays a folded image.
[0043]
Thereafter, when the user performs a selection of a text block or an instruction of scrolling or enlarging / reducing an image by pressing a button or the like via the user instruction unit 6, the client communication unit 202 requests the information of the document block and the line rectangle. , Or a request for image acquisition based on the resolution and the tile number to the server unit 204. The server communication unit 201 transmits necessary information in response to a request from the client communication unit 205. At this time, an appropriate resolution is determined based on the display magnification, and a necessary tile is determined based on the position and size of the display area, and control is performed to minimize the communication data amount. Then, the client unit 205 having obtained necessary information performs the processing as instructed by the user. The operation of the client unit 205 at this time is the same as in the first embodiment.
[0044]
Since the main purpose of the reduced image in the present invention is to grasp the layout, a wide-range image covering the entire document is required. On the other hand, since the purpose of the folded image is to read characters, an image having a higher resolution than the reduced image is required, but the range only needs to be within the text block. For example, consider a document image in which the text block area is half of the total image area. Here, it is assumed that a resolution of, for example, 150 dpi is required to read the characters of the image, and a reduced image for grasping the entire document, for example, 75 dpi is sufficient. Further, it is assumed that the amount of data obtained by compressing the entire image of 150 dpi by some method is 400 kB, and the amount of data of the entire image of 75 dpi after compression is 100 kB. Conventionally, for communication of a document, all images of 150 dpi having a character-readable resolution had to be sent, and a communication volume of 400 kB was generated. However, according to the third embodiment of the present invention, A reduced image + required document block portion = 100 kB + 400 kB / 2 = 300 kB is enough. If a hierarchical compression method such as JPEG2000 is used as a compression method for an image, for example, 75 dpi compressed data as a reduced image can be used as a part of 150 dpi compressed data. The amount can be further reduced. As described above, the effect of the present embodiment is that when a document image is distributed via a network, communication is controlled in accordance with the resolution and the tile so that only a text block is acquired at a high resolution. That is, the amount of data can be reduced.
[0045]
Next, a fourth embodiment of the present invention will be described with reference to the drawings. FIG. 14 is a block diagram showing a fourth embodiment of the document display system according to the present invention. Referring to FIG. 14, in the fourth embodiment of the present invention, not only communication with the client unit 205 but also acquisition of a standard document format HTML or PDF document via the Internet or the like is possible. A second server communication unit 301 capable of converting the acquired HTML document into an image and sending it to the multi-resolution tiled image storage memory 203; and a multi-resolution tile by converting the acquired PDF document into an image. The third embodiment is different from the third embodiment in that a PDF image forming unit 303 for sending the converted image to the coded image storage memory 203 is provided.
[0046]
Next, the operation of the present embodiment will be described with reference to FIG. The second server communication unit 301 acquires a document such as HTML or PDF specified by a user instruction or the like from the client unit via the Internet or the like, and converts the document into an imaging unit corresponding to each format. send. The HTML imaging unit 302 converts the HTML document acquired by the second server communication unit 301 into an image. As the method, for example, there is a method of acquiring by operating as a pseudo printer using a print function of HTML document display software such as a Web browser. With such a method, conversion to an image can be easily achieved without directly handling the document format itself. The PDF imaging unit 303 is the same as the HTML imaging unit 302 except for the difference in the image format. If the multi-resolution tiled image storage memory 203 acquires an image, the other operations are the same as in the third embodiment.
[0047]
The effect of the present embodiment is that, only by preparing a means for converting a document into an image corresponding to the document format, a folded display corresponding to various document formats can be performed without changing the client unit. That is, in the present embodiment, HTML and PDF are described as examples of documents, but other formats operate in the same manner only by providing a means for converting them into images. Therefore, a document targeted by the present embodiment is a document that can be displayed as an image on a display device, or a document that can be converted into an image even when it cannot be displayed on a screen. If so, it can be performed on any of those documents. For example, the document can be converted into an image by a method such as capturing the screen of a document displayed on the screen or converting a print output into an image.
[0048]
【The invention's effect】
As described above, according to the first aspect of the present invention, a sentence block extracting unit that outputs the position and size of a sentence block that is a group of character strings arranged in a document image, and the extracted sentence block A line rectangle extracting means for extracting the position and size of each line in the text block and outputting a line rectangle which is a character string in a region surrounding a column of characters in the text block in a rectangular shape; A user instructing means for instructing a block, and a folded image generating means for producing a folded image by folding the sentence block in accordance with the display area based on the position and size of the line in the sentence block designated by the user Therefore, character display is not used, and wrapping display is performed using only line extraction. Also there is an effect that can generate aliasing image to match the display region with respect to small.
[0049]
According to the second aspect of the present invention, when the line rectangle extracted by the line rectangle extraction unit is divided, there is provided a separation position extraction unit for extracting a separation position of the line rectangle. Since the line rectangle is divided at the delimited position, it is possible to reduce the number of wraps in the middle of one character, and to provide an easy-to-read wrap display.
[0050]
According to the third aspect of the present invention, there is provided a reduced image generating means for generating a reduced image obtained by reducing the entire document image, wherein the reduced image and the folded image are displayed simultaneously, and the folded image generating means is provided by the reduced image generating means. Since the folded image is generated for the display area avoiding the generated reduced image, there is an effect that the position in the sentence image of the sentence block that is being folded and displayed can be easily grasped. In this case, since the folded image is generated so as to avoid the reduced image, there is an effect that the entire display area can be effectively used while avoiding a problem that an area below the reduced image cannot be seen.
[0051]
According to the fourth aspect of the present invention, a server communication unit and a client communication unit for transmitting / receiving a document image, a text block, and information on a line rectangle via a network according to a user's instruction, A multi-resolution tiled image storage memory that holds each tile at multiple resolutions while dividing it into tiles, which are partial images, is used. Acquiring at a high resolution has the effect of reducing the amount of data when distributing a document image via a network.
[0052]
According to the fifth aspect of the present invention, since the format conversion means for converting a specific document format into an image is provided as many as the number of corresponding document formats, various types of documents can be used without changing the client unit. There is an effect that the wrapping display corresponding to the format can be performed.
[0053]
According to the sixth and seventh aspects of the present invention, the position and size of the text block arranged in the document image and the position and size of each line in the text block are extracted, and the text specified by the user is extracted. Since the sentence block is wrapped according to the display area based on the position and size of the line in the block, a wrapped image is generated. Therefore, there is an effect that the amount of operation is small and the text can be read comfortably as compared with the case where no folding is performed.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a first exemplary embodiment of the present invention.
FIG. 2 is a first flowchart showing the operation of the first embodiment;
FIG. 3 is a second flowchart illustrating the operation of the first exemplary embodiment;
FIG. 4 is a flowchart 3 showing an operation of the first exemplary embodiment;
FIG. 5 is a flowchart showing the operation of the folded image generating means 4;
FIG. 6 is an example of a reduced image and a folded image.
FIG. 7 is a block diagram illustrating a configuration of a second exemplary embodiment of the present invention.
FIG. 8 is an example of a break position.
FIG. 9 is an example in which a reduced image and a folded image are displayed in a superimposed manner.
FIG. 10 is a first flowchart illustrating the operation of the second embodiment;
FIG. 11 is a second flowchart illustrating the operation of the second embodiment;
FIG. 12 is a flowchart 3 showing the operation of the second embodiment;
FIG. 13 is a block diagram illustrating a configuration of a third exemplary embodiment of the present invention.
FIG. 14 is a block diagram illustrating a configuration of a fourth exemplary embodiment of the present invention.
FIG. 15 is a diagram illustrating an example of a relationship between a document image and a display area.
FIG. 16 is a diagram illustrating an example of a folded display of a document.
[Explanation of symbols]
1 Image storage memory
2 Text block extraction means
3 Line rectangle extraction means
4 Return image generation means
5 Reduced image generation means
6 User instruction means
7 Display selection means
8 Image display device
11 Separation position extraction means
12 Second folded image generating means
13 Second image display device
101 Display area
102 Document image
103 Wrapped text
111 Reduced image
112, 113 sentence block
114 Folded image
121 line rectangle
122 break position
201 server communication means
202 Client communication means
203 Multi-resolution tiled image storage memory
204 server section
205 Client
301 second server communication means
302 HTML imaging means
303 PDF imaging means

Claims (7)

Sentence block extracting means for outputting the position and size of a sentence block which is a lump of character strings arranged in the document image,
A line rectangle extracting means for extracting a position and a size of each line in the extracted sentence block and outputting a line rectangle which is a character string in an area surrounding a column of characters in the sentence block in a rectangular shape;
User instructing means for instructing a sentence block to be displayed by the user;
A document display system comprising: a wrapped image generation unit configured to generate a wrapped image by wrapping the text block in accordance with the display area based on the position and size of a line in the text block specified by the user. . When dividing the line rectangle extracted by the line rectangle extraction unit, the division unit includes a division position extraction unit that extracts a division position of the line rectangle,
2. The document display system according to claim 1, wherein the folded image generating unit divides the line rectangle at the extracted break position. A reduced image generation unit configured to generate a reduced image obtained by reducing the entire document image,
Display the reduced image and the folded image at the same time,
3. The document display system according to claim 1, wherein the folded image generating means generates a folded image in a display area avoiding the reduced image generated by the reduced image generating means. Server communication means and client communication means for transmitting and receiving document images, text blocks, and information on line rectangles via a network according to a user's instruction;
4. A multi-resolution tiled image storage memory, which divides an image into tiles, which are partial images of a fixed size, and holds each tile at a plurality of resolutions. Document display system. 5. The document display system according to claim 4, wherein format conversion means for converting a specific document format into an image is provided by the number of corresponding document formats. The position and size of a sentence block, which is a group of character strings arranged in the document image, and the position and size of each line in the sentence block are extracted, and the position and size of the line in the sentence block specified by the user are extracted. Generating a folded image in which the sentence block is folded in accordance with the display area. Computer
A sentence block extracting unit that outputs the position and size of a sentence block that is a group of character strings arranged in a document image, and a line rectangle that is a character string of an area surrounding a line of characters in the sentence block in a rectangular shape And a document display program for functioning as a folded image generating means for folding a text block in accordance with the display area based on the position and size of the line selected by the user by the user instructing means.

Images