JP3800825B2 - Image processing apparatus and method, and storage medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing apparatus and method for handling a plurality of images, and a storage medium for storing program software for executing the method.
[0002]
[Prior art]
A technique for simultaneously synthesizing a plurality of images having common attribute information is known. For example, a device or software that forms a high-definition panoramic image with a wide angle of view by connecting a plurality of images in a two-dimensional direction is known. According to this, it is possible to obtain a high-quality image with a wide range of angle of view while using a low-distortion imaging optical system. In order to realize a panoramic image with a moving image, it is necessary to detect a joint of each component image in real time and to combine a plurality of images. In some cases, it is necessary to scale each image.
[0003]
In addition, a stereoscopic image can be seen by viewing the two images in stereo using the fact that parallax is generated between images from two viewpoints arranged in parallel on the left and right. There are a method of displaying on a direct view type three-dimensional display without glasses and a method of switching left and right images using liquid crystal shutter glasses. In the former method, for example, two left and right images need to be alternately arranged for each line of a frame on a display using a lenticular lens or the like, and in the latter method, the left and right images are combined on one screen. Processing to switch to and display is required.
[0004]
As described above, a composite image such as a panoramic image or a stereoscopic image needs to simultaneously process a plurality of constituent images.
[0005]
[Problems to be solved by the invention]
However, special processing has not yet been performed on the remaining images when at least one arbitrary image is processed from the set of images. For this reason, when it is desired to perform the same processing on the entire composite image such as a panoramic image or a stereoscopic image, it is necessary to select and process each of the images constituting the composite image. Will be big.
[0006]
For example, when erasing a set of images once created from the storage medium, the user must perform an erasure operation for the number of images. Further, when one component image constituting the stereoscopic image is erased, it is necessary to change the attribute of the other component image so as not to be stereoscopically viewed.
[0007]
That is, when a set of images is handled as a unit, when an arbitrary one image is selected and erased, etc., it is necessary to perform appropriate processing on the remaining images by the user's own operation. There was a demand for extremely complicated operations.
[0008]
An object of the present invention is to provide an image processing apparatus and method and a storage medium that eliminate such trouble.
[0009]
The present invention also provides an image processing apparatus and method, and a storage medium, which are configured to automatically erase the remaining image when any one image in a set of image groups handled as one is erased. The purpose is to present.
[0010]
[Means for Solving the Problems]
An image processing apparatus according to the present invention is an image processing apparatus that combines a plurality of pieces of image information, and includes attribute information including information specifying the image information and other image information to be combined with the image information. A storage unit that stores a plurality of image files, a selection unit that selects an arbitrary image file from the plurality of image files, and an image of the image file based on attribute information of the image file selected by the selection unit A search unit that searches for an image file that includes image information to be combined with information; and image information of the image file selected by the selection unit is excluded from the combination target, the image file searched by the search unit Means for performing processing for changing attribute information and excluding it from the synthesis target.
[0012]
The image processing apparatus according to the present invention is also an image processing apparatus that performs a predetermined process on a plurality of pieces of image information based on predetermined attribute information, and the image information and other target to be combined with the image information Storage means for storing a plurality of image files including attribute information including information for specifying image information, selection means for selecting an arbitrary image file from the plurality of image files, and an image file selected by the selection means A search unit that searches for an image file including image information to be combined with image information of the image file based on the attribute information of the image file, and image information of the image file selected by the selection unit is excluded from the combination target The remaining image file of the plurality of image files is deleted, or the attribute information of the remaining image file is used for the selection means. A processing selection unit that selects whether to change information indicating an arbitrary image file selected by the processing unit, and an image file processing unit that processes the remaining image file in accordance with a selection result of the processing selection unit. It is characterized by.
[0013]
[Means for Solving the Problems]
An image processing method according to the present invention is an image processing method for combining a plurality of pieces of image information, and includes attribute information including information specifying the image information and other image information to be combined with the image information. A storage step of storing in the storage means a plurality of image files, a selection step of selecting any image file from the plurality of image files by the selection means, and attribute information of the image file selected in the selection step A search step of searching for an image file including image information to be combined with image information of the image file by search means, and when image information of the image file selected in the selection step is excluded from the combination target, change by the processing means the attribute information of the image file Oite searched search step processing for excluding from said compositing target Characterized in that it comprises a step of performing.
[0015]
The image processing method according to the present invention is also an image processing method for performing predetermined processing on a plurality of pieces of image information based on predetermined attribute information, wherein the image information is combined with other image information to be combined with the image information. A storage step of storing a plurality of image files including attribute information including information for specifying image information in a storage unit, a selection step of selecting an arbitrary image file from the plurality of image files by a selection unit, and the selection step A search step of searching for an image file including image information to be combined with the image information of the image file based on the attribute information of the image file selected in step, and a search step of the image file selected in the selection step When image information is excluded from synthesis targets, the remaining image information of the plurality of image information is deleted, or the remaining image information A processing selection step of selecting depending processing selection means to change the information indicating the arbitrary image information selected in the selection step from the attribute information, the remaining image information in accordance with the selection result of the process selection step And an image file processing step for processing.
[0016]
The storage medium according to the present invention stores a computer-readable program for causing a computer to execute the above-described image processing method.
[0017]
【Example】
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0018]
FIG. 1 shows a schematic block diagram of a first embodiment of the present invention. In this embodiment, attribute information indicating each other that is an image constituting the composite image is added to each of the plurality of images constituting the composite image. For any image erasing operation, new attribute information is automatically set for the remaining images.
[0019]
The image processing apparatus 10 according to the present embodiment basically includes a computer. 12 is a storage device for storing a plurality of images and various programs and data, 14 is a CPU, 16 is a memory, 18 is an image processing circuit, 20 is a parallel interface, 22 is a user interface, 24 is a display control circuit, and 26 is VRAM, 28 is a monitor / display (hereinafter referred to as a monitor), and 30 is a CPU bus. An electronic still camera or a video camera may be included. The monitor 28 is a CRT monitor or a liquid crystal monitor. CPU14 reads the program memorize | stored in the memory | storage device 12, and controls each part according to the program.
[0020]
An operation for displaying an image stored in the storage device 12 on the monitor 28 will be described. Image data stored in the storage device 12 is read and transferred to the memory 16 via the CPU bus 30. The image processing circuit 18 performs processing such as right / left difference correction (in the case of stereoscopic viewing) on the memory 16. The display control circuit 24 takes the image data on the memory 16 into the VRAM 26 and displays it on the monitor 28. The user interface 22 is used by the user to input various instructions to the CPU 14. An image captured from the outside via the parallel interface 16 can be displayed on the screen of the monitor 26, and the basic operation is the same.
[0021]
Assume that the storage device 12 stores a pair of left and right image data files constituting a stereoscopic image. This image data may be taken by a camera, created by computer graphics, or a combination of both. Here, it is assumed that the image is taken by a compound eye camera.
[0022]
FIG. 2 shows the storage format in the storage device 12, that is, the file name and attributes. In FIG. 2, the basic file name is “IMAGE1”, and “_R” is added to the right image and “_L” is added to the left image to indicate that it is a component of a common stereoscopic image. However, the file name itself is not limited to this. As the extension, a file indicating the image file format (bmp indicating the bitmap format in FIG. 2) is used. The file format is not limited to bitmap.
[0023]
Accordingly, the storage device 12 stores the image files “IMAGE1_R.bmp” and “IMAGE1_L.bmp”. In this embodiment, in order to indicate that the image files “IMAGE1_R.bmp” and “IMAGE1_L.bmp” are a set of images for stereoscopic viewing, the header of one image file “IMAGE1_R.bmp” The paired image file name “IMAGE1_L.bmp” and the panorama 3D identifier name P1_R are stored, and the header of the other image file “IMAGE1_L.bmp” is the paired image file name “IMAGE1_R.bmp” and panorama 3D. The identifier name P1_L is stored. The header may include not only the file name of the pair image but also information unique to the image such as the size of the file of the pair image and the update date / time.
[0024]
For reference, an image file “IMAGE2.bmp” for 2D and its attribute information are shown in FIG. Since the image file is for 2D, both the pair image name and the panorama 3D identification name are blank in the header.
[0025]
When combining three or more images as in the case of panorama composition, including all the file names of the remaining component images in the header is complicated and the storage area may not be secured. A character string (for example, P1_R, P1_L in FIG. 2) in which each identification character is added to a common character string different from the file name, such as a panorama 3D identifier name, may be recorded. As a result, management that does not depend on the file name becomes possible, and the user can identify the same set of images even when the file name is individually changed. When there are three or more image files, character strings such as “_1”, “_2”, and “_3” may be added.
[0026]
Each image file is appended with the creation date and time of the image file. This is recorded in the directory entry of the storage device 12. The structure of the directory entry in the storage device 12 is shown in FIG. The directory entry includes a file name column, an extension column, an attribute information column, and a leading cluster column for files stored in the storage device 12. Such a structure is well known. In the first cluster column, the first cluster in the FAT of each file is exemplified in hexadecimal.
[0027]
Next, with reference to the flowchart shown in FIG. 4, an operation when one of the image files “IMAGE1_R.bmp” and “IMAGE1_L.bmp” constituting the stereoscopic image is deleted will be described. First, the file manager for displaying the file name of the viewer software of this embodiment is started. As a result, the file names of all the files stored in the storage device 12 are displayed, and the user selects a file to be deleted through the user interface 22 (S1). For example, it is assumed that the file “IMAGE1_L.bmp” is selected as an erasure target.
[0028]
The header of the selected file “IMAGE1_L.bmp” is read (S2), and the presence / absence of a paired image is checked (S3). In the example shown in FIG. 2, since the pair image name “IMAGE1_R.bmp” is entered, it is checked whether or not the image file “IMAGE1_R.bmp” exists in the storage device 12.
[0029]
When the pair image exists (S3), the file “IMAGE1_L.bmp” to be deleted is deleted while displaying the pair image name “IMAGE1_R.bmp” (S4). After that, the header of the file “IMAGE1_R.bmp” that was the pair image is opened, the pair image name column is left blank, the panorama 3D identifier name is also left blank (S5), and the process ends. This is because the image file “IMAGE1_R.bmp” needs to be handled as one piece of 2D image data since the pair image “IMAGE1_L.bmp” constituting the stereoscopic image has been deleted.
[0030]
If the header information of the image file “IMAGE1_R.bmp” is left as it is, the viewer software assumes that the image file “IMAGE1_R.bmp” is paired with the image file “IMAGE1_L.bmp”. The image file “IMAGE1_R.bmp”, which causes an excessive load on the apparatus, starts processing for stereoscopic viewing and search processing for the image file “IMAGE1_L.bmp” which is always handled during playback and processing. Is not already present in the storage device 12 (S3), the image file “IMAGE1_L.bmp” is deleted and the process is terminated (S6).
[0031]
When one of the two image files constituting the stereoscopic image is deleted in this way, the attribute information for the stereoscopic image is deleted from the remaining image file, so that the remaining image file is set as a normal 2D image. It can be handled.
[0032]
Although a stereoscopic image has been described as an example, the same processing is basically applicable to a panoramic composite image in which three or more images are combined. That is, when any one image file is deleted, the remaining image file or group of image files is not related to the deleted image file by deleting the association with the deleted image from the header of the remaining image file. Can be
[0033]
The remaining constituent images can also be searched using the creation date and time of the image data. The storage device 12 may be a detachable device such as a flash memory card.
[0034]
In this embodiment, when one image constituting the composite image is erased, all the remaining images can be automatically erased. FIG. 5 shows a flowchart of the operation.
[0035]
Start the file manager that displays the file name of the viewer software. As a result, the file names of all the files stored in the storage device 12 are displayed, and the user selects a file to be deleted through the user interface 22 (S11). For example, it is assumed that the file “IMAGE1_L.bmp” is selected as an erasure target.
[0036]
The header of the selected file “IMAGE1_L.bmp” is read (S12), and the presence / absence of a paired image is checked (S13). If there is a pair image (S13), the pair image name “IMAGE1_R.bmp” is displayed and the file “IMAGE1_L.bmp” to be erased is erased (S14). IMAGE1_R.bmp "is also deleted (S15), and the process ends.
[0037]
If the paired image file “IMAGE1_R.bmp” does not already exist in the storage device 12 (S13), the image file “IMAGE1_L.bmp” is deleted and the process ends (S16).
[0038]
In this way, when at least one of a plurality of images including attribute information common to each other is erased, all the remaining images are erased, saving time.
[0039]
It is preferable that the user can arbitrarily select the process shown in FIG. 4 and the process shown in FIG. FIG. 6 shows a flowchart of an operation in which the deletion of the pair image or the change of the header of the pair image can be selected immediately before. Here, it is assumed that four image files “IMAGE1.bmp”, “IMAGE2.bmp”, “IMAGE3.bmp”, and “IMAGE4.bmp” are combined.
[0040]
When the file manager that displays the file name of the viewer software of the present embodiment is activated, the file names of all the files stored in the storage device 12 are displayed. Is selected (S21). For example, it is assumed that the file “IMAGE1.bmp” is selected as an erasure target.
[0041]
The header of the selected file “IMAGE1.bmp” is read (S22), and the presence / absence of a pair of images is checked (S23). The images to be paired here are “IMAGE2.bmp”, “IMAGE3.bmp”, and “IMAGE4.bmp”.
[0042]
If there is a pair of images (S23), the file “IMAGE1.bmp” to be deleted is deleted (S24), and the file “IMAGE1” to be deleted is displayed on the screen of the monitor 28 as shown in FIG. .Bmp "is deleted, a list of image files to be paired is displayed, and the user selects whether to delete the grouped images or to change the grouped image header (S25). When the user selects to delete the combined image (S25), the combined image files “IMAGE2.bmp”, “IMAGE3.bmp”, and “IMAGE4.bmp” are deleted (S26), and the process ends. When the user selects “leave” (S25), the pair image name column is left blank in each header of the combined image files “IMAGE2.bmp”, “IMAGE3.bmp”, and “IMAGE4.bmp”, and panorama 3D The identifier name is also left blank and stored (S27), and the process ends. In the latter case, the remaining image files “IMAGE2.bmp”, “IMAGE3.bmp”, and “IMAGE4.bmp” are treated as independent images thereafter.
[0043]
When the image file to be paired does not exist in the storage device 12 (S23), the image file “IMAGE1.bmp” to be erased is erased and the process ends (S28).
[0044]
In this way, the user can select processing of the component image as necessary. Note that the processing for the remaining set images is not limited to the mode described with reference to FIG. For example, the remaining images after erasing any one image can be grouped by dividing them one by one or any number of images, changing attribute information within each group, or deleting image files for each group May be.
[0045]
Although FIG. 6 is intended for the case of a panoramic image, it is obvious that the present invention can also be applied to a stereoscopic image.
[0046]
In each of the above embodiments, attribute information related to a pair of images is recorded in the header portion of each image file. However, a separate file (attribute information file) is provided, and detailed information regarding the pair of images is recorded therein. The name of the attribute information file may be recorded in the header of each image file.
[0047]
The present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device.
[0048]
In addition, in order to operate various devices so as to realize the functions of the above-described embodiments, a program code of software for realizing the functions of the above-described embodiments is stored in a computer in an apparatus or system connected to the various devices. What supplied and implemented the apparatus (or CPU or MPU) of the system by operating the various devices according to a stored program is also included in the scope of the present invention.
[0049]
In this case, the program code of the software itself realizes the functions of the above-described embodiments, and the program code itself and means for supplying the program code to the computer, for example, the program code is stored. This storage medium constitutes the present invention. As a storage medium for storing the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.
[0050]
Further, by executing the program code supplied by the computer, not only the functions of the above-described embodiments are realized, but also the OS (operating system) or other application software in which the program code is running on the computer. Needless to say, the program code is also included in the embodiment of the invention according to the present application even when the functions of the above-described embodiment are realized in cooperation with the above.
[0051]
Furthermore, after the supplied program code is stored in the memory of the function expansion board of the computer or the function expansion unit connected to the computer, the function expansion board or the function expansion unit is based on the instruction of the program code. Needless to say, the CPU according to the present application also includes the case where the functions of the above-described embodiments are realized by performing part or all of the actual processing.
[0052]
【The invention's effect】
As can be easily understood from the above description, according to the present invention, a plurality of image files composed of image information and attribute information including information specifying other image information to be combined with the image information. Among them, when the image information of the selected image file is excluded from the synthesis target, the common attribute information is changed. Regardless of the image file excluded from the image file, it can be handled as a separate image file.
[Brief description of the drawings]
FIG. 1 is a schematic block diagram of an embodiment of the present invention.
FIG. 2 shows an example of a file stored in the storage device 12 and an example of attribute information thereof.
FIG. 3 is a directory entry example of the file example shown in FIG. 2;
FIG. 4 is a flowchart of an erase operation according to the present embodiment.
FIG. 5 is a flowchart of a second erase operation according to the present embodiment.
FIG. 6 is a flowchart of a third erase operation according to the present embodiment.
7 is an example of a display screen in S25 of FIG.
[Explanation of symbols]
10: Image processing device 12: Storage device 14: CPU
16: Memory 18: Image processing circuit 20: Parallel interface 22: User interface 24: Display control circuit 26: VRAM
28: Monitor / display 30: CPU bus

Claims (14)

An image processing apparatus for combining a plurality of pieces of image information,
Storage means for storing a plurality of image files including the image information and attribute information including information specifying other image information to be combined with the image information;
Selecting means for selecting an arbitrary image file from the plurality of image files;
Search means for searching for an image file including image information to be combined with image information of the image file based on attribute information of the image file selected by the selection means;
Means for performing processing for changing the attribute information of the image file searched by the search means and excluding it from the synthesis target when the image information of the image file selected by the selection means is excluded from the synthesis target; An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the process of excluding the image file selected by the selection unit from the plurality of image files from the synthesis target is erasure.   The image processing apparatus according to claim 1, further comprising: setting new information for combining the searched image file as attribute information of the image file searched by the search unit.   The image processing apparatus according to claim 1, wherein the attribute information includes a file name of the image file.   When the image information of the image file selected by the selection unit is excluded from synthesis targets, the selection unit determines from the attribute information of the remaining image files among the plurality of image files stored in the storage unit. 3. The information specifying the selected image file is deleted, and / or the remaining image files stored in the storage means of the plurality of image files are also deleted. Image processing device. An image processing apparatus that performs predetermined processing on a plurality of pieces of image information based on predetermined attribute information,
Storage means for storing a plurality of image files including the image information and attribute information including information specifying other image information to be combined with the image information;
Selecting means for selecting an arbitrary image file from the plurality of image files;
Search means for searching for an image file including image information to be combined with image information of the image file based on attribute information of the image file selected by the selection means;
When the image information of the image file selected by the selection unit is excluded from synthesis targets, the remaining image files of the plurality of image files are deleted, or the selection is performed from the attribute information of the remaining image files. Processing selection means for selecting whether to change information indicating an arbitrary image file selected by the means;
An image processing apparatus comprising: an image file processing unit that processes the remaining image file in accordance with a selection result of the processing selection unit. An image processing method for combining a plurality of pieces of image information,
A storage step of storing, in a storage unit, a plurality of image files including the image information and attribute information including information specifying other image information to be combined with the image information;
A selection step of selecting an arbitrary image file from the plurality of image files by a selection means ;
A search step of searching for an image file including image information to be combined with the image information of the image file based on the attribute information of the image file selected in the selection step by a search unit ;
Excluding the image information of the image file selected in the selection step from the synthesis target, to exclude from the compositing target change by the processing means the attribute information of Oite retrieved image files in the search step And an image processing method.   The image processing method according to claim 7, wherein the process of excluding the image file selected in the selection step from the plurality of image files from the synthesis target is erasure. Further, the attribute information of Oite retrieved image files in the search process, according to claim 7, characterized in that setting the new information to the retrieved image file composited by the processing means Image processing method.   The image processing method according to claim 7, wherein the attribute information includes a file name of the image file. When erasing the image file selected in the selection step, the image information selected in the selection step from the attribute information of the remaining image files among the plurality of image files stored in the storage step. 9. The image processing method according to claim 8, wherein the specified information is deleted by the processing means and / or the remaining image files stored in the storage step among a plurality of image files are also deleted. . An image processing method for performing predetermined processing on a plurality of pieces of image information based on predetermined attribute information,
A storage step of storing, in a storage unit, a plurality of image files including the image information and attribute information including information specifying other image information to be combined with the image information;
A selection step of selecting an arbitrary image file from the plurality of image files by a selection means ;
A search step of searching for an image file including image information to be combined with the image information of the image file based on the attribute information of the image file selected in the selection step by a search unit ;
When the image information of the image file selected in the selection step is excluded from synthesis targets, the remaining image information of the plurality of image information is deleted, or the attribute information of the remaining image information is used as the attribute information. A process selection step of selecting by the process selection means whether to change the information indicating any image information selected in the selection step;
And an image file processing step of processing the remaining image information in accordance with a selection result of the processing selection step. A computer-readable storage medium storing a program for causing a computer to execute the image processing method according to claim 7. A readable storage medium storing a program for causing a computer to execute the image processing method according to claim 12.

Images