JPH09266561A - Digital still camera for generating continuous image and continuous image generating method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily and precisely obtain continuous images by the digital still camera. SOLUTION: A camera main body is equipped with plural image memories 5 which store image data on subject images and correspond to movement positions of the camera main body, a panorama memory 7 which stores subject image data before image pickup movement with a margin, a moving vector detecting circuit 30 which detects the moving direction of the camera main body, a display part 2 which projects an image being picked up, a control circuit 3 which projects part of image data stored in the image memories 5 before image pickup movement together with the image being picked up, side by side, within the range on the display part 2 determined according to movement information from the moving vector detecting circuit 30, and a shutter release button which is operated while both the images are connected with each other on the display part 2. The control circuit 3 sends pixel data, being picked up, on the display part 2 to the panorama memory 7 when the shutter release button is pressed, and puts the data together with the image data stored previously in the panorama memory and stores the composite image data.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital still camera capable of producing a continuous horizontally long image such as a panoramic image and a continuous image producing method thereof.

[0002]

2. Description of the Related Art A digital camera temporarily stores an image signal in a flash memory or the like in a camera body and displays the image in the flash memory on a printer or a display. As a thing
The configurations shown in FIGS. 9 and 10 are known. This is a viewfinder on the front of the camera body (1) for checking the image to be taken.
(15) and the imaging lens unit (4), and a shutter button (10) is provided on the upper surface. The camera body (1) is rotatably provided around a virtual point P as shown in FIG. 11 according to the position of the subject. Inside the camera body (1), as shown in FIG. 9, on the optical path from the imaging lens unit (4),
A CCD element (40) is provided, and the CCD element (40) is connected to a plurality of image memories (5) (5) (5) via an A / D conversion circuit (42).

A / D conversion circuit (42) and image memory (5) (5)
A changeover switch (SW1) is provided between (5) and
The changeover switch (SW1) is a control circuit according to the moving position.
It is switched by (3). The image from the CCD element (40) is stored in the image memory (5) corresponding to the moving position via the changeover switch (SW1). Image memory (5) (5)
The image from (5) is stored in the panorama memory (7) by the instruction of the control circuit (3). The image output from the panorama memory (7) is displayed on a printer or display (not shown) connected to the camera body (1).

When creating continuous images, first confirm the images to be taken and press the shutter button (10). The first image is stored in the first image memory (5) in FIG. Next, the photographer looks at the viewfinder (15) and rotationally moves the camera body (1) to shift the lens direction with respect to the subject, and when the image to be captured is captured, the shutter button (10) is pressed again. The control circuit (3) has a changeover switch (SW
1) is switched and the image signal A / D converted from the CCD element (40) is stored in the second image memory (5). Thereafter, similarly, the image signal is stored in the third image memory (5). The control circuit (3) transfers the image data stored in each image memory (5) (5) (5) to the panorama memory (7). The image data is a panorama memory that is predetermined for each image memory (5).
The image data is stored side by side in the respective areas in (7), and the continuous image data is taken out from the output terminal (11).
The image data from the output terminal (11) is D / A converted and displayed in a printer or the like connected to the camera body (1).

[0005]

In the case of the conventional still camera, since the viewfinder (15) and the imaging lens unit (4) are separated from each other, the image that can be seen through the viewfinder (15) and the imaging lens unit (4). However, the image actually captured is slightly different. In addition, since it is not known up to which part of the previously photographed image, there may be a gap between the subjects to be continuously photographed, or conversely, the amount of overlap may increase. Therefore, it is difficult to create a smooth continuous panoramic image. Furthermore, when an attempt is made to create a continuous image using a wide-angle lens, the captured image may be distorted due to the aberration of the central portion and the peripheral portion of the imaging lens unit (4). Therefore, the image becomes unnatural. It is an object of the present invention to easily and accurately obtain continuous images using a digital still camera.

[0006]

[Means for Solving the Problems] A camera body (1) for photographing a continuous subject at each moving position has an image memory (5) for storing image data of a subject image at a moving position of the camera body (1). Correspondingly, a plurality is provided. The camera body (1) includes a panorama memory (7) that stores subject image data before image pickup with a margin, a motion vector detection circuit (30) that detects a moving direction of the camera body (1), A display unit (2) for displaying an image and a part of the image data stored in the image memory (5) before moving the image are detected by a motion vector detection circuit (30).
In the range on the display unit (2) determined on the basis of the moving direction information from the control circuit (3), which juxtaposes with the image currently being imaged, and the two images on the display unit (2) match. A shutter button (10) to be operated is provided. Control circuit (3)
Sends the pixel data currently being imaged on the display unit (2) to the panorama memory (7) when the shutter button (10) is operated, and synthesizes it with the image data previously stored in the panorama memory (7). Store.

[0007]

In the present invention, since the continuous images are created while checking the continuity between the subject image before the camera body is moved and the current subject image, the joint between the two images is inconspicuous. It is possible to obtain a smooth image. Since the captured images are stitched together while changing the position at which the subject is captured by the camera body to create a continuous image, there is no image distortion due to aberration of the imaging lens unit. Moreover, since the subject image is displayed on the display unit, the image to be created can be easily confirmed, and there is no difficulty in joining the two subject images as in the conventional case.

[0008]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An example of the present invention will be described below in detail with reference to the drawings. The digital still camera shown below captures a subject image at an arbitrary location, then captures another subject image by changing the shooting location, confirms that both images are continuous, and then synthesizes both images. , To obtain continuous images. Note that the same reference numerals are used for the same configuration as the conventional one. (First example) As shown in FIGS. 2 (a) and 2 (b), the camera body (1)
Is an imaging lens unit (4) on the front facing the subject
Is provided, and a display unit (2) is provided on the rear surface facing the photographer, and a shutter button (10) is provided on the upper surface. The display unit (2) is composed of, for example, a liquid crystal panel, and an image captured by the imaging lens unit (4) is displayed. The camera body (1) is usually fixed to a rotating plate (16) on a tripod, and as shown in FIG. Capture the image at the position. For convenience of explanation, the images captured at the respective movement positions are shown at points A, B, and C that are the respective movement positions, as shown in FIG. By picking up images in this way, an image having no difference in perspective is captured in the camera body (1) at each moving position.

FIG. 1 is a block diagram showing a circuit configuration in the camera body (1). As in the conventional case, a CCD element (40) is provided on the optical path of the imaging lens unit (4) and
The CD element (40) converts the image signal into an electric signal and outputs it by switching the vertical shutter and the horizontal shutter for each predetermined field by the CCD drive circuit (41). The electric signal is converted into a digital signal by the A / D conversion circuit (42), and is transferred to the image memory via the changeover switch (SW1).
(5) (5) (5) are sequentially input. Each image memory (5)
As will be described later, the image data captured by the imaging lens unit (4) is stored.

The image data from each image memory (5) (5) (5) is sent to the panorama memory (7) and the image signal processing circuit (6). The image signal processing circuit (6) performs processing such as low frequency conversion and emphasis on the digital image signal from each image memory (5), D / A converts it, and outputs it.
It is connected to the display unit (2). The panorama memory (7) is a large-capacity memory that can store all the image data from the imaging lens unit (4) with a margin.
(7), image memory (5) (5) (5), changeover switch (SW
1) is a control circuit to which the signal from the shutter button (10) is input
The operation can be switched by (3). In the control circuit (3),
A motion vector detection circuit (30) is connected. The motion vector detection circuit (30) is composed of an angular velocity sensor and the like, and detects the moving direction of the camera body (1).

An example of use when a continuous image is obtained is shown in which the image to be photographed is a landscape representing the ridgeline of a mountain as shown in FIG. The procedure for creating a continuous image is shown in the flowchart of FIG. First, the camera body (1) is placed at point A. Initially, the changeover switch (SW1) is connected to the first image memory (5), and the image from the imaging lens unit (4) is the CCD.
Element (40), A / D conversion circuit (42), first image memory (5)
Then, the image signal processing circuit (6) displays the image on the display unit (2). The photographer presses the shutter button (10) at point A
(S1). The image signal taken into the CCD element (40) is digitized, and the image data is stored in the panorama memory (7) and the first image memory (5) by the signal from the control circuit (3) ( S2). Although FIG. 4 shows an array of images in the panorama memory (7), the image data from the first image memory (5) has an arbitrary free space on the left and right as shown by X in FIG. Stored in position.

In this state, the camera body (1) is moved to the virtual point P.
It is rotated clockwise (see FIG. 11) (S3). The motion vector detection circuit (30) detects that the camera body (1) has rotated clockwise, and notifies the control circuit (3) of that fact. The control circuit (3) is closer to the clockwise direction among the image data stored in the first image memory (5) due to the clockwise rotation of the camera body (1), that is, the right end portion of the display unit (2). Command to send out the image data of the amount displayed in. Here, the image data sent from the image memory (5) is
It is an image of the area AA at the point A in FIG.
The horizontal width of A, that is, the field section, is the control circuit.
(3) is stored in advance.

The control circuit (3) then displays the image data from the first image memory (5) by shifting it to the left side of the display unit (2) due to the clockwise rotation of the camera body (1). Issue a command to do. The panorama memory (7) does not operate while the camera body (1) is rotating. The image data from the first image memory (5) is D / A converted by the image signal processing circuit (6) and then sent to the display unit (2). The image memory (5) is generally formed by arranging registers in multiple stages, and continuously sends image data until a stop command signal is received from the control circuit (3). That is, while the camera body (1) shown in FIG.
The image signal processing circuit (6) continues to be supplied with the signal indicating that the still image of the area AA is displayed in the area BB that is the left side portion of (2). The field width of the area BB is the same as that of the area AA.

The control circuit (3) then switches to the changeover switch (S
W1) is connected to the second image memory (5). The image data passed through the second image memory (5) is an image signal processing circuit.
It is displayed on the display unit (2) via (6). At this time, the control circuit (3) displays the image data on the image signal processing circuit (6) via the second image memory (5) in a range other than the area BB on the display section (2). Give instructions. Therefore, the moving image that has passed through the second image memory (5) is displayed on the display unit (2) side by side with the still image from the first image memory (5) (S4). Here, as a means for displaying two types of images on the display unit (2), for example, an image supplied from the second image memory (5) as used in a character multiplex system in a television receiver. A means for superimposing the image signal from the first image memory (5) on a predetermined field of the signal is conceivable. This is a well known technique.

The photographer successively observes the moving images transferred to the display section (2), and at the point B as shown in FIG.
It is confirmed that the image currently being captured, which is displayed on the display unit (2), is continuous with the image displayed on the area BB from the first image memory (5), specifically, the ridgeline of the mountain is connected. Then, (S5), the rotation of the camera body (1) is stopped and the shutter button (10) is pressed (S6). The image at the point B remains displayed on the display unit (2) together with the image from the first image memory (5).

The control circuit (3) includes a motion vector detection circuit (3
Since the rotation direction of the camera body (1) is input from (0), the control circuit (3) uses the image data at the point B in the panorama memory (7) as the image previously captured at the point A. Know that it should be arranged to the right of the data. The control circuit (3) sends to the panorama memory (7) the image data currently being imaged which passes through the second image memory (5) and is already stored in the panorama memory (7) as shown in FIG. The image data from the first image memory (5) is arranged at the Y position on the right side. Therefore, in the panorama memory (7), the image captured at the point A and the image captured at the point B are successively stored (S7).

Further, the control circuit (3) stops the output of the image data from the first image memory (5) and prepares the image data for the second image memory in preparation for the preparation of the next continuous image.
It is stored in (5) (S8). When the camera body (1) next rotates clockwise, the control circuit (3) will move to the second image memory.
The image instructing to send from (5) is the point B in FIG.
It is needless to say that the width of the area BC in the horizontal direction, that is, the field section is the same as the width of the area AA.

The image composition in the panorama memory (7) is a known technique as shown in Japanese Utility Model Publication No. 8-4783. Hereinafter, the same processing is performed when the camera body (1) is set to the position C in FIG. The image stored in the panorama memory (7) can be confirmed by a printer or a display connected to the camera body (1). In this way, continuous images can be easily obtained. In this example, the image memory
Although (5) is three, three or more may be provided depending on the moving position.

(Second Example) In this example, instead of visually observing the continuity of the image captured before movement displayed on the display unit (2) and the image currently being captured, the camera body ( It is characterized in that it is detected by the circuit incorporated in 1) and the indicator lamp is turned on to notify at the time of detection. As shown by the dotted line in FIG. 2, the indicator lamp (8) is provided on the right side of the display unit (2). The indicator lamp (8) is usually LE
Although D is used, other light emitters may be used. FIG. 6 is a block diagram showing a circuit configuration in the camera body (1) of this example. The image data from the image memories (5), (5) and (5) is input to the image signal processing circuit (6) and also to the connection detection circuit (9). The connection detection circuit (9) has a display unit.
It detects the overlap of image data in a predetermined area in the image projected in (2), and is connected to the control circuit (3) and the motion vector detection circuit (30).

There are various conceivable configurations of the connection detection circuit (9), but as an example, a configuration in which binarization processing is performed for comparison is given. The binarization process uses a threshold level, which is a predetermined brightness, as a threshold value, sets a pixel having a density equal to or lower than the threshold value in the grayscale image to “1”, and a pixel having a density value equal to or higher than the threshold value. This is a well-known image processing technique for bitizing "0". For example, the landscape of the ridgeline of the mountain shown in FIG. 8A is converted as shown in FIG. 8B when the binarization process is performed. As shown in FIG. 7, the connection detection circuit (9)
A D / A conversion circuit (90), a binarization processing circuit (91) for binarizing the pixel data from the image memory (5), and 2
Binary memory that temporarily stores the pixel data that has been binarized
(92) and pixel data stored in the binarization memory (92),
Next, a comparison circuit (93) is provided for comparing the binarized pixel data with each other within a predetermined pixel area. Comparison circuit
(93) is connected to the indicator lamp (8). Here, the predetermined pixel area specifically refers to the range AA in FIG.

The procedure for creating continuous images will be described below. The operation of the motion vector detection circuit (30) and the display unit (2) is
Similar to the above, the captured image and the moving position of the camera body (1) are the same as in FIG. First, install the camera body (1) at the point A and press the shutter button (10). Control circuit
The image data is panorama memory by the signal from (3).
(7) and the image memory (5), respectively. Next, when the camera body (1) is rotated clockwise toward the point B, the control circuit (3) causes the image data in the predetermined field section from the first image memory (5), that is, the above-mentioned image data. The image data in the same area AA is output. At this time,
The panorama memory (7) does not work. Connection detection circuit (9)
Operates based on the signal from the motion vector circuit (30),
The image output from the first image memory (5) is binarized and temporarily stored in the binarized memory (92).

The control circuit (3) also displays the image data from the first image memory (5) in close proximity to the left side of the display section (2) based on the information from the motion vector detection circuit (30), and The changeover switch (SW1) is connected to the second image memory (5). As described above, the still image from the first image memory (5) and the moving image that has passed through the second image memory (5) are displayed side by side on the display unit (2). Connection detection circuit
(9) binarizes images successively input to the second image memory (5) as the camera body (1) rotates.

The comparison circuit (93) compares the pixel data stored in the binarization memory (92) with the pixel data binarized and input from the second image memory (5). Specifically, in FIG. 8B, the bit string stored in the rightmost column is compared with the bit string of the image data supplied from the second image memory (5). When both bit strings match, the comparison circuit (93) turns on the indicator lamp (8) and also issues a shutter pulse to the control circuit (3). The photographer turns on the indicator lamp (8) and sees the image displayed on the display unit (2), and stops the rotational movement of the camera body (1). The control circuit (3) sends the image data from the second image memory (5) to the panorama memory (7) based on the shutter pulse, and already stores it in the panorama memory (7) as shown in FIG. First image memory
Arrange on the right side of the image data from (5).

The control circuit (3) also stores image data in the second image memory (5) in preparation for the next successive image. When the camera body (1) rotates clockwise toward the point C, the control circuit (3) performs the same operation as described above. The connection detection circuit (9) binarizes the image data in the second image memory (5) in preparation for the next panorama image creation based on the information from the motion vector detection circuit (30), It is stored in the binarization memory (92). In this way, the connection detection circuit
By using (9), the connection between the subject image before the camera body (1) is moved and the current subject image is automatically detected. Therefore, the photographer visually finds the connection portion and presses the shutter button.
You can save the trouble of pressing (10).

In this example, after capturing the subject image, the camera body (1) is rotated and the subject image is captured again,
The feature is that a continuous image is created by finding a match between both images. Since the subject image is displayed on the display unit (2), the image to be created can be easily confirmed, and there is no difficulty in joining the two subject images as in the conventional case. Furthermore, since continuous images are created while detecting the connection part between the subject image before the camera body (1) moves and the current subject image, it is possible to obtain a smooth image with no conspicuous joint between both images. it can.

A continuous image can also be created by using a wide-angle lens. In this case, the image pickup lens unit is used.
Due to the aberrations in the central portion and the peripheral portion in (4), the captured image is distorted, and the image becomes unnatural. In this example, the images captured while changing the moving position are stitched together to create a continuous image, so the images do not become unnatural.

The description of the above embodiments is for the purpose of illustrating the present invention, and should not be construed as limiting the invention described in the claims or reducing the scope thereof. Further, the configuration of each part of the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made within the technical scope described in the claims. For example, although the connection detection circuit 9 detects that the images match, the indicator lamp 8 is turned on, but characters or symbols may be displayed in the display unit 2.

[Brief description of drawings]

FIG. 1 is a block diagram showing a circuit configuration inside a camera body.

[FIG. 2] (a) is a perspective view of the camera body as seen obliquely from the front,
(b) is a perspective view of the same as seen from diagonally behind.

FIG. 3 is a diagram illustrating a moving position of a camera body and an image to be captured.

FIG. 4 is a diagram showing image composition in a panorama memory.

FIG. 5 is a flowchart showing a procedure for creating a continuous image.

FIG. 6 is a block diagram showing a circuit configuration inside a camera body in another embodiment.

FIG. 7 is a block diagram showing the inside of a connection detection circuit.

FIG. 8A is a diagram showing an image to be binarized, and FIG.
It is a figure which shows the state after a value conversion process.

FIG. 9 is a block diagram showing a circuit configuration in a conventional camera body.

FIG. 10 (a) is a perspective view of a conventional camera body as seen diagonally from the front, and FIG. 10 (b) is a perspective view as seen from diagonally rear of the same.

FIG. 11 is a diagram showing a state in which the camera body is rotationally moved.

[Explanation of symbols]

 (1) Camera body (2) Display section (3) Control circuit (5) Image memory (7) Panorama memory (9) Connection detection circuit (30) Motion vector detection circuit

Claims (3)

[Claims] 1. A camera body (1) for photographing a continuous subject at each movement position, and an image memory (5) for digitally encoding and storing the captured image signal, and stores the images captured at each movement position. In a digital still camera that joins together to create continuous images, a plurality of image memories (5) are provided corresponding to the moving position of the camera body (1), and a panorama that stores subject image data before moving with a margin. A memory (7), a motion vector detection circuit (30) that detects the moving direction of the camera body (1), a display unit (2) that displays the image currently being captured, and an image memory (5) that stores the image before moving. A control circuit (3) for displaying a part of the generated image data side by side with the image currently being imaged in a range on the display unit (2) determined based on the moving direction information from the motion vector detection circuit (30). And both images on the display (2) Comprising a shutter button (10) operated at Therefore state, the control circuit (3), when the shutter button (10) operation, the display unit (2)
The pixel data of the image currently being captured above is stored in the panorama memory.
A digital still camera characterized by being sent to (7) and being combined with the image data previously stored in the panorama memory (7) and stored. 2. A camera body (1) for photographing a continuous subject at each movement position, and an image memory (5) for digitally encoding the stored image signal and storing the image signal. In a digital still camera that joins together to create continuous images, a plurality of image memories (5) are provided corresponding to the moving position of the camera body (1), and a panorama that stores subject image data before moving with a margin. A memory (7), a motion vector detection circuit (30) that detects the moving direction of the camera body (1), a display unit (2) that displays the image currently being captured, and an image memory (5) that stores the image before moving. A control circuit (3) for displaying a part of the generated image data side by side with the image currently being imaged in a range on the display unit (2) determined based on the movement direction information from the motion vector detection circuit (30). And move the camera body (1) Sometimes the display (2)
The control circuit (3) is provided with a connection detection circuit (9) for detecting a state where the above two types of images are connected, and an informing means connected to the connection detection circuit (9) to notify the completion of connection of both images. When the connection detection circuit (9) detects the connection between both images, the pixel data currently being imaged on the display unit (2) is sent to the panorama memory (7), and the panorama memory (7) is sent.
A digital still camera characterized by being combined with the image data previously stored in and stored. 3. A camera body (1) for photographing a continuous subject at each movement position is provided, image data before movement is stored in an image memory (5), and a panorama memory (7) has a margin. Display unit corresponding to the moving direction when the camera body (1) moves.
(2) A part of the image data in the image memory (5) is displayed side by side with the image currently being captured, and when the connection between both images on the display unit (2) is detected, the display unit ( 2) The pixel data currently being imaged above is stored in the panorama memory.
A continuous image creating method of sending to (7) and synthesizing with the image data previously stored in the panorama memory (7) and storing.