JP4788607B2 - IMAGING DEVICE, IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, PROGRAM FOR IMAGE PROCESSING METHOD, AND RECORDING MEDIUM CONTAINING PROGRAM FOR IMAGE PROCESSING METHOD - Google Patents

Description

  The present invention relates to an imaging apparatus, an image processing apparatus, an image processing method, a program for the image processing method, and a recording medium on which the program for the image processing method is recorded, and can be applied to, for example, a digital video camera. The present invention stops the recording of thumbnail images due to a decrease in the transfer rate to the recording medium, and records only moving images, thereby recording a thumbnail image for cueing used for head search and editing point search on the recording medium. In this case, a moving image can be reliably recorded even when the transfer rate to the recording medium temporarily decreases.

  2. Description of the Related Art Conventionally, in an imaging apparatus such as a digital video camera, a moving image is data-compressed by MPEG (Moving Picture Experts Group) and recorded on a recording medium. In this MPEG, data compression processing is performed by dividing moving images in GOP (Group Of Pictures) units.

  Regarding recording of such a moving image, for example, Japanese Patent Laid-Open No. 2006-74690 discloses a method of creating a thumbnail image for cueing used for cueing or editing point search for each predetermined picture and recording it on a recording medium. Proposed. According to the technique disclosed in Japanese Patent Application Laid-Open No. 2006-74690, a desired scene can be cued at high speed using the cueing thumbnail image. You can use it to search for edit points.

  However, when a cueing thumbnail image is created for each predetermined picture and recorded on a recording medium, the amount of data recorded on the recording medium increases as compared with the case of recording only a moving image. On the other hand, in this type of imaging apparatus, the transfer rate to the recording medium may temporarily decrease.

  That is, for example, in a hard disk device, an impact may be detected by an acceleration sensor to retract the head, and when the head is retracted, the transfer rate to the recording medium temporarily decreases. In addition, in a disk device such as a hard disk device or an optical disk device, a write retry may be performed. In this case, the transfer rate to the recording medium is temporarily reduced. In addition, it is predicted that the power supply voltage is reduced due to battery consumption and the recording circuit does not operate normally. In this case, the transfer rate to the recording medium is temporarily reduced. In some cases, an abnormality is detected by a temperature sensor, a dew condensation sensor or the like, and recording on the recording medium is temporarily interrupted. In this case, the transfer rate to the recording medium is temporarily reduced.

Therefore, in the method of creating a cueing thumbnail image for each predetermined picture and recording it on a recording medium, it is impossible to record a moving image when the transfer rate to the recording medium temporarily decreases in this way. In some cases, the problem was predicted and could not be applied directly.
JP 2006-74690 A

  The present invention has been made in consideration of the above points, and when recording a thumbnail image for cueing on a recording medium, even if the transfer rate to the recording medium temporarily decreases, An image pickup apparatus, an image processing apparatus, an image processing method, a program for the image processing method, and a recording medium on which the program for the image processing method is recorded can be proposed.

  In order to solve the above-mentioned problem, the invention of claim 1 is applied to an imaging apparatus, and a photographing unit that acquires image data of a moving image, and an image of a thumbnail image for each predetermined picture from the image data of the moving image. A thumbnail image creating unit that creates data; a recording unit that records the image data of the moving image and the image data of the thumbnail image on a recording medium; and a reduction in a transfer rate to the recording medium in the recording unit. And a control unit that stops recording the image data of the image on the recording medium.

  Further, the invention of claim 2 is applied to an image processing apparatus, and an image data acquisition unit that acquires image data of a moving image, and creates image data of a thumbnail image for each predetermined picture from the image data of the moving image A thumbnail image creating unit, a moving image image data, a recording unit that records the image data of the thumbnail image on a recording medium, and a reduction in a transfer rate of the recording unit to the recording medium. And a control unit for stopping the recording of the data on the recording medium.

  The invention of claim 10 is applied to an image processing method to acquire image data of moving images, and to acquire image data of thumbnail images for each predetermined picture from the image data of moving images. A thumbnail image creation step to be created, a recording step of recording the image data of the moving image and the image data of the thumbnail image on a recording medium, and a decrease in a transfer rate to the recording medium in the recording step. And a step of controlling to stop recording the image data of the thumbnail image on the recording medium.

  The invention of claim 11 is applied to a program of an image processing method to acquire image data of moving images, and an image of thumbnail images for each predetermined picture from the moving image image data. A thumbnail image creating step for creating data, a recording step for recording the image data of the moving image and the image data of the thumbnail image on a recording medium, and a decrease in a transfer rate to the recording medium in the recording step And a step of controlling to stop recording the image data of the thumbnail image on the recording medium.

The invention of claim 12, there is provided a recording medium recording a program for images processing method that records the image data of a moving image on a recording medium, a program of the image processing method, image data of the moving image An image data acquisition step, a thumbnail image creation step of creating image data of a thumbnail image for each predetermined picture from the image data of the moving image, an image data of the moving image, and an image of the thumbnail image A recording step of recording data on the recording medium, and a control step of stopping recording of the image data of the thumbnail image on the recording medium due to a decrease in a transfer rate to the recording medium in the recording step. Like that.

  The invention according to claim 13 is applied to an image processing apparatus, and an image data acquisition unit that acquires image data of a moving image and image data of a thumbnail image for each predetermined picture of the image data of the moving image; A thumbnail image creation unit that creates image data of a thumbnail image for each picture from the image data of the moving image, a recording medium that stores the image data of the moving image and the image data of the thumbnail image acquired by the image data acquisition unit And a recording unit for recording the thumbnail image to the image data of the moving image is detected, and image data of the thumbnail image created by the thumbnail image creation unit is allocated to a location where the thumbnail image is missing Then, the image data of the moving image and the image data of the thumbnail image are recorded.

  The invention of claim 14 is applied to an image processing method to obtain image data of a moving image and image data acquisition step of acquiring image data of a thumbnail image for each predetermined picture of the image data of the moving image, A thumbnail image creating step for creating image data of a thumbnail image for each picture from the image data of a moving image, the moving image image data acquired in the image data acquiring step, and the image data of the thumbnail image are recorded on the recording medium A recording step of recording the thumbnail image to the moving image image data, and allocating the thumbnail image data created in the thumbnail image creation step to a location where the thumbnail image is missing. The image data of the moving image and the image data of the thumbnail image are recorded

  The invention of claim 15 is applied to a program for an image processing method to obtain image data of a moving image and image data acquisition step of acquiring image data of a thumbnail image for each predetermined picture of the image data of the moving image. A thumbnail image creating step for creating thumbnail image image data for each picture from the moving image image data, and the moving image image data and the thumbnail image image data obtained in the image data obtaining step. A recording step of recording on a recording medium, detecting missing of the thumbnail image with respect to the image data of the moving image, and image data of the thumbnail image created in the thumbnail image creating step at a location where the thumbnail image is missing Assigned to the image data of the moving image and the image data of the thumbnail image. The record.

The invention of claim 16, there is provided a recording medium recording a program for images processing method that records the image data of a moving image on a recording medium, the image data of the moving image, the image data of the moving image An image data acquisition step for acquiring image data of a thumbnail image for each predetermined picture, a thumbnail image generation step for generating image data of a thumbnail image for each picture from the image data of the moving image, and the image data A recording step of recording the image data of the moving image acquired in the acquiring step and the image data of the thumbnail image on a recording medium, and detecting the lack of the thumbnail image with respect to the image data of the moving image, The image data of the thumbnail image created in the thumbnail image creation step is assigned to the missing part. Te, and records the image data of the image data and the thumbnail image of the moving image.

  According to the configuration of claim 1, claim 2, claim 10, claim 11 or claim 12, when it becomes difficult to record both moving images and thumbnail images due to a decrease in the transfer rate to the recording medium. However, recording of moving images can be continued, and moving images can be reliably recorded even when the transfer rate to the recording medium temporarily decreases.

  According to the structure of claim 13, claim 14, claim 15, or claim 16, the structure of claim 1, claim 2, claim 10, claim 11, or claim 12 temporarily The image data of the missing thumbnail image can be supplemented for the recording medium in which the recording of the thumbnail image is stopped.

  According to the present invention, when a thumbnail image for cueing is recorded on a recording medium, a moving image can be reliably recorded even when the transfer rate to the recording medium is temporarily reduced.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate.

(1) Configuration of Embodiment FIG. 2 is a block diagram showing a digital video camera according to an embodiment of the present invention. In the digital video camera 1, the photographing unit 2 includes a CCD (Charge Coupled Device) solid-state imaging device, a CMOS (Complementary Metal-Oxide Semiconductor) solid-state imaging device, and the like. The photographing unit 2 performs photoelectric conversion processing on an optical image formed on the imaging surface by a lens unit (not shown) when capturing a moving image, and generates an imaging signal that is a result of the photoelectric conversion processing. The digital video camera 1 performs analog-digital conversion processing on the imaging signal to generate moving image data D1. The moving image input data (moving image) is subjected to white balance adjustment, gamma correction, and the like. Image input IF) 3.

  The voice conversion unit 4 performs an analog-digital conversion process on a voice signal acquired by a microphone (not shown) at the time of shooting a moving image to generate voice data D2, and this voice data D2 is sent to a voice input interface (voice input IF) 5. Output.

  The moving image input interface 3 and the audio input interface 5 output the moving image image data D1 and the audio data D2 that are sequentially input to the buffer memory 6 when the moving image is captured.

  The monitor unit 7 acquires the image data D1 output from the imaging unit 2 via the buffer memory 6 when capturing a moving image, and displays it on a display such as a liquid crystal display panel. Also, the audio data D2 output from the audio conversion unit 4 is acquired via the buffer memory 6, converted into an audio signal, and output to the earphone. Further, when reproducing a moving image, the image data D3 output from the moving image decompression unit 9 is acquired and displayed via the buffer memory 6. Also, the audio data D4 is acquired from the audio expansion unit 10 via the buffer memory 6, converted into an audio signal, and output to the earphone. On the other hand, at the time of editing or the like, the monitor unit 7 displays an editing screen or the like by displaying the image data generated by the microcomputer 11 via the buffer memory 6. Further, the image data D5 of the still image output from the still image expansion unit 12 is acquired via the buffer memory 6 and displayed on the editing screen or the like.

  The buffer memory 6 includes image data D1 and audio data D2 output from the moving image input interface 3 and audio input interface 5, moving image expansion unit 9, still image expansion unit 12, and image data D3 output from the audio expansion unit 10. , D5, and audio data D4 are temporarily stored and output to each unit.

  When recording a moving image, the moving image compression unit 13 acquires the image data D1 output from the photographing unit 2 via the buffer memory 6, compresses the data using MPEG, and outputs encoded data D6. Here, as shown in FIG. 3, the moving image compression unit 13 forms one GOP with 15 frames, sets the first frame of each GOP to an I picture, and generates encoded data D6.

  The audio compression unit 15 acquires the audio data D2 output from the audio conversion unit 4 via the buffer memory 6 when recording a moving image, and compresses the audio data D2 using AC3 (Audio Code Number 3). The encoded data D7 is output.

  The multiplexer / demultiplexer 16 performs time-division multiplexing processing of the encoded data D6 output from the moving image compression unit 13 and the encoded data D7 output from the audio compression unit 15 when recording a moving image, The video stream data D8 is output.

  Further, the multiplexer / demultiplexer 16 separates the moving picture stream data D9 output from the buffer memory 17 into the encoded data D10 of the moving picture and the encoded data D11 of the audio data when reproducing the moving picture. The video is output to the moving image expansion unit 9 and the audio expansion unit 10.

  The moving image decompression unit 9 decompresses the moving image encoded data D10 output from the multiplexer / demultiplexer 16 to decode the moving image image data D3, and stores the moving image image data D3 in the buffer memory 6. Output. The audio decompression unit 10 decompresses the encoded data D11 of the audio data output from the multiplexer / demultiplexer 16, decodes the audio data D4, and outputs the audio data D4 to the buffer memory 6.

  When the user instructs to create a thumbnail image under the control of the microcomputer 11, the pixel number conversion unit 19 uses a built-in extraction unit 19 </ b> A to record a moving image for each predetermined picture when recording a moving image. Image data D1 is acquired. Further, the image data D1 acquired by the extraction unit 19A is thinned out by pixel to generate image data D13 of a thumbnail image. In addition, in the complementing process to be described later, the image data D13 of the thumbnail image is generated in the same manner under the control of the microcomputer 11.

  Here, in this embodiment, as shown in FIGS. 3A and 3B, the picture acquired by the extraction unit 19A is set to the I picture of the image data D1. Accordingly, the pixel number conversion unit 19 selectively acquires the image data D1 of the first picture of each GOP and creates a thumbnail image for each GOP. The picture for creating the thumbnail image is not limited to the I picture, and may be created from the P picture and the B picture. Further, a plurality of pictures may be selected from one GOP to create thumbnail images, or one thumbnail image may be created for each of the plurality of pictures.

  The still image compression unit 20 compresses the image data D13 of the thumbnail image by a predetermined encoding method, and outputs the encoded data D14 of the thumbnail image to the buffer memory 17. In this embodiment, JPEG (Joint Photographic Coding Experts Group) is applied to this encoding method. Hereinafter, the encoded data D14 of the thumbnail image is appropriately referred to as thumbnail data.

  The still image decompression unit 12 receives the thumbnail data D15 from the buffer memory 17 during editing or the like, decompresses the thumbnail data D15, and outputs the thumbnail data D15 to the buffer memory 6.

  The buffer memory 17 temporarily stores moving image stream data D8 output from the multiplexer / demultiplexer 16 and various data output from the microcomputer 11 when recording moving images, and outputs the data to the drive 21 in a predetermined format. . When the user instructs to record thumbnail images, the encoded data D14 output from the still image compression unit 20 is output to the drive 21 in a predetermined format.

  In this embodiment, a QT (Quick Time) file format is applied to the predetermined format. Here, the QT file format is a multimedia-compatible file format in which a plurality of resources can be played back in synchronization, and has a hierarchical block structure. As shown in FIG. 4, the QT file format file is formed by a movie data atom that stores image data, audio data, and the like, which are resources, and a movie atom that stores management data of this resource. Each resource is assigned to a movie data atom as a track, and each track is formed by being divided by a predetermined amount of samples. A movie atom is created in a hierarchical structure corresponding to the movie data atom, and a management table storing management data of each sample is provided in the lowest layer in the hierarchical structure. In the movie atom, a track based on this management table is provided for each resource. In the QT file format, an external reference format in which all or part of the resource is a separate file is permitted by referring to a movie data atom held in a file of another QT file format. In this case, the movie atom In some cases, it may be constituted only by.

  Accordingly, when the user does not instruct to record the thumbnail image, the buffer memory 17 forms a moving image stream track by using the moving image stream data D8 output from the multiplexer 16 at the time of moving image recording. Is output to the drive 21. If the user has instructed the creation of a thumbnail image, the moving image stream data D8 and the thumbnail data D14 form a moving image stream track and a thumbnail track, respectively. Movie data atom data based on the thumbnail track is output to the drive 21. In addition, in the video stream track, the video stream for one frame is assigned to one sample, and in the thumbnail track, one thumbnail image is assigned to one sample. When the recording of the movie data atom is completed, the movie atom data held in the microcomputer 11 is input and output to the drive 21. Instead of the track of the moving image stream, a track based on the encoded data D6 of the moving image and a track based on the encoded data D7 of the audio data may be formed.

  On the other hand, during reproduction, the buffer memory 17 outputs the data output from the drive 21 to the multiplexer / demultiplexer 16, the still image decompression unit 12, and the microcomputer 11.

  Under the control of the microcomputer 11, the drive 21 sequentially records the output data of the buffer memory 17 on the disk 22, and sequentially reproduces and outputs the file data designated by the microcomputer 11 from the disk 22. Here, the disk 22 is a hard disk.

  When recording on the disk 22, the drive 21 inputs data from the buffer memory 17 in cluster units under the control of the microcomputer 11, and when recording on one cluster is completed, the data of the subsequent cluster is transferred from the buffer memory 17. input. Further, read after write processing is executed for each cluster, and if the error rate has deteriorated to a certain value or more, retry processing is executed. Further, even if the retry is repeated a predetermined number of times, a cluster whose error rate has deteriorated to a certain value or more is set as a defective area, and a substitute process is executed. The impact on the digital video camera 1 is monitored by an acceleration sensor (not shown). When the acceleration detected by the acceleration sensor exceeds a certain value, recording on the disk 22 is immediately interrupted and the head is retracted to a predetermined position. Let Thereafter, when the acceleration falls below a certain value, recording on the disk 22 is resumed.

  The digital video camera 1 configures a moving image recording system indicated by reference numeral 32 in FIG. 5 by the configuration from the photographing unit 2 to the disk 22. A thumbnail image recording system indicated by reference numeral 33 is also configured. In addition, a moving image playback system indicated by reference numeral 34 in FIG. 6 is configured, and further, a thumbnail image playback system indicated by reference numeral 35 is configured.

  The mode dial 24 is a rotary operator that sets the operation mode of the digital video camera 1, and the digital video camera 1 instructs the user whether or not to record a thumbnail image by rotating the mode dial 24. Accept.

  The operation element 25 is an operation element such as a trigger switch for instructing recording start and recording end. The disk 26 is a hard disk device that stores a processing program of the microcomputer 11 and various data used for the processing of the microcomputer 11. Note that various recording media such as an optical disk and a memory may be applied instead of the hard disk device. The drive 27 is an interface of the disk 26. Here, in this embodiment, the program of the microcomputer 11 is provided by being installed in advance on the disk 26. However, in place of provision by such prior installation, recording on an optical disk, a magnetic disk, a memory card, etc. It may be provided by being recorded on a medium, or may be provided by downloading via a network such as the Internet.

  The microcomputer 11 is a computer that controls the operation of each part of the digital video camera 1 and executes a program stored in the disk 26 in response to the operation of the operation unit 25, the mode dial 24, etc. The operation of each part is controlled in response to the operation.

  That is, the microcomputer 11 acquires the image data D1 and the audio data D2 by the imaging unit 2 and the audio conversion unit 4 when the user instructs the imaging, and monitors the image data D1 and the audio data D2 via the buffer memory 6. Output to unit 7.

  In this state, when the user operates the trigger switch to instruct recording, the microcomputer 11 causes the moving image recording unit 32 (FIG. 5) to process the moving image in units of clusters by the data communication with the drive 21. The stream data D8 is recorded on the disk 22. Also, movie atoms are recorded on the disk 26 and sequentially updated, and when the user operates the trigger switch to stop recording, the moving image recording system 32 is instructed to stop operation. Thereafter, when the user instructs to stop shooting, the data of the movie atom recorded on the disk 26 is output to the buffer memory 17 so as to correspond to the movie data atom based on the image data D1 and audio data D2 recorded so far. The movie atom is recorded on the disk 22. In this case, the management data of the movie atom includes the format of the video stream, position information for specifying the start position of each sample by the offset value from the start of the file, the data amount of each sample, the playback time information of the moving image of each sample, etc. Consists of.

  On the other hand, when the user has instructed the creation of a thumbnail image, the microcomputer 11 records the moving picture stream data D8 on the disk 22 and records the thumbnail image recording system 33 (FIG. Thumbnail data is created and recorded on the disk 22 by the process of 5).

  At this time, the processing procedure shown in FIG. 1 is executed, and the video stream data D8 and the thumbnail data D14 are alternately recorded on the disk 22. If the data transfer speed to the disk 22 is temporarily reduced, the thumbnail is displayed. Recording of data D14 is stopped.

  That is, when the user instructs the start of recording, the microcomputer 11 starts this processing procedure and proceeds from step SP1 to step SP2. Here, the microcomputer 11 determines whether or not the data amount of the moving image stream held in the buffer memory 17 is equal to or greater than the recording start threshold value.

  If a negative result is obtained here, the microcomputer 11 repeats step SP2 and waits until the data amount of the moving image stream becomes equal to or greater than the recording start threshold. When the data amount of the moving image stream is equal to or greater than the recording start threshold value, the process proceeds from step SP2 to step SP3, and the moving image stream data D8 stored in the buffer memory 17 is transferred to the drive 21 and recorded for one cluster. When the drive 21 is notified of the completion of recording, the process proceeds to step SP4.

  In step SP4, the microcomputer 11 determines whether the moving picture stream data D8 has been stored up to the end of the stream unit. Here, the stream unit is a data section corresponding to one thumbnail image in the video stream data D8. Therefore, in this embodiment, one stream unit is data for 1 GOP.

  If a negative result is obtained here, the microcomputer 11 proceeds from step SP4 to step SP5, and determines whether or not the data amount of the moving image stream in the buffer memory 17 is less than one cluster. If a negative result is obtained here, the microcomputer 11 returns from step SP5 to step SP3.

  On the other hand, if a positive result is obtained in step SP5, the microcomputer 11 returns from step SP5 to step SP2. By repeating the processing from step SP2 to step SP5, the microcomputer 11 records the moving image stream data D8 on the disk 22 in units of clusters every time the data amount exceeds a certain value. Also, a movie atom is constructed on the disc 26, and this movie atom is recorded on the disc 22 when the photographing is completed.

  When the microcomputer 11 records the video stream data D8 for 1 GOP by repeating the processing from step SP2 to step SP5, an affirmative result is obtained in step SP4, and the process proceeds from step SP4 to step SP6. Here, the microcomputer 11 determines whether or not the immediately preceding peak value of the data amount of the moving image stream in the buffer memory 17 is equal to or greater than the thumbnail recording stop threshold value. Here, the thumbnail recording stop threshold value is a determination reference value for the thumbnail image recording stop processing, and is set to a value larger than the recording start threshold value in step SP2. The thumbnail image recording stop process is a process for omitting recording of thumbnail data on the disk 22.

  If a negative result is obtained here, the microcomputer 11 proceeds from step SP6 to step SP7, executes a thumbnail image recording process, and then proceeds to step SP5. On the other hand, if a positive result is obtained in step SP6, the microcomputer 11 executes the thumbnail recording stop process, and then proceeds to step SP8.

  FIG. 7 is a flowchart showing the thumbnail recording process. When starting this processing procedure, the microcomputer 11 proceeds from step SP11 to step SP12, and determines whether or not the thumbnail data D14 has been accumulated in the buffer memory 17 by a predetermined amount or more.

  If a negative result is obtained here, the microcomputer 11 proceeds from step SP12 to step SP13 and returns to the original processing procedure.

  On the other hand, if a positive result is obtained in step SP12, the microcomputer 11 proceeds from step SP12 to step SP14. Here, the microcomputer 11 selects a track storing the management data of the thumbnail track from the movie atom recorded on the disk 26, and selects a management table corresponding to the recording of the thumbnail data D14 in step SP16 from this track. The microcomputer 11 sets identification information indicating that the management data recorded in the management table is valid in the selected management table.

  Subsequently, the process proceeds to step SP15, where padding processing is performed on the 1-sample thumbnail data D14 stored in the buffer memory 17 so that the 1-sample thumbnail data D14 has a predetermined data amount.

  In step SP16, the padded one sample thumbnail data D14 is output to the drive 21 and recorded on the disk 22. In the subsequent step SP17, the management data of the thumbnail data is set in the sample management table that is effectively set in step SP14 so as to correspond to the recording of one sample. Here, the management data includes the format of the corresponding data recorded in the thumbnail track, position information (address) for specifying the start position of the corresponding sample by the offset value from the start of the file, and the data amount (size) of the corresponding sample. , Reproduction time information, GOP frame information for specifying a generation source frame in a moving picture stream, and the like.

  Subsequently, the microcomputer 11 proceeds to step SP18 and determines whether or not the thumbnail data D14 of all the samples stored in the buffer memory 17 has been recorded. If a negative result is obtained here, the microcomputer 11 returns to step SP14. On the other hand, if a positive result is obtained in step SP18, the process proceeds from step SP18 to step SP13, and the process returns to the original processing procedure. By executing the processing procedure of FIG. 7, the microcomputer 11 records the corresponding thumbnail data D14 on the disk 22 every time a moving image stream is recorded on the disk 22 by 1 GOP. Further, the movie atom held in the disk 26 is updated so as to correspond to the recording of the thumbnail data D14, and when shooting is finished, the movie atom held in the disk 26 is recorded in the disk 22.

  On the other hand, FIG. 8 is a flowchart showing the thumbnail recording stop processing. When starting this processing procedure, the microcomputer 11 proceeds from step SP21 to step SP22. Here, the microcomputer 11 selects a track storing the management data of the thumbnail track from the movie atoms recorded on the disk 26, and identifies that there is an empty slot in which no thumbnail image is recorded in the header of this track. Set the information. If this identification information has already been set, the microcomputer 11 omits the process of step SP22.

  Subsequently, the microcomputer 11 proceeds to step SP23, selects a sample management table corresponding to the thumbnail data to be recorded next from the track of the movie atom selected in step SP22, and the management data recorded in this management table is stored. Identification information indicating invalidity is set in this management table.

  Subsequently, the microcomputer 11 proceeds to step SP24 and discards the encoded data D14 of one sample stored in the buffer memory 17. Further, under the control of the drive 21, an empty area corresponding to the maximum data amount of one sample is formed at the end of the thumbnail track recorded on the disk 22 so as to deal with this discard, and an empty slot by this empty area is defined as a thumbnail track. To form. In this embodiment, as described above in step SP25, since the padding is performed so as to have a constant data amount, the free area in step SP24 is a free area having a constant data amount by the padding process. is there.

  Subsequently, the microcomputer 11 proceeds to step SP25, and sets the thumbnail image management data in the management table set to invalid in step SP23 so as to correspond to the empty slot for one sample. Here, the management data includes the format of the corresponding data recorded in the thumbnail track, position information (address) that specifies the start position of the corresponding empty slot by the offset value from the start of the file, the size of this slot, This is reproduction time information and GOP frame information of thumbnail data originally allocated.

  Subsequently, the microcomputer 11 proceeds to step SP26 and determines whether or not the thumbnail data D14 of all the samples stored in the buffer memory 17 has been recorded. If a negative result is obtained here, the microcomputer 11 returns to step SP23. On the other hand, when a positive result is obtained in step SP26, the process proceeds from step SP26 to step SP27 and returns to the original processing procedure. When the data transfer speed to the disk 22 is temporarily reduced by the execution of the processing procedure of FIG. 8, the microcomputer 11 stops recording the thumbnail data D14 on the disk 22 and gives priority to the video stream. Record. In addition, an empty slot is set in the thumbnail track, and management data is set so that thumbnail data D14 can be separately created and re-recorded by thumbnail complement processing described later.

  FIG. 9 is a time chart showing the time change of the data amount of the buffer memory 17 by the processing of FIGS. In FIG. 9, when recording is started at time t0, the video stream data D8 (FIG. 9A) and thumbnail data D14 (FIG. 9B) are gradually stored in the buffer memory 17 to increase the amount of data. When the data amount of the moving image stream reaches the recording start threshold at time t1, recording of the moving image stream is started, and the data amount of the moving image stream in the buffer memory 17 gradually decreases.

  When the recording of one stream unit is completed at time t2, the recording of the video stream data D8 is stopped and the recording of the thumbnail data D14 is started. When the recording of the thumbnail data D14 is completed at time t3, and the data amount of the moving image stream stored in the buffer memory 17 at this time is equal to or less than one cluster, the data amount of the moving image stream stored in the buffer memory 17 is Wait until it reaches a certain amount. Accordingly, when the data amount of the moving image stream and the thumbnail data in the buffer memory 17 gradually increases from the time point t3, and when the data amount of the moving image stream exceeds the recording start threshold at the subsequent time point t4, the recording of the moving image stream is started, As shown, the data amount of the moving image stream in the buffer memory 17 gradually decreases.

  However, if recording to the disk 22 becomes difficult from time t4 due to, for example, the withdrawal of the head, an extra video stream is stored in the buffer memory 17 until recording to the disk 22 becomes possible at time t5. This may occur when the data amount of the moving image stream is equal to or greater than the threshold value for stopping thumbnail recording.

  In this case, in this embodiment, after recording the moving image stream at time t5, when recording of the moving image stream is completed at time t7, an empty area is set in the thumbnail track and the corresponding thumbnail data is discarded. In this case, the data amount of the thumbnail data in the buffer memory 17 is drastically reduced, and even when the data transfer speed to the recording medium is temporarily reduced, the moving image stream is surely recorded. Is possible.

  Specifically, for example, when the image size of one frame of the moving image stream is 640 × 480 and the image size of the thumbnail image is 640 × 480, the moving image stream and the thumbnail data are transferred to the drive 21 by the cancellation processing in FIG. Compared to the above, the amount of data to be transferred can be reduced by about 7 [%] (1/15), and a margin for a temporary decrease in the data transfer speed to the recording medium can be secured.

  On the other hand, when the user instructs the reproduction of the file, the microcomputer 11 reproduces the file designated by the user from the disk 22, processes it by the audio decompression unit 10 and the moving image decompression unit 9, and displays it on the monitor unit 7. To do. At this time, when the user instructs display of the thumbnail image, the thumbnail data of the file instructed to be reproduced by the user is sequentially reproduced from the disk 22, processed by the still image decompression unit 12, and displayed as a list on the monitor unit 7. Further, in this list display, when the user selects any thumbnail image, based on the GOP frame information set in the thumbnail image management table, a video stream is reproduced from the corresponding frame and displayed on the monitor unit 7. .

  FIG. 10 is a flowchart showing a complementing process for recording the corresponding thumbnail data D14 in the empty slot created by the thumbnail recording stop process of FIG. When the user instructs the reproduction of the file recorded on the disk 22, the microcomputer 11 executes this processing procedure in the background while reproducing this file in response to the user's operation. Note that, in the thumbnail image list display described above, the microcomputer 11 displays thumbnail images in a list at intervals where the supplement processing shown in FIG. 10 is not in time. If thumbnail images are created by this complement processing, the created thumbnail images are added and displayed as a list.

  That is, when starting the processing procedure, the microcomputer 11 proceeds from step SP31 to step SP32. Here, the microcomputer 11 determines whether or not the operation mode of the digital video camera 1 has changed to the reproduction mode by the operation of the operator by the user. If a negative result is obtained here, the digital video camera 1 moves from step SP32 to step SP33 and ends this processing procedure.

  On the other hand, if a positive result is obtained in step SP32, the microcomputer 11 proceeds from step SP32 to step SP34. Here, the microcomputer 11 determines whether or not the file instructed to be reproduced by the user is a file to which a thumbnail image is not partially assigned, that is, whether or not the file has created an empty slot by the thumbnail recording stop processing of FIG. . Specifically, a track storing thumbnail track management data is detected from the movie atom of the file to be reproduced. Further, the contents of the header set for this track are determined, and identification information indicating that there is an empty slot that does not record the thumbnail image set in step SP22 of FIG. It is determined whether the file has not been opened.

  If all thumbnail images are assigned to the file to be played back, the microcomputer 11 moves from step SP34 to step SP33 and ends this processing procedure. On the other hand, when the file to be reproduced is a file to which a part of the thumbnail image is not allocated, the microcomputer 11 proceeds to step SP35.

  In step SP35, the management table of the thumbnail track provided in the movie atom of the file to be reproduced is sequentially searched, and the management table invalidated in step SP23 of FIG. 8 is detected. Based on the detection result, the microcomputer 11 determines whether all the management tables set to invalid are processed. If a negative result is obtained here, the microcomputer 11 proceeds from step SP35 to step SP36, and sets one of the management tables detected in step SP35 as a processing target.

  Subsequently, the microcomputer 11 proceeds to step SP37, and acquires GOP frame information set in the management table to be processed. In the following step SP38, the drive 21 is instructed to reproduce the corresponding GOP from the disc 22 based on the GOP frame information acquired in step SP37. Further, as shown in FIG. 11, the processing of the moving picture stream reproduced by this instruction is instructed to the multiplexer 16 and the moving image decompression unit 9, and the reproduced I picture image data D3 of the GOP is stored in the buffer memory 6.

  In subsequent step SP39, the image data of the thumbnail image is created from the image data D3 stored in the buffer memory 6 under the control of the pixel number conversion unit 19, and the still image compression unit 20 performs the data compression process. When the microcomputer 11 stores the thumbnail data D14 output from the still image compression unit 20 in the buffer memory 17, the microcomputer 11 updates the movie atom recorded on the disk 22 in the subsequent step SP40. By updating the movie atom, the microcomputer 11 sets the management table to be processed as valid, and updates the management data stored in the management table so as to correspond to the thumbnail data D14 stored in the buffer memory 17.

  In the following step SP41, the microcomputer 11 outputs the thumbnail data D14 held in the buffer memory 17 to the drive 21 and records the encoded data D14 in the free area corresponding to the management table that is set to be effective in step SP40. . Thereafter, the microcomputer 11 returns to step SP35.

  On the other hand, if an affirmative result is obtained in step SP35, the process proceeds from step SP36 to step SP42, where identification information indicating that there is an empty slot set so far in the header of the track to be processed is displayed. After changing to the identification information indicating that it does not exist, the process proceeds to step SP33.

  On the other hand, when the user instructs an editing process, the microcomputer 11 displays an editing screen on the monitor unit 7, reproduces thumbnail data from the QT file selected by the user, and displays the thumbnail data on the editing screen. . In addition, the thumbnail data is reproduced in response to a user operation, and the thumbnail image on the editing screen is switched. The editing point setting is received from the user, and the QT file recorded on the disk 22 is edited.

(2) Operation of Embodiment In the above configuration, in the digital video camera 1 (FIG. 2), the image data D1 and the sound data D2 of the moving image acquired by the photographing unit 2 and the sound converting unit 4 are displayed on the monitor unit 7. Monitored. When the user instructs to record a moving image, the image data D1 and audio data D2 are subjected to data compression processing by the moving image compression unit 13 and audio compression unit 15, and then time division multiplexed by the multiplexer / demultiplexer 16. A moving image stream is generated. The moving image stream is recorded on the disk 22 via the buffer memory 17 and the drive 21.

  Further, at the time of recording this moving image, the pixel number conversion unit 19 generates moving image image data D1 by thinning out the pixels for each predetermined picture to generate a cueing thumbnail image. The data is compressed by the still image compression unit 20 and then recorded on the disk 22 via the drive 21.

  Therefore, in this digital video camera 1, the cueing thumbnail data is recorded on the disk 22 simultaneously with the moving image stream, and the amount of data recorded on the disk 22 is smaller than when only the moving image stream is recorded. Will increase.

  On the other hand, in the digital video camera 1, it is predicted that the remaining amount of the battery is reduced and the power supply voltage to the integrated circuit constituting the drive 21 is lowered. In this case, the transfer rate to the disk 22 is It is expected to decline. The drive 21 detects an impact by an acceleration sensor and retracts the head to prevent the disk 22 from being damaged. When the head is retracted in this way, the transfer rate to the disk 22 is temporarily set. Will be reduced. In the drive 21, write retry may be performed. In this case, the transfer rate to the disk 22 is temporarily lowered.

  When the transfer rate to the disk 22 decreases in this way, if the moving image stream and thumbnail data are recorded on the disk 22 as before, the recording of the moving image stream and thumbnail data will not be in time. Eventually, the buffer memory 17 overflows, and the moving image stream and thumbnail data cannot be recorded.

  Therefore, the digital video camera 1 monitors the amount of data in the buffer memory 17 (FIGS. 1 and 9), and discards the thumbnail data stored in the buffer memory 17 when the amount of data increases beyond a certain reference value. Then, the recording of the thumbnail data on the disk 22 is stopped (FIGS. 7 and 8). As a result of the discarding and canceling processing, the digital video camera 1 preferentially records the moving image stream when the transfer rate to the disk 22 decreases and the moving image stream and thumbnail data cannot be recorded in time. , You can shoot without leaking precious scenes.

  In addition, after the video file is recorded, the supplement processing is performed (FIG. 10), and the thumbnail data is discarded and the recording is stopped, and the thumbnail data is created and recorded again, so that the transfer rate is temporarily lowered. Even when only a video stream is recorded, a thumbnail image for cueing can be recorded and held on the disc 22 and a desired scene can be quickly cued using this cueing thumbnail image. Thus, the efficiency of editing processing and the like can be improved.

  In the digital video camera 1, in order to expedite this complementing process, when the thumbnail data is discarded and the recording is stopped, an empty slot is originally formed by forming an empty area at the position where the thumbnail data is recorded. At the same time, GOP frame information specifying the corresponding frame of the moving picture stream and identification information indicating that the management data is invalid are set in the management data.

  Therefore, in the complementing process, it is possible to re-record only the empty area and record the thumbnail data, thereby simplifying the complementing process.

  In addition, in the supplement processing, it is possible to specify the location where the recording of the thumbnail data was stopped by simply searching the management data of the thumbnail track and searching for the identification information indicating that the management data is invalid. Complementary processing can be executed quickly.

  Also, the corresponding frame can be specified by the GOP frame information, and a moving picture stream is selectively reproduced according to the GOP frame information to generate thumbnail data, which is then re-recorded on the disc 22 to perform the complementary processing quickly. be able to.

  In the digital video camera 1, when the thumbnail data is discarded and the recording is stopped, identification information is set in the header in the track of the movie atom that manages the thumbnail data. Therefore, in the digital video camera 1, it is possible to easily determine whether or not the file needs to be complemented based on the recording of the header, and a series of processes related to the complementing process can be simplified.

  In the digital video camera 1, when the user instructs the reproduction of the file, this complementing process is executed in the background. Therefore, for example, by using the image data of the moving image reproduced from the disk 22 for creating the thumbnail data, it is possible to omit the process of separately reproducing the moving image stream from the disk 22 for creating the thumbnail data. Can be simplified.

(3) Advantages of the embodiment According to the above configuration, the thumbnail image recording is stopped by stopping the recording of the thumbnail image due to a decrease in the transfer rate to the recording medium, and only the moving image is recorded. In the case of recording in a moving image, it is possible to reliably record a moving image even when the transfer rate to the recording medium temporarily decreases.

  In addition, when a moving image is played back from a recording medium by a complementing process to create a thumbnail image and recorded at a location where recording to the recording medium is stopped, the transfer rate is temporarily reduced to record only a video stream Even in this case, a thumbnail image for cueing can be recorded and held, and a desired scene can be quickly cueed using the thumbnail image for cueing.

  In addition, by forming an empty area at the location where the thumbnail image recording was stopped, in the complement processing, it is possible to re-record only the location of the empty area and record the thumbnail image, thereby simplifying the complement processing. Can do.

  In addition, management data is provided for each thumbnail image and free area, and by setting identification information indicating whether or not it is a free area in this management data, a place where it is necessary to quickly record a thumbnail image is provided. It can be detected and complemented, and the complementing can be performed quickly.

  In addition, by setting information for specifying a corresponding moving image frame in the management data, it is possible to quickly find a head and to quickly perform a complementary process.

  In the digital video camera of this embodiment, the first operation mode for recording the moving picture stream and the thumbnail data in the QT file format in the same manner as described above for the first embodiment, and the second operation mode for recording only the moving image stream in the QT file format. The operation mode is switched according to the user's operation. In this embodiment, the configuration is the same as that of the digital video camera 1 of Embodiment 1 except that the configuration relating to the second operation mode is different.

  In this digital video camera, in this second operation mode, all thumbnail tracks are set as empty slots and movie data atoms are recorded. In the same manner as in the case of setting an empty slot in the first embodiment, a corresponding movie atom is created and recorded.

  In addition, the file recorded in the second operation mode is sequentially played back in the idle time after the recording is completed to generate thumbnail data, the thumbnail data is recorded on the recording medium, and the complementary process is executed.

  In this embodiment, even when the transfer rate to the recording medium is reduced by stopping the recording of all thumbnail images in the second operation mode, the moving image can be recorded more reliably.

  In the digital video camera of this embodiment, the data compression rate in the moving image compression unit 13 is switched by switching the operation mode by the user, and the image quality is relatively high compared with the normal image quality mode and the normal image quality mode. Record video with mode. In this embodiment, the configuration is the same as that of the digital video camera 1 of Embodiment 1 except that the configuration relating to this operation mode is different. Accordingly, in the same manner as in the first embodiment, in the normal image quality mode and the high image quality mode, the recording of the thumbnail image is stopped due to the decrease in the transfer rate to the recording medium, and the moving image is preferentially recorded.

  In the digital video camera of this embodiment, pixel thinning in the pixel number conversion unit 19 is switched according to the operation mode, and the image size of the thumbnail image is reduced in the high image quality mode compared to the normal image quality mode. Therefore, in this case, when the data amount of the moving image increases due to the high image quality mode, the thumbnail data is recorded with a small amount of data, the moving image transfer rate is ensured, and the quality of the moving image is stabilized and improved.

  In the case of recording in the high image quality mode, after the thumbnail data is recorded, an empty area is provided, and the same area as in the case of recording in the normal image quality mode is assigned to each thumbnail data to form a thumbnail track. Also, identification information of thumbnail data in the high image quality mode and thumbnail data in the normal image quality mode is set in the management table of each sample.

  For the QT file recorded in the normal image quality mode, the complementary process is executed in the same manner as in the first embodiment.

  On the other hand, for a QT file recorded in the high image quality mode, all the thumbnail tracks are set as complementing targets, a moving image is reproduced to generate a thumbnail image in the normal image quality mode, and the thumbnail data of the thumbnail image is stored on the disc. Record in 22.

  According to this embodiment, by recording thumbnail images with a small image size in the high image quality mode, the transfer rate of moving images can be ensured, and the quality of moving images can be further stabilized and improved.

  Further, by replacing a thumbnail image recorded with a small image size with a thumbnail image with a large image size, the image quality of the thumbnail image can be improved.

  In the digital video camera of this embodiment, the switching of the image size of the thumbnail image created in the pixel number conversion unit 19 is performed in combination with the canceling process described in the above-described embodiment by switching the operation mode by the user. In this embodiment, the configuration is the same as that of the above-described digital video camera except that the configuration relating to the switching of the image size is different.

  That is, in this embodiment, a reference value for image size switching with a data amount smaller than the thumbnail recording stop threshold (FIG. 9) is set, and in the determination processing (FIG. 1) in step SP6, the data amount of the video stream is set to the thumbnail recording stop. If the value is less than the threshold value or greater than the reference value for switching the image size, the image size of the thumbnail image is simply reduced to reduce the data amount of the thumbnail data. Also, identification information for identifying that the image size of the thumbnail image has been reduced is set in the corresponding management data table. When the data amount of the moving image stream is less than the thumbnail recording stop threshold and is equal to or larger than the reference value for switching the image size, all of the subsequent thumbnail images may be thumbnail images having a small image size.

  On the other hand, when the data amount of the moving image stream is equal to or larger than the thumbnail recording stop threshold value in the determination process in step SP6, the recording of thumbnail data is stopped.

  In addition, in the complementing process, a thumbnail image with a small image size is created and replaced with a thumbnail image with an original large image size based on the setting of the management data table.

  According to this embodiment, by switching the image size of the thumbnail image in combination with the cancellation process, the thumbnail image having a small image size can be used for the editing process and the reproduction process. The complement process can be omitted.

  In the digital video camera of this embodiment, the number of GOPs for creating one thumbnail image is switched instead of the image size with respect to the digital video camera of the fourth embodiment. The digital video camera of this embodiment is configured in the same way as the digital video camera of Embodiment 4 except that the configuration relating to the switching of the number of GOPs is different.

  That is, this digital video camera increases the number of GOPs for creating one thumbnail image when the data amount of the moving image stream is less than the thumbnail recording stop threshold and is equal to or larger than the reference value for switching the image size, and equivalently the data of the thumbnail data Reduce the amount. The number of GOPs for creating one thumbnail image is recorded in the corresponding management data table. If the data amount of the moving image stream is less than the thumbnail recording stop threshold and greater than or equal to the reference value for switching the image size, all of the subsequent thumbnail images may be created for each number of switched GOPs.

  On the other hand, when the data amount of the moving image stream is equal to or larger than the thumbnail recording stop threshold value in the determination process in step SP6, the recording of thumbnail data is stopped.

  In the complementing process, a thumbnail image is created and replaced based on the setting of the management data table so that one thumbnail image is assigned to one GOP.

  According to this embodiment, the switching of the number of GOPs is executed in combination with the cancellation process, and if practically sufficient, the complementary process can be omitted and the editing process and the reproduction process can be performed. The processing of the digital video camera can be simplified.

  In the above-described embodiments, the case where the hard disk is applied to the moving image recording medium has been described. However, the present invention is not limited thereto, and various recording media such as an optical disk, a memory card, and a magnetic tape can be widely applied. it can.

  Further, in the above-described embodiment, the case where the supplement processing is performed at the time of reproduction has been described. However, the present invention is not limited to this, and the supplement processing may be performed using other processing time and idle time.

  In the above-described embodiments, the case where the present invention is applied to the imaging apparatus has been described. However, the present invention is not limited to this, and for example, an image processing apparatus that performs dubbing and processing of an imaging result recorded by the imaging apparatus, and broadcasting. The present invention can be widely applied to an image processing apparatus that records and reproduces a provided program, image processing software in a computer, and the like.

  The present invention can be applied to, for example, a digital video camera.

It is a flowchart which shows the process sequence at the time of the moving image recording of the microcomputer in the digital video camera of Example 1 of this invention. It is a block diagram which shows the digital video camera of Example 1 of this invention. FIG. 3 is a schematic diagram for explaining recording of moving images in the digital video camera of FIG. 2. FIG. 3 is a schematic diagram illustrating a format of a moving image in the digital video camera of FIG. 2. FIG. 3 is a block diagram showing a configuration at the time of recording a moving image in the digital video camera of FIG. 2. FIG. 3 is a block diagram showing a configuration at the time of reproduction in the digital video camera of FIG. 2. It is a flowchart which shows the thumbnail recording process in the process sequence of FIG. It is a flowchart which shows the thumbnail recording cancellation process in the process sequence of FIG. It is a time chart which shows the displacement of the data amount by the process of FIG. It is a flowchart which shows the complementary process in the digital video camera of FIG. FIG. 3 is a block diagram illustrating a configuration at the time of complement processing in the digital video camera of FIG. 2.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Digital video camera, 2 ... Image pick-up part, 6, 17 ... Buffer memory, 7 ... Monitor part, 9 ... Moving image expansion part, 11 ... Microcomputer, 12 ... Still image expansion part, 13 ...... Moving image compression unit, 19 ... Pixel number conversion unit, 20 ... Still image compression unit, 21 ... Drive, 22, 26 ... Disc

Claims (16)

A shooting unit that acquires image data of a moving image;
A thumbnail image creation unit that creates image data of a thumbnail image for each predetermined picture from the image data of the moving image;
A recording unit that records the image data of the moving image and the image data of the thumbnail image on a recording medium;
A buffer memory for temporarily storing the image data of the moving image and the image data of the thumbnail image that the recording unit records on the recording medium;
It is determined whether the amount of image data of the moving image to be recorded on the recording medium held in the buffer memory is greater than or equal to a certain reference value, and it is determined that the amount of data is greater than or equal to the certain reference value In such a case, the imaging apparatus includes: a control unit that stops recording the image data of the thumbnail image on the recording medium on the assumption that the transfer rate of the recording unit to the recording medium is reduced. An image data acquisition unit for acquiring image data of a moving image;
A thumbnail image creation unit that creates image data of a thumbnail image for each predetermined picture from the image data of the moving image;
A recording unit that records the image data of the moving image and the image data of the thumbnail image on a recording medium;
A buffer memory for temporarily storing the image data of the moving image and the image data of the thumbnail image that the recording unit records on the recording medium;
It is determined whether the amount of image data of the moving image to be recorded on the recording medium held in the buffer memory is greater than or equal to a certain reference value, and it is determined that the amount of data is greater than or equal to the certain reference value case, as a decrease in the transfer rate to the recording medium in the recording unit is generated, the image processing apparatus and a control section for stopping the recording on the recording medium of the image data of the thumbnail image. A playback unit that plays back the image data of the moving image from the recording medium;
The thumbnail image creation unit, the recording unit,
Switch the operation under the control of the control unit to execute the complementary process,
The thumbnail image creation unit
In the complementing process, image data of the thumbnail image is created from the image data of the moving image reproduced by the reproduction unit,
The recording unit is
The image processing apparatus according to claim 2, wherein, in the complementing process, the image data of the thumbnail image created by the thumbnail image creating unit is recorded at a location where the recording of the image data of the thumbnail image on the recording medium is stopped. The recording unit is
The image processing apparatus according to claim 3, wherein an empty area is formed at a location where recording of the image data of the thumbnail image on the recording medium is stopped. The recording unit is
For each image data of the thumbnail image and the free space, management data is provided to record the image data of the thumbnail image, and the free space is formed.
The image processing apparatus according to claim 4, wherein identification information indicating whether or not the management data is a free area is set. The recording unit is
The image processing device according to claim 4, wherein information specifying a frame of image data of the corresponding moving image is set in the management data. The controller is
The image processing apparatus according to claim 2, wherein the recording of all the thumbnail images in the recording unit is stopped by switching the operation mode. The thumbnail image creation unit
The image processing apparatus according to claim 2, wherein the image size of the thumbnail image is switched under the control of the control unit. The thumbnail image creation unit
Under the control of the control unit, the image size is switched between a first image size and a second image size larger than the first image size to create image data of the thumbnail image,
The thumbnail image creation unit, the recording unit,
The operation is switched under the control of the control unit,
Creating image data of a thumbnail image of the second image size from the image data of the moving image reproduced by the reproduction unit;
The image of the second image size thumbnail image created by the thumbnail image creation unit so as to replace the image data of the thumbnail image of the first image size with the image data of the thumbnail image of the second image size. The image processing apparatus according to claim 3, wherein data is recorded on the recording medium. An image data acquisition step for acquiring image data of the moving image;
A thumbnail image creating step of creating image data of a thumbnail image for each predetermined picture from the image data of the moving image;
Recording step of recording the image data of the moving image and the image data of the thumbnail image on a recording medium;
Image data of the moving image to be recorded on the recording medium, which is held in a buffer memory for temporarily storing the image data of the moving image and the image data of the thumbnail image to be recorded on the recording medium in the recording step amount of data determined by whether more than a predetermined reference value, when the data amount is determined to be the more certain reference value, a reduction in the transfer rate to the recording medium in the step of the recording occurs And a control step of stopping recording of the image data of the thumbnail image on the recording medium. An image data acquisition step for acquiring image data of a moving image;
A thumbnail image creating step of creating image data of a thumbnail image for each predetermined picture from the image data of the moving image;
Recording step of recording the image data of the moving image and the image data of the thumbnail image on a recording medium;
Image data of the moving image to be recorded on the recording medium, which is held in a buffer memory for temporarily storing the image data of the moving image and the image data of the thumbnail image to be recorded on the recording medium in the recording step amount of data determined by whether more than a predetermined reference value, when the data amount is determined to be the more certain reference value, a reduction in the transfer rate to the recording medium in the step of the recording occurs as a step of control for stopping the recording on the recording medium of the image data of the thumbnail image,
A program that causes a computer to execute. An image data acquisition step for acquiring image data of a moving image;
A thumbnail image creating step of creating image data of a thumbnail image for each predetermined picture from the image data of the moving image;
Recording step of recording the image data of the moving image and the image data of the thumbnail image on a recording medium;
Image data of the moving image to be recorded on the recording medium, which is held in a buffer memory for temporarily storing the image data of the moving image and the image data of the thumbnail image to be recorded on the recording medium in the recording step amount of data determined by whether more than a predetermined reference value, when the data amount is determined to be the more certain reference value, a reduction in the transfer rate to the recording medium in the step of the recording occurs as a step of control for stopping the recording on the recording medium of the image data of the thumbnail image,
The computer-readable recording medium which recorded the program for making a computer perform. An image data acquisition unit that acquires image data of a moving image and image data of a thumbnail image for each predetermined picture of the image data of the moving image;
A thumbnail image creation unit that creates image data of a thumbnail image for each picture from the image data of the moving image;
A recording unit that records the image data of the moving image acquired by the image data acquisition unit and the image data of the thumbnail image on a recording medium;
Detecting a lack of the thumbnail image with respect to the image data of the moving image;
An image processing apparatus that allocates image data of the thumbnail image created by the thumbnail image creation unit to a location where the thumbnail image is missing, and records the image data of the moving image and the image data of the thumbnail image. An image data acquisition step of acquiring image data of a moving image and image data of a thumbnail image for each predetermined picture of the image data of the moving image;
A thumbnail image creating step for creating image data of a thumbnail image for each picture from the image data of the moving image;
A recording step of recording the image data of the moving image acquired in the image data acquisition step and the image data of the thumbnail image on a recording medium;
Detecting a lack of the thumbnail image with respect to the image data of the moving image;
An image processing method for allocating image data of the thumbnail image created in the thumbnail image creation step to a location where the thumbnail image is missing, and recording the image data of the moving image and the image data of the thumbnail image. An image data acquisition step of acquiring image data of a moving image and image data of a thumbnail image for each predetermined picture of the image data of the moving image;
A thumbnail image creating step for creating image data of a thumbnail image for each picture from the image data of the moving image;
A recording step of recording image data of the moving image acquired in the image data acquisition step and image data of the thumbnail image on a recording medium;
To the computer,
In the recording step,
Detecting a lack of the thumbnail image with respect to the image data of the moving image;
A program for allocating image data of the thumbnail image created in the thumbnail image creation step to a location where the thumbnail image is missing, and recording the image data of the moving image and the image data of the thumbnail image. An image data acquisition step of acquiring image data of a moving image and image data of a thumbnail image for each predetermined picture of the image data of the moving image;
A thumbnail image creating step for creating image data of a thumbnail image for each picture from the image data of the moving image;
A recording step of recording image data of the moving image acquired in the image data acquisition step and image data of the thumbnail image on a recording medium;
To the computer,
In the recording step,
Detecting a lack of the thumbnail image with respect to the image data of the moving image;
A computer-readable recording program that allocates the image data of the thumbnail image created in the thumbnail image creation step to the location where the thumbnail image is missing and records the image data of the moving image and the image data of the thumbnail image Recording medium.

Images