JP2007221327A - Monitoring system, imaging apparatus, information processing method, program, and voice output apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a monitoring system in which imaging apparatuses and a monitoring apparatus are configured in a mutually communicable way that achieves a high crime suppression effect. <P>SOLUTION: Each of general users such as children wears the imaging apparatus as a crime-prevention apparatus. A control means of the imaging apparatus discriminates whether or not any abnormity takes place on the basis of a detection signal of a state detection means, if the control means discriminates occurrence of the abnormity, a voice output means outputs incorporated voice data as human voice. Further, the imaging apparatus uses a communication means to establish communication with the monitoring apparatus. The monitoring apparatus is an apparatus arranged in, e.g. a police station. When the communication is established between the monitoring apparatus and the imaging apparatus, the imaging apparatus transmits imaged image data and collected sound data, that is, a state around the imaging apparatus to the monitoring apparatus so that the monitoring apparatus reaches a state capable of monitoring an emergency state caused in the imaging apparatus. When the monitoring apparatus transmits voice data, a voice output means of the imaging apparatus outputs the voice data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a monitoring system configured such that an imaging apparatus and a monitoring apparatus can communicate with each other, an imaging apparatus, an information processing method thereof, and a program for realizing the information processing method. Furthermore, the present invention relates to a voice output device.

JP 2003-274358 A JP 2003-274359 A JP 2003-274360 A

  For example, as a security device carried by a child or the like, a device that generates a loud sound in an emergency is generally known as a security buzzer.

However, there are times when there is no room to operate a security device and output sound, such as when it is urgent, such as when it is attacked by a thief or when it is about to be kidnapped. obtain.
Even if a loud sound is generated as an electronic sound alarm, the crime prevention effect is unavoidable when there is no person nearby.
In view of these points, an object of the present invention is to realize a device having a higher crime prevention effect.

The monitoring system of the present invention includes a portable imaging device and a monitoring device capable of mutual communication with the imaging device.
The monitoring device constituting the monitoring system includes a communication unit that communicates with the imaging device, an output unit that outputs image data and audio data transmitted from the imaging device and received by the communication unit, Input means for inputting voice to be transmitted as voice data to the imaging apparatus by the communication means.

The imaging apparatus includes an imaging unit that captures an image and captures image data, an audio input unit that inputs external audio and captures audio data, a communication unit that communicates with the monitoring apparatus, and an abnormal situation occurs. A situation detection unit that performs detection for discrimination, a voice sound data generation unit that generates voice data that is output as a human voice, a voice output unit, and an abnormal situation occurrence based on a detection result of the situation detection unit When it is determined, the voice output operation for outputting the voice based on the voice data generated by the voice data generation means from the voice output means, the image data taken by the imaging means and / or the voice input means. Transmission operation for transmitting the voice data to the monitoring device by the communication means, and transmission from the monitoring device and received by the communication means. Audio data and a control unit to execute the received audio output operation to output from the sound output unit.
In addition, after starting the voice output operation, the control unit causes the transmission operation and the reception voice output operation to be executed when a communication connection state with the monitoring device is established by the communication unit.
The image processing apparatus further includes recording processing means for recording the image data captured by the imaging means on a recording medium, and the control means starts recording of the image data by the recording processing means when it is determined that an abnormal situation has occurred. .
In addition, it further comprises recording processing means for recording the audio data captured by the audio input means on a recording medium, and the control means starts recording the audio data by the recording processing means when it is determined that an abnormal situation has occurred. Let
Further, a power supply capable of switching between a standby state in which only the operations of the control means and the situation detection means can be executed and a power-on state in which at least the voice sound output operation, the transmission operation, and the reception voice output operation can be executed. The control means monitors the detection result of the detection means in the standby state, and switches the power supply means to the power-on state when it is determined that an abnormal situation has occurred.
The status detection unit detects whether or not the audio data captured by the audio input unit meets a predetermined determination condition.
The situation detection means detects vibration and detects whether the vibration meets a predetermined determination condition.
The situation detection means detects the physical condition of the user of the imaging apparatus and detects whether or not the detected physical condition meets a predetermined determination condition.
The situation detection unit detects whether or not the imaging device has been removed from the user.
Further, it further comprises position detecting means for detecting position information, and the control means causes the monitoring apparatus to transmit the position information detected by the position detecting means in the transmission operation.
In the transmission operation, the control unit causes the monitoring apparatus to transmit type information for determining the occurrence of abnormality.

The information processing method of the present invention is an information processing method of the imaging apparatus, wherein the determination step of monitoring the detection result by the status detection means to determine the occurrence of an abnormal situation, and the determination step determining that an abnormal situation has occurred A voice sound output step for outputting a voice based on the voice sound data stored in the voice sound data generating means from the voice output means; and image data captured by the imaging means and / or a voice captured by the voice input means. A transmission step of transmitting data to the monitoring device by the communication means; and a reception voice output step of outputting voice data transmitted from the monitoring device and received by the communication means from the voice output means.
The program of the present invention is a program that causes the imaging apparatus to execute the processing of each step described above.

  The voice output device of the present invention includes a situation detection means for performing detection for determining the occurrence of an abnormal situation, a voice sound data generation means for generating voice sound data output as a human voice, a voice output means, and the situation detection And a control means for executing a voice sound outputting operation for causing the voice output means to output a sound based on the voice sound data generated by the voice sound data generating means when it is determined that an abnormal situation has occurred based on the detection result of the means.

In the monitoring system, imaging device, information processing method, and program of the present invention described above, a general user such as a child, for example, wears the imaging device as a security device. The control unit of the imaging apparatus determines whether or not an abnormal situation has occurred based on the detection result of the situation detection unit. If it is determined that an abnormality has occurred, the voice output unit outputs internal voice data as a human voice. . Further, communication with the monitoring device is established by communication means. The monitoring device is a device that is arranged at a police station, for example. When communication is established between the monitoring device and the imaging device, the imaging device transmits the captured image data and collected sound data, that is, the image and sound as the surroundings of the imaging device to the monitoring device, and the monitoring device side It is possible to monitor emergency situations that occurred in Further, when audio data is transmitted from the monitoring device, the audio data is output from the audio output means of the imaging device.
Therefore, for example, if the user is likely to be harassed, the built-in voice data will be output immediately without any operation, and the contents of the voice will make the gangsters appear to You can be informed of abnormal situations. Furthermore, since communication is established immediately after that, it is possible to actually shift to the monitoring state from the monitoring device side, and further, the actual sound from the monitoring device side is output, so that it is in a monitoring state to thugs, etc. Can be threatened.

  The above-described voice output device of the present invention is a device that executes the voice output operation in the above-described imaging device of the present invention. That is, when it is automatically determined that an abnormal situation has occurred, voice output as a human voice is performed.

  According to the present invention, the imaging device (or voice output device) automatically determines that an abnormal situation has occurred, and generates and outputs voice sound data as a human voice. When this happens, there is no need to operate the imaging device (or voice output device). In other words, even if the user is upset or the hand is restrained and cannot be operated, the crime prevention function can be exhibited. In addition, by outputting human voice, it is possible to exert a higher deterrent effect against gangsters than mere electronic sounds, and it is easy to recognize the occurrence of an abnormal situation to surrounding people.

Further, according to the imaging device, the monitoring system, the information processing method, and the program of the present invention, communication is established between the imaging device and the monitoring device while outputting voice sound data and inducing a thug, Enter the actual monitoring state. In this case, the imaging device can recognize the situation at the site on the monitoring device side by transmitting an image or sound to the monitoring device side, and respond according to the situation, for example, arrange for a police officer or give an order for the site express Can do. Furthermore, by transmitting a voice from the monitoring device side and outputting it from the imaging device, it is possible to make a thief or the like recognize that it is in a monitoring state, and to threaten the execution of a criminal act.
Further, by transmitting position information from the imaging device, the site from the monitoring device side can be recognized.
Also, in the case of an accident, not a criminal act, the monitoring device can confirm the situation of the site and the user himself / herself by communication.

In addition, the imaging apparatus is normally set in a standby state with low power consumption, and the power is turned on when an abnormal state occurs. As a result, power consumption can be reduced as a device that is always worn, which is suitable as a battery-driven portable device.
In addition, when the power is turned on and communication with the monitoring device is performed when it is determined that the state is abnormal, it means that unnecessary communication is not performed during normal times. This can also prevent an increase in communication load due to excessive communication when a large number of imaging devices are widely used in general. This also creates a situation where communication can be appropriately executed in an emergency.

  As described above, according to the present invention, it is possible to obtain an effect of realizing an advanced crime deterring effect and enabling appropriate and prompt handling in the event of an accident.

Hereinafter, embodiments of the present invention will be described in the following order.
1. 1. General configuration of monitoring system 2. Configuration of imaging apparatus 3. Configuration of monitoring device 4. Operation when an abnormality occurs Effects, modifications and practical examples of the embodiment

1. General configuration of the monitoring system

FIG. 1 schematically shows a monitoring system according to an embodiment. In the embodiment, the monitoring system of this example includes, for example, the imaging device 1 that is normally worn by a general user, and the monitoring device 50 used in a police station, a security company, or the like.

The imaging device 1 is worn by a user as a security device. In this example, the imaging apparatus 1 is configured such that the camera unit 2 and the control unit 3 are configured as separate devices. The camera unit 2 and the control unit 3 are connected by a cable 4 so that signal transmission is possible.
The camera unit 2 is mounted on the user's shoulder as shown. On the other hand, the control unit 3 is configured to be mounted or held on the user's waist or a pocket of clothes, that is, the user can take an image while carrying it without using his / her hand.

  The imaging device 1 (control unit 3) can communicate with the monitoring device 50. For example, the imaging apparatus 1 is provided with a wireless communication function so that communication can be performed with the monitoring apparatus 50 via a wireless repeater (not shown). The communication line may be either a public line or a dedicated line, a mobile phone line, a wireless communication line using a dedicated band such as police radio, or a line using a network such as the Internet.

  Although the configuration of the imaging device 50 will be described later, communication connection is performed in response to a connection request from the imaging device 1, image data and audio data from the imaging device 1 are received, and displayed and output as audio. For example, a staff member such as a police station can monitor the situation around the imaging apparatus 1. At the time of communication connection, the staff's voice on the monitoring apparatus 50 side is transmitted to the imaging apparatus 1 and the voice is output from the imaging apparatus 1. That is, the voice of the staff of the police station or the like can be heard to the user and the surrounding people.

Prior to the description of the configuration and operation of the imaging device 1 and the monitoring device 50, an operation example performed in this monitoring system when an emergency occurs will be briefly described with reference to FIG.
As shown in FIG. 1, an image pickup apparatus worn by a user is normally in a standby state (power saving state) in a power supply state, and has only a function for determining whether an abnormality has occurred.
As shown in FIG. 2A, for example, it is assumed that the user is likely to be attacked by a thief. In such a case, the imaging apparatus 1 automatically detects the occurrence of an abnormal situation. Then, as shown in FIG. 2B, the imaging apparatus 1 is immediately turned on. The power-on state is a full function state in which all operation functions can be executed.
The imaging apparatus 1 immediately outputs a voice sound alarm as shown in FIG. The voice sound alarm outputs voice sound data stored in the apparatus as a human voice. For example, the voice “Police!” Is output.
In addition, the imaging apparatus 1 executes the imaging function and the recording function by turning on the power, and starts recording images and sounds acquired by the camera unit 1. Further, the imaging device 1 performs communication connection with the monitoring device 50.
Communication with the monitoring device 50 is established while the thief is obsessed with the output voice sound data. At this time, the imaging device 1 and the monitoring device 50 are ready to talk as shown in FIG. That is, the image data and audio data obtained by the camera unit 1 are transmitted from the imaging device 1 to the monitoring device 50. The monitoring device 50 can monitor the situation at the site by using the image data and the sound data. Further, the monitoring device 50 transmits staff voices to the imaging device 1. The imaging apparatus 1 outputs the transmitted audio data as audio. That is, the actual voice of the staff on the monitoring device 50 side is output from the imaging device 1. For example, if the staff on the monitoring device 50 side says “I confirmed the situation at the site” or “I will rush to the site”, it can be heard by thugs. In this case, since the staff of the monitoring device 50 can actually monitor the situation at the site and make a call accordingly, it is intimidating by telling the thief that they are monitoring or urging police officers. It can also be done, and it can be greatly expected that crime execution by thugs can be deterred.

2. Configuration of imaging device

FIG. 3 shows an example of the appearance of the imaging apparatus 1 according to the embodiment.
As described above, the imaging apparatus 1 has a configuration in which the camera unit 2 and the control unit 3 are connected by the cable 4 so that signal transmission is possible. The camera unit 2 is mounted on the user's shoulder, for example, as shown in FIG. 4, and the control unit 3 is mounted or held on the user's waist or a pocket of clothes.
Various methods for attaching the camera unit 2 to the shoulder are conceivable. Although not described in detail here, a mechanism for holding the pedestal 23 of the camera unit 2 is formed on a user's clothes (such as a security jacket). Alternatively, it may be mounted on the shoulder portion by a mounting belt or the like.
The camera unit 2 may be fixed to the top or side of the helmet worn by the user, or attached to the chest or arm, but the shoulder portion is the most even when the user is walking. It is a portion with less shaking, and is therefore optimal as a part to which the camera unit 2 for imaging is attached.

As shown in FIG. 3, the camera unit 2 is provided with two camera parts, a front camera part 21a and a rear camera part 21b. A front microphone 22a and a rear microphone 22b are also provided corresponding to the front and rear camera units 21a and 21b.
The front camera unit 21a captures a scene in front of the user in the wearing state of FIG. 4, and the rear camera unit 21b captures a scene behind the user.
The front camera unit 21a and the rear camera unit 21b are each equipped with a wide-angle lens, and the imaging viewing angle is relatively wide as shown in FIG. 5, and the front camera unit 21a and the rear camera unit 21b are combined. The user can be imaged almost all around.
The front microphone 22a is a microphone having high directivity in the forward direction of the user in the state of FIG. 4 and collects sound corresponding to the scene imaged by the front camera unit 21a.
The rear microphone 22b is a microphone having high directivity behind the user in the state of FIG. 4 and collects sound corresponding to the scene imaged by the rear camera unit 21b.

Needless to say, the degree of the front viewing angle and the rear viewing angle as the respective imaging ranges of the front camera unit 21a and the rear camera unit 21b can be variously set depending on the design of the lens system to be employed. The viewing angle may be set according to a situation where the imaging device 1 is assumed to be used. Of course, there is no need to make the front viewing angle and the rear viewing angle the same angle, and depending on the model, it may be possible to design the viewing angle narrowly.
The same applies to the directivity of the front microphone 22a and the rear microphone 22b, and various designs can be considered depending on the application. For example, a configuration in which one omnidirectional microphone is arranged is also conceivable.

The control unit 3 is a recording function for recording video signals (and audio signals) captured by the camera unit 2 in the memory card 5, a function for performing data communication with the monitoring device 50, and a user for display / operation, etc. Provide interface functions.
For example, a display unit 11 such as a liquid crystal panel is provided on the front surface of the control unit 3.
A communication antenna 12 is formed at a required position.
Further, a card slot 13 into which the memory card 5 is inserted is formed.
Furthermore, an electronic sound, voice data (voice sound data generated inside the control unit 3), and voice for outputting voice during a call with the monitoring device 50 (user's transmission voice on the monitoring device 50 side) are output. An output unit (speaker) 14 is provided.
Further, although not shown, a headphone terminal, a cable connection terminal for performing data transmission with an information device according to a predetermined transmission standard such as USB, IEEE 1394, etc. may be provided.

Various keys, slide switches, and the like are provided as the operation unit 15 for the user to perform operations. Of course, operators such as a jog dial and a trackball may be provided.
Depending on various types of operation units 15, for example, cursor keys, enter keys, and cancel keys can be used to input various operations by performing cursor operations on the display on the display unit 11. Alternatively, dedicated keys for mode setting, power operation (standby / on / off) and other basic operations may be provided.

  For example, when the user wears the imaging apparatus 1 of this example formed by the camera unit 2 and the control unit 3 as shown in FIG. 4, hands-free and almost unconscious imaging is possible. Therefore, when the user wears the imaging device 1 as a security device, it is possible to perform imaging without the user being conscious.

FIG. 6 shows an internal configuration example of the imaging apparatus 1.
As described above, the camera unit 2 includes the front camera unit 21a and the rear camera unit 21b. The front camera unit 21a and the rear camera unit 21b are formed by mounting an imaging optical lens system, a lens driving system, an imaging element unit using a CCD sensor or a CMOS sensor, and the like.
The imaging light from the front camera units 21a and 21b is converted into an imaging video signal by the internal imaging element unit, subjected to predetermined signal processing such as gain adjustment, and supplied to the control unit 3 through the cable 4.
In addition, audio signals obtained by the front microphone 22 a and the rear microphone 22 b are also supplied to the control unit 3 by the cable 4.

In the control unit 3, a controller (CPU: Central Processing Unit) 40 controls the entire operation. The controller 40 controls each unit in accordance with an operation program or a user operation from the operation unit 15 in order to realize various operations described later.
The memory unit 41 is a storage device used for storing program codes executed in the controller 40 and temporarily storing work data being executed.
In the case of this figure, the memory unit 41 is shown as including both a volatile memory and a nonvolatile memory. For example, it includes a non-volatile memory such as a ROM (Read Only Memory) for storing a program, a RAM (Random Access Memory) for calculation work area and various temporary storages, and an EEPROM (Electrically Erasable and Programmable Read Only Memory).

The captured video signal from the front camera unit 2a and the audio signal from the front microphone 3a transmitted from the camera unit 2 via the cable 4 are input to the imaging / audio signal processing unit 31a.
In addition, the imaged video signal from the rear camera unit 2b and the audio signal from the rear microphone 3b are input to the imaging / audio signal processing unit 31b.
The imaging / audio signal processing units 31a and 31b perform video signal processing (luminance processing, color processing, correction processing, etc.) and audio signal processing (equalizing, level adjustment, etc.) on the input captured video signals (and audio signals). To generate captured image data and audio data as signals captured by the camera unit 2.

Note that the imaging operation may be so-called moving image imaging, in which continuous frame imaging is performed at a predetermined frame rate. For example, still images are continuously acquired by sequentially capturing one frame of image data at predetermined time intervals. You may make it go.
The captured image data and audio data processed by the imaging / audio signal processing units 31 a and 31 b are supplied to the communication encoding unit 32 and the recording / reproducing processing unit 33.
The audio data processed by the imaging / audio signal processing units 31a and 31b is also supplied to the audio detection unit 38.

The recording / playback processing unit 33 performs processing for recording and playing back image data and audio data input to the imaging and microphone.
That is, the recording / playback processing unit 33 stores image data and audio data processed and supplied by the imaging / audio signal processing units 31a and 31b based on the control of the controller 40 as a recording medium (the memory card slot 13 shown in FIG. 1). The memory card 5) loaded in the memory card 5 and the image data and audio data recorded on the memory card 5 are read.
At the time of recording, the image data is subjected to data compression processing by a predetermined compression method, or encoding processing to a recording format for recording on the memory card 5 is performed.
During reproduction, various information is extracted from the recorded image file and image decoding processing is performed.

In the case of recording, two types of moving images may be recorded with image data captured by the front camera unit 21a and image data captured by the rear camera unit 21b, or for a predetermined time. The recording may be alternately performed by switching between front and rear at intervals.
In addition, when still image capturing is performed at a predetermined time interval, the captured image data processed by the imaging / audio signal processing units 31a and 31b at the predetermined time interval (for example, one to several seconds interval) is recorded and reproduced. What is necessary is just to make it the still image recording performed at a predetermined time interval supplied to the processing unit 33 by the recording / reproducing processing unit 33. In this case, it is conceivable that the captured image data by the front camera unit 21a and the captured image data by the rear camera unit 21b are alternately supplied to the recording / playback processing unit 33 at regular time intervals.

The communication encoding unit 32 performs processing for transmitting image data and audio data input to the imaging and microphone to the monitoring device 50.
That is, the communication encoding unit 32 performs compression processing, multiplexing processing, encoding to a transmission format on the image data and audio data processed and supplied by the imaging / audio signal processing units 31a and 31b based on the control of the controller 40. Perform processing.
In the transmission encoding process, the image data captured by the front camera unit 21a and the image data captured by the rear camera unit 21b may be transmitted in a time-division multiplexed manner, for example, or at predetermined time intervals. Alternatively, the image data may be transmitted alternately.

The image data and audio data processed by the communication encoding unit 32 are supplied to the transmission data generation unit 42.
The transmission data generation unit 42 generates a data packet to be transmitted to the monitoring device 50.
For example, FIG. 9A shows an example of a transmission data packet. The transmission data generation unit 42 includes image data and audio data from the communication encoding unit 32, and information supplied from the controller 40 as a user ID, The data packet shown in FIG. 9A including the position information, abnormality occurrence determination type information, and the like is generated.
The header information in the transmission data packet includes, for example, a transmission number, a packet number, a transmission data size, image data / audio data attributes, and the like.
The user ID is identification information of a user registered as a user who uses the imaging apparatus 1, and is a code number that is set when a user is registered at a police station, for example.
The position information is latitude / longitude information as a current position, which is detected by a position detector 36 described later.
The abnormality occurrence determination type information is information indicating in what circumstances the controller 40 has determined that an abnormal situation has occurred. For example, a voice detection unit 38, a vibration detection unit 48, a physical condition detection unit 45, and a removal detection described later. Information of the detection result of the unit 46 may be used.
The transmission data generation unit 42 supplies the transmission data packet generated in this way to the communication unit 34 for transmission processing.

The communication unit 34 performs wireless communication with the monitoring device 50 via the antenna 12.
The controller 40 controls the call and line connection processing, data transmission / reception processing, and the like to execute communication.
In response to the transmission data packet supplied from the transmission data generation unit 42, the communication unit 34 performs processing such as high-frequency modulation / amplification to transmit data from the antenna 12. This transmission data is received by the monitoring device 50.
Therefore, the monitoring device 50 is notified of information such as an image picked up by the image pickup device 1, input sound, user ID, position information indicating the current position of the image pickup device 1, and abnormality occurrence determination type information. .
In addition, the communication unit 34 performs data reception demodulation processing on the information transmitted from the monitoring device 50 and data of voice communication with the staff on the monitoring device 50 side, and supplies the reception data to the reception data processing unit 43.
The reception data processing unit 43 performs processing such as packet decoding, information extraction, and audio processing as processing of data received by the communication unit 34, and supplies the received data content to the controller 40.

The display data generation unit 44 generates display data as contents to be displayed on the display unit 11 in accordance with an instruction from the controller 40.
For example, in the display data generation unit 44, the operation menu display, the operation state display, the image reproduced from the memory card 5 and the signal path are not shown in FIG. In addition, processing for monitor display of the captured video signal captured by the front camera unit 21a and the rear camera unit 21b is also performed.
When information to be displayed other than sound is transmitted from the monitoring device 50, the controller 40 instructs the display data generating unit 44 to display data and data contents as characters based on the information. You may make it display on the part 11. FIG.

The voice sound memory 39 is a memory for storing voice data (referred to as “voice sound data” for explanation) as a human voice, and is configured by a nonvolatile memory such as an EEP-ROM. As the contents of the stored voice sound data, a voice sound that is considered practically appropriate as a crime prevention device is set. This voice sound data is the voice output in the case of FIG. "
“What did you do?” “I am the police. I will check the situation immediately.” “I confirmed the scene. I will dispatch a police officer.” “!” Or “Someone come!”, Etc.
When it is determined that an abnormality has occurred, the controller 40 can read the voice data stored in the voice memory 39 and supply it to the voice output unit 14 for voice output.

The audio output unit 14 includes an amplifier circuit unit and a speaker, and performs a required audio output according to an instruction from the controller 40. For example, message voices and alarm sounds during various operations and operations are output, and voice sound data read from the voice sound memory 39 is output as voice. Further, during communication with the monitoring device 50, a voice from the monitoring device 50 (a voice of a staff member who makes a call with the imaging device 1 using the monitoring device 50 at a police station or the like) is output.
Although the signal path is not shown in FIG. 6, the audio signal collected by the front microphone 22a and the rear microphone 22b is supplied and output, so that an audio monitor output at the time of imaging or the like is also performed. When reproduction is performed by the recording / reproduction processing unit 33, reproduction audio is also output by the audio output unit 14.

The operation unit 15 is various operators provided on the casing of the control unit 3 as described in FIG. For example, the controller 40 displays various operation menus on the display unit 11, and the user performs an operation input on the menu by a cursor operation or an enter operation by the operation unit 15. The controller 40 performs predetermined control in accordance with a user operation using the operation unit 15. For example, various controls for the operation mode, reproduction, imaging, and the like of the imaging apparatus 1 can be executed in accordance with a user operation.
Of course, the operation unit 15 may not be an operator corresponding to the operation menu on the display unit 11, and may be prepared as a play key, a stop key, a mode key, or the like.

The position detection unit 36 includes a GPS antenna and a GPS decoder, receives a signal from a GPS (Global Positioning System) satellite, decodes the received signal, and outputs latitude and longitude as current position information.
The controller 40 can grasp the current position from the latitude and longitude data from the position detection unit 36, and can supply the current position information to the transmission data generation unit 42 to be included in the data packet transmitted to the monitoring device 50.

  The external interface performs various connections / communications with external devices. For example, data transmission with an external device is enabled by a predetermined interface standard such as USB or IEEE1394. For example, upload for upgrading the operation program of the controller 40, transmission of data reproduced from the memory card 5 to an external device, and input of various information from the external device are also possible.

The controller 40 determines that an abnormal situation has occurred based on a predetermined determination condition. In order to determine the occurrence of the abnormal situation, the voice detection unit 38 serves as a situation detection unit that supplies detection signals for various situations to the controller 40. , A vibration detection unit 48, a physical condition detection unit 45, and a removal detection unit 46 are provided.
Each of these units outputs various detection signals to the controller 40.

The audio detection unit 38 detects whether or not audio data that matches a predetermined determination condition is input for the audio data processed and supplied by the imaging / audio signal processing units 31a and 31b.
One of the detected contents is an audio level. For example, when a predetermined comparison level is set and the level of the sound collected by the front microphone 22a and the rear microphone 22b is higher than the comparison level, that is, when the sound volume can be estimated as an abnormal situation, A detection signal is output.
Alternatively, a user may register a keyword in advance, and a detection signal may be output when a sound corresponding to the keyword is input. For example, a voice uttered by the user in an emergency such as “Help me” is input in advance at the time of setup or the like and stored in the voice detection unit 38. In normal times, a detection signal is output when the keyword is detected as the input voice. Of course, a plurality of keywords may be registered and the respective detection signals may be output.
Furthermore, it is also conceivable to detect a voice uttered by the user in an abnormal state by performing a voice print analysis of the input voice using the voice or scream of the user as voice print data.
In addition, the tendency of each voice of the perpetrator or victim at the time of abnormality may be stored as a frequency spectrum, and a spectrum analysis may be performed on the input speech to detect the abnormal state.

The vibration detection unit 48 includes a vibration sensor such as an acceleration sensor, and detects an operation state of a user wearing the imaging device 1. The vibration sensor may be provided in the housing of the control unit 3 or may be attached to the user's body outside the housing.
The vibration detection unit 48 stores (learns), for example, a vibration level and pattern at the time of the user's visit operation. Then, when the vibration has an abnormal level or pattern that is difficult to assume during normal operation, a detection signal for estimating the occurrence of the abnormality is output.
Alternatively, the increase rate (differential value) of the vibration level may be detected, and the detection signal may be output by abnormal vibration increase. In this case, learning is not necessary.

As the body condition detection unit 45, for example, sweat detection, pulse detection, and the like can be considered.
When perspiration detection is performed, a perspiration sensor (humidity sensor) is attached to the palm, heel, and the like of the user who wears the imaging device 1, and the body condition detection unit 45 monitors the detection value of the perspiration sensor.
The body condition detection unit 45 is made to learn the normal degree of sweating of the user. In use, when a detection value that is much larger than the normal degree of sweating is detected as a detection value of the sweating sensor, a detection signal for estimating the occurrence of an abnormality is output.
Alternatively, as a method that does not require learning, the rate of increase (differential value) of the detection value of the sweat sensor is constantly checked, and when an abnormal increase is recognized as the rate of increase, a detection signal that estimates the occurrence of an abnormality is output. It may be.
When performing pulse detection, a pulse sensor is mounted on the wrist, neck, or the like of the user who wears the imaging device 1, and the physical condition detection unit 45 monitors the detection value of the pulse sensor.
The physical condition detection unit 45 is made to learn the normal pulse rate of the user. In use, when a detection value that is much larger than the normal pulse rate is detected as a detection value of the pulse sensor, a detection signal for estimating the occurrence of abnormality is output.
Alternatively, as a method that does not require learning, the rate of increase (differential value) of the detected value of the pulse rate is always checked, and when an abnormal increase is recognized as the rate of increase, a detection signal that estimates the occurrence of an abnormality is output. It may be.
In addition, as the physical condition detection part 45, it is good also as a structure which performs one of perspiration detection and a pulse detection, and is good also as a structure which performs both.

The removal detection unit 46 detects that the imaging device 1 has been removed.
For example, the pedestal 23 of the camera unit 1 to be mounted on the shoulder is provided with a sensor for determining whether or not it is crimped to determine whether or not it is in the mounted state. Of course, the sensor of the mounting part in the housing of the control unit 3 may be provided and monitored. Further, it is detected whether the cable 4 is unplugged from the camera unit 1 and the control unit 3.
For these detections, a mechanical sensor or a pressure sensor may be provided in a part used for attachment or detachment or a cable jack. For example, when the cable 4 is removed, signal transmission between the camera unit 1 and the control unit 3 is possible / You may judge in an impossible state.
The removal detection unit 46 outputs a detection signal when these removal situations are detected.
The imaging apparatus 1 is assumed to perform a predetermined operation by the user at the time of normal removal, for example. As an example, it is assumed that, for example, it is removed while pressing a predetermined operation key, or is once removed from a power-off state (a state in which the power is completely turned off, not a standby state described later). When removal is performed without following these regular procedures, it is determined that the imaging device 1 has been removed by the user, for example.

The controller 40 monitors each detection signal from the voice detection unit 38, the vibration detection unit 48, the physical condition detection unit 45, and the removal detection unit 46.
Then, based on the detection signal, it is determined whether an abnormal situation has occurred.

The power supply unit 47 generates a predetermined operating power supply voltage from, for example, a primary battery or a secondary battery, which is a built-in battery, and supplies power to each unit.
In the power-on state, the operating power supply voltage VON is supplied to each part shown in the figure, and a state in which all the functions of the imaging device 1 can be executed (full function state) is set.
On the other hand, as a standby state, the operating power supply voltage VST is set to the controller 40, the sound detection unit 38 (and the sound processing system of the imaging / audio signal processing units 31a and 31b), the vibration detection unit 48, and the body condition detection. Are supplied to the unit 45 and the removal detection unit 46, and it is possible to determine whether an abnormal situation has occurred in the power saving state.
The controller 40 can monitor each detection signal from the voice detection unit 38, the vibration detection unit 48, the physical condition detection unit 45, and the removal detection unit 46 in the standby state in which the operation power supply voltage VST is supplied. When it is determined that an abnormal situation has occurred, the power supply unit 47 is controlled to switch to the power-on state, and the imaging apparatus 1 is set to the full function state.

  With the above-described configurations, the imaging apparatus 1 realizes processing described later. Therefore, the controller 40 performs imaging / audio input operation by the camera unit 2 and imaging / audio signal processing units 31a and 31b, recording / reproducing operation by the recording / reproducing processing unit 33, and transmission data generation by the communication encoding unit 32 and the transmission data generating unit 42. Each control of the operation, the communication operation of the communication unit 34, the display data generation operation of the display data generation unit 44, and the audio output operation of the audio output unit 14 is performed.

Note that the imaging apparatus 1 of the present example is configured as described above, for example, but various structural modifications can be considered as follows.
All of the blocks as the constituent elements shown in FIG. 5 are not essential, and other constituent elements may be added.
For example, the recording function may not be provided, and the captured video data may only be transmitted and output.
Further, as the situation detection means, at least one of the voice detection unit 38, the vibration detection unit 48, the body situation detection unit 45, and the removal detection unit 46 may be provided, and a situation that can detect an abnormal situation can be detected. If so, other detection means may be provided.
Furthermore, as a component not shown, for example, a short-range wireless communication function such as Bluetooth, another device interface function, a user interface function, and the like may be provided.

  The transmission data generation unit 42, the reception data processing unit 43, and the display data generation unit 44 may be configured in hardware as circuit units different from the controller 40 (CPU) as shown in FIG. The processing of each unit can be a so-called software calculation process, and may be realized as a function realized by a software program in the controller 40.

In addition, the appearance of the camera unit 2 and the control unit 3 as shown in FIG. 3 is an example, and controls for an actual user interface, an arrangement for display, and a housing shape are limited. Not. Of course, various shapes are assumed due to differences in configuration.
Although the camera unit 2 and the control unit 3 are connected by the cable 4, the captured video signal and the audio signal may be wirelessly transmitted by a transmitter using radio waves or infrared rays.
Alternatively, the camera unit 2 and the control unit 3 may be integrally formed instead of being separated as shown in FIG.
It is also conceivable to make the control unit 3 a wristwatch type. In that case, it may be possible to arrange a sensor for detecting a pulse and sweating, a vibration sensor, and the like inside the wristband.

In this example, the front camera unit 2a and the rear camera unit 2b are provided. However, at least one camera unit may be provided.
Three or more camera units may be provided.
As for the microphone, in addition to providing each corresponding to each of two or three or more camera units, a common microphone may be provided for all or some of the camera units. Of course, it is sufficient that at least one microphone is provided.
In addition, a pan / tilt mechanism may be formed for all or a part of one or a plurality of camera units, so that the imaging direction can be changed vertically and horizontally.
The pan / tilt operation may be in response to a user operation, or may be automatically controlled by the controller 40.

In this example, the memory card 5 is cited as an example of the recording medium. However, the recording card is not limited to the memory card 5, and for example, an HDD (Hard Disc Drive) is mounted on the recording / playback processing unit 33, or an optical disk, magneto-optical disk, or the like Media may be used. Of course, a magnetic tape medium may be used as the recording medium.

3. Configuration of monitoring device

The configuration of the monitoring device 50 will be described with reference to FIG. The monitoring device 50 is configured as a device that can perform communication (call) with the imaging device 1. The monitoring device 50 can be realized by a hardware computer system as a personal computer or a workstation. Although FIG. 7 shows the configuration as the monitoring device 50, the configuration as shown in FIG. 7 may be realized by software using a computer system.

The communication unit 51 performs reception demodulation processing of data transmitted from the imaging device 1 and transmission modulation processing of data transmitted to the imaging device 1.
The demodulated signal received by the communication unit 51 is decoded by the reception processing unit 52, and the content of the received data is extracted.
The data transmitted from the imaging device 1 includes header information, user ID, position information, abnormality occurrence determination type information, audio / video data, etc., as described with reference to FIG. In 52, each of these data is extracted.

The header information, user ID, position information, and abnormality occurrence determination type information are supplied to the data processing unit 54.
The data processing unit 54 searches the map database 62 according to, for example, position information (latitude / longitude), and acquires detailed position information, for example, a map image, a position name, and an address as the current position information of the imaging device 1. To do.
The data processing unit 54 searches the user database using the user ID. In the user database, the name, address, contact information, age, gender, etc. of the registered user are registered, and information on the user who owns the imaging device 1 (the user who has experienced an abnormal situation) by searching the user database Can be obtained.
The data processing unit 54 supplies the detailed position information, user information, and abnormality occurrence determination type information to the display processing unit 57.

The image data extracted by the reception processing unit 52 is supplied to the image processing unit 55, subjected to decoding processing, and supplied to the display processing unit 57.
The audio data extracted by the reception processing unit 52 is supplied to the reception audio processing unit 56, subjected to decoding processing, audio amplification, and output processing, and supplied to the speaker unit 59.

The display processing unit 57 generates display data based on the decoded image data, detailed position information, user information, and abnormality occurrence determination type information, and causes the display unit 58 to display the display data.
The received image data is an image captured by the imaging device 1. Accordingly, the display unit 58 displays the transmitted captured image and also displays detailed position information, user information, and abnormality occurrence determination type information.
The speaker unit 59 outputs sound around the imaging device 1.
Accordingly, the staff of the police station or the like who uses the monitoring device 50 can obtain the surrounding image and sound as the current state of the imaging device 1, the name of the user of the imaging device 1, the current imaging device 1, and the like. It will be possible to confirm in detail.

A staff member such as a police station can transmit voice data to the imaging apparatus 1 by inputting voice from the microphone 60. The voice input from the microphone 60 is subjected to voice input processing, communication encoding processing, and the like by the transmission voice processing unit 61. The transmission processing unit 53 generates transmission packet data including encoded audio data, which is modulated / amplified by the communication unit 51 and transmitted to the imaging apparatus 1.
For example, the transmission data packet is configured as shown in FIG. The header information includes, for example, a transmission number, a packet number, a transmission data size, and audio data attributes.

The voice data, that is, the voice of the staff is received by the imaging device 1 and output from the voice output unit 14.
That is, in a state where communication connection is established between the imaging device 1 and the monitoring device 50, a call can be made between the user of the imaging device 1 (or a person in the vicinity of the user) and a staff member such as a police station. Especially in situations where the user of the imaging device 1 is attacked by a thief, the staff of the police station or the like can confirm the situation from the output of the display unit 58 and the speaker unit 59, and the police station etc. Staff can issue warnings.
Needless to say, the configuration of the monitoring device 50 is not limited to the configuration of FIG.

4). Operation when an error occurs

The operation of the imaging device 1 (control processing of the controller 40) for realizing the operation shown in FIG. 2 will be described with reference to FIG.
A user usually wears the imaging device 1 in a standby state. The power supply is set to the standby state by a user operation. In this case, the user operates a power switch prepared as one of the operation units 15 when the user wears the power switch. In this case, the operation of the power switch is switched off / standby.
Alternatively, it is assumed that there is no power off state, for example, it may be always in a standby state when a battery is loaded.

In the standby state, the controller 40 monitors each detection signal of the voice detection unit 38, the vibration detection unit 48, the physical condition detection unit 45, and the removal detection unit 46 in Step F100.
As described above, each of the voice detection unit 38, the vibration detection unit 48, the physical condition detection unit 45, and the removal detection unit 46 transmits a detection signal to the controller when a detection result that is presumed to be an occurrence of an abnormal situation is obtained. 40. If there is a detection signal, controller 40 determines whether or not an abnormal situation has occurred in step F101 based on the detection signal.
There are various ways of determining the occurrence of an abnormal situation. For example, as one method, the occurrence of an abnormal situation is estimated by any one of the voice detection unit 38, the vibration detection unit 48, the body condition detection unit 45, and the removal detection unit 46. There is a method of determining that an abnormal situation has occurred when a detection signal is output. Various examples of the method for determining the occurrence of an abnormal situation in step F101 will be described later.

If the controller 40 determines that an abnormal situation has occurred, the controller 40 proceeds to step F102 and first controls the power supply unit 47 to turn on the power. That is, the imaging device 1 is in a full function state.
Subsequently, the controller 40 instructs the communication unit 34 in step F103 to start communication connection processing with the monitoring device 50.
Further, in step F104, the controller 40 reads out the voice sound data stored in the voice sound memory 39, supplies it to the voice output unit 14, and outputs the voice of the voice sound data. That is, when it is determined that an abnormal situation has occurred, the built-in voice sound data is immediately output so that it can be heard by the user and the user's surroundings (such as thugs and people around). For example, as shown in FIG. 2C, the voice “Police!” Is output.
Note that it is preferable to output the voice data not only once but also with various voice contents until the actual communication connection is completed.

Further, in step F105, the controller 40 starts the recording operation of the recording / playback processing unit 33, and causes the memory card 5 to record the captured image data and the input audio data.
The above steps F103, F104, and F105 are each started immediately when it is determined that an abnormal situation has occurred, and these steps may be performed in any order as long as they are started quickly. If possible, execution may be started simultaneously and in parallel.

In step F106, the controller 40 waits for the completion of the communication connection. When the connection is completed, the controller 40 proceeds to step F107 and performs a call process with the monitoring device 50.
In step F106, transmission processing and reception processing as call processing are performed.
As transmission processing, transmission processing of captured image data and input audio data is performed. That is, as described with reference to FIG. 9A, a transmission data packet is generated so that image data, audio data, position information, user ID, and abnormality occurrence determination type information are transmitted to the monitoring device 50. At 50, the situation around the imaging device 1 can be confirmed.
As reception processing, packet data as shown in FIG. 9B sent from the monitoring device 50 is decoded, and the audio data is output from the audio output unit 14. Note that when the output of the received voice data is started in this way, the output of the voice data from the voice memory 39 is stopped. That is, the output is switched from the built-in voice to the call voice.
In this state, as shown in FIG. 2 (d), the monitoring device 50 side confirms the status of the imaging device 1, makes a call according to the situation, and gives a threat to a gangster or an instruction to the user of the imaging device 1. It can be carried out.

Note that after the abnormal situation is resolved, the imaging device 1 may return to the standby state. In this case, the user may make a transition to the standby state by operating the power supply, or the controller 40 may automatically return to the standby state by determining that the abnormal situation has been resolved.
For example, in the call processing in step F107, the communication may be disconnected when the user or the staff of the monitoring device 50 determines that there is no abnormality or the abnormality is solved, but the communication is disconnected or the communication is disconnected. The controller 40 may control the power supply unit 47 to return to the standby state in response to the elapse of a predetermined time from.
Further, as detection signals of the voice detection unit 38, the vibration detection unit 48, the physical condition detection unit 45, and the removal detection unit 46, when a detection signal for estimating an abnormal situation is not generated for a predetermined time or more, the standby state is returned. Also good.
Further, a keyword for returning to the standby state is learned (or set in advance), and when the voice output unit 14 detects that the user has issued the keyword, the standby state is restored. It may be.

5). Effects, modifications and practical examples of the embodiment

In the above embodiment, an effect of realizing an advanced crime deterrent effect or enabling an appropriate and quick response in the event of an accident is obtained.
First, the imaging apparatus 1 automatically determines that an abnormal situation has occurred, and performs the processes of steps F102 to F107 in FIG. Therefore, the user does not need to operate the imaging device 1 when an abnormal situation occurs. This means that the crime prevention function can be exhibited even when the user is in a state of inconvenience or the hand is restrained by a thief or the like and cannot be operated.

When an abnormal situation occurs, first, the imaging apparatus 1 generates and outputs voice data as a human voice. By outputting human voices, it is possible to exert a higher deterrent effect against gangsters than mere electronic sounds, and it is easy to recognize the occurrence of an abnormal situation to surrounding people.
For example, if voice data such as “Police!” Or “Monitoring the situation” is output immediately, a thief may be distracted by the voice, hesitating a criminal act, and even a communication connection You can expect to earn more time.
In addition, when a violent person is attacked, a general user may be surprised and unable to speak, so a voice that draws attention from the surroundings, such as “Help me!”, Is also effective.
The voice sound data may be a voice sound such as a conversation with the user other than a voice threatening a thief or a voice seeking help.
For example, first, voice data such as “What are you doing?” Is output to prompt the user to reply. At this time, if the user replies, the user will be given the illusion that communication is actually taking place and can earn time. Even if the user is unable to respond, outputting voice data such as “I confirmed the scene. I will rush the policeman” a few seconds later will be a great threat to thugs.

  A communication connection is established while outputting such voice data (for example, for several seconds), and an actual monitoring state is entered. The imaging device 1 transmits an image or sound to the monitoring device 50 side, so that the monitoring device 50 can recognize the situation at the site, and responds according to the situation, for example, arranges for a police officer or gives an order for an on-site express. be able to. Furthermore, by transmitting a voice from the monitoring device 50 side and outputting it from the imaging device 1, it is possible to make sure that a thief or the like is in a monitoring state and threaten or convince the execution of a criminal act. .

In addition, the imaging device 1 can also transmit the GPS position information to the monitoring device 50, so that the site can be correctly communicated to the monitoring device 50 side (the police station side), thereby promptly arranging police officers and dispatching the site. It will be possible.
Also, by transmitting the user ID from the imaging device 1 to the monitoring device 50, the user can be specified on the monitoring device 50 side, and the user's judgment (age and gender) can also be used for status confirmation and response processing.
In addition, transmission of abnormality occurrence determination type information from the imaging apparatus 1 to the monitoring apparatus 50 is also useful for situation determination in the monitoring apparatus 50. For example, although there are various circumstances in the abnormal situation, the reason (detection result) that the imaging apparatus 1 determines as the occurrence of abnormality is useful information for the situation determination on the monitoring apparatus 50 side.

In addition, the imaging device 1 starts recording images and sounds in the memory card 5 in response to determining that an abnormality has occurred. This is useful in the sense of preserving the situation at the time of occurrence of an abnormality. For example, after a thief or the like escapes, it is a very useful material for identifying a criminal by recorded video and audio. Even if it is not a criminal act, it is useful as a situation record in the case of a traffic accident, for example.
In the embodiment, both image data and audio data are recorded. However, only image data or only audio data may be recorded.

Further, the imaging apparatus 1 is normally set in a standby state with low power consumption, and when an abnormal state occurs, the power supply is turned on to enter a full function state. Normally, it is in a standby state, so that power consumption can be reduced as a device worn at all times, and it is suitable as a battery-driven portable device.
In addition, when the power is turned on and communication with the monitoring device is performed when it is determined that the state is abnormal, it means that unnecessary communication is not performed during normal times. This can also prevent an increase in communication load due to excessive communication when a large number of imaging devices 1 are widely used in general. This also creates a situation where communication can be appropriately executed in an emergency.
Further, the fact that the recording operation is not performed in the recording / reproduction processing unit 33 in the standby state is also effective in terms of saving the capacity of the memory card 5.
In the embodiment, it has been described only that the power is automatically turned on. Of course, the user may manually turn on the power. In particular, it is necessary to be able to execute a power supply operation, for example, when considering that it can be used as a camera or a communication device at normal times.
In addition, there is an example where it is always used in a full function state without considering power saving. For example, an operation example may be considered in which image recording is always performed by the recording / playback processing unit 33 and communication with the monitoring device 50 is also performed when an abnormal situation occurs.

In order for the controller 40 to determine that an abnormal situation has occurred, a detection result is obtained in which each of the voice detection unit 38, the vibration detection unit 48, the physical condition detection unit 45, and the removal detection unit 46 is estimated to have occurred. The detected signal is supplied to the controller 40.
Depending on the sound detection unit 38, an abnormal situation can be estimated by a loud sound accompanying screaming, violence, an accident, or the like. Moreover, the occurrence of an abnormal situation can be estimated by keyword or voiceprint analysis.
According to the vibration detection unit 48, occurrence of an abnormal situation can be estimated by an abnormal operation due to an accident or violence.
According to the physical condition detection unit 45, it is possible to estimate the occurrence of an abnormal situation based on a heart rate change or sweating according to the extreme tension state or panic state of the user himself / herself.
According to the fact that the removal of the image pickup device by the removal detection unit 46 has not been performed properly, it is possible to estimate the occurrence of an abnormal situation as a situation in which, for example, a thief or the like has removed or taken away the image pickup device 1.

In step F101 in FIG. 8, the controller 40 may determine the detection signals of these detection units based on OR conditions. That is, when an abnormal state detection signal is supplied from one of the detection units (38, 48, 45, 46), if it is determined that an abnormal state has occurred, the abnormality determination sensitivity can be increased, and even a little. If it is estimated to be abnormal, the crime prevention function (operation after step F102) can be exhibited.
On the other hand, when a detection signal from two or more detection units is supplied, or when detection signals from all the detection units (38, 48, 45, 46) are supplied, an abnormal situation occurs under an AND condition. If the determination is made, the detection sensitivity will be lowered, but it becomes a device that carefully judges the occurrence of an abnormality, and it can be made to operate only in an abnormal situation by not operating it unnecessarily.
Of course, the detection sensitivity of occurrence of such an abnormal situation may be arbitrarily set by the user.

Further, level information may be added to the detection signal from each detection unit (38, 48, 45, 46). For example, level 1, level 2, level 3, etc. are set as the level of abnormality determination according to the detection value, and a detection signal whose level increases as the probability of occurrence of abnormality increases is detected by each detection unit (38, 48, 45, 46). For example, the vibration detection unit 48 determines level 1 to level 3 according to the vibration level. For the voice detection unit 38, the level may be determined according to the sound volume, or the level may be set according to the type of keyword.
It is also conceivable that the controller 40 comprehensively determines the occurrence of an abnormal situation according to each of these detection signals and their levels. For example, in the case of a level 1 detection signal, the determination is made based on the AND condition of the detection signals of the detection units (38, 48, 45, 46). For example, it is determined that a situation has occurred. Alternatively, it is also conceivable that the level of each detection signal is added and it is determined that an abnormal situation has occurred when the added value exceeds a predetermined value.
Of course, it is also useful to include such level information in the abnormality occurrence determination type information and transmit it to the monitoring device 50.

The voice sound data may be data of various contents, depending on the reason for determining that an abnormal situation has occurred, that is, the detection signal from each detection unit (38, 48, 45, 46), or the above It is also conceivable to select and output voice sound data in accordance with the detection level.
For example, when the probability of occurrence of an abnormal situation is low, the voice sound data “What did you do?” Is output, but when it can be determined that the abnormal situation is certain, “Police! What are you doing!” In this example, voice data is output.

  Further, in the embodiment, the case where a violent person is attacked is described as an example, but it is useful not only for a criminal act but also for a user having an accident. For example, when a child is injured alone and cannot move, the imaging device 1 and the monitoring device 50 communicate with each other, and the monitoring device 50 side confirms the situation and position of the site, so that the child can immediately go to rescue. Can do.

The program of the present invention can be realized as a program that causes the controller 40 of the imaging apparatus 1 to execute the processing of FIG.
This program can be recorded in advance in a system HDD as a recording medium in an information processing apparatus such as a computer system, a ROM in a microcomputer having a CPU, or the like.
Alternatively, the program is temporarily or permanently stored on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magnet optical) disk, DVD (Digital Versatile Disc), magnetic disk, and semiconductor memory. Can be stored (recorded). Such a removable recording medium can be provided as so-called package software. For example, it can be installed in a computer system by being provided by a CD-ROM, a DVD-ROM, or the like.
In addition to installing from a removable recording medium, this program can also be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

The voice output device of the present invention is realized as a simple device in which the imaging function, the recording / reproducing function, and the communication function are eliminated from the imaging device 1 described above.
For example, an apparatus that executes steps F100, F101, F102, and F104 in FIG. 8 may be used.
The configuration includes voice detection unit 38, vibration detection unit 48, physical condition detection unit 45, removal detection unit 46, and other status detection means, voice sound memory 39, voice output unit 14, power supply unit 47, and steps F100 and F101. , F102, and F104 may be provided with a controller 40 and a memory unit 41. In the case where voice detection is performed using the voice detection unit 38 as situation detection means, a microphone and a voice signal processing system for inputting ambient voice are required.
Such a voice output device can be used as a crime prevention device with a simplified configuration of the imaging device 1. When the user wears a voice output device, when an abnormal situation occurs, a voice for intimidation or help against a gang or the like is output from the voice data without any user operation. In other words, it is possible to obtain a higher crime prevention effect as a so-called crime prevention bell or crime prevention buzzer because it is unnecessary to operate in an emergency and a voice sound effective for crime prevention is output rather than general electronic sound output. it can.

It is explanatory drawing of the monitoring system of embodiment of this invention. It is explanatory drawing of the operation example of the monitoring system of embodiment. It is explanatory drawing of the external appearance of the imaging device of embodiment. It is explanatory drawing of the usage condition of the imaging device of embodiment. It is explanatory drawing of the imaging viewing angle of the imaging device of embodiment. It is a block diagram of the composition of the imaging device of an embodiment. It is a block diagram of the composition of the monitoring device of an embodiment. 3 is a flowchart of processing of the imaging apparatus according to the embodiment. It is explanatory drawing of the data communicated in embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Imaging device, 2 Camera unit, 3 Control unit, 4 Cable, 5 Memory card, 11 Display part, 12 Antenna, 13 Memory card slot, 14 Sound output part, 15 Operation key, 21a Front camera part, 21b Rear camera part, 22a front microphone, 22b rear microphone, 31a, 31b imaging / audio signal processing unit, 32 communication encoding unit, 33 recording / playback processing unit, 34 communication unit, 35 non-sound notification unit, 36 position detection unit, 38 audio detection unit, 39 Voice sound memory, 40 controller, 41 memory section, 42 transmission data generation section, 43 reception data processing section, 44 display data generation section, 45 physical condition detection section, 46 removal detection section, 47 power supply section, 48 vibration detection section, 50 monitoring Device, 51 communication unit, 52 reception processing unit, 3 transmission processing unit, 54 data processing unit, 55 image processing unit, 56 receiving the sound processing unit, 57 display processing unit, 58 display unit, 59 a speaker, 60 a microphone, 61 transmission audio processing unit

Claims (15)

A monitoring system comprising a portable imaging device and a monitoring device capable of communicating with the imaging device,
The imaging apparatus is
An imaging means for taking image data and capturing image data;
Audio input means for inputting audio data and inputting audio data;
A communication means for communicating with the monitoring device;
A situation detection means for performing detection for determining occurrence of an abnormal situation;
Voice sound data generating means for generating voice sound data output as human speech;
Audio output means;
When it is determined that an abnormal situation has occurred based on the detection result of the situation detection unit, a voice output operation that causes the voice output unit to output a voice based on the voice data generated by the voice data generation unit, and the image pickup unit captures the voice The image data and the audio data captured by the audio input means are transmitted to the monitoring device by the communication means, and the audio data transmitted from the monitoring device and received by the communication means are the audio data. Control means for executing a reception voice output operation to be output from the output means;
With
The monitoring device is
Communication means for communicating with the imaging device;
Output means for outputting image data and audio data transmitted from the imaging apparatus and received by the communication means;
Input means for inputting sound to be transmitted as sound data to the imaging apparatus by the communication means;
A monitoring system comprising: An imaging device that is portable and capable of mutual communication with a monitoring device,
An imaging means for taking image data and capturing image data;
Audio input means for inputting audio data and inputting audio data;
A communication means for communicating with the monitoring device;
A situation detection means for performing detection for determining occurrence of an abnormal situation;
Voice sound data generating means for generating voice sound data output as human speech;
Audio output means;
When it is determined that an abnormal situation has occurred based on the detection result of the situation detection unit, a voice output operation that causes the voice output unit to output a voice based on the voice data generated by the voice data generation unit, and the image pickup unit captures the voice Transmission operation for transmitting the received image data and / or audio data captured by the audio input means to the monitoring device via the communication means, and audio data transmitted from the monitoring device and received by the communication means as described above Control means for executing a reception voice output operation to be output from the voice output means;
An imaging apparatus comprising:   The control means causes the transmission operation and the reception voice output operation to be executed when a communication connection state with the monitoring device is established by the communication means after the voice sound output operation is started. Item 3. The imaging device according to Item 2. A recording processing unit for recording the image data captured by the imaging unit on a recording medium;
The imaging apparatus according to claim 2, wherein the control unit starts recording of the image data by the recording processing unit when it is determined that an abnormal situation has occurred. A recording processing unit for recording the audio data captured by the audio input unit on a recording medium;
3. The imaging apparatus according to claim 2, wherein the control unit starts recording the audio data by the recording processing unit when it is determined that an abnormal situation has occurred. Power supply means capable of switching between a standby state in which only the operations of the control means and the situation detection means can be executed and a power-on state in which at least the voice output operation, the transmission operation, and the reception voice output operation can be executed With
3. The control unit according to claim 2, wherein the control unit monitors the detection result of the detection unit in the standby state, and switches the power source unit to the power-on state when it is determined that an abnormal situation has occurred. Imaging device.   The imaging apparatus according to claim 2, wherein the status detection unit detects whether or not the audio data captured by the audio input unit satisfies a predetermined determination condition.   The imaging apparatus according to claim 2, wherein the situation detection unit performs vibration detection and detects whether or not the vibration satisfies a predetermined determination condition.   The imaging according to claim 2, wherein the situation detection unit detects a physical condition of a user of the imaging apparatus and detects whether or not the detected physical condition meets a predetermined determination condition. apparatus.   The imaging apparatus according to claim 2, wherein the status detection unit detects whether the imaging apparatus has been removed from a user. It further comprises position detection means for detecting position information,
The imaging apparatus according to claim 2, wherein the control unit causes the monitoring apparatus to transmit the position information detected by the position detection unit in the transmission operation.   The imaging apparatus according to claim 2, wherein the control unit causes the monitoring apparatus to transmit type information of abnormality occurrence determination in the transmission operation. An imaging device that is portable and capable of mutual communication with a monitoring device,
An imaging means for taking image data and capturing image data;
Audio input means for inputting audio data and inputting audio data;
A communication means for communicating with the monitoring device;
A situation detection means for performing detection for determining occurrence of an abnormal situation;
Voice sound data generating means for generating voice sound data output as human speech;
Audio output means;
As an information processing method of an imaging apparatus having
A determination step of monitoring the detection result by the situation detection means to determine the occurrence of an abnormal situation;
A voice output step for outputting a voice based on the voice data stored in the voice data generation means from the voice output means when it is determined that an abnormal situation has occurred in the determination step;
A transmission step of transmitting the image data captured by the imaging unit and / or the audio data captured by the audio input unit to the monitoring device by the communication unit;
A reception voice output step for outputting voice data transmitted from the monitoring device and received by the communication means from the voice output means;
An information processing method characterized by comprising: An imaging device that is portable and capable of mutual communication with a monitoring device,
An imaging means for taking image data and capturing image data;
Audio input means for inputting audio data and inputting audio data;
A communication means for communicating with the monitoring device;
A situation detection means for performing detection for determining occurrence of an abnormal situation;
Voice sound data generating means for generating voice sound data output as human speech;
Audio output means;
As a program for controlling the operation of the imaging apparatus having
A determination step of monitoring the detection result by the situation detection means to determine the occurrence of an abnormal situation;
A voice output step for outputting a voice of voice data stored in the voice data generation means from the voice output means when it is determined that an abnormal situation has occurred in the determination step;
A transmission step of transmitting image data captured by the imaging unit and / or audio data captured by the audio input unit to the monitoring device by the communication unit;
A reception voice output step for outputting voice data transmitted from the monitoring device and received by the communication means from the voice output means;
For causing the imaging apparatus to execute the program. A situation detection means for performing detection for determining occurrence of an abnormal situation;
Voice sound data generating means for generating voice sound data output as human speech;
Audio output means;
Control means for executing a voice output operation for outputting voice from voice data generated by the voice data generation means from the voice output means when it is determined that an abnormal situation has occurred based on the detection result of the situation detection means;
A voice output device comprising:

Images