JP6679442B2 - Package tracking system, package tracking method and package tracking program - Google Patents

Description

The present invention relates to a package tracking system , a package tracking method, and a package tracking program for tracking packages transported by a conveyor arranged in a package transportation area.

  2. Description of the Related Art In recent years, in the logistics business of parcels, a bar code for identifying the parcel is attached to the parcel to be delivered, for example, a bar code obtained by reading the bar code on a conveyor line provided with a conveyor. Various services such as transportation of luggage are performed using information (for example, barcode ID).

  Although parcels are often managed by bar code IDs, on the other hand, parcels may be lost or damaged every day. For example, if the package is lost due to misdelivery or is damaged during transportation, it is not easy to investigate the cause, and it takes more than one day to investigate the cause. Sometimes it ends up.

  Here, a production system described in Patent Document 1, for example, is known as a prior art for accurately grasping the production performance status of each process in a production line. In a production line in which this production system is used, the image processing apparatus traces and identifies changes in the status of workpieces moving on the production line (for example, raw material status, processing status, and inspected status) by image analysis of a monitoring camera. , Notifies the server of its identification number. The server identifies and records various data with an identification number without attaching a barcode to the work.

JP, 2010-055334, A

  In this way, when there is a problem such as loss or damage of luggage, a user such as an operator or a manager can use the information of the barcode ID along the transportation line or around the transportation line. It was necessary to check the images from the huge number of surveillance cameras provided one by one to check the situation at that time, and it was difficult to investigate the cause of the trouble.

  Further, in Patent Document 1, since the barcode is not attached to the work, as a configuration of the package tracking system for controlling the whereabouts at the time of delivery of the package in the recent physical distribution field where the barcode is attached to the package, Patent Document 1 Cannot be applied.

The present invention has been devised in view of the above-mentioned conventional situation, and in the delivery of a package, even if there is a problem such as loss or damage of the package with the package identification information attached, the cause can be efficiently investigated and the user can An object of the present invention is to provide a package tracking system , a package tracking method, and a package tracking program that improve the usability of the package.

According to the present invention, a plurality of surveillance cameras for respectively imaging different predetermined areas in a luggage transportation area in which a conveyor for transporting at least one luggage is arranged, and the luggage identification information attached to the luggage are read to identify the luggage. A reader for acquiring the information reading result and its reading time, a peripheral image of the predetermined area imaged by the surveillance camera and its imaging time, a reading result of the package identification information acquired by the reader, and its reading A recorder that records time and a corresponding time, and the default imaged by at least one of the monitoring cameras, which is associated with the reading time of the selected package identification information according to the selection of the package identification information. and a terminal device that displays on a monitor the surrounding image areas, said reader configured to any one pair of the plurality of the monitoring cameras As described above, a plurality of the terminal devices are installed in the predetermined area, the terminal device identifies area information for identifying the predetermined area, location identification information for identifying installation locations of the surveillance camera and the reader forming the pair, and the installation location. In the predetermined area, at least one of the person in charge identification information for identifying the person in charge of handling the package in the above is displayed on the monitor together with the peripheral image, and recorded in the recorder in association with the peripheral image. when the baggage scanning time of the baggage identification information is identical is equal to or larger than a predetermined number, that displays the peripheral image associated with the read time on the monitor together with the location identification information, provides a package tracking system .

Further, the present invention provides a package tracking in a package tracking system including a plurality of surveillance cameras arranged in a package transportation area in which a conveyor for transporting at least one package is arranged, a reader, a recorder, and a terminal device. In the method, the surveillance camera images different predetermined areas in the luggage transport area, the reader reads the luggage identification information attached to the luggage, and a reading result of the luggage identification information and its reading. The recorder acquires the time, and the recorder associates the peripheral image of the predetermined area imaged by the surveillance camera and its imaging time with the reading result of the package identification information acquired by the reader and its reading time. The terminal device attaches and records, and in accordance with the selection of the package identification information, the terminal device is associated with the read time of the selected package identification information, Displays a peripheral image of the predetermined area taken by even one of the monitoring cameras on a monitor, the terminal device, when the reader is unable to read the baggage identification information in a predetermined time, the cargo read immediately before There is provided a package tracking method of displaying warning information on the monitor together with the peripheral image associated with the reading time of identification information .

  ADVANTAGE OF THE INVENTION According to this invention, even if there is a trouble such as loss or damage of a package to which package identification information is added during package delivery, the cause can be efficiently investigated and the usability for the user can be improved.

The figure which shows in detail an example of the system configuration and operation outline of the package tracking system of this embodiment. The figure which shows an example of the registration content of a barcode ID list table. Block diagram showing in detail an example of the internal configuration of the barcode camera and the terminal device The figure explaining an example of the barcode reading operation by (A), (B) barcode camera. The flowchart explaining in detail one example of the reading operation procedure of the barcode camera. The figure which shows an example of the registration content of the reading time table of barcode ID. The figure which shows the example of a display of the screen displayed on a display apparatus containing the captured image imaged with the barcode camera and the omnidirectional camera. The figure which shows the example of a display of the screen displayed on a display apparatus containing a history list and the captured image imaged with the barcode camera and the omnidirectional camera. Flowchart explaining in detail one example of the lost baggage detection operation procedure in the baggage tracking system The figure explaining (A), (B) baggage size measurement. Flowchart explaining in detail one example of a damaged baggage detection operation procedure in the baggage tracking system (A) A diagram showing an example of detection of jamming occurring near a corner of a belt conveyor, (B) A diagram showing an example of detection of jamming occurring near a curve of a belt conveyor

  Hereinafter, an embodiment (hereinafter referred to as “the present embodiment”) specifically disclosing a package tracking system and a package tracking method according to the present invention will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of well-known matters and repeated description of substantially the same configuration may be omitted. This is for avoiding unnecessary redundancy in the following description and for facilitating understanding by those skilled in the art. The accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter by them. The present invention can also be expressed as a barcode camera as a surveillance camera that reads a barcode attached to a package, and a package reading method in the barcode camera.

  FIG. 1 is a diagram showing in detail an example of the system configuration and operation outline of the package tracking system 1 of the present embodiment. The baggage tracking system 1 is installed in a distribution warehouse WA as a baggage carrying area which is a facility for storing and delivering packages, for example, and tracks and monitors packages carried by a conveyor (for example, a belt conveyor 100). The distribution warehouse WA may be, for example, in a sales office of a distribution / delivery company, or may be an airport or the like. Hereinafter, although the belt conveyor 100 will be described as an example of the conveyor, the conveyor is not limited to the belt conveyor 100, and other types of conveyors may be used (see later).

  In the distribution warehouse WA, a three-dimensional warehouse (stocker) 150 for storing a large amount of parcels to be delivered, a plurality of belt conveyors 100, 110, 120 for conveying parcels shipped from the stocker 150, each belt conveyor 100, 110, A plurality of carriages 180, 181, 182, etc. for loading the luggage conveyed by 120 are provided. In addition, trucks TR1, TR2, TR3 for transferring the loads loaded on these carts 180, 181, 182 and transporting them to the destination are prepared.

  In addition, a plurality of workers p1, p2, p3, p4, p5, who manually inspect and transfer packages, are arranged at various places in the distribution warehouse WA.

  The belt conveyor 100 is a main line of physical distribution, and conveys the cargo shipped from the stocker 150 from upstream to downstream (that is, from the left side of the paper surface to the right side of the paper surface of FIG. 1). A carriage 180 is prepared at the end of the belt conveyor 100. The worker p1 transfers the luggage that has arrived at the end of the belt conveyor 100 onto the carriage 180. Further, the worker p1 carries the carriage 180 loaded with the luggage gs to the truck TR1 and transfers the luggage gs to the luggage carrier of the truck TR1. When the loading platform of the truck TR1 can approach the end of the belt conveyor 100, the luggage gs can be loaded on the loading platform of the truck TR1 without being loaded on the carriage 180.

  The belt conveyors 110 and 120 are tributary lines for physical distribution that branch off from the belt conveyor 100 at branch points TP1 and TP2, respectively, and load the goods transferred from the belt conveyor 100 to the ends of the tributary lines (that is, below the plane of FIG. 1). To the side). Carts 181 and 182 are prepared at the ends of the belt conveyors 110 and 120, respectively. The workers p4 and p5 transfer the cargo gs arriving at each end of the belt conveyors 110 and 120 to the carriages 181 and 182, respectively. Even in the tributary line, when the loading platforms of the trucks TR2 and TR3 can approach to the end of the belt conveyors 110 and 120, the luggage gs is loaded on the loading platforms of the trucks TR2 and TR3 without being transferred to the carts 181 and 182. It is also possible to change.

  Further, the workers p1, p4, p5 arranged at the ends of the belt conveyors 100, 110, 120 carry bar code readers BR1, BR2, BR3, respectively, and carry various loads gs with carts 180, 181, respectively. At the time of transfer to 182, the bar code BCL as the package identification information attached to each package gs is read. In the present embodiment, when it is not necessary to distinguish the belt conveyors 100, 110, 120, the belt conveyor 100 will be described as a representative.

  Further, at the branch points TP1 and TP2 of the belt conveyor 100 of the main line and the belt conveyors 110 and 120 of the tributary line, the workers p2 and p3 that perform the transfer of the cargo gs conveyed by the belt conveyor 100 are In particular, the bar code reader is not carried and the baggage gs is replaced as it is, but the bar code reader may be carried to read the bar code attached to the baggage gs. Further, as a case where the barcode BCL is attached to the parcel gs, it is assumed that a label having a barcode printed thereon is attached to the parcel, but the barcode may be printed on the parcel itself. Further, the barcode is not limited to the two-dimensional barcode, and may be various barcodes such as a three-dimensional barcode and a color code.

  In the distribution warehouse WA, the transfer of the load from the belt conveyor 100 of the main line to the belt conveyors 110 and 120 of the tributary line is manually performed by an operator, but is automatically performed by a sorter (that is, an automatic sorting device). Sorting may be performed. In the case of manual labor, it is possible that an operator may accidentally transfer the luggage or hit the luggage on another place to damage it. On the other hand, in the case of automatic sorting by the sorter, there is a possibility that the parcel is conveyed to another belt conveyor due to an error in the bar code attached to the parcel or the like. In any case, in the distribution warehouse WA, loss or damage due to erroneous delivery of parcels occurs to some extent.

  The package tracking system 1 according to the present embodiment includes an arrival information management device 2, a video recording device 3, a terminal device 4, a display device 5, an article management device 6, and a plurality of camera pairs 7, 8, 9, 10, 11. .

  The arrival information management device 2 acquires and stores the arrival information of parcels. The arrival information is a list of bar code IDs, which are package identification information attached to all packages to be carried in. FIG. 2 is a diagram showing an example of registered contents of the barcode ID list table TL0. In the bar code ID list table TL0, the bar code IDs are recorded in the order of the parcels that flow on the belt conveyor 100. Further, in the bar code ID list, carry-out port information such as carry-out ports DP1, DP2, DP3, ..., In which the package gs to which the bar code corresponding to the bar code ID is attached should be transported in the distribution warehouse WA is also registered. To be done. The carry-out port information corresponds to the destination information of the package described in the barcode ID or associated with it (in other words, the destination of the package to be delivered). In FIG. 2, barcode IDs are recorded in the order of No1, No2, No3, No4, .... Further, the arrival information management device 2 holds a table (not shown) in which the person who has deposited the parcel (that is, the client who has delivered the parcel) and the bar code ID are associated with each other.

  The video recording device 3 as a recorder has a timer (not shown), and the image data captured by each of the plurality of camera pairs 7, 8, 9, 10, and 11 and the time measured by the timer (that is, the captured image). (Time) is associated and recorded. In addition, the video recording device 3 includes image data captured by a plurality of camera pairs 7, 8, 9, 10, 11 and their image capturing times, and barcode cameras BCA1, BCA2, BCA3, BCA4, BCA5 or barcodes. The barcode ID read by the readers BR1, BR2, BR3 and the reading time thereof may be recorded in association with each other. Further, the video recording device 3 outputs, in accordance with the instruction from the article management device 6, information on image data and imaging time corresponding to the instruction to the terminal device 4 and the article management device 6.

  The plurality of camera pairs 7, 8, 9, 10, 11 are omnidirectional cameras CA1, CA2, CA3, CA4, CA5 as surveillance cameras and bar code cameras BCA1, BCA2 as surveillance cameras and bar code detection cameras, respectively. A pair of BCA3, BCA4, and BCA5 is provided. The camera pairs 7, 8, 9 are arranged at monitoring points WP1, WP2, WP3 located from the upstream side to the downstream side of the belt conveyor 100, which is the main line. The camera pairs 7, 8 and 9 arranged at the monitoring points WP1, WP2 and WP3 are capable of capturing images of different predetermined areas ARE1, ARE2 and ARE3 in the luggage transport area where the luggage gs is transported by the belt conveyor 100, respectively.

  Further, the camera pairs 10 and 11 are arranged at the branch points TP1 and TP2 at the monitoring points WP4 and WP5 respectively located on the belt conveyors 110 and 120 which are tributary lines branched from the belt conveyor 100. The monitoring points WP4 and WP5 are capable of capturing images of different predetermined areas ARE4 and ARE5, respectively, in the luggage transport area where the luggage gs is transported by the belt conveyors 110 and 120, respectively. In the present embodiment, the default areas ARE1, ARE2, ARE3, ARE4, and ARE5 are simply referred to as the default areas ARE unless it is necessary to distinguish them.

  The omnidirectional cameras CA1, CA2, CA3, CA4, CA5 are cameras equipped with a fisheye lens having an angle of view of 360 degrees and capable of capturing 360 degree omnidirectional images (fisheye images). , 120 above (for example, the ceiling). The omnidirectional cameras CA1, CA2, CA3, CA4, CA5, according to an instruction from the terminal device 4 or the article management device 6, include a predetermined area ARE1 so as to include the passage position of the luggage conveyed by the belt conveyors 100, 110, 120. , ARE2, ARE3, ARE4, ARE5 are picked up, and the picked-up images (also referred to as "peripheral images") are output together with the picked-up time to the video recording device 3 for recording.

  The bar code cameras BCA1, BCA2, BCA3, BCA4, BCA5 image the luggage gs conveyed by the belt conveyors 100, 110, 120 and output the captured image to the video recording device 3 together with the image capturing time for recording. In addition, the barcode cameras BCA1, BCA2, BCA3, BCA4, BCA5 as an example of the reader detect the barcode BCL attached to the luggage based on the captured images when they are captured by the barcode cameras BCA1, BCA2, BCA3, BCA4, BCA5. Is read, and the bar code ID (bar code information) that is the read result is output to the video recording device 3 together with the reading time for recording, and is also output to the terminal device 4 or the article management device 6. Details of the barcode cameras BCA1, BCA2, BCA3, BCA4 and BCA5 will be described later. The reading operation of the barcode BCL can be performed by the terminal device 4 or the article management device 6 instead of the barcode camera.

  The terminal device 4 is configured using, for example, a personal computer device, receives an input of a barcode ID via the operation unit 46 that receives a user operation, searches the input barcode ID, and displays a history list indicating the detection result. (That is, a reading history list in which barcode IDs of barcodes read by a barcode camera or a barcode reader in the luggage transport area are arranged in order of reading time, see FIG. 8) is displayed on the display device 5.

  The terminal device 4 also executes various image display processes for displaying the image data input from the video recording device 3 on the display device 5. Further, the terminal device 4 controls the operation of the belt conveyor 100 or the like that conveys various loads. Further, when there is a trouble such as loss or damage of luggage, the terminal device 4 performs a detection operation for investigating the cause. The details of these detection operations will be described later.

  The display device 5 as a monitor divides a screen, for example, and displays images captured by the plurality of camera pairs 7, 8, 9, 10, and 11. Further, the display device 5 displays a history list hst (see FIG. 8) showing the detection result of the barcode ID.

  The article management device 6 has an image database (DB) and has bar code cameras BCA1, BCA2, BCA3, BCA4 for the respective loads gs1, gs2, gs3, ... Conveyed by the belt conveyors 100, 110, 120. The bar code ID read by the BCA5 and its reading time, the images (peripheral images) taken by the omnidirectional cameras CA1, CA2, CA3, CA4, CA5, and the imaging time thereof are acquired from the video recording device 3, and the time is obtained. The information is stored and managed together with the information (that is, the image capturing time and the barcode ID reading time). In the present embodiment, if there is no particular need to distinguish between the loads gs1, gs2, and gs3, they are collectively referred to as the load gs. Further, the article management device 6 manages the delivery destination of the parcel gs by the bar code ID (see FIG. 2), and in particular, the carry-out ports DP1 and DP2 of the parcel gs that are shipped from the stocker 150 and conveyed by the belt conveyor 100. , DP3 is managed.

  FIG. 3 is a block diagram showing in detail an example of the internal configuration of the barcode cameras BCA1, BCA2, BCA3, BCA4, BCA5 and the terminal device 4. The barcode cameras BCA1, BCA2, BCA3, BCA4 and BCA5 have the same configuration. In the present embodiment, the bar code cameras BCA1, BCA2, BCA3, BCA4, BCA5 are collectively referred to as the bar code camera BCA unless it is necessary to distinguish them.

  The barcode camera BCA is a camera capable of generating an image of a package (an image based on visible light) by inputting light reflected by the package and capturing the image, and a barcode attached to the package included in the captured image. Is read by an image sensing method of electronically scanning, and if the reading is successful, the barcode ID of the barcode is acquired. The barcode camera BCA includes an image sensor 21, a lens 22, a sensor driving unit 24, a laser diode (LD) 27, an LD driving unit 28, a diffusion plate (diffuser) 29, a temperature sensor 26, a signal processing unit 30, a communication unit 31, And a speaker 33.

  The image sensor 21 as an imaging unit acquires image data of an object by entering light reflected by the object and imaging the same, and is configured by, for example, a CMOS (complementary metal oxide semiconductor) sensor. . A CCD (charge coupled device) sensor may be used instead of the CMOS sensor. Further, when the barcode camera BCA measures the distance to the outer shape of the luggage gs, and when the laser light projected from the LD 27 is reflected by the luggage gs, the image sensor 21 reflects the reflected light into pixels (or a predetermined number of pixels). Light is received in units of pixel groups.

  The lens 22 focuses the incident light on the image sensor 21. The lens 22 is a wide-angle lens capable of capturing a relatively wide area including the belt conveyor 100 on which the luggage gs is placed, and a narrow-angle lens capable of capturing a relatively narrow area surrounding the barcode BCL attached to the luggage gs. Can be switched. Switching between the wide-angle lens and the narrow-angle lens may be realized according to a control signal from the sensor driving unit 24, for example. Further, switching between the wide-angle lens and the narrow-angle lens is realized by using, for example, a known liquid lens. By using the liquid lens, the angle of view captured by the image sensor 21 can be easily switched to the wide angle or the narrow angle, and the number of parts can be reduced and the size can be reduced.

  The sensor driving unit 24 controls the exposure time and the like of the image sensor 21 according to the instruction from the signal processing unit 30. Further, the sensor driving unit 24, in accordance with an instruction from the signal processing unit 30, instructs, for example, switching between the wide-angle lens having the wide-angle field angle and the narrow-angle lens having the narrow-angle field angle of the lens 22 in a time division manner. Thereby, the lens 22 can switch the wide-angle lens and the narrow-angle lens in a time division manner.

  An LD (Laser Diode) 27 emits a laser beam (for example, near-infrared light) used for measuring the distance to the outer shape of the luggage gs according to a control signal from the LD drive unit 28. The LD 27 may be configured by using an LED (Light Emission Diode) instead of the light source of the laser light, and in this case, emits the LED light.

  The LD drive unit 28 outputs a control signal for driving the LD 27 according to an instruction from the signal processing unit 30. The diffuser plate (diffuser) 29 diffuses the laser light output from the LD 27 so that the entire luggage can be irradiated. The temperature sensor 26 detects a temperature for controlling the temperature of the LD 27 that is easily affected by the temperature.

  The signal processing unit 30 performs various signal processing on the image signal output from the image sensor 21 and outputs the image signal. Further, the signal processing unit 30 outputs a drive signal to the sensor drive unit 24 when reading the barcode. The signal processing unit 30 also outputs a drive signal to the LD drive unit 28 when measuring the distance. Further, the signal processing unit 30 outputs a control signal for switching the angle of view to the sensor driving unit 24 when switching the angle of view of the lens 22.

  The communication unit 31 performs data communication with the terminal device 4, and outputs the image data output from the signal processing unit 30 and the barcode ID output from the barcode camera BCA to the terminal device 4.

  The speaker 33 outputs different sounds (sound information) depending on whether the barcode BCL has been successfully read (sound information) (see FIGS. 4A and 4B).

  In the barcode camera BCA having such a configuration, the two-dimensional image captured at a narrow angle by the barcode camera BCA is an image used for reading the barcode BCL attached to the luggage gs, for example, the luggage. When there is a trouble such as erroneous delivery or damage of gs, it is used for grasping the status of erroneous delivery depending on whether or not the barcode ID was read when investigating the cause. The two-dimensional image may be used for grasping the presence or absence of damage in a plan view, although it is not as large as the distance image (three-dimensional image) of the luggage gs described later.

  On the other hand, the two-dimensional image captured by the barcode camera BCA at a wide angle is an image of a predetermined area including the luggage gs conveyed by the belt conveyor, and there is a problem such as erroneous delivery or damage of the luggage gs. In case of trouble, it is used to understand the situation at the time of trouble in the default area when investigating the cause.

  Further, the barcode camera BCA measures the distance to the object by irradiating a laser beam from the LD 27 and receiving the reflected light by using a known TOF (Time of Flight) technique. That is, the barcode camera BCA acquires an image (distance image) representing the three-dimensional shape of the luggage gs by measuring the distance to the outer shape of the luggage gs. The terminal device 4 determines whether the luggage gs is damaged from the distance image (three-dimensional image) of the luggage gs acquired by the barcode camera BCA.

  The LD 27 in the barcode camera BCA is arranged in an inclined state so that laser light can be projected from an oblique direction with respect to the luggage gs conveyed on the belt conveyor 100.

  FIG. 4A and FIG. 4B are views for explaining the barcode reading operation by the barcode camera BCA.

  When the parcel gs conveyed by the belt conveyor 100 passes through the reading position (monitoring point) by the bar code camera BCA, as shown in FIG. 4A, when the bar code BCL is attached to the parcel gs, The barcode camera BCA captures an image around the barcode BCL, performs image processing on this image, and reads the barcode ID. When the reading of the barcode BCL is successful, the barcode camera BCA outputs a short and high-pitched sound from the speaker 33.

  On the other hand, as shown in FIG. 4B, when the bar code BCL is not attached to the luggage gs, or when the luggage gs falls and the barcode BCL cannot be read, the barcode camera BCA uses the speaker 33. Outputs a long and low sound called "Boo". As a result, a user such as a worker near the barcode camera BCA can immediately know the success or failure of reading the barcode BCL.

  FIG. 5 is a flowchart illustrating in detail an example of a reading operation procedure of the barcode camera BCA. The barcode camera BCA captures a wide-angle image of the predetermined area ARE including the belt conveyor 100 on which the luggage gs is conveyed (S1). The barcode camera BCA determines whether or not the image captured at this wide angle includes the barcode BCL (entire barcode) (S2). The processes of step S1 and step S2 are repeated in the barcode camera BCA until the barcode BCL is included (S2, NO).

  On the other hand, when the barcode BCL is included (S2, YES), the barcode camera BCA images a region including the barcode BCL with a narrow angle. The barcode camera BCA cuts out an area including the barcode BCL from the image captured at a narrow angle (S3). Note that the barcode camera BCA may partially cut out the region including the barcode BCL from the captured image that is simply captured at the wide angle, without capturing the region including the barcode BCL at the included angle.

  The barcode camera BCA performs image processing on the image of the clipped area and reads the barcode ID (S4). The barcode camera BCA outputs the barcode ID which is the reading result to the terminal device 4 together with the reading time (S5). The terminal device 4 adds this barcode ID to the reading time table TL1 (see FIG. 6) stored in the memory 42 together with the reading time. Further, at this time, the image (peripheral image) of the predetermined area ARE imaged in a wide angle by the barcode camera BCA in step S1 and its imaging time are recorded in the video recording device 3 together with the barcode ID and the reading time of the barcode ID. Will be recorded. Further, the omnidirectional camera CA constantly captures an image while the power is turned on, captures an omnidirectional image (peripheral image) of the predetermined area ARE, and records the omnidirectional image on the video recording device 3 together with the capturing time. Output and record.

  After that, the barcode camera BCA determines whether or not to end the imaging by turning off the power, time-out, or the like (S6). When the image pickup is ended, the barcode camera BCA ends this operation, while when the image pickup is continued, the process returns to the process of step S1.

  FIG. 6 is a diagram showing an example of registered contents of the bar code ID reading time table TL1. The reading time table TL1 stores a list of bar code IDs read in time series by the bar code cameras BCA1, BCA2, BCA3, BCA4, BCA5. For example, the barcode ID “AABBBB123” is registered at the reading time “10:10:30”, and the barcode ID “DDBBB123” is registered at the reading time “10:10:33”.

  Here, returning to the description of FIG.

  In FIG. 3, the terminal device 4 is a computer device that controls the entire operation of the package tracking system 1, and includes a processor 41, a memory 42, a communication unit 43, a hard disk 44, a display control unit 45, and the like. The processor 41 controls each unit of the terminal device 4.

  The memory 42 stores a luggage transportation control program executed by the processor 41. The memory 42 also temporarily stores data such as the reading time table TL1. The hard disk 44 is a storage memory that stores various data.

  The display control unit 45 controls the display of the display device 5 connected to the terminal device 4. The communication unit 43 is connected to a plurality of barcode cameras BCA1, BCA2, BCA3, BCA4, BCA5, omnidirectional cameras CA1, CA2, CA3, CA4, CA5, an article management device 6, an image recording device 3, and the like, and between them. To perform data communication.

  FIG. 7 is a diagram showing a display example of a screen 5z displayed on the display device 5 including a captured image captured by the barcode camera BCA and the omnidirectional camera CA. In FIG. 7, the screen 5z of the display device 5 is divided into nine parts. It should be noted that the number of screen divisions may be any number, such as six or three.

  The upper three split screens that form the screen 5z are referred to as split screens 5z-1, 5z-2, and 5z-3 from the left. Similarly, the middle three split screens are referred to as split screens 5z-4, 5z-5, 5z-6 from the left side. Similarly, the lower three split screens are referred to as split screens 5z-7, 5z-8, and 5z-9 from the left side.

  An omnidirectional image (peripheral image iga) of each predetermined area ARE captured by the omnidirectional cameras CA1, CA2, CA3 is displayed on the lower three divided screens 5z-7, 5z-8, 5z-9. . In addition, in the middle three divided screens 5z-4, 5z-5, 5z-6, a predetermined area including the load gs conveyed by the belt conveyor, which is captured by the barcode cameras BCA1, BCA2, BCA3 at wide angles, respectively. A captured image (peripheral image igb) is displayed. On the divided screens 5z-4 and 5z-5, when the load is conveyed by the belt conveyor 100, the bar code BCL attached to the load can be read. The divided screen 5z-6 does not have the bar code BCL attached to the luggage conveyed by the belt conveyor 100.

  Further, on the top three split screens 5z-1, 5z-2, 5z-3, images around the barcode BCL attached to the luggage gs, which are captured by the barcode cameras BCA1, BCA2, BCA3 at narrow angles, are displayed. Is displayed. However, since the barcode BCL is not attached to the luggage gs on the divided screen 5z-3, nothing is displayed. Instead of displaying nothing, a substitute image indicating that there is no barcode, a message, a mark, or the like may be displayed.

  Further, in the screen 5z of the display device 5, the three divided screens in the vertical (row) direction respectively correspond to the camera pairs arranged at the respective monitoring points WP. For example, the split screens 5z-1, 5z-4, and 5z-7 are captured images captured by the camera pair 7, that is, the barcode camera BCA1 and the omnidirectional camera CA1 arranged at the monitoring point WP1 on the upstream side of the belt conveyor 100. Is displayed. Similarly, the split screens 5z-2, 5z-5, 5z-8 are imaged by the camera pair 8, that is, the barcode camera BCA2 and the omnidirectional camera CA2 arranged at the monitoring point WP2 on the middle stream side of the belt conveyor 100. The captured image is displayed. Similarly, the split screens 5z-3, 5z-6, 5z-9 are imaged by the camera pair 9, that is, the barcode camera BCA3 and the omnidirectional camera CA3, which is arranged at the monitoring point WP3 on the downstream side of the belt conveyor 100. The captured image is displayed.

  As described above, since the three captured images in the vertical (row) direction, which are arranged on the screen 5z of the display device, are images captured by the camera pair at the same monitoring point WP, the user can monitor each monitoring point WP. The captured image at is easy to see and can be intuitively determined.

  Further, for example, when the user designates a certain camera pair from the camera pairs 7, 8, 9, 10, 11 at the monitoring points WP1, WP2, WP3, WP4, WP5, the image captured by the designated camera pair is displayed on the screen. It is displayed on the split screens 5z-2, 5z-5, 5z-8 in the central column of 5z. On the split screens 5z-1, 5z-4, 5z-7 in the left column, captured images by a camera pair arranged one upstream from the designated camera pair are arranged. Similarly, on the split screens 5z-3, 5z-6, and 5z-9 in the right column, images picked up by a camera pair arranged one downstream of the designated camera pair are arranged.

  In this way, on the screen 5z of the display device 5, by associating the split screens arranged in the vertical direction with the camera pairs arranged on the belt conveyor 100, the user displays the images captured by the camera pairs on the split screens. Is easy to distinguish intuitively and is easy to visually recognize.

  FIG. 8 is a diagram showing a display example of a screen 5y which is displayed on the display device 5 and includes the history list hst and captured images captured by the barcode camera BCA and the omnidirectional camera CA. The screen 5y of the display device 5 is divided into a left screen 5y1 and a right screen 5y2. On the right screen 5y2, similar to the screen of FIG. 7, the divided screens 5y2-1, 5y2-2, 5y2-3, 5y2-4, 5y2-5, 5y2-6, 5y2-7, 5y2 are divided into nine. -8,5y2-9 is displayed.

  On the other hand, on the left screen 5y1, the history list hst in which the barcode ID is detected is displayed. The history of the detection information of the barcode ID input by the user's input operation is registered in the history list hst. As the detection information of the barcode ID, time information, area identification ID (area identification information), camera position identification ID (location identification information), responsible person identification ID (person identification information) are displayed. By displaying these pieces of detection information, search for the luggage gs to which the barcode ID is attached (for example, in which predetermined area the luggage gs exists, in which camera pair the luggage gs exists). It's easy). Further, it is possible to clarify whereabouts of the person in charge of handling the parcel gs to which the barcode ID is attached, such as the responsibility.

  When the user selects a column (dotted frame e in the figure) registered in the history list hst by clicking or the like, a captured image corresponding to the column is displayed on the right screen 5y2. On the right screen 5y2, an omnidirectional image captured by the omnidirectional camera CA (peripheral image iga) and an image captured by the barcode camera BCA at a wide angle (peripheral image igb) are respectively displayed as split screens configuring the right screen 5y2. Is displayed. Various images can be displayed on the other split screens. For example, a captured image captured by a camera pair adjacent to the camera pair corresponding to the selected column may be displayed.

  The operation of the package tracking system 1 having the above configuration will be described in detail.

(Loss of luggage)
First, a case where the package gs shipped from the distribution warehouse WA is lost due to erroneous delivery or the like will be described. For example, the parcel gs is conveyed in the order of the monitoring point WP1 → the monitoring point WP2 → the monitoring point WP3 of the main line of the belt conveyor 100, and is misdelivered by deviating from the correct route of being loaded and delivered by the worker p1 on the truck TR1. I will explain the case.

  FIG. 9 is a flowchart illustrating in detail an example of a lost baggage detection operation procedure in the baggage tracking system 1. When a user such as a worker or an administrator uses the operation unit 46 to input, for example, a barcode ID of a lost baggage, the terminal device 4 acquires the barcode ID and temporarily stores it in the memory 42 ( S11).

  The terminal device 4 uses the image database stored in the article management device 6 to store various images associated with the input barcode ID (that is, a package to which a barcode corresponding to the barcode ID is attached. Each image captured by the omnidirectional camera or the barcode camera is searched (S12).

  As a result of the image search, the terminal device 4 associates the corresponding barcode ID with the peripheral image stored in the article management device 6 and its time information (specifically, the reading time of the barcode ID and the peripheral image). (Imaging time) is acquired. The terminal device 4 determines that the barcode ID is a tributary line at the branch point TP2 based on various acquired data (peripheral image, barcode ID reading time, peripheral image capturing time) associated with the barcode ID. It is confirmed that this barcode ID is detected by the barcode camera BCA2 at the monitoring point WP2 before being distributed (branched), that is, before cutting (S13).

  Further, the terminal device 4 determines that the barcode ID is based on the acquired various data (peripheral image, reading time of the barcode ID, imaging time of the peripheral image) associated with the barcode ID on the main line (route). It is confirmed that the barcode camera BCA3 has not detected it at the monitoring point WP3) (S14).

  Further, the terminal device 4 determines the barcode ID at the monitoring point WP5 based on the acquired various data (peripheral image, barcode ID reading time, peripheral image capturing time) associated with the barcode ID. It is confirmed that it has been detected (S15).

  On the basis of the information confirmed in steps S13 to S15, the terminal device 4 actually outputs the barcode ID managed by the article management device 6 at the outlet DP1 audited at the monitoring point WP3. Is the carry-out port DP2 that is inspected at the monitoring point WP5, and as a result, it is determined that the parcel gs was carried on the wrong route.

  The terminal device 4 has an omnidirectional camera CA5 arranged at the monitoring point WP5 and an omnidirectional image by the omnidirectional cameras CA2 and CA3 arranged at the monitoring points WP2 and WP3 before and after the branch point TP2, that is, before and after cutting. The omnidirectional image is reproduced, and an image in which an error has occurred during transportation (peripheral image iga) is acquired (S16). Note that the terminal device 4 may output the image (peripheral image iga) acquired in step S16 to the display device 5 to reproduce and display the image.

  In this case, as an image in which an error occurs during transportation, for example, an image in which the worker p3 mistakenly transfers the load on the belt conveyor 100 to the belt conveyor 120 can be cited. It should be noted that this image may be a still image, or may be a moving image for a short time so that the transfer by the worker can be understood.

  On the other hand, if the transportation route of the package shown in the images captured at the monitoring points WP1 to WP5 is correct, the incorrect delivery of the package may cause the package to be misdelivered. It is also assumed that the truck from which the luggage is transferred is wrong. In addition, it is assumed that the loaded truck is wrong at the stage where the truck is loaded directly onto the loading platform of the truck.

  The terminal device 4 stores the image in which an error has occurred during transportation as an evidence image in the hard disk 44 (S17). After that, the terminal device 4 ends this operation.

  As a result, the user such as the administrator can quickly confirm the cause of the erroneous delivery by checking the evidence image stored in the hard disk 44 of the terminal device 4. Here, the peripheral image is both an omnidirectional image (fish-eye image) captured by the omnidirectional camera CA and an image captured by the barcode camera BCA at a wide angle so as to include a belt conveyor and the like. However, either one may be used.

  The above process is executed when a user such as a worker or an administrator notices that the parcel is lost and inputs the barcode ID of the lost parcel to the operation unit 46, for example (trigger). However, if the user is not aware that the luggage is lost, the terminal device 4 may display a message that there is a possibility of loss.

  For example, if the bar code cannot be read by the next bar code camera BCA even after a lapse of a predetermined time after the bar code of the baggage conveyed on the belt conveyor is read, it is highly possible that the baggage was lost on the way. In this case, the terminal device 4 causes the display device 5 to display the peripheral images iga and igb associated with the time information of the reading time immediately before the barcode is read, together with the warning information. The warning information may be a message or a specific mark.

  The user can quickly notice the loss of the luggage by looking at the warning information displayed together with the peripheral image. After that, the user takes the same measures as described above, such as inputting the barcode ID of the baggage for which a warning has been issued to the operation unit 46. As a result, it is possible to respond promptly when the luggage is lost.

  Further, in the above-mentioned processing, the processing is executed upon the input of the user, but without waiting for the input of the user, for example, even after a predetermined time has elapsed since the barcode of the parcel conveyed on the belt conveyor was read. If the bar code cannot be read by the next bar code camera BCA, it may be automatically executed because there is a high possibility that the luggage is lost. In this case, the user can grasp the fact of the loss and the investigation of the cause thereof at the same time by looking at the image in which the error occurred during the transportation.

(Luggage damage)
Next, a case where the package gs shipped from the distribution warehouse WA is damaged will be described. Here, a case will be described in which the outer shape of the package is changed during the process from when the package is loaded to when the package is unloaded, and the package is damaged.

  10 (A) and 10 (B) are diagrams for explaining the size measurement of the luggage gs. As shown in FIG. 10A, the barcode camera BCA acquires a normal captured image (that is, a captured image based on visible light) obtained by the visible light being reflected by the luggage gs and imaged by the image sensor 21. To do.

  Further, the barcode camera BCA irradiates the luggage gs with laser light (for example, near infrared light) from the LD 27. In the barcode camera BCA, the reflected light of the laser light reflected by the luggage gs enters through the lens 22 and is imaged by the image sensor 21 to generate a distance image of the luggage gs based on the irradiation of the laser light. Further, the bar code camera BCA measures the distance to each position of the outer shape of the luggage gs by using the well-known TOF (Time of Flight) technology when irradiating the laser light from the LD 27.

  Note that the barcode camera BCA switches the presence or absence of irradiation of the LD 27 in a time-division manner, controls so that the LD 27 is not irradiated when capturing a captured image based on visible light, while irradiating the LD 27 for distance. A visible light cut filter (not shown) for controlling the reflected light component of the visible light to be cut when capturing an image is arranged on the front side of the image sensor 21 (that is, the incident direction side of the reflected light). It is preferable to control as follows. As a result, the barcode camera BCA can improve the image quality of both the captured image and the range image based on visible light.

  As shown in FIG. 10B, the barcode camera BCA acquires a stereoscopic image (distance image) representing the outer shape of the luggage gs based on the distance information. The distance image (three-dimensional image) acquired by the barcode camera BCA is stored in the image database of the article management device 6. In addition, the barcode camera BCA captures a two-dimensional image (RGB image) of the baggage gs by the image sensor 21, stores it in the image database of the article management device 6 in association with the three-dimensional image.

  The terminal device 4 reads out the three-dimensional image stored in the image database of the article management device 6, and determines whether or not the package is damaged from the three-dimensional image acquired by the barcode camera BCA.

  The barcode camera BCA is arranged in a tilted state so that the LD 27 can project laser light from an oblique direction onto the luggage gs conveyed on the belt conveyor 100. This makes it easy to obtain distance information that represents the outer shape of the package.

  In this way, the barcode camera BCA acquires the luggage image by capturing the luggage with the image sensor 21, and measures the distance to the outer shape of the luggage with the LD 27 to obtain the distance information.

  Upon receiving the parcel image and the distance information from the barcode camera BCA, the terminal device 4 displays the three-dimensional image (distance image) and the parcel image based on the distance information on the display device 5. Furthermore, the terminal device 4 determines the size of the luggage based on the distance information. A graphical user interface (GUI) 200 is displayed on the screen 5z of the display device 5. On this GUI 200, a parcel image GZ1, a distance image GZ2, and a size measurement table TL2 are arranged.

  Various measurement values including the lengths of the three sides (long side, short side, height) of the luggage gs are registered in the size measurement table TL2. In FIG. 10, the size of the bag gs is 600.00 mm in total of three sides, 270 mm in short side, and 270 mm in short based on the measured values of the total of 603 mm on three sides, the long side of 272 mm, the short side of 200 mm, and the height of 130 mm. Since the side is 200 mm and the height is 130 mm, it is determined that the luggage gs is not damaged. The processing time for determining the size of the luggage gs is 223.59 msec.

  FIG. 11 is a flowchart illustrating in detail an example of a damaged baggage detection operation procedure in the baggage tracking system 1. Here, a case where the load gs is damaged between the monitoring points WP1 and WP2 in the belt conveyor 100 which is the main line will be described.

  When the worker uses the barcode reader BR to read the barcode BCL of the damaged luggage gs, the terminal device 4 confirms the barcode ID of the damaged luggage gs and stores it in the memory 42 (S21). Here, the bar code BCL of the damaged baggage gs is read by a user such as an operator. However, the terminal device 4 causes the barcode camera BCA to read the distance information of the luggage gs, obtains the distance information, and compares the distance information with the measurement value of the size of the luggage gs input in advance. It is also possible to automatically determine whether or not the item is damaged, and if it is determined that the package gs is damaged, the bar code camera BCA can read the bar code BCL to acquire the bar code BCL.

  The terminal device 4 retrieves the distance image of the luggage gs captured by the barcode camera BCA, which is stored in the image database of the article management device 6 based on the barcode ID (S22).

  The terminal device 4 compares the three-dimensional shape of the luggage gs obtained from the distance image captured by the barcode camera BCA1 with the three-dimensional shape of the luggage gs obtained from the distance image captured by the barcode cameras BCA2 and BCA4 ( S23). The terminal device 4 identifies the barcode camera in which the change in the appearance (three-dimensional shape) of the luggage gs is detected (S24). Here, it is assumed that a change is detected in the three-dimensional shape of the luggage gs obtained by the barcode camera BCA2.

  When the terminal device 4 detects the change in the three-dimensional shape by the barcode camera BCA2, the omnidirectional images before and after the passage of the luggage gs are captured by the omnidirectional cameras CA1 and CA2 arranged at the monitoring points WP1 and WP2, respectively. It is confirmed and an omnidirectional image (damage cause image) that caused the damage is acquired (S25). The damage cause image is an image showing some kind of damage cause such as the load gs falling from the belt conveyor 100, the worker hitting the load, or the like. Here, the damage cause image is confirmed in the omnidirectional image captured by the omnidirectional camera CA, but the damage cause image may be confirmed in the image captured by the barcode camera BCA at a wide angle.

  The terminal device 4 displays the image (distance image) representing the three-dimensional shape based on the barcode ID, time information, and distance information read by the barcode camera BCA, and the damage cause image captured by the omnidirectional camera CA as evidence images. Is stored in the hard disk 44 (S26). The damage cause image stored as the evidence image may be marked by adding a flag, which is effective when searching for the damage cause image. Further, by comparing the distance image and the damage cause image, a deeper cause investigation can be performed. After that, the terminal device 4 ends this operation.

  As a result, users such as workers and managers can quickly investigate the cause of damage to the luggage gs. Although the terminal device 4 performs the process of searching for the damage cause image here, the barcode camera BCA can also be configured to make the determination by the camera itself using the captured image and the distance image. Therefore, the processing load of the terminal device 4 can be reduced.

(Jamming detection)
12A and 12B are diagrams illustrating an example of jamming detection. FIG. 12A is a diagram illustrating a detection example of jamming that occurs near the corner of the belt conveyor 210. The belt conveyor 210 has a corner that bends at a substantially right angle. Assume that a large baggage gs11 is jammed at this corner.

  In this case, the conveyed baggage gs11 is detected by the barcode camera BCA11 that images the baggage loaded on the belt conveyor 210 over a long distance. When the luggage gs11 arrives at the corner, the barcode camera BCA12 images the luggage gs11, and the arrival of the luggage gs11 is detected.

  When the large baggage gs11 is not able to turn through the corner and stays, that is, when jamming (jamming) occurs, the barcode camera BCA12 continues to detect the same baggage gs11 even after a lapse of time. . Further, the barcode camera BCA13 arranged downstream thereof cannot detect the luggage gs even if the passenger waits because the luggage gs11 remains at the corner.

  As described above, in the baggage tracking system 1 of the present embodiment, if the barcode camera BCA12 continues to detect the baggage gs11 or if the barcode camera BCA13 does not detect the baggage gs after waiting for a certain period of time, the baggage gs stays detected. It is possible to do (jamming detection). When jamming detection is performed, the barcode camera BCA captures a wide-angle image, or the omnidirectional camera CA captures an omnidirectional image as a jamming detection image. The terminal device 4 obtains these jamming detection images and stores the bar code ID, time information, and jamming detection image in the image database of the article management device 6, which is useful for investigating the cause of the jamming. Can be made. Further, when the jamming detection is performed, the terminal device 4, together with the peripheral image at the reading time, the position identification information indicating the position of the monitoring point WP where the camera pair is installed as the location where the jamming (jamming) occurs. , Are displayed on the display device 5. Further, the terminal device 4 adds the warning information and displays the peripheral image. As a result, the user can quickly know the location where jamming (jamming) has occurred.

  FIG. 12B is a diagram illustrating an example of detecting jamming that occurs near the curve of the belt conveyor 220. The belt conveyor 220 has a curve that bends with a predetermined curvature. It is assumed that a plurality of small loads gs are jammed on this curve.

  When a plurality of loads gs are jammed on a curve, the barcode ID read by the barcode camera BCA15 will be read many times. When the same barcode ID is read a predetermined number of times, the terminal device 4 determines that a jam has been detected. Further, when a plurality of packages are staying in the angle of view of the barcode camera BCA15, a plurality of barcodes are detected at the same reading time, and a plurality of barcodes having the same reading time (time information) are detected. When the number of pieces of luggage exceeds a predetermined number, the terminal device 4 determines that a jam has been detected. As a result, jamming can be detected early.

  When the jamming detection is performed on the curve, the barcode camera BCA captures an image at a wide angle or the omnidirectional camera CA captures an omnidirectional image as in the case of the corner. The terminal device 4 obtains these jamming detection images and stores the bar code ID, time information, and jamming detection image in the image database of the article management device 6, which is useful for investigating the cause of the jamming. Can be made. Further, when the jamming detection is performed, the terminal device 4, together with the peripheral image at the reading time, the position identification information indicating the position of the monitoring point WP where the camera pair is installed as the location where the jamming (jamming) occurs. , Are displayed on the display device 5. Further, the terminal device 4 adds the warning information and displays the peripheral image. As a result, the user can quickly know the location where jamming (jamming) has occurred.

  As described above, in the parcel tracking system 1 of the present embodiment, the plurality of omnidirectional cameras CA have different predetermined areas ARE in the physical distribution warehouse WA in which the belt conveyors 100, 110, 120 that convey at least one parcel gs are arranged. Are imaged respectively. The barcode camera BCA (reader) reads the barcode BCL attached (attached) to the luggage gs, and obtains the barcode ID (reading result of the luggage identification information) and its reading time. The video recording device 3 records the peripheral image iga of the predetermined area ARE imaged by the omnidirectional camera CA and its imaging time, the barcode ID acquired by the barcode camera BCA, and its reading time in association with each other. The terminal device 4 is, for example, according to the selection of the barcode ID based on the operation of the user, the predetermined area ARE imaged by at least one omnidirectional camera CA associated with the reading time of the selected barcode ID. The peripheral image iga is displayed on the display device 5.

  As a result, the package tracking system 1 makes it possible, even if there is a problem such as loss or damage of the package gs to which the barcode ID is pasted, in delivery of the package of the physical distribution, the package tracking system 1 is associated with the barcode ID. The peripheral image taken by the omnidirectional camera in the area ARE and the image pickup time, and the list (history) of the bar code ID reading time are displayed on the display device 5, so that the cause of the trouble by the user (for example, a person in charge of troubleshooting) The investigation can be made efficient, and the usability for the user can be improved.

  When the barcode camera BCA cannot read the barcode BCL within a predetermined time, the terminal device 4 displays the warning information together with the peripheral image iga corresponding to the reading time of the barcode BCL read immediately before.

  Thereby, the user can quickly notice the loss of the luggage by looking at the warning information displayed together with the peripheral image.

  Further, the plurality of omnidirectional cameras CA and the plurality of barcode cameras BCA are installed in a plurality of predetermined areas ARE as camera pairs. The terminal device 4 has an area identification ID for identifying the default area ARE, a location identification ID for identifying the installation location of the omnidirectional camera and the bar code camera forming a pair, and handling of luggage at this installation location (for example, check of transportation). At least one of a person identification ID for identifying a person in charge of handling, such as transfer to a trolley) is displayed on the display device 5 together with the peripheral image, and the barcode is further displayed. The image is recorded in the video recording device 3 in association with the ID and the peripheral image.

  As a result, the luggage tracking system 1 searches for the luggage gs to which the barcode ID is attached (for example, in which predetermined area the luggage gs exists, in which camera pair the location where the luggage gs exists). ) Becomes easier. Further, the package tracking system 1 can clarify whereabouts such as the responsibility of the person in charge of handling the package gs to which the barcode ID is attached.

  Further, in the same predetermined area ARE, when there are a predetermined number or more of the loads gs having the same barcode BCL reading time, the terminal device 4 displays the peripheral image iga at the reading time on the display device 5 together with the camera position identification ID. To do.

  As a result, the luggage tracking system 1 can early detect a situation in which a plurality of luggage stays in a part of the predetermined area ARE (that is, jam occurrence) (so-called jamming detection).

  Further, the barcode camera BCA acquires distance information representing the outer shape of the luggage gs. The terminal device 4 displays the distance image GZ2 (three-dimensional image) based on the distance information acquired by the barcode camera BCA on the display device 5 together with the damage cause image (peripheral image).

  As a result, the luggage tracking system 1 can compare the degree of damage of the luggage gs with the cause of the damage, and can further deepen the cause investigation by the user.

  In addition, the terminal device 4 determines whether or not the luggage is damaged based on the three-dimensional image of the luggage gs. When the luggage gs is damaged, the video recording device 3 adds information indicating that the luggage is damaged in association with the peripheral image captured by the omnidirectional camera, and records the peripheral image as the damage cause image. To do.

  As a result, users such as workers and managers can quickly investigate the cause of damage to the luggage gs.

  Further, in the barcode camera BCA, the image sensor 21 images the predetermined area ARE in the distribution warehouse WA in which the belt conveyor 100 that conveys at least one load gs is arranged. The signal processing unit 30 as a detection unit detects the barcode BCL attached (attached) to the luggage gs appearing in the predetermined area ARE based on the peripheral image igb of the predetermined area ARE captured by the image sensor 21. To do. The signal processing unit 30 as a reading unit reads the detected barcode BCL. The communication unit 31 as an output unit outputs the barcode ID of the read barcode BCL (that is, the result of reading the package identification information) to various external devices connected to the barcode camera BCA.

  Conventionally, in physical distribution, a bar code reader that reads a bar code attached to a package and a surveillance camera are separate devices. In other words, none of the barcode readers captures the peripheral image. On the other hand, the barcode camera BCA of the present embodiment can capture a peripheral image of the predetermined area ARE at a wide angle. As a result, the barcode camera BCA alone can read the barcode BCL and capture a peripheral image without using the omnidirectional camera CA. Therefore, the usability for the user is improved. Also, a package tracking system can be constructed at low cost.

  Further, the image sensor 21 can switch the lens 22 between a wide-angle lens and a narrow-angle lens to capture an image. The image of the periphery of the load gs conveyed by the belt conveyor 100 is captured by the wide-angle lens and is attached to the load gs. The barcode BCL is imaged with a narrow-angle lens.

  As described above, the angle of view of the image captured by the image sensor 21 can be switched to the wide angle or the narrow angle, and the number of parts of the barcode camera BCA can be reduced and the size can be reduced.

  The communication unit 31 also adds the time information at the time of reading and outputs the barcode ID.

  This makes it possible to create a history list hst in which the barcode IDs of the barcodes BCL attached to the luggage gs are recorded in time series.

  In addition, when the barcode BCL is successfully read, the barcode camera BCA outputs, for example, a sound (sound information) of “beep!” Indicating the successful reading of the barcode BCL from the speaker 33, and the barcode BCL is read. When it fails, for example, the sound (sound information) of “Boo” indicating that the reading of the barcode BCL has failed is output.

  As a result, a user such as a worker can immediately know the success or failure of reading the barcode BCL.

  Further, when the peripheral image igb captured by the image sensor 21 includes a predetermined number or more of barcode IDs, the barcode camera BCA adds the warning information and outputs the peripheral image igb.

  Accordingly, the user can quickly notice the jamming detection by looking at the warning information displayed together with the peripheral image. Therefore, it is possible to quickly respond when jamming is detected.

  Although the embodiments have been described above with reference to the drawings, it goes without saying that the present invention is not limited to such examples. It is obvious to those skilled in the art that various changes or modifications can be conceived within the scope described in the claims, and naturally, they also belong to the technical scope of the present invention. Understood.

  For example, in the above-described embodiment, the case where the parcel is conveyed by the belt conveyor is shown, but it is also possible to convey the parcel by the roller conveyer, the chain conveyer, etc. Not limited.

The present invention relates to a package tracking system and a package tracking method which, when delivering a package, have a trouble such as a loss or damage of the package with the package identification information, which makes the cause of the problem efficient and improves the usability of the user. It is also useful as a package tracking program .

1 Package Tracking System 2 Receipt Information Management Device 3 Video Recording Device 4 Terminal Device 5 Display Device 6 Article Management Device 7, 8, 9, 10, 11 Camera Pair 21 Image Sensor 22 Lens 24 Sensor Driver 26 Temperature Sensor 27 Laser Diode ( LD)
28 LD drive part 29 Diffusion plate 30 Signal processing part 31 Communication part 33 Speaker 41 Processor 42 Memory 43 Communication part 44 Hard disk 45 Display control part 46 Operation part 100,110,120,210,220 Belt conveyor 150 Three-dimensional warehouse (stocker)
BCA, BCA1 to BCA5 Bar code camera BR1 to BR3 Bar code reader CA1 to CA5 Omnidirectional camera

Claims (6)

A plurality of surveillance cameras for respectively imaging different predetermined areas in the luggage transport area in which a conveyor for transporting at least one luggage is arranged,
A reader that reads the luggage identification information attached to the luggage and obtains a reading result of the luggage identification information and a reading time thereof.
A recorder that records the peripheral image of the predetermined area imaged by the surveillance camera and its imaging time, the reading result of the package identification information acquired by the reader, and the reading time in association with each other,
A terminal device that displays, on a monitor, a peripheral image of the predetermined area captured by at least one of the surveillance cameras, which is associated with the read time of the selected package identification information, according to the selection of the package identification information. , equipped with a,
A plurality of the readers are installed in the predetermined area so as to form a pair with any one of the plurality of surveillance cameras,
The terminal device includes area identification information for identifying the predetermined area, location identification information for identifying installation locations of the surveillance cameras and the readers forming the pair, and a person for identifying a person handling a package at the installation location. At least one of the identification information is displayed on the monitor together with the peripheral image, is recorded in the recorder in association with the peripheral image,
In the predetermined area, when there is a predetermined number or more of packages having the same package identification information read time in the predetermined area, the terminal device displays the peripheral image associated with the read time together with the place identification information on the monitor. that displays,
Luggage tracking system. A plurality of surveillance cameras for respectively imaging different predetermined areas in the luggage transport area in which a conveyor for transporting at least one luggage is arranged,
A reader that reads the luggage identification information attached to the luggage and obtains a reading result of the luggage identification information and a reading time thereof.
A recorder that records the peripheral image of the predetermined area imaged by the surveillance camera and its imaging time, the reading result of the package identification information acquired by the reader, and the reading time in association with each other,
A terminal device that displays, on a monitor, a peripheral image of the predetermined area captured by at least one of the surveillance cameras, which is associated with the read time of the selected package identification information, according to the selection of the package identification information. ,,
When the reader cannot read the package identification information within a predetermined time, the terminal device displays warning information on the monitor together with the peripheral image associated with the read time of the package identification information read immediately before. To do
Luggage tracking system. A plurality of surveillance cameras for respectively imaging different predetermined areas in the luggage transport area in which a conveyor for transporting at least one luggage is arranged,
A reader that reads the luggage identification information attached to the luggage and obtains a reading result of the luggage identification information and a reading time thereof.
A recorder that records the peripheral image of the predetermined area imaged by the surveillance camera and its imaging time, the reading result of the package identification information acquired by the reader, and the reading time in association with each other,
A terminal device that displays, on a monitor, a peripheral image of the predetermined area captured by at least one of the monitoring cameras, which is associated with the read time of the selected package identification information according to the selection of the package identification information. ,,
The reader acquires distance information indicating the outer shape of the package,
The terminal device displays a stereoscopic image based on the distance information acquired by the reader on the monitor together with the peripheral image, and records the stereoscopic image in the recorder in association with the peripheral image.
Luggage tracking system. The package tracking system according to claim 3 ,
The terminal device, based on the three-dimensional image, determines whether the luggage is damaged,
If the package is damaged, the recorder records information indicating that the package is damaged in association with the peripheral image,
Luggage tracking system. A luggage tracking method in a luggage tracking system comprising a plurality of surveillance cameras arranged in a luggage transportation area in which a conveyor for transporting at least one luggage is arranged, a reader, a recorder, and a terminal device,
The surveillance camera images different predetermined areas in the luggage transportation area,
The reader reads the package identification information attached to the package, obtains a read result of the package identification information and a reading time thereof,
The recorder records the peripheral image of the predetermined area imaged by the surveillance camera and its imaging time, the reading result of the package identification information acquired by the reader, and its reading time in association with each other,
In response to the selection of the package identification information, the terminal device displays, on a monitor, a peripheral image of the predetermined area captured by at least one of the monitoring cameras, which is associated with the read time of the selected package identification information. Display ,
When the reader cannot read the package identification information within a predetermined time, the terminal device displays warning information on the monitor together with the peripheral image associated with the read time of the package identification information read immediately before. To do
Package tracking method. A plurality of surveillance cameras, which are arranged in a luggage transport area in which a conveyor for transporting at least one luggage is arranged, and which respectively image different predetermined areas in the luggage transport area, and read the luggage identification information attached to the luggage. Reader for obtaining the reading result and reading time thereof, the peripheral image of the predetermined area taken by the surveillance camera and the image taking time thereof, the reading result of the package identification information obtained by the reader and the reading time thereof. To a terminal device that is a computer that is communicably connected to a recorder that records and
In response to the selection of the package identification information, a step of displaying on the monitor a peripheral image of the predetermined area imaged by at least one of the surveillance cameras, which is associated with the read time of the selected package identification information,
If the reader cannot read the package identification information within a predetermined time, displaying warning information on the monitor together with the peripheral image associated with the read time of the package identification information read immediately before. To make it happen,
Package tracking program.

Images