JP2016038811A - Virtual try-on apparatus, virtual try-on method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a virtual try-on service according to respective try-on person.SOLUTION: A virtual try-on apparatus 10 includes: a first acquisition section 12A; a first display control section 12B; a reception section 12C; a generation section 12D; and a second display control section 12E. The first acquisition section 12A acquires feature information of a try-on person. The first display control section 12B displays a clothing image corresponding to the acquired feature information in a first information, in which at least the feature information and a clothing image are associated with each other, on a first display unit. The reception section 12C receives, from the try-on person, a selection of a target try-on clothing image from the clothing images displayed on the first display unit. The generation section 12D generates a composite image try-on person image and the selected clothing image. The second display control section 12E controls to display the composite image on the second display unit 18.SELECTED DRAWING: Figure 3

Description

  Embodiments described herein relate generally to a virtual try-on device, a virtual try-on method, and a program.

  A technique for displaying a virtual image indicating a state of wearing a clothing to be tried on is disclosed. For example, a technique for displaying a composite image indicating a state in which a user has tried on clothes has been disclosed.

JP 2006-249618 A

  However, conventionally, it has been difficult to provide a virtual try-on service corresponding to each try-on person.

  The problem to be solved by the present invention is to provide a virtual try-on device, a virtual try-on method, and a program that can provide a virtual try-on service according to each try-on.

  The virtual try-on device of the embodiment includes a first acquisition unit, a first display control unit, a reception unit, a generation unit, and a second display control unit. A 1st acquisition part acquires the feature information of a try-on. The first display control unit displays the clothing image corresponding to the acquired feature information in the first information in which the feature information and at least the clothing image are associated with each other on the first display unit. The accepting unit accepts selection of a clothing image of a clothing to be tried on from among the clothing images displayed on the first display unit. The generation unit generates a composite image of the try-on image of the try-on and the selected clothing image. The second display control unit displays the composite image on the second display unit.

The schematic diagram of a virtual fitting system. The schematic diagram which shows the positional relationship of a main-body part and a fitting person. The functional block diagram of a virtual fitting device. The figure which shows an example of the data structure of 1st information. The figure which shows an example of the data structure of 2nd information. The functional block diagram of a 1st terminal. The functional block diagram of a 2nd terminal. The functional block diagram of a 1st server apparatus. The figure which shows an example of the data structure of 3rd information. The functional block diagram of a 2nd server apparatus. The functional block diagram of a 3rd server apparatus. The sequence diagram which shows the procedure of a virtual try-on process. The figure which shows an example of a selection screen. The figure which shows an example of a synthesized image. Explanatory drawing of remaining time display. Explanatory drawing of remaining time display. The functional block diagram of a virtual fitting device. The figure which shows an example of the data structure of 4th information. The sequence diagram which shows the procedure of a virtual try-on process. The functional block diagram of a virtual fitting device. The figure which shows an example of the data structure of 5th information. The sequence diagram which shows the procedure of a virtual try-on process. The figure which shows an example of a display screen. The block diagram which shows the hardware structural example.

  Exemplary embodiments of a virtual fitting device, a virtual fitting method, and a program will be described below in detail with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a schematic diagram of a virtual fitting system 1 according to the present embodiment.

  The virtual try-on system 1 includes a virtual try-on device 10, a first terminal 24, a second terminal 26, a first server device 28, a third server device 30, and a second server device 32. The virtual try-on device 10, the first terminal 24, the second terminal 26, the first server device 28, the third server device 30, and the second server device 32 are connected via a known communication network such as the Internet. Connected.

  In the present embodiment, the virtual try-on device 10, the first terminal 24, and the second terminal 26 are used in a certain area (store A in the present embodiment) and are constructed in the store A. It is connected via a communication network (LAN: Local Area Network) 34. The virtual try-on device 10, the first terminal 24, and the second terminal 26 are connected to the first server device 28, the third server device 30, and the second server via the LAN 34, a GW (gateway) 35, and the Internet 36. The device 32 is communicably connected.

  In the present embodiment, as an example, it is assumed that the virtual try-on device 10, the second terminal 26, and the first terminal 24 are used in a specific area. In this embodiment, store A which sells products or provides services to customers is assumed as a specific area. The specific area is not limited to the store.

  The virtual try-on system 1 is not limited to a form in which the virtual try-on device 10, the second terminal 26, and the first terminal 24 are used within a specific area. For example, the virtual try-on system 1 may be configured to use at least one of the virtual try-on device 10, the second terminal 26, and the first terminal 24 in different areas.

  In the present embodiment, one second terminal 26 and one or a plurality of first terminals 24 are connected to one virtual fitting device 10 arranged in one store A. A form is demonstrated. Note that the number of virtual try-on devices 10 arranged in one area (for example, store A) and the number of first terminals 24 and second terminals 26 that can be connected to each virtual try-on device 10 are limited to these numbers. Not.

  In FIG. 1, one region (store A) is shown for simplicity of explanation, but the virtual try-on device 10, the first terminal 24, and the second terminal 26 are provided in each of the plurality of regions. An arrangement may be adopted.

  The virtual try-on device 10 is a device that displays a composite image of a try-on wearer image and a clothing image.

  The virtual try-on device 10 includes a control unit 12, a storage unit 14, and a main body unit 16. The control unit 12 controls each unit provided in the virtual try-on device 10. The main body unit 16 includes a second display unit 18, a photographing unit 20, and an irradiation unit 22. The virtual try-on device 10 may further include a printing device that prints the composite image, and a transmission unit that transmits the composite image to an external device via a network or the like.

  The imaging unit 20 includes a first imaging unit 20A and a second imaging unit 20B.

  The first photographing unit 20A photographs a try-on and obtains a try-on image of the try-on. The first photographing unit 20A photographs a try-on person every predetermined time. The first photographing unit 20A sequentially outputs the try-on image acquired by photographing to the control unit 12. The first photographing unit 20A continuously photographs a try-on and outputs it to the control unit 12, so that the control unit 12 obtains a moving image including a plurality of try-on images having different photographing times.

  The try-on is an object to try on clothes. The fitting person may be an object to try on clothes, and may be a living thing or a non-living thing. For example, a person may be mentioned as a living thing. The living thing is not limited to a person, and may be an animal other than a person such as a dog or a cat. Non-living materials include, but are not limited to, mannequins that imitate the shape of human bodies and animals, and other objects. The try-on may be a living creature or a non-living creature wearing clothes.

  The clothes are items that can be worn by the try-on. Examples of the clothes include a jacket, a skirt, trousers, shoes, and a hat. The clothes are not limited to outerwear, skirts, trousers, shoes, hats and the like.

  The fitting person image is a bitmap image in the present embodiment. The try-on image is an image in which pixel values indicating the color, brightness, etc. of the try-on are defined for each pixel. The first photographing unit 20A is a known photographing device that can acquire a fitting person image.

  The second photographing unit 20B acquires a depth map by photographing.

  The depth map may be referred to as a distance image. The depth map is an image that defines the distance from the second imaging unit 20B for each pixel. In the present embodiment, the depth map may be created from a fitting person image by a known method such as stereo matching, or may be shot using the second shooting unit 20B under the same shooting conditions as the fitting person image. You may get it at A known imaging device capable of acquiring a depth map is used for the second imaging unit 20B.

  In the present embodiment, the first photographing unit 20A and the second photographing unit 20B photograph a try-on person at the same timing. The first photographing unit 20A and the second photographing unit 20B are controlled by the control unit 12 so as to sequentially perform photographing at the same timing. Then, the photographing unit 20 sequentially outputs the try-on image and the depth map of the try-on obtained by photographing to the control unit 12.

  The second display unit 18 is a device that displays various images. The second display unit 18 is a known display device such as a liquid crystal display device. In the present embodiment, the second display unit 18 displays a composite image (described later) generated by the control unit 12.

  The second display unit 18 is incorporated on one surface of a rectangular housing, for example. In the present embodiment, a case will be described in which the second display unit 18 is configured with a size equal to or greater than the size of a person. Note that the size of the second display unit 18 is not limited to this size.

  FIG. 2 is a schematic diagram showing the positional relationship between the main body 16 and the fitting person P in the present embodiment.

  The control unit 12 (not shown in FIG. 2) displays on the second display unit 18 a composite image W indicating a state in which the try-on person P has tried on various clothes. FIG. 2 shows a composite image W of a try-on person image 40 and a clothing image 42 as an example. The person trying on P such as a person visually recognizes the composite image W presented on the second display unit 18 from a position facing the display surface of the second display unit 18, for example. In addition, the photographing direction of the second photographing unit 20B and the first photographing unit 20A is adjusted in advance so that the fitting person P at a position facing the display surface of the second display unit 18 can be photographed.

  Returning to FIG. 1, irradiation units 22 are provided on both side surfaces of the second display unit 18. The irradiation unit 22 is a known light source. The irradiation unit 22 has the light irradiation direction adjusted in advance so that light can be irradiated to the fitting person P at the position facing the display surface of the second display unit 18. The main body 16 may be configured not to include the irradiation unit 22.

  The storage unit 14 is a known hard disk device that stores various data.

  The first terminal 24 is a known personal computer. In the present embodiment, the case where the first terminal 24 is a portable terminal will be described. The first terminal 24 is a terminal that is operated when the try-on selects a clothing image to be tried on. In the present embodiment, as an example, a case where one or a plurality of first terminals 24 are provided in the store A will be described. However, the first terminal 24 may be a portable terminal of a try-onr.

  The second terminal 26 is a known personal computer. In the present embodiment, the second terminal 26 is used as an operation terminal that transmits various instructions to the virtual try-on device 10.

  In the present embodiment, a case where the first terminal 24 and the second terminal 26 are configured separately will be described. However, the first terminal 24 and the second terminal 26 may be integrally configured. In addition, at least two of the virtual try-on device 10, the second terminal 26, and the first terminal 24 may be integrally configured.

  The first server device 28 is a content distribution server device arranged on the Internet. In the present embodiment, the first server device 28 generates privilege information (details will be described later) according to at least one of the try-on and the clothes image of the try-on target selected by the try-on.

  The second server device 32 updates the first information (details will be described later) and distributes it to the virtual try-on device 10 and the like. The third server device 30 is a server device that can process big data, and is a server device that analyzes user purchase information stored in various server devices on the Internet. In the present embodiment, the third server device 30 generates a recommended image indicating recommended clothing for the try-on.

  In the present embodiment, the user means a generic name of operators including a try-on and a person other than the try-on.

  In the present embodiment, a case will be described in which the first server device 28, the second server device 32, and the third server device 30 are configured separately. However, at least two of the first server device 28, the second server device 32, and the third server device 30 may be integrally configured.

  FIG. 3 is a functional block diagram of the virtual try-on device 10.

  The virtual try-on device 10 includes a control unit 12, a photographing unit 20, a storage unit 14, a second display unit 18, and an irradiation unit 22. The imaging unit 20, the storage unit 14, the second display unit 18, and the irradiation unit 22 are connected to the control unit 12 so that signals can be exchanged.

  The storage unit 14 stores various data. In the present embodiment, the storage unit 14 stores various data such as first information and second information.

  FIG. 4 is a diagram illustrating an example of a data structure of the first information.

  The first information is information that associates the type of clothing, clothing identification information (hereinafter referred to as clothing ID), feature information, posture information, superposition order, alignment information, and clothing image. It is. The first information may be a database or a table, and the data format is not limited. Note that the first information may be information that associates at least a clothing image with feature information, and may be in a form in which other information is associated.

  The type of clothes indicates each type when clothes are classified into a plurality of types under predetermined classification conditions. The classification condition is, for example, a condition indicating which part of the human body (for example, the upper body side or the lower body side) the clothes are worn, a general superposition order when combined and used. The classification conditions are not limited to these. Examples of the types of clothes include, but are not limited to, tops, outers, bottoms, inners, and the like.

  The clothes ID (clothing identification information) is information for identifying clothes. The clothes indicate ready-made clothes, for example. Examples of the clothes ID include, but are not limited to, product numbers and clothes names. Examples of the product number include, but are not limited to, a known EAN (European Article Number) code and a JAN (Japan Article Number) code. As the name, for example, the name of clothes is used.

  The feature information is information indicating the feature of the fitting person. The feature information is classified in advance as to which clothing ID is associated with the color or material of the clothing specified by the clothing ID, and is stored in the first information.

  Specifically, the characteristic information includes at least one of an appearance characteristic of the fitting person and an internal characteristic. The internal features indicate the taste of the try-on. In addition, the form which shows another feature may be sufficient as an internal feature.

  The appearance features include, for example, a body shape parameter indicating the body shape of the try-on, a feature color of the try-on, and the age group of the try-on. The appearance feature may further be a form showing another feature.

  The characteristic color of the try-on indicates a color that matches the try-in in advance according to the skin color, eye color, hair color, and the like of the try-on. The suitable color is a hue that is the same as or similar to the color of the wearer's skin, eyes, hair, or the like. The characteristic color corresponds to what is called “personal color” in the United States and Japan. Note that the characteristic colors are not limited to these colors. For example, the characteristic color may be a color desired by the try-on.

  The body type parameter is information indicating the body type. The body type parameter includes one or more parameters. The parameter is a measurement value of one or a plurality of locations on the human body. The measuring value is not limited to the actually measured value, and includes a value estimated from the measuring value and a value corresponding to the measuring value (for example, a value arbitrarily input by the user).

  Specifically, the body type parameter includes at least one parameter of chest measurement, waist measurement, waist measurement, height, shoulder width, and weight. The parameters included in the body type parameters are not limited to these parameters. For example, the body shape parameter may further include parameters such as a sleeve length and an inseam.

  The clothes image is an image of clothes specified by the corresponding clothes ID. In the present embodiment, a case will be described in which a clothing image is an image showing a state in which clothing is worn on a human body or a human body shape model. The first information includes, as a clothing image, a first clothing image indicating a state worn on the model and the like, a second clothing image indicating a state in which the clothing is placed on a floor surface or the like, May be included as a clothing image. That is, the first clothing image is an image of the worn clothing. The second clothes image is an image of clothes in a state where the shape is placed and placed.

  The superposition order means that when the clothes specified by the corresponding clothes ID are worn on the human body or the like, each of the layers on the upper layer side where the clothing is separated from the human body from the lower layer side closest to the human body. It is the information which shows whether it wears in the hierarchy of. In the first information, a recommended superposition order of clothes specified by the corresponding clothes ID is registered in advance.

  The alignment information indicates the outline of the portion of the corresponding clothing image that characterizes the user's body shape when worn by the user. For example, the alignment information indicates a contour of a part corresponding to a shoulder part, a neck part, a chest part, a side part, a knee part, a thigh part, a head part, an ankle part, and the like of a human body in a corresponding clothing image. Among them, for the alignment information, it is preferable to use the contour of the portion corresponding to the shoulder portion of the human body in the clothing image, but it is not limited to this.

  The posture information is information indicating the posture of the subject that is the subject of the clothing at the time of acquiring the clothing image. Specifically, the posture information is information indicating the posture of the subject when the first clothes image is acquired. The posture information indicates the orientation, movement, and the like of the subject with respect to the photographing apparatus that photographs the clothing image (first clothing image).

  The orientation of the subject indicates the orientation of the subject wearing the clothing of the clothing image with respect to the photographing device when acquiring the clothing image. For example, the direction of the subject is other than the front direction in which the face and the body are facing the front with respect to the photographing apparatus, the side direction in which the face and the body are facing the side with respect to the photographing apparatus, the front direction, and the side direction. There are directions.

  In the present embodiment, the first information associates one piece of feature information, one superposition order, and a plurality of posture information with one piece of clothing ID. Further, the first information associates each of the plurality of clothing images corresponding to each of the plurality of posture information with the alignment information corresponding to each clothing image.

  The first information may be information further associated with other information related to clothes. For example, the first information may be information that further associates the gender, age group, size of clothes (size of ready-made clothes), and the like of a person assumed to be a target of wearing the corresponding clothes. Further, the first information may be information in which clothing attribute information corresponding to the corresponding clothing image is further associated. The clothing attribute information indicates a store, a manufacturer, a brand name, and the like of the clothing specified by the corresponding clothing ID.

  Next, the second information will be described.

  The second information is information including the clothing ID of the clothing image to be tried on, which is input by the user operating the first terminal 24. The virtual try-on device 10 receives the second information from the first terminal 24 and stores it in the storage unit 14.

  FIG. 5 is a diagram illustrating an example of a data structure of the second information. The second information is information in which a transmission date / time, a store ID, a try-on ID, a combination ID, and one or more clothes IDs are associated with each other.

  The transmission date / time indicates the transmission date / time when the second information is transmitted from the first terminal 24 to the virtual try-on device 10. The store ID is information for identifying an area where the virtual try-on device 10 is arranged (store A in the present embodiment). The try-on ID is information that uniquely identifies the try-on. The combination ID is information for identifying a combination of one or more clothes IDs to be tried on. As the clothes ID of the combination of clothes specified by the combination ID, the second information includes, for example, one or more clothes IDs for each type of clothes. In the example illustrated in FIG. 5, the second information includes a clothing ID corresponding to each combination ID, a clothing ID corresponding to the clothing type “tops”, a clothing ID corresponding to the clothing type “inner”, and a clothing ID. And a clothing ID corresponding to the type “bottoms”.

  That is, the plurality of clothes IDs corresponding to the try-on ID and the combination ID indicate clothes images of a plurality of clothes to be tried on in combination selected by the try-on.

  Returning to FIG. 3, the control unit 12 of the virtual try-on device 10 includes a first acquisition unit 12A, a first display control unit 12B, a reception unit 12C, a generation unit 12D, a second display control unit 12E, and a second display unit. An acquisition unit 12F, a communication unit 12G, an output unit 12J, and an update unit 12K are included.

  Part of the first acquisition unit 12A, the first display control unit 12B, the reception unit 12C, the generation unit 12D, the second display control unit 12E, the second acquisition unit 12F, the communication unit 12G, the output unit 12J, and the update unit 12K For example, all of them may be realized by causing a processing device such as a CPU (Central Processing Unit) to execute a program, that is, by software, or by hardware such as an IC (Integrated Circuit), You may implement | achieve combining software and hardware.

  12 A of 1st acquisition parts acquire the feature information of a try-on person. In the present embodiment, the first acquisition unit 12 </ b> A acquires the feature information of the try-on from the first terminal 24. When the fitting person inputs the feature information by operating the first terminal 24, the first terminal 24 transmits the feature information to the virtual fitting device 10 (details will be described later). Thereby, the first acquisition unit 12A acquires feature information.

  The first display control unit 12B displays the clothing image corresponding to the feature information acquired by the first acquisition unit 12A in the first information on the first display unit 24C (details will be described later, see FIG. 6) of the first terminal 24. To do. The first display unit 24C is a display unit provided in the first terminal 24, details of which will be described later.

  Specifically, the first display control unit 12B transmits, to the first display unit 24C, the clothing image corresponding to the feature information acquired by the first acquisition unit 12A in the first information to the first terminal 24. Control the display of.

  As described with reference to FIG. 4, in the first information, a plurality of posture information and a clothing image corresponding to each of the plurality of posture information are associated with one piece of feature information. Yes. For this reason, the first display control unit 12B reads a clothing image corresponding to predetermined posture information (for example, the front direction) from among a plurality of posture information corresponding to the acquired feature information, and transmits the clothing image to the first terminal 24. do it.

  Further, the first information includes a first clothing image indicating a state worn on a model or the like as a clothing image, and a second clothing image indicating a state in which the shape of the clothing is arranged and placed on a floor surface or the like. In the case of the form, the first display control unit 12 </ b> B may read the second clothing image corresponding to the feature information and the posture information “surface” and transmit it to the first terminal 24. In this case, the virtual try-on device 10 can cause the first terminal 24 to display a second clothing image indicating a state in which the virtual fitting device 10 is placed with the shape adjusted.

  The first display control unit 12B may display the clothing attribute information corresponding to the feature information acquired by the first acquisition unit 12 on the first display unit 24C of the first terminal 24.

  In addition, it is preferable that the first display control unit 12B further displays a recommended image recommended on the virtual try-on system 1 side on the first display unit 24C. The recommended image is a recommended image of a clothing image extracted according to a predetermined extraction condition among a plurality of clothing images registered in the first information. The recommended image may be a recommended combination image indicated by a combination of a plurality of clothes images. The recommended combination image is indicated by a combination of a plurality of clothes images. For example, the recommended combination image is a combination of clothes images belonging to each of a plurality of clothes types. The first display control unit 12B acquires a recommended combination image from the third server device 30 and displays the recommended combination image on the first display unit 24C. In the following, a case where the recommended image is a recommended combination image will be described as an example. However, the recommended image is not limited to a combination of clothes images.

  The extraction conditions are, for example, the feature information of the try-on, the clothing image selected by the try-in in the past, the clothing image selected by the other try-in in the past, the clothing image recommended by the store selling the clothing, Clothing images recommended by other selected tryers, clothing images that match or similar to the body shape of the try-on, clothing images that have been previously selected by other try-on users with preferences that match or similar to the taster's preferences , At least one of It is preferable that the other try-on is, for example, another try-on who has feature information that matches or is similar to the feature information of the try-on. Further, the other try-onrs selected in advance by the try-on are, for example, celebrities and celebrities that are preferred by the try-on.

  The recommended combination image is generated by a third server device 30 described later (details will be described later).

  The accepting unit 12C accepts selection of a clothing image of a clothing to be tried on from among the clothing images displayed on the first display unit 24C of the first terminal 24 from the try-on person. In the present embodiment, the accepting unit 12C accepts the selection by the try-on by accepting, from the first terminal 24, the clothing ID of the clothing image selected by the operation by the try-on of the first terminal 24. Specifically, the reception unit 12 </ b> C receives the second information described above from the first terminal 24, thereby receiving the selection of the clothing image of the clothing to be tried on.

  Note that the clothing ID of the clothing image selected for the try-on that is accepted by the accepting unit 12C is not limited to one and may be plural. That is, the reception unit 12C may receive selection of a plurality of clothes images to be tried on in combination from a try-on person. In this case, the reception unit 12C includes a plurality of clothes IDs, a combination ID indicating a combination of a plurality of clothes images specified by the plurality of clothes IDs, a try-on ID, a transmission date and time, and a store ID. 2 information may be received from the first terminal 24.

  In addition, the reception unit 12C may receive selection of clothes attribute information of clothes to be tried on from a try-onr. In this case, the accepting unit 12C accepts the selection by the try-on by accepting from the first terminal 24 the clothing ID corresponding to the clothing attribute information selected by the operation by the try-on of the first terminal 24. Specifically, the reception unit 12 </ b> C receives the second information described above from the first terminal 24, thereby receiving selection of clothing attribute information of clothes to be tried on.

  The second acquisition unit 12F acquires a body type parameter indicating the body type of the try-on.

  In the present embodiment, the second acquisition unit 12F acquires the body parameters by calculating the body parameters of the try-on from the depth map.

  Specifically, the second acquisition unit 12F first acquires the depth map of the try-on by extracting a person region from the depth map acquired from the second imaging unit 20B.

  For example, the second acquisition unit 12F extracts a person region by setting a threshold value for the distance in the depth direction among the three-dimensional positions of the pixels constituting the depth map. For example, in the camera coordinate system of the second imaging unit 20B, the optical axis of the camera in which the position of the second imaging unit 20B is the origin, and the positive Z-axis direction extends from the origin of the second imaging unit 20B toward the subject (try-on). Suppose that In this case, of the pixels constituting the depth map, pixels whose position coordinates in the depth direction (Z-axis direction) are equal to or greater than a predetermined threshold (for example, a value indicating 1 m) are excluded. Thereby, the second acquisition unit 12F obtains a depth map composed of pixels of the person area existing within the threshold range from the second imaging unit 20B, that is, a depth map of the try-on person.

  Next, the second acquisition unit 12F calculates the body parameters of the fitting person from the depth map of the fitting person acquired from the second photographing unit 20B.

  For example, the second acquisition unit 12F applies the three-dimensional model data (three-dimensional polygon model) of the human body to the depth map of the fitting person. Then, the second acquisition unit 12F uses the depth map and the three-dimensional model data applied to the try-on person to set the values of the parameters included in the body type parameters (for example, height, chest measurement, waist measurement, waist measurement, Each value of shoulder width, etc.) is calculated. In this way, the second acquisition unit 12F acquires the body parameters of the try-on.

  Note that the second acquisition unit 12F may receive from the first terminal 24 a parameter indicating the body shape, which is input in accordance with an operation instruction of the first terminal 24 by the try-on person. Thereby, the 2nd acquisition part 12F may acquire a body type parameter.

  The generation unit 12D generates a composite image of the try-on image of the try-on and the selected clothing image. Specifically, the generation unit 12D generates a composite image of the try-on image captured by the first image capturing unit 20A and the selected clothing image. Note that the first information includes a first clothing image indicating a state in which clothing is worn as a clothing image on a model and the like, and a second clothing image indicating a state in which the clothing is placed on a floor surface or the like. If included, the generation unit 12D preferably uses the first clothing image for generation of the composite image.

  The generation unit 12D preferably generates a corrected image obtained by correcting the selected clothing image in accordance with the acquired body parameter. Then, the generation unit 12D generates a composite image by superimposing the corrected image corrected according to the body type parameter on the try-on person image.

  At this time, the generation unit 12D has a position corresponding to the outline (for example, shoulder, waist, etc.) of the portion corresponding to the characteristic region of the human body on the try-on image and the clothing image (or correction image) to be superimposed. Alignment is performed so that the contour indicated by the alignment information matches, and a composite image in which a clothing image (or a correction image) is superimposed on the try-on image is generated. For this reason, the clothes image is synthesized after being aligned along the body contour of the try-on image.

  In addition, it is preferable that the production | generation part 12D produces | generates the synthesized image which superimposed the clothing image of the attitude | position information corresponding to the attitude of the try-on represented by the try-on person image.

  In this case, the generation unit 12D first calculates the posture information of the try-on from the depth map of the try-on acquired from the second photographing unit 20B.

  First, the generation unit 12D generates first skeleton information indicating the skeleton position of the human body for each pixel constituting the acquired depth map of the fitting person. The generation unit 12D generates first skeleton information by applying a human body shape to the depth map.

  Then, the generation unit 12D obtains the try-on image of the try-on obtained by the first imaging unit 20A, with the coordinate system of the pixel position of each pixel of the generated first skeleton information (that is, the coordinate system of the second imaging unit 20B). To the coordinate system of each pixel position (that is, the coordinate system of the first imaging unit 20A). This coordinate conversion is performed by performing known calibration. Accordingly, the generation unit 12D generates the first skeleton information after coordinate conversion as skeleton information.

  Then, the generation unit 12D calculates the try-on's posture information from the generated skeleton information. The generation unit 12D may calculate the orientation (posture information) of the fitting person from the position of each joint indicated by the skeleton information of the fitting person by a known method.

  Note that the generation unit 12D may calculate the posture information of the try-on from the depth map of the try-on using Open NI (Open Natural Interaction) or the like.

  Then, for each clothing ID received from the first terminal 24, the generation unit 12D reads, as a composition target, a clothing image corresponding to the calculated fitting person's posture information among the clothing images corresponding to each clothing ID. Then, the generation unit 12D synthesizes the clothes image (corrected image) selected by the try-on person corresponding to the posture information on the try-on image taken at the same timing as the depth map used for calculating the posture information. By doing so, a composite image is generated. In the present embodiment, the generation unit 12D reverses the image of the fitting person so that the fitting person who confronts the second display unit 18 can confirm the composite image as if he / she visually recognizes the mirror. A composite image is generated by forming the selected clothing image (corrected image) in the selected image.

  In addition, when the second information received from the first terminal 24 includes a plurality of clothes IDs, that is, when the wearer selects a plurality of clothes images to be tried on in combination, the generation unit 12D selects What is necessary is just to produce | generate the synthesized image which superimposed the several clothes image made on the try-on person image like the above.

  In this case, the generation unit 12D reads the superposition order corresponding to the selected plurality of clothes IDs from the first information. Then, the generation unit 12D sequentially superimposes the clothing images corresponding to each of the plurality of clothing IDs selected as the try-on objects on the try-on image according to the corresponding superposition order. At this time, the generation unit 12D, for each of the images to be superimposed (the try-on image and the clothing image), the image (the clothing) that is superimposed on the upper layer side in the lower-layer image (the try-on image and the clothing image). The overlapping area with the image) is removed, and the image is superimposed in order from the lower layer side to the upper layer side. Thereby, the generation unit 12D generates a composite image.

  The generation unit 12D, when instructed to change the superposition order by an operation instruction by a wearer such as an input unit (not shown) provided in the virtual try-on device 10, again generates a composite image along the instructed superposition order. It may be generated.

  In this case, for example, the try-on inputs a clothing image and a superposition order to the superposition order change target by operating an input unit (not shown) provided in the virtual try-on device 10. The generation unit 12D of the control unit 12 may generate the composite image again according to the clothes image and the new superposition order received from the input unit.

  Note that the generation unit 12D may receive an instruction to change the superimposition order from another external device, or according to a gesture indicating a predetermined superposition order change instruction based on movement of a hand or foot by a wearer. Thus, a composite image in which the superposition order is changed may be generated. In this case, for example, the generation unit 12D may determine whether or not the fitting person has performed a gesture indicating a predetermined change instruction by analyzing the fitting person image acquired by the first photographing unit 20A.

  The second display control unit 12E displays the composite image on the second display unit 18. Therefore, as illustrated in FIG. 2, the second display unit 18 displays a composite image W in which the clothing image 42 is superimposed on the try-on image 40. Further, as described above, the synthesized image W is synthesized by being aligned so that the feature region such as the shoulder of the try-on image 40 and the feature region such as the shoulder of the clothing image 42 coincide with each other. Is. In addition, this composite image is obtained by correcting the clothing image of the clothing to be tried selected selected by the try-on according to the body parameter of the try-on, and then superimposing it on the try-on image 40. Therefore, it is possible to provide a composite image W that looks more natural.

  Returning to FIG. 3, the second display control unit 12 </ b> E may display the composite image on the first display unit 24 </ b> C of the first terminal 24. In this case, the second display control unit 12E may transmit the generated composite image to the first terminal 24.

  The communication unit 12G is a known communication interface for communicating with the first terminal 24, the second terminal 26, the first server device 28, the third server device 30, and the second server device 32.

  The communication unit 12G includes a first transmission unit 12H and a first reception unit 12I.

  The first transmission unit 12H transmits various data to the first terminal 24, the second terminal 26, the first server device 28, the third server device 30, or the second server device 32. The first receiving unit 12I receives various data from the first terminal 24, the second terminal 26, the first server device 28, the third server device 30, or the second server device 32.

  In the present embodiment, the first transmission unit 12H transmits the fitting information to the first server device 28 (server device) connected via the network. The try-on information includes a clothes ID (first identification information) for identifying a clothes image to be tried on, and a try-on ID (second identification information) of a try-on who tries on the clothes in the clothes image. Note that the try-on information may further include at least one of a clothes image corresponding to the clothes ID, a try-on wearer image, and a composite image. Further, the fitting information may further include other information.

  In the present embodiment, when the first transmission unit 12H receives a shooting instruction from a try-on while the composite image is displayed on the second display unit 18, the first transmission unit 12H receives the clothing image included in the displayed composite image. Try-on information including a clothes ID, a clothes image corresponding to the clothes ID, and a try-on ID of a try-in person included in the composite image is transmitted to the first server device 28.

  The first receiving unit 12I receives privilege information from the first server device 28 according to at least one of a clothes ID (first identification information) and a try-on ID (second identification information) included in the fitting information.

  The privilege information is, for example, code information that can be used at a virtual store on the Internet, coupons such as various kinds of cash vouchers and discount coupons that can be used at a clothing store corresponding to a clothing ID. A try-on can enter services such as various discounts provided by the virtual store by inputting code information via an input screen of a virtual store site on the Internet, for example. Moreover, the try-on person can receive various services such as discount by displaying a coupon as privilege information on the first terminal 24 or printing it on a paper medium and presenting it at a target store.

  The first receiving unit 12I also sends a URL (Uniform Resource Locator) of a web page in which a clothing image corresponding to the clothing ID included in the fitting information, attribute information corresponding to the clothing image, and the like is arranged to the first server. You may receive from the apparatus 28. FIG. Moreover, it is good also as a form which included privilege information in this web page.

  The output unit 12J outputs the privilege information received from the first server device 28. When receiving the URL from the first server device 28, the output unit 12J outputs the URL. In this embodiment, the output indicates at least one of display, transmission, and printing.

  Specifically, the output unit 12J displays the privilege information and URL received from the first server device 28 on the second display unit 18, the first display unit 24C of the first terminal 24, or the virtual try-on device. The information is output by printing on a recording medium by a printing apparatus (not shown) connected to the printer 10.

  The output unit 12J may convert the privilege information received from the first server device 28, the URL, or the like into an image indicating a one-dimensional code or a two-dimensional code and output the converted information. The two-dimensional code is, for example, a QR code (registered trademark), DataMatrix, Maxi-Code, or the like. The output unit 12J may output both privilege information or URL and a one-dimensional code or a two-dimensional code.

  When receiving the first information from the second server device 32, the updating unit 12 </ b> K registers the received first information in the storage unit 14 to update the first information stored in the storage unit 14. That is, the first information registered in the storage unit 14 is updated with the first information distributed from the second server device 32.

  Next, the first terminal 24 will be described. FIG. 6 is a functional block diagram of the first terminal 24.

  The first terminal 24 includes an input unit 24A, a storage unit 24B, a first display unit 24C, and a control unit 24D. The input unit 24A, the storage unit 24B, and the first display unit 24C are connected to the control unit 24D so as to exchange signals.

  The first display unit 24C is a known display device that displays various images. In the present embodiment, the first display unit 24C displays a list of clothing images to be tried on for the try-on person so that the list can be selected.

  The input unit 24A receives an input from the user. The input unit 24A is a device for the user to perform various operation inputs. Examples of the input unit 24A include a combination of one or more of a voice recognition device such as a mouse, a button, a remote control, a keyboard, and a microphone, and an image recognition device.

  In the present embodiment, the input unit 24A accepts input from the user such as input of a try-on's try-on ID, selection of a clothing image to be tried-on, and various information for specifying feature information of the try-in. .

  The input unit 24A and the first display unit 24C may be configured integrally. Specifically, the input unit 24A and the first display unit 24C may be configured as a UI (User Interface) unit having both an input function and a display function. The UI unit includes an LCD (Liquid Crystal Display) with a touch panel.

  The storage unit 24B stores various data. In the present embodiment, the storage unit 24B will be described with respect to a mode in which the first information is not stored. However, similarly to the storage unit 14 of the virtual try-on device 10, the storage unit 24B may be configured to store the first information.

  In this case, the following processing is performed at predetermined time intervals so that the contents of the first information stored in the storage unit 14 of the virtual try-on device 10 and the storage unit 24B of the first terminal 24 are the same. It is preferable to do so.

  For example, the distribution of the first information to the virtual try-on device 10 and the first terminal 24 by the second server device 32 and a known mirroring process between the virtual try-on device 10 and the first terminal 24 are performed at predetermined time intervals. Is preferred. In addition, before each apparatus (for example, the virtual try-on device 10, the 1st terminal 24, etc.) which stored 1st information performs the various processes using 1st information, it is the latest from the 2nd server apparatus 32. The first information may be acquired and updated.

  The control unit 24D includes a reception unit 24E, a display control unit 24F, and a communication unit 24G. Part or all of the reception unit 24E, the display control unit 24F, and the communication unit 24G may be realized by causing a processing device such as a CPU to execute a program, that is, by software or hardware such as an IC. It may be realized by a combination of software and hardware.

  The communication unit 24G is a communication interface that communicates with external devices such as the virtual try-on device 10, the second terminal 26, and the third server device 30.

  The accepting unit 24E accepts an operation instruction from the user from the input unit 24A. In the present embodiment, the accepting unit 24E accepts a try-on ID, feature information, various input items for specifying feature information, a clothing ID of a clothing image to be tried on, and the like from the input unit 24A.

  The display control unit 24F performs control to display various images on the first display unit 24C. In the present embodiment, the display control unit 24F displays a reception screen, an input screen, a display screen, and the like on the first display unit 24C. The reception screen is a screen for receiving an input of a try-on ID.

  The input screen is a screen for allowing a try-on to input input items for specifying feature information. This input screen includes, for example, one or a plurality of question items for the fitting person for specifying the fitting person's identification information. Specifically, the question item is a questionnaire for specifying the feature information of the try-on. The try-onr inputs a response to the question item included in the input screen using the input unit 24A. Thereby, the reception unit 24E acquires the answer information of the try-on corresponding to the input item for specifying the feature information input by the try-on.

  In this case, the accepting unit 24E accepts the feature information by specifying the corresponding feature information in accordance with the combination of the response information of the try-on to the accepted one or more input items. Specifically, feature information corresponding to a combination of response information for one or a plurality of input items is stored in advance in the storage unit 24B. Then, the receiving unit 24E may receive the feature information by reading the feature information corresponding to the combination of the response information received from the input unit 24A from the storage unit 24B.

  The display screen is a screen including a plurality of clothing images for allowing a try-on to select a clothing image to be tried on.

  Next, the second terminal 26 will be described. FIG. 7 is a functional block diagram of the second terminal 26.

  The second terminal 26 includes an input unit 26A, a storage unit 26B, a display unit 26C, and a control unit 26D. The input unit 26A, the storage unit 26B, and the display unit 26C are connected to the control unit 26D so as to exchange signals.

  The display unit 26C is a known display device that displays various images. In the present embodiment, the display unit 26C displays, for example, an operation screen that is operated when a user who provides a service or a product in the store A issues a try-on ID to a try-on who has visited the store A. To do. In addition, the display unit 26C displays a selection screen that is operated when a try-on who has visited the store A selects combination information of a try-on target to be virtually tried on.

  The input unit 26A receives input from the user. Similarly to the input unit 24A, the input unit 26A is a device for the user to perform various operation inputs.

  Note that the input unit 26A and the display unit 26C may be configured integrally. Specifically, the input unit 26A and the display unit 26C may be configured as a UI unit having both an input function and a display function.

  The storage unit 26B stores various data. In the present embodiment, the storage unit 26B stores try-onr management information in which a try-on ID is associated with attribute information (for example, a name) of the try-on. The fitting person management information is appropriately updated by the control unit 26D.

  The control unit 26D includes a receiving unit 26E, an issuing unit 26F, a display control unit 26G, and a communication unit 26H. Part or all of the receiving unit 26E, the issuing unit 26F, the display control unit 26G, and the communication unit 26H may be realized by causing a processing device such as a CPU to execute a program, that is, by software or an IC Such hardware may be used, or software and hardware may be used in combination.

  The communication unit 26 </ b> H is a communication interface that communicates with the virtual try-on device 10 and external devices such as the first terminal 24.

  The accepting unit 26E accepts an operation instruction from the user from the input unit 26A. In the present embodiment, accepting unit 26E accepts the selected combination information to be tried on from input unit 26A.

  The issuing unit 26F issues a try-on ID that can identify a try-on. For example, the issuing unit 26F generates and issues a new try-on ID different from the try-on ID stored in the try-on management information. It should be noted that a list of locker numbers (hereinafter referred to as locker numbers) that are installed in the store A and are used for storing packages or the like are stored in the storage unit 26B in advance. Then, the issuing unit 26F may issue an unused locker number as a try-on ID among the stored locker numbers as a try-on ID. Note that the try-on ID is not limited to the locker number as long as it is information that can identify the try-on.

  In addition, when the issuing unit 26F receives the exit information including the exit instruction indicating that the try-on is leaving the store A and the try-on ID issued to the try-on from the input unit 26A, the exit information May be deleted from the try-onr management information. The exit information may be input by an operation instruction of the input unit 26A by the user, for example.

  The display control unit 26G performs control to display various images on the display unit 26C. In the present embodiment, the display control unit 26G performs control to display various images such as the operation screen and the selection screen on the display unit 26C. The display control unit 26G displays the try-on ID issued by the issuing unit 26F on the display unit 26C. For this reason, the user can confirm the issued try-on ID by visually recognizing the display unit 26C.

  Next, the first server device 28 will be described. FIG. 8 is a functional block diagram of the first server device 28.

  The first server device 28 includes an input unit 28A, a storage unit 28B, a display unit 28C, and a control unit 28D. The input unit 28A, the storage unit 28B, and the display unit 28C are connected to the control unit 28D so as to exchange signals.

  The display unit 28C is a known display device that displays various images. The input unit 28A receives input from the user. Similarly to the input unit 24A, the input unit 28A is a device for the user to perform various operation inputs. The input unit 28A and the display unit 28C may be configured as a UI unit having both an input function and a display function.

  The storage unit 28B stores various data. In the present embodiment, storage unit 28B stores the third information in advance.

  FIG. 9 is a diagram illustrating an example of a data structure of the third information. The third information is information in which the clothes ID is associated with the attribute information.

  The attribute information is information indicating the attribute of the clothes specified by the corresponding clothes ID. In the present embodiment, the attribute information includes the privilege information of the clothes specified by the corresponding clothes ID and the store information of the clothes specified by the corresponding clothes ID.

  Since privilege information was mentioned above, explanation is omitted here. The store information includes, for example, the location of the clothing store specified by the corresponding clothing ID, information on products provided by the store, information on various services provided by the store. The location of the store is, for example, a location in the real space (such as map information) or a URL of the store's homepage on the website.

  The attribute information may further include a clothing image of the clothing specified by the corresponding clothing ID. Further, the attribute information may further include other information.

  Returning to FIG. 8, the control unit 28D includes a communication unit 28E and a creation unit 28H. A part or all of the communication unit 28E and the creation unit 28H may be realized by causing a processing device such as a CPU to execute a program, that is, by software, or by hardware such as an IC. It may be realized by using software and hardware together.

  The communication unit 28E is a communication interface that communicates with an external device such as the virtual try-on device 10. The communication unit 28E includes a second reception unit 28F and a second transmission unit 28G. The second receiving unit 28F receives various data from an external device. The second transmission unit 28G transmits various data to the external device.

  In the present embodiment, the second reception unit 28F receives fitting information from the virtual fitting device 10. As described above, the try-on information includes one or a plurality of clothes IDs virtually tried on by the try-on, the try-on ID, and the clothes image of the clothes specified by the clothes ID.

  The creation unit 28H generates privilege information according to at least one of the clothes ID (first identification information) and the try-on ID (second identification information) included in the fitting information received by the second reception unit 28F. .

  In the present embodiment, creation unit 28H reads the clothing image corresponding to the clothing ID included in the received fitting information and the attribute information corresponding to the clothing ID from the third information. Then, the creation unit 28H generates and stores a web page including the privilege information and the store information included in the read attribute information and the clothes image of the clothes specified by the clothes ID included in the received fitting information. Store in unit 28B. Then, the second transmission unit 28G transmits a URL indicating the storage location of the web page to the virtual try-on device 10 that is the transmission source of the try-on information.

  Note that the creation unit 28H may transmit the privilege information to the virtual try-on device 10.

  Next, the second server device 32 will be described. FIG. 10 is a functional block diagram of the second server device 32.

  The second server device 32 includes an input unit 32A, a storage unit 32B, a display unit 32C, and a control unit 32D. The input unit 32A, the storage unit 32B, and the display unit 32C are connected to the control unit 32D so as to exchange signals.

  The display unit 32C is a known display device that displays various images. The input unit 32A receives input from the user. Similarly to the input unit 24A, the input unit 32A is a device for the user to perform various operation inputs. Note that the input unit 32A and the display unit 32C may be configured as a UI unit having both an input function and a display function. The storage unit 32B stores various data.

  The control unit 32D includes a communication unit 32E, a collection unit 32F, a second generation unit 32G, and a distribution unit 32H. A part or all of the communication unit 32E, the collection unit 32F, the second generation unit 32G, and the distribution unit 32H may be realized by causing a processing device such as a CPU to execute a program, that is, by software, You may implement | achieve by hardware, such as IC, and may implement | achieve combining software and hardware.

  The communication unit 32E is an interface that communicates with external devices such as the virtual try-on device 10, the second server device 32, the third server device 30, and various server devices connected to the Internet 36.

  The collection unit 32F collects clothing images and attribute information corresponding to the clothing images from various server devices connected to the Internet 36. Since the attribute information has been described above, description thereof is omitted here. The collection unit 32F collects clothes images and attribute information by collecting information about clothes images from various server devices connected to the Internet 36 at predetermined time intervals.

  The second generation unit 32G generates the first information using the collected clothes image and attribute information. Note that the first information generated by the second generation unit 32G can be changed, edited, or added by an operation instruction of the input unit 32A by a user (for example, an administrator of the second server device 32). To do.

  In addition, the second generation unit 32G generates third information (see FIG. 9) in which the clothes ID of the clothes in the collected clothes image is associated with the attribute information.

  The distribution unit 32H sends the first information generated by the second generation unit 32G to the first information and various external devices that store at least a part of the information included in the first information via the communication unit 32E. And deliver. The distribution unit 32H distributes the generated third information to the first server device 28.

  In the present embodiment, the distribution unit 32H distributes the first information to the virtual try-on device 10 and the first server device 28. The distribution unit 32H preferably distributes the first information and the third information only when the first information generated last time by the second generation unit 32G is updated.

  In the virtual try-on device 10, when the first information distributed from the second server device 32 is received, the update unit 12K (see FIG. 3) stores the received first information in the storage unit. Thereby, the virtual try-on device 10 updates the first information stored in the storage unit 14.

  When the first server device 28 receives the third information distributed from the second server device 32, the control unit 28D of the first server device 28 stores the received third information in the storage unit 28B. Thereby, the 1st server apparatus 28 updates the 3rd information memorized by storage part 28B.

  In the case where the storage unit 24B of the first terminal 24 is also configured to store the first information, the distribution unit 32H may further distribute the first information to the first terminal 24. The control unit 24D of the first terminal 24 may update the first information by storing the received first information in the storage unit 24B.

  Next, the third server device 30 will be described. FIG. 11 is a functional block diagram of the third server device 30.

  The third server device 30 includes an input unit 30A, a storage unit 30B, a display unit 30C, and a control unit 30D. The input unit 30A, the storage unit 30B, and the display unit 30C are connected to the control unit 30D so as to exchange signals.

  The display unit 30C is a known display device that displays various images. The input unit 30A receives input from the user. Similarly to the input unit 24A, the input unit 30A is a device for the user to perform various operation inputs. Note that the input unit 30A and the display unit 30C may be configured as a UI unit having both an input function and a display function. The storage unit 30B stores various data.

  Control unit 30D includes a communication unit 30E, an analysis unit 30F, a third generation unit 30G, and a distribution unit 30H. A part or all of the communication unit 30E, the analysis unit 30F, the third generation unit 30G, and the distribution unit 30H may be realized by causing a processing device such as a CPU to execute a program, that is, by software, You may implement | achieve by hardware, such as IC, and may implement | achieve combining software and hardware.

  The communication unit 30 </ b> E is an interface that communicates with the virtual try-on device 10 and external devices such as the first terminal 24. In the present embodiment, the communication unit 30E receives the try-on person information from the first terminal 24 or the virtual try-on device 10. The try-on information includes combination information including clothes IDs of a plurality of clothes images selected as try-on targets by the try-on person, the try-on ID, and the feature information of the try-in person specified by the try-on ID. . The try-on information may be in a form further including other information such as a combination ID.

  The control unit 30D sequentially stores the received fitting person information in the storage unit 30B in association with the reception date and time of the fitting person information.

  The analysis unit 30F searches for various server devices connected to the Internet 36 using the fitting person information received by the communication unit 30E, and analyzes information related to the fitting person information.

  For example, it is assumed that information that can be uniquely identified on the Internet (for example, an e-mail address or a telephone number) is used as the try-on ID. In this case, the analysis unit 30F analyzes the purchase information by acquiring the past purchase history of the try-on ID from another accessible server device or the storage unit 30B.

  The analysis unit 30F also includes the clothing image associated with the same feature information as the feature information included in the received try-on information, or other feature information similar to the feature information included in the try-on information, and the clothing image of the clothing image. The attribute information is acquired from another accessible server device or storage unit 30B.

  Other feature information similar to the feature information is the body shape parameter indicating the body shape of the wearer, the feature color of the wearer, the age group of the wearer, and the wearer's age group. Other characteristic information in which at least one of the personality and the taste of the try-on matches or falls within a predetermined range is shown.

  In addition, the analysis unit 30F acquires, from an accessible server device or storage unit 30B, other clothing images recommended by the clothing store specified by the clothing ID included in the try-on information.

  The third generation unit 30G generates a recommended combination image recommended on the virtual try-on system 1 side according to the received try-on information and the analysis result by the analysis unit 30F.

  In the present embodiment, the third generation unit 30G generates a recommended combination image indicated by a combination of a plurality of clothing images from a plurality of clothing images registered in the first information according to a predetermined extraction condition. To do. Since the extraction condition has been described above, the description thereof is omitted here.

  In addition, for example, the third generation unit 30G may store in advance an analysis result and a recommended combination image including a plurality of clothes IDs corresponding to the analysis result. The third generation unit 30G reads a plurality of clothes IDs corresponding to the analysis result of the analysis unit 30F. Then, the third generation unit 30G may generate clothes images corresponding to the plurality of read clothes IDs as recommended combination images.

  The distribution unit 30H distributes the recommended combination image generated by the third generation unit 30G to the virtual try-on device 10 or the first terminal 24 that is the transmission source of the try-on person information via the communication unit 30E.

  Next, a procedure of virtual try-on processing executed in the virtual try-on system 1 will be described.

  FIG. 12 is a sequence diagram illustrating a procedure of virtual try-on processing executed in the virtual try-on system 1.

  First, the issuing unit 26F of the second terminal 26 issues a try-on ID (SEQ100). As described above, the display control unit 26G displays the try-on ID issued by the issuing unit 26F on the display unit 26C. The user confirms the try-on ID by visually checking the display unit 26C.

  Next, the first terminal 24 receives the try-on ID (SEQ102). The user inputs the try-on ID issued in SEQ100 through an operation instruction of the input unit 24A via the reception screen displayed on the first display unit 24C. Thereby, the reception unit 24E of the first terminal 24 receives the try-on ID.

  Next, the display control unit 24F displays an input screen for inputting input items for specifying feature information on the first display unit 24C (SEQ104). The display control unit 24F may display an input screen for directly inputting feature information on the first display unit 24C.

  Next, the accepting unit 24E accepts the feature information input by the try-on via the input screen (or specified from the response information for the input item) (SEQ106). Then, the communication unit 24G transmits the feature information to the virtual try-on device 10 (SEQ108).

  In the virtual try-on device 10, the first acquisition unit 12A receives feature information. Then, the first display control unit 12B reads a clothing image corresponding to the received feature information from the first information (SEQ110). Then, the first display control unit 12B transmits the read clothing image to the first terminal 24 (SEQ112). At this time, the first display control unit 12 </ b> B may transmit the clothing image and the corresponding clothing ID to the first terminal 24.

  The receiving unit 24E of the first terminal 24 receives a clothing image and a clothing ID from the virtual try-on device 10. Then, the display control unit 24F displays a display screen including the accepted clothing image on the first display unit 24C (SEQ114).

  Through the processing of SEQ106 to SEQ114, a list of clothing images corresponding to the feature information of the try-on among the clothing images included in the first information is displayed on the first display unit 24C. A try-on operates the input unit 24A to select one or more clothes images to be tried on. In the present embodiment, a case will be described in which a try-on person selects a plurality of clothes images to be tried on in combination as clothes images to be tried on.

  Next, the accepting unit 24E accepts selection of a plurality of clothing images to be tried on in combination from the try-onrs (SEQ116). That is, the accepting unit 24E accepts selection of a plurality of clothing images to be tried on in combination by accepting an operation instruction of the input unit 24A from the try-on person.

  Next, the communication unit 24G includes a plurality of clothes IDs to be tried on in combination, a combination ID, a try-on ID received in SEQ102, a store ID, and a transmission date and time, which are selected by the try-on person. Information is transmitted to the second terminal 26 and the virtual try-on device 10 (SEQ 118, SEQ 120). The combination ID may be information that can identify a combination of a plurality of corresponding clothes IDs. The virtual try-on device 10 stores the received second information in the storage unit 14.

  The communication unit 24G may transmit the second information including the transmission date and time to the second terminal 26 and the virtual try-on device 10 by including the transmission date and time at the timing of transmitting the second information in the second information. . In addition, the communication unit 24G stores in advance a store ID indicating a store to which the second information is transmitted. And the communication part 24G should just transmit the 2nd information containing this shop ID to the 2nd terminal 26 and the virtual try-on device 10. FIG.

  Next, the communication unit 24G transmits the try-on information including the combination information including a plurality of clothes IDs to be tried on in combination, the try-on ID received in SEQ 102, and the feature information received in SEQ 106 to the third server device. 30 (SEQ122).

  The communication unit 30 </ b> E of the third server device 30 receives the try-on information from the first terminal 24. The communication unit 30E may receive the try-on information from the virtual try-on device 10. In this case, the communication unit 12 </ b> G of the virtual try-on device 10 may transmit the try-on information received at SEQ 120 to the third server device 30.

  The control unit 30D of the third server device 30 sequentially stores the received fitting person information in the storage unit 30B in association with the reception date and time of the fitting person information. For this reason, the try-on information is effectively used in the next analysis process. Then, the analysis unit 30F analyzes information related to the received try-on information (SEQ124).

  Next, the third generation unit 30G generates a recommended combination image recommended on the virtual try-on system 1 according to the try-on information and the analysis result (SEQ126).

  Then, the distribution unit 30H transmits the recommended combination image to the virtual try-on device 10 (SEQ128). The distribution unit 30H may transmit the recommended combination image to the first terminal 24.

  In the virtual try-on device 10, the communication unit 12G receives the recommended combination image, and the first display control unit 12B transmits the recommended combination image to the first terminal 24 (SEQ129). When the receiving unit 24E of the first terminal 24 receives the recommended combination image, the display control unit 24F displays the recommended combination image on the first display unit 24C (SEQ130).

  Through the processing of SEQ122 to SEQ130, a recommended combination image indicated by a combination of clothing images recommended by the virtual try-on system 1 is displayed on the first display unit 24C.

  Next, the accepting unit 24E accepts selection of a recommended combination image from the try-onr (SEQ132). That is, the accepting unit 24E accepts selection of one of the recommended combination images by accepting an operation instruction of the input unit 24A from the try-on.

  Next, the communication unit 24G includes a plurality of clothes IDs to be tried on in combination, a combination ID, a try-on ID received in SEQ 102, a store ID, and a transmission date and time, which are selected by the try-in at SEQ 132. The second information is transmitted to the second terminal 26 and the virtual try-on device 10 (SEQ134, SEQ136). The virtual try-on device 10 stores the received second information in the storage unit 14.

  Next, the communication unit 24G includes combination information including a plurality of clothes IDs to be tried on in combination, selected by the try-on at SEQ 132, a try-on ID received at SEQ 102, and feature information received at SEQ 106. The try-on information is transmitted to the third server device 30 (SEQ138).

  The communication unit 30 </ b> E of the third server device 30 receives the try-on information from the first terminal 24. The control unit 30D sequentially stores the received fitting person information in the storage unit 30B in association with the reception date and time of the fitting person information (SEQ140). For this reason, the try-on information is effectively used in the next analysis process.

  On the other hand, in the second terminal 26 that has received the second information by the processing of SEQ118 and SEQ134, the display control unit 26G displays on the display unit 26C a selection screen indicating that each of the received second information can be individually selected. It is displayed (SEQ142).

  FIG. 13 is a diagram illustrating an example of the selection screen 46. The selection screen 46 includes, for example, button images 47 (47A to 47C) indicating each of the second information. Each button image 47 includes, for example, characters indicating at least part of information included in the corresponding second information. In the example illustrated in FIG. 13, each button image 47 includes a try-on ID (in FIG. 13, locker number 1, locker number 3, locker number 5) and transmission date / time included in the second information.

  Returning to FIG. 12, the receiving unit 26 </ b> E receives from the input unit 26 </ b> A the selection of the second information corresponding to the combination of the clothing images to be tried on by the wearer among the one or more pieces of second information displayed on the selection screen 46. (SEQ144). That is, a user (for example, a try-on person or a service provider in the store A) inputs the button image 47 of the second information corresponding to the try-on ID of the try-in person according to an operation instruction of the input unit 26A. Thereby, the reception unit 26E receives the selection of the second information corresponding to the combination of the clothes image to be tried on by the try-on.

  Next, the communication unit 26H transmits the second information received in SEQ144 to the virtual try-on device 10 (SEQ146).

  The communication unit 12G of the virtual try-on device 10 receives the second information from the second terminal 26. Then, the second acquisition unit 12F of the virtual try-on device 10 acquires a body type parameter indicating the body type of the wearer (SEQ148).

  Next, the generation unit 12D combines the try-on image of the try-on photographed by the first photographing unit 20A and the clothing image corresponding to the clothing ID included in the second information (see FIG. 5) received in SEQ 146. An image is generated (SEQ150).

  Next, the second display control unit 12E displays the composite image generated in SEQ150 on the second display unit 18 (SEQ152).

  FIG. 14 is a diagram illustrating an example of the composite image W displayed on the second display unit 18. In FIG. 14, in order to simplify the description, a composite image W in which one clothing image 42A is superimposed on the try-on image 40A is shown. Note that the photographing unit 20 continuously performs photographing. During the display of the composite image of SEQ152, the generation unit 12D corresponds to the subject image continuously photographed by the photographing unit 20 and the clothes ID included in the second information (see FIG. 5) received by SEQ146. And the process which produces | generates the synthesized image which synthesize | combined with the clothing image corresponding to the attitude | position information calculated from the depth map obtained by this imaging | photography is repeatedly performed. And the 2nd display control part 12E switches the synthesized image displayed on the 2nd display part 18, whenever a new synthesized image is produced | generated by the synthetic | combination part 12C. For this reason, the second display unit 18 displays a composite image in which a clothing image corresponding to the posture of the subject is superimposed on the subject image as if the subject facing the front was reflected in the mirror. .

  Returning to FIG. 12, next, the receiving unit 12C determines whether or not a composite image change instruction has been received (SEQ154). In the present embodiment, the accepting unit 12C accepts gesture gestures of the fitting person facing the second display unit 18 as various instructions by the fitting person. For example, the accepting unit 12C registers in advance the movement of the try-on that raises the right hand as the change instruction information of the composite image. Then, it is determined that the fitting person has moved up with his right hand by analyzing the fitting person image photographed by the first photographing unit 20A or the depth map photographed by the second photographing unit 20B by a known method. Then, it may be determined that the composite image change instruction information has been received.

  When it is determined that the try-on moves with the right hand, the second display control unit 12E may display an instruction image indicating instruction information corresponding to the movement on the second display unit 18. Specifically, when the second display control unit 12E determines that the fitting person has made a movement to raise his right hand, the second display control unit 12E displays an instruction image (for example, “next coordination”) indicating an instruction to change the composite image, Image) may be displayed on the second display unit 18.

  Specifically, the instruction image may be superimposed and displayed in the vicinity of the region corresponding to the right hand of the try-in in the try-on image (in FIGS. 15-1 (A) to 15-1 (D), Refer to the instruction image 44C, where Fig. 15-1 (C) is an enlarged view of a part of Fig. 15-1 (A), and Fig. 15-1 (D) is a diagram of Fig. 15-1 (B). This is a partially enlarged view).

  As described above, in the present embodiment, the generation unit 12D allows the try-on so that the try-on who confronts the second display unit 18 can confirm the composite image with a sense of visually recognizing the mirror. A composite image is generated by constructing the selected clothing image (corrected image) in an image obtained by inverting the image. For this reason, in FIG. 15-1 and FIG. 15-2 mentioned later, the left hand of a try-on person image corresponds to the right hand of an actual try-on person.

  When an affirmative determination is made in SEQ154 (SEQ154: Yes), the generation unit 12D stores other second information including the try-on ID included in the second information corresponding to the composite image displayed on the second display unit 18 last time. 14, one second information not displayed of the composite image is read. Then, the generation unit 12D generates a composite image in the same manner as SEQ150 using the read second information (SEQ156).

  It should be noted that when this composite image is generated, that is, when the composite image is changed, first time information indicating the remaining time of the composite image after the change is preferably displayed on the second display unit 18. FIG. 15A is an explanatory diagram of the remaining time display.

  When the composite image change instruction is received, as illustrated in FIG. 15A, the second display control unit 12E displays the first time information 44A indicating the remaining time until the composite image after the change is displayed. It is preferable to display on the second display unit 18. The first time information 44A is, for example, an image including a number indicating the remaining time and a circular gauge. At this time, it is preferable to display the composite image W before the change on the second display unit 18 until the composite image after the change is displayed. The first time information 44 </ b> A may be a predetermined time, or may be a time calculated for the time required to display the composite image after the change.

  The 1st time information which shows remaining time should just be displayed in the format which can visually recognize remaining time. For example, as shown in FIG. 15-1 (B), the first time information 44B indicating the remaining time may be a rod-shaped gauge indicating the remaining time. For this reason, for example, the control unit 12 provides the instruction image indicating “next coordination” and the gauge as the first time information indicating the remaining time so as to be visible to the fitting person, and the remaining time is provided. When the gauge shown is full (remaining time “0”), the changed composite image can be displayed on the second display unit 18. The second display control unit 12E includes first time information indicating the remaining time required for processing corresponding to the instruction image and the instruction information (in the above, remaining time required until the composite image after the change is displayed), A composite image including at least one of these may be displayed on the second display unit 18 or both may be displayed.

  Returning to FIG. 12, the second display control unit 12E displays the composite image generated in SEQ156 on the second display unit 18 (SEQ158). Here, the imaging unit 20 continuously performs imaging. During the display of the synthesized image of SEQ158, the generation unit 12D corresponds to the subject image continuously photographed by the photographing unit 20 and the clothes ID included in the second information read by SEQ156, and the The process of generating a composite image obtained by combining the clothing image corresponding to the posture information calculated from the depth map obtained by shooting is repeatedly executed. And the 2nd display control part 12E switches the synthesized image displayed on the 2nd display part 18, whenever a new synthesized image is produced | generated by the synthetic | combination part 12C. For this reason, the second display unit 18 displays a composite image in which a clothing image corresponding to the posture of the subject is superimposed on the subject image as if the subject facing the front was reflected in the mirror. .

  Note that the second display control unit 12E may delete the second information corresponding to the displayed composite image from the storage unit 14 when the composite image is displayed. In addition, the second display control unit 12E may transmit an instruction to delete the second information corresponding to the displayed composite image to the second terminal 26. When receiving the deletion instruction, the second terminal 26 deletes the second information indicated by the received deletion instruction from the storage unit 26B. For this reason, the undisplayed composite image is displayed on the selection screen for selecting the combination information to be tried on, which is displayed on the display unit 26C of the second terminal 26.

  Furthermore, when an instruction to change the superimposition order of the clothes image included in the composite image is instructed by an operation instruction of an input unit or the like not shown in the illustration of the fitting person, the generation unit 12D again performs the superimposition order instructed. A composite image may be generated. Then, the second display control unit 12E may display the generated composite image on the second display unit 18. With respect to the superimposing order change instruction, it may be determined that the superimposing order changing instruction has been made by determining whether or not a predetermined movement has been made by the wearer, as described above.

  On the other hand, if a negative determination is made in SEQ154 (SEQ154: No), the process proceeds to SEQ160.

  Next, the receiving unit 12C determines whether a shooting instruction has been received (SEQ160). In the present embodiment, the accepting unit 12C accepts gesture gestures of the fitting person facing the second display unit 18 as various instructions by the fitting person. For example, the reception unit 12C registers in advance the movement of the try-on that raises the left hand as the shooting instruction information. Then, it is determined that the fitting person has moved up with his left hand by analyzing the fitting person image photographed by the first photographing part 20A or the depth map photographed by the second photographing part 20B by a known method. Sometimes, it may be determined that a shooting instruction has been accepted.

  Note that when it is determined that the try-on moves with the left hand up, the second display control unit 12E may display an instruction image indicating instruction information corresponding to the movement on the second display unit 18. Specifically, when it is determined that the try-on moves the left hand, the second display control unit 12E displays an instruction image (for example, characters and images such as “camera shooting”) indicating a composite image shooting instruction. May be displayed on the second display unit 18. Specifically, the instruction image may be superimposed and displayed in the vicinity of the left hand of the try-in in the try-on image. Similarly to the above, the second display control unit 12E may further display the remaining time.

  FIG. 15B is an explanatory diagram of a remaining time display including an instruction image indicating a photographing instruction. For example, when it is determined that the try-on moves to raise the left hand, the accepting unit 12C accepts an instruction to capture the composite image displayed on the second display unit 18. Then, the second display control unit 12E displays a composite image including at least one of the instruction image and the second time information indicating the remaining time until the photographing instruction is confirmed on the second display unit 18. For example, as illustrated in FIGS. 15-2 (E) and 15-2 (G), the second display control unit 12E includes second time information 44D indicating the remaining time until the photographing instruction is confirmed, and an instruction image 44E. And the synthesized image W including at least one of them is displayed on the second display unit 18. The second time information 44D is, for example, an image including a number indicating the remaining time and a gauge (a circular gauge or a rod-shaped gauge). For this reason, the try-on can cancel the shooting instruction or perform other instructions during the time indicated by the second time information. FIG. 15-2 (G) is an enlarged image of FIG. 15-2 (E).

  Then, after the remaining time indicated by the second time information has elapsed, the second display control unit 12E performs processing according to the instruction image (here, for example, characters and images such as “camera shooting”) and the shooting instruction. The composite image including at least one of the third time information 44F indicating the remaining time until the execution of is displayed on the second display unit 18 (see FIGS. 15-2 (F) and 15-2 (H)). FIG. 15-2 (H) is an enlarged image of FIG. 15-2 (F). For this reason, the try-on can change the posture such as lifting his arm during the time indicated by the third time information 44F.

  When the first time information, the second time information, or the third time information is displayed on the second display unit 19, the reception unit 12 </ b> C displays the fitting person in the left-right direction (right-hand direction or left-hand direction). ), It may be determined that a change of various instructions by the wearer has been accepted. The movement of the fitting person may be determined from the depth map and the fitting person image in the same manner as described above. For example, when the accepting unit 12C determines the movement of the fitting person in the left-right direction, the instruction is changed from the “composite image change instruction” to the “shooting instruction” or the “shooting instruction” is changed to “the composite image change”. It may be determined that an instruction change to “instruction” has been accepted. And the control part 12 should just perform the said process according to the changed instruction | indication.

  If a negative determination is made in SEQ160 (SEQ160: No), the process proceeds to SEQ174 described later. If an affirmative determination is made in SEQ 160 (SEQ 160: Yes), the flow proceeds to SEQ 162. In SEQ162, the first transmitter 12H transmits the try-on information to the first server device 28 (SEQ162). This try-on information is specified by the clothes ID of one or more clothes images included in the composite image displayed immediately before, the try-on IDs of the try-in images included in the composite image, and the clothes ID. And a clothing image of the clothing. That is, the first transmission unit 12H transmits the fitting information on the composite image displayed on the second display unit 18 to the first server device 28 after the remaining time indicated by the third time information has elapsed.

  The second receiving unit 28 </ b> F of the first server device 28 receives try-on information from the virtual try-on device 10. Then, the creation unit 28H obtains privilege information according to at least one of the clothes ID (first identification information) and the try-on ID (second identification information) included in the fitting information received by the second receiving unit 28F. Generate (SEQ164).

  Next, the creation unit 28H reads the clothing image corresponding to the clothing ID included in the received fitting information and the attribute information corresponding to the clothing ID from the third information. Then, the creation unit 28H generates and stores a web page including the privilege information and the store information included in the read attribute information and the clothes image of the clothes specified by the clothes ID included in the received fitting information. The data is stored in the unit 28B (SEQ166, SEQ168).

  Next, the second transmission unit 28G transmits a URL indicating the storage location of the web page to the virtual try-on device 10 (SEQ 170).

  The virtual try-on device 10 receives the URL from the first server device 28. Then, the output unit 12J of the virtual try-on device 10 converts the URL received from the first server device 28 into an image indicating a one-dimensional code or a two-dimensional code, and outputs the image to the second display unit 18 (SEQ172).

  The try-on can easily access the generated web page via the portable terminal by reading the one-dimensional code or the two-dimensional code displayed on the second display unit 18 with the portable terminal of the try-on. be able to. Moreover, the try-on person can easily confirm the clothes image and the attribute information corresponding to the clothes image by browsing this web page.

  Further, it is assumed that the one-dimensional code or the two-dimensional code displayed on the second display unit 18 indicates privilege information. In this case, the try-on can display the benefit information on the display unit of the portable terminal of the try-on, and can receive a service corresponding to the benefit information at a store of the clothes that are tried on. In addition, the try-on person can receive services according to the privilege information at a clothing store or the like by printing the privilege information on a paper medium or the like.

  Next, the receiving unit 12C determines whether or not a virtual fitting end instruction has been received (SEQ174). For example, the reception unit 12C may determine whether a virtual fitting end instruction has been received by determining whether a signal indicating an end instruction has been received from an input unit (not shown) or an external device. . Further, when it is determined that the try-on has performed an operation indicating a predetermined end instruction, it may be determined that a virtual try-on end instruction has been received.

  If a negative determination is made in SEQ174 (SEQ174: No), the process returns to SEQ154. On the other hand, if an affirmative determination is made in SEQ174 (SEQ174: Yes), the process is terminated.

  On the other hand, the second server device 32 executes the following processing every predetermined time.

  First, the collection unit 32F collects clothing images, attribute information corresponding to the clothing images, and the like at predetermined time intervals from various server devices connected to the Internet 36 (SEQ180).

  Next, the second generation unit 32G generates first information (see FIG. 4) and third information (see FIG. 9) using the collected clothes image and attribute information (SEQ182).

  The distribution unit 32H distributes the first information to the virtual try-on device 10 and the first server device 28 (SEQ184). Also, the distribution unit 32H distributes the third information to the first server device 28 (SEQ184).

  In the virtual try-on device 10, when the first information distributed from the second server device 32 is received, the update unit 12K (see FIG. 3) stores the received first information in the storage unit 14, whereby the storage unit 14 The first information stored in is updated.

  When the first server device 28 receives the third information distributed from the second server device 32, the control unit 28D of the first server device 28 stores the received third information in the storage unit 28B, thereby storing the information. The third information stored in the unit 28B is updated.

  As described above, the virtual try-on device 10 of the present embodiment includes the first acquisition unit 12A, the first display control unit 12B, the reception unit 12C, the generation unit 12D, the second display control unit 12E, Is provided. 12 A of 1st acquisition parts acquire the feature information of a try-on person. The first display control unit 12B displays, on the first display unit 24C, the clothing image corresponding to the acquired feature information in the first information in which the feature information and the clothing image are associated at least. The receiving unit 12C receives a selection of a clothing image of a clothing to be tried on from among the clothing images displayed on the first display unit 24C. The generation unit 12D generates a composite image of the try-on image of the try-on and the selected clothing image. The second display control unit 12E displays the composite image on the second display unit 18.

  As described above, in the virtual try-on device 10 according to the present embodiment, the clothes image corresponding to the feature information of the try-on is displayed when the try-on wearer selects a clothing image to be tried on. For this reason, the try-on can select a clothing image to be tried on from the clothing images corresponding to the feature information of the try-on.

  Therefore, the virtual try-on device 10 of the present embodiment can provide a virtual try-on service according to each try-on person.

  Further, when the virtual try-on device 10 is installed in a predetermined area such as a store, the try-on as a visitor who has visited the store can input the feature information of the try-on during the waiting time in the store, By selecting a clothing image to be tried on, it is possible to enjoy virtual try-on after the end of the waiting time.

  Specifically, it is assumed that the virtual try-on device 10 is installed in a beauty salon as a store. In this case, the first terminal 24 causes the first person 24 to enter the feature information and select the clothing image to be tried on during the waiting time at the beauty salon for the dressing person who has visited the beauty salon. Then, after receiving a service such as coloring provided at the beauty salon, the try-on person stands in front of the second display unit 18 of the virtual try-on device 10 and selects desired second information. Thereby, the try-on can confirm a composite image of the try-on image of the try-on after coloring and the clothing image selected as a try-on target in advance on the second display unit 18.

  Further, the first information includes all the clothing images distributed from the second server device 32 regardless of each clothing store or each clothing brand. Then, the first display control unit 12B of the virtual try-on device 10 displays a clothing image corresponding to the feature information of the fitting person in the first information on the first display unit 24C.

  For this reason, the try-on is not limited to a specific brand or a specific store that provides clothes, and the feature information of the try-on among all the clothes images managed by the virtual try-on system 1 and the virtual try-on device 10. The clothing image to be tried on can be selected from the clothing images corresponding to.

  In addition, the first display control unit 12B further displays a recommended combination image, which is extracted according to a predetermined extraction condition and indicated by a combination of a plurality of clothes images, on the first display unit 24C. For this reason, in addition to the above effects, the virtual try-on device 10 according to the present embodiment can further easily provide information that leads to sales promotion of clothes to the try-on person.

  In addition, the first transmission unit 12H of the virtual try-on device 10 includes a clothes ID (first identification information) for identifying a clothes image to be tried on, and a try-on ID (second identification information) of a try-on that tries on clothes in the clothes image. Are transmitted to the first server device 28 connected via the network. The first reception unit 12I receives privilege information corresponding to at least one of the clothes ID and the try-on ID from the first server device 28.

  In addition, the second receiving unit 28 </ b> F of the first server device 28 receives the try-on information from the virtual try-on device 10. The creation unit 28H creates privilege information corresponding to at least one of the clothes ID and the try-on ID included in the received fitting information. The second transmitter 28G transmits the privilege information to the virtual try-on device 10.

  For this reason, the virtual try-on device 10 and the virtual try-on system 1 according to the present embodiment can easily provide privilege information according to the clothes image tried on by the try-on and the feature information of the try-on. In addition, the virtual try-on device 10 and the virtual try-on system 1 can easily provide privilege information that guides a try-on to a store that sells clothes or a virtual store, so information that leads to sales promotion of clothes can be provided. Can be provided easily.

  Therefore, in the virtual try-on device 10 and the virtual try-on system 1 of the present embodiment, a virtual try-on service corresponding to each try-on person can be provided.

  Further, the collection unit 32F of the second server device 32 collects clothing images, attribute information corresponding to the clothing images, and the like from the various server devices connected to the Internet 36 at predetermined time intervals. The second generation unit 32G generates first information (see FIG. 4) and third information (see FIG. 9) using the collected clothes image and attribute information. The distribution unit 32H distributes the generated first information and third information to the virtual try-on device 10 and the first server device 28.

  For this reason, the virtual try-on device 10 and the first server device 28 can execute the various processes described above using the latest clothing image.

  In the present embodiment, a case has been described in which various processes such as reading of a clothing image corresponding to feature information, acquisition of body parameters, generation of a composite image, and the like are executed by the virtual try-on device 10. However, these processes may be executed by the first terminal 24. In this case, each functional unit in the control unit 12 of the virtual try-on device 10 may be mounted on the control unit 24D of the first terminal 24.

  In this case, the first terminal 24 may acquire the body shape parameter from the virtual try-on device 10 or may be acquired from the input unit 24 </ b> A of the first terminal 24.

  By enabling the first terminal 24 to execute the process executed by the virtual try-on device 10, the try-on can perform virtual try-on outside a predetermined area (for example, the home of the try-on) or at any place. It can be carried out.

  In the present embodiment, the case where the first terminal 24 is a terminal used in a predetermined area such as in a store has been described. However, the first terminal 24 may be a portable terminal of a try-on person.

(Second Embodiment)
In the present embodiment, a mode will be described in which the number or type of clothing images to be displayed when selecting a clothing image to be tried on is adjusted according to the scheduled waiting time of the try-on.

  FIG. 1 is a schematic diagram of a virtual try-on system 1A of the present embodiment.

  The virtual try-on system 1A includes a virtual try-on device 10A, a first terminal 24, a second terminal 26, a first server device 28, a third server device 30, and a second server device 32. The virtual try-on device 10A, the first terminal 24, the second terminal 26, the first server device 28, the third server device 30, and the second server device 32 are connected via a known communication network such as the Internet. Connected.

  The virtual try-on system 1A has the same configuration as the virtual try-on system 1 of the first embodiment except that a virtual try-on device 10A is provided instead of the virtual try-on device 10.

  The virtual try-on device 10 </ b> A includes a control unit 13, a storage unit 14 </ b> A, and a main body unit 16. The main body 16 includes a photographing unit 20, a second display unit 18, and an irradiation unit 22. The main body 16 is the same as that of the first embodiment. The storage unit 14A, the control unit 13, and the main body unit 16 are connected so as to be able to exchange signals.

  FIG. 16 is a functional block diagram of the virtual try-on device 10A.

  The storage unit 14A is a known hard disk device. The storage unit 14A stores various data. In the present embodiment, the storage unit 14A stores various data such as first information, second information, and fourth information. The first information and the second information are the same as those in the first embodiment.

  The fourth information is information in which the relationship between the predicted time and the scheduled waiting time is associated with the display condition. FIG. 17 is a diagram illustrating an example of a data structure of the fourth information.

  The predicted time indicates an estimated time required for the try-on to select a try-on target from the plurality of clothes images displayed on the first display unit 24C. The predicted time is calculated by the control unit 13 (details will be described later).

  The scheduled waiting time indicates the scheduled waiting time required for the try-on person to receive the service provided by the store in an area such as the store where the virtual try-on device 10A is installed. The scheduled waiting time is acquired by the control unit 13 (details will be described later).

  The display condition indicates the display condition of the clothing image displayed on the first display unit 24C so as to be selectable. In the present embodiment, the display condition is that the clothing image to be displayed is displayed such that at least one of the type and the number of display of the clothing images displayed on the first display unit 24C decreases as the predicted time for the scheduled waiting time increases. At least one of the number and the type of clothes image to be displayed is determined.

  In the example shown in FIG. 17, at least one of “the number of clothes images M1” and “the clothes of all types S1” corresponds to the relationship “ts <tw” between the predicted time ts and the scheduled waiting time tw as the display condition. It is attached. The relationship “tw <ts <2tw” between the predicted time ts and the scheduled waiting time tw is associated with at least one of “M2 clothing images” and “S2 of all types of clothing” as a display condition. It has been. The relationship between the predicted time ts and the scheduled waiting time tw “2tw <ts <3tw” is associated with at least one of “M3 clothing images” and “S3 types of all types of clothing” as a display condition. It has been. The relationship “3tw <ts” between the predicted time ts and the scheduled waiting time tw is associated with at least one of “M4 clothing images” and “S4 of all types of clothing” as a display condition. Yes.

  Note that each of M1, M2, M3, and M4 represents an integer of 1 or more, and represents a relationship of M1> M2> M3> M4. Each of S1, S2, S3, and S4 represents an integer of 1 or more, and indicates a relationship of S1> S2> S3> S4.

  The types of clothes are, for example, tops, bottoms, outer, inner, etc., as described in the first embodiment.

  Note that the number of clothing images and the type of clothing shown in the display conditions are adjusted in advance so that the try-on can select at least one type of clothing image to be tried on in combination within the scheduled waiting time. That's fine. The clothes image of at least one type indicates a combination in which one type of clothing image is selected for each type of clothing such as tops, bottoms, and outerwear.

  Returning to FIG. 16, the control unit 13 includes a first acquisition unit 12A, a first display control unit 13B, a reception unit 12C, a generation unit 12D, a second display control unit 12E, a second acquisition unit 12F, A communication unit 12G (first transmission unit 12H, first reception unit 12I), an output unit 12J, an update unit 12K, a third acquisition unit 13L, a calculation unit 13M, and a determination unit 13P are included.

  First acquisition unit 12A, first display control unit 13B, reception unit 12C, generation unit 12D, second display control unit 12E, second acquisition unit 12F, communication unit 12G, output unit 12J, update unit 12K, third acquisition unit Part or all of the 13L, the calculation unit 13M, and the determination unit 13P may be realized by causing a processing device such as a CPU to execute a program, that is, by software, or by hardware such as an IC. It may be realized by using software and hardware together.

  First acquisition unit 12A, reception unit 12C, generation unit 12D, second display control unit 12E, second acquisition unit 12F, communication unit 12G (first transmission unit 12H, first reception unit 12I), output unit 12J, and update The part 12K is the same as that of the first embodiment.

  The third acquisition unit 13L acquires the scheduled waiting time of the try-on. Specifically, the third acquisition unit 13L acquires the try-on ID and the scheduled waiting time of the try-on specified by the try-on ID. In the present embodiment, the third acquisition unit 13L acquires the try-on ID and the scheduled waiting time from the second terminal 26. The user inputs the try-on ID and the scheduled waiting time by operating the input unit 26 </ b> A of the second terminal 26. The second terminal 26 may transmit the try-on ID and the scheduled waiting time received from the input unit 26A to the virtual try-on device 10A.

  Note that the third acquisition unit 13L may acquire the try-on ID and the scheduled waiting time from an input unit (not shown) provided in the virtual try-on device 10A.

  The calculation unit 13M calculates the predicted time. Specifically, the calculation unit 13M calculates the predicted time from the number of clothes images corresponding to the feature information acquired by the first acquisition unit 12A in the first information.

  Specifically, the calculation unit 13M calculates the number of clothing images for each type of clothing for the clothing images corresponding to the feature information acquired by the first acquisition unit 12A in the first information. Then, the calculation unit 13M calculates, as the predicted time, a number obtained by multiplying the multiplication value of the number of clothes images for each type of clothes by a constant. The constant may be determined in advance.

For example, in the first information, the number of clothing image corresponding to the feature information, _one N for garment type "tops", _two N for garment type "inner", the garment type "bottoms" are N is assumed to be ₃ (that is, there are 3 types of clothes corresponding to the feature information). N ₁ , N ₂ , and N ₃ are each an integer of 1 or more.

In this case, there are N ₁ × N ₂ × N ₃ combinations of clothing images. Therefore, the calculation unit 13M calculates the predicted time using the following formula (1).

ts = kN ₁ N ₂ N ₃ Formula (1)

In equation (1), k represents a constant, and ts represents the predicted time. In formula (1), ts, N ₁ , N ₂ , and N ₃ are the same as described above.

  The determination unit 13P has a target clothing to be displayed on the first display unit 24C such that the longer the estimated time with respect to the scheduled waiting time, the smaller the type and number of display of the clothing images displayed on the first display unit 24C. At least one of the image type and the display number is determined.

  In the present embodiment, the determination unit 13P displays in correspondence with the relationship between the scheduled waiting time acquired by the third acquisition unit 13L and the predicted time calculated by the calculation unit 13M in the fourth information (see FIG. 17). Read the condition. Thereby, the determination unit 13P determines at least one of the type and the number of display of the clothing image to be displayed on the first display unit 24C.

  Similar to the first display control unit 12B of the first embodiment, the first display control unit 13B first displays a clothing image corresponding to the feature information acquired by the first acquisition unit 12A in the first information. Displayed on the part 24C.

  In the present embodiment, the first display control unit 13B selects at least one clothing image of the type and the number of displays determined by the determination unit 13P from among the clothing images corresponding to the acquired feature information in the first information. Displayed on the first display unit 24C.

  For this reason, the first display unit 24C of the first terminal 24 that is visually recognized when the wearer selects a clothing image to be tried on is a clothing image corresponding to the feature information of the wearer and has a scheduled waiting time. The number of clothes images corresponding to the relationship between the estimated time and the estimated time is displayed.

  Next, a procedure of virtual try-on processing executed in the virtual try-on system 1A will be described.

  FIG. 18 is a sequence diagram illustrating a procedure of virtual try-on processing executed in the virtual try-on system 1A. In addition, the same sequence number is given to the process similar to the virtual try-on system 1, and description is abbreviate | omitted or simplified.

  First, the issuing unit 26F of the second terminal 26 issues a try-on ID (SEQ100). Next, the first terminal 24 receives the try-on ID (SEQ102). Next, the display control unit 24F displays an input screen for inputting input items for specifying feature information on the first display unit 24C (SEQ104). Next, the reception unit 24E receives feature information (SEQ106). Then, the communication unit 24G transmits the feature information to the virtual try-on device 10A (SEQ108).

  Next, the second terminal 26 receives the try-on ID and the scheduled waiting time (SEQ200). For example, the user operates the input unit 26A of the second terminal 26 to input the try-on ID and the scheduled waiting time of the try-on specified by the try-on ID. As for the scheduled waiting time, for example, the user may input the scheduled waiting time of each try-on by using the input unit 26A according to the congestion situation in the store. The control unit 26D of the second terminal 26 receives the try-on ID and the scheduled waiting time from the input unit 26A and transmits them to the virtual try-on device 10A (SEQ202).

  In the virtual try-on device 10A, the first acquisition unit 12A acquires the feature information transmitted from the first terminal 24 by SEQ108. In the virtual try-on device 10 </ b> A, the third acquisition unit 13 </ b> L acquires the try-on ID and the scheduled waiting time from the second terminal 26.

  Next, the calculation unit 13M calculates the predicted time using the first information and the acquired feature information (SEQ204).

  Next, according to the relationship between the predicted time calculated in SEQ204 and the scheduled waiting time acquired in SEQ202, the determination unit 13P determines at least the type and the number of display of the clothing images to be displayed on the first display unit 24C. One is determined (SEQ206).

  Next, the first display control unit 13B reads at least one clothing image of the determined type and the number of displays among the clothing images corresponding to the acquired feature information in the first information (SEQ208). Then, the first display control unit 13B transmits the read clothing image to the first terminal 24 (SEQ112).

  The display control unit 24F of the first terminal 24 displays a display screen including the accepted clothing image on the first display unit 24C (SEQ114).

  Then, the virtual try-on system 1A executes the processes of SEQ114 to SEQ184. The processes of SEQ114 to SEQ184 are the same as those of the first display control unit 13B except that the process of the first display control unit 12B is performed. This is the same as the first embodiment. Therefore, the description is omitted.

  As described above, the virtual try-on device 10A of the present embodiment includes the first acquisition unit 12A, the third acquisition unit 13L, the calculation unit 13M, the determination unit 13P, the first display control unit 13B, and the reception. A unit 12C, a generation unit 12D, and a second display control unit 12E are provided.

  12 A of 1st acquisition parts acquire the feature information of a try-on person. The third acquisition unit 13L acquires the scheduled waiting time of the try-on. The calculation unit 13M calculates a predicted time required for the try-on to select a try-on target from the plurality of clothes images displayed on the first display unit 24C. The determination unit 13P has a target clothing to be displayed on the first display unit 24C such that the longer the estimated time with respect to the scheduled waiting time, the smaller the type and number of display of the clothing images displayed on the first display unit 24C. At least one of the image type and the display number is determined. The first display control unit 13B displays, on the first display unit 24C, at least one clothing image of the determined type and the number of displays among the clothing images corresponding to the acquired feature information in the first information. The receiving unit 12C receives a selection of a clothing image of a clothing to be tried on from among the clothing images displayed on the first display unit 24C. The generation unit 12D generates a composite image of the try-on image of the try-on and the selected clothing image. The second display control unit 12E displays the composite image on the second display unit 18.

  As described above, the virtual try-on device 10A according to the present embodiment is a clothing image corresponding to the feature information of the wearer among the clothing images included in the first information, and includes the scheduled waiting time and the predicted time. A list of clothing images corresponding to the relationship is displayed on the first display unit 24C.

  Therefore, in the virtual try-on device 10A, the first number of clothes images and the number of kinds of clothes images that can be selected from a plurality of clothes images to be tried on, which are at least one type of combination, within the scheduled waiting time are given to the first person. It can be displayed on the display unit 24C.

  Therefore, the virtual try-on device 10A of the present embodiment can provide a virtual try-on service corresponding to each try-on person.

(Third embodiment)
In the present embodiment, a mode is described in which the display screen displayed when selecting a clothing image to be tried on is changed according to the feature information of the try-on.

  FIG. 1 is a schematic diagram of a virtual fitting system 1B according to the present embodiment.

  The virtual try-on system 1B includes a virtual try-on device 10B, a first terminal 24, a second terminal 26, a first server device 28, a third server device 30, and a second server device 32. The virtual try-on device 10B, the first terminal 24, the second terminal 26, the first server device 28, the third server device 30, and the second server device 32 are connected via a known communication network such as the Internet. Connected.

  The virtual try-on system 1B has the same configuration as the virtual try-on system 1 of the first embodiment except that a virtual try-on device 10B is provided instead of the virtual try-on device 10.

  The virtual try-on device 10 </ b> B includes a control unit 15, a storage unit 14 </ b> B, and a main body unit 16. The main body 16 includes a photographing unit 20, a second display unit 18, and an irradiation unit 22. The main body 16 is the same as that of the first embodiment. The memory | storage part 14B, the control part 15, and the main-body part 16 are connected so that signal transmission / reception is possible.

  FIG. 19 is a functional block diagram of the virtual try-on device 10B.

  The storage unit 14B is a known hard disk device. The storage unit 14B stores various data. In the present embodiment, the storage unit 14B stores various data such as first information, second information, and fifth information. The first information and the second information are the same as those in the first embodiment.

  The fifth information is information in which the feature information is associated with the screen design. FIG. 20 is a diagram illustrating an example of a data structure of the fifth information.

  The feature information is the same as that in the first embodiment. That is, the feature information includes at least one of an appearance feature and an inner feature of the fitting person. Specifically, the feature information indicates at least one of a body shape parameter indicating the body shape of a try-on, a feature color of the try-on, an age group of the try-on, a personality of the try-on, and a taste of the try-on.

  The screen design corresponds to the feature information, the background color of the display screen, the display size of at least one of the items and clothing images displayed on the display screen, the item color of the items, and the display on the display screen of at least one of the items and clothing images Indicates the location. The item displayed on the display screen indicates an image other than the clothing image included in the display screen. Items to be displayed on the display screen include button images for performing various operation instructions, and character images indicating explanations for try-on users.

  The fifth information may be set in advance by an operation instruction of the input unit (not shown) by the user and stored in the storage unit 14B. Note that the fifth information may be generated in advance by an external device and stored in the storage unit 14B.

  In the fifth information, for example, a corresponding screen design is set such that the higher the age group indicated in the feature information, the larger the display size of at least one of the items displayed on the display screen and the clothing image. For example, in the fifth information, the item color and background color of the same hue as the feature color indicated in the feature information are set as the corresponding screen design.

  Returning to FIG. 19, the control unit 15 includes a first acquisition unit 12A, a first display control unit 15B, a reception unit 12C, a generation unit 15D, a second display control unit 12E, a second acquisition unit 12F, A communication unit 12G (first transmission unit 12H, first reception unit 12I), an output unit 12J, and an update unit 12K are included.

  First acquisition unit 12A, first display control unit 15B, reception unit 12C, generation unit 15D, second display control unit 12E, second acquisition unit 12F, communication unit 12G (first transmission unit 12H, first reception unit 12I) A part or all of the output unit 12J and the update unit 12K may be realized by causing a processing device such as a CPU to execute a program, that is, by software, or by hardware such as an IC. Alternatively, software and hardware may be used in combination.

  The first acquisition unit 12A, the reception unit 12C, the second display control unit 12E, the second acquisition unit 12F, the communication unit 12G (the first transmission unit 12H, the first reception unit 12I), the output unit 12J, and the update unit 12K This is the same as in the first embodiment.

  As with the first display control unit 12B of the first embodiment, the first display control unit 15B first displays a clothing image corresponding to the feature information acquired by the first acquisition unit 12A in the first information. This is displayed on the part 24C.

  In the present embodiment, the first display control unit 15B generates a display screen including a clothing image corresponding to the acquired feature information in the first information according to the acquired feature information, and the first display unit 24C is displayed.

  That is, the first display control unit 15B has at least one of the display size of at least one of the item and the clothing image displayed on the display screen, the item color of the item, and the display position on the display screen of at least one of the item and the clothing image. One is generated according to the feature information and displayed on the first display unit 24C.

  Specifically, the first display control unit 15B reads the screen design corresponding to the acquired feature information from the fifth information (see FIG. 20). And the 1st display control part 15B arrange | positions the clothing image corresponding to the acquired feature information in the 1st information in the position and magnitude | size according to the read screen design. Further, the predetermined items included in the display screen are adjusted so as to have the display position, size, and color according to the acquired feature information. Thereby, the first display control unit 15B generates a display screen having a screen design corresponding to the acquired feature information, and displays the display screen on the first display unit 24C.

  For this reason, the display screen displayed on the first display unit 24C of the first terminal 24, which is visually recognized when the try-on chooses a clothing image to be tried on, has a screen design according to the feature information of the try-on.

  The generation unit 15D generates a composite image of the try-on's try-on image and the selected clothing image in the same manner as the generation unit 12D in the first embodiment. In the present embodiment, the generation unit 15D further generates a composite image in which the try-on image and the selected clothing image are superimposed on the background image corresponding to the feature information.

  Note that the generation unit 15D may store a background image corresponding to the feature information in the storage unit 14B in advance. The background image is, for example, an image such as a color or a scene according to the feature information. Then, the generation unit 15D may read the background image corresponding to the feature information of the try-on from the storage unit 14B and generate a composite image.

  Next, a procedure of virtual try-on processing executed in the virtual try-on system 1B will be described.

  FIG. 21 is a sequence diagram showing a procedure of virtual try-on processing executed in the virtual try-on system 1B. In addition, the same sequence number is given to the process similar to the virtual try-on system 1, and description is abbreviate | omitted or simplified.

  First, the issuing unit 26F of the second terminal 26 issues a try-on ID (SEQ100). Next, the first terminal 24 receives the try-on ID (SEQ102). Next, the display control unit 24F displays an input screen for inputting input items for specifying feature information on the first display unit 24C (SEQ104). Next, the reception unit 24E receives feature information (SEQ106). Then, the communication unit 24G transmits the feature information to the virtual try-on device 10B (SEQ108).

  Next, the first display control unit 15B reads a clothing image corresponding to the acquired feature information in the first information (SEQ110). Next, the first display control unit 15B generates a display screen including the clothing image read in SEQ110 according to the screen design corresponding to the feature information acquired in SEQ108 (SEQ311). Then, the first display control unit 15B transmits the generated display screen to the first terminal 24 (SEQ312).

  The display control unit 24F of the first terminal 24 displays the received display screen on the first display unit 24C (SEQ313).

  FIG. 22 is a diagram illustrating an example of a display screen. FIG. 22A is a diagram illustrating an example of the display screen 50 in the case where the feature color of the try-in included in the feature information of the try-on is an image that represents the season “spring”. FIG. 22B is a diagram showing an example of the display screen 52 in the case where the feature color of the try-in included in the feature information of the try-on is an image that represents the season “autumn”.

  As shown in FIG. 22, the colors of the area 50 </ b> A in the display screen 50 and the corresponding area 52 </ b> A in the display screen 52 are different from each other according to the feature information of the try-on. The colors of the area 50B in the display screen 50 and the corresponding area 52B in the display screen 52 are different from each other according to the feature information of the try-on. The screen design is not limited to the form shown in FIG.

  Returning to FIG. 21, next, the virtual try-on system 1 </ b> B executes the processing of SEQ <b> 116 to SEQ <b> 148. Note that the processing of SEQ116 to SEQ148 is the same as that of the first embodiment, and thus description thereof is omitted.

  Next, the generation unit 15D adds the try-on image of the try-on photographed by the first photographing unit 20A on the background image corresponding to the feature information acquired in SEQ 106, and the second information received in SEQ 146 (FIG. 5). A composite image is generated by superimposing the clothing image corresponding to the clothing ID included in the reference (SEQ350).

  Next, the second display control unit 12E displays the composite image generated in SEQ350 on the second display unit 18 (SEQ152). Next, the receiving unit 12C determines whether or not a composite image change instruction has been received (SEQ154).

  When an affirmative determination is made in SEQ154 (SEQ154: Yes), the generation unit 12D stores other second information including the try-on ID included in the second information corresponding to the composite image displayed on the second display unit 18 last time. A search is performed from 14B, and one second information that has not been displayed in the composite image is read. Then, the generation unit 12D generates a composite image in the same manner as SEQ350, using the read second information (SEQ356).

  Then, the virtual try-on system 1B executes SEQ158 to SEQ184 as in the first embodiment.

  As described above, the virtual try-on device 10B of the present embodiment includes the first acquisition unit 12A, the first display control unit 15B, the reception unit 12C, the generation unit 15D, the second display control unit 12E, including. 12 A of 1st acquisition parts acquire the feature information of a try-on person. The first display control unit 15B generates a display screen including a clothing image corresponding to the acquired feature information in the first information according to the acquired feature information, and displays the display screen on the first display unit 24C. The receiving unit 12C receives a selection of a clothing image of a clothing to be tried on from among the clothing images displayed on the first display unit 24C. The generation unit 15D generates a composite image of the try-on image of the try-on and the selected clothing image. The second display control unit 12E displays the composite image on the second display unit 18.

  As described above, the virtual try-on device 10B according to the present embodiment generates a display screen including the clothing image corresponding to the acquired feature information in the first information according to the acquired feature information, and the first display unit 24C. To display.

  Therefore, the virtual try-on device 10B of the present embodiment can provide a virtual try-on service according to each try-on person.

(Fourth embodiment)
Next, the virtual try-on device 10, the virtual try-on device 10A, the virtual try-on device 10B, the first terminal 24, the second terminal 26, the first server device 28, the first of the first to third embodiments. The hardware configuration of the three server device 30 and the second server device 32 will be described. FIG. 23 shows the virtual try-on device 10, the virtual try-on device 10A, the virtual try-on device 10B, the first terminal 24, the second terminal 26, the first server device 28, of the first to third embodiments. It is a block diagram which shows the hardware structural example of the 3rd server apparatus 30 and the 2nd server apparatus 32. FIG.

  Virtual try-on device 10, virtual try-on device 10A, virtual try-on device 10B, first terminal 24, second terminal 26, first server device 28, third server device of the first to third embodiments. 30, the second server device 32 includes a display unit 80, a communication I / F unit 82, an input unit 94, a CPU 86, a ROM (Read Only Memory) 88, a RAM (Random Access Memory) 90, an HDD 92, and the like via a bus 96. They are connected to each other and have a hardware configuration using a normal computer.

  The CPU 86 processes the virtual try-on device 10, the virtual try-on device 10A, the virtual try-on device 10B, the first terminal 24, the second terminal 26, the first server device 28, the third server device 30, and the second server device 32. Is an arithmetic device for controlling The RAM 90 stores data necessary for various processes by the CPU 86. The ROM 88 stores a program for realizing various processes by the CPU 86 and the like. The HDD 92 stores data stored in each of the storage units 14, 14A, 14B described above. The communication I / F unit 82 is an interface for connecting to an external device or an external terminal via a communication line or the like and transmitting / receiving data to / from the connected external device or external terminal. The display unit 80 corresponds to each of the second display unit 18, the first display unit 24C, the display unit 26C, the display unit 32C, the display unit 30C, and the display unit 28C described above. The input unit 94 receives an operation instruction from the user.

  Virtual try-on device 10, virtual try-on device 10A, virtual try-on device 10B, first terminal 24, second terminal 26, first server device 28, third server device of the first to third embodiments. 30 and the program for executing the various processes executed by the second server device 32 are provided by being incorporated in advance in the ROM 88 or the like.

  In the first embodiment to the third embodiment, the virtual try-on device 10, the virtual try-on device 10A, the virtual try-on device 10B, the first terminal 24, the second terminal 26, the first server device 28, the third The programs executed in the server device 30 and the second server device 32 are files of a format that can be installed in these devices or an executable format, and are CD-ROM, flexible disk (FD), CD-R, DVD (Digital). It may be configured to be recorded on a computer-readable recording medium such as Versatile Disk).

  Also, the virtual try-on device 10, the virtual try-on device 10A, the virtual try-on device 10B, the first terminal 24, the second terminal 26, the first server device 28, the third embodiment of the first to third embodiments. The program executed by the server device 30 and the second server device 32 may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the virtual try-on device 10, the virtual try-on device 10A, the virtual try-on device 10B, the first terminal 24, the second terminal 26, the first server device 28, the third embodiment of the first to third embodiments. You may comprise so that the program for performing each said process in the server apparatus 30 and the 2nd server apparatus 32 may be provided or distributed via networks, such as the internet.

  Virtual try-on device 10, virtual try-on device 10A, virtual try-on device 10B, first terminal 24, second terminal 26, first server device 28, third server device of the first to third embodiments. As for the program for performing the said various processes performed by 30 and the 2nd server apparatus 32, each part mentioned above is produced | generated on a main memory.

  Various information stored in the HDD 92 may be stored in an external device. In this case, the external device and the CPU 86 may be connected via a network or the like.

  In addition, although several embodiment of this invention was described above, these embodiment is shown as an example and is not intending limiting the range of invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

1, 1A, 1B Virtual try-on system 10, 10A, 10B Virtual try-on device 12A First acquisition unit 12B, 13B, 15B First display control unit 12C Reception unit 12D, 15D generation unit 12E Second display control unit 12F Second acquisition unit 12H 1st transmission part 12I 1st reception part 12J Output part 13L 3rd acquisition part 13M Calculation part 13P Determination part 18 2nd display part 24C 1st display part 28F 2nd reception part 28G 2nd transmission part

Claims (13)

A first acquisition unit for acquiring feature information of the fitting person;
A first display control unit that displays the clothing image corresponding to the acquired feature information on the first display unit in the first information in which the feature information and the clothing image are associated at least;
A reception unit that receives a selection of a clothing image of a clothing to be tried on from among the clothing images displayed on the first display unit;
A generating unit that generates a composite image of the try-on image of the try-on and the selected clothing image;
A second display control unit for displaying the composite image on a second display unit;
Virtual fitting device with The reception unit receives a selection of a plurality of clothes images to be tried on in combination from a try-onr,
The generation unit generates a composite image of the try-on image and the selected plurality of clothes images.
The virtual try-on device according to claim 1. A second acquisition unit for acquiring a body type parameter indicating the body type of the fitting person;
The generator is
Generating a composite image of a corrected image obtained by correcting the selected clothing image in accordance with the acquired body parameter and the try-on image;
The virtual try-on device according to claim 1.   The virtual try-on device according to claim 1, wherein the second display control unit displays the composite image on the first display unit as the second display unit.   The virtual fitting device according to claim 1, wherein the feature information includes at least one of an appearance feature and an inside feature of the fitting person.   The feature information indicates at least one of a body shape parameter indicating a body shape of the fitting person, a characteristic color of the fitting person, an age group of the fitting person, a character of the fitting person, and a taste of the fitting person. The virtual fitting device according to 1. The first display control unit includes:
The recommended image of the clothes image extracted according to a predetermined extraction condition is further displayed on the first display unit.
The virtual try-on device according to claim 1.   The virtual try-on device according to claim 7, wherein the recommended image is indicated by a combination of a plurality of clothes images.   The extraction conditions include the acquired feature information, the clothes image selected by the try-in in the past, the clothes image selected by other try-in in the past, the clothes image recommended by a store selling clothes, The clothes image recommended by another try-on selected by the try-on, the clothes image corresponding to the body shape that matches or resembles the body shape of the try-in person, and other try-ons with a taste that matches or resembles the taste of the try-on The virtual try-on device according to claim 7, wherein the virtual try-on device is at least one of the clothing images selected by the person in the past. The clothes image included in the first information includes a first clothes image indicating clothes in a worn state, and a second clothes image indicating clothes in a state of being placed in a shape.
The first display control unit displays the second clothing image corresponding to the acquired feature information in the first information on the first display unit,
The generating unit generates a composite image of the try-on image and the first clothing image corresponding to the selected clothing image;
The virtual try-on device according to claim 1. A first acquisition unit for acquiring feature information of the fitting person;
First display control for displaying, on the first display unit, the attribute information corresponding to the acquired feature information in the first information in which the feature information, the clothing image, and the attribute information about the clothing image are associated at least. And
A receiving unit that accepts selection of attribute information corresponding to the clothing to be tried on from among the attribute information displayed on the first display unit;
A generating unit that generates a composite image of the try-on image of the try-on and the clothing image corresponding to the selected attribute information;
A second display control unit for displaying the composite image on a second display unit;
Virtual fitting device with Obtaining feature information of the fitting person;
Displaying the clothing image corresponding to the acquired feature information on the first display unit in the first information at least associating the feature information with the clothing image;
A step of receiving a selection of a clothing image of a clothing to be tried on from among the clothing images displayed on the first display unit;
Generating a composite image of the fitting person image of the fitting person and the selected clothing image;
Displaying the composite image on a second display unit;
Including virtual fitting methods. On the computer,
Obtaining feature information of the fitting person;
Displaying the clothing image corresponding to the acquired feature information on the first display unit in the first information at least associating the feature information with the clothing image;
A step of receiving a selection of a clothing image of a clothing to be tried on from among the clothing images displayed on the first display unit;
Generating a composite image of the fitting person image of the fitting person and the selected clothing image;
Displaying the composite image on a second display unit;
A program that executes

Images