JP5785218B2 - Network system, server, home appliance, program, and home appliance linkage method - Google Patents

Description

  The present invention relates to a network system, a server, a home appliance, a program, and a home appliance linkage method in which a plurality of home appliances operate in cooperation.

  2. Description of the Related Art Conventionally, techniques related to electronic devices that emit sound are known. The technique is described in the following patent documents, for example.

  Japanese Unexamined Patent Application Publication No. 2008-131402 (Patent Document 1) discloses a home automation system. According to Japanese Patent Application Laid-Open No. 2008-131402 (Patent Document 1), in a home automation system in which home devices are organically linked to each other and control and monitor terminal devices from the controller via an interface unit, the controller is a terminal. A home automation control discriminating means that operates when a device is controlled and has a home automation control discriminating function that recognizes that the controller has controlled the terminal device. Provided.

  International Publication No. 12/131832 (Patent Document 2) discloses a speech reading apparatus. According to the pamphlet of International Publication No. 12/131830 (Patent Document 2), the speech reading apparatus transmits a request corresponding to the remote control operation to a remote control input unit that accepts a remote control operation and a remote device that stores content. A communication unit that receives response data corresponding to the request, a process control unit that controls a process according to a remote control operation received by the remote control input unit, and a process according to the response data received by the communication unit, and a process control A sound generation unit that generates a sound signal related to the process controlled by the unit, and a sound output unit that reproduces the sound signal generated by the sound generation unit, and the process control unit receives a remote control operation accepted by the remote control input unit A sound signal indicating a process corresponding to the signal is repeatedly generated in the sound generator while the process continues. Make.

JP 2008-131402 A International Publication No. 2012/131832 Pamphlet

  Conventional home appliances emit voice only to convey information to the user. Therefore, the user easily has an inorganic impression regarding home appliances.

  The present invention has been made to solve such a problem, and an object of the present invention is to provide a network system, a server, a home appliance, a program, and a home appliance linkage method that makes it easier for the user to feel humanity with respect to the home appliance. There is.

  According to an aspect of the present invention, a network system including a first home appliance and a second home appliance is provided. When the first home appliance receives the command, the first home appliance outputs a voice representing an instruction to the second home appliance. The second home appliance outputs a response to the instruction by voice.

  According to another aspect of the present invention, a network system including a first home appliance, a second home appliance, and a server is provided. When the first home appliance receives the command, the server causes the first home appliance to output a voice representing an instruction for the second home appliance. The server causes the second home appliance to output a response to the instruction by voice.

  Preferably, the voice instruction includes information for specifying the second home appliance.

  Preferably, when the second home appliance completes the operation in response to the instruction, the first home appliance outputs a word representing an acknowledgment for the second home appliance by voice.

  Preferably, after the output of the instruction voice by the first home appliance is completed, the second home appliance outputs a response by voice.

  Preferably, the first home appliance performs an operation according to the command when receiving the command. The second home appliance performs an operation according to the instruction when the instruction is received.

  According to another aspect of the invention, a home appliance is provided. The home appliance includes a speaker and a processor that receives a command from the outside, controls each part of the home appliance in accordance with the command, and outputs a voice representing an instruction to another home appliance through the speaker.

  According to another aspect of the invention, a server is provided. The server includes a communication interface for communicating with the first and second home appliances, a memory for storing a correspondence relationship between an instruction input to the first home appliance and an instruction output to the second home appliance. Processor. When the first home appliance receives the command, the processor refers to the correspondence relationship, causes the first home appliance to output a voice representing an instruction for the second home appliance via the communication interface, and via the communication interface, The second home appliance is caused to output a response to the instruction by voice.

  According to another aspect of the present invention, a program for controlling a home appliance including a speaker and a processor is provided. The program causes the processor to execute a step of receiving a command, a step of controlling each part of the home appliance in accordance with the command, and a step of outputting a voice representing an instruction to another home appliance via the speaker.

  According to another aspect of the present invention, a server including a communication interface, a processor, and a memory for storing a correspondence relationship between an instruction input to the first home appliance and an instruction output to the second home appliance A program for controlling the program is provided. The program causes the processor to refer to the correspondence relationship when the first home appliance receives an instruction, and to cause the first home appliance to output a voice representing an instruction for the second home appliance via the communication interface; And causing the second home appliance to output a response to the instruction by voice.

  When another aspect of this invention is followed, the cooperation method of a household appliance is provided. In the home appliance cooperation method, the first home appliance accepts the command, the first home appliance controls each part of the first home appliance in response to the command, and the first home appliance corresponds to the command. A step of outputting a voice representing an instruction to the second home appliance; and a step of the second home appliance outputting a response to the instruction by voice.

  As mentioned above, according to this invention, since a household appliance talks with a household appliance, it becomes easy for a user to feel a human feeling with respect to a household appliance.

It is a 1st image figure which shows the whole structure and operation | movement outline | summary of the network system concerning this embodiment. It is a 2nd image figure which shows the whole structure and operation | movement outline | summary of the network system concerning this embodiment. It is a 3rd image figure which shows the whole structure and operation | movement outline | summary of the network system concerning this embodiment. It is a 4th image figure which shows the whole structure and operation | movement outline | summary of the network system concerning this embodiment. It is a 5th image figure which shows the whole structure and operation | movement outline | summary of the network system concerning this embodiment. It is a 6th image figure which shows the whole structure and operation | movement outline | summary of the network system concerning this embodiment. It is a block diagram showing the hardware constitutions of the server which concerns on this embodiment. It is an image figure which shows the information contained in the control command database concerning this embodiment. It is a block diagram showing the hardware constitutions of the cleaner which concerns on 1st and 6th embodiment. It is a block diagram showing the hardware constitutions of the air conditioner concerning this embodiment. It is a block diagram showing the hardware constitutions of the television which concerns on this embodiment. It is a block diagram showing the hardware constitutions of the smart phone concerning this embodiment. It is a block diagram showing the hardware constitutions of the washing machine which concerns on this embodiment. It is a sequence diagram which shows the process sequence in the network system which concerns on 1st Embodiment. It is an image figure which shows the display screen of the smart phone concerning this embodiment. It is a sequence diagram which shows the process sequence of an example of the cooperation operation | movement of the household appliance in the network system which concerns on 1st Embodiment. It is a sequence diagram which shows the process sequence in the network system which concerns on 2nd Embodiment. It is a sequence diagram which shows the process sequence in the network system which concerns on 6th Embodiment. It is a sequence diagram which shows the process sequence of an example of the cooperation operation | movement of the household appliance in the network system which concerns on 6th and 13th embodiment. It is a sequence diagram which shows the process sequence in the network system which concerns on 7th Embodiment. It is a block diagram showing the hardware constitutions of the cleaner which concerns on 13th Embodiment. It is a sequence diagram which shows the process sequence in the network system which concerns on 13th Embodiment. It is a sequence diagram which shows the process sequence in the network system which concerns on 14th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.
<First Embodiment>
<Overall configuration of network system>

  First, the overall configuration of the network system 1 according to the present embodiment will be described with reference to FIGS. 1 to 6 are image diagrams showing an overall configuration and an operation outline of the network system 1 according to the present embodiment.

  Network system 1 includes a plurality of home appliances arranged in a residence or an office, smartphones 500A, 500B, 500C, and server 100. Examples of the home appliance include a vacuum cleaner 200, an air conditioner 300, a television 400, a washing machine, a refrigerator, a rice cooker, an air cleaner, floor heating, and an IH (Induction Heating) cooking heater. Note that home appliances may include AV devices such as home servers.

The plurality of home appliances are paired with each other and exchange various information. A plurality of home appliances may be paired with the smartphones 500A, 500B, and 500C. The plurality of home appliances and the smartphones 500A, 500B, and 500C can be connected to the external server 100 via a wireless LAN, a wired LAN, a router, and the Internet.
<Overview of network system operation>

  Next, an operation outline of the network system 1 according to the present embodiment will be described. First, the cooperative operation of the vacuum cleaner 200, the air conditioner 300, and the television 400 when cleaning is started in the living room will be described with reference to FIGS.

  Referring to FIG. 1, when a user asks the cleaner 200 to “clean”, the cleaner 200 acquires various information such as a weather forecast from the server 100 via the Internet. When the weather is fine, the vacuum cleaner 200 emits a voice saying "I understand. Why don't you open the window because the weather is good?" It is preferable that the vacuum cleaner 200 does not prompt the user to open the window when the weather is bad or the amount of pollen is large.

  Referring to FIG. 2, when the user says “I don't like it because it is annoying.” Toward the vacuum cleaner 200, the vacuum cleaner 200 emits a voice saying, “Air conditioning, clean up the ions.” . The air conditioner 300 emits a voice saying “You know, Mr. Vacuum cleaner. The air conditioner 300 starts to generate ions, and then emits a voice saying, “Mr. vacuum cleaner, I have started to emit ions now.” The vacuum cleaner 200 emits a voice saying "Thank you for the air conditioner. I will contact you when the cleaning is over."

  With reference to FIG. 3, the vacuum cleaner 200 emits a voice saying “Mr. TV, turn up the volume because you are cleaning.” The television 400 emits a voice saying “You know the vacuum cleaner. When the volume is increased, the television 400 emits a voice “Sound cleaner, volume increased.” The vacuum cleaner 200 emits a voice saying "Thank you, TV. I will contact you when the cleaning is over."

  Next, the cooperative operation of the vacuum cleaner 200, the air conditioner 300, and the television 400 when cleaning is completed in the living room will be described with reference to FIG. The vacuum cleaner 200 emits a sound “Cleaning is complete” toward the user. The vacuum cleaner 200 emits a voice saying "Air conditioning, you can stop the ions because cleaning is complete." The air conditioner 300 emits a voice saying, “Mr. Vacuum cleaner, OK. The vacuum cleaner 200 emits a voice saying "Thank you for your cooperation, Air Conditioner".

  The vacuum cleaner 200 emits a voice saying, “Mr. TV, the volume can be returned to the original level because the cleaning is finished.” The television 400 emits a voice saying, “Mr. Vacuum cleaner, OK. The vacuum cleaner 200 emits a voice saying “Thank you for your cooperation.

  Next, the cooperative operation of the vacuum cleaner 200 and the air conditioner 300 when the user stops the generation of ions will be described with reference to FIG. When the user instructs the vacuum cleaner 200 to “stop the generation of ions”, the vacuum cleaner 200 emits a voice saying “Air conditioning, stop the generation of ions”. The air conditioner 300 emits a voice saying, “Mr. Vacuum cleaner, OK. The vacuum cleaner 200 emits a voice saying "I'm sorry, Air Conditioner."

  Next, the cooperative operation of the air conditioner 300 and the washing machine 600 will be described with reference to FIG. The washing machine 600 emits a voice saying “Laundry is finished”. The washing machine 600 acquires various information such as a weather forecast from the server 100 via the Internet. When the weather is bad or the amount of pollen is large, the washing machine 600 emits a voice saying “Air conditioning, it is raining, so the room may be aired or dry.” The air conditioner 300 emits a voice saying “Mr. Washing machine, I understand. The washing machine 600 emits a voice saying “Thank you for the air conditioner”.

  As described above, in the network system 1 according to the present embodiment, a plurality of home appliances have a conversation with each other, that is, the home appliance talks to the home appliance, and the home appliance simply transmits information to the user. It is not a thing. In addition, while the home appliances are talking to each other, the user feels as if he / she is not speaking to him / her, so the user can easily feel humanity regarding the home appliance.

  Further, in order for the home appliance (first home appliance) to output a voice representing an instruction to another home appliance (second home appliance) in response to an instruction received by itself or in response to its own operation. It is easy for a user who is listening to both voices to recognize the cooperation method of a plurality of home appliances. In addition, since the other home appliance (second home appliance) outputs a response to the home appliance (first home appliance) by voice, the user listening to both voices recognizes the cooperation method of the plurality of home appliances. It's easy to do. That is, the possibility that the user cannot understand why the other home appliance (second home appliance) that has not received a command from the user suddenly starts operating is reduced.

Hereinafter, a specific configuration of each part of the network system 1 for realizing such a function will be described in detail.
<Hardware Configuration of Server 100>

  First, an aspect of a specific configuration of the server 100 will be described. FIG. 7 is a block diagram illustrating a hardware configuration of the server 100 according to the present embodiment. Referring to FIG. 7, server 100 includes, as main components, CPU (Central Processing Unit, also simply referred to as a processor) 110, memory 101, memory interface 102, keyboard 103, display 104, and communication interface. 106 and a clock 109.

  The CPU 110 controls each unit of the server 100 by executing a program stored in the memory 101 or an external storage medium. The CPU 110 executes the program stored in the memory 101 or an external storage medium, thereby realizing the operations shown in FIGS. 1 to 6 and the functions and steps described below.

  The keyboard 103 receives a command from the user and inputs the command to the CPU 110. The display 104 outputs characters and images based on signals from the CPU 110.

  The keyboard 103 and the display 104 may be a touch panel 105. The touch panel 105 may be any type such as a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, and a capacitance method. The touch panel 105 may include an optical sensor liquid crystal. The touch panel 105 detects a touch operation on the touch panel 105 by an external object every predetermined time, and inputs touch coordinates (coordinates) to the CPU 110.

  The memory 101 is realized by various RAMs (Random Access Memory), various ROMs (Read-Only Memory), and the like. The memory 101 is a USB (registered trademark) memory, CD, DVD, memory card, FD, hard disk, magnetic tape, cassette tape, MO, MD, IC card, optical card, mask ROM used via an interface. It is also realized by a storage medium such as EPROM or EEPROM.

  The memory 101 stores a program executed by the CPU 110, data generated by the execution of the program by the CPU 110, data input via the keyboard 103 or the touch panel 105, a database described later, and the like.

  Here, FIG. 8 is an image diagram showing information included in the control command database 101A according to the present embodiment. With reference to FIG. 7 and FIG. 8, the memory 101 according to the present embodiment includes a command that is input to a home appliance and transmitted from the home appliance to the server 100, and a command that is output from the server 100 to the home appliance and other home appliances And a control instruction database 101A indicating the correspondence relationship between the When an instruction is input to the home appliance, the CPU 110 refers to the control instruction database 101A based on the instruction and the home appliance to which the instruction is input, and transmits control data corresponding to the instruction and the control data. Read the destination. The CPU 110 transmits the control data to the transmission destination via the communication interface 106.

  1 to 6 and FIG. 8, in the present embodiment, the air conditioner 300 (second home appliance) is specified in the instruction issued by the cleaner 200 (first home appliance). Information to do. When the air conditioner 300 (second home appliance) completes the operation corresponding to the instruction from the vacuum cleaner 200 (first home appliance), the vacuum cleaner 200 gives “thank you”, “sorry” “ Words that express acknowledgments and concluding words such as "Thank you" are spoken.

  In addition, the memory 101 stores information on home appliances belonging to the home and office (hereinafter referred to as home appliance information 101B) for each of a plurality of homes and offices. More specifically, the home appliance information 101B includes, for each of a plurality of homes and offices, the names of home appliances belonging to the homes and offices, their IP addresses, their functions, whether or not they can be paired with other home appliances, and other home appliances. Including pairing status. In this way, the CPU 110 can identify the home appliance that is paired with the home appliance to which the command is input.

  The CPU 110 may read data stored in an external storage medium via the memory interface 102 and store the data in the memory 101. Conversely, the CPU 110 may read data from the memory 101 and store the data in an external storage medium via the memory interface 102.

  As a storage medium, non-volatile programs such as USB memory, CD, DVD, memory card, FD, hard disk, magnetic tape, cassette tape, MO, MD, IC card, optical card, mask ROM, EPROM, EEPROM, etc. And other data storage media.

  The communication interface 106 is realized by an antenna or a connector. The communication interface 106 exchanges data with other devices by wired communication or wireless communication. The CPU 110 receives a program such as control data, image data, and text data from another device via the communication interface 106, and transmits a program such as control data, image data, and text data to another device. To do.

  Specifically, the CPU 110 uses the communication interface 106 to transmit data via a plurality of home appliances such as the vacuum cleaner 200, the air conditioner 300, the television 400, and the washing machine 600, and a plurality of smartphones 500A, 500B, and 500C. Send and receive. The CPU 110 can also transmit / receive data to / from the external keyboard 130 and the display 140 via the communication interface 106.

The clock 109 outputs the current time to the CPU 110 or outputs the elapsed time from a predetermined timing.
<Hardware configuration of vacuum cleaner 200>

  Next, an aspect of a specific configuration of the cleaner 200 will be described. FIG. 9 is a block diagram illustrating a hardware configuration of the vacuum cleaner 200 according to the present embodiment. Referring to FIG. 9, the vacuum cleaner 200 includes, as main components, a CPU 210, a memory 201, a memory interface 202, a button 203, a display 204, a communication interface 206, a speaker 207, a microphone 208, A clock 209 and a cleaning control circuit 220 are included.

  The CPU 210 controls each part of the cleaner 200 by executing a program stored in the memory 201 or an external storage medium. The CPU 210 implements the operations shown in FIGS. 1 to 6 and functions and steps described later by executing a program stored in the memory 201 or an external storage medium and control data received from the server 100.

  The button 203 receives a command from the user and inputs the command to the CPU 210. The display 204 outputs characters and images based on signals from the CPU 210.

  Note that the button 203 and the display 204 may be a touch panel 205. The touch panel 205 may be any type such as a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, and a capacitance method. The touch panel 205 may include an optical sensor liquid crystal. The touch panel 205 detects a touch operation on the touch panel 205 by an external object every predetermined time, and inputs touch coordinates (coordinates) to the CPU 210.

  The memory 201 is realized by various RAMs, various ROMs, and the like. Note that the memory 201 is a USB memory, CD, DVD, memory card, FD, hard disk, magnetic tape, cassette tape, MO, MD, IC card, optical card, mask ROM, EPROM, EEPROM used via an interface. It is also realized by a storage medium such as

  The memory 201 stores a program executed by the CPU 210, data generated by execution of the program by the CPU 210, data input via the button 203 or the touch panel 205, control data received from the server 100, and the like.

  The CPU 210 may read data stored in an external storage medium via the memory interface 202 and store the data in the memory 201. Conversely, the CPU 210 may read data from the memory 201 and store the data in an external storage medium via the memory interface 202. Since the external storage medium is the same as that of the server 100, the illustration is not repeated here.

  The communication interface 206 is realized by an antenna or a connector. The communication interface 206 exchanges data with other devices by wired communication or wireless communication. The CPU 210 receives a program such as control data, image data, and text data from another device via the communication interface 206, or transmits a program such as control data, image data, and text data to another device. To do.

  Specifically, CPU 210 transmits / receives data to / from server 100 and a plurality of smartphones 500A, 500B, and 500C via the Internet by using communication interface 206. The CPU 210 uses the communication interface 206 to directly (without via the Internet) a plurality of other home appliances such as the air conditioner 300, the television 400, and the washing machine 600 and the plurality of smartphones 500A, 500B, and 500C. You can also send and receive data.

  The speaker 207 outputs sound to the outside based on a signal from the CPU 210. The microphone 208 converts external sound into a signal and inputs the signal to the CPU 210.

  The clock 209 outputs the current time to the CPU 210 or outputs the elapsed time from a predetermined timing.

The cleaning control circuit 220 controls each part (such as a motor) of the cleaner 200 based on a signal from the CPU 210.
<Hardware configuration of air conditioner 300>

  Next, an aspect of a specific configuration of the air conditioner 300 will be described. FIG. 10 is a block diagram illustrating a hardware configuration of the air conditioner 300 according to the present embodiment. Referring to FIG. 10, an air conditioner 300 includes, as main components, a CPU 310, a memory 301, a memory interface 302, a button 303, a display 304 (or touch panel 305), a communication interface 306, and a speaker 307. A microphone 308, a clock 309, and an air conditioner control circuit 320.

  Note that the CPU 310, the memory 301, the memory interface 302, the button 303, the display 304, the communication interface 306, the speaker 307, the microphone 308, and the clock 309 are the same as those of the cleaner 200. The description will not be repeated here.

The air conditioner control circuit 320 controls each part (such as a compressor) of the air conditioner 300 based on a signal from the CPU 310.
<Hardware configuration of TV 400>

  Next, an example of a specific configuration of the television 400 will be described. FIG. 11 is a block diagram illustrating a hardware configuration of the television 400 according to the present embodiment. Referring to FIG. 11, a television 400 includes, as main components, a CPU 410, a memory 401, a memory interface 402, a button 403, a display 404 (or touch panel 405), a communication interface 406, and a speaker 407. A microphone 408, a clock 409, and a television control circuit 420.

  Note that the CPU 410, the memory 401, the memory interface 402, the button 403, the display 404, the communication interface 406, the speaker 407, the microphone 408, and the clock 409 are the same as those of the cleaner 200. The description will not be repeated here.

The television control circuit 420 controls each unit (such as an RGB control circuit) of the television 400 based on a signal from the CPU 410.
<Hardware configuration of smartphones 500A, 500B, 500C>

  Next, an aspect of a specific configuration of the smartphones 500A, 500B, and 500C will be described. FIG. 12 is a block diagram illustrating a hardware configuration of the smartphones 500A, 500B, and 500C according to the present embodiment. Referring to FIG. 12, smartphones 500A, 500B, and 500C communicate with CPU 510, memory 501, memory interface 502, touch panel 505 (may be button 503 and display 504) as main components. An interface 506, a speaker 507, a microphone 508, a clock 509, and a smartphone control circuit 520 are included.

  Note that the CPU 510, the memory 501, the memory interface 502, the touch panel 505 (the buttons 503 and the display 504), the communication interface 506, the speaker 507, the microphone 508, and the clock 509 are illustrated in the figure. The main configuration for realizing the operations shown in FIGS. 1 to 6 and the functions and steps described later are the same as those of the vacuum cleaner 200, and therefore description thereof will not be repeated here.

The smartphone control circuit 520 controls each part (such as a telephone circuit) of the smartphones 500A, 500B, and 500C based on a signal from the CPU 510.
<Hardware configuration of washing machine 600>

  Next, an aspect of a specific configuration of the washing machine 600 will be described. FIG. 13 is a block diagram illustrating a hardware configuration of the washing machine 600 according to the present embodiment. Referring to FIG. 13, washing machine 600 includes, as main components, CPU 610, memory 601, memory interface 602, button 603, display 604 (or touch panel 605), communication interface 606, and speaker. 607, a microphone 608, a clock 609, and a washing control circuit 620.

  Note that the CPU 610, the memory 601, the memory interface 602, the button 603, the display 604, the communication interface 606, the speaker 607, the microphone 608, and the clock 609 are similar to those of the cleaner 200. The description will not be repeated here.

The washing control circuit 620 controls each part (such as a motor) of the washing machine 600 based on a signal from the CPU 610.
<Processing procedure of network system 1>

  Next, a processing procedure in the network system 1 according to the present embodiment will be described. FIG. 14 is a sequence diagram showing a processing procedure in the network system 1 according to the present embodiment. FIG. 15 is an image diagram showing display screens of the smartphones 500A, 500B, and 500C according to the present embodiment.

  Referring to FIG. 14, CPU 210 of cleaner 200 determines whether or not a voice from the user is input via microphone 208 (step S <b> 102). CPU210 determines whether the command from a user can be recognized, when the audio | voice from a user is input (in the case of YES in step S102) (step S104).

  When CPU 210 cannot recognize the command from the user (NO in step S104), CPU 100 transmits data (for example, PCM (pulse code modulation) data) indicating the input voice via communication interface 206 to server 100. Transmit (step S106). CPU 110 of server 100 receives voice data from cleaner 200 via communication interface 106 (step S107). The CPU 110 of the server 100 determines whether or not the command from the user can be recognized based on the received voice data (step S108). CPU110 performs the process from step S112, when the command from a user is recognized (in the case of YES in step S108).

  On the other hand, when CPU 210 of vacuum cleaner 200 can recognize a command from the user (YES in step S104), it transmits the command to server 100 (step S110). CPU 110 of server 100 receives a command from cleaner 200 through communication interface 106 (step S111).

  Based on the input command, the CPU 110 of the server 100 stores the command transmission source (here, the cleaner 200) and the command as a timeline record in the memory 101 (step S112). The CPU 110 transmits a message as a timeline record to the smartphones 500A, 500B, and 500C via the communication interface 106 (step S114).

  CPU 510 of smartphones 500A, 500B, and 500C receives the message via communication interface 506 (step S116). As illustrated in FIG. 15, the CPU 510 causes the touch panel 505 to display the message as a timeline record.

  CPU110 of the server 100 specifies the household appliance linked | related with the vacuum cleaner 200 with reference to the household appliance information 101B. For example, the CPU 110 specifies a home appliance being paired with the cleaner 200, a home appliance in the same room as the cleaner 200, or a home appliance with the same address as the cleaner 200. Here, it is assumed that CPU 110 has selected air conditioner 300.

  CPU 110 starts connection with air conditioner 300 via communication interface 106 (step S118). The CPU 310 of the air conditioner 300 starts connection with the server 100 via the communication interface 306 (step S120). At this time, CPU110 may confirm pairing with the vacuum cleaner 200 and the air conditioner 300, or may make both pair.

  CPU110 acquires various data (weather forecast etc.) from memory 101 or other servers (Step S122). CPU 110 refers to a variety of data and, based on control command database 101A, a series of control data for a plurality of home appliances that should operate in response to a command received by cleaner 200 (a command for the first home appliance). (Instruction for the second home appliance) is created (step S124).

  CPU110 transmits the control data with respect to the cleaner 200 to the cleaner 200 via the communication interface 106 based on the created series of control data (step S126). The CPU 210 of the cleaner 200 receives control data from the server 100 via the communication interface 206 (step S128). CPU 210 controls each part of cleaner 200 based on the received control data (step S130). When the control related to the control data is completed, the CPU 210 transmits a completion notification to the server 100 via the communication interface 206 (step S132). The CPU 110 of the server 100 receives the completion notification via the communication interface 106 (step S134).

  Based on the completion notification, the CPU 110 stores, in the memory 101, the home appliance that has completed the control (here, the vacuum cleaner 200) and the content of the control as a timeline record (step S136). The CPU 110 transmits a message as a timeline record to the smartphones 500A, 500B, and 500C via the communication interface 106 (step S138).

  CPU 510 of smartphones 500A, 500B, 500C receives the message via communication interface 506 (step S140). As illustrated in FIG. 15, the CPU 510 causes the touch panel 505 to display the message as a timeline record.

  Based on the created series of control data, CPU 110 transmits control data for air conditioner 300 (instruction for the second home appliance) to air conditioner 300 via communication interface 106 (step S142). The CPU 310 of the air conditioner 300 receives control data from the server 100 via the communication interface 306 (step S144). CPU 310 controls each part of air conditioner 300 based on the received control data (step S146). When the control relating to the control data is completed, the CPU 310 transmits a completion notification to the server 100 via the communication interface 306 (step S148). The CPU 110 of the server 100 receives the completion notification via the communication interface 106 (step S150).

  Based on the completion notification, the CPU 110 stores the control-completed home appliance (here, the air conditioner 300) and the control content in the memory 101 as a timeline record (step S152). CPU 110 transmits a message as a timeline record to smartphones 500A, 500B, and 500C via communication interface 106 (step S154).

  CPU 510 of smartphones 500A, 500B, 500C receives the message via communication interface 506 (step S156). As illustrated in FIG. 15, the CPU 510 causes the touch panel 505 to display the message as a timeline record.

The server 100, the vacuum cleaner 200, the air conditioner 300, and the smartphones 500A, 500B, and 500C perform all the controls for the vacuum cleaner 200 corresponding to the commands input to the vacuum cleaner 200 based on the series of control data created. The processes in steps S126 to S140 are repeated until completion, and the processes in steps S142 to S156 are repeated until all the controls for air conditioner 300 are completed.
<Cooperation between home appliances>

  Next, an example of a cooperative operation of a plurality of home appliances in the network system 1 according to the present embodiment will be described in more detail. Specifically, the repeated step group (cooperation step) after step S126 in FIG. 14 when the cleaner 200 receives an instruction “clean it” from the user in step S102 in FIG. 14 will be described in detail. FIG. 16 is a sequence diagram illustrating an example of a processing procedure of a home appliance cooperation operation in the network system 1 according to the present embodiment.

  Referring to FIG. 16, CPU 110 determines whether or not the time included in the control data for cleaner 200 has been reached (step S1261). Specifically, CPU 110 refers to clock 109 to determine whether the elapsed time from the start of execution of the series of control data created in step S124 has reached the time specified in the control data. (Step S1261). When the elapsed time reaches the time specified in the control data (YES in step S1261), CPU 110 transmits control data for cleaner 200 via communication interface 106 (step S1262).

  CPU 210 receives control data from server 100 via communication interface 206 (step S1263). CPU 210 causes speaker 207 to generate a sound “Okay! How about opening a window?” (Step S1264). CPU 210 waits for a voice from the user via microphone 208 (step S1265).

  When the voice (for example, “OK !!!!” or “I don't like it”) from the user is input (YES in step S1265), CPU 210 receives voice data representing the voice via communication interface 206. It transmits to the server 100 (step S1266). CPU 110 of server 100 receives voice data from cleaner 200 via communication interface 106 (step S1267). More specifically, the server 100 and the smartphones 500A, 500B, and 500C execute the processing of steps S136 to S140 in FIG. 14 (see also FIG. 15). Do not repeat.

  CPU110 transmits the next control data with respect to the cleaner 200 via the communication interface 106, when the audio | voice from a user is affirmative (in the case of YES in step S1268) (step S1269). The CPU 210 of the cleaner 200 receives control data from the server 100 via the communication interface 206 (step S1270). CPU210 starts cleaning by controlling each part of the cleaner 200 via the cleaning control circuit 220 (step S1271).

  On the other hand, if the voice from the user is negative (NO in step S1268), CPU 110 of server 100 proceeds to the next control (here, control (1) in FIG. 8). . That is, the CPU 110 determines whether or not the elapsed time has passed 5 seconds (step S1272). CPU110 transmits the data of control (1) to the vacuum cleaner 200 via the communication interface 106, when elapsed time has passed 5 seconds (in the case of YES in step S1272) (step S1273).

  The CPU 210 of the cleaner 200 receives the control (1) data from the server 100 via the communication interface 206 (step S1274). The CPU 210 causes the speaker 207 to generate a voice saying “Air conditioner, I'm going to clean out the ions.” (Step S1275). That is, in this embodiment, information for specifying the air conditioner 300 (second home appliance) is included in the instruction issued by the cleaner 200 (first home appliance).

  When the generation of the sound is completed, the CPU 210 transmits a control (1) completion notification to the server 100 via the communication interface 206 (step S1276). CPU 110 of server 100 receives notification of completion of control (1) from cleaner 200 via communication interface 106 (step S1277). More specifically, the server 100 and the smartphones 500A, 500B, and 500C execute the processes in steps S136 to S140 in FIG. 14 (see also FIG. 15), but the description is repeated here because it becomes complicated. Absent.

  The CPU 110 of the server 100 shifts to the next control (here, control (2) in FIG. 8). That is, CPU 110 determines whether or not the elapsed time has passed 10 seconds (step S1278). If the elapsed time has passed 10 seconds (YES in step S1278), CPU 110 transmits control (2) data to air conditioner 300 via communication interface 106 (step S1279).

  The CPU 310 of the air conditioner 300 receives control (2) data from the server 100 via the communication interface 306 (step S1280). The CPU 310 causes the speaker 307 to generate a sound “You know, cleaner. I'm going to emit ions” (step S1281). When the generation of the sound is completed, the CPU 310 transmits a control (2) completion notification to the server 100 via the communication interface 306 (step S1282). CPU 110 of server 100 receives notification of completion of control (2) from air conditioner 300 via communication interface 106 (step S1283). More specifically, the server 100 and the smartphones 500A, 500B, and 500C execute the processes in steps S152 to S158 in FIG. 14 (see also FIG. 15), but the description is repeated here because it becomes complicated. Absent.

  In FIG. 16, the process regarding one control with respect to the cleaner 200 and the process regarding one control with respect to the air conditioner 300 are described. However, the server 100, the cleaner 200, the air conditioner 300, and the smartphones 500 </ b> A, 500 </ b> B, and 500 </ b> C complete all (other) controls on the cleaner 200 corresponding to the command input to the cleaner 200. The processing from step S1272 to step S1277 is repeated, and the processing from step S1278 to step S1282 is repeated until all (other plural) controls for the air conditioner 300 are completed.

As described above, in the network system 1 according to the present embodiment, a plurality of home appliances talk to other home appliances, and the home appliances do not merely transmit information to the user. In addition, while the home appliances are talking to each other, the user feels as if they are not talking to him / her, so that the user can more easily feel humanity regarding the home appliance.
<Second Embodiment>

  In the first embodiment, the user inputs a command to the cleaner 200. However, the user can also input a command to the smartphones 500A, 500B, and 500C. For example, the user inputs a voice “cleaned” toward the microphone 508 of the smartphone 500A. This will be specifically described below.

  Referring to FIG. 17, CPU 510 of smartphone 500 </ b> A determines whether or not a voice from the user is input via microphone 508 (step S <b> 101). CPU510 judges whether the command from a user can be recognized, when the voice from a user is inputted (in the case of YES at Step S101) (Step S103).

  If CPU 510 cannot recognize the command from the user (NO in step S103), data indicating the input voice (for example, PCM (pulse code modulation) data) is transmitted to server 100 via communication interface 506. Transmit (step S105). The CPU 110 of the server 100 receives audio data from the smartphone 500A via the communication interface 106 (step S107). The CPU 110 of the server 100 determines whether or not the command from the user can be recognized based on the received voice data (step S108). CPU110 performs the process from step S112, when the command from a user is recognized (in the case of YES in step S108).

  On the other hand, when CPU 510A of smartphone 500A can recognize the command from the user (YES in step S103), it transmits the command to server 100 (step S109). CPU 110 of server 100 receives a command from smartphone 500A via communication interface 106 (step S111).

  Based on the input command, the CPU 110 of the server 100 stores the command transmission source (smart phone 500A in this case) and the command in the memory 101 as a timeline record (step S112). The CPU 110 transmits a message as a timeline record to the smartphones 500A, 500B, and 500C via the communication interface 106 (step S114).

Since an example of the subsequent processing and the cooperative operation of a plurality of home appliances is the same as those in the first embodiment, description thereof will not be repeated here. For example, the vacuum cleaner 200 generates a sound “I understand” in step S130. Alternatively, the smartphone 500A displays a message of the cleaner 200 “I understand” or makes a sound as a timeline in step S140.
<Third Embodiment>

In the first embodiment, the CPU 110 proceeds to the next control when the completion notification from the cleaner 200 is received and the elapsed time reaches the execution time associated with the control data. However, the CPU 110 may proceed to the next control when receiving a completion notification from the cleaner 200. That is, the execution time for each control may not be specified in advance. Specifically, in FIG. 16, CPU 110 does not have to execute the processes of steps S1272 and S1278.
<Fourth Embodiment>

Conversely, the CPU 110 may proceed to the next control based on the elapsed time. That is, the CPU 110 may be configured to proceed to the next control when the elapsed time reaches the execution time regardless of whether or not the completion notification is received. For example, in FIG. 16, the CPU 110 and the CPU 210 may not execute the processes of step S1276, step S1277, step S1282, and step S1283.
<Fifth Embodiment>

Further, the following cooperation method may be adopted. That is, the CPU 310 of the air conditioner 300 acquires the sound of the cleaner 200 from the microphone 308. The CPU 310 recognizes the content of the sound and the completion of the sound output by analyzing the sound. The CPU 110 may start outputting sound from the speaker 307 when the recognition is successful. In any case, after the cleaner 200 (first home appliance) finishes outputting the sound, the air conditioner 300 (second home appliance) may start outputting the sound.
<Sixth Embodiment>

  Next, a sixth embodiment will be described. In the network system 1 according to the first to fifth embodiments described above, the server 100 transmits control data to a corresponding home appliance for each control. However, in this embodiment, the server 100 transmits a series of control data to a predetermined home appliance, and the predetermined home appliance transmits control data to the corresponding home appliance for each control. Compared with the fifth embodiment, the role of the server 100 is reduced. In addition, both are the same regarding the movement of the household appliance which a user sees, and the audio | voice from the household appliance which a user hears.

  First, the overall configuration of the network system 1 according to the present embodiment is the same as that of the first embodiment shown in FIGS. 1 to 6, and therefore description thereof will not be repeated here.

  Moreover, since the operation | movement outline | summary of the network system 1 which concerns on this embodiment is the same as that of 1st Embodiment shown in FIGS. 1-6, description is not repeated here. In other words, the network system 1 according to the present embodiment is also one in which a plurality of home appliances have a conversation with each other, and the home appliance does not only transmit information to the user.

In addition, the hardware configuration of the server 100, the vacuum cleaner 200, the air conditioner 300, the television 400, the washing machine 600, and the smartphones 500A, 500B, and 500C is the same as that of the first embodiment, and thus description thereof will not be repeated here. .
<Processing procedure of network system 1>

  Below, the process sequence in the network system 1 which concerns on this embodiment is demonstrated. FIG. 18 is a sequence diagram showing a processing procedure in the network system 1 according to the present embodiment. As shown in FIGS. 14 and 18, the processing from step S202 to S216 in the present embodiment is the same as the processing from step S102 to step S116 in the first embodiment, and therefore description thereof will be repeated here. I will not return.

  Referring to FIG. 18, CPU 110 starts connection with air conditioner 300 via communication interface 106, confirms pairing between cleaner 200 and air conditioner 300, and causes both to pair ( Step S218). That is, the vacuum cleaner 200 confirms pairing with the air conditioner 300 or starts pairing (step S219). The air conditioner 300 confirms pairing with the cleaner 200 or starts pairing (step S220).

  CPU110 acquires various data (weather forecast etc.) from the memory 101 or another server (step S222). CPU 110 refers to a variety of data and, based on control command database 101A, a series of control data for a plurality of home appliances that should operate in response to a command received by cleaner 200 (a command for the first home appliance). (Instruction for the second home appliance) is created (step S224).

  The CPU 110 of the server 100 transmits the created series of control data (including a command for the cleaner 200 and a command for the air conditioner 300) to the cleaner 200 via the communication interface 106 (step S226). CPU 210 of cleaner 200 receives a series of control data from server 100 via communication interface 206 (step S228). CPU 210 controls each part of cleaner 200 based on the first control data in the received series of control data (step S230). When the control regarding the control data is completed, the CPU 210 transmits a completion notification to the server 100 via the communication interface 206 (step S232). The CPU 110 of the server 100 receives the completion notification via the communication interface 106 (step S234).

  Based on the completion notification, the CPU 110 stores the home appliance that has completed the control (here, the vacuum cleaner 200) and the content of the control in the memory 101 as a timeline record (step S236). CPU 110 transmits a message as a timeline record to smartphones 500A, 500B, and 500C via communication interface 106 (step S238).

  CPU 510 of smartphones 500A, 500B, 500C receives the message via communication interface 506 (step S240). As illustrated in FIG. 15, the CPU 510 causes the touch panel 505 to display the message as a timeline record.

  The CPU 210 of the cleaner 200 transmits control data for the air conditioner 300 to the air conditioner 300 via the communication interface 206 based on the series of control data (step S242). CPU 310 of air conditioner 300 receives control data from cleaner 200 via communication interface 306 (step S244). CPU 310 controls each part of air conditioner 300 based on the received control data (step S246). When the control relating to the control data is completed, CPU 310 transmits a completion notification to cleaner 200 and server 100 via communication interface 306 (step S248).

  The CPU 110 of the server 100 receives the completion notification via the communication interface 106 (step S250). The CPU 210 of the cleaner 200 receives a completion notification from the air conditioner 300 via the communication interface 206 (step S252). The air conditioner 300 may transmit the completion notification only to the cleaner 200 without sending it to the server 100. In this case, the CPU 210 of the cleaner 200 transmits a completion notification related to the control of the air conditioner 300 to the server 100 via the communication interface 206.

  Based on the completion notification, the CPU 110 of the server 100 stores the control-completed home appliance (here, the air conditioner 300) and the control content in the memory 101 as a timeline record (step S254). The CPU 110 transmits a message as a timeline record to the smartphones 500A, 500B, and 500C via the communication interface 106 (step S256).

  CPU 510 of smartphones 500A, 500B, 500C receives the message via communication interface 506 (step S258). As illustrated in FIG. 15, the CPU 510 causes the touch panel 505 to display the message as a timeline record.

The server 100, the cleaner 200, the air conditioner 300, and the smartphones 500A, 500B, and 500C perform the processes of Steps S230 to S240 until all the controls for the cleaner 200 corresponding to the command input to the cleaner 200 are completed. The processes in steps S242 to S258 are repeated until all the controls for the air conditioner 300 are repeated.
<Cooperation between home appliances>

  Next, an example of a cooperative operation of a plurality of home appliances in the network system 1 according to the present embodiment will be described in more detail. Specifically, the repeated step group (cooperation step) after step S226 in FIG. 18 when the cleaner 200 receives an instruction “clean it” from the user in step S202 in FIG. 18 will be described in detail. FIG. 19 is a sequence diagram illustrating an example of a processing procedure of a home appliance cooperation operation in the network system 1 according to the present embodiment.

  Referring to FIG. 19, CPU 210 determines whether or not the time included in the control data for cleaner 200 has been reached (step S2301). Specifically, the CPU 210 refers to the clock 209 and determines whether or not the elapsed time from the start of the series of control data received in step S228 has reached the time specified in the control data. When the elapsed time reaches the time specified in the control data (YES in step S2301), CPU 210 generates a sound “Okay, please open the window?” On speaker 207 (step S2301). S2302). CPU 210 waits for a voice from the user via microphone 208 (step S2303).

  When the voice from the user (for example, “OK !!” or “I don't like it”) is input (if YES in step S2303), CPU 210 determines whether or not the voice from the user is positive. Is determined (step S2304). If the voice from the user is positive (YES in step S2304), CPU 210 starts cleaning by controlling each part of cleaner 200 via cleaning control circuit 220 (step S2305). .

  On the other hand, when the voice from the user is negative (NO in step S2304), CPU 210 performs the next control (in this case, control (1) at the start of cleaning of the cleaner in FIG. 8). ). That is, the CPU 210 determines whether or not the elapsed time has passed 5 seconds (step S2306). When the elapsed time has passed 5 seconds (YES in step S2306), CPU 210 generates a sound “sound from the air conditioner, clean up ions” on speaker 207 (step S2307). .

  Here, in detail, when the generation of the sound is completed, the CPU 210 transmits a control (1) completion notification to the server 100 via the communication interface 206. Then, the server 100 and the smartphones 500A, 500B, and 500C execute the processes in steps S234 to S240 in FIG. 18 (see also FIG. 15).

  The CPU 210 shifts to the next control (in this case, the control (2) at the start of cleaning of the cleaner of FIG. 8). That is, CPU 210 determines whether or not the elapsed time has passed 10 seconds (step S2308). When the elapsed time has passed 10 seconds (YES in step S2308), CPU 210 transmits the control (2) data to air conditioner 300 via communication interface 206 (step S2309).

  CPU 310 of air conditioner 300 receives control (2) data from cleaner 200 via communication interface 306 (step S2310). The CPU 310 causes the speaker 307 to generate a sound “You know, Mr. Vacuum cleaner. I'm going to emit ions” (step S2311).

  Specifically, when the generation of the sound is completed, CPU 310 of air conditioner 300 transmits a completion notification of control (1) to server 100 via communication interface 306. Alternatively, when the CPU 210 of the vacuum cleaner 200 receives the completion notification of the control (2) from the air conditioner 300, the completion notification of the control (2) is transmitted to the server 100. And the server 100 and smart phone 500A, 500B, 500C perform the process (refer also FIG. 15) of step S252-step S258 of FIG.

  When the generation of the sound is completed, CPU 310 transmits a notification of completion of control (2) to vacuum cleaner 200 via communication interface 306 (step S2312). The CPU 210 of the vacuum cleaner 200 receives a completion notification from the server 100 via the communication interface 206 and shifts to the next control (in this case, the control (3) at the start of cleaning of the vacuum cleaner in FIG. 8). To do.

  The server 100, the vacuum cleaner 200, the air conditioner 300, and the smartphones 500A, 500B, and 500C perform the processes from step S2306 to step S2307 until all the controls for the vacuum cleaner 200 corresponding to the command input to the vacuum cleaner 200 are completed. The processes in steps S2308 to S2313 are repeated until all the controls for the air conditioner 300 are repeated.

As described above, in the network system 1 according to the present embodiment, a plurality of home appliances talk to other home appliances, and the home appliances do not merely transmit information to the user. In addition, while the home appliances are talking to each other, the user feels as if they are not talking to him / her, so that the user can more easily feel humanity regarding the home appliance.
<Seventh Embodiment>

  In the sixth embodiment, the user inputs a command to the cleaner 200. However, the user can also input a command to the smartphones 500A, 500B, and 500C. For example, the user inputs a voice “cleaned” toward the microphone 508 of the smartphone 500A. This will be specifically described below.

  Referring to FIG. 20, CPU 510 of smartphone 500 </ b> A determines whether or not voice from the user is input via microphone 508 (step S <b> 201). CPU510 determines whether the command from a user can be recognized, when the audio | voice from a user is input (in the case of YES in step S201) (step S203).

  If CPU 510 cannot recognize the command from the user (NO in step S203), CPU 100 transmits data indicating the input voice (for example, PCM (pulse code modulation) data) to server 100 via communication interface 506. Transmit (step S205). The CPU 110 of the server 100 receives audio data from the smartphone 500A via the communication interface 106 (step S207). The CPU 110 of the server 100 determines whether or not a command from the user can be recognized based on the received audio data (step S208). CPU110 performs the process from step S212, when the command from a user can be recognized (in the case of YES in step S208).

  On the other hand, when the CPU 510 of the smartphone 500A can recognize the command from the user (YES in step S203), the CPU 510A transmits the command to the server 100 (step S209). CPU 110 of server 100 receives a command from smartphone 500A via communication interface 106 (step S211).

  Based on the input command, the CPU 110 of the server 100 stores the command transmission source (the smartphone 500A in this case) and the command in the memory 101 as a timeline record (step S212). CPU 110 transmits a message as a timeline record to smartphones 500A, 500B, and 500C via communication interface 106 (step S214).

Since an example of the subsequent processing and the cooperative operation of a plurality of home appliances is the same as those of the sixth embodiment, description thereof will not be repeated here. For example, the vacuum cleaner 200 generates a sound “I understand” in step S230. Alternatively, the smartphone 500A displays a message of the cleaner 200 “I understand” or emits a voice as a timeline in step S240.
<Eighth Embodiment>

In the sixth embodiment, the CPU 110 proceeds to the next control when it receives a completion notification from the cleaner 200 and when the elapsed time reaches the execution time associated with the control data. However, the CPU 110 may proceed to the next control when receiving a completion notification from the cleaner 200. That is, the execution time for each control may not be specified in advance. Specifically, in FIG. 19, the CPU 110 does not have to execute the processes of steps S2306 and S2308.
<Ninth Embodiment>

Conversely, the CPU 110 may proceed to the next control based on the elapsed time. That is, the CPU 110 may be configured to proceed to the next control when the elapsed time reaches the execution time regardless of whether or not the completion notification is received. For example, in FIG. 19, the CPU 110 and the CPU 210 do not have to execute the processes of steps S2312, S2313.
<Tenth Embodiment>

Further, the following cooperation method may be adopted. That is, the CPU 310 of the air conditioner 300 acquires the sound of the cleaner 200 from the microphone 308. The CPU 310 recognizes the content of the sound and the completion of the sound output by analyzing the sound. The CPU 110 may start outputting sound from the speaker 307 when the recognition is successful. In any case, after the cleaner 200 (first home appliance) finishes outputting the sound, the air conditioner 300 (second home appliance) may start outputting the sound.
<Eleventh embodiment>

Next, an eleventh embodiment will be described. In said 6th-10th embodiment, the cleaner 200 received control data from the server 100, and the cleaner 200 controlled another household appliance after that using pairing. However, home appliances other than the cleaner 200 may receive control data from the server 100, and then the home appliance may control other home appliances using pairing.
<Twelfth Embodiment>

  Next, a twelfth embodiment will be described. In said 6th-10th embodiment, the form which not only the vacuum cleaner 200 but several household appliances receive control data from the server 100 may be sufficient. Thereafter, the plurality of home appliances may communicate with each other while communicating the situation using pairing. For example, the server 100 collects instructions for the cleaner 200 and transmits them to the cleaner 200, sends instructions for the air conditioner 300 to the air conditioner 300, and the cleaner 200 and the air conditioner 300 are based on each other's completion notification. Control may be advanced.

As the control proceeds among the plurality of home appliances, even if communication failure with the server 100 occurs, the operation control for each device is executed. That is, control of individual devices (completion of cleaning) is executed even if an unexpected server down or communication failure with the server occurs.
<13th Embodiment>

  Next, a thirteenth embodiment will be described. In the network system 1 according to the first to twelfth embodiments described above, the server 100 transmits control data to home appliances. However, in this embodiment, at least one home appliance stores the control data and the control command database in advance, and the role of the server 100 is further reduced compared to the first to twelfth embodiments. It is a thing. In addition, both are the same regarding the movement of the household appliance which a user sees, and the audio | voice from the household appliance which a user hears.

  Since the entire configuration of the network system 1 according to the present embodiment is the same as that of the first embodiment shown in FIGS. 1 to 6, the description thereof will not be repeated here. In the following description, information relating to weather forecasts and a mode in which the server 100 is used for communication with the smartphones 500A, 500B, and 500C will be described. However, the main part of the present embodiment, that is, the processing after step S322 in FIG. Further, the processing described in FIG. 19 to be used later can be applied to a form that does not include the server 100 at all.

  Moreover, since the operation | movement outline | summary of the network system 1 which concerns on this embodiment is the same as that of 1st Embodiment shown in FIGS. 1-6, description is not repeated here. In other words, the network system 1 according to the present embodiment is also one in which a plurality of home appliances have a conversation with each other, and the home appliance does not only transmit information to the user. In addition, while the home appliances are talking to each other, the user feels as if he / she is not speaking to him / her, so the user can easily feel humanity regarding the home appliance. Hereinafter, a specific configuration of each part of the network system 1 for realizing such a function will be described.

  First, the hardware configuration of the server 100 is the same as that of the first embodiment except for the data stored in the memory 101, and therefore description thereof will not be repeated here. That is, the network system 1 in the present embodiment is different from the first embodiment in that a part of data stored in the server 100 in the first embodiment is stored by a household appliance such as the vacuum cleaner 200. is there.

  Next, an aspect of a specific configuration of the cleaner 200 will be described. FIG. 21 is a block diagram illustrating a hardware configuration of the vacuum cleaner 200 according to the present embodiment. Referring to FIG. 21, the hardware configuration of the vacuum cleaner 200 is the same as that of the first embodiment except for the data stored in the memory 201. Absent.

  The memory 201 according to the present embodiment stores a control command database 201 </ b> A indicating a correspondence relationship between commands input to a home appliance and commands output to the home appliance and other home appliances as illustrated in FIG. 8. In addition, the memory 201 stores information about home appliances belonging to the home or office (referred to as home appliance information 201B). More specifically, home appliance information 201B includes the name, IP address, function, availability of pairing between home appliances, and the pairing state between home appliances belonging to the home or office.

The hardware configurations of the air conditioner 300, the television 400, the washing machine 600, and the smartphones 500A, 500B, and 500C are the same as those of the first embodiment, and thus description thereof will not be repeated here.
<Processing procedure of network system 1>

  Next, a processing procedure in the network system 1 according to the present embodiment will be described. FIG. 22 is a sequence diagram illustrating a processing procedure in the network system 1 according to the present embodiment.

  Referring to FIG. 22, CPU 210 of cleaner 200 determines whether or not a voice from the user is input via microphone 208 (step S <b> 302). CPU210 determines whether the command from a user can be recognized, when the audio | voice from a user is input (in the case of YES in step S302) (step S304).

  If CPU 210 can recognize the command from the user (YES in step S304), CPU 210 transmits the command to server 100 (step S306). CPU 110 of server 100 receives a command from cleaner 200 via communication interface 106 (step S307).

  Based on the input command, the CPU 110 of the server 100 stores the command transmission source (here, the cleaner 200) and the command as a timeline record in the memory 101 (step S308). CPU 110 transmits a message as a timeline record to smartphones 500A, 500B, and 500C via communication interface 106 (step S310).

  CPU 510 of smartphones 500A, 500B, 500C receives the message via communication interface 506 (step S312). As illustrated in FIG. 15, the CPU 510 causes the touch panel 505 to display the message as a timeline record.

  CPU210 of the vacuum cleaner 200 specifies the household appliance linked | related with the cleaner 200 with reference to the household appliance information 201B. For example, the CPU 210 identifies a home appliance being paired with the cleaner 200, a home appliance in the same room as the cleaner 200, or a home appliance registered in the home appliance information 201B. Here, it is assumed that the CPU 210 has selected the air conditioner 300.

  CPU 210 starts pairing connection with air conditioner 300 via communication interface 206 (step S314). The CPU 310 of the air conditioner 300 starts pairing connection with the cleaner 200 via the communication interface 306 (steps S314 and S316).

  The CPU 210 requests various data (such as weather forecast) from the server 100 via the Internet by using the communication interface 206 (step S318). CPU 110 of server 100 transmits various data to cleaner 200 via communication interface 106 (step S320).

  The CPU 210 creates a series of control data of a plurality of home appliances to be operated in response to the command received by the cleaner 200 based on the control command database 201A while referring to various data (step S322).

  CPU210 controls each part of the cleaner 200 based on one control data in the created series of control data (step S324). When the control related to the control data is completed, the CPU 210 transmits a completion notification to the server 100 via the communication interface 206 (step S326). The CPU 110 of the server 100 receives the completion notification via the communication interface 106 (step S328).

  Based on the completion notification, the CPU 110 stores, in the memory 101, the home appliance (here, the cleaner 200) that has completed the control and the content of the control as a timeline record (step S330). The CPU 110 transmits a message as a timeline record to the smartphones 500A, 500B, and 500C via the communication interface 106 (step S332).

  The CPU 510 of the smartphone 500A, 500B, 500C receives the message via the communication interface 506 (step S334). As illustrated in FIG. 15, the CPU 510 causes the touch panel 505 to display the message as a timeline record.

  The CPU 210 of the cleaner 200 transmits a command for the air conditioner 300 to the air conditioner 300 via the communication interface 206 based on the control data (step S336). The CPU 310 of the air conditioner 300 receives control data from the cleaner 200 via the communication interface 306 (step S338). CPU 310 controls each part of air conditioner 300 based on the received control data (step S340). When the control related to the control data is completed, CPU 310 transmits a completion notification to vacuum cleaner 200 and server 100 via communication interface 306 (step S342).

  The CPU 110 of the server 100 receives the completion notification via the communication interface 106 (step S344). The CPU 210 of the cleaner 200 receives a completion notification from the air conditioner 300 via the communication interface 206 (step S346). The air conditioner 300 may transmit the completion notification only to the cleaner 200 without sending it to the server 100. In this case, the CPU 210 of the cleaner 200 transmits a completion notification related to the control of the air conditioner 300 to the server 100 via the communication interface 206.

  Based on the completion notification, the CPU 110 of the server 100 stores the control-completed home appliance (here, the air conditioner 300) and the control content in the memory 101 as a timeline record (step S348). CPU 110 transmits a message as a timeline record to smartphones 500A, 500B, and 500C via communication interface 106 (step S350).

  CPU 510 of smartphones 500A, 500B, 500C receives the message via communication interface 506 (step S352). As illustrated in FIG. 15, the CPU 510 causes the touch panel 505 to display the message as a timeline record.

  The server 100, the vacuum cleaner 200, the air conditioner 300, and the smartphones 500A, 500B, and 500C repeat the processes in steps S324 to 334 until all the controls for the vacuum cleaner 200 corresponding to the command input to the vacuum cleaner 200 are completed. Until the control of the air conditioner 300 is completed, the processes in steps S336 to S352 are repeated.

  In addition, about an example (refer FIG. 19) of the cooperation operation | movement of the some household appliance in the network system 1 which concerns on this embodiment, since it is the same as that of 6th Embodiment, description is not repeated here.

As described above, in the network system 1 according to the present embodiment, a plurality of home appliances talk to other home appliances, and the home appliances do not merely transmit information to the user. In addition, while the home appliances are talking to each other, the user feels as if they are not talking to him / her, so that the user can more easily feel humanity regarding the home appliance.
<Fourteenth embodiment>

  In the thirteenth embodiment, the user inputs a command to the cleaner 200. However, the user can also input a command to the smartphones 500A, 500B, and 500C. For example, the user inputs a voice “cleaned” toward the microphone 508 of the smartphone 500A. This will be specifically described below.

  Referring to FIG. 23, CPU 510 of smartphone 500A determines whether or not a voice from the user is input via microphone 508 (step S301). When the voice from the user is input (YES in step S301), CPU 510 determines whether or not the command from the user can be recognized (step S303).

  If CPU 510 cannot recognize the command from the user (NO in step S303), CPU 510 repeats the processing from step S301. However, when CPU 510 cannot recognize a command from the user (NO in step S303), CPU 510 transmits data indicating voice input (for example, PCM (pulse code modulation) data) via communication interface 506. 100 may be transmitted. In this case, the server 100 performs voice analysis as in the second and seventh embodiments.

  On the other hand, when CPU 510A of smartphone 500A can recognize a command from the user (YES in step S303), CPU 510A transmits the command to server 100 (step S305). CPU 110 of server 100 receives a command from smartphone 500A via communication interface 106 (step S307).

  Based on the input command, the CPU 110 of the server 100 stores the command transmission source (the smartphone 500A in this case) and the command in the memory 101 as a timeline record (step S308). CPU 110 transmits a message as a timeline record to smartphones 500A, 500B, and 500C via communication interface 106 (step S310).

Since an example of the subsequent processing and the cooperative operation of a plurality of home appliances is the same as those in the thirteenth embodiment, description thereof will not be repeated here. For example, the vacuum cleaner 200 generates a sound “I understand” in step S324. Alternatively, the smartphone 500A displays a message of the cleaner 200 “I understand” or emits a sound as a timeline in step S334.
<Fifteenth embodiment>

In the thirteenth embodiment, the CPU 110 proceeds to the next control when the completion notification from the cleaner 200 is received and the elapsed time reaches the execution time corresponding to the control data. However, the CPU 110 may proceed to the next control when receiving a completion notification from the cleaner 200. That is, the execution time for each control may not be specified in advance. In FIG. 19, the CPU 110 does not have to execute the processes of steps S2306 and S2308.
<Sixteenth Embodiment>

Conversely, the CPU 110 may proceed to the next control based on the elapsed time. That is, the CPU 110 may be configured to proceed to the next control when the elapsed time reaches the execution time regardless of whether or not the completion notification is received. For example, in FIG. 19, the CPU 110 and the CPU 210 do not have to execute the processes of steps S2312, S2313.
<Seventeenth embodiment>

Further, the following cooperation method may be adopted. That is, the CPU 310 of the air conditioner 300 acquires the sound of the cleaner 200 from the microphone 308. The CPU 310 recognizes the content of the sound and the completion of the sound output by analyzing the sound. The CPU 110 may start outputting sound from the speaker 307 when the recognition is successful. In any case, after the cleaner 200 (first home appliance) finishes outputting the sound, the air conditioner 300 (second home appliance) may start outputting the sound.
<Eighteenth embodiment>

In the thirteenth embodiment, the cleaner 200 stores the control data and the control command database 201A in advance, and the cleaner 200 controls other home appliances using pairing. However, home appliances other than the cleaner 200 may store the control data and the control command database 201A in advance. And the said household appliance may control another household appliance using pairing.
<Nineteenth embodiment>

In the thirteenth embodiment, the cleaner 200 stores the control data and the control command database 201A in advance, and the cleaner 200 controls other home appliances using pairing. However, not only the vacuum cleaner 200 but also a plurality of home appliances may store the control data and the control command database 201A in advance. And you may have a conversation between the said some household appliances, using a pairing, conveying a situation mutually. For example, the vacuum cleaner 200 and the air conditioner 300 may advance the control based on the control data and the control command database 201A stored in response to the mutual completion notification.
<Other application examples>

  It goes without saying that the present invention can also be applied to a case where it is achieved by supplying a program to a system or apparatus. Then, a storage medium storing a program represented by software for achieving the present invention is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the program code stored in the storage medium It is possible to enjoy the effects of the present invention also by reading and executing.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Furthermore, after the program code read from the storage medium is written to another storage medium provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the CPU of the function expansion board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  It should be thought that embodiment disclosed this time is an illustration and restrictive at no points. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 Network System 100 Server 101 Memory 106 Communication Interface 110 CPU
200 Vacuum Cleaner 201 Memory 206 Communication Interface 207 Speaker 208 Microphone 210 CPU
300 Air Conditioner 301 Memory 306 Communication Interface 307 Speaker 308 Microphone 310 CPU
400 TV 500A, 500B, 500C Smartphone 600 Washing machine

Claims (9)

A network system comprising a first communication device, a second communication device, and a server,
The server stores a correspondence relationship between a plurality of communication devices and a group, and information indicating a cooperative operation of the plurality of communication devices,
The server refers to the correspondence relationship and the cooperation operation, and when the first communication device accepts an instruction, the server outputs an audio to the second communication device belonging to the same group as the first communication device. And send control data to execute the operation,
The network system, wherein the server outputs an operation response of the second communication device based on the control data by voice.   The network according to claim 1, wherein the server stores communication devices belonging to a plurality of homes as the correspondence relationship, and creates a series of data as control data for controlling a cooperative operation between communication devices belonging to the same home. system.   The network system according to claim 1, wherein the communication device is a home appliance having a communication function.   The network system according to claim 1, wherein the server acquires various data from another server, determines a cooperative operation based on the various data, and creates the corresponding voice.   The network system according to any one of claims 1 to 4, wherein the voice instruction includes information for identifying the second communication device and an acknowledgment. The first communication device performs an operation according to the command when receiving the command,
The network system according to any one of claims 1 to 5, wherein the second communication device performs an operation according to the instruction when the instruction is received. A communication interface for communicating with the first and second communication devices;
A memory for storing a first correspondence relationship between a plurality of communication devices and a group, and information indicating a cooperative operation of the plurality of communication devices;
A processor, the processor comprising:
When the first communication device accepts the command, the first and second group correspondences and cooperative operations are referred to, and the first communication device belongs to the first communication device via the communication interface. Transmitting control data for executing sound output and operation to the second communication device;
A server that causes an operation response of the second communication device based on the control data to be output by voice via the communication interface. Controlling a server including a communication interface, a processor, a first correspondence relationship between a plurality of communication devices and a group, and a memory for storing information indicating a cooperative operation of the plurality of communication devices A program, the program on the processor,
When the first communication device accepts the command, the first and second group correspondences and cooperative operations are referred to, and the first communication device belongs to the first communication device via the communication interface. Transmitting control data for executing sound output and operation to the second communication device;
A step of outputting an operation response of the second communication device based on the control data by voice via the communication interface. A first communication device receiving a command;
The first communication device controlling each part of the first communication device according to the command;
A step of transmitting control data for causing the first communication device to execute voice output and a cooperative operation for a second communication device belonging to the same group as the first communication device corresponding to the command; ,
The server includes causing the second communication device to output an operation response to the control data by voice.