CN111786860B - Household appliance, control method thereof and computer readable storage medium - Google Patents
Household appliance, control method thereof and computer readable storage mediumDownload PDFInfo
- Publication number
- CN111786860B CN111786860BCN202010608725.4ACN202010608725ACN111786860BCN 111786860 BCN111786860 BCN 111786860BCN 202010608725 ACN202010608725 ACN 202010608725ACN 111786860 BCN111786860 BCN 111786860B
- Authority
- CN
- China
- Prior art keywords
- voice signal
- appliance
- household appliance
- preset
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034methodMethods0.000titleclaimsabstractdescription39
- 230000001960triggered effectEffects0.000claimsdescription10
- 238000012790confirmationMethods0.000claimsdescription9
- 230000004044responseEffects0.000abstractdescription8
- 230000000875corresponding effectEffects0.000description40
- 230000001276controlling effectEffects0.000description10
- 230000006870functionEffects0.000description4
- 241000282326Felis catusSpecies0.000description3
- 238000004891communicationMethods0.000description3
- 239000000284extractSubstances0.000description3
- 230000008569processEffects0.000description3
- 206010011224CoughDiseases0.000description2
- 206010011469CryingDiseases0.000description2
- 241001465754MetazoaSpecies0.000description2
- 238000001816coolingMethods0.000description2
- 238000010586diagramMethods0.000description2
- 238000012549trainingMethods0.000description2
- 238000004378air conditioningMethods0.000description1
- 238000013473artificial intelligenceMethods0.000description1
- 230000002596correlated effectEffects0.000description1
- 238000011161developmentMethods0.000description1
- 238000005516engineering processMethods0.000description1
- 230000003993interactionEffects0.000description1
- 230000004807localizationEffects0.000description1
- 230000003287optical effectEffects0.000description1
- 230000009466transformationEffects0.000description1
- 238000000844transformationMethods0.000description1
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Selective Calling Equipment (AREA)
Abstract
Description
Technical Field
The present invention relates to the field of home appliances, and in particular, to a home appliance, a control method thereof, and a computer-readable storage medium.
Background
Household appliances such as air conditioners, electric fans and the like have become essential products for people as living appliances. With the rapid development of artificial intelligence technology, household appliances with voice recognition function are also in endless, and interaction and experience between the household appliances are greatly improved.
The user can send the voice command to the household appliance, and the household appliance recognizes the voice command through the voice recognition function so as to respond to the voice command. However, other electronic devices exist in the environment where the household appliance is located, and the sound emitted by the electronic devices may carry a control instruction, so that the household appliance responds to the operation not emitted by the user, and the household appliance has the problem of voice false response.
Disclosure of Invention
The invention mainly aims to provide a household appliance, a control method thereof and a computer readable storage medium, and aims to solve the problem of voice error response of the household appliance.
In order to achieve the above object, the present invention provides a method for controlling a home appliance, comprising:
receiving a voice signal and determining whether the voice signal triggers a preset sound event;
when the voice signal is determined to trigger the preset sound event, determining whether the voice signal is a voice signal sent by the electronic equipment;
and when the voice signal is determined not to be the voice signal sent by the electronic equipment, responding to the voice signal to execute a corresponding operation.
In one embodiment, the household appliance is provided with an infrared sensor, and the step of determining whether the voice signal is a voice signal sent by the electronic device comprises:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
and determining whether the infrared thermal image comprises a temperature area where the target object is located, wherein when the infrared thermal image comprises the temperature area where the target object is located, the voice signal is determined not to be the voice signal sent by the electronic equipment.
In one embodiment, the household appliance is provided with an infrared sensor, and the step of determining whether the voice signal is a voice signal sent by the electronic device comprises:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
determining the area of a temperature region where a target object is located in the infrared thermal image;
and determining whether the area is matched with a preset area, wherein when the area is matched with the preset area, it is determined that the voice signal is not a voice signal sent by the electronic equipment.
In one embodiment, the household appliance is provided with an infrared sensor, and the step of determining whether the voice signal is a voice signal sent by the electronic device comprises:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
in the infrared thermal image, determining a temperature area where a target object is located, and determining the spatial position of the target object in the space where the household appliance is located according to the spatial coordinates of the temperature area;
acquiring the position of a sound source sending the voice signal;
and determining whether the spatial position is matched with the sound source position, wherein when the spatial position is matched with the sound source position, the voice signal is determined to be a voice signal which is not sent out by the electronic equipment.
In one embodiment, it is recognized by a voice recognition model whether the voice signal triggers a preset voice event.
In one embodiment, the step of receiving the voice signal comprises:
the household appliance receives the voice signal collected by the terminal, wherein the household appliance and the terminal are in the same environment.
In an embodiment, after the step of determining whether the voice signal is a voice signal sent by an electronic device, the method further includes:
when the voice signal is determined not to be the voice signal sent by the electronic equipment, determining the operation corresponding to the voice signal;
outputting prompt information of the household appliance executing operation;
and when receiving confirmation information triggered based on the prompt information, executing the step of responding to the voice signal to execute the corresponding operation.
In order to achieve the above object, the present invention further provides a home appliance, which includes a memory, a processor, and a home appliance control program stored in the memory and executable on the processor, wherein the home appliance control program implements the steps of the home appliance control method when executed by the processor.
In one embodiment, the household appliance is provided with an infrared sensor connected with the processor.
In order to achieve the above object, the present invention further provides a computer-readable storage medium storing a control program of an appliance, which when executed by a processor, implements the steps of the control method of an appliance as described above.
The household appliance receives a voice signal, determines whether the voice signal triggers a preset sound event, if so, identifies the voice signal to determine whether the voice signal is the voice signal sent by the electronic equipment, and responds to the voice signal to execute corresponding operation when determining that the voice signal is not the voice signal sent by the electronic equipment. The household appliance receives the voice signal, recognizes the voice signal to determine whether the voice signal triggers a preset voice event, further determines whether the voice signal is the voice signal sent by the electronic equipment if the voice signal triggers the preset voice event, and executes the operation corresponding to the voice signal if the voice signal triggers the preset voice event, so that the household appliance is prevented from responding to a control instruction triggered by the electronic equipment, and the problem that the household appliance generates voice false response due to the electronic equipment is solved.
Drawings
Fig. 1 is a schematic diagram of a hardware architecture of a home appliance according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating a first embodiment of a method for controlling a home appliance according to the present invention;
fig. 3 is a detailed flowchart of step S20 in the second embodiment of the method for controlling a home appliance according to the present invention;
fig. 4 is a detailed flowchart of step S20 in the third embodiment of the method for controlling a home appliance according to the present invention;
fig. 5 is a detailed flowchart of step S20 in the fourth embodiment of the method for controlling a home appliance according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: receiving a voice signal and determining whether the voice signal triggers a preset sound event; when the voice signal is determined to trigger the preset sound event, determining whether the voice signal is a voice signal sent by the electronic equipment; and when the voice signal is determined not to be the voice signal sent by the electronic equipment, responding to the voice signal to execute a corresponding operation.
The household appliance receives the voice signal, recognizes the voice signal to determine whether the voice signal triggers a preset voice event, further determines whether the voice signal is the voice signal sent by the electronic equipment if the voice signal triggers the preset voice event, and executes the operation corresponding to the voice signal if the voice signal triggers the preset voice event, so that the household appliance is prevented from responding to a control instruction triggered by the electronic equipment, and the problem that the household appliance generates voice false response due to the electronic equipment is solved.
As shown in fig. 1, fig. 1 is a schematic diagram of a hardware architecture of a home appliance according to an embodiment of the present invention.
The embodiment of the invention relates to a household appliance, which can be an air conditioner, a television and the like, and comprises: aprocessor 101, such as a CPU, amemory 102 and acommunication bus 103. Wherein acommunication bus 103 is used for enabling the connection communication between these components.
Thememory 102 may be a high-speed RAM memory or a non-volatile memory (e.g., a disk memory). As shown in fig. 1, amemory 103, which is a kind of computer storage medium, may include a control program of the home appliance therein; and theprocessor 101 may be configured to call up a control program of the home appliance stored in thememory 102 and perform the following operations:
receiving a voice signal and determining whether the voice signal triggers a preset sound event;
when the voice signal is determined to trigger the preset sound event, determining whether the voice signal is a voice signal sent by the electronic equipment;
and when the voice signal is determined not to be the voice signal sent by the electronic equipment, responding to the voice signal to execute a corresponding operation.
In one embodiment, theprocessor 101 may be configured to call a control program of the home appliance stored in thememory 102, and perform the following operations:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
and determining whether the infrared thermal image comprises a temperature area where the target object is located, wherein when the infrared thermal image comprises the temperature area where the target object is located, the voice signal is determined not to be the voice signal sent by the electronic equipment.
In one embodiment, theprocessor 101 may be configured to call a control program of the home appliance stored in thememory 102, and perform the following operations:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
determining the area of a temperature region where a target object is located in the infrared thermal image;
and determining whether the area is matched with a preset area, wherein when the area is matched with the preset area, it is determined that the voice signal is not a voice signal sent by the electronic equipment.
In one embodiment, theprocessor 101 may be configured to call a control program of the home appliance stored in thememory 102, and perform the following operations:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
in the infrared thermal image, determining a temperature area where a target object is located, and determining the spatial position of the target object in the space where the household appliance is located according to the spatial coordinates of the temperature area;
acquiring the position of a sound source sending the voice signal;
and determining whether the spatial position is matched with the sound source position, wherein when the spatial position is matched with the sound source position, the voice signal is determined to be a voice signal which is not sent out by the electronic equipment.
In one embodiment, theprocessor 101 may be configured to call a control program of the home appliance stored in thememory 102, and perform the following operations:
and identifying whether the voice signal triggers a preset voice event or not through a voice identification model.
In one embodiment, theprocessor 101 may be configured to call a control program of the home appliance stored in thememory 102, and perform the following operations:
the household appliance receives the voice signal collected by the terminal, wherein the household appliance and the terminal are in the same environment.
In one embodiment, theprocessor 101 may be configured to call a control program of the home appliance stored in thememory 102, and perform the following operations:
when the voice signal is determined not to be the voice signal sent by the electronic equipment, determining the operation corresponding to the voice signal;
outputting prompt information of the household appliance executing operation;
and when receiving confirmation information triggered based on the prompt information, executing the step of responding to the voice signal to execute the corresponding operation.
According to the scheme, the household appliance receives the voice signal, determines whether the voice signal triggers the preset sound event, if so, identifies the voice signal to determine whether the voice signal is the voice signal sent by the electronic equipment, and responds to the voice signal to execute the corresponding operation when determining that the voice signal is not the voice signal sent by the electronic equipment. The household appliance receives the voice signal, recognizes the voice signal to determine whether the voice signal triggers a preset voice event, further determines whether the voice signal is the voice signal sent by the electronic equipment if the voice signal triggers the preset voice event, and executes the operation corresponding to the voice signal if the voice signal triggers the preset voice event, so that the household appliance is prevented from responding to a control instruction triggered by the electronic equipment, and the problem that the household appliance generates voice false response due to the electronic equipment is solved.
Based on the hardware architecture of the household appliance, the embodiment of the control method of the household appliance is provided.
Referring to fig. 2, fig. 2 is a first embodiment of a method for controlling a home appliance according to the present invention, the method comprising the steps of:
step S10, receiving a voice signal and determining whether the voice signal triggers a preset sound event;
in this embodiment, the execution subject is a home appliance. The household appliance can be an air conditioner, a television and the like. The household appliance can be provided with a voice acquisition module so as to acquire voice signals in real time. The household appliance is provided with a preset sound event, the preset sound event refers to sound without definite words, and the sound is defined as special sound. The special sound may be: the sounds of crying babies, coughing in the elderly, and squeaking in pets (e.g., cat squeaking and dog squeaking). After receiving the voice signal, the household appliance extracts the sound features of the voice signal, wherein the sound features can be tone, speed of sound and the like. The household appliance extracts the sound features, compares the sound features with preset sound features, and determines the preset sound features corresponding to the maximum similarity of the sound features, wherein the maximum similarity is greater than a preset threshold value, so that the sound contained in the voice signal can be determined to be special sound, that is, the voice signal is determined to trigger a preset sound event. The preset sound features are extracted from the special sound.
In addition, a voice recognition model can be set in the household appliance, the voice recognition model is obtained by training various special voices, and the trained voice recognition model can recognize whether the voice signal is the special voice. That is, after the voice signal is input to the voice recognition model, the voice recognition model can recognize whether the voice signal is a special voice. The household appliance can judge that the voice signal triggers the voice event if the voice signal is a special voice according to the recognition result output by the voice recognition model acquired by the household appliance. And when the voice signal is not a special sound, discarding the voice signal. The voice recognition model can also be obtained by training the voice characteristics of the special voice.
Of course, the home appliance may input the voice signal to the server to recognize the voice signal through the voice recognition model in the server, and the server transmits the recognition result to the home appliance. If the recognition result is that the voice signal is a special sound, the voice signal can be determined to trigger a preset sound event.
Step S20, when it is determined that the voice signal triggers the preset sound event, determining whether the voice signal is a voice signal sent by the electronic equipment;
the household appliance determines whether the voice signal is the voice signal sent by the electronic equipment after determining that the voice signal touches a preset voice-sending event. Specifically, the frequency of the voice signal sent by the electronic device is fixed, so that the device can extract the frequency of the voice signal, compare the frequency with the preset frequency, and determine that the voice signal is the voice signal sent by the electronic device if the difference between the frequencies is smaller than the preset difference. If the difference between the frequencies of the two signals is larger than the preset difference value, the voice signal is determined not to be the voice signal sent by the electronic equipment.
And step S30, when the voice signal is determined not to be the voice signal sent by the electronic equipment, responding to the voice signal to execute corresponding operation.
When the household appliance determines that the voice signal is not the voice signal sent by the electronic equipment, the household appliance determines the operation corresponding to the voice signal, and then responds to the voice signal to execute the operation corresponding to the voice signal. The following examples are given. For example, if the voice signal is a baby cry, the operation corresponding to the voice signal causes the household appliance to send a prompt message of the baby cry to the preset terminal, and the preset terminal is a mobile phone of a parent of the baby. For another example, the voice signal is the cough sound of the elderly, and the air conditioner is in the cooling mode, at this time, it indicates that the room temperature is too low, and the operation corresponding to the voice signal is to reduce the wind speed, the wind volume and the output cooling capacity. In addition, if the voice signal is a cat sound, the operation corresponding to the voice signal is to output a soothing voice of the cat owner. In addition, when the voice signal is a dog call, the pet dog eating time is probably, and the operation corresponding to the voice signal is prompt information for outputting dog eating to the preset terminal. It is understood that the operation corresponding to the voice signal is determined by at least one of an operation scene of the air conditioner and a scene of the target object corresponding to the voice signal.
In the technical scheme provided by this embodiment, the home appliance receives a voice signal, determines whether the voice signal triggers a preset sound event, if so, identifies the voice signal to determine whether the voice signal is a voice signal sent by the electronic device, and responds to the voice signal to execute a corresponding operation when determining that the voice signal is not a voice signal sent by the electronic device. The household appliance receives the voice signal, recognizes the voice signal to determine whether the voice signal triggers a preset voice event, further determines whether the voice signal is the voice signal sent by the electronic equipment if the voice signal triggers the preset voice event, and executes the operation corresponding to the voice signal if the voice signal triggers the preset voice event, so that the household appliance is prevented from responding to a control instruction triggered by the electronic equipment, and the problem that the household appliance generates voice false response due to the electronic equipment is solved.
Referring to fig. 3, fig. 3 is a second embodiment of the method for controlling a home appliance according to the present invention, where based on the first embodiment, the step S20 includes:
step S21, acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
step S22, determining whether the infrared thermal image includes a temperature region where the target object is located, wherein when it is determined that the infrared thermal image includes the temperature region where the target object is located, it is determined that the voice signal is not a voice signal emitted by the electronic device.
In this embodiment, the household appliance is provided with an infrared sensor, and the infrared sensor may be an infrared camera or an infrared array sensor. The household appliance collects the infrared thermal image of the environment where the household appliance is located through the infrared sensor.
When the household appliance determines that the voice signal triggers the sound event, the household appliance can determine a target object according to the voice signal, wherein the target object can be a baby, an old man or an animal. And the target object has a corresponding body surface temperature, e.g., the normal body surface temperature of an infant is 36.2-37.0. Of course, the elderly as well as animals also have corresponding body surface temperatures. The household appliance stores the normal body surface temperature of the target object, and the stored normal body surface temperature is the preset temperature interval of the target object.
After acquiring the infrared thermal image, the household appliance firstly acquires a preset temperature interval corresponding to the target object, and then searches out a temperature area formed by the preset temperature interval from the infrared thermal image, wherein the temperature area is the temperature area where the target object is located. If the infrared thermal image exists in the temperature area where the target object is located, the voice signal can be determined to be sent by the target object in the environment where the household appliance is located, but not sent by the electronic equipment. If the infrared thermal image does not include the temperature area where the target object is located, the voice information can be determined to be sent by the electronic equipment.
In the technical scheme provided by this embodiment, household electrical appliances are provided with infrared sensor, and household electrical appliances obtain the infrared thermal image of the environment that household electrical appliances are located through infrared sensor, if infrared thermal image includes the temperature region that target object is located, can confirm the speech signal that speech signal does not send for electronic equipment to make the accurate operation that corresponds of response sound event of household electrical appliances.
Referring to fig. 4, fig. 4 is a third embodiment of the method for controlling a home appliance according to the present invention, where based on the first or second embodiment, the step S20 includes:
step S23, acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
step S24, determining the area of the temperature area where the target object is located in the infrared thermal image;
and step S25, determining that the area matches a preset area, wherein when the area matches the preset area, it is determined that the voice signal is not a voice signal sent by the electronic device.
In this embodiment, the household appliance is provided with an infrared sensor, and the household appliance acquires an infrared thermal image through the infrared sensor and determines a temperature area where the target object is located through the infrared thermal image. For a specific determination method, reference is made to the above description, and details are not repeated here.
The temperature region in which the target object is located actually refers to a region of a preset temperature interval in the infrared thermal image, and the temperature of the temperature region is not necessarily the temperature of the target object. For example, a baking cage is just arranged in a room, and after the baking cage is closed, the temperature of the baking cage is reduced to 36.2-37 ℃; or the temperature of the keyboard of the notebook computer is between 36.2 and 37 degrees. It will be appreciated that the temperature zone determined by the appliance in the infrared thermal image need not be the temperature zone in which the target object is located. The target object has a certain volume, the volume can be converted into the area of the target object in the infrared thermal image, and the area and the target object are stored in a home appliance in a correlated mode.
The household appliance can aggregate all points of the infrared thermal image in the preset temperature interval of the target object, so that the area of the aggregated temperature area is calculated. Specifically, the household appliance can calculate the number of the pixel points included in the temperature region, so that the ratio is obtained according to the number of the pixel points in the temperature region and the total number of the pixel points in the infrared thermal image, and the area of the temperature region can be obtained by multiplying the ratio by the area of the infrared thermal image.
And the household appliance determines whether the area is matched with the preset area, and if the area is matched with the preset area, the voice signal is determined not to be the voice signal sent by the electronic equipment. The area is matched with the preset area, wherein the difference value between the area and the preset area is smaller than a preset threshold value.
In the technical scheme provided by this embodiment, after determining that the area of the temperature region where the target object is located is obtained in the infrared thermal image, the home appliance determines whether the area matches a preset area, and if so, determines that the voice signal is not the voice signal sent by the electronic device.
Referring to fig. 5, fig. 5 is a fourth embodiment of the method for controlling a home appliance according to the present invention, where based on the first or second embodiment, the step S20 includes:
step S26, acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
step S27, determining a temperature area where a target object is located in the infrared thermal image, and determining the spatial position of the target object in the space where the household appliance is located according to the spatial coordinates of the temperature area;
step S28, obtaining the sound source position of the voice signal;
and step S29, determining whether the spatial position matches with the sound source position, wherein when the spatial position matches with the sound source position, the voice signal is determined to be a voice signal which is not sent by the electronic equipment.
In this embodiment, after acquiring the temperature region of the target object (see the above description for determining the temperature region), the home appliance acquires the spatial position of the target object in the environment where the home appliance is located according to the spatial coordinates of the temperature region. The temperature area is actually a sub-image area in the infrared thermal image, and the thermal red thermal image is provided with corresponding spatial coordinates, so that the spatial coordinates corresponding to the temperature area can be determined, and the spatial coordinates corresponding to the temperature area can be the spatial coordinates of the center point of the area. The household appliance can determine the spatial position of the target object in the space where the household appliance is located according to the spatial coordinates.
When the household appliance collects the voice signals, the source of the voice signals can be positioned, and therefore the sound source position of the voice signals is determined. The household appliance further determines whether the spatial position is matched with the sound source position, and if the spatial position is overlapped with the sound source position or the distance between the spatial position and the sound source position is small, the spatial position can be determined to be matched with the sound source position. The spatial coordinates of the sound source position can be obtained by home appliance localization, so as to determine the distance between the spatial position (the spatial position and the sound source position have corresponding spatial coordinates) and the sound source position.
In the technical scheme provided by this embodiment, after the home appliance determines the temperature area where the target object is located, the home appliance determines the spatial position of the target object in the space where the home appliance is located according to the spatial coordinates corresponding to the temperature area, receives the sound source position corresponding to the voice signal, and determines whether the sound source position is matched with the spatial position, thereby accurately determining whether the voice signal is sent out by the electronic device.
In one embodiment, the voice signal received by the home appliance is acquired by the first terminal. The first terminal is provided with a voice acquisition module, and the first terminal sends acquired voice signals to the household appliances. The first terminal can be a mobile phone, an Ipad, a computer, and the like. The first terminal starts the voice acquisition module in real time and sends the acquired voice signal to the household appliance. The APP can be loaded at the first terminal, the first terminal sends the collected voice signals to household appliances through the APP, or sends the voice signals to the APP server, and the APP server sends the voice signals to the household appliances. In this way, the household appliance receives the voice signal by using the voice acquisition module of the existing device (the first terminal) without configuring the voice acquisition module, so that the control cost of the household appliance is saved. In addition, the environment where the first terminal is located is the same as the environment where the household appliance is located, so that the household appliance can accurately respond to the operation corresponding to the sound event in the environment of the household appliance. In addition, the sound source position of the voice signal can be positioned by the first terminal, and the first terminal sends the voice signal and the sound source position to the household appliance at the same time, so that the household appliance determines whether the voice signal is sent out by the electronic equipment.
In an embodiment, after determining that the voice signal is not a voice signal sent by the electronic device, the home appliance needs to determine an operation corresponding to the voice signal. The operation may be the execution of the function of the home appliance, but since the target object itself does not have the confirmation capability, the home appliance may respond to the operation corresponding to the voice signal after determining the operation corresponding to the voice signal, and the operation is the turning-off and turning-on of the function on the home appliance or the adjustment of the operation parameter, all with the consent of the home appliance-associated object, so as to avoid the home appliance responding to the operation that does not conform to the intention of the user. For example, the voice signal is a baby crying, the air conditioner (the household appliance is the air conditioner) determines that the operation corresponding to the voice signal is increasing heat output, the air conditioner needs to send specific content of the operation to the second terminal, and a user of the second terminal is a parent of the baby; if the second terminal feeds back the confirmation information, the fact that the user of the second terminal agrees with the operation of the air conditioner can be determined, and the air conditioner increases the heat output. Of course, the home appliance may send the prompt message for the home appliance to perform the operation to the server, so that the server sends the prompt message to the second terminal. Or, the household appliance can directly play or display the prompt message.
It can be understood that, after determining the operation corresponding to the voice signal, the home appliance outputs prompt information for the home appliance to execute the operation, and if receiving confirmation information triggered based on the prompt information, the home appliance may respond to the voice signal to execute the corresponding operation. The confirmation information triggered based on the operation may be confirmation information triggered by the second terminal based on the operation information, or confirmation operation fed back based on the play or display of the home appliance.
The present invention also provides a home appliance, which includes a memory, a processor, and a home appliance control program stored in the memory and executable on the processor, wherein the home appliance control program, when executed by the processor, implements the steps of the home appliance control method according to the above embodiment.
The present invention also provides a computer-readable storage medium storing a control program for an appliance, which, when executed by a processor, implements the steps of the method for controlling an appliance according to the above embodiment.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention essentially or contributing to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioning device, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent structures or equivalent flow transformations that may be embodied in the present specification and drawings, or directly or indirectly applied to other related arts, and are within the scope of the present invention.
Claims (10)
1. A method for controlling a home appliance, comprising:
receiving a voice signal, and determining whether the voice signal triggers a preset sound event, wherein the preset sound event is a special sound without definite words;
when the voice signal is determined to trigger the preset sound event, determining whether the voice signal is a voice signal sent by the electronic equipment;
when the voice signal is determined not to be a voice signal sent by the electronic equipment, responding to the voice signal to execute a corresponding operation;
wherein the step of determining whether the voice signal is a voice signal sent by the electronic device comprises:
extracting the frequency of the voice signal, comparing the frequency with a preset frequency, and judging whether the difference value of the frequency between the frequency and the preset frequency is greater than a preset difference value, wherein if the difference value of the frequency between the frequency and the preset frequency is greater than the preset difference value, the voice signal is determined not to be the voice signal sent by the electronic equipment.
2. The method for controlling an electronic appliance according to claim 1, wherein the electronic appliance is provided with an infrared sensor, and the step of determining whether the voice signal is a voice signal emitted from the electronic device comprises:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
and determining whether the infrared thermal image comprises a temperature area where the target object is located, wherein when the infrared thermal image comprises the temperature area where the target object is located, the voice signal is determined not to be the voice signal sent by the electronic equipment.
3. The method for controlling an electronic appliance according to claim 1, wherein the electronic appliance is provided with an infrared sensor, and the step of determining whether the voice signal is a voice signal emitted from the electronic device comprises:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
determining the area of a temperature region where a target object is located in the infrared thermal image;
and determining whether the area is matched with a preset area, wherein when the area is matched with the preset area, it is determined that the voice signal is not a voice signal sent by the electronic equipment.
4. The method for controlling an electronic appliance according to claim 1, wherein the electronic appliance is provided with an infrared sensor, and the step of determining whether the voice signal is a voice signal emitted from the electronic device comprises:
acquiring an infrared thermal image of the environment where the household appliance is located, which is acquired by the infrared sensor;
in the infrared thermal image, determining a temperature area where a target object is located, and determining the spatial position of the target object in the space where the household appliance is located according to the spatial coordinates of the temperature area;
acquiring the position of a sound source sending the voice signal;
and determining whether the spatial position is matched with the sound source position, wherein when the spatial position is matched with the sound source position, the voice signal is determined to be a voice signal which is not sent out by the electronic equipment.
5. The method of controlling an electronic appliance according to claim 1, wherein it is recognized whether the voice signal triggers a preset voice event through a voice recognition model.
6. The method for controlling an electronic appliance according to any one of claims 1 to 5, wherein the step of receiving a voice signal comprises:
the household appliance receives the voice signal collected by the terminal, wherein the household appliance and the terminal are in the same environment.
7. The method for controlling an electronic appliance according to any one of claims 1 to 5, wherein the step of determining whether the voice signal is a voice signal transmitted from the electronic device further comprises:
when the voice signal is determined not to be the voice signal sent by the electronic equipment, determining the operation corresponding to the voice signal;
outputting prompt information of the household appliance executing operation;
and when receiving confirmation information triggered based on the prompt information, executing the step of responding to the voice signal to execute the corresponding operation.
8. An appliance comprising a memory, a processor, and a control program for the appliance stored in the memory and executable on the processor, wherein the control program for the appliance, when executed by the processor, implements the steps of the method for controlling an appliance according to any one of claims 1 to 7.
9. The appliance of claim 8, wherein the appliance is provided with an infrared sensor coupled to the processor.
10. A computer-readable storage medium storing a control program for an appliance, the control program for an appliance implementing the steps of the method for controlling an appliance according to any one of claims 1 to 7 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010608725.4ACN111786860B (en) | 2020-06-29 | 2020-06-29 | Household appliance, control method thereof and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010608725.4ACN111786860B (en) | 2020-06-29 | 2020-06-29 | Household appliance, control method thereof and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111786860A CN111786860A (en) | 2020-10-16 |
| CN111786860Btrue CN111786860B (en) | 2022-04-01 |
Family
ID=72761125
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010608725.4AActiveCN111786860B (en) | 2020-06-29 | 2020-06-29 | Household appliance, control method thereof and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111786860B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112908321A (en)* | 2020-12-02 | 2021-06-04 | 青岛海尔科技有限公司 | Device control method, device, storage medium, and electronic apparatus |
| CN113362823A (en)* | 2021-06-08 | 2021-09-07 | 深圳市同行者科技有限公司 | Multi-terminal response method, device, equipment and storage medium of household appliance |
| CN115985312A (en)* | 2022-12-06 | 2023-04-18 | 珠海格力电器股份有限公司 | Air conditioner control method, device, equipment and medium based on voice recognition |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104269172A (en)* | 2014-07-31 | 2015-01-07 | 广东美的制冷设备有限公司 | Voice control method and system based on video positioning |
| CN104267618A (en)* | 2014-07-31 | 2015-01-07 | 广东美的制冷设备有限公司 | Voice control method and system based on infrared positioning |
| CN106653014A (en)* | 2016-10-31 | 2017-05-10 | 广州华凌制冷设备有限公司 | Voice control method for smart home and voice control device for smart home |
| CN106886162A (en)* | 2017-01-13 | 2017-06-23 | 深圳前海勇艺达机器人有限公司 | The method of smart home management and its robot device |
| CN110085233A (en)* | 2019-04-08 | 2019-08-02 | 广东美的制冷设备有限公司 | Sound control method and its device, electronic equipment and computer readable storage medium |
| CN110262442A (en)* | 2019-07-31 | 2019-09-20 | 浙江工商职业技术学院 | A kind of scenery control method and control centre's equipment based on Internet of Things |
| CN110601933A (en)* | 2019-09-17 | 2019-12-20 | 百度在线网络技术（北京）有限公司 | Control method, device and equipment of Internet of things equipment and storage medium |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102201230B (en)* | 2011-06-15 | 2012-08-22 | 天津大学 | Voice detection method for emergency |
| US9046414B2 (en)* | 2012-09-21 | 2015-06-02 | Google Inc. | Selectable lens button for a hazard detector and method therefor |
| CN103280220B (en)* | 2013-04-25 | 2015-11-18 | 北京大学深圳研究生院 | A kind of real-time recognition method for baby cry |
| CN103281581B (en)* | 2013-05-31 | 2016-12-28 | 成都三零凯天通信实业有限公司 | By man-machine interactive system and the method for smart mobile phone Voice command IP Set Top Box |
| EP3264266B1 (en)* | 2015-05-20 | 2020-08-05 | Huawei Technologies Co. Ltd. | Method for positioning sounding location, and terminal device |
| CN106452994A (en)* | 2016-09-22 | 2017-02-22 | 北京智能管家科技有限公司 | Device control method and apparatus |
| CN106683360A (en)* | 2017-01-16 | 2017-05-17 | 福建泉州环宇通电子有限公司 | Alarm column for triggering alarm with specific audio |
| CN108369813B (en)* | 2017-07-31 | 2022-10-25 | 深圳和而泰智能家居科技有限公司 | Specific voice recognition method, apparatus and storage medium |
| CN109003600B (en)* | 2018-08-02 | 2021-06-08 | 科大讯飞股份有限公司 | Message processing method and device |
| CN110535732B (en)* | 2019-07-29 | 2021-12-07 | 深圳绿米联创科技有限公司 | Equipment control method and device, electronic equipment and storage medium |
- 2020
- 2020-06-29CNCN202010608725.4Apatent/CN111786860B/enactiveActive
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104269172A (en)* | 2014-07-31 | 2015-01-07 | 广东美的制冷设备有限公司 | Voice control method and system based on video positioning |
| CN104267618A (en)* | 2014-07-31 | 2015-01-07 | 广东美的制冷设备有限公司 | Voice control method and system based on infrared positioning |
| CN106653014A (en)* | 2016-10-31 | 2017-05-10 | 广州华凌制冷设备有限公司 | Voice control method for smart home and voice control device for smart home |
| CN106886162A (en)* | 2017-01-13 | 2017-06-23 | 深圳前海勇艺达机器人有限公司 | The method of smart home management and its robot device |
| CN110085233A (en)* | 2019-04-08 | 2019-08-02 | 广东美的制冷设备有限公司 | Sound control method and its device, electronic equipment and computer readable storage medium |
| CN110262442A (en)* | 2019-07-31 | 2019-09-20 | 浙江工商职业技术学院 | A kind of scenery control method and control centre's equipment based on Internet of Things |
| CN110601933A (en)* | 2019-09-17 | 2019-12-20 | 百度在线网络技术（北京）有限公司 | Control method, device and equipment of Internet of things equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111786860A (en) | 2020-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111786860B (en) | Household appliance, control method thereof and computer readable storage medium | |
| CN110661685B (en) | Information feedback method and device, electronic equipment and storage medium | |
| US12052494B2 (en) | Systems and methods of power-management on smart devices | |
| CN110535732B (en) | Equipment control method and device, electronic equipment and storage medium | |
| CN113169991A (en) | Intelligent device distribution network method, device, electronic device and storage medium | |
| CN113412609B (en) | Equipment control method, device, server and storage medium | |
| CN107544272B (en) | Terminal control method, device and storage medium | |
| CN106225174B (en) | Air conditioner control method and system and air conditioner | |
| US11050828B2 (en) | Electronic device, server and method of controlling the same | |
| CN107589725B (en) | Smart home equipment control method and control equipment based on built-in antenna | |
| CN111425997B (en) | Method and device for determining blowing mode, terminal and computer readable medium | |
| KR20200085143A (en) | Conversational control system and method for registering external apparatus | |
| CN113593544A (en) | Device control method and apparatus, storage medium, and electronic apparatus | |
| CN112614333A (en) | Remote controller retrieving method and system | |
| CN114019807A (en) | Data processing method, apparatus, system, device and readable storage medium | |
| CN110658736A (en) | Household appliance control method, household appliance control device and computer storage medium | |
| CN110730330B (en) | Sound processing method and device, doorbell and computer readable storage medium | |
| TW202022650A (en) | Method for controlling devices based on voice message and control terminal device | |
| JP2019061334A (en) | DEVICE CONTROL DEVICE, DEVICE CONTROL METHOD, AND DEVICE CONTROL SYSTEM | |
| JP2018170744A (en) | Remote control system, remote control method, and program | |
| WO2016206644A1 (en) | Robot control engine and system | |
| CN118034637B (en) | Method for processing sensing interaction of universal terminal, control device and storage medium | |
| CN107449109B (en) | Air conditioner voice control method and device, air conditioner and readable storage medium | |
| CN113938734A (en) | Smart television control method, device and equipment based on radar and storage medium | |
| CN110989423B (en) | Method, device, terminal and computer readable medium for controlling multiple intelligent devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |