技术领域technical field
本发明涉及家电领域，尤其涉及一种智能家电设备的语音协同控制方法。The invention relates to the field of home appliances, in particular to a voice cooperative control method for smart home appliances.
背景技术Background technique
现有的家电设备中，通常设置有用于人机交互的操作显示屏幕，用户可以通过该操作显示屏幕进行选择设置，比如冰箱门体上设有触摸显示屏幕用于用户进行温度选择设置，炒菜机上设有触摸显示屏幕用于菜谱的查询选择以及烹饪进程的查看，但在使用过程中，需要用户进行较多的手动操作，尤其针对老人，较为麻烦与困难。In the existing home appliances, there is usually an operation display screen for human-computer interaction, through which the user can select and set. For example, a touch display screen is provided on the refrigerator door for the user to select and set the temperature. There is a touch display screen for querying and selecting recipes and viewing the cooking process, but in the process of use, the user needs to perform more manual operations, especially for the elderly, which is troublesome and difficult.
随着技术的不断发展，出现了通过语音控制的家电设备，具体通过在家电设备上设置语音拾取装置，通过语音拾取装置拾取用户的语音控制指令后根据语音数据库进行匹配识别后执行相应的工作。但是也存在问题：语音控制的家电设备要求用户发出的是标准的普通话来进行识别，但中国地域广阔，方言众多，很多人不会讲普通话，对每种方言都建立语音数据库来控制不现实；而且即使会讲普通话的用户也可能带有较重的口音而不标准，从而影响语音控制指令的准确识别，导致无法使用家电设备。With the continuous development of technology, household appliances controlled by voice appear. Specifically, by setting a voice pickup device on the household appliance, the voice pickup device picks up the user's voice control instructions, performs matching and recognition according to the voice database, and then executes the corresponding work. But there are also problems: voice-controlled home appliances require users to speak standard Mandarin for recognition, but China has a vast territory and many dialects, and many people cannot speak Mandarin, so it is unrealistic to establish a voice database for each dialect to control; Moreover, even users who can speak Mandarin may have a heavy and non-standard accent, which affects the accurate recognition of voice control commands, resulting in the inability to use home appliances.
发明内容Contents of the invention
本发明旨在在于至少部分解决上述技术问题之一。The present invention aims at at least partially solving one of the above-mentioned technical problems.
本发明的目的在于提供了智能家电设备的语音协同控制方法。The purpose of the present invention is to provide a voice cooperative control method for smart home appliances.
为实现上述目的，采用的技术方案如下：In order to achieve the above purpose, the technical scheme adopted is as follows:
一种智能家电设备的语音协同控制方法，所述方法包括：A voice cooperative control method for smart home appliances, the method comprising:
第一智能家电设备获取第一用户的语音指令信息；The first smart home appliance acquires the voice instruction information of the first user;
第一智能家电设备发送协助请求信息至与其关联的第二智能家电设备和/或移动终端设备；The first smart home appliance sends assistance request information to its associated second smart home appliance and/or mobile terminal device;
所述第二智能家电设备和/或移动终端设备根据所述协助请求信息生成机器执行信息，并发送至所述第一智能家电设备。The second smart home appliance and/or the mobile terminal generates machine execution information according to the assistance request information, and sends it to the first smart home appliance.
第一智能家电设备获取第一用户的语音指令信息后向与其关联的第二智能家电设备和/或移动终端设备发送协助请求信息，通过所述第二智能家电设备和/或移动终端设备根据该协助请求信息协助生成用于控制第一智能家电设备工作的机器执行信息，从而协助所述第一用户对第一智能家电设备进行控制，避免第一智能家电设备无法直接根据该第一用户的语音指令信息进行工作而带来的不便。After the first smart home appliance obtains the voice instruction information of the first user, it sends assistance request information to the second smart home appliance and/or mobile terminal device associated with it, and the second smart home appliance and/or mobile terminal device according to the The assistance request information assists in generating machine execution information for controlling the work of the first smart home appliance, thereby assisting the first user to control the first smart home appliance, preventing the first smart home appliance from being unable to directly follow the voice of the first user. Inconvenience caused by ordering information to work.
进一步的，在所述第一智能家电设备发送述协助请求信息至与其关联的第二智能家电设备和/或移动终端设备步骤前，还包括：Further, before the first smart home appliance sends the assistance request information to its associated second smart home appliance and/or mobile terminal device, it also includes:
所述第一智能家电设备查询本地语音指令数据库；The first smart home appliance queries a local voice command database;
在所述第一智能家电设备无法从本地语音指令数据库中匹配所述第一用户的语音指令信息时，向与其关联的第二智能家电设备和/或移动终端设备发送协助请求信息。When the first smart home appliance fails to match the voice command information of the first user from the local voice command database, send assistance request information to the second smart home appliance and/or mobile terminal device associated therewith.
第一智能家电设备上的本地语音指令数据库能够快速、方便的读取，因此，优先查询本地语音指令数据库中是否能够匹配所述第一用户的语音指令信息，而在所述第一智能家电设备无法从本地语音指令数据库中匹配所述第一用户的语音指令信息时，向与其关联的第二智能家电设备和/或移动终端设备发送协助请求信息。The local voice command database on the first smart home appliance can be read quickly and conveniently. Therefore, it is preferred to query whether the voice command information of the first user can be matched in the local voice command database, and the first smart home appliance When the voice command information of the first user cannot be matched from the local voice command database, send assistance request information to the second smart home appliance and/or mobile terminal device associated therewith.
进一步的，所述方法还包括：Further, the method also includes:
在所述第一智能家电设备无法从本地语音指令数据库中匹配所述第一用户的语音指令信息时，将所述第一用户的语音指令信息发送至云端服务器查询；When the first smart home appliance cannot match the voice command information of the first user from the local voice command database, send the voice command information of the first user to a cloud server for query;
在所述云端服务器为查询到与所述语音指令信息相对应的机器执行信息时，向与其关联的第二智能家电设备和/或移动终端设备发送协助请求信息。When the cloud server finds machine execution information corresponding to the voice instruction information, it sends assistance request information to the second smart home appliance and/or mobile terminal associated therewith.
进一步的，所述第二智能家电设备和/或移动终端设备根据所述协助请求信息生成机器执行信息步骤包括：Further, the step of generating machine execution information according to the assistance request information by the second smart home appliance and/or mobile terminal device includes:
第二智能家电设备和/或移动终端设备根据所述协助请求信息解析所述第一用户的语音控制指令信息，并根据第二用户的设置操作生成机器执行信息。The second smart home appliance and/or mobile terminal parses the first user's voice control instruction information according to the assistance request information, and generates machine execution information according to the second user's setting operation.
第二智能家电设备和/或移动终端设备根据所述协助请求信息解析所述第一用户的语音控制指令信息，然后再将解析出的语音控制指令信息后进行播放，第二用户根据该语音控制指令信息进行操作，比如进行与该语音指令信息相对应的语音或者手动选择设置或者键入文字等操作，从而根据第二用户的设置操作生成机器执行信息，实现为第一用户提供快速、准确的协助。此外，所述第二用户还可以对第一用户的语音控制指令信息进行检查确认，确定是否需要对该协助请求的内容进行变更调整。The second smart home appliance and/or mobile terminal device parses the voice control instruction information of the first user according to the assistance request information, and then plays the parsed voice control instruction information. Operate the instruction information, such as performing operations corresponding to the voice instruction information or manually selecting settings or typing text, so as to generate machine execution information according to the second user's setting operation, and provide fast and accurate assistance to the first user . In addition, the second user may also check and confirm the voice control instruction information of the first user to determine whether the content of the assistance request needs to be changed or adjusted.
进一步的，所述方法还包括：Further, the method also includes:
建立与所述第一用户的语音指令信息相对应的机器执行信息数据库，并在所述智能家电设备和/或云端服务器上进行保存。A machine execution information database corresponding to the first user's voice instruction information is established, and stored on the smart home appliance and/or cloud server.
如此，在建立与该第一用户的语音信息相对应的机器执行信息数据库后，当再一次获取到该语音指令信息时，能够直接、快速的根据该建立的数据库进行查询相应的机器执行信息，减少对第二智能家电设备和/或移动终端设备的依赖。In this way, after the machine execution information database corresponding to the voice information of the first user is established, when the voice command information is obtained again, the corresponding machine execution information can be directly and quickly queried according to the established database, Reduce dependence on second smart home appliances and/or mobile terminal devices.
进一步的，在第一智能家电设备获取第一用户的语音指令信息步骤前，还包括：Further, before the first smart home appliance obtains the first user's voice command information step, it also includes:
获取所述第一用户的身份信息；Obtain the identity information of the first user;
在所述第一用户具有控制权限时获取所述第一用户的语音指令信息。Acquiring voice command information of the first user when the first user has control authority.
必须是具有控制权限的第一用户才能够进行智能家电设备的控制，这样可以避免不具有控制权限的小孩或者其他外人对智能家电设备进行控制操作，而且在拾取所述第一用户的语音指令信息前需要先验证用户的身份信息，避免获取不具备控制权限的用户语音指令信息而导致信息冗余浪费。Only the first user with control authority can control the smart home appliances, which can prevent children or other outsiders who do not have control authority from controlling the smart home appliances, and when picking up the voice command information of the first user It is necessary to verify the identity information of the user first, so as to avoid the waste of redundant information caused by obtaining the voice command information of the user who does not have the control authority.
进一步的，所述第一智能家电设备发送的协助请求信息包括所述第一用户的身份信息。Further, the assistance request information sent by the first smart home appliance includes the identity information of the first user.
如此，使得第二智能家电设备和/或移动终端设备侧的第二用户在接收到协助请求信息时，能够获知请求协助的第一用户身份信息，进而确定是否进行协助，或者对需要协助的内容进行变更调整。In this way, when receiving the assistance request information, the second smart home appliance and/or the second user on the mobile terminal side can know the identity information of the first user requesting assistance, and then determine whether to provide assistance, or to determine whether to provide assistance, or to provide information on the content requiring assistance. Make changes and adjustments.
进一步的，所述第一智能家电设备关联有至少两个第二智能家电设备和/或移动终端设备，且所述第二智能家电设备和/或移动终端设备之间预设有优先等级。Further, the first smart home appliance is associated with at least two second smart home appliances and/or mobile terminal devices, and priority levels are preset between the second smart home appliances and/or mobile terminal devices.
以此避免当所述第一智能家电设备只关联有一个第二智能家电设备和/或移动终端设备而该第二智能家电设备和/或移动终端设备又无法提供协助而导致第一智能家电设备控制失败的问题。而且，所述第二智能家电设备和/或移动终端设备之间预设有优先等级，使得第一智能家电设备能够按照该预设的优先等级向第二智能家电设备和/或移动终端设备发出协助请求，保证有序进行。In this way, when the first smart home appliance is only associated with a second smart home appliance and/or mobile terminal and the second smart home appliance and/or mobile terminal cannot provide assistance, the first smart home appliance The problem of control failure. Moreover, a priority level is preset between the second smart home appliance and/or the mobile terminal device, so that the first smart home appliance can send a message to the second smart home appliance and/or mobile terminal device according to the preset priority level. Facilitate requests to ensure orderly progress.
进一步的，在预设时间内无法接收到高优先级的第二智能家电设备和/或移动终端设备应答时，向次优先级的第二智能家电设备和/或移动终端设备发送协助请求信息。Further, when a response from the second smart home appliance and/or mobile terminal device with high priority cannot be received within the preset time, the assistance request information is sent to the second smart home appliance device and/or mobile terminal device with lower priority.
进一步的，所述智能家电设备是冰箱、烤箱、饭煲、豆浆机、炒菜机、扫地机中的一种，所述移动终端设备是手机、PAD、可穿戴设备中的一种。Further, the smart home appliance is one of refrigerators, ovens, rice cookers, soybean milk makers, cooking machines, and sweepers, and the mobile terminal is one of mobile phones, PADs, and wearable devices.
附图说明Description of drawings
图1是本发明实施例智能家电设备的语音协同控制方法流程图；FIG. 1 is a flowchart of a voice cooperative control method for smart home appliances according to an embodiment of the present invention;
图2是本发明实施例中的冰箱与移动终端语音协同控制架构示意图；FIG. 2 is a schematic diagram of a voice cooperative control architecture of a refrigerator and a mobile terminal in an embodiment of the present invention;
图3是本发明实施例中的冰箱结构示意框图；Fig. 3 is a schematic block diagram of the structure of the refrigerator in the embodiment of the present invention;
图4是本发明实施例中的冰箱与冰箱语音协同控制架构示意图。Fig. 4 is a schematic diagram of a refrigerator and refrigerator voice cooperative control architecture in an embodiment of the present invention.
具体实施方式Detailed ways
下面结合具体实施方式与附图对本发明的内容做进一步的解释说明，以便更加清楚的阐明本发明的技术方案以及取得的有益效果。The content of the present invention will be further explained below in conjunction with specific implementation methods and accompanying drawings, so as to more clearly illustrate the technical solutions of the present invention and the beneficial effects achieved.
一种智能家电设备的语音协同控制方法，所述方法的流程图如图1所示，包括：A voice cooperative control method for smart home appliances, the flow chart of the method is shown in Figure 1, including:
第一智能家电设备获取第一用户的语音指令信息；The first smart home appliance acquires the voice instruction information of the first user;
第一智能家电设备发送协助请求信息至与其关联的第二智能家电设备和/或移动终端设备；The first smart home appliance sends assistance request information to its associated second smart home appliance and/or mobile terminal device;
所述第二智能家电设备和/或移动终端设备根据所述协助请求信息生成机器执行信息，并发送至所述第一智能家电设备。The second smart home appliance and/or the mobile terminal generates machine execution information according to the assistance request information, and sends it to the first smart home appliance.
第一智能家电设备获取第一用户的语音指令信息后向与其关联的第二智能家电设备和/或移动终端设备发送协助请求信息，通过所述第二智能家电设备和/或移动终端设备根据该协助请求信息协助生成用于控制第一智能家电设备工作的机器执行信息，从而协助所述第一用户对第一智能家电设备进行控制，避免第一智能家电设备无法直接根据该第一用户的语音指令信息进行工作而带来的不便。After the first smart home appliance obtains the voice instruction information of the first user, it sends assistance request information to the second smart home appliance and/or mobile terminal device associated with it, and the second smart home appliance and/or mobile terminal device according to the The assistance request information assists in generating machine execution information for controlling the work of the first smart home appliance, thereby assisting the first user to control the first smart home appliance, preventing the first smart home appliance from being unable to directly follow the voice of the first user. Inconvenience caused by ordering information to work.
举例来说，当远在老家的父母因为普通话说不标准或者不会说普通话而导致无法控制家中的智能家电设备时，智能家电设备就可以向与其关联的子女使用的移动终端设备和/或子女家中的智能家电设备而获得其子女的协助，从而实现对智能家电设备的控制。For example, when parents far away in their hometown cannot control the smart home appliances at home because their Mandarin is not standard or they cannot speak Mandarin, the smart home appliances can send information to the mobile terminal devices used by their associated children and/or children The smart home appliances at home get the assistance of their children, so as to realize the control of smart home appliances.
进一步的，在所述第一智能家电设备发送协助请求信息至与其关联的第二智能家电设备和/或移动终端设备步骤前，还包括：Further, before the first smart home appliance sends assistance request information to its associated second smart home appliance and/or mobile terminal device, it also includes:
所述第一智能家电设备查询本地语音指令数据库；The first smart home appliance queries a local voice command database;
在所述第一智能家电设备无法从本地语音指令数据库中匹配所述第一用户的语音指令信息时，向与其关联的第二智能家电设备和/或移动终端设备发送协助请求信息。When the first smart home appliance fails to match the voice command information of the first user from the local voice command database, send assistance request information to the second smart home appliance and/or mobile terminal device associated therewith.
第一智能家电设备上的本地语音指令数据库能够快速、方便的读取，因此，优先查询本地语音指令数据库中是否能够匹配所述第一用户的语音指令信息，而在所述第一智能家电设备无法从本地语音指令数据库中匹配所述第一用户的语音指令信息时，向与其关联的第二智能家电设备和/或移动终端设备发送协助请求信息。The local voice command database on the first smart home appliance can be read quickly and conveniently. Therefore, it is preferred to query whether the voice command information of the first user can be matched in the local voice command database, and the first smart home appliance When the voice command information of the first user cannot be matched from the local voice command database, send assistance request information to the second smart home appliance and/or mobile terminal device associated therewith.
进一步的，所述方法还包括：Further, the method also includes:
在所述第一智能家电设备无法从本地语音指令数据库中匹配所述第一用户的语音指令信息时，将所述第一用户的语音指令信息发送至云端服务器查询；When the first smart home appliance cannot match the voice command information of the first user from the local voice command database, send the voice command information of the first user to a cloud server for query;
在所述云端服务器为查询到与所述语音指令信息相对应的机器执行信息时，向与其关联的第二智能家电设备和/或移动终端设备发送协助请求信息。When the cloud server finds machine execution information corresponding to the voice instruction information, it sends assistance request information to the second smart home appliance and/or mobile terminal associated therewith.
具体的，所述第一、第二智能家电设备可以通过无线或者有线方式与云端服务器进行通信。优选的，采用WIFI无线通讯方式。Specifically, the first and second smart home appliances can communicate with the cloud server in a wireless or wired manner. Preferably, a WIFI wireless communication method is adopted.
进一步的，所述第二智能家电设备和/或移动终端设备根据所述协助请求信息生成机器执行信息步骤包括：Further, the step of generating machine execution information according to the assistance request information by the second smart home appliance and/or mobile terminal device includes:
第二智能家电设备和/或移动终端设备根据所述协助请求信息解析所述第一用户的语音控制指令信息，并根据第二用户的设置操作生成机器执行信息。The second smart home appliance and/or mobile terminal parses the first user's voice control instruction information according to the assistance request information, and generates machine execution information according to the second user's setting operation.
可以理解的，第二智能家电设备和/或移动终端设备根据所述协助请求信息解析所述第一用户的语音控制指令信息，然后再将解析出的语音控制指令信息后进行播放，第二用户根据该语音控制指令信息进行操作，比如进行与该语音指令信息相对应的语音或者手动选择设置或者键入文字等操作，从而根据第二用户的设置操作生成机器执行信息，实现为第一用户提供快速、准确的协助。It can be understood that the second smart home appliance and/or mobile terminal device parses the voice control command information of the first user according to the assistance request information, and then plays the parsed voice control command information, and the second user Operate according to the voice control instruction information, such as performing operations corresponding to the voice instruction information or manually selecting settings or typing text, so as to generate machine execution information according to the setting operation of the second user, so as to provide fast access to the first user. , accurate assistance.
此外，所述第二用户还可以对第一用户的语音控制指令信息进行检查确认，确定是否需要对该协助请求的内容进行变更调整。当该语音控制指令的内容本身超出所述第一智能家电设备的控制要求或者符合实际逻辑等，则协助将该语音控制指令调整至第一智能家电设备的控制范围内，例如，第一用户在温度超过30℃的炎热夏天时对智能空调发出“制热到20℃”的语音控制指令，显然不符合逻辑，因此第二用户可以协助将指令内容调整为制冷到20℃；而当该语音控制指令的内容符合所述第一智能家电设备的控制要求时，则直接按照该语音控制指令进行协助。In addition, the second user may also check and confirm the voice control instruction information of the first user to determine whether the content of the assistance request needs to be changed or adjusted. When the content of the voice control instruction itself exceeds the control requirements of the first smart home appliance or conforms to actual logic, etc., then assist in adjusting the voice control instruction to within the control range of the first smart home appliance. In the hot summer when the temperature exceeds 30°C, it is obviously illogical to issue the voice control command "heating to 20°C" to the smart air conditioner, so the second user can assist in adjusting the content of the command to cool to 20°C; and when the voice control When the content of the instruction meets the control requirements of the first smart home appliance, assistance is provided directly according to the voice control instruction.
进一步的，所述方法还包括：Further, the method also includes:
建立与所述第一用户的语音指令信息相对应的机器执行信息数据库，并在所述智能家电设备和/或云端服务器上进行保存。A machine execution information database corresponding to the first user's voice instruction information is established, and stored on the smart home appliance and/or cloud server.
以此，能够建立与该第一用户的语音信息相对应的机器执行信息数据库，当再一次获取到该语音指令信息时，能够直接、快速的根据该建立的数据库进行查询相应的机器执行信息，减少对第二智能家电设备和/或移动终端设备的依赖。In this way, a machine execution information database corresponding to the voice information of the first user can be established, and when the voice instruction information is obtained again, the corresponding machine execution information can be directly and quickly queried according to the established database, Reduce dependence on second smart home appliances and/or mobile terminal devices.
进一步的，在第一智能家电设备获取第一用户的语音指令信息步骤前，还包括：Further, before the first smart home appliance obtains the first user's voice command information step, it also includes:
获取所述第一用户的身份信息；Obtain the identity information of the first user;
在所述第一用户具有控制权限时获取所述第一用户的语音指令信息。Acquiring voice command information of the first user when the first user has control authority.
可以理解的，必须是具有控制权限的第一用户才能够进行智能家电设备的控制，这样可以避免不具有控制权限的小孩或者其他外人对智能家电设备进行控制操作，而且在拾取所述第一用户的语音指令信息前需要先验证用户的身份信息，避免获取不具备控制权限的用户语音指令信息而导致信息冗余浪费。It can be understood that only the first user with control authority can control the smart home appliance, which can prevent children or other outsiders who do not have control authority from controlling the smart home appliance, and when picking up the first user It is necessary to verify the identity information of the user before receiving the voice command information of the user, so as to avoid the waste of redundant information caused by obtaining the voice command information of the user who does not have the control authority.
具体的，所述第一用户的身份信息可以是在智能家电设备上设置有身份识别装置，比如指纹识别器、人脸识别器、虹膜识别器等，通过指纹识别或者人脸识别进行第一用户的身份信息确认，当然，也可以通过拾取用户的声音，从该声音中提取声纹信息从而确定用户的身份信息。Specifically, the identity information of the first user may be that an identity recognition device, such as a fingerprint reader, a face recognition device, an iris recognition device, etc., is provided on the smart home appliance, and the first user's identity information is verified through fingerprint recognition or face recognition. Of course, the identity information of the user can also be determined by picking up the user's voice and extracting the voiceprint information from the voice.
进一步的，所述第一智能家电设备发送的协助请求信息包括所述第一用户的身份信息。Further, the assistance request information sent by the first smart home appliance includes the identity information of the first user.
如此，使得第二智能家电设备和/或移动终端设备侧的第二用户在接收到协助请求信息时，能够获知请求协助的第一用户身份信息，进而进一步确定是否进行协助，或者对需要协助的内容进行变更调整，使得当第一用户的想要进行控制的智能家电设备的功能不合适或不利于该第一用户时，可以进行相应的调整，避免该不利事件的发生。例如第一用户想要某烹饪设备对某食物进行煎炸烹饪，而第二用户知道该第一用户的健康状况不适合采用煎炸的烹饪方式，因此，可以协助调整为清蒸的烹饪方式。In this way, when the second user on the side of the second smart home appliance and/or mobile terminal device receives the assistance request information, he/she can know the identity information of the first user requesting assistance, and then further determine whether to provide assistance, or provide assistance to those who need assistance. The content is changed and adjusted, so that when the function of the smart home appliance that the first user wants to control is inappropriate or unfavorable to the first user, corresponding adjustments can be made to avoid the occurrence of the adverse event. For example, the first user wants a certain cooking device to fry a certain food, but the second user knows that the first user's health condition is not suitable for fried cooking, so the second user can assist in adjusting the cooking method to steaming.
进一步的，所述第一智能家电设备关联有至少两个第二智能家电设备和/或移动终端设备，且所述第二智能家电设备和/或移动终端设备之间预设有优先等级。Further, the first smart home appliance is associated with at least two second smart home appliances and/or mobile terminal devices, and priority levels are preset between the second smart home appliances and/or mobile terminal devices.
以此避免当所述第一智能家电设备只关联有一个第二智能家电设备和/或移动终端设备而该第二智能家电设备和/或移动终端设备又无法提供协助而导致第一智能家电设备控制失败的问题。而且，所述第二智能家电设备和/或移动终端设备之间预设有优先等级，使得第一智能家电设备能够按照该预设的优先等级向第二智能家电设备和/或移动终端设备发出协助请求，保证有序进行。In this way, when the first smart home appliance is only associated with a second smart home appliance and/or mobile terminal and the second smart home appliance and/or mobile terminal cannot provide assistance, the first smart home appliance The problem of control failure. Moreover, a priority level is preset between the second smart home appliance and/or the mobile terminal device, so that the first smart home appliance can send a message to the second smart home appliance and/or mobile terminal device according to the preset priority level. Facilitate requests to ensure orderly progress.
进一步的，在预设时间内无法接收到高优先级的第二智能家电设备和/或移动终端设备应答时，向次优先级的第二智能家电设备和/或移动终端设备发送协助请求信息。Further, when a response from the second smart home appliance and/or mobile terminal device with high priority cannot be received within the preset time, the assistance request information is sent to the second smart home appliance device and/or mobile terminal device with lower priority.
可以理解的，此时，与所述第一智能家电设备关联的第二智能家电设备和/或移动终端越多，为所述第一智能家电设备提供协助的成功概率就越高。It can be understood that at this time, the more second smart home appliances and/or mobile terminals associated with the first smart home appliance, the higher the success probability of providing assistance to the first smart home appliance.
进一步的，所述智能家电设备是冰箱、烤箱、饭煲、豆浆机、炒菜机、扫地机中的一种，所述移动终端设备是手机、PAD、可穿戴设备中的一种，其中所述可穿戴设备包括但不限于智能手表、智能眼镜、智能耳机。Further, the smart home appliance is one of refrigerators, ovens, rice cookers, soybean milk machines, cooking machines, and sweepers, and the mobile terminal device is one of mobile phones, PADs, and wearable devices, wherein the Wearable devices include, but are not limited to, smart watches, smart glasses, and smart headphones.
下面结合附图2、附图3和具体应用场景举例说明一种智能冰箱和与其关联的手机语音协同控制的过程。The process of voice cooperative control of a smart refrigerator and its associated mobile phone is illustrated below with reference to accompanying drawings 2 and 3 and specific application scenarios.
所述协同控制方法的步骤为：The steps of the cooperative control method are:
步骤S100：冰箱上的图像识别模块获取第一用户的照片，控制模块将该照片与其存储模块内预设的具有控制权限的用户照片进行比对，在确认该用户具有对该冰箱的控制权限时，通过语音拾取模块获取该用户的语音指令信息；Step S100: The image recognition module on the refrigerator obtains the photo of the first user, and the control module compares the photo with the photo of the user with control authority preset in the storage module, and when it is confirmed that the user has the control authority of the refrigerator , acquiring the voice command information of the user through the voice pickup module;
步骤S200：冰箱控制模块根据所述第一用户的语音控制指令查询存储模块内的本地语音指令数据库，当本地语音指令数据库无法识别出该用户的语音指令信息时，进入步骤S300；Step S200: The refrigerator control module queries the local voice command database in the storage module according to the first user's voice control command, and when the local voice command database cannot recognize the user's voice command information, enter step S300;
步骤S300：所述冰箱通过无线通讯模块连接云端服务器，并根据所述用户的语音指令信息查询云端服务器的云端语音指令数据库，当云端语音指令数据库仍旧无法识别出该用户的语音指令信息时，启动协同控制功能，进入步骤S400；Step S300: The refrigerator is connected to the cloud server through the wireless communication module, and queries the cloud voice command database of the cloud server according to the voice command information of the user. When the voice command database of the cloud server still cannot recognize the voice command information of the user, start Coordinated control function, enter step S400;
步骤S400：所述冰箱向与其关联的最高优先等级的第一移动终端设备发送协助请求信息，所述第一移动终端设备在预设时间内无应答时，向次优先级的第二移动终端设备发送协助请求信息，并在所述第二移动终端设备做出应答时进入步骤S500；Step S400: The refrigerator sends assistance request information to the first mobile terminal device with the highest priority associated with it, and when the first mobile terminal device does not respond within a preset time, it sends assistance request information to the second mobile terminal device with the second priority Send assistance request information, and enter step S500 when the second mobile terminal device responds;
步骤S500：所述第二移动终端设备接收到该使用者根据该协助请求信息反馈的机器执行信息，并将其发送至所述冰箱，所述冰箱建立与所述第一用户的语音指令信息相对应的机器执行信息数据库，并存储于其存储模块内和/或上传云端服务器进行保存。Step S500: The second mobile terminal device receives the machine execution information fed back by the user according to the assistance request information, and sends it to the refrigerator, and the refrigerator establishes a voice command information corresponding to the first user. The corresponding machine execution information database is stored in its storage module and/or uploaded to the cloud server for preservation.
可以理解的，如图4所示，也可以是第一用户的智能冰箱与第二用户的智能冰箱关联完成上述语音协同控制的方法，其具体控制过程步骤不再赘述。It can be understood that, as shown in FIG. 4 , the smart refrigerator of the first user may also be associated with the smart refrigerator of the second user to complete the above voice cooperative control method, and the specific control process steps will not be repeated here.
此外，术语“第一”、“第二”仅用于描述的目的，而不能理解为指示或暗示相对重要性；术语“多个”则指两个或两个以上，除非另有明确的限定。术语“安装”、“相连”、“连接”、“固定”等术语均应做广义理解，例如，“连接”可以是固定连接，也可以是可拆卸连接，或一体地连接；“相连” 可以是直接相连，也可以通过中间媒介间接相连。对于本领域的普通技术人员 而言，可以根据具体情况理解上述术语在本发明中的具体含义。In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance; the term "plurality" refers to two or more, unless otherwise clearly defined . The terms "mounted", "connected", "connected", "fixed" and other terms should be interpreted in a broad sense, for example, "connected" can be fixedly connected, detachably connected, or integrally connected; "connected" can be directly or indirectly through an intermediary. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.
在本说明书的描述中，术语“一个实施例”、“一些实施例”、“具体实施例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不一定指的是相同的实施例或实例。而且，描述的具体特征、结构、材料或特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, descriptions of the terms "one embodiment", "some embodiments", "specific embodiments" and the like mean that specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in the present invention In at least one embodiment or example of . In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
在本发明中，除非另有明确的规定和限定，第一特征在第二特征“上”或“下”可以是第一和第二特征直接接触，或第一和第二特征通过中间媒介间接接触。而且，第一特征在第二特征“之上”、“上方”和“上面”可是第一特征在第二特征正上方或斜上方，或仅仅表示第一特征水平高度高于第二特征。In the present invention, unless otherwise clearly specified and limited, the first feature may be in direct contact with the first feature or the first and second feature may be in direct contact with the second feature through an intermediary. touch. Moreover, "above", "above" and "above" the first feature on the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature.
所属领域的技术人员可以清楚地了解到，为了描述的方便和间接，上述描述的系统、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。Those skilled in the art can clearly understand that for the convenience and indirectness of description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, and details are not repeated here.
应该理解到，在本申请所提供的几个实施例中，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，模块的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个模块或组件可以结合或者集成到另一个系统，或一些特征可以忽略，或不执行。It should be understood that in the several embodiments provided in this application, the disclosed systems, devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components can be combined or integrated into Another system, or some features may be ignored, or not implemented.
作为分离部件说明的模块可以是或者也可以不是物理上分开的，作为模块显示的不见可以是或者也可以不是物联模块，即可以位于一个地方，或者也可以分不到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本发明实施例方案的目的。A module described as a separate component may or may not be physically separated, and a module displayed as a module may or may not be an IoT module, that is, it may be located in one place, or it may not be divided into multiple network modules. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solutions of the embodiments of the present invention.
另外，在本发明各个实施例中的各功能模块可以集成在一个处理单元中，也可以是各个模块单独物理存在，也可以是两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, each module may exist separately physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules.
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分，或者该技术方案的全部或者部分可以以软件产品的形式体现处理，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备执行本发明各个实施例方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的戒指。If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium Among them, several instructions are included to enable a computer device to execute all or part of the steps of the methods in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk, and other rings that can store program codes.
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710102383.7ACN108510984B (en) | 2017-02-24 | 2017-02-24 | Voice cooperative control method of intelligent household electrical appliance |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710102383.7ACN108510984B (en) | 2017-02-24 | 2017-02-24 | Voice cooperative control method of intelligent household electrical appliance |
| Publication Number | Publication Date |
|---|---|
| CN108510984Atrue CN108510984A (en) | 2018-09-07 |
| CN108510984B CN108510984B (en) | 2020-10-27 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710102383.7AActiveCN108510984B (en) | 2017-02-24 | 2017-02-24 | Voice cooperative control method of intelligent household electrical appliance |
| Country | Link |
|---|---|
| CN (1) | CN108510984B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110109368A (en)* | 2019-05-21 | 2019-08-09 | 四川虹美智能科技有限公司 | A kind of intelligent appliance progress control method, apparatus and system |
| CN110246498A (en)* | 2019-07-15 | 2019-09-17 | 广东美的制冷设备有限公司 | Method of speech processing, device and household appliance |
| CN110364150A (en)* | 2019-06-25 | 2019-10-22 | 北京小米移动软件有限公司 | Speaker control method and device |
| CN110501918A (en)* | 2019-09-10 | 2019-11-26 | 百度在线网络技术（北京）有限公司 | Intelligent electrical appliance control, device, electronic equipment and storage medium |
| WO2020119437A1 (en)* | 2018-12-11 | 2020-06-18 | 青岛海尔洗衣机有限公司 | Voice control method, cloud server and terminal device |
| WO2020119438A1 (en)* | 2018-12-11 | 2020-06-18 | 青岛海尔洗衣机有限公司 | Voice control method, cloud server and terminal device |
| CN113132191A (en)* | 2019-12-31 | 2021-07-16 | 海信集团有限公司 | Voice control method of intelligent device, intelligent device and storage medium |
| CN113488038A (en)* | 2021-06-17 | 2021-10-08 | 深圳Tcl新技术有限公司 | Voice recognition method and system of intelligent device, storage medium and terminal device |
| CN113515056A (en)* | 2021-07-27 | 2021-10-19 | 华帝股份有限公司 | Function execution method and intelligent household appliance |
| CN113593547A (en)* | 2021-06-25 | 2021-11-02 | 青岛海尔科技有限公司 | Voice control method and device |
| CN113671844A (en)* | 2021-08-06 | 2021-11-19 | 深圳市欧瑞博科技股份有限公司 | Intelligent device control method and device, intelligent control device and storage medium |
| CN113870849A (en)* | 2021-08-17 | 2021-12-31 | 青岛海尔空调器有限总公司 | Information processing method, device and system |
| CN114039805A (en)* | 2021-11-03 | 2022-02-11 | 珠海格力电器股份有限公司 | Interaction method and device between devices and electronic device |
| WO2022088991A1 (en)* | 2020-10-27 | 2022-05-05 | 华为技术有限公司 | Remote assistance method and system, and electronic device and storage medium |
| CN115067803A (en)* | 2021-03-11 | 2022-09-20 | 云米互联科技(广东)有限公司 | Control method of sweeper, control system and storage medium |
| CN116600172A (en)* | 2023-03-30 | 2023-08-15 | 海尔优家智能科技（北京）有限公司 | Video playing method, device, storage medium and electronic device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090282371A1 (en)* | 2008-05-07 | 2009-11-12 | Carrot Medical Llc | Integration system for medical instruments with remote control |
| CN105761719A (en)* | 2016-04-12 | 2016-07-13 | 九阳股份有限公司 | Kitchen electric appliance having voice control function and control method |
| CN105807903A (en)* | 2014-12-30 | 2016-07-27 | Tcl集团股份有限公司 | Control method and device of intelligent equipment |
| CN106254462A (en)* | 2016-08-05 | 2016-12-21 | 北京奇虎科技有限公司 | Method, server and the system of a kind of remote assistance realizing mobile terminal |
| CN106292321A (en)* | 2016-08-30 | 2017-01-04 | 无锡小天鹅股份有限公司 | Washing machine and control method thereof and control system |
| CN107786602A (en)* | 2016-08-30 | 2018-03-09 | 九阳股份有限公司 | A kind of Synergistic method of intelligent cooking equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090282371A1 (en)* | 2008-05-07 | 2009-11-12 | Carrot Medical Llc | Integration system for medical instruments with remote control |
| CN105807903A (en)* | 2014-12-30 | 2016-07-27 | Tcl集团股份有限公司 | Control method and device of intelligent equipment |
| CN105761719A (en)* | 2016-04-12 | 2016-07-13 | 九阳股份有限公司 | Kitchen electric appliance having voice control function and control method |
| CN106254462A (en)* | 2016-08-05 | 2016-12-21 | 北京奇虎科技有限公司 | Method, server and the system of a kind of remote assistance realizing mobile terminal |
| CN106292321A (en)* | 2016-08-30 | 2017-01-04 | 无锡小天鹅股份有限公司 | Washing machine and control method thereof and control system |
| CN107786602A (en)* | 2016-08-30 | 2018-03-09 | 九阳股份有限公司 | A kind of Synergistic method of intelligent cooking equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020119437A1 (en)* | 2018-12-11 | 2020-06-18 | 青岛海尔洗衣机有限公司 | Voice control method, cloud server and terminal device |
| US11967320B2 (en) | 2018-12-11 | 2024-04-23 | Qingdao Haier Washing Machine Co., Ltd. | Processing voice information with a terminal device and a cloud server to control an operation |
| US11705129B2 (en) | 2018-12-11 | 2023-07-18 | Qingdao Haier Washing Machine Co., Ltd. | Voice control method, cloud server and terminal device |
| WO2020119438A1 (en)* | 2018-12-11 | 2020-06-18 | 青岛海尔洗衣机有限公司 | Voice control method, cloud server and terminal device |
| CN110109368B (en)* | 2019-05-21 | 2022-08-02 | 四川虹美智能科技有限公司 | Intelligent household appliance operation control method, device and system |
| CN110109368A (en)* | 2019-05-21 | 2019-08-09 | 四川虹美智能科技有限公司 | A kind of intelligent appliance progress control method, apparatus and system |
| CN110364150A (en)* | 2019-06-25 | 2019-10-22 | 北京小米移动软件有限公司 | Speaker control method and device |
| CN110246498B (en)* | 2019-07-15 | 2021-04-20 | 广东美的制冷设备有限公司 | Voice processing method and device and household appliance |
| CN110246498A (en)* | 2019-07-15 | 2019-09-17 | 广东美的制冷设备有限公司 | Method of speech processing, device and household appliance |
| CN110501918B (en)* | 2019-09-10 | 2022-10-11 | 百度在线网络技术（北京）有限公司 | Intelligent household appliance control method and device, electronic equipment and storage medium |
| CN110501918A (en)* | 2019-09-10 | 2019-11-26 | 百度在线网络技术（北京）有限公司 | Intelligent electrical appliance control, device, electronic equipment and storage medium |
| CN113132191A (en)* | 2019-12-31 | 2021-07-16 | 海信集团有限公司 | Voice control method of intelligent device, intelligent device and storage medium |
| WO2022088991A1 (en)* | 2020-10-27 | 2022-05-05 | 华为技术有限公司 | Remote assistance method and system, and electronic device and storage medium |
| CN115067803B (en)* | 2021-03-11 | 2023-12-12 | 云米互联科技(广东)有限公司 | Control method of sweeper, control system and storage medium |
| CN115067803A (en)* | 2021-03-11 | 2022-09-20 | 云米互联科技(广东)有限公司 | Control method of sweeper, control system and storage medium |
| CN113488038A (en)* | 2021-06-17 | 2021-10-08 | 深圳Tcl新技术有限公司 | Voice recognition method and system of intelligent device, storage medium and terminal device |
| CN113593547A (en)* | 2021-06-25 | 2021-11-02 | 青岛海尔科技有限公司 | Voice control method and device |
| CN113515056A (en)* | 2021-07-27 | 2021-10-19 | 华帝股份有限公司 | Function execution method and intelligent household appliance |
| CN113671844A (en)* | 2021-08-06 | 2021-11-19 | 深圳市欧瑞博科技股份有限公司 | Intelligent device control method and device, intelligent control device and storage medium |
| CN113870849A (en)* | 2021-08-17 | 2021-12-31 | 青岛海尔空调器有限总公司 | Information processing method, device and system |
| CN114039805A (en)* | 2021-11-03 | 2022-02-11 | 珠海格力电器股份有限公司 | Interaction method and device between devices and electronic device |
| CN116600172A (en)* | 2023-03-30 | 2023-08-15 | 海尔优家智能科技（北京）有限公司 | Video playing method, device, storage medium and electronic device |
| Publication number | Publication date |
|---|---|
| CN108510984B (en) | 2020-10-27 |
| Publication | Publication Date | Title |
|---|---|---|
| CN108510984A (en) | A kind of voice cooperative control method of intelligent appliance equipment | |
| US11824677B2 (en) | Smart home device control method, medium, mobile terminal and apparatus | |
| EP3305140B1 (en) | Cooking appliance, and cooking control method and device thereof | |
| WO2016065813A1 (en) | Method and apparatus for customising smart device scenario mode | |
| WO2016065812A1 (en) | Scenario mode setting-based smart device control method and apparatus | |
| WO2016065825A1 (en) | Method and apparatus for recommending scenario mode for smart device | |
| CN107465584A (en) | Method for network access and device, the intelligent appliance of intelligent appliance | |
| WO2020199673A1 (en) | Method and device for controlling household appliance, and household appliance | |
| EP3476259A1 (en) | Method and apparatus for controlling cooking appliance, cooking appliance and control device | |
| WO2020168571A1 (en) | Device control method, apparatus, system, electronic device and cloud server | |
| CN204903991U (en) | Cooking utensil control system of adaptable different height above sea level | |
| JP7440211B2 (en) | Information output method, information output device and program | |
| CN113485134A (en) | Device control method and apparatus, storage medium, and electronic device | |
| WO2018072490A1 (en) | Method and apparatus for controlling smart home appliance, and storage medium | |
| WO2018163022A1 (en) | Cooker hood and household interconnection control method based on cooker hood | |
| WO2020259346A1 (en) | Ultrasonic device control method, mobile terminal and control system | |
| AU2019302632B2 (en) | Method for operating a cooking appliance | |
| CN112369122B (en) | Methods for operating cooking utensils | |
| CN113251588A (en) | Automatic air conditioner control method and system and air conditioner | |
| CN104536299A (en) | Household appliance starting method, device and system and central control equipment | |
| WO2022247373A1 (en) | Method and apparatus for controlling home appliance, and appliance | |
| CN108415293B (en) | Cooking control method and device for cooking | |
| CN114216228B (en) | Control method, control system, electronic device and storage medium of air conditioner | |
| CN114216235B (en) | Control methods, control systems, electronic devices and storage media for air conditioning interconnection | |
| WO2023024813A1 (en) | Control method, apparatus and device for household appliance |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | Effective date of registration:20250507 Address after:No. 999, Mei Li Road, Huaiyin District, Ji'nan, Shandong Patentee after:Shandong Jiuchuang Home Appliance Co.,Ltd. Country or region after:China Address before:No. 999, Mei Li Road, Huaiyin District, Ji'nan, Shandong Patentee before:JOYOUNG Co.,Ltd. Country or region before:China | |
| TR01 | Transfer of patent right |