CN109618202B - Method for controlling peripheral device, television and readable storage medium - Google Patents
Method for controlling peripheral device, television and readable storage mediumDownload PDFInfo
- Publication number
- CN109618202B CN109618202BCN201811586659.4ACN201811586659ACN109618202BCN 109618202 BCN109618202 BCN 109618202BCN 201811586659 ACN201811586659 ACN 201811586659ACN 109618202 BCN109618202 BCN 109618202B
- Authority
- CN
- China
- Prior art keywords
- control instruction
- controlled
- information
- voice
- voice information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4108—Peripherals receiving signals from specially adapted client devices characterised by an identification number or address, e.g. local network address
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42225—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details characterized by types of remote control, e.g. universal remote control
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
- H04N21/42684—Client identification by a unique number or address, e.g. serial number, MAC address, socket ID
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- General Engineering & Computer Science (AREA)
- Power Engineering (AREA)
- Telephonic Communication Services (AREA)
- Selective Calling Equipment (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明涉及电视技术领域，尤其涉及控制外设的方法、电视及可读存储介质。The present invention relates to the technical field of televisions, and in particular, to a method for controlling peripheral devices, a television and a readable storage medium.
背景技术Background technique
近年来，物联网技术飞速发展，其应用范围已经涉及到电子、通信、软件等多个行业，作为未来家居生活物联化的体现，智能家居发展也备受瞩目，发展速度日新月异。电视作为未来家居生活中客厅的主角，承载着客厅大屏娱乐生活的智能性和趣味性，是智能家居生态系统中不可或缺的一环。In recent years, the Internet of Things technology has developed rapidly, and its application scope has involved many industries such as electronics, communications, software, etc. As the embodiment of the Internet of Things in the future home life, the development of smart home has also attracted much attention, and the development speed is changing with each passing day. As the protagonist of the living room in the future home life, the TV carries the intelligence and fun of the large-screen entertainment life in the living room, and is an indispensable part of the smart home ecosystem.
然而，现有的电视通常只有播放电视节目及连接网络的功能，功能较为单一。However, the existing TV usually only has the functions of playing TV programs and connecting to the network, and the functions are relatively single.
发明内容SUMMARY OF THE INVENTION
本发明的主要目的在于提供一种控制外设的方法、电视及可读存储介质，旨在解决现有技术中电视功能较为单一的技术问题。The main purpose of the present invention is to provide a method for controlling peripheral devices, a TV and a readable storage medium, which aims to solve the technical problem that the TV function is relatively single in the prior art.
为实现上述目的，本发明提供一种控制外设的方法，应用于电视，所述控制外设的方法包括以下步骤：In order to achieve the above object, the present invention provides a method for controlling peripheral devices, which is applied to a TV, and the method for controlling peripheral devices includes the following steps:
在所述电视处于开机或待机状态时，接收语音信息；Receive voice information when the TV is in a power-on or standby state;
基于所述语音信息生成控制指令；generating a control instruction based on the voice information;
将所述控制指令通过物联网IOT平台发送至待控设备对应的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器；Sending the control instruction to the shadow device corresponding to the device to be controlled through the Internet of Things IOT platform, so that the shadow device synchronizes the control instruction to the controller of the device to be controlled;
通过所述控制器做出与所述控制指令对应的响应动作。A response action corresponding to the control instruction is made by the controller.
优选地，所述控制指令为第一控制指令；所述基于所述语音信息生成控制指令的步骤包括：Preferably, the control instruction is a first control instruction; the step of generating a control instruction based on the voice information includes:
判断所述语音信息是否为已解析信息；Determine whether the voice information is parsed information;
若否，则将所述语音信息解析为用户意图；If not, parse the voice information into user intent;
在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令。When it is determined that the user intention has the first authorization information, the user intention is converted into a first control instruction.
优选地，所述将所述语音信息解析为用户意图的步骤包括：Preferably, the step of parsing the voice information into user intent includes:
将所述语音信息解析为对应的语音文本；Parsing the voice information into corresponding voice text;
将所述语音文本转化为对应的用户意图。Convert the speech text into corresponding user intent.
优选地，所述在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令的步骤之前，所述控制外设的方法还包括：Preferably, before the step of converting the user intention into a first control instruction when it is determined that the user intention has the first authorization information, the method for controlling a peripheral device further includes:
判断所述用户意图是否存在第一授权信息，其中，若是，则将所述用户意图转化为第一控制指令；Determine whether there is first authorization information in the user intent, wherein, if so, convert the user intent into a first control instruction;
若否，则在接收到第一账号信息时进行授权验证操作，在所述第一账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤。If not, an authorization verification operation is performed when the first account information is received, and the step of determining whether the voice information is parsed information is returned to after the first account information is successfully authorized.
优选地，所述判断所述语音信息是否为已解析信息的步骤之后，所述控制外设的方法还包括：Preferably, after the step of judging whether the voice information is parsed information, the method for controlling peripherals further includes:
若判定所述语音信息为已解析信息，则判断所述语音信息是否存在第二授权信息；If it is determined that the voice information is parsed information, then determine whether there is second authorization information in the voice information;
若判定所述语音信息存在第二授权信息，则将所述语音信息转化为第二控制指令；If it is determined that there is second authorization information in the voice information, converting the voice information into a second control instruction;
若判定所述语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，在所述第二账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤。If it is determined that there is no second authorization information in the voice information, an authorization verification operation is performed when the second account information is received, and the process of determining whether the voice information is parsed is returned after the second account information is successfully authorized. information steps.
优选地，所述控制指令为第一控制指令或第二控制指令；所述将所述控制指令通过物联网IOT平台发送至待控设备的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器的步骤包括：Preferably, the control instruction is a first control instruction or a second control instruction; the control instruction is sent to the shadow device of the device to be controlled through the Internet of Things IOT platform, so that the shadow device can send the control instruction to the shadow device. The steps of synchronizing to the controller of the device to be controlled include:
基于所述第一授权信息或第二授权信息获取所述待控设备的ID；Obtain the ID of the device to be controlled based on the first authorization information or the second authorization information;
将所述第一控制指令搭配ID或第二控制指令搭配ID通过物联网IOT平台发送至消息管理中心，其中，所述消息管理中心包括多个影子设备，且每个影子设备对应一个待控设备；Send the first control instruction with ID or the second control instruction with ID to the message management center through the Internet of Things IOT platform, wherein the message management center includes a plurality of shadow devices, and each shadow device corresponds to a device to be controlled ;
通过所述影子设备与所述待控设备订阅同一个消息队列，且通过所述消息队列进行状态同步；Subscribing to the same message queue through the shadow device and the device to be controlled, and performing state synchronization through the message queue;
通过所述消息队列将所述控制指令同步至所述待控设备的控制器。The control instruction is synchronized to the controller of the device to be controlled through the message queue.
优选地，所述通过所述影子设备与所述待控设备订阅同一个消息队列的步骤之前，所述控制外设的方法还包括：Preferably, before the step of subscribing to the same message queue through the shadow device and the device to be controlled, the method for controlling peripherals further includes:
将所述第一控制指令或第二控制指令转换为机器指令集；converting the first control instruction or the second control instruction into a machine instruction set;
基于所述机器指令集查找设备列表；looking up a device list based on the machine instruction set;
在查找到所述ID对应的第一待控设备时，获取所述第一待控设备对应的影子设备，并执行所述通过所述影子设备与所述待控设备订阅同一个消息队列的步骤。When the first device to be controlled corresponding to the ID is found, obtain the shadow device corresponding to the first device to be controlled, and execute the step of subscribing to the same message queue through the shadow device and the device to be controlled .
优选地，所述在所述电视处于开机或待机状态时，接收语音信息的步骤包括：Preferably, the step of receiving voice information when the TV is in a power-on or standby state includes:
在接收到语音信息时，判断所述电视是否处于开机状态；When receiving the voice information, determine whether the TV is in a power-on state;
若否，则唤醒所述物联网IOT平台接收所述语音信息后，执行所述基于所述语音信息生成控制指令的步骤；If not, wake up the IoT platform to receive the voice information, and execute the step of generating a control command based on the voice information;
若是，则执行所述基于所述语音信息生成控制指令的步骤。If yes, execute the step of generating a control instruction based on the voice information.
此外，为实现上述目的，本发明还提供一种电视，所述电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的控制外设的程序，所述控制外设的程序被所述处理器执行时实现上述中任一项所述的控制外设的方法的步骤。In addition, in order to achieve the above object, the present invention also provides a television, which includes: a memory, a processor, and a program for controlling peripherals stored in the memory and running on the processor, the control When the program of the peripheral is executed by the processor, the steps of any one of the above-mentioned methods for controlling the peripheral are implemented.
此外，为实现上述目的，本发明还提供一种可读存储介质，所述可读存储介质上存储有控制外设的程序，所述控制外设的程序被处理器执行时实现上述中任一项所述的控制外设的方法的步骤。In addition, in order to achieve the above object, the present invention also provides a readable storage medium, on which a program for controlling peripheral devices is stored, and when the program for controlling peripheral devices is executed by a processor, any one of the above-mentioned programs is realized. The steps of the method for controlling a peripheral device described in item.
本发明中，在电视处于开机或待机状态时接收语音信息，将基于语音信息生成控制指令，实现电视在开机或待机时的语音接收及控制指令生成；将控制指令通过物联网IOT平台发送至待控设备的影子设备，且通过影子设备与待控设备的控制器同步，实现控制指令通过影子设备控制待控设备，从而实现待控设备对控制指令的响应。本发明实现电视在开机或开机情况下接收语音生成控制指令，且待控设备做出响应的功能，满足用户不同情景下的控制需求，同时，使待控设备能够跨平台进行控制，使待控设备的响应不再受到平台的限制，影子设备同步状态的方法，可以避免由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备状态负载过大的问题，极大的提高了多平台同时请求设备状态的响应效率问题，能够更好的适应跨平台及高并发的设备处理需求。In the present invention, the voice information is received when the TV is in the on or standby state, and the control command is generated based on the voice information, so as to realize the voice reception and the generation of the control command when the TV is on or in the standby state; the control command is sent to the waiting state through the Internet of Things IOT platform. The shadow device of the control device is synchronized with the controller of the device to be controlled through the shadow device, so that the control command controls the device to be controlled through the shadow device, thereby realizing the response of the device to be controlled to the control command. The invention realizes the function that the TV receives the voice to generate the control command when the TV is turned on or on, and the device to be controlled responds, so as to meet the control requirements of the user in different scenarios, and at the same time, the device to be controlled can be controlled across platforms, so that the device to be controlled can be controlled across platforms. The response of the device is no longer limited by the platform. The method of synchronizing the state of the shadow device can avoid the problem that the device state cannot be synchronized due to the unstable network and the excessive load of the device state requested by multiple applications, which greatly improves the multi-platform state. At the same time, the response efficiency of requesting device status can better adapt to cross-platform and high-concurrency device processing requirements.
附图说明Description of drawings
图1为本发明实施例方案涉及的电视硬件结构示意图；1 is a schematic diagram of a TV hardware structure involved in an embodiment of the present invention;
图2为本发明控制外设的方法第一实施例的流程示意图；FIG. 2 is a schematic flowchart of a first embodiment of a method for controlling peripherals according to the present invention;
图3为本发明控制外设的方法第二实施例的流程示意图；3 is a schematic flowchart of a second embodiment of a method for controlling peripherals according to the present invention;
图4为本发明控制外设的方法第三实施例的流程示意图。FIG. 4 is a schematic flowchart of a third embodiment of a method for controlling a peripheral device according to the present invention.
本发明目的实现、功能特点及优点将结合实施例，参照附图做进一步说明。The object realization, functional features and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments.
具体实施方式Detailed ways
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
如图1所示，图1是本发明实施例方案涉及的硬件运行环境的电视结构示意图。As shown in FIG. 1 , FIG. 1 is a schematic diagram of a TV structure of a hardware operating environment involved in an embodiment of the present invention.
如图1所示，该电视可以包括：处理器1001，例如CPU，网络接口1004，用户接口1003，存储器1005，通信总线1002。其中，通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard)，可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器，也可以是稳定的存储器(non-volatile memory)，例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1 , the television may include: a
可选地，电视还可以包括摄像头、RF(Radio Frequency，射频)电路，传感器、音频电路、WiFi模块等等。当然，电视还可配置陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。Optionally, the TV may further include a camera, an RF (Radio Frequency, radio frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. Of course, the TV can also be equipped with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which will not be repeated here.
本领域技术人员可以理解，图1中示出的电视结构并不构成对电视的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。Those skilled in the art can understand that the TV structure shown in FIG. 1 does not constitute a limitation on the TV, and may include more or less components than the one shown, or combine some components, or arrange different components.
如图1所示，作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及控制外设的程序。As shown in FIG. 1 , the
在图1所示的电视中，网络接口1004主要用于连接后台服务器，与后台服务器进行数据通信；用户接口1003主要用于连接客户端(用户端)，与客户端进行数据通信；而处理器1001可以用于调用存储器1005中存储的控制外设的程序，并执行以下操作：In the TV shown in FIG. 1 , the
在所述电视处于开机或待机状态时，接收语音信息；Receive voice information when the TV is in a power-on or standby state;
基于所述语音信息生成控制指令；generating a control instruction based on the voice information;
将所述控制指令通过物联网IOT平台发送至待控设备对应的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器；Sending the control instruction to the shadow device corresponding to the device to be controlled through the Internet of Things IOT platform, so that the shadow device synchronizes the control instruction to the controller of the device to be controlled;
通过所述控制器做出与所述控制指令对应的响应动作。A response action corresponding to the control instruction is made by the controller.
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：Further, the
判断所述语音信息是否为已解析信息；Determine whether the voice information is parsed information;
若否，则将所述语音信息解析为用户意图；If not, parse the voice information into user intent;
在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令。When it is determined that the user intention has the first authorization information, the user intention is converted into a first control instruction.
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：Further, the
将所述语音信息解析为对应的语音文本；Parsing the voice information into corresponding voice text;
将所述语音文本转化为对应的用户意图。Convert the speech text into corresponding user intent.
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：Further, the
判断所述用户意图是否存在第一授权信息；judging whether there is first authorization information in the user intent;
若否，则在接收到第一账号信息时进行授权验证操作，在所述第一账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤；If not, perform an authorization verification operation when receiving the first account information, and return to execute the step of judging whether the voice information is parsed information after the first account information is successfully authorized;
若是，则将所述用户意图转化为第一控制指令。If so, convert the user intent into a first control instruction.
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：Further, the
若判定所述语音信息为已解析信息，则判断所述语音信息是否存在第二授权信息；If it is determined that the voice information is parsed information, then determine whether there is second authorization information in the voice information;
若判定所述语音信息存在第二授权信息，则将所述语音信息转化为第二控制指令；If it is determined that there is second authorization information in the voice information, converting the voice information into a second control instruction;
若判定所述语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，在所述第二账号信息授权成功后返回执行所述判断所述语音信息是否为已解析信息的步骤。If it is determined that there is no second authorization information in the voice information, an authorization verification operation is performed when the second account information is received, and the process of determining whether the voice information is parsed is returned after the second account information is successfully authorized. information steps.
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：Further, the
基于所述第一授权信息或第二授权信息获取所述待控设备的ID；Obtain the ID of the device to be controlled based on the first authorization information or the second authorization information;
将所述第一控制指令搭配ID或第二控制指令搭配ID通过物联网IOT平台发送至消息管理中心，其中，所述消息管理中心包括多个影子设备，且每个影子设备对应一个待控设备；Send the first control instruction with ID or the second control instruction with ID to the message management center through the Internet of Things IOT platform, wherein the message management center includes a plurality of shadow devices, and each shadow device corresponds to a device to be controlled ;
通过所述影子设备与所述待控设备订阅同一个消息队列，且通过所述消息队列进行状态同步；Subscribing to the same message queue through the shadow device and the device to be controlled, and performing state synchronization through the message queue;
通过所述消息队列将所述控制指令同步至所述待控设备的控制器。The control instruction is synchronized to the controller of the device to be controlled through the message queue.
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：Further, the
将所述第一控制指令或第二控制指令转换为机器指令集；converting the first control instruction or the second control instruction into a machine instruction set;
基于所述机器指令集查找设备列表；looking up a device list based on the machine instruction set;
在查找到所述ID对应的第一待控设备时，获取所述第一待控设备对应的影子设备，并执行所述通过所述影子设备与所述待控设备订阅同一个消息队列的步骤。When the first device to be controlled corresponding to the ID is found, obtain the shadow device corresponding to the first device to be controlled, and execute the step of subscribing to the same message queue through the shadow device and the device to be controlled .
进一步地，处理器1001可以调用存储器1005中存储的控制外设的程序，还执行以下操作：Further, the
在接收到语音信息时，判断所述电视是否处于开机状态；When receiving the voice information, determine whether the TV is in a power-on state;
若否，则唤醒所述物联网IOT平台接收所述语音信息后，执行所述基于所述语音信息生成控制指令的步骤；If not, wake up the IoT platform to receive the voice information, and execute the step of generating a control command based on the voice information;
若是，则执行所述基于所述语音信息生成控制指令的步骤。If yes, execute the step of generating a control instruction based on the voice information.
参照图2，图2为本发明控制外设的方法第一实施例的流程示意图，在第一实施例中，控制外设的方法包括：Referring to FIG. 2, FIG. 2 is a schematic flowchart of a first embodiment of a method for controlling peripherals according to the present invention. In the first embodiment, the method for controlling peripherals includes:
步骤S10，在所述电视处于开机或待机状态时，接收语音信息。Step S10, when the TV is in a power-on or standby state, receive voice information.
本实施例中，用户在使用电视时，通过遥控器的近场语音功能或者电视自带的远场语音功能说出想要实现的操作，用户的语音通过遥控器或者电视上的麦克风阵列上传到电视中。首先，会对电视是否开机进行判断，在判定电视处于开机状态时，则电视端的物联网IOT平台会迅速进行响应，将基于语音信息生成控制指令；若电视处于待机状态，首先需要唤醒电视的语音识别功能，即唤醒电视的物联网IOT平台，从而保证电视在待机状态下仍然能完成物联网IOT平台服务相应的功能。In this embodiment, when using the TV, the user speaks the desired operation through the near-field voice function of the remote control or the far-field voice function of the TV, and the user's voice is uploaded to the remote control or the microphone array on the TV. on TV. First, it will judge whether the TV is turned on. When it is judged that the TV is turned on, the IoT platform on the TV side will respond quickly and generate control commands based on the voice information; if the TV is in the standby state, the voice of the TV needs to be woken up first. The identification function is to wake up the Internet of Things IOT platform of the TV, so as to ensure that the TV can still complete the corresponding functions of the Internet of Things IOT platform service in the standby state.
步骤S20，基于所述语音信息生成控制指令。Step S20, generating a control instruction based on the voice information.
本实施例中，不管是开机状态还是待机状态，在接收到语音信息时，会将语音信息生成控制指令，具体为：用户的语音信息上传到电视的语音解析平台，语音解析平台判断所述语音信息是否被解析过，如果没被解析过，则开始进行语音解析，将语音解析为用户意图，再判断用户意图是否存在第一授权信息，如果存在，则将用户意图转化为第一控制指令。In this embodiment, regardless of the power-on state or the standby state, when voice information is received, a control command is generated from the voice information, specifically: uploading the user's voice information to the voice analysis platform of the TV, and the voice analysis platform judges the voice Whether the information has been parsed, if not, start voice parsing, parse the voice into user intent, and then determine whether the user intent has first authorization information, and if so, convert the user intent into a first control command.
由于智能家居中待控设备有很多，如电视、空调、洗衣机等，因此，需要对语音信息进行解析，如果语音信息被解析过，说明该语音信息作为控制指令控制过对应的待控设备，如用户从未通过语音打开过空调，那么，在接收到“打开空调”的语音信息时，可判定该语音信息为未解析语音，此时，将该语音信息解析为用户意图，并且，判断该用户意图是否存在第一授权信息，即空调是否被授权到智能家居系统中，若是，则将该语音信息“打开空调”转化为第一控制指令。Since there are many devices to be controlled in a smart home, such as TVs, air conditioners, washing machines, etc., it is necessary to parse the voice information. If the voice information has been parsed, it means that the voice information has been used as a control command to control the corresponding device to be controlled, such as If the user has never turned on the air conditioner through voice, then when receiving the voice information of "turn on the air conditioner", it can be determined that the voice information is unparsed voice. At this time, the voice information is parsed into the user's intention, and the user Whether the intention exists the first authorization information, that is, whether the air conditioner is authorized to the smart home system, and if so, convert the voice information "turn on the air conditioner" into the first control command.
通过判断语音信息是否为已解析信息，若否，在判定用户意图存在第一授权信息时，才将用户意图转化为第一控制指令，实现了对语音信息的验证，在验证成功时，实现对待控设备的可控性。By judging whether the voice information is parsed information, if not, when it is determined that the user's intention has the first authorization information, the user's intention is converted into the first control command, which realizes the verification of the voice information, and when the verification is successful, the treatment is realized. controllability of equipment.
步骤S30，将所述控制指令通过物联网IOT平台发送至待控设备对应的影子设备，以供所述影子设备将所述控制指令同步至所述待控设备的控制器。Step S30, sending the control instruction to the shadow device corresponding to the device to be controlled through the Internet of Things IOT platform, so that the shadow device can synchronize the control instruction to the controller of the device to be controlled.
本实施例中，在控制指令生成后，通过物联网IOT平台发送至待控设备对应的影子设备，以供影子设备将控制指令同步至待控设备的控制器。In this embodiment, after the control command is generated, it is sent to the shadow device corresponding to the device to be controlled through the IoT platform, so that the shadow device can synchronize the control command to the controller of the device to be controlled.
IOT(Internet of things，物联网)是新一代信息技术的重要组成部分，也是“信息化”时代的重要发展阶段，物联网就是物物相连的互联网。这有两层意思：其一，物联网的核心和基础仍然是互联网，是在互联网基础上的延伸和扩展的网络；其二，其用户端延伸和扩展到了任何物品与物品之间，进行信息交换和通信，也就是物物相息。物联网通过智能感知、识别技术与普适计算等通信感知技术，广泛应用于网络的融合中，也因此被称为继计算机、互联网之后世界信息产业发展的第三次浪潮。IOT (Internet of things, Internet of Things) is an important part of the new generation of information technology, and it is also an important development stage in the "informationization" era. The Internet of Things is the Internet of things connected. This has two meanings: First, the core and foundation of the Internet of Things is still the Internet, which is an extended and expanded network based on the Internet; Exchange and communication, that is, things go hand in hand. The Internet of Things is widely used in the integration of networks through communication perception technologies such as intelligent perception, identification technology and ubiquitous computing.
本案的物联网IOT平台，将智能家居中的如空调、洗衣机、冰箱、电视机等家用电器通过网络的形式连接起来。The Internet of Things (IoT) platform in this case connects household appliances such as air conditioners, washing machines, refrigerators, TVs and other household appliances in the smart home through the network.
影子设备，即影子系统(PowerShadow)构建现有操作系统的虚拟影像，即影子模式(shadow mode)，它和真实的系统完全一样，用户可随时选择启用或者退出这个虚拟影像。用户进入影子模式(shadow mode)后，所有操作都是虚拟的，不会对真正的系统产生影响，一切改变将在退出Shadow模式后消失。The shadow device, that is, the shadow system (PowerShadow) builds a virtual image of the existing operating system, that is, the shadow mode (shadow mode), which is exactly the same as the real system, and the user can choose to enable or disable this virtual image at any time. After the user enters the shadow mode (shadow mode), all operations are virtual and will not affect the real system, and all changes will disappear after exiting the shadow mode.
本案的影子设备，其实是模拟待控设备的一款软件，一个物联网IOT平台内设有多个影子设备，每一个影子设备都对应一个待控设备的标识符，如ID，由于影子设备与对应的待控设备是同步进行的，因此，物联网IOT平台通过影子设备就能控制对应的待控设备。The shadow device in this case is actually a piece of software that simulates the device to be controlled. There are multiple shadow devices in an IoT platform, and each shadow device corresponds to an identifier of the device to be controlled, such as an ID. The corresponding devices to be controlled are synchronized. Therefore, the IoT platform can control the corresponding devices to be controlled through the shadow device.
步骤S40，通过所述控制器做出与所述控制指令对应的响应动作。Step S40, the controller makes a response action corresponding to the control instruction.
本实施例中，由于物联网IOT平台通过影子设备控制对应的待控设备，即控制待控设备的控制器MCU，物联网IOT平台在接收到控制指令后，通过对应的影子设备同步给对应的待控设备的控制器，使得控制器做出与控制指令对应的响应动作。In this embodiment, since the Internet of Things IOT platform controls the corresponding device to be controlled through the shadow device, that is, the controller MCU that controls the device to be controlled, after receiving the control command, the Internet of Things IOT platform synchronizes to the corresponding device through the corresponding shadow device. The controller of the device to be controlled makes the controller make a response action corresponding to the control instruction.
如控制指令为“打开空调”，物联网IOT平台在接收到“打开空调”的控制指令时，通过与空调对应的影子设备同步该指令给空调的控制器，此时，空调的控制器执行打开的动作。If the control command is "turn on the air conditioner", when the IoT platform receives the control command of "turn on the air conditioner", it synchronizes the command to the controller of the air conditioner through the shadow device corresponding to the air conditioner. At this time, the controller of the air conditioner executes the opening operation. Actions.
本案包括三个平台，分别为待控设备(包括电视端自身、空调、洗衣机等家电)的硬件设备平台、物联网IOT平台以及后台服务器管理平台，三个平台的配合可以满足用户不同情景下的控制需要。同时使设备可以跨平台进行控制，比如，物联网IOT平台通过影子设备控制待控设备的控制器，实现跨平台控制；使设备的响应不再受到平台的限制，大大提高了方案的适用性。影子设备同步状态的方法，可以避免由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备状态负载过大的问题，极大的提高了多平台同时请求设备状态的响应效率问题，如待控设备的硬件设备平台、物联网IOT平台以及后台服务器管理平台三个平台之间同时请求一些状态时不会影响响应效率，能够更好的适应跨平台及高并发的设备处理需求。This case includes three platforms, namely the hardware equipment platform of the equipment to be controlled (including the TV itself, air conditioners, washing machines and other home appliances), the Internet of Things IOT platform and the background server management platform. The cooperation of the three platforms can meet the needs of users in different scenarios. Control needs. At the same time, the device can be controlled across platforms. For example, the IoT platform controls the controller of the device to be controlled through the shadow device to achieve cross-platform control; the response of the device is no longer limited by the platform, which greatly improves the applicability of the solution. The method of synchronizing the state of the shadow device can avoid the problem that the device state cannot be synchronized due to the unstable network and the overload of multi-application requesting the device state, which greatly improves the response efficiency of multiple platforms requesting the device state at the same time, such as The hardware device platform of the device to be controlled, the IoT platform of the Internet of Things, and the background server management platform will not affect the response efficiency when some states are requested at the same time, and can better adapt to the cross-platform and high-concurrency device processing requirements.
本发明在接收到语音信息时，将基于语音信息生成控制指令，实现电视在开机或待机时的语音接收及控制指令生成；将控制指令通过物联网IOT平台发送至待控设备的影子设备，且通过影子设备与待控设备的控制器同步，实现控制指令通过影子设备控制待控设备，从而实现待控设备对控制指令的响应。本发明实现电视在开机或开机情况下接收语音生成控制指令，且待控设备做出响应的功能，满足用户不同情景下的控制需求，同时，使待控设备能够跨平台进行控制，使待控设备的响应不再受到平台的限制，影子设备同步状态的方法，可以避免由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备状态负载过大的问题，极大的提高了多平台同时请求设备状态的响应效率问题，能够更好的适应跨平台及高并发的设备处理需求。When the present invention receives the voice information, it will generate the control command based on the voice information to realize the voice reception and control command generation when the TV is turned on or in standby; the control command is sent to the shadow device of the device to be controlled through the Internet of Things IOT platform, and By synchronizing the shadow device with the controller of the device to be controlled, the control command can control the device to be controlled through the shadow device, thereby realizing the response of the device to be controlled to the control command. The invention realizes the function that the TV receives the voice to generate the control command when the TV is turned on or on, and the device to be controlled responds, so as to meet the control requirements of the user in different scenarios, and at the same time, the device to be controlled can be controlled across platforms, so that the device to be controlled can be controlled across platforms. The response of the device is no longer limited by the platform. The method of synchronizing the state of the shadow device can avoid the problem that the device state cannot be synchronized due to the unstable network and the excessive load of the device state requested by multiple applications, which greatly improves the multi-platform state. At the same time, the response efficiency of requesting device status can better adapt to cross-platform and high-concurrency device processing requirements.
基于第一实施例，本发明还提出控制外设的方法的第二实施例，如图3所示，所述控制指令为第一控制指令；步骤S20包括：Based on the first embodiment, the present invention also proposes a second embodiment of the method for controlling peripherals. As shown in FIG. 3 , the control instruction is the first control instruction; step S20 includes:
步骤S21，判断所述语音信息是否为已解析信息；Step S21, judging whether the voice information is parsed information;
用户的语音信息上传到电视的语音解析平台，语音解析平台判断所述语音信息是否被解析过，如用户从未通过语音打开过空调，那么，在接收到“打开空调”的语音信息时，可判定该语音信息为未解析语音。The user's voice information is uploaded to the voice analysis platform of the TV, and the voice analysis platform determines whether the voice information has been parsed. It is determined that the voice information is unparsed voice.
步骤S22，若否，则将所述语音信息解析为用户意图；Step S22, if not, parse the voice information into user intent;
在判定语音信息为未解析语音，首先，将语音信息解析为用户意图，具体为：通过智能语音识别算法，识别出相应的语音内容，这些语音内容经过语义转换服务器的智能增删改，从而解析为用户意图，识别为具体的智能设备可以接收的控制指令。When it is determined that the voice information is unparsed voice, first, the voice information is parsed into the user's intention, specifically: through the intelligent voice recognition algorithm, the corresponding voice content is identified, and these voice contents are intelligently added, deleted and modified by the semantic conversion server, so as to be parsed as User intent, identified as a control command that can be received by a specific smart device.
步骤S23，在判定所述用户意图存在第一授权信息时，将所述用户意图转化为第一控制指令。In step S23, when it is determined that the user's intention contains the first authorization information, the user's intention is converted into a first control instruction.
本实施例中，用户的语音信息上传到电视的语音解析平台，语音解析平台判断所述语音信息是否被解析过，如果没被解析过，则开始进行语音解析将语音解析为用户意图，再判断用户意图是否存在第一授权信息，如果存在，则将用户意图转化为第一控制指令。In this embodiment, the user's voice information is uploaded to the voice analysis platform of the TV, and the voice analysis platform judges whether the voice information has been parsed. Whether the user's intention exists the first authorization information, and if so, convert the user's intention into the first control instruction.
对语音信息进行解析，如果语音信息被解析过，说明该语音信息作为控制指令控制过对应的待控设备，如用户从未通过语音打开过空调的待控设备，那么，在接收到“打开空调”的语音信息时，可判定该语音信息为未解析语音，此时，将该语音信息解析为用户意图，并且，判断该用户意图是否存在第一授权信息，即空调是否被授权到智能家居系统中，若是，则将该语音信息“打开空调”转化为第一控制指令。Analyze the voice information. If the voice information has been parsed, it means that the voice information has been used as a control command to control the corresponding device to be controlled. ” voice information, it can be determined that the voice information is unparsed voice, at this time, the voice information is parsed into the user’s intention, and it is judged whether the user’s intention has the first authorization information, that is, whether the air conditioner is authorized to the smart home system. If yes, convert the voice message "turn on the air conditioner" into a first control command.
通过判断语音信息是否为已解析信息，若否，在判定用户意图存在第一授权信息时，才将用户意图转化为第一控制指令，实现了对语音信息的验证，在验证成功时，实现对待控设备的可控性。By judging whether the voice information is parsed information, if not, when it is determined that the user's intention has the first authorization information, the user's intention is converted into the first control command, which realizes the verification of the voice information, and when the verification is successful, the treatment is realized. controllability of equipment.
进一步地，步骤S22包括：Further, step S22 includes:
步骤S221，将所述语音信息解析为对应的语音文本；Step S221, parsing the voice information into corresponding voice text;
步骤S222，将所述语音文本转化为对应的用户意图。Step S222, converting the speech and text into corresponding user intentions.
本实施例中，在判定所述语音信息为未解析语音时，首先需要将语音信息解析为用户意图，具体为：利用语音识别技术将语音信息解析成对应的语音文本，然后通过语义理解技术，将语音文本转换为响应的用户意图。In this embodiment, when it is determined that the voice information is unparsed voice, it is first necessary to parse the voice information into user intentions, specifically: using the voice recognition technology to parse the voice information into corresponding voice text, and then using the semantic understanding technology, Convert speech text to responsive user intent.
语音识别技术是指将人类的语音中的词汇内容转换为计算机可读的输入，例如按键、二进制编码或者字符序列。与说话人识别及说话人确认不同，后者尝试识别或确认发出语音的说话人而非其中所包含的词汇内容。Speech recognition technology refers to the conversion of lexical content in human speech into computer-readable input, such as keystrokes, binary codes, or sequences of characters. Unlike speaker identification and speaker verification, the latter attempts to identify or identify the speaker who uttered the speech rather than the lexical content contained within it.
语义理解技术，是指运用各种方法，学习与理解一段文本所表示的语义内容，任何对语言的理解都可以归为语义分析的范畴。一段文本通常由词、句子和段落来构成，根据理解对象的语言单位不同，语义分析又可进一步分解为词汇级语义分析、句子级语义分析以及篇章级语义分析。一般来说，词汇级语义分析关注的是如何获取或区别单词的语义，句子级语义分析则试图分析整个句子所表达的语义，而篇章语义分析旨在研究自然语言文本的内在结构并理解文本单元(可以是句子从句或段落)间的语义关系。简单地讲，语义分析的目标就是通过建立有效的模型和系统，实现在各个语言单位(包括词汇、句子和篇章等)的自动语义分析，从而实现理解整个文本表达的真实语义。Semantic understanding technology refers to the use of various methods to learn and understand the semantic content represented by a piece of text. Any understanding of language can be classified into the category of semantic analysis. A piece of text is usually composed of words, sentences and paragraphs. Depending on the language unit of the comprehension object, semantic analysis can be further decomposed into lexical level semantic analysis, sentence level semantic analysis and chapter level semantic analysis. In general, lexical-level semantic analysis focuses on how to obtain or distinguish the semantics of words, sentence-level semantic analysis attempts to analyze the semantics expressed by the entire sentence, and discourse-level semantic analysis aims to study the intrinsic structure of natural language texts and understand text units The semantic relationship between (can be sentence clauses or paragraphs). Simply put, the goal of semantic analysis is to achieve automatic semantic analysis in various language units (including vocabulary, sentences, and chapters) by establishing effective models and systems, so as to understand the real semantics of the entire text.
进一步地，步骤S23之前，所述控制外设的方法还包括：Further, before step S23, the method for controlling peripherals further includes:
步骤S231，判断所述用户意图是否存在第一授权信息，其中，若是，则将所述用户意图转化为第一控制指令；Step S231, judging whether the user intent has first authorization information, wherein, if so, converting the user intent into a first control instruction;
步骤S232，若否，则在接收到第一账号信息时进行授权验证操作，在所述第一账号信息授权成功后返回执行步骤21。Step S232, if not, perform an authorization verification operation when the first account information is received, and return to step 21 after the first account information is authorized successfully.
本实施例中，在判定用户意图存在第一授权信息之前，首先判断该用户意图是否存在第一授权信息，第一授权信息是指用户能通过语音控制对应的待控设备，即拥有待控设备标识符如ID之类的唯一特征信息；若用户意图未存在第一授权信息时，首先需要进行授权验证，具体为：用户输入第一账号信息，可以通过扫描电视上的二维码，或者是手动输入第一账号信息进行相应的授权操作，并且，对第一账号信息进行验证，在验证成功时，说明授权成功，则返回执行步骤S21，重新对语音信息是否为已解析信息进行判断。In this embodiment, before it is determined that the user intends to have the first authorization information, it is first determined whether the user intends to have the first authorization information. The first authorization information means that the user can control the corresponding device to be controlled through voice, that is, owns the device to be controlled. The identifier is unique feature information such as ID; if the user intends that there is no first authorization information, authorization verification is required first, specifically: the user can input the first account information by scanning the QR code on the TV, or Manually input the first account information to perform a corresponding authorization operation, and verify the first account information. When the verification is successful, it indicates that the authorization is successful, and then returns to step S21 to re-determine whether the voice information is parsed information.
若判定用户意图存在授权信息，则说明用户意图已包含了待控设备标识符如ID之类的唯一特征信息，此时，可直接将用户意图转换为第一控制指令。If it is determined that authorization information exists for the user's intention, it means that the user's intention already includes unique feature information such as the identifier of the device to be controlled, such as ID. At this time, the user's intention can be directly converted into a first control instruction.
通过对用户意图是否存在第一授权信息的判断，实现对语音信息是否存在待控设备可控性的判断，在判定用户意图对待控设备存在可控性时，才能将用户意图转换为第一控制指令。By judging whether the user's intention has the first authorization information, the judgment of whether the voice information has the controllability of the device to be controlled is realized. When it is determined that the user's intention is controllable, the user's intention can be converted into the first control. instruction.
进一步地，步骤S21之后，所述控制外设的方法还包括：Further, after step S21, the method for controlling peripherals further includes:
步骤S211，若判定所述语音信息为已解析信息，则判断所述语音信息是否存在第二授权信息；Step S211, if it is determined that the voice information is parsed information, then determine whether the voice information has second authorization information;
在判定语音信息为已解析信息，则判断语音信息是否存在第二授权信息，比如，用户用语音打开过空调，电视的语音解析平台解析过“打开空调”的语音，此时，判定该语音为已解析信息，判断“打开空调”中是否包含了具体的空调的ID之类的唯一标识符，由于每家每户都有多台空调，此时，尽管用户用语音打开过A空调，但是并不代表用户的B空调为已授权信息，因此，若用户想要打开B空调，需要判断“打开空调”是否存在第二授权信息。When it is determined that the voice information is parsed information, it is determined whether the voice information has second authorization information. For example, the user has turned on the air conditioner by voice, and the voice analysis platform of the TV has parsed the voice of "turn on the air conditioner". At this time, it is determined that the voice is The information has been parsed to determine whether "turn on the air conditioner" contains a unique identifier such as the ID of a specific air conditioner. Since each household has multiple air conditioners, at this time, although the user has turned on the A air conditioner by voice, it is not. It does not mean that the user's B air conditioner is authorized information. Therefore, if the user wants to turn on the B air conditioner, it is necessary to determine whether there is second authorization information for "turn on the air conditioner".
步骤S212，若判定所述语音信息存在第二授权信息，则将所述语音信息转化为第二控制指令；Step S212, if it is determined that the voice information has second authorization information, then the voice information is converted into a second control instruction;
在判定语音信息存在第二授权信息时，将语音信息转换为第二控制指令，如用户用语音打开过B空调，在语音信息为“打开B空调”时，包含了B空调的唯一标识符ID，因此，可直接将语音信息转换为第二控制指令。When it is determined that there is second authorization information in the voice information, the voice information is converted into a second control instruction. For example, if the user has turned on the B air conditioner by voice, when the voice information is "turn on the B air conditioner", the unique identifier ID of the B air conditioner is included. , therefore, the voice information can be directly converted into the second control instruction.
步骤S213，若判定所述语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，在所述第二账号信息授权成功后返回执行步骤S21。Step S213, if it is determined that the voice information does not have the second authorization information, perform authorization verification when the second account information is received, and return to step S21 after the second account information is authorized successfully.
本实施例中，若判定语音信息未存在第二授权信息，则在接收到第二账号信息时进行授权验证操作，具体验证方式与验证第一授权信息类似，用户输入第二账号信息，可以通过扫描电视上的二维码，或者是手动输入第二账号信息进行相应的授权操作，并且，对第二账号信息进行验证，在验证成功时，说明授权成功，则返回执行步骤S21，重新对语音信息是否为已解析信息进行判断。In this embodiment, if it is determined that there is no second authorization information in the voice information, an authorization verification operation is performed when the second account information is received, and the specific verification method is similar to that of verifying the first authorization information. Scan the two-dimensional code on the TV, or manually input the second account information to perform the corresponding authorization operation, and verify the second account information. When the verification is successful, it means that the authorization is successful, then return to step S21, and re-authenticate the voice Whether the information is parsed information is judged.
进一步地，基于第二实施例，提出本发明控制外设的方法的第三实施例，如图4所示，所述控制指令为第一控制指令或第二控制指令，步骤S30包括：Further, based on the second embodiment, a third embodiment of the method for controlling peripherals of the present invention is proposed. As shown in FIG. 4 , the control instruction is a first control instruction or a second control instruction, and step S30 includes:
步骤S31，基于所述第一授权信息或第二授权信息获取所述待控设备的ID；Step S31, obtaining the ID of the device to be controlled based on the first authorization information or the second authorization information;
由于第一授权信息及第二授权信息均包含了待控设备的唯一标识符如ID，在获取待控设备的唯一标识符后，使得物联网IOT平台能够得知所述语音信息具体要操作的待控设备。Since both the first authorization information and the second authorization information contain the unique identifier of the device to be controlled, such as ID, after obtaining the unique identifier of the device to be controlled, the IoT platform can know the specific operation of the voice information. device to be controlled.
步骤S32，将所述第一控制指令搭配ID或第二控制指令搭配ID通过物联网IOT平台发送至消息管理中心，其中，所述消息管理中心包括多个影子设备，且每个影子设备对应一个待控设备；Step S32, sending the first control instruction collocation ID or the second control instruction collocation ID to the message management center through the Internet of Things IOT platform, wherein the message management center includes multiple shadow devices, and each shadow device corresponds to one equipment to be controlled;
由于消息管理中心包括多个影子设备，且每个影子设备均对应一个待控设备，如影子设备A对应空调A，影子设备B对应空调B，如，根据第一控制指令搭配空调A的ID通过物联网IOT平台发送至消息管理中心，使得消息管理中心得知是要控制空调A，此时，消息管理中心将第一控制指令搭配空调A的ID发送至影子设备A。Since the message management center includes multiple shadow devices, and each shadow device corresponds to a device to be controlled, for example, shadow device A corresponds to air conditioner A, and shadow device B corresponds to air conditioner B. The IOT platform of the Internet of Things sends the message to the message management center, so that the message management center knows that the air conditioner A is to be controlled. At this time, the message management center sends the first control command and the ID of the air conditioner A to the shadow device A.
步骤S33，通过所述影子设备与所述待控设备订阅同一个消息队列，且通过所述消息队列进行状态同步；Step S33, subscribe to the same message queue through the shadow device and the device to be controlled, and perform state synchronization through the message queue;
通过影子设备与对应的待控设备订阅同一个消息队列，实现影子设备与对应的待控设备之间的状态同步。如影子设备A接收到控制指令“打开空调A”，通过订阅同一个消息队列，使得控制指令“打开空调A”同步至空调A的控制器。By subscribing to the same message queue between the shadow device and the corresponding device to be controlled, the state synchronization between the shadow device and the corresponding device to be controlled is realized. For example, if the shadow device A receives the control command "Turn on the air conditioner A", by subscribing to the same message queue, the control command "Turn on the air conditioner A" is synchronized to the controller of the air conditioner A.
步骤S34，通过所述消息队列将所述控制指令同步至所述待控设备的控制器。Step S34, synchronizing the control instruction to the controller of the device to be controlled through the message queue.
通过消息队列将所述控制指令同步至所述待控设备的控制器，使得待控设备的控制器做出与控制指令对应的响应动作。如影子设备A接收到控制指令“打开空调A”，通过订阅同一个消息队列，使得控制指令“打开空调A”同步至空调A的控制器，此时，空调A的控制器执行打开空调A的开关的响应动作，实现语音控制空调A。The control instruction is synchronized to the controller of the device to be controlled through a message queue, so that the controller of the device to be controlled makes a response action corresponding to the control instruction. For example, if shadow device A receives the control command "Turn on air conditioner A", it subscribes to the same message queue to synchronize the control command "Turn on air conditioner A" to the controller of air conditioner A. At this time, the controller of air conditioner A executes the operation of turning on air conditioner A. The response action of the switch realizes voice control of air conditioner A.
进一步地，步骤S33之前，所述控制外设的方法还包括：Further, before step S33, the method for controlling peripherals further includes:
将所述第一控制指令或第二控制指令转换为机器指令集；converting the first control instruction or the second control instruction into a machine instruction set;
基于所述机器指令集查找设备列表；looking up a device list based on the machine instruction set;
在查找到所述ID对应的第一待控设备时，获取所述第一待控设备对应的影子设备，并执行步骤S33。When the first device to be controlled corresponding to the ID is found, the shadow device corresponding to the first device to be controlled is acquired, and step S33 is performed.
本实施例中，在准确理解用户语音意图的基础上，将第一控制指令或第二控制指令转换为机器可以识别的机器指令集。基于所述机器指令集查找设备列表，即电视端根据当前用户的标识同步去获取用户的可控的设备列表。如果查找到该智能待设设备，就将控制指令下发给该待控设备的影子设备。此时影子设备会自动将设备的所有状态同步给该影子设备的真实设备。否则则出现智能提示，使用户得到正确及有效的响应。In this embodiment, on the basis of accurately understanding the user's voice intention, the first control instruction or the second control instruction is converted into a machine instruction set that can be recognized by the machine. The device list is searched based on the machine instruction set, that is, the TV terminal synchronously acquires the user's controllable device list according to the current user's identification. If the intelligent device to be set is found, the control instruction is issued to the shadow device of the device to be controlled. At this time, the shadow device will automatically synchronize all the state of the device to the real device of the shadow device. Otherwise, an intellisense will appear so that the user can get a correct and effective response.
进一步地，步骤S10包括：Further, step S10 includes:
在接收到语音信息时，判断所述电视是否处于开机状态；When receiving the voice information, determine whether the TV is in a power-on state;
若否，则唤醒所述物联网IOT平台接收所述语音信息后，执行所述基于所述语音信息生成控制指令的步骤；If not, wake up the IoT platform to receive the voice information, and execute the step of generating a control command based on the voice information;
若是，则执行步骤S20。If yes, step S20 is executed.
用户在使用电视时，通过遥控器的近场语音功能或者电视自带的远场语音功能说出想要实现的操作，用户的语音通过遥控器或者电视上的麦克风阵列上传到电视中。首先，会对电视是否开机进行判断，在判定电视处于开机状态时，则电视端的物联网IOT平台会迅速进行响应，将基于语音信息生成控制指令；若电视处于待机状态，首先需要唤醒电视的语音识别功能，即唤醒电视的物联网IOT平台，从而保证电视在待机状态下仍然能完成物联网IOT平台服务相应的功能。When using the TV, the user speaks the desired operation through the near-field voice function of the remote control or the far-field voice function of the TV, and the user's voice is uploaded to the TV through the remote control or the microphone array on the TV. First, it will judge whether the TV is turned on. When it is judged that the TV is turned on, the IoT platform on the TV side will respond quickly and generate control commands based on the voice information; if the TV is in the standby state, the voice of the TV needs to be woken up first. The identification function is to wake up the Internet of Things IOT platform of the TV, so as to ensure that the TV can still complete the corresponding functions of the Internet of Things IOT platform service in the standby state.
本发明的具体优势在于：The specific advantages of the present invention are:
相对于单纯采用MQTT协议对设备直接进行控制，本发明更倾向于采用目前主流的物联网IOT平台技术去实现设备的管理和控制。Compared with simply using the MQTT protocol to directly control the device, the present invention is more inclined to use the current mainstream Internet of Things IOT platform technology to realize the management and control of the device.
物联网IOT平台技术在设备的接入方面有着极大的包容性。它不但提供了2/3/4G、NB-IOT、LoRA等不同网络设备接入的方案，而且提供了包括MQTT、CoPA协议在内的多种协议的设备SDK，既满足了长连接的实时性需求，也满足了短连接的低功耗需求。The IoT platform technology is extremely inclusive in terms of device access. It not only provides solutions for accessing different network devices such as 2/3/4G, NB-IOT, LoRA, etc., but also provides device SDKs for various protocols including MQTT and CoPA protocols, which not only satisfies the real-time nature of long connections It also meets the low power consumption requirements for short connections.
物联网IOT平台技术在对设备管理和数据采集分析方面有着天然的优势。它可以提供完整的设备生命周期管理功能，支持设备的注册、功能定义、脚本解析、在线调试、远程配置、固件升级、远程维护、实时监控，而且还可以对设备进行分组管理以及对设备进行有选择性的删除。The IoT platform technology has natural advantages in device management and data collection and analysis. It can provide complete device life cycle management functions, support device registration, function definition, script parsing, online debugging, remote configuration, firmware upgrade, remote maintenance, real-time monitoring, and can also manage devices in groups and carry out active monitoring of devices. Selective deletion.
在数据采集及分析管理方面，物联网IOT平台技术也有着不错的表现。我们可以通过IOT技术对设备进行实时的备份，还可以将数据上传至云平台进行存储、计算等其他服务。In terms of data collection and analysis and management, the IoT platform technology of the Internet of Things also has a good performance. We can perform real-time backup of devices through IOT technology, and can also upload data to the cloud platform for storage, computing and other services.
在安全性方面，物联网IOT平台技术也提供了超强的安全保障能力。当我们登录IOT后台时，不但需要经过多重身份验证，而且不同的身份所对应的操作权限也会有很大的区别。当数据进行传输通信时，物联网IOT平台对数据进行了多层次的加密，保证了数据的机密性和完整性，而且支持设备级别的通信资源隔离，防止设备越权等问题的出现。In terms of security, the IoT platform technology also provides strong security assurance capabilities. When we log in to the IOT background, not only do we need to go through multiple authentications, but also the operation permissions corresponding to different identities will be very different. When the data is transmitted and communicated, the IoT platform encrypts the data at multiple levels to ensure the confidentiality and integrity of the data, and supports the isolation of communication resources at the device level to prevent the emergence of problems such as device unauthorized access.
除了采用物联网IOT平台技术去控制外设，方便了对设备的统一管理和数据采集，本发明也将语音识别和唤醒技术纳入其中。在用户通过语音技术去控制外设的整个逻辑过程中，从最初的通过唤醒词进行语音唤醒，然后麦克风的语音录入，再到语音后台的解析处理，最后进行语音合成反馈用户，整个过程的处理快捷高效，极大丰富了用户的观影体验。In addition to using the IoT platform technology of the Internet of Things to control peripheral devices, which facilitates the unified management and data collection of the devices, the present invention also incorporates voice recognition and wake-up technologies. In the whole logical process of the user controlling the peripherals through the voice technology, from the initial voice wake-up through the wake-up word, then the voice input of the microphone, to the analysis and processing of the voice background, and finally to the voice synthesis feedback to the user, the whole process of processing Fast and efficient, greatly enriching the user's viewing experience.
本发明还用到一项关键技术，它实现了电视在待机状态下仍然可以去控制外设。即智能化硬件息屏技术，用户在对电视进行关机操作时，硬件端进行智能响应，CPU会有选择性地去关闭一些必要性的服务，同时保留IOT相关服务，这样当用户在发出语音指令时，CPU会正常地进行解析运转，从而实现在待机状态下对外设的控制。The invention also uses a key technology, which realizes that the TV can still control the peripheral devices in the standby state. That is, the intelligent hardware information screen technology. When the user shuts down the TV, the hardware side responds intelligently, and the CPU will selectively shut down some necessary services while retaining the IOT-related services, so that when the user sends a voice command At the time, the CPU will perform the analysis operation normally, so as to realize the control of the peripherals in the standby state.
本发明设计的方案，可以根据电视的当前状态，智能选择语音的识别方式。同时将用户的语音识别为硬件设备可以接收到的控制指令。采用影子设备同步数据的方式，避免了由于网络不稳定所导致的设备状态无法同步和多应用程序请求设备负载过大的问题，可以使电视在各种复杂的应用场景下控制大量设备的要求。The solution designed by the present invention can intelligently select the voice recognition mode according to the current state of the TV. At the same time, the user's voice is recognized as a control command that the hardware device can receive. The method of synchronizing data by shadow devices avoids the problem of unsynchronized device status and excessive load of multiple applications requesting devices due to unstable network, and enables the TV to control a large number of devices in various complex application scenarios.
本发明使得用户在看电视的时候可以通过电视端的语音去很方便快捷地去控制周边家居设备，比如智能空气净化器、智能空调、智能音箱等，甚至在电视待机的情况下依然可以通过语音去实现对该类设备的操控，从而丰富了电视的角色定位，增强了电视的主角光环，更进一步强调了电视作为智能家居控制入口进行外设控制的全新概念，给人们的家居生活带来了极大的便利。The present invention enables users to conveniently and quickly control surrounding household equipment, such as smart air purifiers, smart air conditioners, smart speakers, etc., through the voice of the TV terminal when watching TV, and even when the TV is on standby, the voice can still be used to control Realize the control of this type of equipment, thus enriching the role of the TV, enhancing the protagonist halo of the TV, and further emphasizing the new concept of the TV as a smart home control entrance for peripheral control, which brings great importance to people's home life. Great convenience.
此外，本发明实施例还提出一种可读存储介质，所述可读存储介质上存储有控制外设的程序，所述控制外设的程序被处理器执行时实现如上所述的控制外设的方法的步骤。In addition, an embodiment of the present invention also provides a readable storage medium, where a program for controlling peripherals is stored on the readable storage medium, and when the program for controlling peripherals is executed by a processor, the above-described peripherals are controlled. steps of the method.
本发明可读存储介质的具体实施例与上述控制外设的方法的各个实施例基本相同，在此不做赘述。The specific embodiments of the readable storage medium of the present invention are basically the same as the above-mentioned embodiments of the method for controlling a peripheral device, which will not be repeated here.
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台装置设备(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本发明各个实施例所述的方法。From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on such understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM) as described above. , magnetic disk, optical disk), including several instructions to make a device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present invention, or directly or indirectly applied in other related technical fields , are similarly included in the scope of patent protection of the present invention.
Claims (8)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811586659.4ACN109618202B (en) | 2018-12-24 | 2018-12-24 | Method for controlling peripheral device, television and readable storage medium |
| PCT/CN2019/078836WO2020133741A1 (en) | 2018-12-24 | 2019-03-20 | Peripheral control method, television, and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811586659.4ACN109618202B (en) | 2018-12-24 | 2018-12-24 | Method for controlling peripheral device, television and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109618202A CN109618202A (en) | 2019-04-12 |
| CN109618202Btrue CN109618202B (en) | 2020-12-08 |
Family
ID=66011071
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811586659.4AActiveCN109618202B (en) | 2018-12-24 | 2018-12-24 | Method for controlling peripheral device, television and readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109618202B (en) |
| WO (1) | WO2020133741A1 (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110753921B (en)* | 2019-01-11 | 2023-08-29 | Oppo广东移动通信有限公司 | Query request processing method, device, computer equipment and storage medium |
| WO2021012235A1 (en)* | 2019-07-24 | 2021-01-28 | Oppo广东移动通信有限公司 | Method for generating shadow device, device, and storage medium |
| CN110501988B (en)* | 2019-09-25 | 2020-06-09 | 北京金茂绿建科技有限公司 | Method and device for realizing integration control of Internet of things equipment |
| CN111478965A (en)* | 2020-04-07 | 2020-07-31 | 四川虹美智能科技有限公司 | Method, device and system for processing device shadow |
| CN113676382B (en)* | 2020-05-13 | 2023-04-07 | 云米互联科技(广东)有限公司 | IOT voice command control method, system and computer readable storage medium |
| CN114244860B (en)* | 2020-09-07 | 2024-12-31 | 北京金山云网络技术有限公司 | A method, device, electronic device and storage medium for managing Internet of Things devices |
| CN112600881A (en)* | 2020-12-01 | 2021-04-02 | 珠海格力电器股份有限公司 | Method, device, server and storage medium for providing service of internet of things |
| CN112556988B (en)* | 2020-12-02 | 2023-09-26 | 海信视像科技股份有限公司 | Display device and detection circuit thereof |
| CN115134343B (en)* | 2021-03-29 | 2024-11-29 | 深圳绿米联创科技有限公司 | Device control method, system, device, server and storage medium |
| CN114137888B (en)* | 2021-12-10 | 2023-10-03 | 珠海格力电器股份有限公司 | Linkage control method of equipment, processor and equipment linkage control system |
| CN114900384B (en)* | 2022-04-11 | 2024-03-22 | 哈尔滨工业大学 | Cross-platform communication system and method for Internet of things and intelligent equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106385347A (en)* | 2016-09-09 | 2017-02-08 | 珠海格力电器股份有限公司 | Household appliance control method and device |
| CN106792028A (en)* | 2016-12-29 | 2017-05-31 | 重庆金鑫智慧科技有限公司 | A kind of Set Top Box control intelligent domestic system based on Internet of Things |
| CN107911492A (en)* | 2017-12-27 | 2018-04-13 | 浙江力石科技股份有限公司 | The method and device that equipment accesses in platform of internet of things |
| CN108255934A (en)* | 2017-12-07 | 2018-07-06 | 北京奇艺世纪科技有限公司 | A kind of sound control method and device |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203966093U (en)* | 2014-07-18 | 2014-11-26 | 谭迎建 | Intelligent home integration apparatus |
| KR101662396B1 (en)* | 2014-10-13 | 2016-10-05 | 한국과학기술원 | Method and system for controlling device based internet of things |
| CN105717797A (en)* | 2016-01-29 | 2016-06-29 | 四川长虹电器股份有限公司 | Household management device, system and method based on speech recognition |
| CN105872075B (en)* | 2016-05-06 | 2018-08-31 | 东莞中科智城软件有限公司 | Method for mapping Internet of things equipment to smart city resource model |
| US10459687B2 (en)* | 2017-03-28 | 2019-10-29 | Wipro Limited | Method and system for controlling an internet of things device using multi-modal gesture commands |
| US10686865B2 (en)* | 2017-04-10 | 2020-06-16 | Ayla Networks, Inc. | Third-party application control of devices in an IoT platform |
| CN107515944A (en)* | 2017-08-31 | 2017-12-26 | 广东美的制冷设备有限公司 | Exchange method, user terminal and storage medium based on artificial intelligence |
| CN107370649B (en)* | 2017-08-31 | 2020-09-11 | 广东美的制冷设备有限公司 | Household appliance control method, system, control terminal and storage medium |
| CN107479400A (en)* | 2017-09-28 | 2017-12-15 | 广东美的制冷设备有限公司 | Control method, device, home appliance and the readable storage medium storing program for executing of home appliance |
| CN108111617A (en)* | 2017-12-27 | 2018-06-01 | 浙江力石科技股份有限公司 | The implementation method and device of rule control in platform of internet of things |
- 2018
- 2018-12-24CNCN201811586659.4Apatent/CN109618202B/enactiveActive
- 2019
- 2019-03-20WOPCT/CN2019/078836patent/WO2020133741A1/ennot_activeCeased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106385347A (en)* | 2016-09-09 | 2017-02-08 | 珠海格力电器股份有限公司 | Household appliance control method and device |
| CN106792028A (en)* | 2016-12-29 | 2017-05-31 | 重庆金鑫智慧科技有限公司 | A kind of Set Top Box control intelligent domestic system based on Internet of Things |
| CN108255934A (en)* | 2017-12-07 | 2018-07-06 | 北京奇艺世纪科技有限公司 | A kind of sound control method and device |
| CN107911492A (en)* | 2017-12-27 | 2018-04-13 | 浙江力石科技股份有限公司 | The method and device that equipment accesses in platform of internet of things |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109618202A (en) | 2019-04-12 |
| WO2020133741A1 (en) | 2020-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109618202B (en) | Method for controlling peripheral device, television and readable storage medium | |
| CN111880645B (en) | Server for determining target device and controlling target device based on voice input of user and operation method thereof | |
| CN107370649B (en) | Household appliance control method, system, control terminal and storage medium | |
| KR102429436B1 (en) | Server for seleting a target device according to a voice input, and controlling the selected target device, and method for operating the same | |
| US11140315B2 (en) | Method, storage medium, terminal device, and server for managing push information | |
| US11874904B2 (en) | Electronic device including mode for using an artificial intelligence assistant function of another electronic device | |
| CN103197571A (en) | Control method, device and system | |
| CN107909998B (en) | Voice instruction processing method and device, computer equipment and storage medium | |
| CN108648431B (en) | Method and device for configuring functions of remote controller, terminal equipment and readable storage medium | |
| CN108683574A (en) | A kind of apparatus control method, server and intelligent domestic system | |
| WO2019000871A1 (en) | Method and device for providing voice service, and server | |
| CN107580237A (en) | Operating method, device, system and the storage medium of TV | |
| CN112102828A (en) | Voice control method and system for automatically broadcasting content on large screen | |
| CN105141998A (en) | Smart television voice remote controller control method and system based on DLNA (Digital Living Network Alliance) | |
| CN111048083A (en) | Voice control method, device and storage medium | |
| CN111212327A (en) | Control method and device of playing equipment and storage medium | |
| US20240020369A1 (en) | Speech control system and method, apparatus, device, medium, and program product | |
| CN113990316A (en) | Voice control method, device, server, terminal device and storage medium | |
| CN114005443B (en) | Device control method, device, server and storage medium | |
| CN111385624B (en) | Voice-based data transmission control method, smart television and storage medium | |
| CN112435663A (en) | Command voice management method, device, equipment and medium | |
| CN118535286A (en) | Operation sharing method and device, electronic equipment and storage medium | |
| CN118335076A (en) | Electronic equipment, method and device for determining false wake-up audio and storage medium | |
| CN115396709B (en) | Display device, server and wake-up-free voice control method | |
| CN113555019A (en) | Voice control method, device and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |