CN114387969A - Dual-thread smart screen control method, device, electronic device and storage medium - Google Patents
Dual-thread smart screen control method, device, electronic device and storage mediumDownload PDFInfo
- Publication number
- CN114387969A CN114387969ACN202210064870.XACN202210064870ACN114387969ACN 114387969 ACN114387969 ACN 114387969ACN 202210064870 ACN202210064870 ACN 202210064870ACN 114387969 ACN114387969 ACN 114387969A
- Authority
- CN
- China
- Prior art keywords
- control
- smart screen
- thread
- voice
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/10544—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
- G06K7/10821—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum further details of bar or optical code scanning devices
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/18—Speech classification or search using natural language modelling
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/225—Feedback of the input speech
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Artificial Intelligence (AREA)
- Electromagnetism (AREA)
- General Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Translated fromChinese技术领域technical field
本发明涉及人工智能领域，涉及一种智能屏控制方法，尤其涉及一种双线程智能屏控制方法、装置、电子设备及计算机可读存储介质。The present invention relates to the field of artificial intelligence, to a method for controlling an intelligent screen, and in particular to a method, device, electronic device and computer-readable storage medium for controlling a dual-thread intelligent screen.
背景技术Background technique
监控大屏系统在政府、医院等各个场景的应用已十分普遍，但是目前的大屏系统都存在页面数据无法现场控制的问题，也就是说，想要变动大屏幕上显示的页面数据，只能通过页面的定时器来刷新，如此用户只能被动等待页面数据的刷新，而不能自主查找自己需要的数据，影响用户的体验的问题。The application of monitoring large-screen systems in various scenarios such as governments and hospitals has been very common, but the current large-screen systems have the problem that page data cannot be controlled on-site. That is to say, if you want to change the page data displayed on the large screen, you can only The page is refreshed by the timer, so the user can only passively wait for the page data to be refreshed, but cannot find the data they need independently, which affects the user experience.
并且，通常监控大屏的页面内容仅能够通过鼠标操作，而大屏通常设置在展厅，主机通常设置在机房，因此导致用户无法进行现场操纵，且机房的专人操控操作成本非常高；即便部分监控显示大屏配备有遥控器，但遥控器操作键有限，往往仅能够通过遥控器进行设定的简单硬件操作，不能进行信息选择、调用等复杂操作。In addition, the page content of the monitoring large screen can only be operated by the mouse, and the large screen is usually set in the exhibition hall, and the host is usually set in the computer room, so the user cannot perform on-site operation, and the operation cost of the special person in the computer room is very high; even some monitoring The large display screen is equipped with a remote control, but the operation keys of the remote control are limited, and often only simple hardware operations can be set through the remote control, and complex operations such as information selection and calling cannot be performed.
因此，亟需一种提高用户体验性、增强交互性的双线程智能屏控制方法、装置。Therefore, there is an urgent need for a dual-threaded smart screen control method and device that improves user experience and enhances interactivity.
发明内容SUMMARY OF THE INVENTION
本发明提供一种提高用户体验性、增强交互性的双线程智能屏控制方法、装置、电子设备及计算机可读存储介质，其主要目的在于能够解决现有监控大屏的页面内容仅能够通过鼠标操作，而大屏通常设置在展厅，主机通常设置在机房，因此导致用户无法进行现场操纵，且机房的专人操控操作成本非常高；即便部分监控显示大屏配备有遥控器，但遥控器操作键有限，往往仅能够通过遥控器进行设定的简单硬件操作，不能进行信息选择、调用等复杂操作的问题。The present invention provides a dual-thread smart screen control method, device, electronic device and computer-readable storage medium that improve user experience and enhance interactivity. However, the large screen is usually set in the exhibition hall, and the host is usually set in the computer room, so the user cannot perform on-site operation, and the operation cost of the special person in the computer room is very high; even if some monitoring display large screens are equipped with a remote control, but the remote control operation keys Limited, often only simple hardware operations can be set through the remote control, and complex operations such as information selection and calling cannot be performed.
为实现上述目的，本发明提供的一种双线程智能屏控制方法，包括：In order to achieve the above purpose, a dual-thread intelligent screen control method provided by the present invention includes:
获取与智能屏相连接的数据库端口，并创建所述智能屏的外挂连接接口；其中，所述外挂连接接口包括语音接口和扫码接口；Acquire the database port connected with the smart screen, and create a plug-in connection interface of the smart screen; wherein, the plug-in connection interface includes a voice interface and a code scanning interface;
通过所述数据库端口在预设数据库中获取所述智能屏中的操控按键，并将所述操控按键进行顺次连接以形成功能连接拓扑图；Obtain the control keys in the smart screen from the preset database through the database port, and connect the control keys in sequence to form a functional connection topology diagram;
将所述功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据所述功能连接拓扑图形成辅助程序；One-to-one correspondence between the functional connection topology map and the functions learned by NLP to form an NLP recognition model, and form an auxiliary program according to the functional connection topology map;
将所述NLP识别模型与所述语音接口相连接以形成语音控制线程；以及，将所述辅助程序与所述扫码接口相连接以形成扫码控制线程；其中，所述语音控制线程用于通过语音识别操控所述智能屏，所述扫码控制线程用于通过扫码程序操控所述智能屏。Connect the NLP recognition model with the voice interface to form a voice control thread; and connect the auxiliary program with the code scanning interface to form a code scanning control thread; wherein the voice control thread is used for The smart screen is controlled by voice recognition, and the code scanning control thread is used to control the smart screen through a code scanning program.
可选地，所述获取与智能屏相连接的数据库端口，包括：Optionally, the acquisition of the database port connected to the smart screen includes:
通过预设的密码登陆与所述智能屏相连接的服务端；其中所述服务端与所述智能屏通过Http双向连接；Log in to the server connected to the smart screen through a preset password; wherein the server and the smart screen are bidirectionally connected through Http;
通过所述服务端中预设的调取程序获取所述智能屏的配置参数；Obtain the configuration parameters of the smart screen through a calling program preset in the server;
解析所述配置参数以获取与所述智能屏相连接的数据库端口。Parse the configuration parameters to obtain the database port connected to the smart screen.
可选地，创建智能屏的外挂连接接口包括创建语音接口和扫码接口；其中，Optionally, creating the external connection interface of the smart screen includes creating a voice interface and a code scanning interface; wherein,
创建语音接口的步骤，包括：The steps to create a voice interface include:
按照预存储的关键词反复训练预设的关键词触发脚本以形成关键词触发模型；Repeatedly train the preset keyword trigger script according to the pre-stored keywords to form a keyword trigger model;
基于所述关键词触发模型和预设的音频接收器形成语音接口；A voice interface is formed based on the keyword trigger model and a preset audio receiver;
创建扫码接口的步骤，包括：The steps for creating a code scanning interface include:
通过所述服务端中的网络模块向二维码管理服务进行二维码申请；Apply for a two-dimensional code to the two-dimensional code management service through the network module in the server;
通过所述二维码管理服务对所述二维码申请进行合法性验证；Verifying the validity of the QR code application through the QR code management service;
若通过合法性验证，则生成启动二维码；If it passes the legality verification, a startup QR code will be generated;
将所述启动二维码作为扫码接口显示在所述智能屏上，并且所述启动二维码按照预设时间定时更新。The startup two-dimensional code is displayed on the smart screen as a code scanning interface, and the startup two-dimensional code is regularly updated according to a preset time.
可选地，所述通过所述数据库端口在预设数据库中获取所述智能屏中的操控按键，并将所述操控按键进行顺次连接以形成功能连接拓扑图，包括：Optionally, obtaining the control keys in the smart screen from a preset database through the database port, and sequentially connecting the control keys to form a functional connection topology diagram, including:
在所述数据库中获取所述智能屏中的操控按键；Obtain the control buttons in the smart screen in the database;
标注所述操控按键的操控功能；Mark the control function of the control button;
遍历所述操控功能以获取功能列表；Traverse the manipulation functions to obtain a function list;
根据所述功能列表对所述操控功能进行连线处理以形成功能连接拓扑图。The manipulation functions are connected according to the function list to form a function connection topology map.
可选地，所述将所述功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，包括：Optionally, the one-to-one correspondence between the function connection topology map and the functions learned by NLP to form an NLP recognition model includes:
在所述功能连接拓扑图中标记学习信息；所述学习信息包括与所述功能列表的每一栏相对应的关键字和与所述关键字关联的字眼；Marking learning information in the functional connection topology map; the learning information includes keywords corresponding to each column of the function list and words associated with the keywords;
所述功能连接拓扑图中的各个操控按键与NLP学习的功能一一对应以形成NLP功能脚本；Each control button in the function connection topology diagram corresponds to the function learned by NLP to form an NLP function script;
使所述NLP功能脚本根据所述学习信息与与所述操控按键的操控功能进行学习，直至关于所述NLP功能脚本的反馈函数值达到预设值以形成NLP识别模型。The NLP function script is made to learn according to the learning information and the manipulation function with the manipulation button, until the feedback function value about the NLP function script reaches a preset value to form an NLP recognition model.
可选地，所述根据所述功能连接拓扑图形成辅助程序，包括：Optionally, forming an auxiliary program according to the functional connection topology diagram includes:
对所述功能连接拓扑图进行顺次遍历以获取功能总览信息；traversing the functional connection topology diagram in sequence to obtain functional overview information;
根据所述功能总览信息确定程序逻辑；Determine program logic according to the function overview information;
通过程序编撰语言基于所述程序逻辑生成辅助程序。An auxiliary program is generated based on the program logic by a programming language.
可选地，在所述将所述NLP识别模型与所述语音接口相连接以形成语音控制线程，将所述辅助程序与所述扫码接口相连接以形成扫码控制线程的步骤中，Optionally, in the step of connecting the NLP recognition model with the voice interface to form a voice control thread, and connecting the auxiliary program with the code scanning interface to form a code scanning control thread,
通过语音识别操控所述智能屏的步骤，包括：The steps of manipulating the smart screen through voice recognition include:
通过所述语音控制线程中的语音接口接收用户的指令语音语音和操控语音，并对所述指令语音进行语音识别以形成指令自然语言，若所述指令自然语言与预设的关键字相匹配，则对所述操控语音进行语音识别以获取操控自然语言；Receive the user's command voice and control voice through the voice interface in the voice control thread, and perform voice recognition on the command voice to form a command natural language, if the command natural language matches a preset keyword, performing speech recognition on the manipulation voice to obtain manipulation natural language;
将所述操控自然语言输入所述NLP识别模型中，使所述NLP识别模型根据所述操控自然语言自动操控所述智能屏；Inputting the manipulation natural language into the NLP recognition model, so that the NLP recognition model automatically controls the smart screen according to the manipulation natural language;
通过扫码程序操控所述智能屏的步骤，包括：The steps of controlling the smart screen through a code scanning program include:
通过扫描所述扫码控制线程中的扫码接口以连接移动客户端与所述辅助程序；Connect the mobile client and the auxiliary program by scanning the code scanning interface in the code scanning control thread;
通过所述辅助程序操控所述智能屏。The smart screen is controlled by the auxiliary program.
为了解决上述问题，本发明还提供一种双线程智能屏控制装置，所述装置包括：In order to solve the above problems, the present invention also provides a dual-thread intelligent screen control device, the device includes:
接口创建单元，用于获取与智能屏相连接的数据库端口，并创建所述智能屏的外挂连接接口；其中，所述外挂连接接口包括语音接口和扫码接口；an interface creation unit, used for acquiring a database port connected to the smart screen, and creating a plug-in connection interface of the smart screen; wherein, the plug-in connection interface includes a voice interface and a code scanning interface;
拓扑生成单元，用于通过所述数据库端口在预设数据库中获取所述智能屏中的操控按键，并将所述操控按键进行顺次连接以形成功能连接拓扑图；a topology generation unit, configured to obtain the control keys in the smart screen from a preset database through the database port, and connect the control keys in sequence to form a functional connection topology diagram;
程序辅助单元，用于将所述功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据所述功能连接拓扑图形成辅助程序；A program auxiliary unit, used for one-to-one correspondence between the functional connection topology map and the functions learned by NLP to form an NLP recognition model, and to form an auxiliary program according to the functional connection topology map;
线程生成单元，用于将所述NLP识别模型与所述语音接口相连接以形成语音控制线程；以及，将所述辅助程序与所述扫码接口相连接以形成扫码控制线程；其中，所述语音控制线程用于通过语音识别操控所述智能屏，所述扫码控制线程用于通过扫码程序操控所述智能屏。A thread generation unit, used to connect the NLP recognition model with the voice interface to form a voice control thread; and, connect the auxiliary program with the code scanning interface to form a code scanning control thread; wherein, the The voice control thread is used to control the smart screen through voice recognition, and the code scanning control thread is used to control the smart screen through a code scanning program.
为了解决上述问题，本发明还提供一种电子设备，所述电子设备包括：In order to solve the above problems, the present invention also provides an electronic device, the electronic device includes:
存储器，存储至少一个指令；及a memory that stores at least one instruction; and
处理器，执行所述存储器中存储的指令以实现上述所述的双线程智能屏控制方法中的步骤。The processor executes the instructions stored in the memory to implement the steps in the above-mentioned dual-thread smart screen control method.
为了解决上述问题，本发明还提供一种计算机可读存储介质，所述计算机可读存储介质中存储有至少一个指令，所述至少一个指令被电子设备中的处理器执行以实现上述所述的双线程智能屏控制方法。In order to solve the above problems, the present invention also provides a computer-readable storage medium, where at least one instruction is stored in the computer-readable storage medium, and the at least one instruction is executed by a processor in an electronic device to implement the above-mentioned Dual-thread smart screen control method.
本发明实施例获取与智能屏相连接的数据库端口，并创建智能屏的外挂连接接口；其中，外挂连接接口包括语音接口和扫码接口；通过数据库端口在预设数据库中获取所述智能屏中的操控按键，并将操控按键进行顺次连接以形成功能连接拓扑图；而后将功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据功能连接拓扑图形成辅助程序，再将NLP识别模型与语音接口相连接以形成语音控制线程，将辅助程序与扫码接口相连接以形成扫码控制线程；其中，语音控制线程用于通过语音识别操控智能屏，扫码控制线程用于通过扫码程序操控所述智能屏，如此能够使用户在现场进行自定义操作，提高用户的体验性和高交互性。In the embodiment of the present invention, a database port connected to the smart screen is acquired, and an external connection interface of the smart screen is created; wherein, the external connection interface includes a voice interface and a code scanning interface; The control buttons are connected in sequence to form a functional connection topology map; then the functional connection topology map is corresponding to the functions learned by NLP to form an NLP recognition model, and an auxiliary program is formed according to the functional connection topology map, and then The NLP recognition model is connected with the voice interface to form a voice control thread, and the auxiliary program is connected with the code scanning interface to form a code scanning control thread; wherein, the voice control thread is used to control the smart screen through voice recognition, and the code scanning control thread is used for Since the smart screen is controlled through a code scanning program, the user can perform custom operations on the spot, and the user experience and high interactivity can be improved.
附图说明Description of drawings
图1为本发明一实施例提供的双线程智能屏控制方法的流程示意图；1 is a schematic flowchart of a dual-thread smart screen control method provided by an embodiment of the present invention;
图2为本发明一实施例提供的双线程智能屏控制装置的模块示意图；2 is a schematic diagram of a module of a dual-thread smart screen control device provided by an embodiment of the present invention;
图3为本发明一实施例提供的实现双线程智能屏控制方法的电子设备的内部结构示意图；3 is a schematic diagram of the internal structure of an electronic device for implementing a dual-thread smart screen control method provided by an embodiment of the present invention;
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。The realization, functional characteristics and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments.
具体实施方式Detailed ways
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
监控大屏系统在政府、医院等各个场景的应用已十分普遍，但是目前的大屏系统都存在页面数据无法现场控制的问题，也就是说，想要变动大屏幕上显示的页面数据，只能通过页面的定时器来刷新，如此用户只能被动等待页面数据的刷新，而不能自主查找自己需要的数据，影响用户的体验的问题。The application of monitoring large-screen systems in various scenarios such as governments and hospitals has been very common, but the current large-screen systems have the problem that page data cannot be controlled on-site. That is to say, if you want to change the page data displayed on the large screen, you can only The page is refreshed by the timer, so the user can only passively wait for the page data to be refreshed, but cannot find the data they need independently, which affects the user experience.
并且，通常监控大屏的页面内容仅能够通过鼠标操作，而大屏通常设置在展厅，主机通常设置在机房，因此导致用户无法进行现场操纵，且机房的专人操控操作成本非常高；即便部分监控显示大屏配备有遥控器，但遥控器操作键有限，往往仅能够通过遥控器进行设定的简单硬件操作，不能进行信息选择、调用等复杂操作。In addition, the page content of the monitoring large screen can only be operated by the mouse, and the large screen is usually set in the exhibition hall, and the host is usually set in the computer room, so the user cannot perform on-site operation, and the operation cost of the special person in the computer room is very high; even some monitoring The large display screen is equipped with a remote control, but the operation keys of the remote control are limited, and often only simple hardware operations can be set through the remote control, and complex operations such as information selection and calling cannot be performed.
为了解决上述问题，本发明提供一种双线程智能屏控制方法。参照图1所示，为本发明一实施例提供的双线程智能屏控制方法的流程示意图。该方法可以由一个装置执行，该装置可以由软件和/或硬件实现。In order to solve the above problems, the present invention provides a dual-thread intelligent screen control method. Referring to FIG. 1 , it is a schematic flowchart of a dual-thread smart screen control method provided by an embodiment of the present invention. The method may be performed by an apparatus, which may be implemented in software and/or hardware.
在本实施例中，双线程智能屏控制方法包括：In this embodiment, the dual-thread smart screen control method includes:
S1：获取与智能屏相连接的数据库端口，并创建智能屏的外挂连接接口；其中，所述外挂连接接口包括语音接口和扫码接口；S1: Acquire a database port connected to the smart screen, and create a plug-in connection interface of the smart screen; wherein, the plug-in connection interface includes a voice interface and a code scanning interface;
S2：通过所述数据库端口在预设数据库中获取所述智能屏中的操控按键，并将所述操控按键进行顺次连接以形成功能连接拓扑图；S2: Obtain the control keys in the smart screen from the preset database through the database port, and connect the control keys in sequence to form a functional connection topology diagram;
S3：将所述功能连接拓扑图与NLP(Neuro-Linguistic Programming，神经语言程序学)学习的功能一一对应以形成NLP识别模型，并根据所述功能连接拓扑图形成辅助程序；S3: One-to-one correspondence between the functional connection topology map and the functions learned by NLP (Neuro-Linguistic Programming) to form an NLP recognition model, and form an auxiliary program according to the functional connection topology map;
S4：将所述NLP识别模型与所述语音接口相连接以形成语音控制线程；以及，将所述辅助程序与所述扫码接口相连接以形成扫码控制线程；其中，所述语音控制线程用于通过语音识别操控所述智能屏，所述扫码控制线程用于通过扫码程序操控所述智能屏。S4: connect the NLP recognition model with the voice interface to form a voice control thread; and connect the auxiliary program with the code scanning interface to form a code scanning control thread; wherein, the voice control thread It is used to control the smart screen through voice recognition, and the code scanning control thread is used to control the smart screen through a code scanning program.
在图1所示的实施例中，步骤S1为获取与智能屏相连接的数据库端口，并创建智能屏的外挂连接接口；其中，所述外挂连接接口包括语音接口和扫码接口的过程，其中，获取与所述智能屏相连接的数据库端口的过程，包括：In the embodiment shown in FIG. 1, step S1 is to obtain the database port connected to the smart screen, and create an external connection interface of the smart screen; wherein, the external connection interface includes a voice interface and a process of scanning a code interface, wherein , the process of obtaining the database port connected with the smart screen includes:
S111：通过预设的密码登陆与所述智能屏相连接的服务端；其中所述服务端与所述智能屏通过Http双向连接；S111: log in to the server connected to the smart screen through a preset password; wherein the server and the smart screen are bidirectionally connected through Http;
S112：通过所述服务端中预设的调取程序获取所述智能屏的配置参数；S112: Acquire configuration parameters of the smart screen through a calling program preset in the server;
S113：解析所述配置参数以获取与所述智能屏相连接的数据库端口；S113: Parse the configuration parameters to obtain a database port connected to the smart screen;
创建智能屏的外挂连接接口的过程包括创建语音接口与扫码接口，其中，The process of creating the plug-in connection interface of the smart screen includes creating a voice interface and a code scanning interface, wherein,
创建语音接口的过程，包括：The process of creating a voice interface, including:
S121-1：预设关键词触发脚本：S121-1: Preset keyword trigger script:
S121-2：按照预存储的关键词反复训练所述关键词触发脚本以形成关键词触发模型；S121-2: Repeatedly train the keyword triggering script according to pre-stored keywords to form a keyword triggering model;
S121-3：基于关键词触发模型和预设的音频接收器形成语音接口；其中，所述音频接收器用于接收用的的语音，并将语音转换为自然语言，所述语音接口用于接收用户的语音，并对所述语音进行解析以获取自然语言，并在该自然语言中提取关键字，并判断所述关键字与所述预存储的关键词是否一致，其中，若一致则通过所述语音接口进入下一程序(下述的NLP控制脚本)，若不一致，则停止智能屏操作；需要说明的，该预设的关键词可以是密码类型的语句，也可以为象征性的语句，在本实施例中，只有拥有操控权限的用户才具有该密码类型的语句，如此提高监控大屏(智能屏)的操控安全性。S121-3: A voice interface is formed based on the keyword trigger model and a preset audio receiver; wherein, the audio receiver is used for receiving the voice for use, and converts the voice into natural language, and the voice interface is used for receiving the user's voice and parse the voice to obtain a natural language, extract keywords from the natural language, and judge whether the keywords are consistent with the pre-stored keywords, and if they are consistent, pass the The voice interface enters the next program (the following NLP control script), if it is inconsistent, stop the smart screen operation; it should be noted that the preset keyword can be a password-type sentence or a symbolic sentence. In this embodiment, only the user who has the control authority has the password type statement, thus improving the control security of the monitoring large screen (smart screen).
创建扫码接口的过程，包括：The process of creating a code scanning interface, including:
S122-1：通过所述服务端中的网络模块向二维码管理服务进行二维码申请；S122-1: Apply for a two-dimensional code to the two-dimensional code management service through the network module in the server;
S122-2：通过所述二维码管理服务对所述二维码申请进行合法性验证；S122-2: Verify the validity of the two-dimensional code application through the two-dimensional code management service;
S122-3：若通过合法性验证，则生成启动二维码；S122-3: If the legality verification is passed, generate a startup QR code;
S122-4：将所述启动二维码作为扫码接口显示在所述智能屏上，并且所述启动二维码按照预设时间定时更新；S122-4: Display the startup QR code as a code scanning interface on the smart screen, and the startup QR code is regularly updated according to a preset time;
具体的，在步骤S11为获取与智能屏相连接的数据库端口的过程，首先需要通过预设的密码登陆服务端，该服务端即为智能屏的后台服务器端，而后台服务器与该智能屏通过http连接；该智能屏为智能显示大屏，可以安装在任意具有展示性质的场合，比如展厅中的展示屏，而该服务端通常设置在机房；在获取数据库端口时首先登陆服务端，通过服务端中地调取程序获取该智能屏所连接的所有装置及软件的配置参数，而后在参数中挑取数据库端口的相关数据，如此后续根据该数据库端口获取数据库中的数据；Specifically, in step S11, for the process of obtaining the database port connected to the smart screen, it is first necessary to log in to the server through a preset password. The server is the backend server of the smart screen, and the backend server and the smart screen pass through http connection; the smart screen is a large smart display screen, which can be installed in any occasion with a display nature, such as a display screen in an exhibition hall, and the server is usually set in the computer room; when obtaining the database port, first log in to the server, and pass the service The end-to-end calling program obtains the configuration parameters of all devices and software connected to the smart screen, and then picks up the relevant data of the database port in the parameters, so that the data in the database is subsequently obtained according to the database port;
步骤S12为创建外挂连接接口的过程；其中，步骤S121为创建语音接口的过程，即创建最先与用户进行交互的语音接口的过程，该语音接口用于识别用户是否在召唤语音线程，创建该语音接口时首先预设关键词触发脚本，而后采用预设的关键词反复训练该关键词触发脚本以形成关键词触发模型，该触发模型可以为对话式人工智能系统的一部分，在本实施例中，该关键词触发模型为训练好的语音单词识别网络，即当用户说关键词时即可唤醒该智能屏的语音操控线程；Step S12 is the process of creating a plug-in connection interface; wherein, step S121 is the process of creating a voice interface, that is, the process of creating a voice interface that interacts with the user first, and the voice interface is used to identify whether the user is calling a voice thread, and create the voice interface. In the voice interface, a keyword triggering script is first preset, and then the keyword triggering script is repeatedly trained using the preset keywords to form a keyword triggering model. The triggering model can be a part of a conversational artificial intelligence system. In this embodiment, , the keyword triggering model is a trained voice word recognition network, that is, when the user speaks a keyword, the voice control thread of the smart screen can be awakened;
步骤S122为创建扫码接口的过程，即创建最先与用户进行交互的扫码接口的过程，通过该扫码接口可触发后台的程序，从而通过扫码的方式建立与智能屏的连接，进而通过手机即可操控该智能屏，在创建该扫码接口时，首先通过服务端向二维码管理服务进行二维码申请，该二维码管理服务可以为服务端本地的服务模块，也可以是通过网络访问的独立的服务模块，在此不作具体限制，在二维码管理服务接收到该二维码申请之后首先进行合法性验证，若通过合法性验证，则生成启动二维码，该启动二维码显示在智能屏上作为扫码接口，可以通过点击智能屏的方式唤醒出该启动二维码，也可以始终将该启动二维码显示在智能屏的角落中，在此不做限制，并且该启动二维码定时更新，而且单人单码，即该启动二维码一经扫描即刻更新，以增加访问该启动二维码的安全性。Step S122 is the process of creating a code-scanning interface, that is, a process of creating a code-scanning interface that interacts with the user first, through which a program in the background can be triggered, thereby establishing a connection with the smart screen by scanning the code, and then The smart screen can be controlled through a mobile phone. When creating the code scanning interface, first apply for a QR code to the QR code management service through the server. The QR code management service can be a local service module on the server, or It is an independent service module accessed through the network, and there is no specific limitation here. After the two-dimensional code management service receives the two-dimensional code application, the legality verification is firstly performed. If the legality verification is passed, the startup two-dimensional code is generated. The startup QR code is displayed on the smart screen as a scanning interface. You can wake up the startup QR code by clicking on the smart screen, or you can always display the startup QR code in the corner of the smart screen. Restrictions, and the activation QR code is updated regularly, and the single-person single code, that is, the activation QR code is updated immediately after scanning, so as to increase the security of accessing the activation QR code.
在图1所示的实施例中，步骤S2为通过所述数据库端口在预设数据库中获取所述智能屏中的操控按键，并将所述操控按键进行顺次连接以形成功能连接拓扑图的过程，包括：In the embodiment shown in FIG. 1 , step S2 is to obtain the control keys in the smart screen from the preset database through the database port, and connect the control keys in sequence to form a functional connection topology diagram. process, including:
S21：在所述数据库中获取所述智能屏中的操控按键；S21: Acquire the control buttons in the smart screen from the database;
S22：标注所述操控按键的操控功能；S22: marking the control function of the control button;
S23：遍历所述操控功能以获取功能列表；S23: Traverse the manipulation functions to obtain a function list;
S24：根据所述功能列表对所述操控功能进行连线处理以形成功能连接拓扑图；S24: Perform connection processing on the control function according to the function list to form a function connection topology diagram;
步骤S21为在数据库中获取智能屏中的操控按键的过程，该操控按键不单指落实到智能屏上的物理按键，还包括服务端中能控制该智能屏的虚拟按键，及所有能够使智能屏发生状态或操作改变的按键，并且将该按键按照逻辑的前后进行排序；Step S21 is the process of acquiring the control keys in the smart screen from the database, the control keys not only refer to the physical keys implemented on the smart screen, but also include virtual keys in the server that can control the smart screen, and all the keys that can make the smart screen work. Buttons whose state or operation has changed, and the buttons are sorted logically before and after;
步骤S23为标注操控按键的操控功能的过程，比如通常第一个为开机键，然后点击菜单键，然后再在菜单键中选择目标键，再点击ok键，从而由步骤S21将开机键-菜单键-目标键-ok键进行排序，而后通过步骤S22进行操控功能的标注，比如在开机键的信息中备注用于设备开机，在菜单键的信息中备注用于功能模块选择，在目标键的信息中备注用于选择目标按键以选择在智能屏中的展示内容，在ok键的信息中备注用于确认目标按键的选择等，如此，明确的标注各个操控按键的操控功能，从而能够形成清晰地功能列表，进而在训练语音识别模型时提高训练精度；Step S23 is the process of marking the control function of the control button. For example, usually the first one is the power-on key, then click the menu key, then select the target key in the menu key, and then click the ok key, so that the power-on key-menu is changed in step S21. The key-target key-ok key is sorted, and then the control function is marked in step S22, for example, in the information of the power-on key, a note is used for device booting, and a note in the information of the menu key is used for function module selection. The remarks in the information are used to select the target key to select the display content on the smart screen, and the remarks in the information of the ok key are used to confirm the selection of the target key, etc. In this way, the control function of each control key is clearly marked, so as to form a clear list of features to improve training accuracy when training speech recognition models;
步骤S24、步骤S25为遍历操控功能以获取功能列表，并形成功能连接拓扑图的过程，步骤S21中将各个操控按键进行初步排序后，在步骤S21的基础上根据功能进行连接，比如ok键的应用频率最高，其上的连接线也最多，如此根据各个操控按键的功能将各个功能线所使用的操控按键连接起来以构成功能连接拓扑图。Step S24 and Step S25 are the process of traversing the manipulation functions to obtain a function list and forming a functional connection topology diagram. The application frequency is the highest, and the connection lines on it are also the most. In this way, the control keys used by each function line are connected according to the functions of each control key to form a functional connection topology diagram.
在图1所示的实施例中，步骤S3为将所述功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据所述功能连接拓扑图形成辅助程序的过程，将所述功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型的过程，包括：In the embodiment shown in FIG. 1 , step S3 is a process of forming an NLP recognition model by one-to-one correspondence between the function connection topology map and the functions learned by NLP, and forming an auxiliary program according to the function connection topology map. The process of forming an NLP recognition model by mapping the above-mentioned functional connection topology map to the functions learned by NLP, including:
S311：在所述功能连接拓扑图中标记学习信息；所述学习信息包括与所述功能列表的每一栏相对应的关键字和与所述关键字关联的字眼；S311: Mark learning information in the function connection topology map; the learning information includes keywords corresponding to each column of the function list and words associated with the keywords;
S312：所述功能连接拓扑图中的各个操控按键与NLP学习的功能一一对应以形成NLP功能脚本；S312: Each control button in the function connection topology diagram corresponds to the function learned by NLP one-to-one to form an NLP function script;
S313：使所述NLP功能脚本根据所述学习信息与与所述操控按键的操控功能进行学习，直至关于NLP功能脚本的反馈函数值达到预设值以形成NLP识别模型；其中，该反馈函数为预设的，其旨在于判断该NLP脚本是否被训练完成，也即是说，使NLP功能脚本根据学习信息与与操控按键的操控功能进行反复学习，若该反馈函数值达到预设值则停止反复学习，并且将最后一次完成学习的NLP功能脚本作为NLP识别模型。S313: Make the NLP function script learn according to the learning information and the manipulation function with the manipulation button, until the feedback function value about the NLP function script reaches a preset value to form an NLP recognition model; wherein, the feedback function is By default, it is designed to judge whether the NLP script has been trained, that is to say, make the NLP function script perform repeated learning according to the learning information and the manipulation function of the control button, and stop if the feedback function value reaches the preset value. Repeat the learning, and use the NLP function script of the last completed learning as the NLP recognition model.
根据所述功能连接拓扑图形成辅助程序的过程，包括：The process of forming an auxiliary program according to the functional connection topology diagram includes:
S321：对所述功能连接拓扑图进行顺次遍历以获取功能总览信息；S321: traverse the function connection topology diagram in sequence to obtain function overview information;
S322：根据所述功能总览信息确定程序逻辑；S322: Determine program logic according to the function overview information;
S323：通过程序编撰语言基于所述程序逻辑生成辅助程序；S323: Generate an auxiliary program based on the program logic through a programming language;
步骤S31为形成NLP识别模型的过程，如此能够通过语音识别操控智能屏；步骤S32为生成辅助程序的过程，该辅助程序在本实施例中通常为微信小程序，如此可通过该辅助程序在手机上自助操控智能屏；Step S31 is the process of forming an NLP recognition model, so that the smart screen can be controlled by voice recognition; Step S32 is the process of generating an auxiliary program, which is usually a WeChat applet in this embodiment, so that the auxiliary program can be used in the mobile phone through the auxiliary program. Self-service control smart screen;
具体的，在步骤S31中，步骤S311为标记学习信息的过程，从而后续可根据该学习信息进行反复的学习训练；该学习信息为关键字和与该关键字相关联的字眼，比如以菜单键为例，与其相关的学习信息即包括“打开”、“选择”、“菜单”、“选项”等关键字，若用户说出与之相关的关键字，则智能屏的后台自动进入菜单键，或经由菜单键直接进入用户所述的目标模块，比如若用户说重置显示栏，则该智能屏能够在后台经由菜单键直接点击显示栏处，从而重置显示栏；Specifically, in step S31, step S311 is the process of marking learning information, so that subsequent learning and training can be repeated according to the learning information; the learning information is a keyword and a word associated with the keyword, such as a menu key For example, the related learning information includes keywords such as "open", "select", "menu", "option", etc. If the user speaks the related keywords, the background of the smart screen will automatically enter the menu button, Or directly enter the target module described by the user via the menu key, for example, if the user says to reset the display bar, the smart screen can directly click the display bar in the background via the menu key, thereby resetting the display bar;
步骤S312、步骤S313首先将功能连接拓扑图中的各个操控键与NLP学习的功能相对应以形成NLP功能脚本，再使NLP功能脚本根据学习信息与与操控按键的操控功能进行反复学习以形成NLP识别模型，具体的学习过程不具体限制，在本实施例中，使NLP功能脚本根据学习信息与与操控按键的操控功能进行反复学习以形成NLP识别模型的过程，包括：Step S312, Step S313 First, each manipulation key in the functional connection topology diagram corresponds to the function learned by NLP to form an NLP function script, and then the NLP function script is repeatedly learned according to the learning information and the manipulation function with the manipulation keys to form an NLP. Recognition model, the specific learning process is not specifically limited, in this embodiment, the NLP function script is repeatedly learned according to the learning information and the control function with the control button to form the process of the NLP recognition model, including:
通过所述NLP功能脚本对所述学习信息进行分类以获取功能结果；Classify the learning information through the NLP function script to obtain a function result;
将所述功能结果与所述操控功能进行比对以获取损失函数；comparing the function result with the manipulation function to obtain a loss function;
根据所述损失函数进行反向传播以更新所述NLP功能脚本，直至所述待NLP功能脚本的的权重达到预设阈值，并将最后一次更新的NLP功能脚本作为NLP识别模型；该识别模型即可实现通过自然语言直接自动操控智能屏。Back-propagation is performed according to the loss function to update the NLP function script until the weight of the to-be-NLP function script reaches a preset threshold, and the last updated NLP function script is used as the NLP identification model; the identification model is The smart screen can be directly and automatically controlled through natural language.
在步骤S32中，首先对功能连接拓扑图进行顺次遍历以获取功能总览信息，该总览信息即为所有能够使智能屏发生状态改变或操作改变的功能信息；而后再根据该功能总览信息切丁程序逻辑，即确定生成一种什么样的程序去操控该智能屏，该程序的逻辑是什么，而后通过程序编撰语言基于该程序逻辑生成辅助程序，即根据步骤S322获取了程序逻辑，再根据该程序逻辑生成辅助程序，从而通过该程序即可实现该程序逻辑，也就是说可以直接通过该程序按照功能连接拓扑图的逻辑控制该智能屏。In step S32, firstly traverse the function connection topology diagram in sequence to obtain function overview information, which is all the function information that can change the state or operation of the smart screen; and then cut into pieces according to the function overview information Program logic, that is, to determine what kind of program to generate to control the smart screen, what is the logic of the program, and then generate an auxiliary program based on the program logic through the programming language, that is, to obtain the program logic according to step S322, and then according to the program logic The program logic generates an auxiliary program, so that the program logic can be realized through the program, that is to say, the smart screen can be controlled directly through the program according to the logic of the functional connection topology diagram.
在图1所示的实施例中，步骤S4为将所述NLP识别模型与所述语音接口相连接以形成语音控制线程，以及将所述辅助程序与所述扫码接口相连接以形成扫码控制线程的过程，所述语音控制线程用于通过语音识别操控所述智能屏，所述扫码控制线程用于通过扫码程序操控所述智能屏；其中，In the embodiment shown in FIG. 1 , step S4 is to connect the NLP recognition model with the voice interface to form a voice control thread, and connect the auxiliary program with the scan code interface to form a scan code A process of controlling a thread, the voice control thread is used to control the smart screen through voice recognition, and the code scanning control thread is used to control the smart screen through a code scanning program; wherein,
通过语音识别操控所述智能屏的过程，包括：The process of controlling the smart screen through voice recognition includes:
S411:通过所述语音控制线程中的语音接口接收用户的指令语音语音和操控语音，并对所述指令语音进行语音识别以形成指令自然语言，若所述指令自然语言与预设的关键字相匹配，则对所述操控语音进行语音识别以获取操控自然语言；S411: Receive the user's command voice and control voice through the voice interface in the voice control thread, and perform voice recognition on the command voice to form a command natural language, if the command natural language is consistent with a preset keyword If it matches, perform speech recognition on the control voice to obtain the control natural language;
S412：将所述操控自然语言输入所述NLP识别模型中，使所述NLP识别模型根据所述操控自然语言自动操控所述智能屏；S412: Input the manipulation natural language into the NLP recognition model, so that the NLP recognition model automatically controls the smart screen according to the manipulation natural language;
通过扫码程序操控所述智能屏的过程，包括：The process of controlling the smart screen through the code scanning program includes:
S421：通过扫描所述扫码控制线程中的扫码接口以连接移动客户端与所述辅助程序；S421: Connect the mobile client and the auxiliary program by scanning the code scanning interface in the code scanning control thread;
S422：通过所述辅助程序操控所述智能屏；S422: Control the smart screen through the auxiliary program;
具体的，步骤S41为利用语音控制线程进行操控的过程，在步骤S41中涉及语音识别技术，机语音转文字的过程，该过程在如今已经非常成熟，识别率非常高，通过语音识别技术可以方便快捷的解析成相关文本，比如说用户想输入“查看某个城市的某项，或多项指标情况”，利用传统的键盘输入需要5-10秒的时间才能打完这段文字，而利用语音识别技术能够在3秒内完成文字的输入和解析，这样大大的节省了用户的时间；Specifically, step S41 is the process of using the voice control thread to control. In step S41, it involves voice recognition technology, the process of converting voice to text. This process is very mature now, and the recognition rate is very high. Through the voice recognition technology, it is convenient to Quickly parse it into relevant text. For example, if the user wants to input "view a certain item in a city, or multiple indicators", it takes 5-10 seconds to type this text using traditional keyboard input, but using voice The recognition technology can complete the text input and analysis within 3 seconds, which greatly saves the user's time;
在步骤S412中，在使所述NLP识别模型根据所述操控自然语言自动操控所述智能屏的过程中，进一步包括：In step S412, in the process of enabling the NLP recognition model to automatically manipulate the smart screen according to the manipulation natural language, further comprising:
对所述操控自然语言进行划分以形成时间维度词和检索维度词；dividing the manipulated natural language to form time-dimension words and retrieval-dimension words;
对所述时间维度词进行转码以获取音码，并根据音码进行纠错，且使用正则表达式进行时间模式的提取以获取时间关键字；同时对所述检索维度词进行分词、去重和保留处理以获取有效词，并根据该有效词匹配操控功能，进而按照操控功能操控智能屏。Transcoding the time dimension words to obtain phonetic codes, performing error correction according to the phonetic codes, and using regular expressions to extract time patterns to obtain time keywords; at the same time, performing word segmentation and deduplication on the retrieval dimension words and reservation processing to obtain a valid word, and match the control function according to the valid word, and then control the smart screen according to the control function.
步骤S42为利用扫码控制线程进行操控的过程，在步骤S42中，步骤S421为扫描扫描接口的过程，在本实施例中，即为扫描二维码的过程，用户使用扫描大屏的二维码，并且授权智能屏，在授权的过程二维码管理服务需要验证二维码是否合法有效，并且返回授权信息给用户，从而通过小程序(辅助程序)实现指定智能屏的控制。Step S42 is the process of using the scanning code control thread to control. In step S42, step S421 is the process of scanning the scanning interface. In this embodiment, it is the process of scanning the two-dimensional code. During the authorization process, the two-dimensional code management service needs to verify whether the two-dimensional code is legal and valid, and returns the authorization information to the user, so as to realize the control of the designated smart screen through the applet (auxiliary program).
在本实施例中，二维码的生成通过国密加密算法、二维码刷新技术以保证接入的安全性。首先每个接入的二维码都需要通过授权appId，appSecret才能进行接入，并且按照SM4算法对传输数据进行加密和解密，另外每个二维码都具有时效性，避免二维码被滥用的可能，另外每个二维码在使用的过程都会刷新其有效性，保证了二维码不在使用过程当中失效；In this embodiment, the generation of the two-dimensional code adopts the national secret encryption algorithm and the two-dimensional code refresh technology to ensure the security of access. First of all, each accessed QR code needs to be accessed through the authorized appId and appSecret, and the transmitted data is encrypted and decrypted according to the SM4 algorithm. In addition, each QR code is time-sensitive to prevent the QR code from being abused. In addition, each QR code will refresh its validity during use, ensuring that the QR code does not become invalid during use;
此外，在本实施例中，该扫码控制线程和语音控制线程可以相互连接，用户发送语音指令控制的同时可以对扫描的二维码有效性进行验证和刷新时效。In addition, in this embodiment, the code scanning control thread and the voice control thread can be connected to each other, and the user can verify the validity of the scanned two-dimensional code and refresh the time limit while sending the voice command to control.
本发明提供的双线程智能屏控制方法，首先获取与智能屏相连接的数据库端口，并创建智能屏的外挂连接接口；其中，外挂连接接口包括语音接口和扫码接口；通过数据库端口在预设数据库中获取所述智能屏中的操控按键，并将操控按键进行顺次连接以形成功能连接拓扑图；而后将功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据功能连接拓扑图形成辅助程序，再将NLP识别模型与语音接口相连接以形成语音控制线程，将辅助程序与扫码接口相连接以形成扫码控制线程；其中，语音控制线程用于通过语音识别操控智能屏，扫码控制线程用于通过扫码程序操控所述智能屏，如此能够使用户在现场进行自定义操作，提高用户的体验性和高交互性。In the dual-thread smart screen control method provided by the present invention, the database port connected to the smart screen is first obtained, and an external connection interface of the smart screen is created; wherein, the external connection interface includes a voice interface and a code scanning interface; The control keys in the smart screen are obtained from the database, and the control keys are sequentially connected to form a functional connection topology map; then the functional connection topology map is corresponding to the functions learned by NLP to form an NLP recognition model, and according to the function Connect the topology diagram to form an auxiliary program, then connect the NLP recognition model with the voice interface to form a voice control thread, and connect the auxiliary program with the code scanning interface to form a code scanning control thread; wherein, the voice control thread is used for manipulation through voice recognition. For the smart screen, the scanning code control thread is used to control the smart screen through the scanning code program, so that the user can perform custom operations on the spot and improve the user experience and high interactivity.
如上所述，在图1所示的实施例中，本发明提供的双线程智能屏控制方法，具有如下好处：1、通过设置关键词触发模型与音频接收器，即可直接判断用户是否有语音操控的需求，换句话说用户在说关键词时即可调用大屏的语音识别系统；2、根据功能列表对操控功能进行连线处理以形成功能连接拓扑图，该功能连接拓扑图与NLP学习的功能一一对应，如此可通过NLP识别模型自动操控大屏；3、用户使用扫描大屏的二维码，并且授权智能屏，在授权的过程二维码管理服务需要验证二维码是否合法有效，并且返回授权信息给用户，从而通过小程序(辅助程序)实现指定智能屏的控制，提高用户的体验性。As mentioned above, in the embodiment shown in FIG. 1 , the dual-thread smart screen control method provided by the present invention has the following advantages: 1. By setting the keyword trigger model and the audio receiver, it can be directly judged whether the user has a voice Manipulation requirements, in other words, users can call the large-screen speech recognition system when they say keywords; 2. Connect the manipulation functions according to the function list to form a function connection topology map, which connects the topology map and NLP learning One-to-one correspondence between the functions, so that the large screen can be automatically controlled through the NLP recognition model; 3. The user scans the QR code on the large screen and authorizes the smart screen. During the authorization process, the QR code management service needs to verify whether the QR code is legal or not. It is effective, and the authorization information is returned to the user, so as to realize the control of the designated smart screen through the applet (auxiliary program), and improve the user's experience.
如图2所示，本发明提供一种双线程智能屏控制装置100，本发明可以安装于电子设备中。根据实现的功能，该双线程智能屏控制装置100可以包括接口创建单元101、拓扑生成单元102、程序辅助单元103、线程生成单元104。本发明所述模块也可以称之为单元，是指一种能够被电子设备处理器所执行，并且能够完成固定功能的一系列计算机程序段，其存储在电子设备的存储器中。As shown in FIG. 2 , the present invention provides a dual-thread smart screen control device 100, and the present invention can be installed in an electronic device. According to the realized functions, the dual-thread smart screen control apparatus 100 may include an interface creation unit 101 , a topology generation unit 102 , a program auxiliary unit 103 , and a thread generation unit 104 . The modules in the present invention can also be called units, which refer to a series of computer program segments that can be executed by the electronic device processor and can perform fixed functions, and are stored in the memory of the electronic device.
在本实施例中，关于各模块/单元的功能如下：In this embodiment, the functions of each module/unit are as follows:
接口创建单元101，用于获取与智能屏相连接的数据库端口，并创建智能屏的外挂连接接口；其中，所述外挂连接接口包括语音接口和扫码接口；The interface creation unit 101 is used for acquiring the database port connected with the smart screen, and creating a plug-in connection interface of the smart screen; wherein, the plug-in connection interface includes a voice interface and a code scanning interface;
拓扑生成单元102，用于通过所述数据库端口在预设数据库中获取所述智能屏中的操控按键，并将所述操控按键进行顺次连接以形成功能连接拓扑图；A topology generating unit 102, configured to obtain the control keys in the smart screen from a preset database through the database port, and connect the control keys in sequence to form a functional connection topology diagram;
程序辅助单元103，用于将所述功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据所述功能连接拓扑图形成辅助程序；A program assistance unit 103, used for one-to-one correspondence between the functional connection topology map and the functions learned by NLP to form an NLP recognition model, and to form an auxiliary program according to the functional connection topology map;
线程生成单元104，用于将所述NLP识别模型与所述语音接口相连接以形成语音控制线程；以及，将所述辅助程序与所述扫码接口相连接以形成扫码控制线程；其中，所述语音控制线程用于通过语音识别操控所述智能屏，所述扫码控制线程用于通过扫码程序操控所述智能屏。A thread generation unit 104, configured to connect the NLP recognition model with the voice interface to form a voice control thread; and, connect the auxiliary program with the code scanning interface to form a code scanning control thread; wherein, The voice control thread is used to control the smart screen through voice recognition, and the code scanning control thread is used to control the smart screen through a code scanning program.
具体的实现步骤参照上述双线程智能屏控制方法的具体实施例，在此不做赘述。The specific implementation steps refer to the specific embodiments of the above-mentioned dual-thread smart screen control method, which will not be repeated here.
如上所述，本发明提供的双线程智能屏控制装置，首先通过接口创建单元101获取与智能屏相连接的数据库端口，并创建智能屏的外挂连接接口；其中，外挂连接接口包括语音接口和扫码接口；再利用拓扑生成单元102通过数据库端口在预设数据库中获取所述智能屏中的操控按键，并将操控按键进行顺次连接以形成功能连接拓扑图；而后通过程序辅助单元103将功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据功能连接拓扑图形成辅助程序，再通过线程生成单元104将NLP识别模型与语音接口相连接以形成语音控制线程，将辅助程序与扫码接口相连接以形成扫码控制线程；其中，语音控制线程用于通过语音识别操控智能屏，扫码控制线程用于通过扫码程序操控所述智能屏，如此能够使用户在现场进行自定义操作，提高用户的体验性和高交互性。As mentioned above, the dual-thread smart screen control device provided by the present invention first obtains the database port connected with the smart screen through the interface creation unit 101, and creates an external connection interface of the smart screen; wherein, the external connection interface includes a voice interface and a scanning interface. code interface; then use the topology generation unit 102 to obtain the control buttons in the smart screen through the database port in the preset database, and connect the control buttons in sequence to form a functional connection topology diagram; The connection topology map and the functions learned by NLP are in one-to-one correspondence to form an NLP recognition model, and an auxiliary program is formed according to the functional connection topology map, and then the NLP recognition model is connected with the voice interface through the thread generation unit 104 to form a voice control thread. The program is connected with the code scanning interface to form a code scanning control thread; wherein, the voice control thread is used to control the smart screen through voice recognition, and the code scanning control thread is used to control the smart screen through the code scanning program, so that the user can be on the scene. Perform custom operations to improve user experience and high interactivity.
本发明提供的双线程智能屏控制装置，具有如下好处：1、通过设置关键词触发模型与音频接收器，即可直接判断用户是否有语音操控的需求，换句话说用户在说关键词时即可调用大屏的语音识别系统；2、根据功能列表对操控功能进行连线处理以形成功能连接拓扑图，该功能连接拓扑图与NLP学习的功能一一对应，如此可通过NLP识别模型自动操控大屏；3、用户使用扫描大屏的二维码，并且授权智能屏，在授权的过程二维码管理服务需要验证二维码是否合法有效，并且返回授权信息给用户，从而通过小程序(辅助程序)实现指定智能屏的控制，提高用户的体验性。The dual-thread intelligent screen control device provided by the present invention has the following advantages: 1. By setting the keyword trigger model and the audio receiver, it can be directly judged whether the user has a demand for voice control, in other words, when the user speaks the keyword, The large-screen speech recognition system can be invoked; 2. Connect the control functions according to the function list to form a functional connection topology map, which corresponds to the functions learned by NLP, so that it can be automatically controlled by the NLP recognition model. Large screen; 3. The user scans the QR code on the large screen and authorizes the smart screen. During the authorization process, the QR code management service needs to verify whether the QR code is legal and valid, and return the authorization information to the user, so as to pass the applet ( Auxiliary program) to realize the control of the designated smart screen and improve the user experience.
如图3所示，本发明提供一种双线程智能屏控制方法的电子设备1。As shown in FIG. 3 , the present invention provides an electronic device 1 with a dual-thread smart screen control method.
该电子设备1可以包括处理器10、存储器11和总线，还可以包括存储在存储器11中并可在所述处理器10上运行的计算机程序，如双线程智能屏控制程序12。The electronic device 1 may include a processor 10, a memory 11 and a bus, and may also include a computer program stored in the memory 11 and run on the processor 10, such as a dual-threaded smart screen control program 12.
其中，所述存储器11至少包括一种类型的可读存储介质，所述可读存储介质包括闪存、移动硬盘、多媒体卡、卡型存储器(例如：SD或DX存储器等)、磁性存储器、磁盘、光盘等。所述存储器11在一些实施例中可以是电子设备1的内部存储单元，例如该电子设备1的移动硬盘。所述存储器11在另一些实施例中也可以是电子设备1的外部存储设备，例如电子设备1上配备的插接式移动硬盘、智能存储卡(Smart Media Card，SMC)、安全数字(SecureDigital，SD)卡、闪存卡(Flash Card)等。进一步地，所述存储器11还可以既包括电子设备1的内部存储单元也包括外部存储设备。所述存储器11不仅可以用于存储安装于电子设备1的应用软件及各类数据，例如双线程智能屏控制程序的代码等，还可以用于暂时地存储已经输出或者将要输出的数据。Wherein, the memory 11 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, mobile hard disk, multimedia card, card-type memory (for example: SD or DX memory, etc.), magnetic memory, magnetic disk, CD etc. The memory 11 may be an internal storage unit of the electronic device 1 in some embodiments, such as a mobile hard disk of the electronic device 1 . In other embodiments, the memory 11 may also be an external storage device of the electronic device 1, such as a pluggable mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, flash memory card (Flash Card), etc. Further, the memory 11 may also include both an internal storage unit of the electronic device 1 and an external storage device. The memory 11 can not only be used to store application software installed in the electronic device 1 and various data, such as the code of a dual-threaded smart screen control program, etc., but also can be used to temporarily store data that has been output or will be output.
所述处理器10在一些实施例中可以由集成电路组成，例如可以由单个封装的集成电路所组成，也可以是由多个相同功能或不同功能封装的集成电路所组成，包括一个或者多个中央处理器(Central Processing unit，CPU)、微处理器、数字处理芯片、图形处理器及各种控制芯片的组合等。所述处理器10是所述电子设备的控制核心(Control Unit)，利用各种接口和线路连接整个电子设备的各个部件，通过运行或执行存储在所述存储器11内的程序或者模块(例如双线程智能屏控制程序等)，以及调用存储在所述存储器11内的数据，以执行电子设备1的各种功能和处理数据。In some embodiments, the processor 10 may be composed of integrated circuits, for example, may be composed of a single packaged integrated circuit, or may be composed of multiple integrated circuits packaged with the same function or different functions, including one or more integrated circuits. Central processing unit (Central Processing Unit, CPU), microprocessor, digital processing chip, graphics processor and combination of various control chips, etc. The processor 10 is the control core (Control Unit) of the electronic device, and uses various interfaces and lines to connect various components of the entire electronic device, and by running or executing the programs or modules (for example, dual Thread smart screen control program, etc.), and call the data stored in the memory 11 to execute various functions of the electronic device 1 and process data.
所述总线可以是外设部件互连标准(peripheral component interconnect，简称PCI)总线或扩展工业标准结构(extended industry standard architecture，简称EISA)总线等。该总线可以分为地址总线、数据总线、控制总线等。所述总线被设置为实现所述存储器11以及至少一个处理器10等之间的连接通信。The bus may be a peripheral component interconnect (PCI for short) bus or an extended industry standard architecture (extended industry standard architecture, EISA for short) bus or the like. The bus can be divided into address bus, data bus, control bus and so on. The bus is configured to implement connection communication between the memory 11 and at least one processor 10 and the like.
图3仅示出了具有部件的电子设备，本领域技术人员可以理解的是，图3示出的结构并不构成对所述电子设备1的限定，可以包括比图示更少或者更多的部件，或者组合某些部件，或者不同的部件布置。FIG. 3 only shows an electronic device with components. Those skilled in the art can understand that the structure shown in FIG. 3 does not constitute a limitation on the electronic device 1, and may include fewer or more components than those shown in the figure. components, or a combination of certain components, or a different arrangement of components.
例如，尽管未示出，所述电子设备1还可以包括给各个部件供电的电源(比如电池)，优选地，电源可以通过电源管理装置与所述至少一个处理器10逻辑相连，从而通过电源管理装置实现充电管理、放电管理、以及功耗管理等功能。电源还可以包括一个或一个以上的直流或交流电源、再充电装置、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。所述电子设备1还可以包括多种传感器、蓝牙模块、Wi-Fi模块等，在此不再赘述。For example, although not shown, the electronic device 1 may also include a power supply (such as a battery) for powering the various components, preferably, the power supply may be logically connected to the at least one processor 10 through a power management device, so that the power management The device implements functions such as charge management, discharge management, and power consumption management. The power source may also include one or more DC or AC power sources, recharging devices, power failure detection circuits, power converters or inverters, power status indicators, and any other components. The electronic device 1 may further include various sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.
进一步地，所述电子设备1还可以包括网络接口，可选地，所述网络接口可以包括有线接口和/或无线接口(如WI-FI接口、蓝牙接口等)，通常用于在该电子设备1与其他电子设备之间建立通信连接。Further, the electronic device 1 may also include a network interface, optionally, the network interface may include a wired interface and/or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is usually used in the electronic device 1 Establish a communication connection with other electronic devices.
可选地，该电子设备1还可以包括用户接口，用户接口可以是显示器(Display)、输入单元(比如键盘(Keyboard))，可选地，用户接口还可以是标准的有线接口、无线接口。可选地，在一些实施例中，显示器可以是LED显示器、液晶显示器、触控式液晶显示器以及OLED(Organic Light-Emitting Diode，有机发光二极管)触摸器等。其中，显示器也可以适当的称为显示屏或显示单元，用于显示在电子设备1中处理的信息以及用于显示可视化的用户界面。Optionally, the electronic device 1 may further include a user interface, and the user interface may be a display (Display), an input unit (eg, a keyboard (Keyboard)), optionally, the user interface may also be a standard wired interface or a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, and the like. The display may also be appropriately called a display screen or a display unit, which is used for displaying information processed in the electronic device 1 and for displaying a visualized user interface.
应该了解，所述实施例仅为说明之用，在专利申请范围上并不受此结构的限制。It should be understood that the embodiments are only used for illustration, and are not limited by this structure in the scope of the patent application.
所述电子设备1中的所述存储器11存储的双线程智能屏控制程序12是多个指令的组合，在所述处理器10中运行时，可以实现：The dual-threaded smart screen control program 12 stored in the memory 11 in the electronic device 1 is a combination of multiple instructions, and when running in the processor 10, it can realize:
获取与智能屏相连接的数据库端口，并创建智能屏的外挂连接接口；其中，所述外挂连接接口包括语音接口和扫码接口；Obtain the database port connected with the smart screen, and create a plug-in connection interface of the smart screen; wherein, the plug-in connection interface includes a voice interface and a code scanning interface;
通过所述数据库端口在预设数据库中获取所述智能屏中的操控按键，并将所述操控按键进行顺次连接以形成功能连接拓扑图；Obtain the control keys in the smart screen from the preset database through the database port, and connect the control keys in sequence to form a functional connection topology diagram;
将所述功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据所述功能连接拓扑图形成辅助程序；One-to-one correspondence between the functional connection topology map and the functions learned by NLP to form an NLP recognition model, and form an auxiliary program according to the functional connection topology map;
将所述NLP识别模型与所述语音接口相连接以形成语音控制线程；以及，将所述辅助程序与所述扫码接口相连接以形成扫码控制线程；其中，所述语音控制线程用于通过语音识别操控所述智能屏，所述扫码控制线程用于通过扫码程序操控所述智能屏。Connect the NLP recognition model with the voice interface to form a voice control thread; and connect the auxiliary program with the code scanning interface to form a code scanning control thread; wherein the voice control thread is used for The smart screen is controlled by voice recognition, and the code scanning control thread is used to control the smart screen through a code scanning program.
具体地，所述处理器10对上述指令的具体实现方法可参考图1对应实施例中相关步骤的描述，在此不赘述。需要强调的是，为进一步保证上述双线程智能屏控制的私密和安全性，上述双线程智能屏控制的数据存储于本服务器集群所处区块链的节点中。Specifically, for the specific implementation method of the above-mentioned instruction by the processor 10, reference may be made to the description of the relevant steps in the corresponding embodiment of FIG. 1, and details are not described herein. It should be emphasized that, in order to further ensure the privacy and security of the above-mentioned dual-threaded smart screen control, the data controlled by the above-mentioned dual-threaded smart screen is stored in the node of the blockchain where the server cluster is located.
服务器可以是独立的服务器，也可以是提供云服务、云数据库、云计算、云函数、云存储、网络服务、云通信、中间件服务、域名服务、安全服务、内容分发网络(ContentDelivery Network，CDN)、以及大数据和人工智能平台等基础云计算服务的云服务器。The server can be an independent server, or it can provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, and Content Delivery Network (CDN). ), as well as cloud servers for basic cloud computing services such as big data and artificial intelligence platforms.
进一步地，所述电子设备1集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。所述计算机可读介质可以包括：能够携带所述计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM，Read-Only Memory)。Further, if the modules/units integrated in the electronic device 1 are implemented in the form of software functional units and sold or used as independent products, they may be stored in a computer-readable storage medium. The computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) .
本发明实施例还提供一种计算机可读存储介质，所述存储介质可以是非易失性的，也可以是易失性的，所述存储介质存储有计算机程序，所述计算机程序被处理器执行时实现：An embodiment of the present invention further provides a computer-readable storage medium, the storage medium may be non-volatile or volatile, and the storage medium stores a computer program, and the computer program is executed by a processor When realized:
获取与智能屏相连接的数据库端口，并创建智能屏的外挂连接接口；其中，所述外挂连接接口包括语音接口和扫码接口；Obtain the database port connected with the smart screen, and create a plug-in connection interface of the smart screen; wherein, the plug-in connection interface includes a voice interface and a code scanning interface;
通过所述数据库端口在预设数据库中获取所述智能屏中的操控按键，并将所述操控按键进行顺次连接以形成功能连接拓扑图；Obtain the control keys in the smart screen from the preset database through the database port, and connect the control keys in sequence to form a functional connection topology diagram;
将所述功能连接拓扑图与NLP学习的功能一一对应以形成NLP识别模型，并根据所述功能连接拓扑图形成辅助程序；One-to-one correspondence between the functional connection topology map and the functions learned by NLP to form an NLP recognition model, and form an auxiliary program according to the functional connection topology map;
将所述NLP识别模型与所述语音接口相连接以形成语音控制线程；以及，将所述辅助程序与所述扫码接口相连接以形成扫码控制线程；其中，所述语音控制线程用于通过语音识别操控所述智能屏，所述扫码控制线程用于通过扫码程序操控所述智能屏。Connect the NLP recognition model with the voice interface to form a voice control thread; and connect the auxiliary program with the code scanning interface to form a code scanning control thread; wherein the voice control thread is used for The smart screen is controlled by voice recognition, and the code scanning control thread is used to control the smart screen through a code scanning program.
具体地，所述计算机程序被处理器执行时具体实现方法可参考实施例双线程智能屏控制方法中相关步骤的描述，在此不赘述。Specifically, for the specific implementation method when the computer program is executed by the processor, reference may be made to the description of the relevant steps in the dual-thread smart screen control method in the embodiment, which will not be repeated here.
在本发明所提供的几个实施例中，应该理解到，所揭露的设备，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the modules is only a logical function division, and there may be other division manners in actual implementation.
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的，作为模块显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The modules described as separate components may or may not be physically separated, and components shown as modules may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
另外，在本发明各个实施例中的各功能模块可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用硬件加软件功能模块的形式实现。In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or can be implemented in the form of hardware plus software function modules.
对于本领域技术人员而言，显然本发明不限于上述示范性实施例的细节，而且在不背离本发明的精神或基本特征的情况下，能够以其他的具体形式实现本发明。It will be apparent to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, but that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics of the invention.
因此，无论从哪一点来看，均应将实施例看作是示范性的，而且是非限制性的，本发明的范围由所附权利要求而不是上述说明限定，因此旨在将落在权利要求的等同要件的含义和范围内的所有变化涵括在本发明内。不应将权利要求中的任何附关联图标记视为限制所涉及的权利要求。Therefore, the embodiments are to be regarded in all respects as illustrative and not restrictive, and the scope of the invention is to be defined by the appended claims rather than the foregoing description, which are therefore intended to fall within the scope of the claims. All changes within the meaning and range of the equivalents of , are included in the present invention. Any reference signs in the claims shall not be construed as limiting the involved claim.
本发明所指区块链是分布式数据存储、点对点传输、共识机制、加密算法等计算机技术的新型应用模式。区块链(Blockchain)，本质上是一个去中心化的数据库，是一串使用密码学方法相关联产生的数据块，每一个数据块中包含了一批次网络交易的信息，用于验证其信息的有效性(防伪)和生成下一个区块。区块链可以包括区块链底层平台、平台产品服务层以及应用服务层等。The blockchain referred to in the present invention is a new application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithm. Blockchain, essentially a decentralized database, is a series of data blocks associated with cryptographic methods. Each data block contains a batch of network transaction information to verify its Validity of information (anti-counterfeiting) and generation of the next block. The blockchain can include the underlying platform of the blockchain, the platform product service layer, and the application service layer.
此外，显然“包括”一词不排除其他单元或步骤，单数不排除复数。系统权利要求中陈述的多个单元或装置也可以由一个单元或装置通过软件或者硬件来实现。第二等词语用来表示名称，而并不表示任何特定的顺序。Furthermore, it is clear that the word "comprising" does not exclude other units or steps and the singular does not exclude the plural. Several units or means recited in the system claims can also be realized by one unit or means by means of software or hardware. Second-class terms are used to denote names and do not denote any particular order.
最后应说明的是，以上实施例仅用以说明本发明的技术方案而非限制，尽管参照较佳实施例对本发明进行了详细说明，本领域的普通技术人员应当理解，可以对本发明的技术方案进行修改或等同替换，而不脱离本发明技术方案的精神和范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be Modifications or equivalent substitutions can be made without departing from the spirit and scope of the technical solutions of the present invention.
Claims (10)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210064870.XACN114387969A (en) | 2022-01-20 | 2022-01-20 | Dual-thread smart screen control method, device, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210064870.XACN114387969A (en) | 2022-01-20 | 2022-01-20 | Dual-thread smart screen control method, device, electronic device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114387969Atrue CN114387969A (en) | 2022-04-22 |
Family
ID=81203577
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210064870.XAPendingCN114387969A (en) | 2022-01-20 | 2022-01-20 | Dual-thread smart screen control method, device, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114387969A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150189362A1 (en)* | 2013-12-27 | 2015-07-02 | Samsung Electronics Co., Ltd. | Display apparatus, server apparatus, display system including them, and method for providing content thereof |
| CN109981761A (en)* | 2019-03-14 | 2019-07-05 | 南京乐美达电子科技有限公司 | Method based on small routine manipulation large screen |
| CN110232916A (en)* | 2019-05-10 | 2019-09-13 | 平安科技（深圳）有限公司 | Method of speech processing, device, computer equipment and storage medium |
| CN110489350A (en)* | 2019-09-12 | 2019-11-22 | 苏州浪潮智能科技有限公司 | A kind of servomechanism test method based on NLP |
| CN110660391A (en)* | 2019-09-29 | 2020-01-07 | 苏州思必驰信息科技有限公司 | Method and system for customizing voice control of large-screen terminal based on RPA (resilient packet Access) interface |
| CN114357265A (en)* | 2021-12-13 | 2022-04-15 | 中电投新疆能源化工集团陇西新能源有限责任公司 | Wind turbine blade fault classification method and system based on NLP |
- 2022
- 2022-01-20CNCN202210064870.XApatent/CN114387969A/enactivePending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150189362A1 (en)* | 2013-12-27 | 2015-07-02 | Samsung Electronics Co., Ltd. | Display apparatus, server apparatus, display system including them, and method for providing content thereof |
| CN109981761A (en)* | 2019-03-14 | 2019-07-05 | 南京乐美达电子科技有限公司 | Method based on small routine manipulation large screen |
| CN110232916A (en)* | 2019-05-10 | 2019-09-13 | 平安科技（深圳）有限公司 | Method of speech processing, device, computer equipment and storage medium |
| CN110489350A (en)* | 2019-09-12 | 2019-11-22 | 苏州浪潮智能科技有限公司 | A kind of servomechanism test method based on NLP |
| CN110660391A (en)* | 2019-09-29 | 2020-01-07 | 苏州思必驰信息科技有限公司 | Method and system for customizing voice control of large-screen terminal based on RPA (resilient packet Access) interface |
| CN114357265A (en)* | 2021-12-13 | 2022-04-15 | 中电投新疆能源化工集团陇西新能源有限责任公司 | Wind turbine blade fault classification method and system based on NLP |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022105493A1 (en) | Semantic recognition-based data query method and apparatus, device and storage medium | |
| CN111433736A (en) | Machine control system, machine control method, and program | |
| RU2632122C2 (en) | Method and password verification device for inspecting input password and computer system containing password verification device | |
| CN112528262A (en) | Application program access method, device, medium and electronic equipment based on token | |
| US12021864B2 (en) | Systems and methods for contactless authentication using voice recognition | |
| US12167101B2 (en) | Validating parameters on discrete computing applications to grant access control to content or commands | |
| CN101442410A (en) | Method and apparatus for generating dynamic cipher, and application system containing the apparatus | |
| CN110555072A (en) | Data access method, device, equipment and medium | |
| CN114004206B (en) | Form generation method, device, computer equipment and storage medium | |
| CN106156598A (en) | A kind of Quick Response Code privacy logs in protection system and method | |
| CN112487790A (en) | Improved semantic parser including coarse semantic parser and fine semantic parser | |
| US10402557B2 (en) | Verification that an authenticated user is in physical possession of a client device | |
| US20230085367A1 (en) | Authorization processing method, electronic device, and non-transitory computer-readable storage medium | |
| CN116225424A (en) | General model effect display method, device, equipment and storage medium | |
| CN113506108B (en) | Account management method, device, terminal and storage medium | |
| CN114387969A (en) | Dual-thread smart screen control method, device, electronic device and storage medium | |
| CN118197305A (en) | Voice control method and device and electronic equipment | |
| US20230004989A1 (en) | Customer recognition system | |
| US11501011B2 (en) | Method for defining policy across information model exposed via an application programming interface | |
| WO2022267181A1 (en) | Method and apparatus for generating code list, computer device, and storage medium | |
| CN114650436B (en) | Remote control method, device, equipment and medium based on background service | |
| CN106557296B (en) | Method and device for acquiring sound information | |
| US20240160912A1 (en) | Machine-learning model for intelligent rule generation | |
| CN114281849B (en) | Data query method and device | |
| CN120743397A (en) | Method, apparatus, device and medium for creating a digital assistant |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right | Effective date of registration:20220928 Address after:518066 2601 (Unit 07), Qianhai Free Trade Building, No. 3048, Xinghai Avenue, Nanshan Street, Qianhai Shenzhen-Hong Kong Cooperation Zone, Shenzhen, Guangdong, China Applicant after:Shenzhen Ping An Smart Healthcare Technology Co.,Ltd. Address before:1-34 / F, Qianhai free trade building, 3048 Xinghai Avenue, Mawan, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong 518000 Applicant before:Ping An International Smart City Technology Co.,Ltd. |