Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: receiving a control instruction triggered on a terminal; searching user habit data in a preset user habit database according to the triggered control instruction, wherein each control instruction is correspondingly bound with the user habit data in the user habit database; and if the user habit data bound with the triggered control instruction is found, executing the operation associated with the corresponding user habit data, thereby realizing the requirement that the intelligent interactive software finishes the things meeting the user habits, and improving the use experience of the user.
Taking a mobile phone voice assistant as an example, because the current mobile phone voice assistant function usually responds to an instruction to perform an operation, and generally, the one-to-one corresponding relationship is not changeable. For the user, such functional rules are relatively rigid, and in many scenarios, the user actually wants the voice assistant to help complete more things, and preferably actively helps the user to complete things according with the living habits of each user. That is, in the prior art, the voice assistant usually performs one operation corresponding to one instruction, and cannot meet the requirement that a user performs multiple steps of operations corresponding to one instruction.
The invention provides a solution, which can realize the requirement of intelligent interactive software for completing things meeting the habit of a user, and can realize that one voice instruction can complete multi-step automatic operation by taking the voice instruction as an example, meet the requirement of the user and improve the use experience of the user.
Specifically, as shown in fig. 1, a first embodiment of the present invention proposes a method for controlling a terminal, including:
step S101, receiving a control instruction triggered on a terminal;
the execution main body of the embodiment may be a terminal, or may also be a device for controlling the terminal, and the device may be configured by hardware, or may be carried on the terminal in the form of software.
The scheme of the embodiment mainly relates to the application of intelligent interaction software on the terminal, such as a mobile phone voice assistant.
The control instruction is a conditional instruction for triggering a user to perform a relevant operation on the terminal, and includes, but is not limited to, a voice instruction, which is triggered by a mobile phone voice assistant application in this embodiment, for example, and the control of the terminal is realized by voice.
The terminal related to the embodiment is provided with the voice assistant application, and the user can realize that the voice control terminal executes corresponding operation through the voice assistant application.
As an implementation mode, the user can wake up the voice assistant application by clicking a voice assistant icon on the desktop of the terminal or wake up the voice assistant application by a corresponding menu option on the terminal.
And at the terminal side, after receiving the awakening instruction of the user, the terminal starts the voice assistant application according to the awakening instruction of the user.
Step S102, searching user habit data in a preset user habit database according to the triggered control instruction, wherein each control instruction is correspondingly bound with the user habit data in the user habit database;
in this embodiment, a user habit database is created in advance, a series of operations that a user is used to after using an application and a control instruction corresponding to the application function are stored in the user habit database, and the series of operations and the corresponding control instruction are bound and stored. That is to say, in the user habit database, each control instruction correspondingly binds user habit data with a plurality of step operations.
Taking the voice instruction as an example, in this embodiment, a user habit database is created in advance, a series of operations that a user is used to after using the voice function and a voice instruction corresponding to the voice function are stored in the user habit database, and the series of operations and the corresponding voice instruction are bound and stored. That is, in the user habit database, each voice instruction corresponds to and binds user habit data with a plurality of step operations.
The series of operations used by the user after the user uses the voice function are obtained by screening according to a series of operations after the user uses the voice function within a period of time.
After a voice instruction triggered by a user after the user uses the terminal voice assistant application is received, a preset user habit database is searched according to the voice instruction, and whether a series of user habitual operations corresponding to the voice instruction exist in the user habit database or not is judged.
Step S103, if the user habit data bound with the triggered control instruction is found, executing the operation associated with the corresponding user habit data.
And if the user habit data bound with the voice command triggered by the user is found, executing a series of operations corresponding to the voice command.
Therefore, by the scheme, the user habit database is created in advance, when a voice instruction triggered by a user after the user uses a terminal voice assistant application is received, the preset user habit database is searched according to the voice instruction triggered by the user, and user habit data with a plurality of steps of operation are correspondingly bound in each voice instruction in the user habit database; and if the user habit data bound with the voice command triggered by the user is found, executing corresponding multi-step operation, so that the aim of performing multi-step combined operation corresponding to one voice command is fulfilled, the requirements of the user are met, and the use experience of the user is improved.
As shown in fig. 2, a second embodiment of the present invention provides a method for controlling a terminal, including:
step S80, in a preset time period, when receiving a control instruction triggered by a user on a terminal, monitoring a series of operations in a preset time period, and recording and storing the operations;
step S90, a series of operations with a plurality of step operations meeting preset rules are screened out from the series of operations stored in the preset time period and used as the use habit data of the user, and corresponding control instructions are obtained;
and S100, binding the screened use habit data of the user with the corresponding control instruction.
Step S201, receiving a control instruction triggered on a terminal;
step S202, searching user habit data in a preset user habit database according to the triggered control instruction, wherein each control instruction is correspondingly bound with the user habit data in the user habit database;
step S203, if the user habit data bound to the triggered control instruction is found, executing an operation associated with the corresponding user habit data.
Steps S201, S202, and S203 are the same as steps S101, S102, and S103 in the first embodiment described in fig. 1, and are not described again here.
Compared with the first embodiment, in the embodiment, the method further includes creating a user habit database, and in the user habit database, binding the use habit data of the user with the corresponding control instruction.
Taking the voice instruction as an example, after the user wakes up the voice assistant, a series of operations performed by the user after using the voice function are recorded through real-time monitoring, and after the user repeats the same series of operations for a plurality of times (more than 3 times), the voice assistant automatically binds the series of operations after using the voice function with the voice instruction corresponding to the voice function, so that the aim of performing multi-step combined operation corresponding to one instruction is fulfilled.
Specifically, in a preset time period, when a voice instruction triggered by a user after the user uses a terminal voice assistant application is received each time, a series of operations within a preset time length after the user uses the terminal voice assistant application this time are monitored, recorded and stored;
screening a series of operations with a plurality of steps which meet preset rules from the series of operations stored in the preset time period, using the series of operations as the use habit data of the user, and acquiring a corresponding voice instruction;
as an embodiment, a target series of operations repeated a preset number of times (for example, 3 times) may be screened from each series of operations stored within the preset time period, as the usage habit data of the user;
or, as another implementation, a target series of operations with the similarity reaching a preset condition is screened from a series of operations stored within the preset time period, and the target series of operations with the similarity reaching the preset condition are summarized into multi-step operations as the use habit data of the user.
And finally, binding the screened using habit data of the user with the corresponding voice instruction.
The concrete implementation is as follows:
decomposing each step in the screened using habit data of the user into corresponding commands according to a time sequence, generating a command chain, and responding to each command in sequence when executing operation; the generated command chain is then bound with the corresponding voice instruction.
According to the scheme, after the user wakes up the voice assistant, a series of operations of the user after the voice function is used are recorded in real time through monitoring, and after the user repeats the same series of operations for many times, the voice assistant automatically binds the series of operations after the voice function is used with the voice instruction corresponding to the voice function. Subsequently, after receiving a voice instruction triggered by a user after the user uses a terminal voice assistant application, searching a preset user habit database according to the voice instruction triggered by the user, wherein each voice instruction is correspondingly bound with user habit data with a plurality of steps of operation in the user habit database; and if the user habit data bound with the voice command triggered by the user is found, executing a plurality of corresponding step operations. By the scheme, the aim of automatically performing multi-step combination operation corresponding to one voice command is fulfilled, the requirements of users are met, and the use experience of the users is improved; in addition, the voice assistant can help a user to complete repetitive multistep operation, the voice assistant more conforming to the individual use habit of each user is customized, the freedom degree of the user-defined instruction of the voice assistant is improved, the user experience and the playability of the voice assistant are improved, and the novel voice assistant which is richer in function, stronger in playability, more in accordance with the use habit of the individual user and higher in efficiency is provided for the user.
Further, in this embodiment, the method may further include:
prompting the user whether to store the use habit data of the user bound with the corresponding control instruction;
and if the confirmation instruction of the user is received, correspondingly storing the use habit data of the user bound with the corresponding control instruction.
More specifically, as an implementation manner, in this embodiment, a user operation monitoring module, a potential user usage habit storage module, a user usage habit screening module, a formal user usage habit storage module, and a prompting module may be provided, taking a voice assistant application as an example, where:
the user operation monitoring module: the voice assistant is activated when the user starts to use the voice assistant, and a series of operations which are manually performed by the user when the user uses the voice assistant and within a period of time after the user uses the voice assistant are monitored and recorded as the use habits of the potential user.
The potential user uses the habit storage module: and the user operation monitoring module stores the monitored data into the potential user use habit storage module every time.
The user uses the habit screening module: and the user use habit screening module compares the data which is stored before with the newly added data after the data of the storage module is updated every time, and records the occurrence frequency of the data and adds one time if the comparison is consistent. And when the frequency of the use habit of a certain potential user is more than 3 times, screening out the use habit of the potential user, and storing the use habit as the use habit of the user into a formal user use habit storage module.
The formal user uses the habit storage module: and the voice command is connected with the user use habit screening module and used for storing the screened user use habits and corresponding to the voice command used by the previously activated user operation monitoring module after inquiring the consent of the user.
A user prompting module: when the formal user usage habit storage module is updated, the formal user usage habit storage module is used for prompting whether the user wants to correspond the usage habit to the voice instruction used by the previous activated user operation monitoring module.
In the scheme of the embodiment, after the user wakes up the voice assistant, the user operation monitoring module is activated to start working, and a series of operations performed by the user after the user uses the voice function are recorded by the user operation monitoring module and stored as a potential use habit of the user. When the user repeats the same series of operations (more than 3 times), the potential use habit is changed into the real use habit of the user, and the user is asked whether to bind the series of operations after the user uses the voice function with the voice instruction corresponding to the voice function. After the user agrees, the voice function is used, and a series of subsequent operations of the user can automatically help the user to finish the operations, so that the aim of performing multi-step combined operation corresponding to one instruction is fulfilled. The specific process flow may be as shown in fig. 3.
Taking a mobile phone as an example, the background user operation monitoring module is activated by using a voice instruction, and keeps an activated state within one hour (which can be set) later, mainly monitors interface switching brought by manual operation of the mobile phone by a user, matches a corresponding application by an acquired application package name, so as to acquire the application being operated by the user, and then acquires the operation being performed by the user by a system general method such as reading notification bar information (music application usually has information display in the notification bar), or acquires the current state of the application by an API of the corresponding application, and records the operation being performed by the user.
When formal user use habit storage is carried out, data is firstly classified according to applications, if notification bar information can be acquired in a system general mode, the data is recorded according to the method, and if the notification bar information cannot be acquired in the system general mode, the data is recorded and API is directly called for carrying out the data storage. And recording the whole series of operation flows into a formal user use habit storage module in sequence.
Subsequently, as shown in fig. 4, after the user uses the voice assistant, the voice assistant obtains a recognition result, at this time, the voice assistant determines whether the recognition result has a corresponding user usage habit, if so, the corresponding data is called from the formal user usage habit storage module, and after the operation required by the user is normally executed, the user usage habit recorded in the formal user usage habit storage module is continuously executed until the processing is completed.
And if the identification result is judged that no corresponding user use habit exists, executing corresponding user operation according to a normal response flow.
Therefore, by the scheme, the aim of performing multi-step combined operation corresponding to one voice instruction is fulfilled, the requirements of users are met, and the use experience of the users is improved; in addition, after the user wakes up the voice assistant, a series of operations carried out by the user after the voice function is used are recorded in real time through monitoring, and after the user repeats the same series of operations for many times, the voice assistant automatically binds the series of operations carried out after the voice function is used with the voice command corresponding to the voice function, so that the aim of carrying out multi-step combined operation corresponding to one voice command is fulfilled, the requirements of the user are met, and the use experience of the user is improved. And the voice assistant can help the user to complete repeated multi-step operation, customize the voice assistant which is more in line with the individual use habit of each user, improve the freedom of the user-defined instruction of the voice assistant, and simultaneously improve the user experience and the playability of the voice assistant.
The scheme of the present embodiment is described in detail by specific examples below:
for example, a user is awakened by an alarm clock in the morning, after the alarm clock is turned off through sound control, the monitoring module in the background starts working at the moment, the related information of interface switching is monitored, the user manually opens music to start playing music, the monitoring module detects that the interface is switched to a music player interface, the information such as album names, singers and song names of the music being played can be obtained by reading the content displayed on the notification bar or directly using the API interface at the moment, and then the user opens taxi taking software half an hour later to input destination to start taxi appointment. At this moment, the monitoring module monitors that the interface is switched into taxi taking software, so that a destination input by a user can be obtained by using the API, the obtained data can be temporarily stored in the storage module for the use habits of potential users, the user still repeats the combined operation for two days later, namely, the combined operation is a very regular behavior, at this moment, the screening module monitors that the data has repeated for three times, and then the prompting module prompts the user whether to treat the set of operation as the use habits of the user. After the user agrees, the series of operations can be disassembled into a plurality of step commands to sequentially respond, for example, a music playing phone, because the existing API is directly available, the step can be set to directly call the API to respond, and finally, the disassembled step commands are bound to the command for turning off the voice-controlled alarm clock and are automatically executed after responding to the voice-controlled command for turning off the alarm clock. Every morning, the user only needs to close the voice-controlled alarm clock, the voice assistant can automatically complete subsequent operations, the music player is called through the API, an album which is listened to all the time, such as a 'hot song', is played, an application opening command is automatically called to open taxi taking software after half an hour, and taxi taking destinations are automatically input through the API to carry out taxi appointment. The method is a collection of personal use habits of the user, and different subsequent processing steps can be automatically customized by the voice assistant according to different personal habits of different users.
Correspondingly, the invention provides an embodiment of the device for controlling the terminal.
The preferred embodiment of the present invention provides a device for controlling a terminal, including:
the receiving module is used for receiving a control instruction triggered on the terminal;
the searching module is used for searching user habit data in a preset user habit database according to the triggered control instruction, and each control instruction is correspondingly bound with the user habit data in the user habit database;
and the operation execution module is used for searching the user habit data bound with the triggered control instruction in the search module and executing the operation associated with the corresponding user habit data.
Further, the apparatus further comprises: user operation monitoring module, potential user use habit storage module, user use habit screening module, formal user use habit storage module and suggestion module, wherein:
the user operation monitoring module is used for monitoring a series of operations within a preset time length after the user uses the terminal voice assistant application in this time when receiving a voice instruction triggered by the user after the user uses the terminal voice assistant application in a preset time period, and recording and storing the operations to the potential user use habit storage module;
the user use habit screening module is used for screening a series of operations with a plurality of step operations which meet preset rules from the series of operations stored by the potential user use habit storage module in the preset time period, and taking the series of operations as the use habit data of the user and acquiring a corresponding voice instruction; binding the screened use habit data of the user with the corresponding voice instruction;
the formal user use habit storage module is connected with the user use habit screening module and is used for correspondingly storing the screened user use habit data of the user and the voice instruction used for activating the user operation monitoring module;
the prompting module is used for prompting whether the user stores the use habit data of the user bound with the corresponding voice instruction; and if the confirmation instruction of the user is received, correspondingly storing the use habit data of the user bound with the corresponding voice instruction and the corresponding voice instruction to the formal user use habit storage module, and prompting the user whether to correspondingly store the use habit and the corresponding voice instruction after the formal user use habit storage module is updated.
For the principle of this embodiment, please refer to the above embodiments, which are not described herein again.
In addition, an embodiment of the present invention further provides a device for controlling a terminal, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program when executed by the processor performing at least the following:
receiving a control instruction triggered on a terminal;
searching user habit data in a preset user habit database according to the triggered control instruction, wherein each control instruction is correspondingly bound with the user habit data in the user habit database;
and if the user habit data bound with the triggered control instruction is found, executing the operation associated with the corresponding user habit data.
Specifically, as shown in fig. 5, the terminal where the device for controlling the terminal is located in this embodiment may include: aprocessor 1001, such as a CPU, anetwork interface 1004, auser interface 1003, amemory 1005, acommunication bus 1002. Wherein acommunication bus 1002 is used to enable connective communication between these components. Theuser interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and theoptional user interface 1003 may also include a standard wired interface, a wireless interface. Thenetwork interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). Thememory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). Thememory 1005 may alternatively be a storage device separate from theprocessor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 5 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 5, amemory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a control terminal program.
In the mobile terminal shown in fig. 5, thenetwork interface 1004 is mainly used for connecting to a network server and performing data communication with the network server; theuser interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and theprocessor 1001 may be configured to call the control terminal program stored in thememory 1005 and perform the following operations:
receiving a control instruction triggered on a terminal;
searching user habit data in a preset user habit database according to the triggered control instruction, wherein each control instruction is correspondingly bound with the user habit data in the user habit database;
and if the user habit data bound with the triggered control instruction is found, executing the operation associated with the corresponding user habit data.
Further, theprocessor 1001 may be further configured to call a control terminal program stored in thememory 1005, and perform the following operations:
and establishing the user habit database through user habit data learning, wherein the user habit data is bound with the corresponding control instruction.
Further, theprocessor 1001 may be further configured to call a control terminal program stored in thememory 1005, and perform the following operations:
monitoring a series of operations within a preset time length and recording and storing the operations when receiving a control instruction triggered by a user on a terminal within a preset time period;
screening a series of operations with multiple step operations meeting preset rules from the series of operations stored in the preset time period, using the series of operations as the use habit data of the user, and acquiring corresponding control instructions;
and binding the screened use habit data of the user with the corresponding control instruction.
Further, theprocessor 1001 may be further configured to call a control terminal program stored in thememory 1005, and perform the following operations:
screening out a target series of operations repeated for a preset number of times from each series of operations stored in the preset time period, wherein the target series of operations are used as the use habit data of the user; or
And screening out a target series of operations with the similarity reaching a preset condition from the series of operations stored in the preset time period, and summarizing the target series of operations with the similarity reaching the preset condition into multi-step operations as the use habit data of the user.
Further, theprocessor 1001 may be further configured to call a control terminal program stored in thememory 1005, and perform the following operations:
prompting the user whether to store the use habit data of the user bound with the corresponding control instruction;
and if the confirmation instruction of the user is received, correspondingly storing the use habit data of the user bound with the corresponding control instruction.
Further, theprocessor 1001 may be further configured to call a control terminal program stored in thememory 1005, and perform the following operations:
decomposing each step in the screened using habit data of the user into corresponding commands according to a time sequence, generating a command chain, and responding to each command in sequence when executing operation;
and binding the generated command chain with the corresponding control instruction.
Furthermore, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program at least implements the following operations:
receiving a control instruction triggered on a terminal;
searching user habit data in a preset user habit database according to the triggered control instruction, wherein each control instruction is correspondingly bound with the user habit data in the user habit database;
if the user habit data bound to the triggered control instruction is found, the specific control terminal process of the embodiment for executing the corresponding user habit data association operation may refer to the above embodiment, and is not described herein again.
The above description is only for the preferred embodiment of the present invention and is not intended to limit the scope of the present invention, and all equivalent structures or flow transformations made by the present specification and drawings, or applied directly or indirectly to other related arts, are included in the scope of the present invention.