Disclosure of Invention
The embodiment of the invention aims to provide an operation method of a terminal, the terminal and a readable storage medium, which expand common gesture operations, so that the terminal can be quickly operated through the common gestures, and the efficiency of a user in operating the terminal is improved.
In order to solve the above technical problem, an embodiment of the present invention provides an operation method of a terminal, which is applied to the terminal, and includes: acquiring touch operation comprising at least one touch point; identifying the touch finger at each touch point to obtain an identification result of each touch point; determining an instruction triggering gesture according to the identification result of each touch point and the touch operation, wherein the identification result comprises fingerprint identification information; and determining the instruction to be executed according to the instruction triggering gesture and the corresponding relation between the instruction triggering gesture and the preset instruction, and executing the instruction to be executed.
An embodiment of the present invention further provides a terminal, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform the above-mentioned operation method of the terminal.
Embodiments of the present invention also provide a computer-readable storage medium storing a computer program, which when executed by a processor implements the operation method of the terminal described above.
Compared with the prior art, the embodiment of the invention determines the instruction triggering gesture by acquiring the touch operation and the recognition result of each touch point in the touch operation, and then executes the corresponding instruction according to the instruction triggering gesture; the same touch operation performed by different touch fingers is distinguished through the recognition result of the touch points, so that the quantity of instruction touch gestures is greatly expanded, the terminal can be rapidly operated through common gestures, and the efficiency of the user in operating the terminal is improved.
In addition, before obtaining the touch operation including at least one touch point, the operation method of the terminal further includes: storing fingerprint identification information of each finger to be touched; combining the stored fingerprint identification information of at least one finger to be touched with preset touch operation executed by each finger to be touched to obtain an instruction triggering gesture; and setting a corresponding relation between the instruction triggering gesture and a preset instruction. The stored fingerprint identification information is combined with touch operation to obtain an instruction triggering gesture, and the corresponding relation between the instruction triggering gesture and a preset instruction is set, so that the corresponding instruction is executed after the instruction triggering gesture of the user is detected.
In addition, identifying the touch finger located at each touch point to obtain the identification result of each touch point specifically includes: acquiring fingerprint identification information of each touch point; performing the following processing on the fingerprint identification information of each touch point: matching the fingerprint identification information with stored fingerprint identification information of a finger to be touched to obtain a matching result of the fingerprint identification information; and taking the matching result as the recognition result of the touch point. By acquiring the fingerprint identification information of each touch point and matching the fingerprint identification information with the stored fingerprint identification information, the fingerprint identification information of each touch point can be quickly identified, and the identification result of each touch point can be quickly determined.
In addition, determining an instruction triggering gesture according to the recognition result and the touch operation of each touch point specifically includes: and if the fingerprint identification information corresponding to each touch point is successfully matched, combining the touch operation constructed by all the touch points and the fingerprint identification information of each touch point as an instruction triggering gesture. The fingerprint identification information corresponding to each touch point is successfully matched, so that each touch point is identified, and different instruction touch gestures with the same touch operation can be distinguished conveniently according to the identification result of each touch point.
In addition, determining an instruction triggering gesture according to the recognition result and the touch operation of each touch point specifically includes: if at least one touch point which is not successfully matched exists, acquiring fingerprint identification information of each successfully matched touch point; and combining the touch operation constructed by the successfully matched touch points with the fingerprint identification information of each successfully matched touch point to serve as an instruction triggering gesture.
In addition, determining an instruction triggering gesture according to the recognition result and the touch operation of each touch point specifically includes: and if at least one touch point which is not successfully matched exists, determining that the instruction triggering gesture is a null gesture, wherein the null gesture corresponds to a prompt instruction for prompting that the touch point which is not successfully matched exists. In the case that the instruction triggering gesture is determined to be a null gesture, a prompt instruction may be executed, for example, to prompt the user that there is fingerprint identification information that is not successfully matched; therefore, the method for determining the corresponding command trigger gesture according to the recognition results of various touch points can be perfected, and the command trigger gesture can be determined more flexibly.
In addition, the fingerprint identification information comprises a fingerprint image and a name corresponding to the fingerprint image; storing fingerprint identification information of each finger to be touched, specifically comprising: acquiring a fingerprint image of each finger to be touched; and acquiring a name corresponding to each fingerprint image, and storing each fingerprint image and the corresponding name. Through storing the fingerprint image and the name corresponding to the fingerprint image, the fingerprint image and the touch operation can be conveniently combined subsequently.
In addition, after the instruction to be executed is executed, the operation method of the terminal further includes: when the number of the touch points is detected to be changed and the number of the changed touch points is larger than 1, the changed touch operation is obtained again; identifying the touch finger of each changed touch point, and acquiring an identification result of each changed touch point; determining a changed instruction triggering gesture according to the recognition result of each changed touch point and the changed touch operation; and determining the changed instruction to be executed according to the changed instruction triggering gesture and the corresponding relation between the instruction triggering gesture and the preset instruction, and executing the changed instruction to be executed. When the change of the touch points is detected and the number of the changed touch points is still larger than 1, the changed touch points are identified again, and the electric quantity consumption of the terminal can be greatly reduced because the touch points are not always identified.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, it will be appreciated by those of ordinary skill in the art that numerous technical details are set forth in order to provide a better understanding of the present application in various embodiments of the present invention. However, the technical solution claimed in the present application can be implemented without these technical details and various changes and modifications based on the following embodiments.
A first embodiment of the present invention relates to a method of operating a terminal. The method is applied to terminals supporting touch operation, such as smart phones, PADs and the like, and the terminal screen can support fingerprint capture in a full screen mode or large-area screen capture. The specific flow of the operation method of the terminal is shown in fig. 1.
Step 101: and acquiring touch operation comprising at least one touch point.
Specifically, after the screen of the terminal detects that the touch operation occurs, the touch operation is acquired. For example, if the user presses the screen of the terminal with two fingers, the touch operation is a pressing action including two touch points; if the user presses the screen with a single finger, the touch operation is the pressing operation of the finger. It is understood that the terminal may also only obtain a touch operation containing at least two points.
It should be noted that before the touch operation including at least one touch point is obtained, fingerprint identification information of each finger to be touched is stored; combining the stored fingerprint identification information of at least one finger to be touched with preset touch operation executed by each finger to be touched to obtain an instruction triggering gesture; and setting a corresponding relation between the instruction triggering gesture and a preset instruction.
Specifically, in order to facilitate the combination of the fingerprint identification information of the touch finger and the touch operation, the fingerprint identification information of the finger to be touched, which is required by the user, can be pre-entered, and the fingerprint identification information can be a fingerprint image, and can also be a fingerprint image and a name corresponding to the fingerprint image.
In this embodiment, taking the example that the fingerprint identification information includes a fingerprint image and a name corresponding to the fingerprint image, the process of storing the fingerprint identification information of each finger to be touched may be: the terminal acquires a fingerprint image of each finger to be touched, acquires a name corresponding to each fingerprint image, and stores each fingerprint image and the corresponding name. If the user edits the name corresponding to the fingerprint image after inputting the fingerprint image of the finger to be touched, the terminal can directly acquire the name of the fingerprint image, for example, the user inputs the fingerprint image of the index finger, and the name of the fingerprint image is edited to be the index finger of the right hand after inputting the fingerprint image. If the user does not edit the name of the entered fingerprint image, the terminal may name each stored fingerprint image, for example, the first fingerprint image, the second fingerprint image, and the like.
The fingerprint image and the name corresponding to the fingerprint image are stored, so that the fingerprint identification information of the touch point and the touch operation can be conveniently combined subsequently.
Step 102: and identifying the touch finger at each touch point to obtain an identification result of each touch point.
Specifically, the method for obtaining the recognition result of each touch point may be: firstly, acquiring fingerprint identification information of each touch point; after the terminal acquires the touch operation including at least one touch point, the terminal can acquire the fingerprint identification information of the touch finger corresponding to each touch point through the under-screen fingerprint capturing component in the area of the touch operation, and identify the touch finger located at each touch point to acquire the identification result of each touch point.
Performing the following processing on the fingerprint identification information of each touch point: and matching the fingerprint identification information with the stored fingerprint identification information of the finger to be touched, acquiring a matching result of the fingerprint identification information, and taking the matching result as an identification result of the touch point. For example, fingerprint identification information of 5 fingers of the right hand of the user is stored, the terminal detects two touch points, namely a touch point a and a touch point B, the fingerprint identification information of the touch point a is respectively matched with the fingerprint identification information of the stored 5 fingers, and if the fingerprint identification information of the touch point a is the same as the fingerprint identification information of the stored index finger of the right hand, the identification result of the touch point a is determined: the touch point A is the index finger of the right hand; and matching the fingerprint identification information of the touch point B with the stored fingerprint identification information of each touch point, and determining that the touch point B fails to be matched if the fingerprint identification information of the touch point B is not the same as the fingerprint identification information of the touch point B.
Step 103: and determining an instruction triggering gesture according to the identification result of each touch point and the touch operation, wherein the identification result comprises fingerprint identification information.
In a specific implementation, if it is determined that the fingerprint identification information corresponding to each touch point is successfully matched, the combination of the touch operation established by all the touch points and the identification result of each touch point is used as an instruction trigger gesture.
The following describes, by way of a specific example, a process of determining an instruction trigger gesture when it is determined that fingerprint identification information corresponding to each touch point is successfully matched:
and detecting two touch points, namely a touch point A and a touch point B, respectively, and identifying the touch operation constructed by the touch point A and the touch point B as the action that the relative distance between the touch point A and the touch point B gradually increases, wherein the identification result of the touch point A is the index finger of the right hand of the user, the identification result of the touch point B is the middle finger of the right hand of the user, and then determining that the instruction triggering gesture is the action that the relative distance between the index finger of the right hand and the middle finger of the right hand gradually increases.
It should be noted that if it is determined that at least one unidentified touch point exists, other processing manners are adopted, for example, it may be determined that the instruction triggering gesture is a null gesture, where the null gesture corresponds to a prompt instruction for prompting that an unmatched touch point exists. When the corresponding relation between the instruction triggering gesture and the preset instruction is set, the null gesture and the prompt instruction can be bound. For example, the null gesture is bound to a prompt instruction that displays information that "the touch point is not recognized".
Step 104: and determining the instruction to be executed according to the instruction triggering gesture and the corresponding relation between the instruction triggering gesture and the preset instruction, and executing the instruction to be executed.
Because the corresponding relation between the instruction triggering gesture and the preset instruction is preset, the instruction to be executed can be quickly determined according to the obtained instruction triggering gesture, for example, if the instruction triggering gesture is determined to be an action that the relative distance between the index finger of the right hand and the middle finger of the right hand is gradually far, the instruction for amplifying the screen is correspondingly executed.
Compared with the prior art, the embodiment of the invention determines the instruction triggering gesture by acquiring the touch operation and the recognition result of each touch point in the touch operation, and then executes the corresponding instruction according to the instruction triggering gesture; the same touch operation performed by different touch fingers is distinguished through the recognition result of the touch points, so that the quantity of instruction touch gestures is greatly expanded, the terminal can be rapidly operated through common gestures, and the efficiency of the user in operating the terminal is improved.
A second embodiment of the present invention relates to an operating method of a terminal. The second embodiment is a further improvement of the first embodiment, and the main improvements are as follows: in the second embodiment of the present invention, after the instruction to be executed is executed, whether the number of touch points changes is detected, and if it is determined that the number of touch points changes and the number of touch points after the change is greater than 1, the instruction to be executed after the change of the touch points is determined again. The specific flow of the operation method of the terminal is shown in fig. 2.
Step 201: and acquiring touch operation comprising at least one touch point.
Step 202: and identifying the touch finger at each touch point to obtain an identification result of each touch point.
Step 203: and determining an instruction triggering gesture according to the identification result of each touch point and the touch operation, wherein the identification result comprises fingerprint identification information.
Step 204: and determining the instruction to be executed according to the instruction triggering gesture and the corresponding relation between the instruction triggering gesture and the preset instruction, and executing the instruction to be executed.
Step 205: when the number of the touch points is detected to be changed and the number of the changed touch points is larger than 1, the changed touch operation is obtained again; and if the number of the touch points is determined to be changed and the number of the changed touch points is less than or equal to 1, ending the whole process.
Specifically, after the instruction to be executed is executed, the terminal detects whether the number of touch points changes, and if it is determined that the number of touch points changes and the number of touch points after changing is less than or equal to 1, it indicates that the current user is not performing multi-point touch operation (such as single-point touch) or the user ends touch operation. If the number of the changed touch points is larger than 1, the user is indicated to change the instruction triggering gesture and needs to be determined again.
The reacquiring of the changed touch operation is substantially the same as step 201 in this embodiment, and is not described herein again.
Step 206: and identifying the touch finger at each changed touch point, and acquiring the identification result of each changed touch point.
Specifically, only after the number of touch points is changed, the touch finger at each touch point is re-identified. The touch finger at the touch point is re-identified only after the number of the touch points is changed, so that the fingerprint capturing component is not always in a state of capturing the fingerprint, and the electric quantity of the terminal is saved.
Step 207: and determining the changed instruction triggering gesture according to the recognition result of each changed touch point and the changed touch operation.
This step is substantially the same as step 203 in this embodiment, and is not described herein again.
Step 208: and determining the changed instruction to be executed according to the changed instruction triggering gesture and the corresponding relation between the instruction triggering gesture and the preset instruction, and executing the changed instruction to be executed.
This step is substantially the same as step 204 in this embodiment, and is not described herein again.
It should be noted that steps 201 to 204 in this embodiment are substantially the same as steps 101 to 104 in the first embodiment, and will not be described again here.
According to the operation method of the terminal provided by the embodiment, when the change of the touch points is detected and the number of the changed touch points is still larger than 1, the changed touch points are identified again, and the electric quantity consumption of the terminal can be greatly reduced because the touch points are not always identified.
A third embodiment of the present invention relates to an operating method of a terminal. The third embodiment is substantially the same as the first embodiment, and mainly differs therefrom in that: in the third embodiment of the present invention, if it is determined that at least one touch point that is not successfully matched exists, the command trigger gesture is determined in a different manner. The specific flow triggered by the determination instruction is shown in fig. 3.
Step 301: and if the at least one touch point which is not successfully matched exists, acquiring the identification result of each successfully matched touch point.
Specifically, because the unmatched touch points exist, the fingerprint identification information of the unmatched touch points is not the fingerprint identification information of the pre-stored finger to be touched, only the identification result of each successfully matched touch point is obtained, and the successfully unmatched touch points are ignored. The touch points which are not successfully matched are ignored, so that the interference of other fingers which do not store the fingerprint identification information to the current touch operation when the user performs the touch operation can be avoided.
Step 302: and combining the touch operation constructed by the successfully matched touch points with the recognition result of each successfully matched touch point to serve as an instruction triggering gesture.
Specifically, the touch operation constructed by the successfully matched touch points is identified, and the touch action and the identification result of each successfully matched touch point are combined and bound to be used as an instruction triggering gesture. The identification result comprises fingerprint identification information of the touch point.
For example, a user holds a mobile phone with the left hand, presses the left thumb on the screen of the mobile phone, and simultaneously performs a touch operation in which the relative distance between the index finger of the right hand and the middle finger of the right hand gradually increases, wherein fingerprint identification information of each finger of the right hand is stored in the terminal, and then it is determined that the instruction triggering gesture is the touch operation in which the relative distance between the index finger of the right hand and the middle finger of the right hand gradually increases.
In another specific implementation, if it is determined that at least one unmatched successful touch point exists, the touch operation constructed by the unmatched successful touch point is determined as the default instruction triggering gesture of the terminal.
For example, the user stores fingerprint identification information of all fingers of the right hand, the user holds the mobile phone by the right hand, wherein the thumb and the index finger of the right hand are pressed on the screen of the mobile phone, the touch operation constructed by the index finger and the middle finger of the left hand is that the relative distance between the middle finger and the left finger is longer and longer, at this time, the unmatched touch points are the fingerprint identification information of the index finger and the middle finger of the left hand, and therefore, the touch operation constructed by the unmatched touch points is identified at this time, and the instruction of amplifying the screen by default of the terminal is executed.
In the operation method of the terminal provided by the embodiment, when at least one unmatched touch point exists, only the identification result of the matched touch point is obtained, and the touch operation combination constructed by the successfully matched touch point is used as the instruction trigger gesture, so that interference of other fingers which do not store fingerprint identification information to the current touch operation when the user performs the touch operation can be avoided.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
A fourth embodiment of the present invention relates to a terminal, and a specific structure of the terminal 40 is shown in fig. 4, and includes: at least one process 401; and a memory 402 communicatively coupled to the at least one processor 401; the memory 402 stores instructions executable by the at least one processor 401, and the instructions are executed by the at least one processor 401, so that the at least one processor 401 can execute the operation method of the terminal.
The memory 402 and the processor 401 are connected by a bus, which may include any number of interconnected buses and bridges that link one or more of the various circuits of the processor 401 and the memory 402. The bus may also link various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor 401 may be transmitted over a wireless medium via an antenna, which may receive the data and transmit the data to the processor 401.
The processor 401 is responsible for managing the bus and general processing and may provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And memory 402 may be used to store data used by the processor in performing operations.
A fifth embodiment of the present invention relates to a computer-readable storage medium storing a computer program which, when executed by a processor, implements the method of operating the terminal described above.
Those skilled in the art can understand that all or part of the steps in the method of the foregoing embodiments may be implemented by a program to instruct related hardware, where the program is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific examples for carrying out the invention, and that various changes in form and details may be made therein without departing from the spirit and scope of the invention in practice.