Information processing method and electronic equipmentTechnical Field
The present invention relates to information processing technologies, and in particular, to an information processing method and an electronic device.
Background
Electronic equipment such as a smart phone and a tablet personal computer provided with a touch screen display unit is increasingly widely used, in practical application, a user often needs to use the electronic equipment to perform quick input, but when the touch screen display unit in the electronic equipment displays a virtual key, the input efficiency and accuracy are affected because the user cannot use the virtual key to perform positioning correction, and related technologies have no effective solutions for how to realize quick and accurate input of the virtual key.
Disclosure of Invention
The embodiment of the invention provides an information processing method and electronic equipment, which can improve the accuracy and the input efficiency of inputting by using virtual keys and improve the user experience.
The technical scheme of the embodiment of the invention is realized as follows:
the embodiment of the invention provides an information processing method, which is applied to electronic equipment, wherein the electronic equipment supports and displays a virtual input area, and the virtual input area supports and displays keys; the method comprises the following steps:
receiving a first operation carried out by an operation body in the virtual input area;
analyzing the first operation to obtain operation characteristic information of the operation body;
judging whether the first operation meets the operation requirement or not based on the operation characteristic information of the operation body;
when the obtained analysis result represents that the first operation does not meet the operation requirement, sending out prompt information based on the analysis result; wherein,
the prompt information is used for indicating the operation body to adjust the first operation, so that the adjusted first operation meets the operation requirement.
Preferably, before determining whether the first operation meets the operation requirement, the method further comprises:
detecting the number of operation points corresponding to the first operation sensed in the virtual input area, and detecting the duration of sensing the operation points;
and when the number of the operation points of the first operation is greater than a first threshold value and the duration time of sensing the operation points is greater than a second threshold value, switching to enter a detection state to judge whether the first operation meets the operation requirement.
Preferably, the determining whether the first operation meets the operation requirement based on the operation characteristic information of the operation body includes:
comparing the position of the operation point corresponding to the first operation sensed in the virtual input area with the position of a reference operation point;
when the distance of the operating point of the first operation deviating from the reference operating point is smaller than a third threshold value, determining that the first operation meets an operating requirement; otherwise, the first operation is judged not to meet the operation requirement.
Preferably, before determining that the first operation satisfies the operation requirement, the method further comprises:
determining a first operation reference line based on at least the positions of a first operation point and a second operation point in the operation points;
comparing the minimum included angle between the first operation reference line and a preset operation reference line with a fourth threshold;
and when the obtained comparison result represents that the minimum included angle is larger than the fourth threshold value, judging that the first operation meets the operation requirement.
Preferably, sending out prompt information based on the analysis result includes:
sending the prompt information based on the distance of the position of the operation point of the first operation deviating from the position of the reference operation point and the minimum included angle between the first operation reference line and a preset operation reference line; wherein,
the prompt information is used for indicating the operation body to adjust the corresponding operation point to move the offset distance to the reference operation point and indicating the operation body to adjust the angle relative to the reference operation line so that the minimum included angle is smaller than the fourth threshold value.
Preferably, before determining that the first operation satisfies the operation requirement, the method further comprises:
determining a second operation reference line based on at least the positions of a third operation point and a fourth operation point of the operation points;
comparing a first distance with a fifth threshold, wherein the first distance is the distance between a fifth operation point of the operation points and the second operation reference line;
and when the obtained comparison result indicates that the first distance is smaller than the fifth threshold, judging that the first operation meets the operation requirement.
Preferably, sending out prompt information based on the analysis result includes:
sending the prompt information based on the distance of the operating point of the first operation deviating from the reference operating point and the first distance; wherein,
the prompt information is used for instructing the operation body to adjust the corresponding operation point to move the offset distance to the reference operation point, and instructing the operation body to adjust the position of the fifth operation point, so that the first distance is smaller than the third threshold.
Preferably, the sending out the prompt message includes sending out at least one of the following types of prompt messages:
voice prompt information; image prompt information; and (5) vibration induction prompt information.
An embodiment of the present invention further provides an information processing electronic device, where the electronic device includes:
the display unit is used for displaying a virtual input area, and the virtual input area supports displaying keys;
a receiving unit configured to receive a first operation performed by an operator in the virtual input area;
the analysis unit is used for analyzing the first operation to obtain the operation characteristic information of the operation body;
a judging unit configured to judge whether the first operation satisfies an operation requirement based on operation characteristic information of the operation body;
the prompting unit is used for sending out prompting information based on the analysis result when the obtained analysis result represents that the first operation does not meet the operation requirement; the prompt information is used for indicating the operation body to adjust the first operation, so that the adjusted first operation meets the operation requirement.
Preferably, the electronic device further includes:
a detection unit, configured to detect the number of operation points corresponding to the first operation sensed in the virtual input area, and detect a duration time during which the operation points are sensed;
and when the number of the operation points of the first operation is greater than a first threshold value and the duration time of sensing the operation points is greater than a second threshold value, switching to enter a detection state to trigger the judging unit to judge whether the first operation meets the operation requirement.
Preferably, the judging unit includes:
the first comparison module is used for comparing the position of the operation point corresponding to the first operation, which is sensed in the virtual input area, with the position of a reference operation point;
the judging module is used for judging that the first operation meets the operation requirement when the distance of the operating point of the first operation deviating from the reference operating point is smaller than a third threshold value; otherwise, the first operation is judged not to meet the operation requirement.
Preferably, the judging unit further includes:
the first determining module is used for determining a first operation datum line at least based on the positions of a first operation point and a second operation point in the operation points;
the judging module is further configured to compare a minimum included angle between the first operation reference line and a preset operation reference line with a fourth threshold, and determine that the obtained comparison result represents that the minimum included angle is greater than the fourth threshold, and when a distance from an operation point of the first operation to the reference operation point is less than a third threshold, it is determined that the first operation meets an operation requirement; otherwise, the first operation is judged not to meet the operation requirement.
Preferably, the prompting unit is further configured to send the prompting information based on a distance that a position of the operation point of the first operation deviates from a position of the reference operation point and a minimum included angle between the first operation reference line and a preset operation reference line; wherein,
the prompt information is used for indicating that the operation point corresponding to the operation body moves the offset distance to the reference operation point, and indicating that the operation body adjusts the angle relative to the reference operation line, so that the minimum included angle is smaller than the fourth threshold value.
Preferably, the judging unit further includes:
the second determining module is used for determining a second operation datum line at least based on the positions of a third operation point and a fourth operation point in the operation points;
the judging module is further configured to compare a first distance with a fifth threshold, where the first distance is a distance from a fifth operation point of the operation points to the second operation reference line; when the obtained comparison result is determined to represent that the first distance is smaller than the fifth threshold, judging that the first operation meets the operation requirement; otherwise, the first operation is judged not to meet the operation requirement.
Preferably, the prompting unit is further configured to send the prompting information based on a distance that the operating point of the first operation deviates from the reference operating point and the first distance; wherein,
the prompt information is used for instructing the operation body to adjust the corresponding operation point to move the offset distance to the reference operation point, and instructing the operation body to adjust the position of the fifth operation point, so that the first distance is smaller than the third threshold.
Preferably, the prompting unit is further configured to issue at least one of the following types of prompting messages:
voice prompt information; image prompt information; and (5) vibration induction prompt information.
In the embodiment of the invention, whether the first operation meets the operation requirement is judged by analyzing the operation characteristic information of the first operation of the user, and the prompt is carried out when the operation requirement is not met without the need that the user always pays attention to the position of the key stroke of the finger, when the first operation does not meet the operation requirement, for example, the distance between the initial position of the finger and the position of the virtual key is overlarge, or one finger and a plurality of virtual keys are clicked, the prompt information is sent out to instruct the user to carry out calibration, thereby improving the input efficiency and the accuracy,
drawings
FIG. 1 is a first schematic flow chart illustrating an implementation of an information processing method according to an embodiment of the present invention;
FIG. 2a is a schematic diagram of a second implementation flow of the information processing method according to the embodiment of the present invention;
FIG. 2b is a diagram illustrating a user in an input ready state according to an embodiment of the present invention;
FIG. 3a is a schematic view of a third implementation flow of an information processing method according to an embodiment of the present invention;
fig. 3b to fig. 3d are schematic views of a scene for sending a prompt message in the embodiment of the present invention;
FIG. 4a is a schematic diagram of a flow chart of implementing the information processing method in the embodiment of the present invention;
FIG. 4b is a schematic diagram of a scenario in which a prompt message is sent out in the embodiment of the present invention;
FIG. 5a is a schematic diagram of an implementation flow of an information processing method according to an embodiment of the present invention;
FIG. 5b is a schematic diagram of a scenario in which a prompt message is sent out in the embodiment of the present invention;
fig. 6a to 6b are schematic structural diagrams of an electronic device according to an embodiment of the invention.
Detailed Description
The inventor finds that the virtual keyboard displayed on the screen of the tablet personal computer or the touch screen notebook computer is generally designed into a full key layout, and a user uses two fingers to input characters on a large-size keyboard efficiently; compared with a physical keyboard, the virtual keyboard is difficult to position by using a smooth surface, so that the input accuracy is low, and in order to avoid input errors, a user needs to pay attention to the position of each finger keystroke in the input process, so that the input efficiency is very low;
the inventor also finds that when the electronic device supports and displays a virtual input area, and the virtual input area supports and displays keys, as shown in fig. 1, in step 101, a first operation performed by an operation body (corresponding to a finger of a user) is received in the virtual input area; in step 102, analyzing the first operation to obtain operation characteristic information of an operation body; in step 103, judging whether the first operation meets the operation requirement based on the operation characteristic information of the operation body; in step 104, when the obtained analysis result indicates that the first operation does not meet the operation requirement, sending a prompt message based on the analysis result to instruct the operation body to adjust the first operation so that the adjusted first operation meets the operation requirement; therefore, the operation of the user can be calibrated without the need that the user always pays attention to the position of the finger keystroke, and when the operation does not meet the operation requirement, for example, the distance between the initial position of the finger and the position of the virtual key is too large, or one finger and a plurality of virtual keys are clicked, the prompt information is sent out to indicate the user to calibrate, so that the input efficiency is improved.
Example one
The embodiment describes an information processing method, which is applied to an electronic device, wherein the electronic device supports and displays a virtual input area, and the virtual input area supports and displays keys; as shown in fig. 2a, the information processing method according to the present embodiment includes the steps of:
in step 201, a first operation performed by an operator is received in a virtual input area.
In step 202, the number of the sensed operation points corresponding to the first operation in the virtual input area is detected, and the duration of the sensed operation points is detected.
When the finger of the user performs the first operation, the finger can be in contact with the display unit of the electronic equipment, and when the finger is in contact with the display unit of the electronic equipment, the display unit is triggered to sense an operation point at the contact part; the finger can not be in contact with the display unit of the electronic equipment, and the finger is a conductor, so that the display unit can sense the operation point corresponding to the finger when the distance between the finger and the display unit is within the sensing distance of the display unit.
Step 203, judging whether the first operation meets the following conditions: the number of the operation points of the first operation is larger than a first threshold value, and the duration time for sensing the operation points of the first operation is larger than a second threshold value; if yes, go to step 204; otherwise, step 207 is performed.
Step 203 is to judge whether the user touches the virtual keys, if no touch occurs, the pause process between the touched keys is represented, a detection state can be entered, whether the placement position of the finger on the display unit of the electronic device is accurate is detected, and the subsequent step 204 and step 205 are to switch to enter the detection state to judge whether the first operation meets the processing requirement.
And step 204, analyzing the first operation to obtain the operation characteristic information of the operation body.
The operation characteristic information of the operation body comprises the position of the erasing point obtained by sensing the operation body and the duration of sensing the operation point.
Step 205, judging whether the first operation meets the operation requirement based on the operation characteristic information of the operation body; if the operational requirement is not satisfied, go to step 206; if the operational requirements are met, step 207 is performed.
And step 206, sending out prompt information based on the analysis result.
The prompt information is used for indicating the operation body to adjust the first operation, so that the adjusted first operation meets the operation requirement.
Step 207, detecting the virtual key triggered by the operation point of the first operation, and generating a signal corresponding to the triggered virtual key.
Step 207 is to complete the input processing based on the first operation, and the generated signal is used to send to the application triggering the invoking of the text input, so that the application obtains the information input by the user.
As an example, as shown in fig. 2b, when the user is in the input preparation state, usually at least one finger of the hand will contact the electronic device display unit (corresponding to the first operation), so that the number of the contacts sensed by the electronic device display unit is at least 5 (corresponding to the first threshold), and the contact time exceeds the time interval (corresponding to the second threshold) during which the user continuously performs the first operation to perform the input, when the number of the operation points of the first operation satisfies the above condition, it indicates that the user is currently in the input pause state, and the user may continue the input based on the current pose of the finger, the technical solution in this embodiment calibrates the first operation in the pause state, so that the first operation satisfies the operation requirement (e.g. accurately matching the positions of the respective fingers and the reference virtual keys, and matching the placement pose of the palm relative to the display unit and the reference pose), the input efficiency and the accuracy of subsequent user input based on the current pose can be improved.
Example two
The embodiment describes an information processing method, which is applied to an electronic device, wherein the electronic device supports and displays a virtual input area, and the virtual input area supports and displays keys; as shown in fig. 3a, the information processing method according to the present embodiment includes the steps of:
in step 301, a first operation performed by an operator is received in a virtual input area.
Step 302, detecting the number of the sensed operation points corresponding to the first operation in the virtual input area, and detecting the duration of the sensed operation points.
When the finger of the user performs the first operation, the finger can be in contact with the display unit of the electronic equipment, and when the finger is in contact with the display unit of the electronic equipment, the display unit is triggered to sense an operation point at the contact part; the finger can not be in contact with the display unit of the electronic equipment, and the finger is a conductor, so that the display unit can sense the operation point corresponding to the finger when the distance between the finger and the display unit is within the sensing distance of the display unit.
Step 303, determining whether the first operation satisfies the following condition: the number of the operation points of the first operation is larger than a first threshold value, and the duration time for sensing the operation points of the first operation is larger than a second threshold value; if so, go to step 304; otherwise, step 309 is performed.
Step 304, switching to enter a detection state to determine whether the first operation meets the operation requirement.
Steps 305 to 307 are processes of switching to enter a detection state to determine whether the first operation satisfies the operation requirement.
Step 305, analyzing the first operation to obtain the operation characteristic information of the operation body.
Step 306, comparing the position of the operation point corresponding to the first operation sensed in the virtual input area with the position of the reference operation point.
Because the operation point of the first operation is obtained by the electronic equipment sensing different fingers (corresponding to the operation body), whether the initial position of the first operation in the virtual input area of the electronic equipment is accurate or not can be determined by comparing the operation point of the first operation with a reference operation point (the reference operation point can be corresponding to the geometric center position of a virtual key A, a virtual key S, a virtual key D, a virtual key F, a virtual key J, a virtual key K, a virtual key L and a virtual key L).
Step 307, judging whether the distance of the operating point of the first operation deviating from the reference operating point is smaller than a third threshold, if so, judging that the first operation meets the operating requirement, exiting the detection state, and turning to step 309; otherwise, it is determined that the first operation does not satisfy the operation requirement, and the process proceeds to step 308.
The third threshold may correspond to a size (e.g., a side length) of the virtual key, such that when the distance from the operating point of the first operation to the reference operating point exceeds the third threshold, it indicates that the user does not have the finger accurately stop at the position of the reference virtual key in the pause state, i.e., does not satisfy the operating requirement; fig. 3b shows a schematic diagram of the first operation meeting the operation requirement, where the distance between the operation point of the first operation and the reference operation point does not exceed the size of the virtual key, and at this time, a prompt message "meeting the operation requirement" may be displayed on the display unit; fig. 3c shows a schematic diagram of the first operation not meeting the requirement, where the distance between the operating point of the first operation and the reference operating point exceeds the size of the virtual key, that is, the operating point of the first operation falls on the non-reference key.
And 308, sending out prompt information based on the analysis result.
The prompt information is used for indicating the operation body to adjust the first operation, so that the adjusted first operation meets the operation requirement.
A schematic diagram of sending out the prompt information based on different analysis results is shown in fig. 3d, taking an example that the electronic device senses an operation point corresponding to a right finger, a dotted arrow represents an operation point of the right index finger and a reference operation point (i.e. a distance from the center of the right index finger to the center of the key J), and if the distance between the operation point of the right index finger and the reference point is shown by an arrow 1, it indicates that the placement position of the current index finger is very accurate, and the prompt information good can be sent out; if the distance between the operating point of the index finger of the right hand and the reference operating point is shown by an arrow 2, which indicates that the operating point of the index finger of the right hand has a small distance (which belongs to a range that does not cause an error of the touch key), a prompt message "OKBecareful" can be sent; if the distance between the operating point of the right index finger and the reference operating point is shown by an arrow 3, the distance between the operating point corresponding to the right index finger and the reference operating point exceeds a third threshold (if a touch is made based on the position, an input error will be caused), and a prompt message "ErrorNeedhomeposition" can be sent to prompt the user that the placement position of the finger needs to be adjusted.
It should be noted that, in fig. 3d, the prompt message is sent in the form of an image, in practical applications, the prompt message may be sent in the form of voice, or in the form of vibration induction (a vibrator may be disposed in the electronic device), when the first operation does not meet the operation requirement, a vibration prompt is sent; of course, the prompt message when the difference does not meet the requirement may be sent when the first operation meets the operation requirement.
Step 309, detecting the virtual key triggered by the operation point of the first operation, and generating a signal corresponding to the triggered virtual key.
Step 309 is to complete the input processing process based on the first operation, and the generated signal is used to send to the application triggering the invoking of the text input, so that the application obtains the information input by the user; it should be noted that, as shown in fig. 3d, during the user input process, only one finger in one palm of the hand is able to click the screen to determine the keystroke behavior, and the multi-finger simultaneous click contact cannot be recognized as the correct keystroke operation in step 309.
In the embodiment, whether the operation requirement is met or not is judged based on the position of the operation point where the finger is in contact with the display unit (corresponding to the first operation) and the reference operation point when the input pause state is in the input pause state, and when the operation requirement is not met, the position of the finger is prompted to be adjusted to meet the operation requirement, so that the efficiency and the accuracy of subsequent input operation can be obviously improved.
EXAMPLE III
The embodiment describes an information processing method, which is applied to an electronic device, wherein the electronic device supports and displays a virtual input area, and the virtual input area supports and displays keys; as shown in fig. 4a, the information processing method according to the present embodiment includes the steps of:
in step 401, a first operation performed by an operator is received in a virtual input area.
In step 402, the number of the sensed operation points corresponding to the first operation in the virtual input area is detected, and the duration of the sensed operation points is detected.
When the finger of the user performs the first operation, the finger can be in contact with the display unit of the electronic equipment, and when the finger is in contact with the display unit of the electronic equipment, the display unit is triggered to sense an operation point at the contact part; the finger can not be in contact with the display unit of the electronic equipment, and the finger is a conductor, so that the display unit can sense the operation point corresponding to the finger when the distance between the finger and the display unit is within the sensing distance of the display unit.
Step 403, determining whether the first operation satisfies the following conditions: the number of the operation points of the first operation is larger than a first threshold value, and the duration time for sensing the operation points of the first operation is larger than a second threshold value; if so, go to step 404; otherwise, step 410 is performed.
As an example of step 403, when the user is in the input preparation state, typically at least one finger of the hand will be in contact with the electronic device display unit (corresponding to a first operation), thus, the number of contacts sensed by the display unit of the electronic device is at least 5 (corresponding to the first threshold), and the contact time exceeds the time interval (corresponding to the second threshold) for the user to continuously perform the first operation for inputting, when the number of operation points of the first operation satisfies the above condition, indicating that the input is currently in a pause state, the user may continue inputting based on the current pose of the finger, if the first operation is calibrated in the pause state so that the first operation meets the operation requirement (for example, the positions of the fingers and the reference virtual keys are accurately matched, and the placing pose of the palm relative to the display unit is matched with the reference pose), the input efficiency and the accuracy of subsequent user input based on the current pose can be improved.
Steps 404 to 407 are processes of switching to enter a detection state to determine whether the first operation satisfies the operation requirement.
Step 404, analyzing the first operation to obtain the operation characteristic information of the operation body.
The operation characteristic information of the operation body comprises the position of an operation point obtained by sensing the operation body and the duration of sensing the operation point.
In step 405, the position of the operation point corresponding to the first operation sensed in the virtual input area is compared with the position of the reference operation point.
Because the operation point of the first operation is obtained by the electronic equipment sensing different fingers (corresponding to the operation body), whether the initial position of the first operation in the virtual input area of the electronic equipment is accurate or not can be determined by comparing the operation point of the first operation with a reference operation point (the reference operation point can correspond to the geometric center position of the virtual keys A, S, D, F, J, K, L and the like).
Step 406, the distance of the operating point of the first operation from the reference operating point is compared with a third threshold.
Step 407, determining a first operation reference line based on at least the positions of the first operation point and the second operation point in the operation points.
For example, the first operation reference line may be determined using operation points corresponding to the right index finger and the right little finger, and of course, the first operation reference line may be determined using operation points corresponding to other fingers, such as the right middle finger and the right ring finger.
Step 408, judging whether the following conditions are met: the distance of the operating point of the first operation deviating from the reference operating point is less than a third threshold; the minimum included angle between the first operation datum line and the preset operation datum line is smaller than a fourth threshold value; if yes, judging that the first operation meets the operation requirement, and executing the step 410; otherwise, it is determined that the first operation does not satisfy the operation requirement, and the procedure proceeds to step 409.
The third threshold may correspond to a size (e.g., a side length) of the virtual key, and when the distance from the operating point of the first operation to the reference operating point exceeds the third threshold, it indicates that the user does not have a finger accurately stop at the position of the reference virtual key in the pause state, taking a right hand as an example, the operating point of the first operation may be an operating point corresponding to any one of an index finger, a ring finger, a middle finger and a little finger,
the preset operation reference line can be a reference virtual key such as 'A', 'S', 'D', 'F', 'J', 'K' and 'L'; "the straight line formed by the connection, because the operation point of the first operation is obtained by the electronic device sensing different fingers (corresponding to the operation body), an included angle between the first operation reference line corresponding to the operation point of the first operation and the preset reference operation line reflects a deviation angle of the palm placing direction (the palm placing direction is the placing direction of the palm relative to the virtual input area of the electronic device when the first operation is performed) relative to the palm reference placing direction;
therefore, when the operating point of the first operation deviates from the reference operating point by a distance exceeding the third threshold and by an angle smaller than the fourth threshold (e.g., 10 degrees), it may be determined that the first operation satisfies the operating requirement.
And 409, sending out prompt information based on the distance of the position of the operation point of the first operation deviating from the position of the reference operation point and the minimum included angle between the first operation reference line and the preset operation reference line.
The prompt information is used for indicating the operation point corresponding to the operation body adjustment to move to the reference operation point by the offset distance and indicating the operation body adjustment to adjust the angle relative to the reference operation line so that the minimum included angle is smaller than a third threshold value.
A schematic diagram of sending out the prompt information based on different analysis results is shown in fig. 4b, taking an example that the electronic device senses an operation point corresponding to a right finger, where a dotted arrow represents a distance that the operation point of the right index finger is offset from a reference operation point (i.e., a distance from the center of the right index finger to the center of the key J), and if the distance between the operation point of the right index finger and the key J is shown by an arrow 1, when the distance between the operation point of the right index finger and the reference operation point (corresponding to the key J) is zero (i.e., completely overlapped), and a minimum included angle α between a first reference line corresponding to the operation point of the right index finger and the right middle finger and a preset reference line is smaller than a fourth threshold value (e.g., 10 degrees), it indicates that the placement position of the current index; if the distance between the operating point of the index finger of the right hand and the reference operating point is shown by an arrow 2, the operating point of the index finger of the right hand has a smaller distance from the reference operating point, and the placing direction of the palm of the right hand is compared with the reference placing direction of the palm to generate a deviation of alpha, a prompt message 'OKBecareful' can be sent; if the distance between the operating point of the index finger of the right hand and the reference operating point is shown by an arrow 3, and the minimum included angle β between the first reference line corresponding to the operating point of the index finger of the right hand and the middle finger of the right hand and the preset reference line is greater than a fourth threshold (for example, 10 degrees), the distance between the operating point corresponding to the index finger of the right hand and the reference operating point exceeds the third threshold, and the placing direction of the palm of the right hand and the reference placing direction of the palm are compared to generate a β deviation exceeding the fourth threshold, a prompt message "error needle position" can be sent out to prompt the user that the position needs to be adjusted, for example, the user can be prompted to adjust the placing direction β of the palm clockwise, and the operating point of the index finger of the right hand is moved to the virtual key J by the distance of the reference operating point, so that.
It should be noted that, in fig. 4b, the prompt message is sent out in the form of an image, in practical application, the prompt message may be sent out in the form of voice, or in the form of vibration (a vibrator may be provided in the electronic device), when the first operation does not meet the operation requirement, a vibration prompt is sent out; of course, the prompt message when the difference does not meet the requirement may be sent when the first operation meets the operation requirement.
Step 410, detecting a virtual key triggered by the operation point of the first operation, and generating a signal corresponding to the triggered virtual key.
Step 410 is to complete the input processing based on the first operation, and the generated signal is used to send to the application triggering the invoking of the text input, so that the application obtains the information input by the user; it should be noted that, during the input process of the user, only one finger in one palm of the hand clicks the screen to determine the keystroke behavior, and the simultaneous clicking contact of multiple fingers cannot be recognized as the correct keystroke operation.
In the embodiment, whether the operation requirement is met or not is judged based on the position of the operation point where the finger is in contact with the display unit (corresponding to the first operation) and the reference operation point when the input pause state is in the input pause state, and when the operation requirement is not met, the position of the finger is prompted to be adjusted to meet the operation requirement, so that the efficiency and the accuracy of subsequent input operation can be obviously improved.
Example four
The embodiment describes an information processing method, which is applied to an electronic device, wherein the electronic device supports and displays a virtual input area, and the virtual input area supports and displays keys; as shown in fig. 5a, the information processing method according to the present embodiment includes the steps of:
in step 501, a first operation performed by an operator is received in a virtual input area.
Step 502, detecting the number of the sensed operation points corresponding to the first operation in the virtual input area, and detecting the duration of the sensed operation points.
When the finger of the user performs the first operation, the finger can be in contact with the display unit of the electronic equipment, and when the finger is in contact with the display unit of the electronic equipment, the display unit is triggered to sense an operation point at the contact part; the finger can not be in contact with the display unit of the electronic equipment, and the finger is a conductor, so that the display unit can sense the operation point corresponding to the finger when the distance between the finger and the display unit is within the sensing distance of the display unit.
Step 503, determining whether the first operation satisfies the following condition: the number of the operation points of the first operation is larger than a first threshold value, and the duration time for sensing the operation points of the first operation is larger than a second threshold value; if so, go to step 504; otherwise, step 510 is performed.
As an example of step 503, when the user is in the input preparation state, typically at least one finger of the hand will be in contact with the electronic device display unit (corresponding to a first operation), thus, the number of contacts sensed by the display unit of the electronic device is at least 5 (corresponding to the first threshold), and the contact time exceeds the time interval (corresponding to the second threshold) for the user to continuously perform the first operation for inputting, when the number of operation points of the first operation satisfies the above condition, indicating that the input is currently in a pause state, the user may continue inputting based on the current pose of the finger, if the first operation is calibrated in the pause state so that the first operation meets the operation requirement (for example, the positions of the fingers and the reference virtual keys are accurately matched, and the placing pose of the palm relative to the display unit is matched with the reference pose), the input efficiency and the accuracy of subsequent user input based on the current pose can be improved.
Step 504 to step 507 are processes of switching to enter a detection state to determine whether the first operation meets the operation requirement.
Step 504, analyzing the first operation to obtain the operation characteristic information of the operation body.
The operation characteristic information of the operation body comprises the position of an operation point obtained by sensing the operation body and the duration of sensing the operation point.
Step 505, comparing the position of the operation point corresponding to the first operation sensed in the virtual input area with the position of the reference operation point.
Because the operation point of the first operation is obtained by the electronic equipment sensing different fingers (corresponding to the operation body), whether the initial position of the first operation in the virtual input area of the electronic equipment is accurate or not can be determined by comparing the operation point of the first operation with a reference operation point (the reference operation point can correspond to the geometric center position of the virtual keys A, S, D, F, J, K, L and the like).
Step 506, the distance of the operating point of the first operation deviating from the reference operating point is compared with a third threshold.
Step 507, determining a second operation reference line at least based on the positions of the third operation point and the fourth operation point in the operation points.
For example, the first operation reference line may be determined using an operation point corresponding to the index finger of the right hand and the little finger of the right hand, and of course, the second operation reference line may be determined using an operation point corresponding to another finger, such as the middle finger of the right hand and the ring finger of the right hand.
Step 508, determine whether the following conditions are met: the distance of the operating point of the first operation deviating from the reference operating point is less than a third threshold; whether the first distance is smaller than a fifth threshold (the first distance is a distance from a fifth operation point of the operation points to the second operation reference line); if yes, judging that the first operation meets the operation requirement, and executing step 510; otherwise, it is determined that the first operation does not satisfy the operation requirement, and the process proceeds to step 509.
The third threshold may correspond to a size (e.g., a side length) of the virtual key, and when the distance from the operating point of the first operation to the reference operating point exceeds the third threshold, it indicates that the user does not have a finger accurately stop at the position of the reference virtual key in the pause state, taking a right hand as an example, the operating point of the first operation may be an operating point corresponding to any one of an index finger, a ring finger, a middle finger and a little finger,
the preset operation reference line can be a reference virtual key such as 'A', 'S', 'D', 'F', 'J', 'K' and 'L'; "the straight line formed by the connection, because the operation point of the first operation is obtained by the electronic device sensing different fingers (corresponding to the operation body), the distance between the fifth operation point (different from the third operation point and the fourth operation point) and the second operation reference line reflects the bending degree of the contact connecting line of the finger sensed by the display unit of the electronic device (the larger the bending degree, the more inaccurate the position of the finger);
therefore, when the operating point of the first operation deviates from the reference operating point by a distance exceeding the third threshold and the first distance is smaller than the fifth threshold, it may be determined that the first operation satisfies the operating requirement.
In step 509, a prompt message is sent out based on the distance between the position of the operation point of the first operation and the position of the reference operation point, and the first distance.
The prompt information is used for instructing the operation body to adjust the operation point corresponding to the operation body to move to the reference operation point by the offset distance of the operation point, and instructing the operation body to adjust the position of the finger corresponding to the fifth operation point.
A schematic diagram of sending out the prompt information based on different analysis results is shown in fig. 5b, taking an example that the electronic device senses an operation point corresponding to a right finger, where a dotted arrow represents a distance that the operation point of the right index finger is offset from a reference operation point (i.e., a distance from the center of the right index finger to the center of the key J), and if the distance between the operation point corresponding to the right index finger and the key J is shown by an arrow 1 and a distance D1 between the operation point of the middle finger of the right hand and the second reference line is smaller than a fifth threshold, it indicates that the placement pose of the finger is very accurate, and the prompt information good can be sent out; if the distance between the operating point of the index finger of the right hand and the reference operating point is shown by an arrow 2, the distance D2 between the operating point of the middle finger of the right hand and the second reference line is smaller than a fifth threshold value, and the placing direction of the palm of the right hand is compared with the reference placing direction of the palm to generate a deviation alpha, which indicates that the operating point of the index finger of the right hand and the reference operating point have a smaller distance, and the middle finger of the right hand deviates from the other fingers of the right hand by a distance D2, a prompt message "OKBecareful" can be sent; if the distance between the operating point of the index finger of the right hand and the reference operating point is shown by an arrow 3, and the distance D2 between the operating point of the middle finger of the right hand and the second reference line is greater than the fifth threshold, it indicates that the distance between the operating point corresponding to the index finger of the right hand and the reference operating point exceeds the third threshold, and the placement position of the middle finger of the right hand and the finger of the middle finger of the right hand obviously do not form a straight line, and may send a prompt message "error needle position" to prompt the user to adjust the placement position of the finger, for example, may prompt the user to move the operating point of the index finger of the right hand to the virtual key J by the distance of the offset of the reference operating point, and move the middle finger of the right hand downward by the distance D2.
It should be noted that, in fig. 5b, the prompt message is sent out in the form of an image, in practical application, the prompt message may be sent out in the form of voice, or in the form of vibration (a vibrator may be provided in the electronic device), when the first operation does not meet the operation requirement, a vibration prompt is sent out; of course, the prompt message when the difference does not meet the requirement may be sent when the first operation meets the operation requirement.
Step 510, detecting a virtual key triggered by an operation point of the first operation, and generating a signal corresponding to the triggered virtual key.
Step 510 is to complete an input processing process based on a first operation, and the generated signal is used to send to an application triggering and calling text input, so that the application obtains information input by a user; it should be noted that, during the input process of the user, only one finger in one palm of the hand clicks the screen to determine the keystroke behavior, and the simultaneous clicking contact of multiple fingers cannot be recognized as the correct keystroke operation.
In the embodiment, whether the operation requirement is met or not is judged based on the position of the operation point where the finger is in contact with the display unit (corresponding to the first operation) and the reference operation point when the input pause state is in the input pause state, and when the operation requirement is not met, the position of the finger is prompted to be adjusted to meet the operation requirement, so that the efficiency and the accuracy of subsequent input operation can be obviously improved.
This embodiment describes an electronic processing device, as shown in fig. 6, the electronic processing device includes:
the display unit 10 is used for displaying a virtual input area, and the virtual input area supports displaying keys;
a receiving unit 20 configured to receive a first operation performed by an operator in the virtual input area;
an analyzing unit 30, configured to analyze the first operation to obtain operation characteristic information of the operation body;
a judging unit 40 configured to judge whether the first operation satisfies an operation requirement based on operation characteristic information of the operation body;
the prompting unit 50 is configured to send a prompting message based on the analysis result when the obtained analysis result indicates that the first operation does not meet the operation requirement; the prompt information is used for indicating the operation body to adjust the first operation, so that the adjusted first operation meets the operation requirement.
As an embodiment, the electronic device further comprises:
a detecting unit 60 for detecting the number of operation points corresponding to the first operation sensed in the virtual input area and detecting a duration time during which the operation points are sensed;
when the number of the operation points of the first operation is greater than a first threshold and the duration time of sensing the operation points is greater than a second threshold, the detection state is switched to enter, so as to trigger the determining unit 40 to determine whether the first operation meets the operation requirement.
As an embodiment, the determining unit 40 includes (not shown in the figure):
the first comparison module is used for comparing the position of the operation point corresponding to the first operation, which is sensed in the virtual input area, with the position of a reference operation point;
the judging module (coupled with the first comparing module) is used for judging that the first operation meets the operation requirement when the distance of the operating point of the first operation deviating from the reference operating point is smaller than a third threshold value; otherwise, the first operation is judged not to meet the operation requirement.
As an embodiment, the determining unit 40 further includes (not shown in the figure):
a first determining module (coupled to the judging module) for determining a first operation reference line based on at least the positions of a first operation point and a second operation point of the operation points;
the judging module is further configured to compare a minimum included angle between the first operation reference line and a preset operation reference line with a fourth threshold, and determine that the obtained comparison result represents that the minimum included angle is greater than the fourth threshold, and when a distance from an operation point of the first operation to the reference operation point is less than a third threshold, it is determined that the first operation meets an operation requirement; otherwise, the first operation is judged not to meet the operation requirement.
As an embodiment, the prompting unit 50 is further configured to send the prompting information based on a distance that a position of the operation point of the first operation deviates from a position of the reference operation point and a minimum included angle between the first operation reference line and a preset operation reference line; wherein,
the prompt information is used for indicating that the operation point corresponding to the operation body moves the offset distance to the reference operation point, and indicating that the operation body adjusts the angle relative to the reference operation line, so that the minimum included angle is smaller than the fourth threshold value.
As an embodiment, the determining unit 40 further includes (not shown in the figure):
a second determining module (coupled to the judging module) for determining a second operation reference line based on at least the positions of a third operation point and a fourth operation point of the operation points;
the judging module is further configured to compare a first distance with a fifth threshold, where the first distance is a distance from a fifth operation point of the operation points to the second operation reference line; when the obtained comparison result is determined to represent that the first distance is smaller than the fifth threshold, judging that the first operation meets the operation requirement; otherwise, the first operation is judged not to meet the operation requirement.
As an embodiment, the prompting unit 50 is further configured to issue the prompting message based on a distance that an operation point of the first operation deviates from the reference operation point and the first distance; wherein,
the prompt information is used for instructing the operation body to adjust the corresponding operation point to move the offset distance to the reference operation point, and instructing the operation body to adjust the position of the fifth operation point, so that the first distance is smaller than the third threshold.
As an embodiment, the prompting unit 50 is further configured to issue at least one of the following types of prompting messages:
voice prompt information; image prompt information; and (5) vibration induction prompt information.
In practical applications, the display unit 10 may be a display screen in an electronic device; the receiving unit 20 may be implemented by a display unit and a touch driving integrated circuit; the analysis unit 30, the judgment unit 40 and the detection unit 60 can be implemented by a Microprocessor (MCU) or a logic programmable gate array (FPGA) in the electronic device; when the image prompt information needs to be sent out, the prompt unit 50 can be realized by a display screen in the electronic equipment; when voice prompt information needs to be sent out, the prompt unit 50 can be realized by a microphone in the electronic equipment; the prompting unit 50 can be implemented by a vibrator in the electronic device when it is required to send out a vibration sensing prompt message.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a removable memory device, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.