Detailed Description
Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Embodiments may be implemented in a number of different forms. One of ordinary skill in the art will readily recognize the fact that the manner and content may be changed into other forms without departing from the spirit and scope of the present disclosure. Accordingly, the present disclosure should not be construed as being limited to the following description of the embodiments. Embodiments of the present disclosure and features of embodiments may be combined with each other arbitrarily without conflict.
In the drawings, the size of one or more constituent elements, thicknesses of layers or regions may be exaggerated for clarity. Accordingly, one aspect of the present disclosure is not necessarily limited to this dimension, and the shape and size of one or more components in the drawings do not reflect true proportions. Further, the drawings schematically show ideal examples, and one mode of the present disclosure is not limited to the shapes or numerical values shown in the drawings, and the like.
The ordinal numbers of "first", "second", "third", etc. in the present specification are provided to avoid mixing of constituent elements, and are not intended to be limited in number. The term "plurality" in this disclosure means two or more in number.
In the present specification, for convenience, words such as "middle", "upper", "lower", "front", "rear", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like, which indicate an azimuth or a positional relationship, are used to describe positional relationships of constituent elements with reference to the drawings, only for convenience of description and simplification of the description, and do not indicate or imply that the apparatus or elements referred to must have a specific azimuth, be configured and operated in a specific azimuth, and thus are not to be construed as limiting the present disclosure. The positional relationship of the constituent elements is appropriately changed according to the direction of the described constituent elements. Therefore, the present invention is not limited to the words described in the specification, and may be appropriately replaced according to circumstances.
In this specification, the terms "mounted," "connected," and "connected" are to be construed broadly, unless explicitly stated or limited otherwise. For example, it may be a fixed connection, a removable connection, or an integral connection; may be a mechanical connection, or a connection; may be directly connected, or indirectly connected through intermediate members, or may be in communication with the interior of two elements. The meaning of the above terms in the present disclosure can be understood by one of ordinary skill in the art as appropriate. In this specification, "electrically connected" includes a case where constituent elements are connected together by an element having some electric action. The "element having a certain electric action" is not particularly limited as long as it can transmit an electric signal between the connected constituent elements. Examples of the "element having some electric action" include not only an electrode and a wiring but also a switching element such as a transistor, a resistor, an inductor, a capacitor, other elements having various functions, and the like.
With the development of technology, there is an urgent need for haptic perception and haptic reproduction in man-machine interaction. However, the current haptic effect in the human-computer interaction process is single, which easily results in monotonous haptic feeling of the user and poor user experience.
The embodiment provides an interaction method, a display touch device and a storage medium, which can improve the situation that the single touch perception effect in the human-computer interaction process affects the user experience.
Fig. 1 is a flow chart illustrating an interaction method according to at least one embodiment of the present disclosure. In some examples, as shown in fig. 1, the interaction method provided in this embodiment may include the following steps.
Step 101, determining a touch operation on a graphical user interface (GUI, GRAPHICAL USER INTERFACE) for a target object, and determining touch parameter information of the touch operation.
Step 102, generating a touch signal according to the touch parameter information. Wherein the haptic signal is configured to drive the haptic feedback device to generate a corresponding haptic feedback effect.
Step 103, when the touch parameter information of the touch operation is detected to change, updating the touch signal according to the updated touch parameter information.
In some examples, for a user's touch operation on a target object, corresponding haptic feedback may be generated. For example, the GUI may display GUI controls (e.g., including button controls, control bar controls, knob controls, etc.), the user may perform touch operations (e.g., including click operations, slide operations, etc.) on the GUI controls, and haptic feedback effects corresponding to the GUI controls and touch operations may be generated by the haptic feedback device for the user's touch operations on the GUI controls. Moreover, in the process of changing the touch parameters of the touch operation of the GUI control, the corresponding haptic feedback effect can be adjusted according to the change of the touch parameters, so that the user can feel rich haptic feedback effects, and the user experience is enhanced.
In the interaction method of the embodiment, the haptic signal may be determined by the touch parameter information of the touch operation for the target object, and the haptic signal may be changed along with the change of the touch parameter information of the touch operation, so as to generate rich haptic feedback effects. In this way, not only the interactive experience of the user can be enriched, but also the touch operation of the user can be effectively guided based on different haptic feedback effects, for example, the blind operation of the user can be prompted and guided.
In some examples, when no change in touch parameter information for a touch operation of a target object is detected, the haptic signal may be kept unchanged so as to generate a haptic feedback effect consistent with the previous. When the touch operation for the target object is detected to be finished, the output of the tactile signal can be stopped, and the next touch operation for the target object is detected to wait for the tactile feedback.
In some examples, after detecting a touch operation for a target object, touch parameter information of the touch operation may be detected and acquired in real time, and whether the touch parameter information changes may be determined according to the continuously acquired touch parameter information, so as to change the haptic signal according to the change of the touch parameter information. In other examples, after detecting the touch operation for the target object, the touch parameter information of the touch operation may be periodically detected and acquired, and whether the touch parameter information changes may be determined according to the periodically acquired touch parameter information, so as to change the haptic signal according to the change of the touch parameter information. The present embodiment is not limited thereto.
In some examples, the interaction method of the present embodiment may be applied to a display touch device. The display touch device may be an electronic device having a display function and a touch function. For example, displaying the touch device may include: cell phone, tablet computer, wearable device, vehicle-mounted device, central control device, etc. The display touch device can receive touch operation of a user and generate corresponding touch feedback effects through the touch feedback device aiming at the touch operation of a target object. However, the present embodiment is not limited thereto.
In some examples, the application scenario of the interaction method of the present embodiment may include, but is not limited to: intelligent home, intelligent wear, intelligent transportation, intelligent finance, and the like.
In some examples, the touch parameter information of the touch operation may include at least one of: touch position, touch pressure, touch number, touch area, touch duration and touch sequence. The touch parameter information of this example may be parameter information characterizing an attribute feature of the touch operation. For example, the touch parameter information of the touch operation may include: touch position, touch pressure, number of touches, touch area, touch duration, or touch sequence; as another example, the touch parameter information may include: the touch position and the touch pressure, or the touch position and the touch area, or the touch position and the touch duration, or the touch pressure and the touch duration. The combination of touch parameters included in the touch parameter information is not limited in this embodiment.
In some examples, the touch location may characterize the location of the touch operation on the touch surface of the display touch device. For example, the touch operation is a click operation, and the touch position may include coordinate information of a contact point of the click operation on a touch surface of the display touch device. For example, the touch operation is a sliding operation, and the touch position of the sliding operation acquired at a certain moment may include coordinate information of a contact point of the sliding operation on a touch surface of the touch device at the certain moment. For the sliding operation, the touch displacement of the sliding operation may be determined according to the change of the touch position. In some examples, the display touch device may include a capacitive touch panel to identify contact locations at the touch surface. The present embodiment is not limited thereto.
In some examples, touch pressure may refer to a force applied by a user's finger to a touch surface of a display touch device when performing a touch operation. For example, the touch operation is a click operation, and the touch pressure may be an amount of force applied to the touch surface of the display touch device by the click operation. For example, the display touch device may include a pressure detection sensor (e.g., a piezoelectric ceramic sheet) that may detect a touch pressure of a touch operation on a touch surface.
In some examples, the number of points of touch may refer to the number of contacts a user's finger applies to a touch surface of a display touch device when performing a touch operation. The touch points of the touch operation can be collected for a display touch panel supporting multi-point touch. For example, a display touch device may include a capacitive touch panel to capture the number of contacts on a touch surface.
In some examples, the touch area may refer to the contact area of a user's finger with a touch surface of a display touch device when performing a touch operation. For example, the touch operation is a click operation and there is only one contact, and the touch area may be a contact area of a single contact of the click operation. For another example, the touch operation is a click operation and includes a plurality of contacts, and the touch area may be a sum of contact areas of all contacts of the click operation.
In some examples, the touch duration may refer to a dwell time of a user on a touch surface of the display touch device while performing a touch operation. For example, the touch operation is a click operation and there is only one contact, and the touch duration may be the duration that a single contact of the click operation stays on the touch surface. For another example, the touch operation is a click operation and includes a plurality of contacts, and the touch duration may be a maximum duration in which all contacts of the click operation stay on the touch surface. For another example, the touch operation is a sliding operation, and the touch duration may refer to a contact duration between the contact and the touch surface in the sliding operation.
In some examples, the touch sequence may refer to a direction of movement of a user on a touch surface of the display touch device when performing a touch operation. For example, the touch operation is a sliding operation, and the touch sequence may refer to a moving direction of a contact point of the sliding operation on the touch surface.
In some examples, the haptic signal may be characterized by at least one of the following parameters: waveform type, waveform amplitude, waveform frequency. For example, by adjusting at least one of the waveform type, waveform amplitude, and waveform frequency, different haptic signals may be generated, thereby driving different haptic feedback effects.
In some examples, the feedback strength of the haptic signal may be adjusted by setting at least one parameter of the haptic signal. For example, when the waveform type and waveform amplitude are the same, the higher the waveform frequency of the haptic signal, the greater the feedback intensity; the lower the waveform frequency of the haptic signal, the less the feedback intensity. As another example, when the waveform type and the waveform frequency are the same, the greater the waveform amplitude of the haptic signal, the greater the feedback intensity, and the smaller the waveform amplitude of the haptic signal, the smaller the feedback intensity.
In some examples, the waveform frequency of the haptic signal may be less than or equal to 200 hertz (Hz). The haptic signal of the waveform frequency of the present example helps to create a film-pressing effect with the finger, thereby changing the surface friction coefficient, giving a rich haptic feedback effect.
In some examples, the waveform type may include at least one of: pulse wave, square wave, triangular wave, sine function wave, sawtooth wave. Where the waveform amplitude and the waveform frequency are equal, the feedback intensity of the square wave, the rectangular wave is relatively small, and the feedback intensity of the pulse wave, the triangular wave and the sawtooth wave is relatively large. In some examples, a high frequency pulse wave may be provided as the haptic signal to achieve a haptic feedback effect with relatively large feedback intensity; by setting a low frequency square wave as the haptic signal, a haptic feedback effect with relatively small feedback intensity is achieved. The present embodiment is not limited to the waveform type of the haptic signal. In some examples, the waveforms described above may be combined or converted to generate a desired waveform.
In some examples, in step 11, determining a touch operation of the graphical user interface for the target object may include: and determining the touch operation as the touch operation aiming at the target object when the touch position of the touch operation is positioned in the area where the target object is positioned and the type of the target object is matched with the type of the touch operation. For example, after the touch operation is detected, whether the touch operation is operated in the area where the target object is located or not can be judged according to the touch position of the touch operation and the position of the area where the target object is located; when the touch position of the touch operation is located in the area where the target object is located and the type of the target object is matched with the type of the touch operation, it can be determined that the detected touch operation is the touch operation for the target object. When the touch position of the detected touch operation is not in the area where the target object is located or the type of the target object is not matched with the type of the touch operation, it can be determined that the detected touch operation is not the touch operation for the target object.
In some examples, the type of target object may include at least one of: GUI controls, set multi-touch areas. Wherein the GUI control may include: button controls, control bar controls, knob controls. The present embodiment is not limited thereto.
In some examples, the types of touch operations may include at least: click operation and slide operation.
In some examples, the matching relationship between the type of the target object and the type of the touch operation may be preset, and after determining the type of the target object and the type of the touch operation, whether the two match is determined according to the preset matching relationship. For example, the matching relationship of the type of the target object and the type of the touch operation may include at least one of: the button control is matched with the clicking operation, the control bar control is matched with the sliding operation, the knob control is matched with the sliding operation, and the multi-point touch area is matched with the clicking operation. In some examples, the sliding operation for the button control is not considered a touch operation to activate the button control, failing to trigger the interaction method of the present example; clicking operation for the control bar control is not considered as touch operation for starting the control bar control, and the interaction method of the example cannot be triggered; clicking operation on the knob control is not considered as a touch operation to start the knob control, and cannot trigger the interaction method of the present example.
In some examples, step 12 may include: determining a corresponding relation between touch parameter information and parameters of a touch signal according to the type of the target object and the type of touch operation aiming at the target object; and generating a touch signal according to the touch parameter information and the corresponding relation between the touch parameter signal and the parameters of the touch signal. For example, for a target object and a touch operation, the type of which has a matching relationship, a correspondence relationship between touch parameter information of the touch operation and parameters of a haptic signal may be preset. After the type of the target object and the type of the touch operation are determined to be matched, a corresponding relationship between the touch parameter information of the touch operation and the parameters of the haptic signal can be determined so as to generate the corresponding haptic signal according to the touch parameter information, thereby driving to generate the corresponding haptic feedback effect.
In some examples, when the target object includes a control bar control and the touch operation for the target object is a sliding operation, it may be determined that the waveform frequency of the haptic signal depends on the touch position of the touch operation. In this example, for the sliding operation of the control bar control, the waveform frequency of the haptic signal can be changed according to the position change of the contact during the sliding operation, so that different haptic feedback results can be given during the sliding operation of the sliding operation, so as to enrich the haptic sensation of the user.
In some examples, when the target object includes a button control and the touch operation for the target object is a click operation, it may be determined that the waveform amplitude of the haptic signal depends on the touch pressure of the touch operation. In this example, for the click operation of the button control, the waveform amplitude of the haptic signal may be changed according to the change of the touch pressure applied during the click operation, so as to give different haptic feedback results to enrich the haptic sensation of the user.
In some examples, when the target object includes a multi-touch area and the touch operation for the target object is a click operation, it may be determined that the waveform type of the haptic signal depends on the number of touches of the touch operation. In this example, for the clicking operation of the multi-touch area, the waveform type of the haptic signal may be changed according to the change of the number of the touch points in the clicking operation, so as to give different haptic feedback results to enrich the haptic sensation of the user.
The scheme of the present embodiment is illustrated by some examples below.
Fig. 2 is a schematic diagram of a display touch device according to at least one embodiment of the disclosure. In some examples, as shown in fig. 2, the display touch device of the present embodiment may include: the touch panel 21, the haptic feedback device 22, and the processor 23 are displayed. The processor 23 is connected to the display touch panel 21 and the haptic feedback device 22.
In some examples, the Processor 23 may be a microcontroller (MCU, microcontroller Unit), a central processing unit (CPU, central Processing Unit), a general purpose Processor, a data signal Processor (DSP, digital Signal Processor), an Application specific integrated electrode (ASIC), a Field-Programmable gate array (FPGA) GATE ARRAY, or other Programmable logic device, a transistor logic device, or any combination of the above. For example, a processor may be a combination that implements computing functionality, such as may include one or more microprocessor combinations, a combination of DSPs and microprocessors, and the like.
In some examples, the display touch panel 21 may include a display panel and a touch panel. The touch panel may collect touch operations thereon by a user (e.g., operations on the touch panel using a finger by the user) and implement corresponding operations according to a preset program. For example, the user clicks on the operation of the shortcut identification of the function module, etc. The touch panel may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The capacitive touch panel operates based on the principle that the size of a capacitance varies with the size of finger pressure. The resistive touch panel works based on the principle that the resistance of the piezoresistor changes along with the pressure of the finger. For example, the touch panel may be a capacitive touch panel. In some examples, the touch panel may be configured to collect touch parameter information of a touch operation, such as a touch location, a touch duration, a touch area, a number of touches, a touch order of the touch operation. In other examples, the display touch panel may incorporate a pressure sensor (e.g., an optical fiber or a piezoelectric ceramic sheet) to collect touch pressure of a touch operation.
In some examples, the touch panel may overlay the display panel, and after the touch panel detects a touch operation thereon, the touch panel is transmitted to the processor to determine a type of touch event, and then the processor provides a corresponding interface output on the display panel according to the type of touch event. The touch panel and the display panel may be implemented as two independent components for input and output functions of the mobile terminal. In some examples, the touch panel and the display panel may be integrated to implement input and output functions. For example, displaying the touch panel 21 may include: a substrate (such as a glass substrate), and a display structure and a touch structure sequentially disposed on the substrate.
In some examples, haptic feedback device 22 may include: piezoelectric structures (e.g., including piezoelectric ceramic sheets, or piezoelectric films) and drive circuits. The piezoelectric structure is electrically connected with the driving circuit. The driving circuit may receive the haptic signal from the processor 23 and drive the piezoelectric structure to generate a haptic feedback effect in accordance with the haptic signal. For example, the haptic feedback device 22 may be located on a side of the substrate of the display touch panel 21 remote from the touch structure; or the tactile feedback device 22 may be located on a side of the touch structure that is proximate to the substrate. In some examples, the piezoelectric structure of the haptic feedback device may simultaneously serve as a pressure sensor, enabling the acquisition of touch pressure for a touch operation. The present embodiment is not limited thereto. In other examples, the display touch device may be provided with a separate pressure transmitter for touch pressure acquisition.
In some examples, the haptic feedback effect generated by the haptic feedback device may include a haptic feedback effect generated based on a film-pressing effect. The air pressure film can be formed between the surface of the finger of the user and the touch surface (such as a horizontal plane) of the display touch device, has high-pressure characteristic and certain extrusion force, and can change the positive pressure touched by the finger, so that the relative friction coefficient between the finger and the touch surface is changed, and the film pressing effect is generated. Different touch sensations can be presented based on the film-pressing effect produced by different haptic signals. The present example utilizes the film pressing effect to give haptic feedback effects, can feedback a more realistic touch sensation to the user, can optimize the user experience, and avoids the haptic feedback effects of excessive force or stimulus from affecting the user experience.
FIG. 3 is a schematic plan view of a haptic feedback device in accordance with at least one embodiment of the present disclosure. In some examples, as shown in fig. 3, the piezoelectric structure of haptic feedback device 22 may include: a plurality of piezoelectric ceramic pieces 221 arrayed. The piezoelectric ceramic plates 221 at the corresponding positions can vibrate under the driving of the driving circuit, so that the touch surface generates in-plane deformation and out-of-plane deformation, and the user finger can feel the haptic feedback effect.
In some examples, the set region of the array of piezoceramic sheets may correspond to a touch region of a display touch device. The piezoelectric ceramic chip array of this example can be used as a pressure sensor for displaying a touch device at the same time. For example, the plurality of piezoelectric ceramic plates in the range of the contact point of the touch operation can collect the touch pressure of the touch operation, and the data processing is performed on the touch pressure collected by the plurality of piezoelectric ceramic plates, so that the touch pressure of the contact point can be determined. For another example, one or more piezoelectric ceramic plates in the range of the contact point of the touch operation can vibrate under the drive of the driving circuit, so as to realize the haptic feedback for the touch operation. However, the present embodiment is not limited thereto. In other examples, the haptic feedback device may include a plurality of piezoelectric ceramic plates disposed in a peripheral region of the display touch device, and the piezoelectric ceramic plates may vibrate under the driving of the driving circuit to implement haptic feedback for touch operation.
Fig. 4 is an example flow chart of an interaction method of at least one embodiment of the present disclosure. FIG. 5 is a schematic diagram of a control bar control in accordance with at least one embodiment of the present disclosure. Fig. 6A and 6B are diagrams illustrating an operation of at least one embodiment of the present disclosure. In this example, a target object is taken as a control bar control, and a touch operation matched with the control bar control is taken as a sliding operation for illustration.
In some examples, as shown in fig. 4, the interaction method of the present example may include the following steps.
Step 101, detecting whether a graphical user interface has touch operation. In some examples, the display touch panel may detect whether the graphical user interface has a touch operation in real time or periodically.
In some examples, step 102 may be performed when the display touch panel detects a touch operation; when no touch operation is detected, the process may return to step 101 to continue to detect whether there is a touch operation, for example, whether a touch operation occurs may be detected in real time.
Step 102, obtaining touch parameter information of a touch operation. In some examples, the display touch panel may acquire touch parameter information of a touch operation after detecting the touch operation. For example, the display touch panel may detect at least one of a touch position, a touch area, a touch point number, a touch duration, and a touch order of a touch operation through a capacitive touch panel having a function of recognizing a contact point position; for another example, the display touch panel may integrate a pressure sensor, and detect a touch pressure of a touch operation using the pressure sensor. In this example, the touch parameter information for the touch operation includes: the touch position is described as an example.
Step 103, judging whether the touch operation is a touch operation for the target object. In some examples, when it is determined that the touch operation is a touch operation for the target object, steps 104 and 105 may be performed; when it is determined that the touch operation is not a touch operation for the target object, feedback may not be performed on the touch operation, for example, the touch operation is considered to be an erroneous operation, and step 101 is returned.
In some examples, the display touch panel may transmit touch parameter information of a touch operation acquired in real time or periodically to the processor. The processor may determine, according to the collected touch parameter information (including a touch position, for example) of the touch operation, whether the type of the touch operation and the touch operation are located in the area where the target object is located, and determine whether the detected type of the touch operation matches the type of the target object by combining a matching relationship between the type of the preset target object and the type of the touch operation. For example, if the detected touch operation is identified to be located in the area where the target object is located and the type of the detected touch operation is matched with the type of the target object, it may be determined that the detected touch operation is a touch operation for the target object. When the touch operation is not located in the area where the target object is located or the type of the detected touch operation is not matched with the type of the target object, it can be determined that the detected touch operation is not the touch operation of the target object. In this example, when it is identified that the detected touch operation is located in the area where the control bar control is located and the detected touch operation is a sliding operation, it may be determined that the detected touch operation is a touch operation for the control bar control.
Step 104, generating a touch signal according to the touch parameter information of the touch operation. In some examples, the processor may determine a correspondence between the touch parameter information and parameters of the haptic signal according to the type of the target object and the type of the touch operation, and generate the corresponding haptic signal according to the touch parameter information and the correspondence between the touch parameter information and parameters of the haptic signal. The processor may send the generated haptic signal to a haptic feedback device, which may generate a corresponding haptic feedback effect based on the haptic signal. This example takes a change in the touch position of a touch operation as an example to adjust the waveform frequency of the haptic signal.
In some examples, control bar control 31 is illustrated as a bar-like structure extending in a first direction X, as shown in fig. 5. The second direction Y intersects the first direction X, e.g. the first direction X is perpendicular to the second direction Y. The planes of the first direction X and the second direction Y may be parallel to a plane of a touch surface of the display touch panel, for example. The control bar control 31 may be configured for adjusting functions such as adjusting volume, adjusting brightness, adjusting temperature, etc. The control bar control 31 may have a bar-shaped adjustment area on which a slider 32 is arranged. The slider 32 may be moved in the adjustment zone of the bar to indicate the corresponding adjustment value. The user can perform a setting operation in the bar-shaped adjustment area by dragging the slider 32. For example, the user drags the slider 32 to move in the first direction X in the bar-shaped adjustment area, and may adjust the volume gradually to increase, or adjust the brightness gradually to increase; the user drags the slider 32 to move in the bar-shaped adjustment area in the opposite direction of the first direction X, and can adjust the volume or gradually decrease the brightness. In some examples, the slider 32 may be a rounded rectangular block. The present embodiment is not limited to the shape of the slider. For example, the slider 32 may be a circular block, or an oval block, or an arrow-shaped structure located in the adjustment region of the bar. In other examples, the display slider 32 may be hidden and the slider 32 may be displayed upon detection of a touch operation at a control bar control.
In some examples, as shown in fig. 5, the control bar control 31 may be divided into a continuous plurality of first sub-regions 310 along the length of the control bar control 31. The areas of the plurality of first sub-regions 310 may be substantially the same. The present embodiment is not limited thereto. For example, the areas of the plurality of first sub-regions may be partially identical. As another example, the areas of the plurality of first sub-regions may be different, e.g., may be increasing or decreasing along the first direction.
In some examples, as shown in fig. 5, the waveform frequency of the haptic signals corresponding to the plurality of first sub-regions 310 of the control bar control 31 may vary along the length of the control bar control 31. For example, the waveform frequencies of the haptic signals corresponding to the plurality of first sub-regions 310 arranged in the first direction X may be sequentially increased or sequentially decreased. When the waveform type and waveform amplitude of the haptic signal are the same, the feedback intensity of the haptic feedback effect may be changed by changing the waveform frequency, e.g., the greater the waveform frequency, the greater the feedback intensity, the smaller the waveform frequency, and the smaller the feedback intensity. The waveform frequencies corresponding to the plurality of first sub-regions 310 of the control bar control 31 in this example are different, so that the feedback intensities of the haptic feedback effects for the touch operation of the different first sub-regions are different, so that the user can feel the haptic feedback effects with different feedback intensities in the different first sub-regions of the control bar control conveniently.
In some examples, as shown in fig. 5, taking an example of a gradual increase in the adjustment value of the control bar control 31 along the first direction X, the waveform frequencies of the control bar control 31 corresponding to the plurality of first sub-regions 310 along the first direction X may sequentially increase. In this way, the user can feel the haptic feedback effect of different feedback intensity, for example, feel the increase of the feedback intensity along the first direction X in the sliding operation of dragging the slider 32 along the first direction X. For example, the sliding of the slider along the first direction X in the control bar control may increase the volume, the sliding along the opposite direction of the first direction X in the control bar control may decrease the volume, and by setting the waveform frequencies corresponding to the continuous multiple first sub-regions 310 along the first direction X to sequentially increase, the feedback intensity corresponding to the continuous multiple first sub-regions 310 along the first direction X may be gradually increased, and during the sliding operation of the user dragging the slider along the first direction X, the gradually increased feedback effect may be felt, and during the sliding operation of the user dragging the slider along the opposite direction of the first direction X, the gradually decreased feedback effect may be felt.
In some examples, the processor may generate the haptic signal f1 (x 1, y 1) from the touch location for the sliding operation of the control bar control, including, for example, the origin location coordinates P1 (x 1, y 1). Where x1 is the abscissa of the starting position, y1 is the ordinate of the starting position, and f1 is the waveform function. The waveform function corresponds to a waveform type, and the waveform functions of different waveform types are different. The waveform function of the present example may be a sine function, thereby generating a sine function wave. The waveform type and waveform amplitude of the haptic signal may take on preset values.
In some examples, after determining a sliding operation for a control bar control, the processor may generate a haptic signal according to a touch position of the sliding operation as shown in fig. 6A. As shown in fig. 6A, the coordinates of the start point position of the sliding operation are located in the first sub-area near the left end of the control bar control, and the waveform frequency of the corresponding generated haptic signal is small.
In some examples, the processor may transmit the generated haptic signal to the haptic feedback device to drive the haptic feedback device to generate a corresponding haptic feedback effect. For example, the haptic feedback device may drive the piezoelectric ceramic sheet corresponding to the touch location according to the haptic signal f1 (x 1, y 1) to generate a vibration displacement according to the feedback intensity of the haptic signal, so that the user senses vibration or friction of the touch surface.
Step 105, determining whether the touch position of the touch operation is changed. In some examples, the processor may determine whether the touch parameter information of the touch operation for the target object changes according to touch parameter information of the touch operation acquired in real time or periodically by the display touch panel. When it is detected that the touch parameter information of the touch operation for the target object is changed, step 106 may be executed; when it is detected that the touch parameter information of the touch operation for the target object is not changed, the haptic signal generated in step 104 is output, and the touch operation is continuously detected, and whether the touch operation for the target object is ended is detected.
In some examples, for a sliding operation of a control bar control, a coordinate position of a contact point during the sliding operation may be acquired, e.g., a midpoint position coordinate P2 (x 2, y 2) of the sliding operation. From the coordinates of the intermediate point position of the sliding operation, an updated haptic signal may be obtained as f2 (x 2, y 2), where x2 is the abscissa of the intermediate point position, y2 is the ordinate of the intermediate point position, and f2 is a waveform function, for example, may be a sine function.
In some examples, the haptic signal generated by the processor according to the updated touch position of the sliding operation may be as shown in fig. 6B. As shown in fig. 6B, the mid-point location coordinates of the sliding operation may be located within the first sub-region of the mid-portion of the control bar control, and the waveform frequency of the correspondingly generated haptic signal may be greater. The waveform functions f1 and f2 may be the same waveform function, and the waveform frequency corresponding to the waveform function f2 is greater than the waveform frequency of the waveform function f 1.
In some examples, the processor may transmit the updated haptic signal to the haptic feedback device to drive the haptic feedback device to update the corresponding haptic feedback effect. For example, the haptic feedback device may drive the piezoelectric ceramic sheet corresponding to the updated touch location according to the haptic signal f2 (x 2, y 2) to generate a vibration displacement according to the feedback intensity of the haptic signal, so that the user senses the vibration of the touch surface. The user can feel the haptic feedback with gradually increased feedback intensity along the direction of the sliding operation, compared to the haptic feedback felt at the starting point position of the sliding operation.
In some examples, the haptic feedback device may include: a plurality of haptic feedback units (e.g., piezoelectric ceramic sheets) may be arranged in an array. The haptic feedback device may drive the haptic feedback unit corresponding to the touch position of the touch operation to generate the haptic feedback effect after receiving the haptic signal. For example, the haptic feedback unit corresponding to the touch position or the haptic feedback unit adjacent to the touch position is driven to generate a vibration effect so that the user's finger can feel the haptic feedback.
In some examples, the processor may determine in real time or periodically whether a touch location of a touch operation for the target object has changed, thereby enabling real-time or periodic updating of the haptic signal. In this example, when the touch position of the sliding operation of the control bar control is detected to change, the haptic signal matched with the feedback intensity corresponding to the first sub-region where the touch position is located can be updated and output, so that the haptic feedback effect can change along with the change of the touch position of the sliding operation, thereby enabling the haptic feedback effect to be richer and being beneficial to enhancing the user experience.
In other examples, the target object is a control bar control, and the haptic signal may be determined according to a touch position and a touch sequence of the sliding operation. For example, the control bar controls can correspond to a first order (e.g., an order of adjusting the values from large to small) and a second order (e.g., an order of adjusting the values from small to large), and the waveform amplitudes of the haptic signals corresponding to the first order and the second order can be different, e.g., the waveform amplitudes of the haptic signals corresponding to the first order can be less than the waveform amplitudes of the haptic signals corresponding to the second order. After the sliding operation for the control bar control is detected, the waveform frequency of the touch signal can be determined according to the touch position of the sliding operation, and the waveform amplitude of the touch signal is determined according to the touch sequence of the sliding operation so as to generate the corresponding touch signal. After detecting that at least one of the touch position and the touch sequence of the sliding operation controlled by the control bar is changed, the waveform frequency can be updated according to the updated touch position, or the waveform amplitude can be updated according to the updated touch sequence, or the waveform frequency can be updated according to the updated touch position, and the waveform amplitude can be updated according to the updated touch sequence. In this way, in the sliding operation process of the control bar control by the user, different haptic feedback effects can be felt along with the change of the sliding operation, so that the user experience can be enhanced, and the guiding of the operation of the user is facilitated.
FIG. 7 is a schematic diagram of a knob control in accordance with at least one embodiment of the present disclosure. In some examples, as shown in fig. 7, the knob control 41 may be circular in shape. The present embodiment is not limited thereto. For example, the knob control may be rounded rectangular or oval in shape, etc.
In some examples, as shown in fig. 7, the knob control 41 may be configured for adjusting functions, such as adjusting temperature, adjusting volume, and the like. The touch operation matched with the knob control 41 may be a slide operation. The knob control 41 may be divided in the circumferential direction into a plurality of consecutive second sub-areas 410. The user can realize function adjustment (for example, adjusting volume change or adjusting temperature change) through sliding operation on the plurality of second sub-areas 410 of the knob control 41, and generate corresponding tactile signals according to the second sub-areas 410 where the touch position of the sliding operation is located. The waveform frequencies of the haptic signals corresponding to the plurality of second sub-regions 410 may be different. For example, the waveform frequencies of the haptic signals corresponding to the plurality of second sub-regions 410 arranged in the clockwise direction may be sequentially increased or sequentially decreased. In this example, the user may feel haptic feedback effects of different feedback intensities in a sliding operation of the knob control. For example, sliding the knob control in the clockwise direction can increase the volume, sliding the knob control in the counterclockwise direction can decrease the volume, and by setting the waveform frequency corresponding to the plurality of second sub-areas connected in the clockwise direction to increase in sequence, the feedback intensity corresponding to the plurality of second sub-areas connected in the clockwise direction can be gradually increased or decreased, and in the sliding operation of the user, the feedback effect gradually increased in the clockwise direction and the feedback effect gradually decreased in the counterclockwise direction can be felt.
The method of interaction for the knob control may refer to the description of the foregoing embodiments, so that the description is omitted herein.
Fig. 8 is another example flow chart of an interaction method of at least one embodiment of the present disclosure. Fig. 9A and 9B are diagrams illustrating an operation of at least one embodiment of the present disclosure. In this example, a target object is taken as a button control, and a touch operation matched with the button control is taken as a click operation for example.
In some examples, as shown in fig. 8, the interaction method of the present example may include the following steps.
Step 201, detecting whether a graphical user interface has a touch operation. In some examples, the display touch panel may detect whether the graphical user interface has a touch operation in real time or periodically.
Step 202, obtaining touch parameter information of a touch operation. In some examples, the display touch panel may acquire touch parameter information of a touch operation after detecting the touch operation. In this example, the touch parameter information of the touch operation may include: touch position and touch pressure. For example, the display touch panel may acquire a touch position through a capacitive touch panel, and acquire a touch pressure through a piezoelectric ceramic sheet.
Step 203, determining whether the touch operation is a touch operation for the target object. In some examples, when it is determined that the touch operation is a touch operation for the target object, steps 204 and 205 may be performed; when it is determined that the touch operation is not a touch operation for the target object, feedback may not be performed on the touch operation, for example, the touch operation is considered to be a false operation, and step 201 is returned.
Step 204, generating a touch signal according to the touch parameter information of the touch operation. This example takes the change in touch pressure of a touch operation as an example to adjust the waveform amplitude of the haptic signal.
In some examples, as shown in fig. 9A and 9B, the button control 51 may be configured to implement a start, shut down, or select function. The shape of the button control 51 may be elliptical. However, the present embodiment is not limited thereto. For example, the shape of the button control 51 may be circular, rectangular, or rounded rectangular.
In some examples, the preset button control may correspond to a plurality of touch pressure ranges. For example, the plurality of touch pressure ranges may include a tap pressure range, and a heavy pressure range, the tap pressure range having a pressure value less than the tap pressure range, the tap pressure range having a pressure value less than the heavy pressure range. The waveform amplitude of the touch signal corresponding to the touch pressure ranges changes along with the numerical values of the touch pressure ranges. For example, the waveform amplitudes corresponding to the tap pressure range, and the heavy pressure range may be sequentially increased. The division of the touch pressure range corresponding to the button control in this embodiment is not limited. In other examples, different touch pressure ranges may be set for different button controls, e.g., one button control may correspond to three touch pressure ranges and another button control may correspond to four or two touch pressure ranges.
In some examples, the processor may generate the haptic signal according to a touch pressure of a click operation for the button control. As shown in fig. 9A, the touch pressure for the click operation of the button control belongs to the tap pressure range, and the haptic signal may be generated according to the waveform amplitude corresponding to the tap pressure range. Wherein, the waveform type and waveform frequency of the haptic signal can be preset values. For example, the haptic feedback device may generate a waveform signal with a weaker amplitude to achieve a weak haptic feedback effect. In some examples, the user may experience weaker vibrations when the user lightly presses a button control in the graphical user interface.
Step 205, determine whether the touch pressure of the touch operation changes. In some examples, step 206 may be performed when the processor detects a change in touch pressure for a click operation of the button control; when it is detected that the touch pressure of the clicking operation for the button control is not changed, the tactile signal generated in the step 204 is output, the clicking operation is continuously detected, and whether the clicking operation for the button control is finished is detected.
In some examples, the processor may update the haptic signal based on a change in touch pressure for a click operation of the button control. As shown in fig. 9B, when the touch pressure for the click operation of the button control is updated to the re-pressing force range, the haptic signal may be updated according to the waveform amplitude corresponding to the re-pressing force range. For example, the haptic feedback device may generate a waveform signal with a stronger amplitude to achieve a stronger haptic feedback effect. In some examples, when the user presses the button control again, the user may experience a stronger vibration.
The detailed description of the remaining steps of the interaction method of this example may refer to the description of the foregoing embodiments, so that the description thereof is omitted here.
In the example, the piezoelectric ceramic plates can be arranged in an array manner on a display touch panel, can be used as a pressure sensor in the acquisition process, and can convert touch pressure signals into voltage signals so as to acquire touch pressure; in the haptic feedback process, vibration corresponding to the haptic signal can be generated under the driving of the driving circuit to realize haptic feedback.
In some examples, as shown in fig. 9A and 9B, in the process that the touch pressure is changed from small to large in the clicking operation of the button control by the user, the haptic feedback device can give out vibration from small to large, so that the user can feel the change of the haptic feedback effect due to different touch pressures when pressing the same position, and the user experience in the human-computer interaction process is more satisfied. Moreover, the feedback intensity of the vibration feedback given by the tactile feedback device is related to the touch pressure of the clicking operation, and an operation prompt, such as excessive force or insufficient force, can be given to the user.
In some examples, the button control may be a control button of a video playback class application. The light-point button control can start video playing or pause video playing; the video fast forward operation can be executed by pressing the button control lightly; and the video fast-rewinding operation can be executed by pressing the button control again. In the clicking operation process of the button control, a user can control and realize different functions by controlling the applied touch pressure, different haptic feedback effects can be driven according to different touch pressures, the user can feel rich haptic feedback effects in the clicking operation process, and the touch pressure can be adjusted according to the haptic feedback effects so as to realize the required functions.
In other examples, the target object is a button control, and the haptic signal may be determined according to a touch pressure and a touch duration of the click operation. For example, a click operation of a button control may correspond to multiple touch duration ranges, where the multiple touch duration ranges may be different. For example, the plurality of touch duration ranges may include a first duration range, a second duration range, and a third duration range, where the first duration range is less than the first duration, the second duration range is greater than or equal to the first duration and less than the second duration, and the third duration range is greater than or equal to the second duration. The first duration may be less than the second duration, and both are greater than zero. The waveform frequencies of the haptic signals corresponding to the first, second, and third time ranges may be different. For example, the waveform frequency corresponding to the first time period range may be smaller than the waveform frequency corresponding to the second time period range, and the waveform frequency corresponding to the second time period range may be smaller than the waveform frequency corresponding to the third time period range. After the click operation for the button control is detected, the waveform amplitude of the haptic signal can be determined according to the touch pressure of the click operation, and the waveform frequency of the haptic signal can be determined according to the touch duration of the click operation to generate a corresponding haptic signal. After detecting that at least one of the touch pressure and the touch duration of the click operation for the button control is changed, the waveform amplitude can be updated according to the updated touch pressure, or the waveform frequency can be updated according to the updated touch duration, or the waveform amplitude can be updated according to the updated touch pressure, and the waveform frequency can be updated according to the updated touch duration. In this way, in the click operation process of the user on the button control, different haptic feedback effects can be felt along with the change of the click operation, so that the user experience can be enhanced, and the user operation can be guided to realize the function intended by the user.
In other examples, the target object is a button control, and the haptic signal may be determined based on a touch duration of the click operation. For example, a click operation of a button control may correspond to multiple touch duration ranges, where the multiple touch duration ranges may be different. Waveform frequencies corresponding to the plurality of touch duration ranges may be different. After detecting a click operation for the button control, a waveform frequency of the haptic signal may be determined according to a touch duration of the click operation to generate a corresponding haptic signal. After detecting that the touch duration of the clicking operation for the button control changes, the waveform frequency can be updated according to the updated touch duration.
In other examples, the target object is a button control, and the touch signal may be determined according to a touch area of the click operation. For example, a clicking operation of a button control may correspond to multiple touch area ranges, where the multiple touch area ranges may be different, and a waveform frequency or waveform amplitude corresponding to the multiple touch area ranges may be different. After detecting a click operation for the button control, a waveform frequency or waveform amplitude of the haptic signal may be determined according to a touch area of the click operation to generate a corresponding haptic signal. After detecting that the touch area of the clicking operation for the button control changes, the waveform frequency or waveform amplitude can be updated according to the updated touch area.
FIG. 10 is another flow chart of an interaction method of at least one embodiment of the present disclosure. Fig. 11A and 11B are diagrams illustrating an operation of at least one embodiment of the present disclosure. In this example, a target object is taken as a multi-touch area, and a touch operation matched with the multi-touch area is taken as a click operation for illustration.
In some examples, as shown in fig. 10, the interaction method of the present example may include the steps of:
Step 301, detecting whether a graphical user interface has a touch operation. In some examples, the display touch panel may detect whether the graphical interactive interface has a touch operation in real time or periodically.
Step 302, obtaining touch parameter information of a touch operation. In some examples, the display touch panel may acquire touch parameter information of a touch operation after detecting the touch operation. In this example, the touch parameter information of the touch operation may include: touch position and number of touches. For example, the display touch panel may acquire a touch position and a touch point number through the capacitive touch panel.
Step 303, determining whether the touch operation is a touch operation for the target object. In some examples, when it is determined that the touch operation is a touch operation for the target object, step 304 and step 305 may be performed; when it is determined that the touch operation is not a touch operation for the target object, feedback may not be performed on the touch operation, for example, the touch operation is considered to be an erroneous operation, and step 301 is returned.
Step 304, generating a touch signal according to the touch parameter information of the touch operation. This example takes as an example a change in the number of points of touch of a click operation to adjust the waveform type of the haptic signal.
In some examples, as shown in fig. 11A and 11B, the set multi-touch area of the graphical user interface may be a target object, e.g., the target object may be a blank area displayed in the graphical user interface.
In some examples, the multi-touch area may be preset to correspond to a plurality of contact ranges. For example, the plurality of contact ranges may include: a first contact range, a second contact range, and a third contact range. The first contact range may be less than or equal to the first number, the second contact range may be greater than the first number and less than or equal to the second number, and the third contact range may be greater than the second number, wherein the second number may be greater than the first number. The division of the contact range corresponding to the multi-touch area in this embodiment is not limited. In other examples, different multi-touch areas may be provided with corresponding different contact ranges, e.g., one multi-touch area may correspond to three contact ranges and another multi-touch area may correspond to two or four contact ranges.
In some examples, the processor may generate the haptic signal based on a number of points of the click operation for the multi-touch region. As shown in fig. 11A, the number of touch points for the click operation of the multi-touch area is one, for example, belongs to the first contact range, and the haptic signal may be generated according to the waveform type corresponding to the first contact range. For example, the first contact range corresponds to a sine function wave, and the waveform frequency and waveform amplitude of the haptic signal may take on preset values.
In some examples, as shown in fig. 11A, the click operation for the multi-touch area is a single-touch operation, having one contact point whose coordinate position is Q1 (x 3, y 3). The processor may generate haptic signals g1 (x 3, y 3), where x3 is the abscissa of the contact point, y3 is the ordinate of the contact point, and g1 is a waveform function. The waveform type corresponding to the first contact range in this example is a sine function wave, and the waveform function g1 is a sine function. For example, the driving circuit of the haptic feedback device may drive the piezoelectric ceramic plate corresponding to the position of the contact point to generate vibration feedback corresponding to the feedback intensity of the haptic signal. In some examples, when the user single-touches the target object, entry into the next level page may be achieved.
Step 305, determine whether the number of touch points of the touch operation changes. In some examples, step 306 may be performed when the processor detects a change in the number of touch points for a click operation of the multi-touch area; when it is detected that the number of touch points of the clicking operation for the multi-touch area does not change, the haptic signal generated in step 304 is output, and the clicking operation is continuously detected, and whether the clicking operation for the multi-touch area is finished is detected.
In some examples, the processor may update the haptic signal based on a change in the number of points of the click operation for the multi-touch region. As shown in fig. 11B, when the number of touch points for the click operation of the multi-touch area is two, for example, belongs to the second contact range, the haptic signal may be generated according to the waveform type corresponding to the second contact range. For example, the second contact range corresponds to a rectangular wave, and the waveform frequency and waveform amplitude of the haptic signal may take on preset values.
In some examples, as shown in fig. 11B, the click operation for the multi-touch area is a multi-touch operation having two contacts with coordinate positions Q1 (x 3, y 3) and Q2 (x 4, y 4). The processor may generate haptic signals g2 (x 3, y 3) and g2 (x 4, y 4), g2 being a rectangular wave function. For example, the driving circuit of the haptic feedback device may drive the piezoelectric ceramic sheet corresponding to the positions of the two contacts to generate vibration feedback corresponding to the feedback intensity of the haptic signal. In some examples, returning to the previous level page may be accomplished when the user multi-touches the target object.
The detailed description of the remaining steps of the interaction method of this example may refer to the description of the foregoing embodiments, so they are not repeated here.
In this example, as shown in fig. 11A and 11B, in the process that the number of touch points of the clicking operation of the user on the multi-touch area is switched from one point to two points, the processor may generate haptic signals with different waveform types, so that the haptic feedback device may give haptic feedback effects with different intensities, and the user may feel the change of the haptic feedback effects by changing the number of touch points when clicking operation is performed on the same area, so as to better conform to the user experience in the human-computer interaction process. Moreover, the feedback intensity of the vibration feedback given by the tactile feedback device is related to the number of touch points of the clicking operation, and an operation prompt can be given to a user.
In other examples, the target object may be a multi-touch area, and the touch signal is determined according to the number of touches and the touch area of the click operation. The touch area collected at a certain moment in the present example may refer to the sum of the touch areas of all the contacts of the click operation at that moment. For example, the clicking operation of the multi-touch area may correspond to a plurality of touch area ranges, wherein the plurality of touch area ranges may be different, and the waveform frequency or waveform amplitude corresponding to the plurality of touch area ranges may be different. After the click operation for the multi-touch area is detected, the waveform type of the haptic signal may be determined according to the number of the touch points of the click operation, and the waveform frequency may be determined according to the touch area to generate the corresponding haptic signal. After detecting that at least one of the touch point number and the touch area of the clicking operation changes, the waveform type can be updated according to the updated touch point number, or the waveform frequency can be updated according to the updated touch area, or the waveform type can be updated according to the updated touch point number, and the waveform frequency can be updated according to the updated touch area. In this way, in the process that the user performs the clicking operation on the multi-touch area, different haptic feedback effects can be felt along with the change of the clicking operation, so that the user experience can be enhanced, and the user operation can be guided to achieve the function desired to be achieved.
In other examples, the target object may include: application icons, display images, file icons, etc. For example, a click operation for a display image may implement an image zoom-in or zoom-out function, and generate a corresponding haptic signal according to touch parameter information of the click operation to implement a rich haptic feedback effect. For another example, the dragging operation for the file icon can realize functions of file opening, file deleting or file sending, and the corresponding touch signal is generated according to the touch parameter information of the dragging operation, so that touch feedback is realized. The present embodiment is not limited thereto.
In other examples, the correspondence between the touch parameter information of the touch operation for the target object and the parameter of the haptic signal may be adjusted or matched according to the actual application scenario, so as to meet the actual use requirement. The present embodiment is not limited thereto.
According to the interaction method provided by the embodiment, the touch parameter information of the touch operation can be detected on the graphical user interface, and different haptic feedback effects are driven to be fed back based on the change of the touch parameter information, so that rich haptic feedback effects are generated. The method and the device not only can increase diversified experiences of interaction, but also can effectively guide touch operation of a user.
The embodiment also provides a display touch device, including: the touch control device comprises a display touch control panel, a processor and a touch feedback device, wherein the processor is connected with the display touch control panel and the touch feedback device. The display touch panel is configured to acquire touch parameter information of a touch operation at a graphical user interface. The processor is configured to determine a touch operation at the graphical user interface for the target object; generating a touch signal according to the touch parameter information of the touch operation, and updating the touch signal according to the updated touch parameter information when the touch parameter information of the touch operation is detected to change. The touch parameter information comprises at least one of the following: touch position, touch pressure, touch number, touch area, touch duration and touch sequence. The haptic feedback device is configured to generate a corresponding haptic feedback effect from the haptic signal.
In some exemplary embodiments, the haptic signal is characterized by at least one of the following parameters: waveform type, waveform amplitude, waveform frequency.
In some example embodiments, the processor is configured to generate the haptic signal according to touch parameter information of the touch operation by: determining a corresponding relation between touch parameter information and parameters of a touch signal according to the type of the target object and the type of touch operation aiming at the target object; and generating the touch signal according to the touch parameter information and the corresponding relation between the touch parameter information and the parameters of the touch signal.
In some example embodiments, the processor is configured to determine the correspondence between the touch parameter information and the parameter of the haptic signal according to the type of the target object and the type of the touch operation for the target object by at least one of: when the target object comprises a control bar control and the touch operation of the target object is a sliding operation, determining that the waveform frequency of the touch signal depends on the touch position of the touch operation; when the target object comprises a button control and the touch operation of the target object is a click operation, determining that the waveform amplitude of the haptic signal depends on the touch pressure of the touch operation; when the target object comprises a multi-touch area and the touch operation of the target object is a click operation, determining the waveform type of the haptic signal depends on the touch point number of the touch operation.
In some exemplary embodiments, the control bar control is divided into a plurality of first sub-regions along the length direction of the control bar control, and the waveform frequency of the tactile signals corresponding to the plurality of first sub-regions varies along the length direction of the control bar control; when the target object includes a control bar control and the touch operation for the target object is a sliding operation, the processor is configured to generate the haptic signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal by: determining a first sub-area where the contact is located in the control bar control according to the touch position of the contact in the sliding operation; and generating the touch signal according to the waveform frequency corresponding to the first subarea.
In some exemplary embodiments, the button control corresponds to a plurality of touch pressure ranges, and the waveform amplitude of the haptic signal corresponding to the plurality of touch pressure ranges varies with the magnitude of the value of the plurality of touch pressure ranges. When the target object includes a button control and the touch operation for the target object is a click operation, the processor is configured to generate the haptic signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal by: determining a touch pressure range to which the touch pressure of the clicking operation belongs according to the touch pressure of the clicking operation; and generating the touch signal according to the waveform amplitude corresponding to the determined touch pressure range.
In some exemplary embodiments, the multi-touch area corresponds to a plurality of contact ranges, and the waveforms corresponding to the plurality of contact ranges are different in type. When the target object includes a multi-touch area and the touch operation for the target object is a click operation, the processor is configured to generate the haptic signal according to the touch parameter information and the correspondence between the touch parameter information and the parameters of the touch signal by: determining a contact range to which the touch point belongs according to the touch point number of the clicking operation; and generating the touch signal according to the waveform type corresponding to the determined contact range.
In some exemplary embodiments, the haptic feedback device includes at least: piezoelectric ceramic plates.
The description of the display touch device in this embodiment may refer to the description of the foregoing embodiments, so that the description is omitted here.
In addition, at least one embodiment of the present disclosure further provides a non-transitory computer readable storage medium storing a computer program that when executed implements the steps of the interaction method described above.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, functional modules/units in the apparatus, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between the functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed cooperatively by several physical components. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
The foregoing has shown and described the basic principles, principal features, and advantages of the present disclosure. The present disclosure is not limited to the above-described embodiments, and the above-described embodiments and descriptions merely illustrate the principles of the disclosure, which may be subject to various changes and modifications without departing from the spirit and scope of the disclosure, which are all within the scope of the disclosure as claimed.