CN113010253A

Movatterモバイル変換

Info

Publication number: CN113010253A
Application number: CN202110297315.7A
Authority: CN
Inventors: 阿迪思; 张小青
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2021-03-19
Filing date: 2021-03-19
Publication date: 2021-06-22

Abstract

The application discloses a display interface adjusting method, electronic equipment, a touch pen and a readable storage medium, and belongs to the technical field of communication. The ultrasonic transmitters are arranged on the electronic equipment in a nonlinear arrangement mode, ultrasonic signals are sent to the touch pen provided with at least two microphones according to the transmitting parameters corresponding to the ultrasonic transmitters, so that the touch pen determines distance information between the microphones and the ultrasonic transmitters corresponding to the transmitting parameters according to the ultrasonic signals received by the microphones, and the touch pen can be accurately positioned in a scene that the touch pen is not in contact with a screen according to the distances between different positions of the at least two microphones of the touch pen and different positions of the at least three ultrasonic transmitters on the electronic equipment, so that the detection distance is enlarged, the response speed of positioning through ultrasonic ranging is high, the accuracy is high, the efficiency of adjusting UI display of the electronic equipment can be effectively improved, and the efficiency of operating the electronic equipment by a user is improved.

Description

Display interface adjusting method, electronic equipment and touch pen

Technical Field

The application belongs to the technical field of communication, and particularly relates to a display interface adjusting method, electronic equipment and a touch pen.

Background

In the process of gradually popularizing electronic devices such as mobile phones and tablet computers, users can operate the electronic devices by means of a touch pen.

Based on different operating habits that different users may have different left-handed or right-handed users, different handheld modes may occur when the User operates the electronic device by holding the stylus pen, and at this time, a UI (User Interface) display scheme of the electronic device needs to be adjusted to adapt to the User operations in different handheld modes.

Disclosure of Invention

An object of the embodiments of the present application is to provide a display interface adjustment method, an electronic device, a stylus, and a readable storage medium, which can solve the problem that the adjustment efficiency of a display interface of a user of a corresponding electronic device is low due to low distance detection accuracy and efficiency of the stylus with respect to the electronic device.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a display interface adjustment method, which is applied to an electronic device, where the electronic device includes at least three ultrasonic transmitters arranged non-linearly, and the method includes:

sending an ultrasonic signal to a touch pen according to the transmission parameters corresponding to the ultrasonic transmitter, wherein the touch pen comprises at least two microphones with different positions;

receiving distance information between each ultrasonic transmitter and each microphone sent by the stylus pen, and determining a handheld mode of the stylus pen according to the distance information, or receiving the handheld mode of the stylus pen sent by the stylus pen according to the distance information, wherein the distance information is determined by the stylus pen according to ultrasonic signals corresponding to the transmitting parameters;

and adjusting the user display interface of the electronic equipment according to the handheld mode.

In a second aspect, an embodiment of the present application provides another display interface adjustment method, which is applied to a stylus including at least two microphones with different positions, and the method includes:

receiving an ultrasonic signal of electronic equipment through the microphone, and determining the transmitting frequency, the receiving frequency and the transmitting parameter for receiving the ultrasonic signal, wherein the ultrasonic signal is sent by at least three ultrasonic transmitters which are arranged in a nonlinear way on the electronic equipment;

determining distance information between each ultrasonic transmitter and each microphone according to the transmitting parameters, the transmitting frequency and the receiving frequency;

sending the distance information to the electronic equipment, so that the electronic equipment determines the handheld mode of the stylus according to the distance information and adjusts a user display interface according to the handheld mode; or determining the handheld mode of the stylus according to the distance information, and sending the handheld mode to the electronic device, so that the electronic device adjusts a user display interface according to the handheld mode.

In a third aspect, an embodiment of the present application provides an electronic device, which includes at least three ultrasonic transmitters arranged non-linearly, and includes:

the ultrasonic wave sending module is used for sending an ultrasonic wave signal to a touch pen according to the sending parameters corresponding to the ultrasonic wave sender, and the touch pen comprises at least two microphones with different positions;

the handheld mode determining module is used for receiving distance information between each ultrasonic transmitter and each microphone sent by the stylus and determining the handheld mode of the stylus according to the distance information, or receiving the handheld mode, determined by the stylus according to the distance information, sent by the stylus, and the distance information is determined by the stylus according to the ultrasonic signals corresponding to the transmitting parameters;

and the display interface adjusting module is used for adjusting the user display interface of the electronic equipment according to the handheld mode.

In a fourth aspect, an embodiment of the present application provides a stylus pen, where the stylus pen includes at least two microphones with different positions, and the stylus pen includes:

the signal receiving module is used for receiving ultrasonic signals of electronic equipment through the microphone and determining the transmitting frequency, the receiving frequency and the transmitting parameters for receiving the ultrasonic signals, and the ultrasonic signals are sent through at least three ultrasonic transmitters which are arranged in a nonlinear way on the electronic equipment;

the distance determining module is used for determining distance information between each ultrasonic transmitter and each microphone according to the transmitting parameters, the transmitting frequency and the receiving frequency;

the information sending module is used for sending the distance information to the electronic equipment so that the electronic equipment determines the handheld mode of the stylus according to the distance information and adjusts a user display interface according to the handheld mode; or, the method and the device are used for determining the handheld mode of the stylus according to the distance information and sending the handheld mode to the electronic device, so that the electronic device adjusts a user display interface according to the handheld mode.

In a fifth aspect, the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect or the second aspect.

In a sixth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first or second aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect or the second aspect.

In the embodiment of the application, by arranging at least three ultrasonic transmitters which are arranged in a non-linear way on the electronic equipment, and sends ultrasonic signals to a touch control pen provided with at least two microphones according to the corresponding transmitting parameters of the ultrasonic transmitter, so that the touch control pen can determine the distance information between the microphone and the ultrasonic transmitter corresponding to the transmission parameter according to the ultrasonic signal received by the acoustic transmitter, according to the distances between different positions of at least two microphones of the touch control pen and different positions of at least three ultrasonic transmitters on the electronic equipment, under the scene that the touch control pen is not in contact with the screen, the touch control pen is accurately positioned, so that the detection distance is enlarged, the response speed of ultrasonic distance measurement positioning is high, the precision is high, the efficiency of adjusting UI display of the electronic equipment can be effectively improved, and the efficiency of operating the electronic equipment by a user is improved.

Drawings

FIG. 1 is a flowchart illustrating steps of a first method for adjusting a display interface according to an embodiment of the present disclosure;

fig. 2 is a flowchart illustrating steps of a second method for adjusting a display interface according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a first electronic device provided in an embodiment of the present application;

FIG. 4 is a schematic diagram of an ultrasonic ranging process provided in an embodiment of the present application;

FIG. 5 is a schematic diagram illustrating a vertical distance of a microphone relative to an electronic device according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a coordinate system of an electronic device according to an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of another coordinate system of an electronic device according to an embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a user display interface provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of another user display interface provided by embodiments of the present application;

FIG. 10 is a flowchart illustrating a third method for adjusting a display interface according to an embodiment of the present disclosure;

FIG. 11 is a flowchart illustrating a fourth method for adjusting a display interface according to an embodiment of the present disclosure;

FIG. 12 is a schematic diagram of yet another user display interface provided by an embodiment of the present application;

fig. 13 is a flowchart illustrating a fifth method for adjusting a display interface according to an embodiment of the present disclosure;

FIG. 14 is a schematic diagram of the transmitting frequency and the receiving frequency of an ultrasonic signal according to an embodiment of the present application;

fig. 15 is a schematic structural diagram of a second electronic device provided in an embodiment of the present application;

fig. 16 is a schematic structural diagram of a third electronic device provided in an embodiment of the present application;

fig. 17 is a schematic structural diagram of a fourth electronic device provided in the embodiment of the present application;

fig. 18 is a schematic structural diagram of a fifth electronic device provided in an embodiment of the present application;

fig. 19 is a schematic structural diagram of a stylus provided in an embodiment of the present application;

FIG. 20 is an interaction diagram of a display interface adjustment method according to an embodiment of the present disclosure;

FIG. 21 is an interaction diagram of another display interface adjustment method provided in the embodiments of the present application;

fig. 22 is a block diagram of an electronic device according to an embodiment of the present application;

fig. 23 is a block diagram illustrating a structure of a stylus pen according to an embodiment of the present disclosure;

fig. 24 is a schematic hardware structure diagram of an electronic device implementing an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The display interface adjustment method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

Fig. 1 is a flowchart of steps of a first display interface adjustment method provided in an example of the present application, and as shown in fig. 1, the method may be applied to an electronic device including at least three non-linearly arranged ultrasonic transmitters, and the method may include:

step 101, sending an ultrasonic signal to a touch pen according to a sending parameter corresponding to the ultrasonic sender, wherein the touch pen comprises at least two microphones with different positions.

The embodiment of the application is applied to the scene of operating the electronic equipment through the touch control pen, wherein, the electronic equipment indicates to provide services such as audio-visual, communication to the user, and the equipment of accessible touch control pen operation, can include the ultrasonic transmitter of at least three nonlinear arrangement on the electronic equipment, ultrasonic transmitter indicates the device that can launch ultrasonic signal in to the environment according to certain frequency, optionally, ultrasonic transmitter can be the speaker that sets up on the electronic equipment, also can be other modules that can launch ultrasonic signal, if can be under the screen ultrasonic module, screen vibration sound production module etc., this application embodiment does not do not specifically limit to ultrasonic transmitter's type.

In the embodiment of the application, the nonlinear arrangement means that after positions of the ultrasonic transmitters in the electronic device are connected in pairs, lines of an obtained two-dimensional graph are not on a straight line, specifically, a geometric center of the electronic device is used as an origin to serve as a two-dimensional coordinate, an X coordinate of at least one position in the positions of the ultrasonic transmitters is different from X coordinates of other positions, and a Y coordinate of at least one position is different from Y coordinates of other positions.

In the embodiment of the present application, since the ultrasonic signal itself does not have a distinguishable feature, different transmission parameters may be preset for different ultrasonic transmitters, so as to distinguish the ultrasonic signals sent by the different ultrasonic transmitters, optionally, the transmission parameters may be transmission frequency, transmission time, transmission cycle number, and the like of the ultrasonic signal sent by the ultrasonic transmitter, and the embodiment of the present application does not specifically limit the type of the transmission parameters.

In this application embodiment, the stylus is a pen-shaped tool equipment, can realize the operation of clicking, writing, drawing etc. to electronic equipment, can include two at least microphones of different positions on the stylus, wherein, the different cross sections in different microphone corresponds to the stylus in the position difference. A Microphone, which may also be called a Mic (Microphone), is an energy conversion device that can convert a sound signal into an electrical signal, and at least two microphones are disposed at different positions on a stylus pen, so that ultrasonic signals can be received at least two different positions on the stylus pen, and a distance, an inclination, and the like of the stylus pen can be determined according to the at least two point positions.

And 102, receiving distance information between each ultrasonic transmitter and each microphone sent by the stylus, and determining the handheld mode of the stylus according to the distance information, wherein the distance information is determined by the stylus according to ultrasonic signals corresponding to the transmitting parameters.

In this embodiment of the application, after sending an ultrasonic signal to the stylus, the stylus may determine, based on an ultrasonic ranging principle, a Time of flight (TOF) of the ultrasonic signal and an ultrasonic transmitter that sends the ultrasonic signal according to the ultrasonic signal corresponding to the transmission parameter, and then determine, according to the Time of flight and a propagation speed of the ultrasonic signal, a distance between each microphone and each ultrasonic transmitter, so as to obtain distance information between each microphone and each ultrasonic transmitter, at this Time, the electronic device may determine, according to the distance information between different microphones and each ultrasonic transmitter, a distance, an inclination direction, and the like of the stylus relative to the electronic device, so as to determine a handheld manner of the stylus.

For example, when the stylus pen includes two microphones, namelymicrophone 1 and microphone 2, the distances of themicrophones 1 and 2 relative to the electronic device can be determined according to the distance of themicrophone 1 and 2 to each ultrasonic transmitter; and the inclination direction of the touch pen can be determined by comparing the distances of themicrophones 1 and 2 at different positions relative to the same ultrasonic transmitter, so that the hand-held mode of the touch pen can be determined.

Or, after thestep 101, the method comprises:

and 103, receiving a handheld mode which is sent by the touch pen and determined by the touch pen according to the distance information.

In this embodiment of the application, the electronic device may receive distance information sent by the stylus and determine a handheld manner of the stylus according to the distance information, or may also receive a handheld manner sent by the stylus and determined by the stylus according to the distance information, and the description of determining the handheld manner by the stylus according to the distance information may refer to the description of determining the handheld manner by the electronic device according to the distance information instep 102, that is, a person skilled in the art may select a main body of completing the processing procedure of determining the handheld manner of the stylus according to the distance information according to the requirement, which is not limited in this embodiment of the application.

And 104, adjusting a user display interface of the electronic equipment according to the handheld mode.

In this embodiment of the application, the handheld manner may be left-handed or right-handed, and the user display interface of the electronic device may be correspondingly adjusted according to different handheld manners, for example, the toolbar layout of the editing interface may be adjusted according to the handheld manner, the display position of the icon with a higher use frequency may be adjusted, the direction of the shortcut gesture may be adjusted, the direction of the stylus interaction may be adjusted, and the like.

Fig. 2 is a flowchart illustrating steps of a second method for adjusting a display interface according to an embodiment of the present application, where as shown in fig. 2, the method is applied to an electronic device, the electronic device includes at least three ultrasonic transmitters arranged in a non-linear manner, and the method may include:

step 201, sending an ultrasonic signal to a touch pen according to a transmission parameter corresponding to the ultrasonic transmitter, where the touch pen includes at least two microphones with different positions.

In the embodiment of the present application,step 201 may refer to the related description ofstep 101, and is not described herein again to avoid repetition.

Fig. 3 is a schematic structural diagram of a first electronic device provided in an embodiment of the present application, and as shown in fig. 3, anelectronic device 301 includes afirst speaker 302, asecond speaker 303, and athird speaker 304, which are arranged in a triangular non-linear manner on a frame, and according to emission parameters respectively corresponding to different speakers, thefirst speaker 302 emits a firstultrasonic wave 3021, thesecond speaker 303 emits a secondultrasonic wave 3031, and thethird speaker 304 emits a thirdultrasonic wave 3041.

Step 202, receiving distance information between each ultrasonic transmitter and each microphone respectively sent by the stylus, and determining a vertical distance between each microphone and the electronic device screen according to the distance information and the position information of each ultrasonic transmitter, wherein the distance information is determined by the stylus according to the ultrasonic signal corresponding to the transmission parameter.

In the embodiment of the present application, the stylus pen determines the distance information between each ultrasonic transmitter and each microphone according to the ultrasonic signal, which may refer to the related description ofstep 102, and the description is not repeated here.

Fig. 4 is a schematic diagram of an ultrasonic ranging process provided in an embodiment of the present application, and as shown in fig. 4, based on fig. 3, astylus 305 is further included, where thestylus 305 includes afirst microphone 306 and asecond microphone 307, and thefirst microphone 306 may receive a firstultrasonic wave 3021, a second ultrasonic wave 3032, and a thirdultrasonic wave 3041, so as to determine distance information d1, d2, and d3 of thefirst microphone 306 with respect to the firstultrasonic transmitter 302, the secondultrasonic transmitter 303, and the thirdultrasonic transmitter 304, respectively; thesecond microphone 307 may receive the first, second, and third

ultrasonic waves

3021, 3032, and 3041 to determine distance information d4, d5, and d6 of thesecond microphone 307 with respect to the first, second, and third

ultrasonic transmitters

302, 303, and 304, respectively.

In the embodiment of the application, the ultrasonic transmitters are preset on the electronic device, so that the positions of the ultrasonic transmitters can be confirmed to be known, at this time, the distances between at least three ultrasonic transmitters which are arranged in a nonlinear manner are also known, the plane where the screen of the electronic device is located is determined by the at least three ultrasonic transmitters which are arranged in the nonlinear manner, and the vertical distance of the microphone relative to the screen can be calculated according to the distance between the sounder and each ultrasonic transmitter, so that the distance of the touch pen relative to the electronic device is determined.

Fig. 5 is a schematic diagram of a vertical distance between a microphone and an electronic device according to an embodiment of the present application, and as shown in fig. 5, on the basis of fig. 4, a triangular pyramid model (P-ABC) can be constructed by connecting a first microphone 306 (point P), a first ultrasonic transmitter 302 (point a), a second ultrasonic transmitter 303 (point B), and a third ultrasonic transmitter 304 (point C) two by two, and the side length of each side of the triangular pyramid model (P-ABC) is known, so that a vertical distance h from thefirst microphone 306 to a plane of the firstultrasonic transmitter 302, the secondultrasonic transmitter 303, and the thirdultrasonic transmitter 304 can be calculated₁. Vertical distance h of second microphone 307 (point O)₂And so on.

And step 203, determining three-dimensional coordinate information of each microphone relative to the screen of the electronic equipment according to the vertical distance and the position information of each ultrasonic transmitter.

In this embodiment, an X axis and a Y axis of a two-dimensional coordinate may be constructed on a screen of an electronic device, and a Z axis may be constructed in a direction perpendicular to the screen of the electronic device, so as to establish a three-dimensional coordinate system, at this time, a position of a microphone may be converted into three-dimensional coordinate information in the three-dimensional coordinate system, specifically, a Z axis coordinate of the three-dimensional coordinate information may be determined according to a vertical distance, an X axis coordinate and a Y axis coordinate in the three-dimensional coordinate information may be determined according to distance information between the microphone and an ultrasonic generator and position information of each ultrasonic emitter, for example, an XY coordinate information of each ultrasonic emitter may be determined according to the position information of each ultrasonic emitter, and an XY coordinate information of the microphone may be determined according to the distance information between the microphone and each ultrasonic emitter, which is not particularly limited in this embodiment.

Fig. 6 is a schematic diagram of a coordinate system of an electronic device according to an embodiment of the present disclosure, as shown in fig. 6, based on fig. 5, an X axis and a Y axis are constructed by taking a geometric center of a screen of the electronic device as a coordinate origin, as shown in the figure, a Z axis (not shown in the figure) is constructed perpendicular to the coordinate origin, at this time, an X-axis coordinate of afirst microphone 306 on a stylus is an X axis₁The Y-axis coordinate is Y₁A second microphone 307Has an X-axis coordinate of X₂The Y-axis coordinate is Y₂(ii) a According to the vertical distance h₁Determining the Z-axis coordinate of thefirst microphone 306 as Z₁According to the vertical distance h₂Determining the Z-axis coordinate of thesecond microphone 307 as Z₂I.e. three-dimensional coordinate information (point O) of the first microphone 306 (point P) and thesecond microphone 307 can be determined.

And step 204, determining the holding mode of the touch pen by comparing three-dimensional coordinate information between at least two microphones.

In the embodiment of the application, because the inclination directions of the left-handed and right-handed touch pens in the handheld mode are different, the inclination direction of the touch pen can be determined by comparing the three-dimensional coordinate information of at least two microphones with different positions on the touch pen, so that the height of any one position relative to any other position can be determined, and the handheld mode of the touch pen can be determined.

Optionally, the stylus pen includes a first microphone located in the operation area and a second microphone located in the non-operation area.

In the embodiment of the application, because the stylus is usually a partial region and can operate the electronic device, if the electronic device cannot be operated through the pen tail and the pen holder of the stylus, the electronic device can be operated through the pen point, and if the electronic device cannot be operated through the pen tail and the pen point, the stylus can be divided into an operation region and a non-operation region, wherein the operation region refers to a region on the stylus where the electronic device can be operated, and the non-operation region refers to a region on the stylus where the electronic device cannot be operated. At this time, the first microphone may be disposed in the operation area, and the second microphone may be disposed in the non-operation area, so that the position relationship between the operation area and the non-operation area may be determined, and the handheld manner of the stylus pen may be determined effectively and accurately.

Thestep 204 comprises:

and step S11, determining that the holding mode of the touch pen is right-handed when the X-axis coordinate of the first microphone is smaller than the X-axis coordinate of the second microphone.

In the embodiment of the present application, generally, when the stylus pen is held, the operation region is close to the fingertip direction, the non-operation region is pointed to the palm direction, and the three-dimensional coordinate information can be expressed as a magnitude relation between X-axis coordinates.

As shown in FIG. 6, X of thefirst microphone 306₁Smaller than X of thesecond microphone 307₂Then, the stylus is held by the right hand.

And step S12, determining that the holding mode of the touch pen is left-handed when the X-axis coordinate of the first microphone is larger than the X-axis coordinate of the second microphone.

In this embodiment, referring to step S11, when the X-axis coordinate of the first microphone is greater than the X-axis coordinate of the second microphone, it is described that the position of the operation region is on the right side of the position of the non-operation region, the position of the non-operation region is on the left side of the position of the operation region, the fingertip direction is on the right side of the palm direction, and the palm direction is on the left side of the fingertip direction, and the stylus pen is held by the left hand.

FIG. 7 is a schematic diagram of another coordinate system of an electronic device according to an embodiment of the present application, as shown in FIG. 7, the first microphone 306 (point P) is shown as X₁Greater than X of the second microphone 307 (point O)₂Then, the stylus is held by the right hand.

In the embodiment of the application, the X-axis coordinate of the first microphone and the X-axis coordinate of the second microphone may be equal, at this time, the stylus is parallel to the Y-axis of the XY plane coordinate system on the screen of the electronic device, and since the handheld mode of the stylus may be handheld by the left hand, handheld by the right hand, or idle, optionally, the handheld mode at this time may be determined by the historical X-axis coordinates of the first microphone and the second microphone within a preset time period, and if the X-axis coordinate of the first microphone is smaller than the X-axis coordinate of the second microphone within the previous 10s, the handheld mode of the stylus is determined to be handheld by the right hand; if the X-axis coordinate of the first microphone is larger than that of the second microphone, determining that the holding mode of the touch pen is left-handed; if the X-axis coordinate of the first microphone is equal to the X-axis coordinate of the second microphone, it is determined that the handheld mode of the stylus pen is idle, where the preset time period may also be 5 seconds, 15 seconds, 30 seconds, 60 seconds, and the like, which is not specifically limited in this embodiment of the application.

In the embodiment of the present application, further, generally, when the stylus is held, the operation area is closer to the electronic device screen than the non-operation area, and the three-dimensional coordinate information may be represented as a magnitude relationship between Z-axis coordinates, so that it may be determined whether the stylus is currently held by hand according to the magnitude relationship of the Z-axis coordinates, for example, when the Z-axis coordinate of the first microphone is smaller than the Z-axis coordinate of the second microphone, it is described that the position of the operation area is closer to the electronic device screen than the position of the non-operation area, and it is determined that the stylus is held by hand; otherwise, the stylus is determined to be in a state of not being held by the hand. However, when the Z-axis coordinate of the first microphone is greater than or equal to the Z-axis coordinate of the second microphone, the user may be in a state where the stylus pen is held flatly and held upside down during the operation interval, and at this time, in order to improve the efficiency of the user when continuing to operate, the user display interface may also be adjusted in a handheld manner, and a person skilled in the art may select the position according to actual needs, which is not specifically limited by the embodiment of the present application.

Alternatively, thestep 201 is followed by:

and step 205, receiving a handheld mode, which is sent by the stylus pen and determined by the stylus pen according to the distance information.

In the embodiment of the present application,step 205 may correspond to the related description referring to step 103, and is not described herein again to avoid repetition.

And step 206, adjusting a user display interface of the electronic equipment according to the handheld mode.

In the embodiment of the present application,step 206 may correspond to the related description referring to step 104, and is not described herein again to avoid repetition.

Fig. 8 is a schematic diagram of a user display interface according to an embodiment of the present application, as shown in fig. 8, theuser display interface 40 includes atoolbar 401 and asystem icon bar 402, where the system icon bar includes icons "open", "edit", "insert", "tool", and "+", and in a case where the stylus is held by a right hand, the user display interface may be adjusted such that thetoolbar 401 is displayed on the right side of the user display interface, and the icons "open", "edit", "insert", "tool", and "+" are displayed in thesystem icon bar 402 from left to right, and more system icons may be displayed by clicking "+".

As shown in fig. 8, in a case that the handheld manner of the stylus is right-handed, the interaction manner of the stylus and the electronic device may also be adjusted, for example, when the stylus slides on the electronic device from left to right along the arrow direction, the electronic device exits from the current user display interface.

Fig. 9 is a schematic diagram of another user display interface provided in the embodiment of the present application, as shown in fig. 9, theuser display interface 40 includes atoolbar 401 and asystem icon bar 402, where the system icon bar includes icons "open", "edit", "insert", "tool", and "+", and in a case where the stylus is held by the left hand, the user display interface may be adjusted such that thetoolbar 401 is displayed on the left side of the user display interface, and the icons "+", "tool", "insert", "edit", and "open" are displayed in thesystem icon bar 402 from left to right.

As shown in fig. 9, in a case that the holding manner of the stylus is left-handed, the interaction manner of the stylus and the electronic device may also be adjusted, for example, when the stylus slides on the electronic device from right to left along the arrow direction, the electronic device exits from the current user display interface.

Fig. 10 is a flowchart illustrating steps of a third method for adjusting a display interface according to an embodiment of the present application, where, as shown in fig. 10, the method is applied to an electronic device, the electronic device includes at least three ultrasonic transmitters arranged in a non-linear manner, and the method may include:

step 501, sending an ultrasonic signal to a touch pen according to a sending parameter corresponding to the ultrasonic sender, wherein the touch pen comprises at least two microphones with different positions.

In the embodiment of the present application,step 501 may refer to the related description ofstep 101, and is not described herein again to avoid repetition.

Step 502, receiving distance information between each ultrasonic transmitter and each microphone respectively sent by the stylus, and determining a vertical distance between each microphone and the electronic device screen according to the distance information and the position information of each ultrasonic transmitter, wherein the distance information is determined by the stylus according to the ultrasonic signal and the transmission parameter corresponding to the ultrasonic signal.

In the embodiment of the present application,step 502 may refer to the related description ofstep 202, and is not repeated herein to avoid repetition.

And 503, determining three-dimensional coordinate information of each microphone relative to the screen of the electronic equipment according to the vertical distance.

In the embodiment of the present application,step 503 may refer to the related description ofstep 203, and is not repeated herein to avoid repetition.

Step 504, determining the difference between the Z-axis coordinates of any two microphones.

In the embodiment of the application, the Z-axis coordinate of the microphone may represent the height of the position of the microphone in the Z-axis direction, so that the height difference of any two microphones can be obtained through the difference value between the Z-axis coordinates of any two microphones, when the stylus pen is held by hand, one end is usually lower to operate the electronic device, and the other end is higher to fix the stylus pen, at this time, whether the stylus pen is in a holding state or not can be determined through the height difference between any two microphones, and then the holding mode of the stylus pen is further determined.

And 505, comparing the three-dimensional coordinate information between at least two microphones under the condition that the difference value meets a preset difference value condition corresponding to any two microphones, and determining the handheld mode of the touch pen.

In the embodiment of the application, since the operating area is usually closer to the electronic device and the non-operating area is farther from the electronic device during the use of the stylus, therefore, determining that the operating area of the stylus is lower than the non-operating area according to the Z-axis coordinate, determining that the probability that the stylus is in a handheld state is higher when the height difference reaches a certain value, and calculating the difference value between the Z-axis coordinates of any two microphones, the difference obtained according to the difference between the subtraction number and the subtracted number in the Z-axis coordinate of any two microphones is different, the preset difference condition may thus include a preset difference magnitude between the Z-axis coordinates, and a subtraction number and a subtracted number in the difference calculation, alternatively, the magnitude of the preset difference may be a default value of the system, or may be determined according to the length of the stylus pen, the distance between any two microphones, the size of the palm of the user, the holding habit, and the like.

If the Z-axis coordinate closer to the operation area is a subtraction number, the Z-axis coordinate farther from the operation area is a subtraction number, and the difference value is greater than or equal to a preset difference value, determining that the difference value meets a preset difference value condition corresponding to any two microphones, wherein the preset difference value is greater than zero; and when the Z-axis coordinate close to the operation area is a reduced number, the Z-axis coordinate far away from the operation area is a reduced number, and the difference value is smaller than or equal to a preset difference value, determining that the difference value meets a preset difference value condition corresponding to any two microphones, wherein the preset difference value is smaller than zero.

For example, in the XY plane coordinate system shown in FIG. 6, when thefirst microphone 306 has a Z-axis coordinate Z₁Minus the Z-axis coordinate Z of thesecond microphone 307₂When the difference value is smaller than a preset difference value and the preset difference value is smaller than zero, determining that the touch pen is in a handheld state; when the Z-axis coordinate Z of thesecond microphone 307₂Minus the Z-axis coordinate Z of thefirst microphone 306₁If the difference is greater than the preset difference and the preset difference is greater than zero, the touch pen is determined to be in a handheld state.

In the embodiment of the present application, the three-dimensional coordinate information between the at least two microphones is compared to determine that the handheld manner of the stylus pen may refer to the related content ofstep 204, and for avoiding repetition, details are not repeated herein.

Optionally,step 501 is followed by:

and step 506, receiving a handheld mode which is sent by the touch pen and determined by the touch pen according to the distance information.

In the embodiment of the present application,step 506 may correspond to the related description referring to step 103, and is not described herein again to avoid repetition.

And step 507, adjusting a user display interface of the electronic equipment according to the handheld mode.

In the embodiment of the present application,step 507 may correspond to the related description referring to step 104, and is not described herein again to avoid repetition.

Fig. 11 is a flowchart illustrating steps of a fourth method for adjusting a display interface according to an embodiment of the present application, where as shown in fig. 11, the method is applied to an electronic device, the electronic device includes at least three ultrasonic transmitters arranged in a non-linear manner, and the method may include:

step 601, sending an ultrasonic signal to a touch pen according to the transmission parameters corresponding to the ultrasonic transmitter, wherein the touch pen comprises at least two microphones with different positions.

In the embodiment of the present application,step 601 may refer to the related description ofstep 101, and is not described herein again to avoid repetition.

Step 602, receiving distance information between each ultrasonic transmitter and each microphone respectively sent by the stylus, and determining a vertical distance between each microphone and the electronic device screen according to the distance information and the position information of each ultrasonic transmitter, where the distance information is determined by the stylus according to the ultrasonic signal and the transmission parameter corresponding to the ultrasonic signal.

In the embodiment of the present application,step 602 may refer to the related description ofstep 202, and is not repeated herein to avoid repetition.

Step 603, determining three-dimensional coordinate information of each microphone relative to the screen of the electronic equipment according to the vertical distance.

In the embodiment of the present application,step 603 may refer to the related description ofstep 203, and is not repeated herein to avoid repetition.

Optionally, the target microphone is included in the microphone, and the target microphone is located in the operation area on the stylus pen.

In the embodiment of the present application, the operation area may correspond to the related description in the foregoingstep 204, and is not described herein again to avoid repetition.

And step 604, comparing the three-dimensional coordinate information between at least two microphones under the condition that the three-dimensional coordinate information of the target microphone is located in the effective identification area of the electronic equipment, and determining the handheld mode of the stylus.

In this embodiment of the application, a microphone in the operation area may be determined as a target microphone, the position of the target microphone may correspond to the position of the operation area, the effective identification area is an area range that can receive an operation of the stylus pen and respond to the operation area on the electronic device, when the operation area of the stylus pen is located in the effective identification area, the probability that the stylus pen is in a state of being held by a hand is high, optionally, the effective identification area may be the entire display area of the user display interface or a partial area in the user display interface, and specifically, the effective identification area of the electronic device may be determined by determining an X-axis coordinate range, a Y-axis coordinate range, a Z-axis coordinate range, and the like in the three-dimensional coordinate system.

In the embodiment of the application, the three-dimensional coordinate information of the target microphone is located in the effective identification area, and may be that the X-axis coordinate of the target sensor is located in the X-axis coordinate range of the effective identification area, the Y-axis coordinate of the target sensor is located in the Y-axis coordinate range of the effective identification area, the Z-axis coordinate of the target sensor is located in the Z-axis coordinate range of the effective identification area, and the like, so that it is determined that the operation area of the stylus is located in the effective identification area, at this time, the probability that the stylus is in a handheld state is high, and the three-dimensional coordinate information between at least two microphones may be further compared to determine the handheld mode of the stylus.

As shown in FIG. 6, the effective identification area of the electronic device includes [ Y_{0_Max}，Y_{0_Min}]、[X_{0_Max}，X_{0_Min}]Wherein Y is_{0_Max}、Y_{0_Min}、X_{0_Max}、X_{0_Min}The specific numerical value of (a) may be a boundary value of the user display interface. At this time, the X-axis coordinate and the Y-axis coordinate of thefirst microphone 306 satisfy X_{0_Max}>X₁>X_{0_Min}And Y_{0_Max}>Y₁>Y_{0_Min}Then it is determined that thefirst microphone 306 is within the valid identification area of the electronic device.

Fig. 12 is a schematic view of another user display interface provided in the embodiment of the present application, and as shown in fig. 12, a partial area of theeffective identification area 701, which is customized, in the user display interface 70 specifically includes [ X_define-min，X_define-max]、[Y_define-min，Y_define-max]For example, the partial area is theother display area 702, and theother display area 702 cannot be operated by the operation area of the stylus. At this time, the X-axis coordinate and the Y-axis coordinate of thefirst microphone 306 when the stylus is located in the operation region satisfy X_define-min<X₁<X_define-max，Y_define-min<Y₁<Y_define-maxThen it is determined that thefirst microphone 306 is within the valid identification area of the electronic device.

Optionally, thestep 601 is followed by:

and 605, receiving a handheld mode which is sent by the touch pen and determined by the touch pen according to the distance information.

In the embodiment of the present application,step 606 may correspond to the related description referring to step 103, and is not described herein again to avoid repetition.

And 606, adjusting a user display interface of the electronic equipment according to the handheld mode.

In the embodiment of the present application, step 607 may correspond to the related description referring to step 104, and is not repeated herein to avoid repetition.

Fig. 13 is a flowchart illustrating a fifth method for adjusting a display interface according to an embodiment of the present disclosure, where as shown in fig. 13, the method is applied to a stylus pen, where the stylus pen includes at least two microphones with different positions, and the method may include:

step 801, receiving an ultrasonic signal of an electronic device through the microphone, and determining a transmitting frequency, a receiving frequency and a transmitting parameter for receiving the ultrasonic signal, wherein the ultrasonic signal is transmitted through at least three ultrasonic transmitters which are arranged in a nonlinear way on the electronic device.

In the embodiment of the present application, the stylus, the microphone, the electronic device, the transmission parameter, and the ultrasonic transmitter may refer to the related description ofstep 101, and are not described herein again to avoid repetition.

In the embodiment of the application, the transmitting frequency refers to a frequency adopted by an ultrasonic transmitter when transmitting an ultrasonic signal, the receiving frequency refers to a frequency when the ultrasonic signal is received, and in the process of transmitting the ultrasonic signal, a frequency difference exists between the receiving frequency and the transmitting frequency of the ultrasonic signal based on propagation delay, coding and decoding delay and other factors. Alternatively, the ultrasonic signal may be a frequency modulated continuous wave, such as a sawtooth wave, a triangular wave, or the like.

Step 802, determining distance information between each ultrasonic transmitter and each microphone according to the transmitting parameters, the transmitting frequency and the receiving frequency.

In this embodiment of the application, the stylus may determine the ultrasonic transmitter corresponding to the received ultrasonic signal according to the transmission parameter, and determine the frequency difference of the ultrasonic signal according to the receiving frequency and the transmitting frequency of the ultrasonic wave, so as to determine the distance information between each ultrasonic transmitter and each microphone, optionally, the stylus may determine the transmitting frequency of the ultrasonic signal sent by the ultrasonic transmitter through periodic communication with the electronic device, or may set the transmitting frequency of the ultrasonic signal of each ultrasonic transmitter to be the same default value, and the manner of determining the transmitting frequency is not particularly limited in this embodiment of the application.

Optionally, the transmission parameter comprises a transmission frequency.

In this embodiment, the transmission parameter may be a transmission frequency, and different ultrasonic transmitters correspond to different transmission frequencies, and at this time, the transmission frequency is used for calculating a frequency difference in the transmission process of the ultrasonic signal and distinguishing the ultrasonic transmitters corresponding to the ultrasonic signal.

Thestep 802 includes:

step S21, determining the ultrasonic transmitter sending the ultrasonic signal according to the transmitting frequency.

As shown in fig. 4, the firstultrasonic transmitter 302 corresponds to a transmission frequency of K1, the secondultrasonic transmitter 303 corresponds to a transmission frequency of K2, and the thirdultrasonic transmitter 304 corresponds to a transmission frequency of K3, wherein the transmission frequency may be a center frequency of the ultrasonic signal. When thefirst microphone 306 and thesecond microphone 307 respectively receive the ultrasonic signals, the transmitting frequency corresponding to the received ultrasonic signals can be determined according to the communication between the stylus and the electronic device, so that the ultrasonic transmitter for transmitting the ultrasonic signals is determined.

And step S22, determining frequency difference information corresponding to the ultrasonic signals according to the transmitting frequency and the receiving frequency.

Step S23, determining distance information between each microphone and the ultrasonic transmitter that transmits the ultrasonic signal according to the frequency difference information corresponding to the ultrasonic signal.

For example, fig. 14 is a schematic diagram of the transmitting frequency and the receiving frequency of an ultrasonic signal according to an embodiment of the present application, and as shown in fig. 14, frequency modulated continuous wave ranging is adopted, and an ultrasonic signal with a transmitting frequency varying according to a periodic sawtooth is transmitted by an ultrasonic transmitter, where a modulation period is T and a modulation bandwidth is Δ f, and then a range a is calculated by the following formula (1):

A＝T*C_{speed of sound} (1)

At this time, if the transmission frequency is f1 and the reception frequency is f2, the distance information L is calculated by the following formula (2):

for example, T is 10ms, f1 is 45kHz, f2 is 42kHz, and so on.

At this time, the ultrasonic transmitter which transmits the ultrasonic signal can be specified from the transmission frequency f1, and the distance information of the microphone from the ultrasonic transmitter is L.

Optionally, the transmission parameter comprises a transmission time.

In this application embodiment, the transmission parameter may also be a transmission time, that is, different ultrasonic transmitters may transmit the ultrasonic signal at different times, and the stylus may determine a correspondence between the transmission time and the ultrasonic transmitter in advance by communicating with the electronic device, so as to determine the ultrasonic transmitter corresponding to the ultrasonic signal according to the transmission time of the ultrasonic signal.

Thestep 802 includes:

step S31, determining the ultrasonic transmitter sending the ultrasonic signal according to the transmitting time.

As shown in fig. 4, the transmission time of the firstultrasonic transmitter 302 is T1, the transmission time of the secondultrasonic transmitter 303 is T2, and the transmission time of the thirdultrasonic transmitter 304 is T3, and since the distance between the electronic device and the stylus pen is usually small and the propagation speed of the ultrasonic signal is high, it can be seen that the ultrasonic signal received by the microphone on the stylus pen at the time T1 corresponds to the firstultrasonic transmitter 302, the ultrasonic signal received at the time T2 corresponds to the secondultrasonic transmitter 303, and the ultrasonic signal received at the time T3 corresponds to the thirdultrasonic transmitter 304.

And step S32, determining frequency difference information corresponding to the ultrasonic signals according to the transmitting frequency and the receiving frequency.

Step S33, determining distance information between each microphone and the ultrasonic transmitter that transmits the ultrasonic signal according to the frequency difference information corresponding to the ultrasonic signal.

In the embodiment of the present application, the steps S32 to S33 may refer to the related descriptions of the steps S22 to S23, which are not repeated herein.

Step 803, sending the distance information to the electronic device, so that the electronic device determines a handheld mode of the stylus according to the distance information, and adjusts a user display interface according to the handheld mode.

In this embodiment of the application, after determining the distance information between each microphone and each ultrasonic transmitter, the stylus may send the distance information to the electronic device, so that the electronic device determines a handheld manner of the stylus according to the distance information, and adjusts the user display interface according to the handheld manner, specifically, the related description of the foregoingstep 102 and step 104 may be referred to, and details are not repeated here to avoid repetition.

Optionally,step 802 is followed by:

step 804, determining a handheld mode of the stylus according to the distance information, and sending the handheld mode to the electronic device, so that the electronic device adjusts a user display interface according to the handheld mode.

In the embodiment of the application, after the stylus determines the distance information between each microphone and each ultrasonic transmitter, the handheld mode of the stylus may also be determined directly according to the distance information, and the process of determining the handheld mode by the stylus according to the distance information may be performed by referring to the process of determining the handheld mode by the electronic device according to the distance information, which is not repeated.

In the embodiment of the application, by arranging at least two microphones with different positions on the touch control pen, and receiving ultrasonic information sent by electronic equipment provided with at least three ultrasonic transmitters in nonlinear arrangement according to corresponding transmission parameters, determining distance information between the microphone and the ultrasonic transmitter corresponding to the transmission parameters by the touch pen according to the ultrasonic signal received by the microphone, according to the distances between different positions of at least two microphones of the touch control pen and different positions of at least three ultrasonic transmitters on the electronic equipment, under the scene that the touch control pen is not in contact with the screen, the touch control pen is accurately positioned, so that the detection distance is enlarged, the response speed of ultrasonic distance measurement positioning is high, the precision is high, the efficiency of adjusting UI display of the electronic equipment can be effectively improved, and the efficiency of operating the electronic equipment by a user is improved.

The embodiment of the present application is implemented by interaction between an electronic device and a stylus, where the electronic device includes at least three ultrasonic transmitters arranged non-linearly, the stylus includes at least two microphones with different positions, optionally, the ultrasonic transmitter of the electronic device may be a speaker or another module capable of transmitting an ultrasonic signal, the ultrasonic transmitter may be independently disposed or may be multiplexed with other elements of the electronic device, for example, the electronic device may include afirst speaker 302, asecond speaker 303, and athird speaker 304 as shown in fig. 3, optionally, theelectronic device 301 may further include anelectronic module 3011, where theelectronic module 3011 may include a processor, a communication module, a codec, and the like, and the processor may perform data processing, coordinate system construction, handheld determination, user display interface adjustment, and the like, the communication module can communicate with the stylus, and the codec can process the electrical signal of the ultrasonic signal, and the like.

Fig. 15 is a schematic structural diagram of a second electronic device provided in an embodiment of the present application, and as shown in fig. 15, anelectronic device 901 includes afirst speaker 902, asecond speaker 903, and anultrasonic fingerprint module 904 that are arranged in a non-linear manner, where thefirst speaker 902 is located at the top of a frame of theelectronic device 901, thesecond speaker 903 is located at the bottom of the frame of theelectronic device 901, and theultrasonic fingerprint module 904 is located on a screen of theelectronic device 901.

Fig. 16 is a schematic structural diagram of a third electronic device according to an embodiment of the present application, and as shown in fig. 16, anelectronic device 1001 includes afirst speaker 1002, asecond speaker 1003, and a screen-vibration sound-generatingmodule 1004, which are arranged in a non-linear manner, where thefirst speaker 1002 is located at the top of a frame of theelectronic device 1001, thesecond speaker 1003 is located at the bottom of the frame of theelectronic device 1001, and the screen-vibration sound-generatingmodule 1004 is located on a screen of theelectronic device 1001.

Fig. 17 is a schematic structural diagram of a fourth electronic device provided in this embodiment, and as shown in fig. 17, anelectronic device 1101 includes afirst speaker 1102, asecond speaker 1103 and anultrasonic transmitter 1104 that are arranged in a non-linear manner, where thefirst speaker 1102 is located at the top of a bezel of theelectronic device 1101, thesecond speaker 1103 is located at the bottom of the bezel of theelectronic device 1101, and theultrasonic transmitter 1104 is multiplexed in a USB (Universal Serial Bus) interface.

Fig. 18 is a schematic structural diagram of a fifth electronic device provided in the embodiment of the present application, and as shown in fig. 18, theelectronic device 1201 includes afirst speaker 1202, asecond speaker 1203, and anultrasonic emitter 1204, which are arranged in a non-linear manner, where thefirst speaker 1202 is located at the top of a frame of theelectronic device 1201, thesecond speaker 1203 is located at the bottom of the frame of theelectronic device 1201, and theultrasonic emitter 1204 is multiplexed in an earphone jack.

Fig. 19 is a schematic structural diagram of a stylus pen provided in an embodiment of the present application, as shown in fig. 19, thestylus pen 130 may include at least twomicrophones 1301 with different positions, aprocessor 1302, acommunication module 1303, astorage module 1304, and apower module 1305, where themicrophone 1301 is configured to receive an ultrasonic signal sent by an ultrasonic transmitter in an electronic device, theprocessor 1302 may be configured to perform data processing, coordinate system construction, handheld mode determination, and the like, thecommunication module 1303 may communicate with the electronic device, and thepower module 1305 is configured to supply power to the stylus pen.

Fig. 20 is an interaction diagram of a display interface adjustment method provided in an embodiment of the present application, and as shown in fig. 20, the method may be applied to the electronic device shown in any of fig. 3, fig. 15 to fig. 18, and the stylus shown in fig. 19, including:

1401, the electronic equipment sends an ultrasonic signal to the touch pen according to the emission parameters of the ultrasonic emitter;

step 1402, the touch pen receives the ultrasonic signal through the microphone, and determines the receiving frequency and the transmitting parameter of the ultrasonic signal;

step 1403, the stylus determines distance information between each ultrasonic transmitter and each microphone according to the transmitting parameters and the receiving frequency;

step 1404, the touch control pen sends the distance information between each ultrasonic transmitter and each microphone to the electronic equipment;

step 1405, the electronic device determines the holding mode of the stylus according to the distance information between each ultrasonic transmitter and each microphone;

and step 1406, the electronic equipment adjusts the user display interface according to the handheld mode.

Fig. 21 is an interaction diagram of another display interface adjustment method provided in an embodiment of the present application, and as shown in fig. 21, the method may be applied to the electronic device shown in any of fig. 3, 15 to 18, and the stylus shown in fig. 19, and the method may include:

step 1501, the electronic equipment sends an ultrasonic signal to the touch pen according to the transmitting parameters of the ultrasonic transmitter;

step 1502, the touch control pen receives the ultrasonic signal through the microphone, and determines the receiving frequency and the transmitting parameter of the ultrasonic signal;

step 1503, the stylus determines distance information between each ultrasonic transmitter and each microphone according to the transmitting parameters and the receiving frequency;

step 1504, the stylus determines the holding mode of the stylus according to the distance information between each ultrasonic transmitter and each microphone;

step 1505, the stylus sends the handheld mode of the stylus to the electronic device;

and step 1506, the electronic equipment adjusts the user display interface according to the handheld mode.

In the embodiment of the application, at least three ultrasonic transmitters which are arranged in a non-linear way are arranged on the electronic equipment, and the electronic equipment sends ultrasonic signals to a touch control pen provided with at least two microphones according to the transmitting parameters corresponding to the ultrasonic transmitters, the touch control pen determines the distance information between the microphones and the ultrasonic transmitters corresponding to the transmitting parameters according to the ultrasonic signals received by the microphones, according to the distances between different positions of at least two microphones of the touch control pen and different positions of at least three ultrasonic transmitters on the electronic equipment, under the scene that the touch control pen is not in contact with the screen, the touch control pen is accurately positioned, so that the detection distance is enlarged, the response speed of ultrasonic distance measurement positioning is high, the precision is high, the efficiency of adjusting UI display of the electronic equipment can be effectively improved, and the efficiency of operating the electronic equipment by a user is improved.

It should be noted that, in the display interface adjustment method provided in the embodiment of the present application, the execution main body may be an electronic device or a stylus pen, or a control module in the electronic device or the stylus pen, which is used for executing the loaded display interface adjustment method. In the embodiment of the present application, an electronic device or a stylus is taken as an example to execute a method for adjusting a loaded display interface, which illustrates the method for adjusting a display interface provided in the embodiment of the present application.

Fig. 22 is a block diagram of anelectronic device 160 according to an embodiment of the present application, where the electronic device includes at least three ultrasonic transmitters arranged in a non-linear manner, and as shown in fig. 22, the electronic device includes:

an ultrasonicwave sending module 1601, configured to send an ultrasonic wave signal to a stylus according to a sending parameter corresponding to the ultrasonic wave sender, where the stylus includes at least two microphones with different positions;

a handheldmode determining module 1602, configured to receive distance information between each ultrasonic transmitter and each microphone sent by the stylus, and determine a handheld mode of the stylus according to the distance information, or receive a handheld mode of the stylus sent by the stylus according to the distance information, where the distance information is determined by the stylus according to an ultrasonic signal corresponding to the transmission parameter;

a displayinterface adjusting module 1603, configured to adjust a user display interface of the electronic device according to the handheld manner.

Optionally, the handheldmanner determining module 1602 includes:

the vertical distance calculation submodule is used for determining the vertical distance between each microphone and the screen of the electronic equipment according to the distance information and the position information of each ultrasonic transmitter;

the three-dimensional coordinate construction sub-module is used for determining three-dimensional coordinate information of each microphone relative to the screen of the electronic equipment according to the vertical distance and the position information of each ultrasonic transmitter;

and the handheld mode determining submodule is used for determining the handheld mode of the stylus by comparing three-dimensional coordinate information between at least two microphones.

Optionally, the microphones include a target microphone, the target microphone is located in an operation area on the stylus pen, and the handheld mode determination submodule is specifically configured to compare three-dimensional coordinate information between at least two microphones when the three-dimensional coordinate information of the target microphone is located in an effective identification area of the electronic device, and determine a handheld mode of the stylus pen.

Optionally, the handheld mode determination submodule includes:

a coordinate difference determination unit for determining a difference between the Z-axis coordinates of any two microphones;

and the handheld mode determining unit is used for comparing the three-dimensional coordinate information between at least two microphones under the condition that the difference value meets a preset difference value condition corresponding to any two microphones, and determining the handheld mode of the stylus pen.

Optionally, the stylus includes a first microphone located in an operation area and a second microphone located in a non-operation area, and the handheld manner determining sub-module is specifically configured to determine that the handheld manner of the stylus is right-handed when the X-axis coordinate of the first microphone is smaller than the X-axis coordinate of the second microphone; and under the condition that the X-axis coordinate of the first microphone is larger than the X-axis coordinate of the second microphone, determining that the holding mode of the touch pen is left-handed.

Fig. 23 is a block diagram of astylus 170 according to an embodiment of the present disclosure, where the stylus includes at least two microphones with different positions, as shown in fig. 13, the stylus includes:

asignal receiving module 1701, configured to receive an ultrasonic signal of an electronic device through the microphone, and determine a transmitting frequency, a receiving frequency, and a transmitting parameter for receiving the ultrasonic signal, where the ultrasonic signal is sent by at least three ultrasonic transmitters arranged in a non-linear manner on the electronic device;

adistance determining module 1702, configured to determine distance information between each ultrasonic transmitter and each microphone according to the transmitting parameter, the transmitting frequency, and the receiving frequency;

aninformation sending module 1703, configured to send the distance information to the electronic device, so that the electronic device determines a handheld manner of the stylus according to the distance information, and adjusts a user display interface according to the handheld manner; or, the method and the device are used for determining the handheld mode of the stylus according to the distance information and sending the handheld mode to the electronic device, so that the electronic device adjusts a user display interface according to the handheld mode.

Optionally, the transmission parameter includes a transmission frequency, and thedistance determining module 1702 includes:

an ultrasonic transmitter determining submodule for determining the ultrasonic transmitter which transmits the ultrasonic signal according to the transmitting frequency;

the frequency difference determining submodule is used for determining frequency difference information corresponding to the ultrasonic signals according to the transmitting frequency and the receiving frequency;

and the distance determining submodule is used for determining distance information between each microphone and the ultrasonic transmitter which sends the ultrasonic signals according to the frequency difference information corresponding to the ultrasonic signals.

Optionally, the transmission parameter includes a transmission time, and thedistance determining module 1702 includes:

the ultrasonic transmitter determining submodule is further used for determining the ultrasonic transmitter which sends the ultrasonic signal according to the transmitting time;

the frequency difference determining submodule is further used for determining frequency difference information corresponding to the ultrasonic signals according to the transmitting frequency and the receiving frequency;

the distance determining submodule is further configured to determine distance information between each microphone and the ultrasonic transmitter that transmits the ultrasonic signal according to the frequency difference information corresponding to the ultrasonic signal.

The electronic device or the stylus in the embodiment of the present application may be a device, and may also be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The electronic device or the stylus in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The electronic device or the stylus provided in the embodiment of the present application can implement each process implemented by the electronic device or the stylus in the method embodiments of fig. 1 to 14, and for avoiding repetition, details are not repeated here.

Optionally, an electronic device is further provided in this embodiment of the present application, and includes a processor 1810, amemory 1809, and a program or an instruction stored in thememory 1809 and executable on the processor 1810, where the program or the instruction is executed by the processor 1810 to implement each process of the foregoing display interface adjustment method embodiment, and may achieve the same technical effect, and in order to avoid repetition, details are not described here again.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

Theelectronic device 1800 includes, but is not limited to:radio frequency unit 1801,network module 1802,audio output unit 1803,input unit 1804,microphone 1805,display unit 1806, user input unit 1807,interface unit 1808,memory 1809, and processor 1810.

Those skilled in the art will appreciate that theelectronic device 1800 may also include a power supply (e.g., a battery) for powering the various components, and that the power supply may be logically connected to the processor 1810 via a power management system to perform functions such as managing charging, discharging, and power consumption. The electronic device structure shown in fig. 24 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description thereof is omitted.

Theaudio output unit 1803 of the electronic device includes at least three ultrasonic transmitters arranged on the electronic device in a non-linear manner, theaudio output unit 1803 is configured to send an ultrasonic signal to a stylus according to a transmission parameter corresponding to the ultrasonic transmitter, and the stylus includes at least two microphones at different positions;

the processor 1810 is configured to receive distance information between each ultrasonic transmitter and each microphone sent by the stylus, and determine a handheld manner of the stylus according to the distance information, or receive a handheld manner determined by the stylus according to the distance information sent by the stylus, where the distance information is determined by the stylus according to an ultrasonic signal corresponding to the transmission parameter;

thedisplay unit 1806 adjusts a user display interface of the electronic device according to the handheld manner.

Optionally, the processor 1810 is specifically configured to determine, according to the distance information and the position information of each ultrasonic transmitter, a vertical distance between each microphone and the screen of the electronic device; determining three-dimensional coordinate information of each microphone relative to the screen of the electronic equipment according to the vertical distance and the position information of each ultrasonic transmitter; and determining the holding mode of the touch pen by comparing three-dimensional coordinate information between at least two microphones.

Optionally, the microphones include a target microphone, the target microphone is located in an operation area on the stylus pen, and the processor 1810 is specifically configured to compare three-dimensional coordinate information between at least two microphones when the three-dimensional coordinate information of the target microphone is located in an effective identification area of the electronic device, so as to determine a handheld manner of the stylus pen.

Optionally, the processor 1810 is further configured to determine a difference between Z-axis coordinates of any two microphones; and comparing the three-dimensional coordinate information between at least two microphones under the condition that the difference value meets a preset difference value condition corresponding to any two microphones, and determining the handheld mode of the touch pen.

Optionally, the stylus includes a first microphone located in an operation area and a second microphone located in a non-operation area, and the processor 1810 is specifically configured to determine that the holding manner of the stylus is right-handed when the X-axis coordinate of the first microphone is smaller than the X-axis coordinate of the second microphone; and under the condition that the X-axis coordinate of the first microphone is larger than the X-axis coordinate of the second microphone, determining that the holding mode of the touch pen is left-handed.

Alternatively, the structure shown in fig. 24 may also be a stylus pen including at least two microphones with different positions, in this case, the processor 1810 is configured to receive an ultrasonic signal of an electronic device through themicrophone 1805, and determine a receiving frequency and a transmitting parameter of the ultrasonic signal, where the ultrasonic signal is sent through at least three ultrasonic transmitters arranged in a non-linear manner on the electronic device; determining distance information between each ultrasonic transmitter and each microphone according to the transmitting parameters, the transmitting frequency and the receiving frequency; sending the distance information to the electronic equipment, so that the electronic equipment determines the handheld mode of the stylus according to the distance information and adjusts a user display interface according to the handheld mode; or determining the handheld mode of the stylus according to the distance information, and sending the handheld mode to the electronic device, so that the electronic device adjusts a user display interface according to the handheld mode.

Optionally, the transmission parameter includes a transmission frequency, and the processor 1810 is specifically configured to determine the ultrasonic transmitter that transmits the ultrasonic signal according to the transmission frequency; respectively determining frequency difference information corresponding to the ultrasonic signals according to the transmitting frequency and the receiving frequency; and determining distance information between each microphone and the ultrasonic transmitter which sends the ultrasonic signals according to the frequency difference information corresponding to the ultrasonic signals.

Optionally, the transmission parameter includes a transmission time, and the processor 1810 is specifically configured to determine the ultrasonic transmitter that transmits the ultrasonic signal according to the transmission time; determining frequency difference information corresponding to the ultrasonic signals according to the transmitting frequency and the receiving frequency; and determining distance information between each microphone and the ultrasonic transmitter which sends the ultrasonic signals according to the frequency difference information corresponding to the ultrasonic signals.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the foregoing display interface adjustment method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above embodiment of the display interface adjustment method, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A display interface adjusting method is applied to electronic equipment, wherein the electronic equipment comprises at least three ultrasonic transmitters which are arranged in a nonlinear way, and the method comprises the following steps:

2. The method of claim 1, wherein determining the holding mode of the stylus according to the distance information comprises:

determining the vertical distance between each microphone and the screen of the electronic equipment according to the distance information and the position information of each ultrasonic transmitter;

determining three-dimensional coordinate information of each microphone relative to the screen of the electronic equipment according to the vertical distance and the position information of each ultrasonic transmitter;

and determining the holding mode of the touch pen by comparing three-dimensional coordinate information between at least two microphones.

3. The method of claim 2, wherein the target microphone is included in the microphones, the target microphone is located in an operation area on the stylus pen, and the comparing three-dimensional coordinate information between at least two of the microphones to determine a hand-held manner of the stylus pen comprises:

and under the condition that the three-dimensional coordinate information of the target microphone is located in the effective identification area of the electronic equipment, comparing the three-dimensional coordinate information between at least two microphones to determine the handheld mode of the stylus.

4. The method of claim 2, wherein said comparing three-dimensional coordinate information between at least two of said microphones to determine a hand-held position of said stylus comprises:

determining a difference between the Z-axis coordinates of any two microphones;

and comparing the three-dimensional coordinate information between at least two microphones under the condition that the difference value meets a preset difference value condition corresponding to any two microphones, and determining the handheld mode of the touch pen.

5. The method of claim 2, wherein the stylus includes a first microphone located in an operational area and a second microphone located in a non-operational area, and wherein the comparing three-dimensional coordinate information between at least two of the microphones to determine the hand-held position of the stylus comprises:

determining that the holding mode of the touch pen is right-handed when the X-axis coordinate of the first microphone is smaller than the X-axis coordinate of the second microphone;

and under the condition that the X-axis coordinate of the first microphone is larger than the X-axis coordinate of the second microphone, determining that the holding mode of the touch pen is left-handed.

6. A display interface adjusting method is applied to a touch pen, wherein the touch pen comprises at least two microphones with different positions, and the method comprises the following steps:

receiving an ultrasonic signal of electronic equipment through the microphone, and determining the receiving frequency and the transmitting parameter of the ultrasonic signal, wherein the ultrasonic signal is sent by at least three ultrasonic transmitters which are arranged in a nonlinear way on the electronic equipment;

7. The method of claim 6, wherein the transmitting parameters comprise transmitting frequency, and the determining distance information of each ultrasonic transmitter from each microphone according to the transmitting parameters and the receiving frequency comprises:

determining the ultrasonic transmitter for transmitting the ultrasonic signal according to the transmitting frequency;

determining frequency difference information corresponding to the ultrasonic signals according to the transmitting frequency and the receiving frequency;

and determining distance information between each microphone and the ultrasonic transmitter which sends the ultrasonic signals according to the frequency difference information corresponding to the ultrasonic signals.

8. The method of claim 6, wherein the transmitting parameters comprise transmitting time, and the determining distance information of each ultrasonic transmitter from each microphone according to the transmitting parameters and the receiving frequency comprises:

determining the ultrasonic transmitter for transmitting the ultrasonic signal according to the transmitting time;

9. An electronic device comprising at least three non-linearly arranged ultrasonic emitters, the electronic device comprising:

10. A stylus comprising at least two microphones in different locations, the stylus comprising:

11. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the display interface adjustment method according to claims 1-5 or 6-8.