Movatterモバイル変換


[0]ホーム

URL:


CN111290695A - Terminal control method and device based on priority control and terminal - Google Patents

Terminal control method and device based on priority control and terminal
Download PDF

Info

Publication number
CN111290695A
CN111290695ACN202010070580.7ACN202010070580ACN111290695ACN 111290695 ACN111290695 ACN 111290695ACN 202010070580 ACN202010070580 ACN 202010070580ACN 111290695 ACN111290695 ACN 111290695A
Authority
CN
China
Prior art keywords
control
terminal
interface
touch
interactive interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010070580.7A
Other languages
Chinese (zh)
Other versions
CN111290695B (en
Inventor
赵宁
许仁
周枫
王伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
VDL Industry Shenzhen Co Ltd
Original Assignee
VDL Industry Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by VDL Industry Shenzhen Co LtdfiledCriticalVDL Industry Shenzhen Co Ltd
Priority to CN202010070580.7ApriorityCriticalpatent/CN111290695B/en
Publication of CN111290695ApublicationCriticalpatent/CN111290695A/en
Application grantedgrantedCritical
Publication of CN111290695BpublicationCriticalpatent/CN111290695B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

The application relates to a terminal control method, a device, a terminal, computer equipment and a storage medium based on priority control, wherein the method comprises the following steps: the method comprises the steps of obtaining a control request of a control terminal, wherein the control request carries identity authentication information of the control terminal, sending an interactive interface to the control terminal when the identity authentication of the control terminal is completed according to the identity authentication information, wherein the interactive interface is an interface currently controlled by at least two control terminals, receiving touch operation data, sent by each control terminal, of a user aiming at each interactive interface, identifying the priority of each touch operation data, responding each touch operation data according to the priority, and generating and sending a corresponding touch response interface to each control terminal. The application also provides a terminal control method and device based on priority control, computer equipment and a storage medium. According to the scheme, the controlled terminal does not need to be carried, and the controlled terminal can orderly respond according to the priority, so that operation conflicts are reduced, and the control efficiency is improved.

Description

Terminal control method and device based on priority control and terminal
Technical Field
The present application relates to the field of communications technologies, and in particular, to a method and an apparatus for controlling a terminal based on priority control, a terminal, a computer device, and a storage medium.
Background
With the rapid development of computer science and technology, smart home becomes a current hot topic and is favored. The intelligent home is embodied in an internet of things manner under the influence of the internet. The intelligent home realizes remote control, namely the control terminal sends the operation information to the Internet of things intelligent gateway, and then the Internet of things intelligent gateway operates the Internet of things intelligent terminal to realize remote control.
However, when a plurality of control terminals simultaneously send a plurality of operation commands such as "start, increase wind speed, cool and heat" to the air conditioner, the data transmission bears a small pressure, and the phenomenon of operation conflict is easy to occur. Similarly, the remote control of the communication terminal is also the same, when a user sends more action instructions to the controlled terminal through a plurality of control terminals, the problem of operation insensitivity easily occurs because of no differentiation instructions, and the problem of carrying the host body is also needed for controlling the communication terminal, so that the control efficiency is not high.
Disclosure of Invention
In view of the above, it is necessary to provide a terminal control method, apparatus, terminal, computer device, and storage medium based on priority control capable of improving control efficiency in view of the above technical problems.
A terminal control method based on priority control comprises the following steps:
acquiring a control request of a control terminal, wherein the control request carries identity authentication information of the control terminal;
when the identity authentication of the control terminal is completed according to the identity authentication information, sending an interactive interface to the control terminal, wherein the interactive interface is an interface currently controlled by at least two control terminals;
receiving touch operation data of a user aiming at each interactive interface, which are sent by each control terminal;
and identifying the priority of each touch operation data, responding each touch operation data according to the priority, and generating and sending a corresponding touch response interface to each control terminal.
In one embodiment, the touch operation data includes operator identity information, an operation application, and an operation type;
identifying the priority of each touch operation data includes:
and performing weighted summation based on the identity information of the operator, the operation application and the operation type, and determining the priority of each touch operation data.
In one embodiment, the receiving touch operation data of the user for the interactive interface sent by each control terminal includes:
and when touch operation data of a user aiming at the interactive interface, which are sent by any control terminal, are received, the unique operation authority of the control terminal on the interactive interface in the current time period is locked.
In one embodiment, after sending the corresponding touch response interface to each control terminal, the method further includes:
and sending operator information to the plurality of control terminals, wherein the operator information comprises a data sender for generating touch operation data of the corresponding touch response interface.
A terminal control device based on priority control, the device includes:
the control request acquisition module is used for acquiring a control request of the control terminal, and the control request carries identity authentication information of the control terminal;
the data sending module is used for sending an interactive interface to each control terminal when the identity authentication of each control terminal is completed according to the identity authentication information, wherein the interactive interface is an interface currently controlled by at least two control terminals;
the data receiving module is used for receiving touch operation data, which are sent by each control terminal and aim at each interactive interface, of a user, wherein the touch operation data comprise touch operation time;
and the data response module is used for identifying the priority of each touch operation data, responding each touch operation data according to the priority, and generating and sending a corresponding touch response interface to each control terminal.
A computer device comprising a memory storing a computer program and a processor implementing the steps in the priority control based terminal control method described above when executing the computer program.
A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the above-mentioned priority control-based terminal control method.
According to the terminal control method and device based on priority control, the computer equipment and the storage medium, when the identity authentication of the control terminal is completed according to the identity authentication information, the interactive interface is sent to the control terminal, the touch operation data sent by each control terminal is received, each touch response operation data is sequentially responded according to the identified priority of the touch operation data, and each control terminal of the corresponding touch response interface is generated and sent. According to the scheme, the controlled terminal does not need to be carried, a user can operate the interactive interfaces of the control terminals, many-to-one remote control over the controlled terminal is achieved, the controlled terminal can respond orderly according to the priority, operation conflicts are reduced, and control efficiency is improved.
A terminal control method based on priority control comprises the following steps:
sending an operation request to a controlled terminal, wherein the operation request carries identity authentication information;
acquiring an interactive interface fed back by the controlled terminal according to the identity authentication information, and displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals;
responding to touch operation of a user on the interactive interface to obtain touch operation data;
sending the touch operation data to a controlled terminal;
and acquiring a touch response interface of the controlled terminal, and displaying the touch response interface, wherein the touch response interface is generated by the controlled terminal in response to each touch operation data according to the identified priority of each touch operation data.
In one embodiment, the obtaining of the interactive interface fed back by the controlled terminal according to the identity authentication information includes:
and receiving a plurality of interactive interfaces fed back by the controlled terminal, and displaying each interactive interface in a split screen mode, wherein the interactive interfaces are the interfaces which are independently controlled by the control terminals at present.
In one embodiment, the obtaining of the interactive interface fed back by the controlled terminal according to the identity authentication information includes:
acquiring program operation window data fed back by the controlled terminal according to the identity authentication information;
processing the program operation window data to obtain interactive interface configuration data;
and configuring the corresponding interactive interface according to the interactive interface configuration data.
In one embodiment, acquiring a touch response interface of a controlled terminal includes:
acquiring touch response window data displayed after the controlled terminal responds to the touch operation data;
processing the touch response window data to obtain touch response interface configuration data;
and configuring the touch response interface according to the touch response interface configuration data.
In one embodiment, before obtaining the interactive interface fed back by the controlled terminal according to the identity authentication information, the method further includes:
sending a connection request to a controlled terminal, wherein the control request carries identity information;
and receiving the connection permission message fed back by the controlled terminal according to the identity information, and establishing connection with the controlled terminal.
In one embodiment, further comprising:
the control center is connected with the controlled terminal and used for forwarding the data transmitted by the control terminal to the controlled terminal and forwarding the data transmitted by the controlled terminal to the control terminal, so that the communication between the control terminal and the controlled terminal is realized.
In one embodiment, the resolution of the displayed touch response interface control terminal is matched with the size of the corresponding split screen area.
A terminal control device based on priority control, the device includes:
the control request sending module is used for sending a control request to the controlled terminal, and the control request carries identity authentication information;
the first interface display module is used for acquiring an interactive interface fed back by the controlled terminal according to the identity authentication information and displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals;
the touch operation response module is used for responding to the touch operation of the user on the interactive interface to obtain touch operation data;
the touch operation data sending module is used for sending the touch operation data to the controlled terminal;
and the second interface display module is used for acquiring a touch response interface of the controlled terminal and displaying the touch response interface, and the touch response interface is generated by the controlled terminal according to the identified priority of each touch operation data.
A terminal, comprising: communication module, touch-control display module and treater, wherein:
the communication module is connected with the controlled terminal, the processor acquires an interactive interface of the controlled terminal and sends the interactive interface to the touch display module, the touch display module receives and displays the interactive interface, the touch operation data is obtained by responding to the touch operation of a user on the interactive interface and sent to the processor, the touch operation data comprises touch operation time, the processor acquires and sends the touch operation data to the controlled terminal, a touch response interface of the controlled terminal is acquired and sent to the touch display module, and the touch display module receives and displays the touch response interface, wherein the touch response interface is generated by the controlled terminal according to the identified priority of each piece of touch operation data.
A computer device comprising a memory storing a computer program and a processor implementing the steps in the priority control based terminal control method described above when executing the computer program.
A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the above-mentioned priority control-based terminal control method.
In the priority control-based terminal control method, device, terminal, computer device and storage medium, the plurality of control terminals obtain the interactive interface fed back by the controlled terminal by sending the control request to the controlled terminal, simultaneously display the interactive interface, further send the touch operation data to the controlled terminal by responding to the touch operation of the user on the interactive interface, and obtain the touch response interface generated by the controlled terminal according to the identified priority of each touch operation data. According to the scheme, the controlled terminal does not need to be carried, direct operation on the control terminal is replaced by interaction between the control terminal and the controlled terminal, a user can operate on the interaction interfaces of the control terminals, many-to-one remote control on the controlled terminal is achieved, portability is improved, the controlled terminal can orderly respond according to the priority, operation conflicts are reduced, and control efficiency is improved.
Drawings
Fig. 1 is a diagram of an application environment of a terminal control method based on priority control in an embodiment;
fig. 2 is a flowchart illustrating a terminal control method based on priority control according to an embodiment;
fig. 3 is a flowchart illustrating a terminal control method based on priority control according to an embodiment;
fig. 4 is a detailed flowchart of a terminal control method based on priority control in another embodiment;
FIG. 5 is a diagram illustrating an application scenario in which multiple control terminals control a controlled terminal according to an embodiment;
fig. 6 is a diagram of an application environment of a terminal control method based on priority control in another embodiment;
FIG. 7 is a software architecture diagram of a terminal control method based on priority control in one embodiment;
fig. 8 is a block diagram of a terminal in one embodiment;
fig. 9 is a detailed configuration block diagram of a terminal in another embodiment;
FIG. 10 is a block diagram showing a configuration of a terminal control apparatus based on priority control according to an embodiment;
fig. 11 is a block diagram showing a configuration of a terminal control apparatus based on priority control in another embodiment;
fig. 12 is a detailed configuration block diagram of a terminal control apparatus based on priority control in another embodiment;
FIG. 13 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The terminal control method based on priority control provided by the application can be applied to an application environment diagram as shown in fig. 1. In the application environment, a plurality ofcontrol terminals 202 and controlledterminals 204 are included. Thecontrol terminal 202 has touch and display functions. The touch control function is that a user controls an operation interface by touching or writing with a writing pen on a touch screen, the display function comprises a display operation interface and a touch control response interface, and the touch control response interface is an interface for displaying corresponding touch control response after touch control operation. The controlledterminal 204 is a terminal controlled by the plurality ofcontrol terminals 202, the controlledterminal 204 wirelessly communicates with thecontrol terminals 202, after the controlledterminal 204 completes identity authentication of thecontrol terminals 202, the controlled terminal transmits an interactive interface currently being controlled by other control terminals to thecontrol terminals 202 through a wireless link, identifies the priority of touch operation data sent by thecontrol terminals 202, makes a touch response according to the priority, generates a corresponding touch response interface, and transmits the touch response interface to thecontrol terminals 202. Thecontrol terminal 202 and the controlledterminal 204 may be, but are not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices.
In one embodiment, as shown in fig. 2, the present application further provides a method for controlling a terminal based on priority control, which can still be applied to the application environment diagram shown in fig. 1. Taking the example that the method is applied to the controlledterminal 204 in fig. 1 as an example, the method includes the following steps:
step S200, acquiring a control request of the control terminal, wherein the control request carries identity authentication information of the control terminal.
In specific implementation, at least two users may operate thecontrol terminal 202 to simultaneously control a controlled terminal by multiple users, eachcontrol terminal 202 is connected to the controlledterminal 204, and a remote control system or a remote control application program is preset in each of thecontrol terminal 202 and the controlledterminal 204, and the control of the controlled terminal can be realized through the operation system/application program. It is understood that thecontrol terminal 202 and the controlledterminal 204 have established a connection before step S100. Specifically, the connection may be established through a Wireless communication method such as 3G, 4G, 2.4G, 5G, Wi-Fi (Wireless Fidelity) communication or bluetooth communication. If the user wants to remotely control the controlledterminal 204, thecontrol terminal 202 may send a control request carrying the identity authentication information to the controlledterminal 204, and receive the control request. Specifically, the identity authentication information may be generated when the controlledterminal 204 completes identity authentication on thecontrol terminal 202 to allow confirmation of establishment of the connection, and includes, but is not limited to, an identity code or an identity identifier, such as "001", subjected to authentication by thecontrol terminal 204.
And step S400, when the identity authentication of the control terminal is completed according to the identity authentication information, sending an interactive interface to the control terminal, wherein the interactive interface is an interface currently controlled by at least two control terminals.
In specific implementation, the identity authentication information takes an identity code as an example, and the identity authentication may be to search whether the identity code exists in a database table, and if so, the authentication is passed. Identity authentication is also not limited to character string password verification, fingerprint verification, face verification, iris verification and other verification modes. The interactive interface may be an operation interface displayed on the controlledterminal 204 and shared by at least twocontrol terminals 202, or may be a background interface that the controlledterminal 204 enters a "security mode" similar to a computer by running a corresponding remote operation process after authorizing remote operation of eachcontrol terminal 202, or may be an operation interface of an application program running in the background of the controlledterminal 204 being controlled by eachcontrol terminal 202, for example, an operation window interface of a WeChat application program running in the background of the controlledterminal 204 is controlled by the control terminal A, and an operation window interface of a Paibao application program running in the background of the controlledterminal 204 is controlled by the control terminal B. Further, the background interface is not displayed on the current interface of the controlledterminal 204, so that the user of the controlledterminal 204 can perform autonomous operation unaffected while the controlledterminal 204 is remotely controlled by the controlledterminal 202. Further, the interactive interface may also be an interface generated by thecontrol terminal 202 and including information of the controlled terminal operated by each control terminal.
Step S600, receiving touch operation data, which is sent by each control terminal and is targeted by a user for each interactive interface.
In specific implementation, a user may perform a touch operation on the interactive interface of thecontrol terminal 202 through a finger or a stylus, where the touch operation may include operations such as clicking, long-pressing, sliding, zooming, and multi-touch. Thecontrol terminal 202 receives and records the touch operation to obtain touch operation data, specifically, the touch operation data includes operator identity information, operation application, touch operation time, touch point coordinates, touch duration, touch pressure information, and the like.
Step S800, identifying the priority of each touch operation data, responding each touch operation data according to the priority, and generating and sending a corresponding touch response interface to each control terminal.
In specific implementation, when one or more touch operation data are received, the priority of each touch operation data is identified according to a preset priority algorithm, the execution sequence of each touch operation data is determined, each touch operation data is sequentially responded according to the execution sequence, corresponding operation is executed according to information such as touch coordinates, touch duration, touch pressure and the like in the touch operation data, an operation interface (program operation window) corresponding to the control terminal is updated, a corresponding touch response interface is generated, and the touch response interface is sent to each control terminal, so that each control terminal can synchronously receive the latest operation interface. Specifically, the touch response interface generated by the controlledterminal 204 may be a final touch response interface obtained after all the touch operation data are responded, or may be a plurality of touch response interfaces obtained by responding the touch operation data one by one and sent in real time. And after the touch response operation is finished, synchronously updating the self interactive interface.
In particular, the response to the touch operation includes various situations. The following description will be given by taking the sorted touch operations as touch operation 1, touch operation 2, touch operation 3, and touch operation n … in sequence as an example:
in case 1, if no conflict between the received touch operations is detected, sequentially executing touch operations 1 to n according to a sequence, and taking a final interface n generated after the touch operation n is executed as a first touch response interface; or the interfaces generated by each touch operation (i.e. interface 1 and interface 2 …, interface n) are all used as touch response interfaces and are sequentially sent to each control terminal;
and 2, if the received touch operations are detected to have conflicts, responding to only the touch operation 1 with the earliest touch time, and taking the generated interface 1 as a touch response interface. Or responding to the former operations without conflict, and generating a response interface, for example, the operations of the former touch operations 1 to 5 have no conflict, and a conflict is generated when the touch operation 6 is reached, and only the touch operations 1 to 5 need to be responded at this time. Before the current control terminal a has not sent the touch operation data, the controlledterminal 204 may receive the touch operations of other control terminals in real time, and make a response, and send the interface after the response to the control terminal a as a touch response interface. If the user wants to continue the operation of the controlledterminal 204, the touch operation can be performed on the touch response interface again, then the touch operation data is sent to the controlledterminal 204 again through thecontrol terminal 202, and the touch response interface sent by the controlledterminal 204 is received again (different from the previous touch response interface), which is similar to the way in which the user normally performs the touch operation on a mobile terminal such as a mobile phone to perform the operation.
In the terminal control method based on priority control, when the identity authentication of the control terminal is completed according to the identity authentication information, an interactive interface is sent to the control terminal, touch operation data sent by each control terminal is received, each touch response operation data is sequentially responded according to the identified priority of the touch operation data, and each control terminal of the corresponding touch response interface is generated and sent. According to the scheme, the controlled terminal does not need to be carried, a user can operate the interactive interfaces of the control terminals, many-to-one remote control over the controlled terminal is achieved, and the response is orderly carried out according to the priority, so that the operation conflict is reduced, and the control efficiency is improved.
In one embodiment, the touch operation data includes operator identity information, an operation application, and an operation type; identifying the priority of each touch operation data includes: and performing weighted summation based on the identity information of the operator, the operation application and the operation type, and determining the priority of each touch operation data.
In specific implementation, when responding to the touch operation of the user, thecontrol terminal 202 records the identity information (administrator or common user) of the operator, the operation type (long press operation, click operation, slide operation, and the like), the operation duration, the operation application (QQ or WeChat), and the like, and generates touch operation data according to the recorded touch operation. After receiving the touch operation data, the controlledterminal 204 performs weighted summation according to the operator identity information, the operation application and the operation type therein, and determines the priority of each touch operation data.
Specifically, the following modes can be included:
1) for applications with different operations, the priority between each application may be preset, for example, the priority of the operation on the application a is greater than the priority of the manipulation on the application B;
2) for applications with the same operation, priorities of different operation types can be set, for example, the priority of the sliding operation is greater than that of the clicking operation, and the priority of the long-time pressing operation is greater than that of the sliding operation;
3) for different operators, the operation priority can also be set, for example, the operation priority of a user with administrator authority is higher than that of a common user;
the operator can set the related algorithms in the controlledterminal 204 according to the above-mentioned several ways, for example, the corresponding weights can be set according to factors such as the identity of the operator, the application/process acted by the operation, and the operation type, and the like, and the weights can be summed to determine the priority. The higher the total number value obtained, the greater its priority. In this embodiment, the touch operation data can be efficiently and orderly responded by determining the priority of each touch operation data.
In one embodiment, after sending the corresponding touch response interface to each control terminal, the method further includes: and sending operator information to each control terminal, wherein the operator information comprises a data sender for generating touch operation data of the corresponding touch response interface.
In practical applications, in addition to sending the corresponding touch response interface to the control terminal, the control terminal may also send operator information, where the operator information includes a data sender generating touch operation data of the corresponding touch response interface, so that each control terminal knows which related operations have been performed by each control terminal. In addition, the identity information of the control terminal that sends the touch operation data in the current time period (i.e., the identity information of the current other control terminals) may also be sent, so that each control terminal can know that the other control terminals that are currently operating the controlledterminal 202 except for itself.
In one embodiment, the receiving touch operation data of the user for each interactive interface sent by each control terminal includes: and when touch operation data of a user aiming at the interactive interface, which are sent by any control terminal, are received, the unique operation authority of the control terminal on the interactive interface in the current time period is locked.
In practical application, for receiving touch operation on the same interactive interface sent by a plurality of different control terminals in a short time, in order to reduce the conflict of touch operation data, when receiving the touch operation data of a user on a certain interactive interface sent by any control terminal, the unique operation authority of the control terminal on the interactive interface in the current time period is locked, the receiving of the touch operation data sent by other control terminals is stopped, further, an operation prohibition message can be sent to other control terminals, so that the users of other control terminals stop operating the interactive interface, when the user stops the touch operation on the interactive interface, the unique operation authority is released, the touch operation data sent by other control terminals are allowed to be received, further, an operation permission message can be sent to other control terminals, so that the users of other control terminals can operate in time. In the embodiment, by locking the operation permission, the conflict of touch operation data can be reduced, and the fluency of data interaction is ensured.
In one embodiment, as shown in fig. 3, a method for controlling a terminal based on priority control is provided, which is described by taking the method as an example applied to thecontrol terminal 202 in fig. 1, and includes the following steps:
step S100, sending a control request to the controlled terminal, wherein the control request carries identity authentication information.
In a specific implementation, at least two users may operate on thecontrol terminal 202 to realize that a plurality of users control one controlled terminal at the same time. Similarly, eachcontrol terminal 202 is connected to the controlledterminal 204, and a remote control system or a remote operation application program is preset in each of thecontrol terminal 202 and the controlledterminal 204, and the control of the controlled terminal can be realized through the operation system/application program. It is understood that thecontrol terminal 202 and the controlledterminal 204 have established a connection before step S100. Specifically, the connection may be established through a Wireless communication method such as 3G, 4G, 2.4G, 5G, Wi-Fi (Wireless Fidelity) communication or bluetooth communication. After the connection with the controlledterminal 204 is established, if the user wants to remotely control the controlled terminal, a control request carrying the identity authentication information may be sent to the controlledterminal 204, so as to obtain the interactive interface of the controlledterminal 204 at the current time sent according to the identity authentication information. Specifically, the identity authentication information may be generated when the controlledterminal 204 completes identity authentication on thecontrol terminal 202 to allow confirmation of establishment of the connection, and includes, but is not limited to, an identity code or an identity identifier, such as "001", subjected to authentication by thecontrol terminal 204.
And step S300, acquiring an interactive interface fed back by the controlled terminal according to the identity authentication information, and displaying the interactive interface, wherein the interactive interface is an interface currently controlled by at least two control terminals.
And after the controlledterminal 204 completes the identity authentication according to the identity authentication information, sending an interactive interface to thecontrol terminal 202, and acquiring the interactive interface sent by the controlledterminal 204. In a specific implementation, the interactive Interface may be obtained by capturing an operation Interface image of the controlledterminal 204, and using the operation Interface image as the interactive Interface, or capturing data such as User Interface (UI) data, screen size, resolution, and the like of the screen of the controlledterminal 204, and obtaining the interactive Interface according to the data. For example, the controlledterminal 204 may perform a screen capture operation on the entire operation interface thereof, and take the screen capture result as an interactive interface. Or reading the operation interface parameters of the controlledterminal 204 to obtain the resolution of 2048 × 1536 pixels, when the upper left corner of the operation interface is the origin of coordinates, the software icon (e.g. WeChat icon) is located at the pixel of coordinates (1600,600), and according to the resolution, the type of the icon and the position of the icon, the interactive interface can be obtained. After the interactive interface of the controlledterminal 204 is obtained, the interactive interface may be directly displayed, or the interactive interface may be subjected to certain processing such as scaling, capturing, filling, and the like or rendering processing according to the screen resolution and the screen size to obtain an interactive interface matched with the screen size data of thecontrol terminal 202, and then the interactive interface matched with the screen size data of thecontrol terminal 202 is displayed. Further, the user may resize each displayed interactive interface. It can be understood that the control terminal that establishes the connection with the controlledterminal 204 before the control terminal a obtains the interactive interface sent by the controlledterminal 204 in the same manner. Similarly, several representations of the interactive interface have been described in detail in the foregoing embodiments, and are not described in detail herein.
Step S500, responding to the touch operation of the user on the interactive interface to obtain touch operation data.
The touch operation is an operation of controlling an operation interface by a user through touch or stylus writing on an interactive interface of thecontrol terminal 202. In specific implementation, a user may click a software icon on an interactive interface of thecontrol terminal 202 through a finger or a stylus to open the software, click each control in the software after the software is opened, or perform a touch operation in an operation interface after the software is opened, where the touch operation may include clicking, long-pressing, sliding, zooming, multi-point touch, and the like. Thecontrol terminal 202 receives the touch operation of the user, and records the touch operation time, the touch point coordinates, the touch duration, the touch pressure information, and the like of the user to obtain touch operation data. For example, if the smart tablet is thecontrol terminal 202, the tablet is the controlledterminal 204. The first interactive interface resolution of the tablet computer is 2048 × 1536 pixels, the second interactive interface resolution of the smart hand board 302 is 1024 × 768 pixels, when a user needs to start the WeChat, the WeChat icon is clicked at the second interactive interface coordinate (500,200), touch operation data are converted into click operation at the first interactive interface coordinate (1000,400) according to the proportion of the first interactive interface to the second interactive interface, then the touch operation data are sent to the tablet computer through a network, and the tablet computer performs touch response at the first interactive interface (1000,400).
Step S700, sending the touch operation data to the controlled terminal.
After obtaining the touch operation data carrying the touch operation time, eachcontrol terminal 202 may send the touch operation data to the controlledterminal 204 in real time, so that the controlledterminal 204 performs time-sharing control according to the touch operation time and sequentially responds to the touch operation data.
And S900, acquiring a touch response interface of the controlled terminal, and displaying the touch response interface, wherein the touch response interface is generated by the controlled terminal according to the identified priority of each touch operation data.
The touch response interface may be an interface generated by the controlledterminal 204 by the controlled terminal in response to each touch operation data according to the identified priority of each touch operation data. Specifically, the priority may be determined according to the operation application, the operator, the operation time period, and the like. In another embodiment, the touch response interface of the controlledterminal 204 may be a final touch response interface obtained after all touch operation data are responded, or may be a plurality of touch response interfaces obtained by responding touch operation data each time and sent in real time. In a specific implementation, the touch response interface may be obtained by capturing a touch response interface image of the controlledterminal 204, and using the touch response interface image as the first touch response interface, or by reading information such as resolution, color, and text of the touch response interface of the controlledterminal 204, and obtaining the first touch response interface according to the information. For example, for the controlledterminal 204, a screen capture operation may be performed on the entire touch response interface thereof, and the screen capture result is taken as the first touch response interface. Or, the touch response interface information of the controlledterminal 204, including the resolution of 2048 × 1536 pixels, the text content and the position displayed by the touch response, the color and the position of the image displayed by the touch response, and the like, is read, and the first touch response interface is obtained according to the touch response interface information. After the first touch response interface is obtained, the first touch response interface may be scaled in an equal proportion according to the resolution of the interface of thecontrol terminal 202 to obtain a second touch response interface. For example, when the resolutions of the interface of thecontrol terminal 202 and the first touch response interface are not in equal proportion, the first touch response interface may be scaled in equal proportion, then operations such as interception or filling are performed according to the scaling result to obtain a second touch response interface, and then the second touch response interface is displayed; if the resolutions are in equal proportion, the first touch response interface can be directly zoomed into an interface matched with the size of the screen to obtain a second touch response interface, and then the second touch response interface is displayed in the corresponding split screen area. Referring to fig. 5, an application scenario in which a plurality of control terminals operate a controlled terminal may further include that a user may adjust the size of each touch response interface.
In the terminal control method based on priority control, the plurality of control terminals acquire the interactive interface fed back by the controlled terminal by sending the control request to the controlled terminal, display the interactive interface, further send the touch operation data to the controlled terminal by responding to the touch operation of the user on the interactive interface, acquire the priority of each identified touch operation data by the controlled terminal, and respond to the touch response interface generated by each touch operation data. According to the scheme, the controlled terminal does not need to be carried, the portability is improved, a user can operate the interactive interfaces of the control terminals, many-to-one remote control over the controlled terminal is achieved, the controlled terminal can respond orderly according to the priority, operation conflicts are reduced, and the control efficiency is improved.
In an embodiment, as shown in fig. 4, before obtaining the interactive interface fed back by the controlled terminal according to the identity authentication information, the method further includes: and step S050, sending a connection request to the controlled terminal, wherein the connection request carries identity information, receiving a connection permission message fed back by the controlled terminal according to the identity information, and establishing connection with the controlled terminal.
In specific implementation, the process of establishing the connection between thecontrol terminal 202 and the controlledterminal 204 may be: thecontrol terminal 202 can select a specific controlled terminal that needs to be connected, for example, a smart device such as a mobile phone, a computer, and a smart band. The intelligent device may be an intelligent device in a history that thecontrol terminal 202 has been connected or remotely controlled before, or may be a new terminal device.
In practical applications, thecontrol terminal 202 may be powered on to enter a display interface, a user opens a history connection device record, and selects a specific controlled terminal to be connected to connect, or searches a currently connectable controlled terminal, and then selects a specific controlled terminal to be connected to connect through touch operation, at this time, thecontrol terminal 202 responds to the touch operation of the user, sends an operation request carrying identity information thereof to the selected controlled terminal 204, the controlledterminal 204 receives the request, reads the identity information in the request, performs identity authentication or pairing authentication based on the identity information, and if the authentication is passed, sends a connection permission message to thecontrol terminal 202 to establish connection with thecontrol terminal 202. Specifically, the verification method includes, but is not limited to, character string password verification, fingerprint verification, face verification, iris verification, or the like.
Further, the controlledterminal 204 may also set the control authority of thecontrol terminal 202, and for some operations related to privacy sensitivity or importance, thecontrol terminal 202 needs to be authenticated again, or different access authorities are needed to be accessible. Specifically, the connection with the controlled terminal can be established through 3G, 4G, 5G, 2.4G, Wi-Fi, Bluetooth or a custom wireless protocol. In a specific implementation, the communication distance between thecontrol terminal 202 and the controlledterminal 204 is within a Wi-Fi or bluetooth communication range, and the two realize data transmission through Wi-Fi, bluetooth or a custom wireless protocol. Due to the fact that a general platform such as Wi-Fi or Bluetooth is used or a user-defined wireless protocol is used, a completely open operating environment can be kept, any controlled terminal is allowed to develop application software at any time, and increasingly complex and diversified functional requirements of communication products can be met. In this embodiment, the connection is allowed to be established only after the controlled terminal is authenticated, so that the standardization and the security of the remote operation can be ensured.
In an embodiment, as shown in fig. 4, acquiring an interactive interface fed back by the controlled terminal according to the identity authentication information, and displaying the interactive interface includes: step S320, acquiring a plurality of interactive interfaces of the controlled terminal, and performing split-screen display on each interactive interface, where the interactive interfaces are interfaces that are independently controlled by each control terminal currently.
The split-screen display processing means that a split-screen technology is adopted to divide a screen of the control terminal into a plurality of split-screen areas, and then the acquired interactive interface of the controlled terminal is displayed in the corresponding split-screen area, so that the control interface of each control terminal can be comprehensively viewed through the screen of the control terminal. In this embodiment, the control terminal currently used by the user may be a control terminal with a higher operation authority, and the control terminal can view or operate the control interfaces of other control terminals. Further, the control terminal with higher operation authority may also select one or more interactive interfaces sent by the controlledterminal 202 to perform a sharing operation or an interactive interface for viewing. In addition, the control interfaces of thecontrol terminal 202 to the controlledterminal 204 except the terminal itself are all interfaces that are controlled independently, for example, the control terminal a controls the running window interface (interactive interface a) of the WeChat application running in the background of the controlledterminal 204, and the control terminal B controls the running window interface (interactive interface B) of the QQ application running in the background of the controlledterminal 204.
In specific implementation, the split-screen display processing may be to obtain a screenshot of a plurality of operation interfaces that the controlledterminal 204 is being independently controlled by theother control terminals 202, use the screenshot as an interactive interface (regarded as a first interactive interface), then obtain data such as screen UI data, screen size, resolution, and the like of the interactive interface captured by the controlled terminal, perform scaling or rendering on the interactive interface in an equal proportion based on the data and the screen resolution thereof to obtain a second interactive interface, and then display the second interactive interface in a corresponding split-screen area. Specifically, fig. 5 is a schematic diagram of the split-screen display. More specifically, when the resolution of thecontrol terminal 202 is not equal to the resolution of the first interactive interface, the first interactive interface may be scaled in an equal proportion, and then operations such as interception or filling are performed according to the scaling result to obtain a second interactive interface, so as to display the second interactive interface; if the resolution ratio is in equal proportion, the first interactive interface can be directly zoomed into an interface matched with the size of the split screen area to obtain a second interactive interface; if the resolutions are just matched, the first interactive interface can be directly used as a second interactive interface, and then the second interactive interface is displayed in the corresponding split screen area. For example, the resolution of the first interactive interface is 2048 × 1536 pixels, and if the resolution of thecontrol terminal 202 is 1024 × 768 pixels, the first interactive interface can be scaled down to 50% of the original value to obtain a second interactive interface; if the interface resolution of thecontrol terminal 202 is 1024 × 800 pixels, the first interactive interface may be reduced to 50% of the original interface in equal proportion, and then displayed in the center of the interface of thecontrol terminal 202, and then black is filled in the blank portion, so as to obtain the second interactive interface. Further, in order to facilitate the user to visually check which controlled terminal corresponds to the second interactive interface displayed on which split screen area, the identity of the controlled terminal may be displayed on the split screen area, for example, a word such as "interface that you are operating XXX (identity information)" may be displayed. In another embodiment, the interactive interfaces may be displayed in a split-screen manner, or in a sliding manner, and each interactive interface may be switched by a sliding operation.
In one embodiment, the split-screen display processing of each interactive interface includes: the method comprises the steps of obtaining the number of interactive interfaces and the identification information of each control terminal, determining the number of split screen areas according to the number of the interactive interfaces, dividing a screen into split screen areas corresponding to the number of the split screen areas, and displaying each interactive interface in each split screen area according to the identification information of the control terminal.
In practical application, to ensure the accuracy of split-screen display, the split-screen display processing on the interactive interface may be: counting the number of interactive interfaces (interactive interfaces correspond to each Control terminal) sent by the controlledterminal 204 or the number of Control terminals operating the controlled terminal except for the controlled terminal, acquiring identification information (including device numbers, Media Access Control (MAC) addresses and other information capable of uniquely identifying the controlled terminal) of the Control terminals except for the controlled terminal, then determining the number of split screen areas according to the number of interactive interfaces or the number of other controlledterminals 204 operating the controlled terminal, dividing the screen into split screen areas corresponding to the number of split screen areas, and if the number of received interactive interfaces or the number of Control terminals operating the controlled terminal is 2,3 or 4, correspondingly dividing the screen into 1 × 2, 1 × 3 and 2 × 2. And after the screen splitting is finished, displaying each interactive interface in the corresponding split screen area according to the identity identification information of the control terminal. Specifically, the corresponding relationship between the identity identifier and the split screen area may be preset, for example, the split screen area 1 (for example, coordinates (0,0) -coordinates (512,384) are the split screen area 1) corresponds to the control terminal a, the split screen area 2 corresponds to the control terminal B, the distribution display of each interactive interface is completed according to the relationship and the identity identifier information carried by each interactive interface, or the split screen display may be performed in sequence according to the sequence of receiving the interactive interfaces, so as to obtain the corresponding relationship between the split screen area and the controlled terminal (that is, the corresponding relationship between the control terminal and the coordinate range). After the corresponding relationship between the split screen area and thecontrol terminal 202 is obtained, the corresponding relationship between the split screen area and thecontrol terminal 202 can be sent to other control terminals, so that the other control terminals can determine which coordinate range interval the split screen area specifically corresponds to.
In addition, a user may touch a plurality of split screen areas during one touch operation in the touch operation process, for example, if a large sliding operation is performed and the action position of the user involves a plurality of split screens, the user may perform the following two methods: firstly, a control terminal can preset that one touch operation can only control one split screen at the same time, when multiple screen operations exist, the split screen which is acted by the touch action at the earliest time can be selected, the split screen is taken as the operated split screen, and other split screens are not processed; if the second control terminal is not limited, all related split screens can be used as action objects of touch operation, and processing can be performed according to touch time. In this embodiment, the split-screen display of the interactive interface is completed through the number of other control terminals or interactive interfaces and the identification information of other control terminals, and the split-screen display can be flexibly and accurately performed according to different situations.
In one embodiment, the obtaining of the interactive interface fed back by the controlled terminal according to the identity authentication information includes: and acquiring program operation window data fed back by the controlled terminal according to the identity authentication information, processing the program operation window data to obtain a plurality of interactive interface configuration data, and configuring corresponding interactive interfaces according to the interactive interface configuration data.
In a specific implementation, the acquisition of the interactive interface may be to acquire screenshot data of a currently displayed interface sent by the controlledterminal 204 after the identity authentication is completed, or may also be to acquire current program running window data of the controlledterminal 204 or program running window data being controlled by another control terminal, where the program running window data includes page information of an operation interface of an application currently displayed by the controlledterminal 204 or running in the background, including various attribute information and configuration data of the page, screen UI data, screen size, resolution, and the like of the page, to thecontrol terminal 202. Then, thecontrol terminal 202 may perform processing such as scaling, capturing, or filling on the program operating window data according to the size of the split screen area or the screen size to obtain the interactive interface configuration data, configure a corresponding interactive interface according to the interactive interface configuration data, and further display the interactive interface. In this embodiment, the interactive interface of the controlledterminal 204 may be page configuration data other than the screen capture data, and the corresponding interactive interface of the controlledterminal 204 can be accurately configured and displayed.
In one embodiment, acquiring a touch response interface of a controlled terminal includes: and acquiring touch response window data displayed after the corresponding controlled terminal responds to the touch operation data, processing the touch response window data to obtain touch response interface configuration data, and configuring a touch response interface according to the touch response interface configuration data.
After the controlled terminal 204 sequentially performs touch response on the touch operation data according to the priority of the touch operation, a touch response interface may be correspondingly generated and sent to eachcontrol terminal 202, specifically, screenshot data of the touch response interface may be sent, or touch response window data, that is, page information of the operation interface displayed after the controlledterminal 204 performs touch response, including various attribute information and configuration data of the page, screen UI data, screen size, resolution, and the like, may be sent to thecontrol terminal 202. Then, thecontrol terminal 202 may perform processing such as scaling, capturing, or filling on the touch response window data according to the size of the split screen area or the screen size to obtain touch response interface configuration data, configure a corresponding touch response interface according to the touch response interface configuration data, and further display the touch response interface. In this embodiment, the touch response interface of the controlledterminal 204 may be page configuration data other than the screen capture data, and the touch response interface of the controlledterminal 204 can be accurately configured and displayed.
In one embodiment, the displayed interactive interface and the displayed touch response interface are matched with the resolution of the control terminal or the size of the corresponding split screen area.
The interactive interface and the response interface displayed by thecontrol terminal 202 may be rendered interfaces, and the interfaces are matched with the screen size (resolution) of thecontrol terminal 202 or the size of the split screen area. Taking the split screen area as an example, in specific implementation, each split screen area (split screen interface) correspondingly displays an interactive interface and a touch response interface of the controlledterminal 204. For example, there are 3 controlled terminals connected to thecontrol terminal 202, which are respectively a controlled terminal a, a controlled terminal B, and a controlled terminal C, and the control terminal also has 3 split screen interfaces, which are respectively a split screen a, a split screen B, and a split screen B, where the interactive interface a displayed on the split screen a is an interface obtained by rendering the initial interactive interface of the controlled terminal a, and the interface is matched with the size of the split screen area, the interactive interface B displayed on the split screen B is an interface obtained by rendering the initial interactive interface of the controlled terminal B, and the interface is matched with the size of the split screen area, and the interactive interface C displayed on the split screen C is an interface obtained by rendering the initial interactive interface of the controlled terminal C, and the interface is matched with the size of the split screen area. Specifically, the rendered action may be performed by the controlled terminal or the control terminal. In the embodiment, the interface is rendered into the interface matched with the size of the split screen area, so that the interface data can be more reasonably displayed, and the use feeling of a user is improved.
In one embodiment, further comprising: the control center is connected with the controlled terminal and used for forwarding the data transmitted by the control terminal to the controlled terminal and forwarding the data transmitted by the controlled terminal to the control terminal, so that the communication between the control terminal and the controlled terminal is realized.
As shown in fig. 6, in the terminal control method based on priority control provided in the present application, the controlledterminal 204 and the plurality ofcontrol terminals 202 may also be in communication mode through thecontrol center 206, that is, thecontrol center 206 is used for data forwarding between the control terminal and the controlled terminal, thecontrol center 206 may be a server, a cloud (cloud computing server), a computer host, and the like, there may be a plurality ofcontrol centers 206, eachcontrol center 206 operates independently, the control centers 206 and thecontrol center 206 may be independent of each other or connected to each other, and eachcontrol center 206 may also be implemented by an independent server or a server cluster composed of a plurality of servers, and the like.
In a specific implementation, the controlledterminal 204 may be connected to thecontrol center 206 in advance, the controlledterminal 204 may backup the data in thecontrol center 206 in advance and set the data to be in an accessible state, or the controlledterminal 204 may be in a controllable state through a preinstalled remote operation application/operating system. Thecontrol terminal 202 may send its own identity code to thecontrol center 206, and thecontrol center 206 establishes a connection with thecontrol terminal 202 after receiving and completing the verification of the identity code. Thecontrol terminal 202 obtains one or more interactive interfaces sent by the controlledterminal 202 through thecontrol center 206, and then performs display or split screen display processing on the corresponding interactive interfaces. The user performs touch operation on the displayed interactive interface, software such as a browser portal and the like for receiving the touch operation of the user is preset in thecontrol terminal 202, thecontrol terminal 202 receives the touch operation of the user on the specific interactive interface, records information such as user touch operation time, touch coordinates, touch duration, touch pressure and the like, obtains touch operation data, and forwards the touch operation data to the controlledterminal 204 through thecontrol center 206. The controlledterminal 202 receives the touch operation data, identifies the priority of each touch operation data, generates a touch response interface after performing touch response according to the priority, and sends the touch response interface to thecontrol terminal 202 through thecontrol center 206. In the embodiment, the control center establishes connection with the controlled terminal, so that the data storage space can be reduced, and remote control can be performed on the basis of data backed up by the controlled terminal in the control center.
Fig. 7 is a schematic software architecture diagram of a terminal control method based on priority control according to an embodiment, which includes anintelligent panel 702, acloud computing server 704 and atablet computer 706, where theintelligent panel 702 is a control terminal, thecloud computing server 704 is a control center, and thetablet computer 706 is a controlled terminal. Thecloud computing server 704 includes, among other things,message middleware 708, front-end services 710, back-end services 712, and adatabase 714.
Referring to fig. 7, software for running data such as a neighborhood screen UI and touch events on thetablet pc 706 carries private Protocol data through a TCP (Transmission Control Protocol)/IP (internet Protocol Address) via a 4G/5G network, and establishes a connection with thecloud computing server 704. In thecloud computing server 704, themessage middleware 708 efficiently distributes data, and the back-end service 712 and the front-end service 710 perform bidirectional communication through a Websocket protocol. Specifically, when the cloud computing server 704 performs information transmission with the smart tablet 702 and the tablet 706, specifically, the cloud computing server 704 communicates with the tablet 706 through a TCP/IP protocol by using the message middleware 708, receives an operation interface (including an interactive interface and a touch response interface) sent by the tablet 706, the message middleware 708 transmits the operation interface to the back-end service 712 through the TCP/IP protocol, the back-end service 712 transmits the operation interface to the front-end service 710 through the Websocket protocol, the front-end service 710 performs rendering processing on the operation interface according to the resolution, the size of the operation interface, and the like of the smart tablet 702, so that the rendered image is adapted to the smart tablet 702, the smart tablet 702 actively obtains the rendered image from the front-end service 710 through the HTTP protocol, and the cloud computing server 704 receives, which is obtained by performing touch operation on an interface displayed by the tablet by a user and is sent by the smart tablet 702 through the HTTP or Restful interface, and includes touch time, and touch time, The backend service 712 encapsulates the touch operation data, such as the touch coordinate, the touch pressure, and the touch duration, with a TCP/IP protocol-based private protocol through the message middleware 708, and forwards the encapsulated touch operation data to the tablet pc 706. Then, thebackend service 712 sends the received touch response interface sent by thetablet computer 706 to thesmart tablet 702 through themessage middleware 708.
It should be understood that although the various steps in the flowcharts of fig. 2-4 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-4 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps or stages.
In one embodiment, as shown in fig. 8, there is provided a terminal including:communication module 510,touch display module 520 andprocessor 530, wherein:
thecommunication module 510 is connected with a controlled terminal, theprocessor 530 acquires an interactive interface of the controlled terminal and sends the interactive interface to thetouch display module 520, thetouch display module 520 receives and displays the interactive interface, the touch operation of a user on the interactive interface is responded, touch operation data is obtained and sent to theprocessor 530, theprocessor 530 acquires and sends the touch operation data to the controlled terminal, a touch response interface of the controlled terminal is acquired and sent to thetouch display module 520, and thetouch display module 520 receives and displays the touch response interface, wherein the touch response interface is generated by the controlled terminal according to the priority of each identified touch operation data.
In another embodiment, as shown in fig. 9, thecommunication module 510 includes awireless communication interface 1616, and thetouch display module 520 may be atouch display screen 1602. Specifically, referring to fig. 11, thewireless communication interface 1616 may be a 3G/4G/5G network or Wi-Fi antenna interface, thetouch display screen 1602 may be an OLED (Organic Light-Emitting Diode) and glass (or sapphire) cover plate, and the processor may be equipped with a high-pass APQ8053 on a PCBA (Printed Circuit Board Assembly). In addition, the terminal includes apartition 1604, a battery 1608 (capacity 1000mAh, 1.0mm), a USB interface 1610(Type C), astainless steel bezel 1612 and aback cover 1614, theback cover 1614 can be an OLED and glass (or sapphire) cover. Because components such as a microphone, a camera and the like are not designed, the conversation function can be realized through the Bluetooth headset, and the shooting can be realized through the wristwatch.
More specifically, the thickness of the terminal may be 4mm, the former period may use Wi-Fi and BT (Bit Torrent) communication interfaces for interaction, and the later period may use an autonomous protocol for interaction. 5-6 inch screen can be adopted for various extension (such as biological detection) hand board terminals of network mobile phones, network video screen terminals, game terminals and intelligent watches; for intelligent home terminals such as a home management board, a reading board, a game board, a WeChat board, a social contact board, an operation board and the like, a 7-14 inch screen can be adopted; for intelligent teaching, meeting, aviation and high-speed rail terminals such as a teaching board, a textbook board, a test board, a meeting board, an aviation board, a high-speed iron board, a one-way confidential information board and the like, a 7-14 inch screen can also be adopted; for intelligent surface terminals such as office table boards, projection display boards, food ordering boards, bus station boards, household appliance boards, intelligent furniture boards, bar interactive boards, outdoor natural scene interactive boards, movie and television interactive boards, concert sports focusing boards and the like, 5-105 inches screens can be adopted.
The terminal can ensure good realization of touch and display functions, realizes functions of data processing, data storage and the like through the controlled terminal and/or the control center, and functionally separates touch and display from other functions. Because the functions of data processing, data storage and the like do not need to be realized, compared with the traditional terminal, the terminal can realize various complex functions by light weight, small volume and thin thickness, and the problems of large weight and volume and poor portability of the terminal in the traditional communication system are solved.
Furthermore, because the terminal uses an open communication platform, the terminal can directly communicate through the open platforms such as a wireless communication network or a cloud without depending on any mobile phone brand and obtaining permission of an operator, and the complex problem caused by the existing terminal brand and operator configuration threshold is avoided.
In one embodiment, as shown in fig. 10, there is provided a terminal control apparatus based on priority control, including: a manipulationrequest sending module 610, a firstinterface display module 620, a touchoperation response module 630, a touch operationdata sending module 640, and a secondinterface display module 650, wherein:
the controlrequest sending module 610 is configured to send a control request to the controlled terminal, where the control request carries identity authentication information;
the firstinterface display module 620 is configured to obtain an interactive interface fed back by the controlled terminal according to the identity authentication information, and display the interactive interface;
a touchoperation response module 630, configured to respond to a touch operation performed on the interactive interface by a user, and obtain touch operation data;
a touch operationdata sending module 640, configured to send touch operation data to a controlled terminal;
the secondinterface display module 650 is configured to obtain a touch response interface of the controlled terminal, and display the touch response interface, where the touch response interface is generated by the controlled terminal in response to each touch operation data according to the identified priority of each touch operation data.
In an embodiment, the firstinterface display module 610 is further configured to obtain a plurality of interactive interfaces of the controlled terminal, and perform split-screen display on each interactive interface, where the interactive interfaces are interfaces of the controlled terminal that are currently controlled by each control terminal independently.
In an embodiment, as shown in fig. 11, the apparatus further includes adata connection module 660, configured to send a connection request to the controlled terminal, where the control request carries identity information, and receive a connection permission message fed back by the controlled terminal according to the identity information, to establish a connection with the controlled terminal.
In an embodiment, as shown in fig. 11, the apparatus further includes aninterface configuration module 670, configured to obtain program execution window data fed back by the controlled terminal according to the identity authentication information, process the program execution window data to obtain multiple interaction interface configuration data, and configure a corresponding interaction interface according to each interaction interface configuration data.
In an embodiment, theinterface configuration module 670 is further configured to obtain touch response window data displayed after the corresponding controlled terminal responds to the touch operation data, process the touch response window data to obtain touch response interface configuration data, and configure the touch response interface according to the touch response interface configuration data.
In an embodiment, thedata connection module 660 is further configured to establish a connection with the controlled terminal through a control center, where the control center is configured to forward data transmitted by the control terminal to the controlled terminal and forward data transmitted by the controlled terminal to the control terminal, so as to implement communication between the control terminal and the controlled terminal.
For the specific definition of the terminal control device based on priority control, see the above definition of the terminal control method based on priority control, which is not described herein again. The respective modules in the priority control-based terminal control apparatus described above may be implemented in whole or in part by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, as shown in fig. 12, there is provided a terminal control apparatus based on priority control, including: a controlrequest obtaining module 710, adata sending module 720, adata receiving module 730, and adata responding module 740, wherein:
the controlrequest obtaining module 710 is configured to obtain a control request of the control terminal, where the control request carries identity authentication information of the control terminal;
thedata sending module 720 is configured to establish connection with each control terminal and send an interactive interface to the control terminal when the identity authentication of the control terminal is completed according to the identity authentication information, where the interactive interface is an interface currently controlled by at least two control terminals;
thedata receiving module 730 is configured to receive touch operation data, which is sent by each control terminal and is used by a user for each interactive interface;
thedata response module 740 is configured to identify the priority of each touch operation data, respond to each touch operation data according to the priority, and generate and send a corresponding touch response interface to each control terminal.
In one embodiment, thedata sending module 720 is further configured to send operator information to each control terminal, where the operator information includes a data sender generating touch operation data of a corresponding touch response interface.
In one embodiment, thedata response module 740 is further configured to perform a weighted summation based on the operator identity information, the operation application, and the operation type to determine a priority of each touch operation data.
In one embodiment, thedata response module 740 is further configured to lock the unique operation right of the control terminal to the interactive interface in the current time period when receiving touch operation data, sent by any control terminal, of the user for the interactive interface.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 12. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a method of controlling a terminal based on priority control. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 12 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, which includes a memory and a processor, the memory stores a computer program, and the processor implements the steps of the above-mentioned priority control-based terminal control method when executing the computer program.
In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps in the priority control-based terminal control method described above.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (16)

the communication module is connected with a controlled terminal, the processor acquires an interactive interface of the controlled terminal, sends the interactive interface to the touch display module, the touch display module receives and displays the interactive interface, responds to touch operation of a user on the interactive interface, obtains touch operation data, sends the touch operation data to the processor, the processor acquires and sends the touch operation data to the controlled terminal, acquires a touch response interface of the controlled terminal, and sends the touch response interface to the touch display module, and the touch display module receives and displays the touch response interface, wherein the touch response interface is generated by the controlled terminal according to the priority of each identified touch operation data.
CN202010070580.7A2020-01-212020-01-21Terminal control method and device based on priority control and terminalActiveCN111290695B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202010070580.7ACN111290695B (en)2020-01-212020-01-21Terminal control method and device based on priority control and terminal

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202010070580.7ACN111290695B (en)2020-01-212020-01-21Terminal control method and device based on priority control and terminal

Publications (2)

Publication NumberPublication Date
CN111290695Atrue CN111290695A (en)2020-06-16
CN111290695B CN111290695B (en)2021-12-14

Family

ID=71030089

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202010070580.7AActiveCN111290695B (en)2020-01-212020-01-21Terminal control method and device based on priority control and terminal

Country Status (1)

CountryLink
CN (1)CN111290695B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN111880845A (en)*2020-07-242020-11-03西安万像电子科技有限公司Method, system and device for controlling target application
CN112728772A (en)*2020-12-312021-04-30广东万和热能科技有限公司Control method of water heater
CN113535059A (en)*2021-07-052021-10-22深圳康佳电子科技有限公司 A display terminal control method, device, intelligent terminal and storage medium
CN113923633A (en)*2021-09-292022-01-11湖北亿咖通科技有限公司Intelligent cabin control method, system and equipment integrating mobile terminal
CN114006893A (en)*2021-10-292022-02-01平安银行股份有限公司Multi-terminal remote control method, device, equipment and storage medium
CN114186046A (en)*2021-12-142022-03-15平安壹钱包电子商务有限公司 Information processing method, device, server and storage medium
CN114244642A (en)*2021-12-102022-03-25珠海格力电器股份有限公司Control method and device of equipment, computer readable storage medium and processor
CN115202779A (en)*2022-06-102022-10-18网易(杭州)网络有限公司Remote control method and related equipment
CN116389635A (en)*2023-03-202023-07-04深圳市正浩创新科技股份有限公司Control method, computer-readable storage medium, and terminal
CN117270726A (en)*2023-11-202023-12-22荣耀终端有限公司Information interaction method, host and terminal equipment
WO2025138552A1 (en)*2023-12-282025-07-03江苏纳美达光电科技有限公司Human-computer interaction system and method with bidirectional communication

Citations (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101489092A (en)*2009-02-202009-07-22深圳华为通信技术有限公司Meeting control method, meeting control device and meeting system
US20110234366A1 (en)*2008-12-042011-09-29Koninklijke Philips Electronics N.V.Methods for selecting and controlling devices
CN104181902A (en)*2014-09-102014-12-03杨坤华Smart home and socialized service control system
CN104980926A (en)*2015-06-052015-10-14小米科技有限责任公司Remote control method and device for mobile terminal
CN105554537A (en)*2015-12-082016-05-04青岛海信电器股份有限公司Control method and control device
US20160344569A1 (en)*2015-05-202016-11-24Samsung Electronics Co., Ltd.Method for controlling an external device and an electronic device therefor
US20170039139A1 (en)*2014-09-262017-02-09Intel CorporationHardware apparatuses and methods to control access to a multiple bank data cache
CN107248943A (en)*2017-07-062017-10-13海信集团有限公司Apparatus control method and device
CN107707436A (en)*2017-09-182018-02-16广东美的制冷设备有限公司Terminal control method, device and computer-readable recording medium
US20180356946A1 (en)*2017-06-122018-12-13Shih Ning CHOUScene-mode switching system and state conflict displaying method
US20190240578A1 (en)*2014-12-222019-08-08Nexon Korea CorporationApparatus and method for controlling object
CN110349396A (en)*2019-07-292019-10-18维达力实业(深圳)有限公司Intelligent interactive system, interactive terminal and control platform
CN110488619A (en)*2019-07-292019-11-22维达力实业(深圳)有限公司The information interaction system of household appliance and control method, the device of household appliance

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20110234366A1 (en)*2008-12-042011-09-29Koninklijke Philips Electronics N.V.Methods for selecting and controlling devices
CN101489092A (en)*2009-02-202009-07-22深圳华为通信技术有限公司Meeting control method, meeting control device and meeting system
CN104181902A (en)*2014-09-102014-12-03杨坤华Smart home and socialized service control system
US20170039139A1 (en)*2014-09-262017-02-09Intel CorporationHardware apparatuses and methods to control access to a multiple bank data cache
US20190240578A1 (en)*2014-12-222019-08-08Nexon Korea CorporationApparatus and method for controlling object
US20160344569A1 (en)*2015-05-202016-11-24Samsung Electronics Co., Ltd.Method for controlling an external device and an electronic device therefor
CN104980926A (en)*2015-06-052015-10-14小米科技有限责任公司Remote control method and device for mobile terminal
CN105554537A (en)*2015-12-082016-05-04青岛海信电器股份有限公司Control method and control device
US20180356946A1 (en)*2017-06-122018-12-13Shih Ning CHOUScene-mode switching system and state conflict displaying method
CN107248943A (en)*2017-07-062017-10-13海信集团有限公司Apparatus control method and device
CN107707436A (en)*2017-09-182018-02-16广东美的制冷设备有限公司Terminal control method, device and computer-readable recording medium
CN110349396A (en)*2019-07-292019-10-18维达力实业(深圳)有限公司Intelligent interactive system, interactive terminal and control platform
CN110488619A (en)*2019-07-292019-11-22维达力实业(深圳)有限公司The information interaction system of household appliance and control method, the device of household appliance

Cited By (15)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN111880845A (en)*2020-07-242020-11-03西安万像电子科技有限公司Method, system and device for controlling target application
CN112728772A (en)*2020-12-312021-04-30广东万和热能科技有限公司Control method of water heater
CN112728772B (en)*2020-12-312022-06-14广东万和热能科技有限公司Control method of water heater
CN113535059A (en)*2021-07-052021-10-22深圳康佳电子科技有限公司 A display terminal control method, device, intelligent terminal and storage medium
CN113923633A (en)*2021-09-292022-01-11湖北亿咖通科技有限公司Intelligent cabin control method, system and equipment integrating mobile terminal
CN113923633B (en)*2021-09-292024-05-24亿咖通(湖北)技术有限公司Intelligent cabin control method, system and equipment integrating mobile terminal
CN114006893B (en)*2021-10-292024-02-09平安银行股份有限公司Multi-terminal remote control method, device, equipment and storage medium
CN114006893A (en)*2021-10-292022-02-01平安银行股份有限公司Multi-terminal remote control method, device, equipment and storage medium
CN114244642A (en)*2021-12-102022-03-25珠海格力电器股份有限公司Control method and device of equipment, computer readable storage medium and processor
CN114186046A (en)*2021-12-142022-03-15平安壹钱包电子商务有限公司 Information processing method, device, server and storage medium
CN115202779A (en)*2022-06-102022-10-18网易(杭州)网络有限公司Remote control method and related equipment
CN116389635A (en)*2023-03-202023-07-04深圳市正浩创新科技股份有限公司Control method, computer-readable storage medium, and terminal
CN117270726A (en)*2023-11-202023-12-22荣耀终端有限公司Information interaction method, host and terminal equipment
CN117270726B (en)*2023-11-202024-04-19荣耀终端有限公司 Information interaction method, host and terminal device
WO2025138552A1 (en)*2023-12-282025-07-03江苏纳美达光电科技有限公司Human-computer interaction system and method with bidirectional communication

Also Published As

Publication numberPublication date
CN111290695B (en)2021-12-14

Similar Documents

PublicationPublication DateTitle
CN111290695B (en)Terminal control method and device based on priority control and terminal
US12328527B2 (en)Image management system, image management method, and computer program product
CN111314441B (en) Terminal control method, device and terminal based on multi-area control
CN111309226B (en)Terminal control method and device based on communication quality, terminal and computer equipment
US11947998B2 (en)Display method and device
CN111324248A (en)Terminal control method, terminal control device, terminal, computer equipment and storage medium
CN111273850B (en)Terminal control method and device, computer equipment and storage medium
TWI673679B (en)Method,apparatus and computer-readable storage media for user interface
US20140181683A1 (en)Method and system for controlling external device
US20160269973A1 (en)Communication system, transmission terminal, communication method, and medium
CN113792277A (en)Method and device for displaying application and picture and electronic equipment
TW201303752A (en)Method and system for application program execution based on augmented reality and cloud computing
CN109388620A (en)A kind of method and the first electronic equipment of striding equipment access data
CN109639569B (en)Social communication method and terminal
US20150249696A1 (en)Transmission terminal, transmission system, transmission method, and recording medium storing transmission control program
CN114265641A (en) Control method, electronic device, and computer-readable storage medium
WO2019184631A1 (en)Information processing method and apparatus, computer-readable storage medium, and terminal
US20240020369A1 (en)Speech control system and method, apparatus, device, medium, and program product
CN111314442B (en)Terminal control method and device based on time-sharing control, terminal and computer equipment
WO2015131813A1 (en)Method and system for operating device
CN116017086A (en)Interactive processing method and device, electronic equipment and storage medium
CN111263004B (en)Terminal control method and device, computer equipment and storage medium
US20220035958A1 (en)Communication terminal, system, control method, and recording medium
US20150249695A1 (en)Transmission terminal, transmission system, transmission method, and recording medium storing transmission control program
CN105335088A (en)File sharing method and device

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp