技术领域technical field
本发明涉及通信技术领域,更具体地,涉及一种控制移动终端的方法、一种控制移动终端的装置,以及一种移动终端。The present invention relates to the technical field of communications, and more specifically, to a method for controlling a mobile terminal, a device for controlling a mobile terminal, and a mobile terminal.
背景技术Background technique
随着移动通信技术的发展,诸如手机等移动终端越来越普及,给人们在的生活、学习、工作带来了极大的便利。这些移动终端随着技术更新,其实现的功能也越来越丰富,以为用户提供各种各样的服务,满足用户需求。With the development of mobile communication technology, mobile terminals such as mobile phones are becoming more and more popular, which brings great convenience to people's life, study and work. With technology updates, these mobile terminals have more and more functions implemented, so as to provide users with various services and meet user needs.
用户在使用移动终端的过程中,通常会遇到各种各样的问题,导致其不能获得移动终端所提供的服务。例如,若用户想通过移动终端观看某一视频,则需要移动终端安装有支持该视频的数据格式播放的应用程序。当移动终端没有安装该应用程序时,而用户又不会将该应用程序安装到移动终端中,导致其不能通过移动终端观看视频。目前,用户通常是通过其他人帮助,来解决遇到的问题。但是,当其他人与用户不是在同一地方时,就不能操作用户的移动终端,即不能帮助用户解决移动终端的问题。During the process of using the mobile terminal, the user usually encounters various problems, resulting in that he cannot obtain the services provided by the mobile terminal. For example, if a user wants to watch a certain video through a mobile terminal, the mobile terminal needs to be installed with an application program that supports the data format playback of the video. When the application program is not installed in the mobile terminal, and the user will not install the application program in the mobile terminal, the user cannot watch the video through the mobile terminal. At present, users usually solve the problems they encounter through the help of others. However, when other people are not in the same place as the user, they cannot operate the user's mobile terminal, that is, they cannot help the user solve the problem of the mobile terminal.
显然,移动终端在使用过程中,存在使用不方便的问题。Apparently, there is a problem of inconvenient use of the mobile terminal during use.
发明内容Contents of the invention
鉴于上述问题,本发明实施例提出了一种控制移动终端的方法,以远程协助用户解决移动终端的问题,从而解决移动终端使用不方便的问题。In view of the above problems, an embodiment of the present invention proposes a method for controlling a mobile terminal to remotely assist a user to solve a problem of the mobile terminal, thereby solving the problem of inconvenient use of the mobile terminal.
相应的,本发明实施例还提出了一种控制移动终端的装置和一种移动终端以保证上述方法的实施以及应用。Correspondingly, the embodiment of the present invention also proposes an apparatus for controlling a mobile terminal and a mobile terminal to ensure the implementation and application of the above method.
在第一方面,本发明实施例公开了一种控制移动终端的方法,包括:预先与主控终端建立控制连接;依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息;基于上述控制连接,将上述屏幕图像信息发送给主控终端;依据主控终端针对上述屏幕图像信息反馈的操作信息,确定操 作事件并执行。通过本实施例,移动终端作为被控终端,可以用于主控终端建立控制连接,从而使得其他用户可以通过主控终端控制被控终端,帮助使用被控终端的用户解决遇到的移动终端问题,即解决移动终端使用不方便的问题。In the first aspect, the embodiment of the present invention discloses a method for controlling a mobile terminal, including: establishing a control connection with the main control terminal in advance; taking a screenshot of the current display interface according to the system authority information to generate screen image information; based on the above control connection , sending the above-mentioned screen image information to the main control terminal; according to the operation information fed back by the main control terminal for the above-mentioned screen image information, determine and execute the operation event. Through this embodiment, the mobile terminal, as the controlled terminal, can be used to establish a control connection with the main control terminal, so that other users can control the controlled terminal through the main control terminal, and help the users using the controlled terminal to solve the mobile terminal problems encountered , which solves the problem of inconvenient use of mobile terminals.
结合第一方面,本发明在第一方面的第一种实现方式中,上述与主控终端建立控制连接,包括:依据被控终端对应第一标识信息登录页面;依据在页面接收到输入信息,确定第二标识信息;向第二标识信息对应的主控终端发送第一连接请求;当接收到上述主控终端针对第一连接请求反馈的第一连接响应时,建立上述控制连接。被控终端可以向主控终端发送第一连接请求,即可以主动邀请主控终端对其进行控制,即用户在使用过程中可以通过发送第一连接请求,请求其他用户控制其所使用的被控终端,以解决所遇到的移动终端问题。In combination with the first aspect, in the first implementation of the first aspect of the present invention, the establishment of the control connection with the controlling terminal includes: logging in to the page according to the first identification information corresponding to the controlled terminal; according to receiving input information on the page, Determine the second identification information; send a first connection request to the master terminal corresponding to the second identity information; and establish the control connection when receiving the first connection response fed back by the master control terminal for the first connection request. The controlled terminal can send the first connection request to the main control terminal, that is, it can actively invite the main control terminal to control it, that is, the user can request other users to control the controlled terminal they use by sending the first connection request during use. terminal to solve the mobile terminal problems encountered.
结合第一方面的第一种实现方式,本发明在第一方面的第二种实现方式中,上述依据被控终端对应第一标识信息登录页面,包括:当检测到第一登录模式选择命令时,检测本地是否存储有标识信息;在本地存储有标识信息时,检测上述标识信息是否与厂商信息关联;当上述标识信息不关联厂商信息,将上述标识信息作为第一标识信息;当本地没有存储标识信息,或者上述标识信息关联厂商信息时,通过服务器生成第一标识信息并保存;基于第一标识信息执行第一登录模式选择命令,以登录页面。具有可以快速登录页面的好处,从而提高建立控制连接的效率。In combination with the first implementation of the first aspect, in the second implementation of the first aspect of the present invention, the login page based on the first identification information corresponding to the controlled terminal includes: when the first login mode selection command is detected , to detect whether there is identification information stored locally; when there is identification information stored locally, detect whether the above identification information is associated with manufacturer information; when the above identification information is not associated with manufacturer information, use the above identification information as the first identification information; Identification information, or when the above identification information is associated with vendor information, the server generates and saves the first identification information; executes the first login mode selection command based on the first identification information to log in to the page. It has the advantage of being able to quickly log in to the page, thereby improving the efficiency of establishing a control connection.
结合第一方面的第二种实现方式,本发明在第一方面的第三种实现方式中,上述依据被控终端对应第一标识信息登录页面,包括:当检测到第二登录模式选择命令时,检测登录对应的厂商信息;当检测到厂商信息时,采用上述厂商信息进行账号登录;在账号登录后,检测本地是否存储有标识信息;当本地存储有标识信息时,检测上述标识信息是否与离线标识信息匹配;当上述标识信息与离线标识信息匹配时,将上述标识信息作为第一标识信息,并登录页面。基于账号登录,具有保证移动终端安全的好处。In combination with the second implementation of the first aspect, in the third implementation of the first aspect of the present invention, the above-mentioned login page based on the controlled terminal corresponding to the first identification information includes: when the second login mode selection command is detected , detect the manufacturer information corresponding to the login; when the manufacturer information is detected, use the above manufacturer information to log in the account; after the account is logged in, check whether there is identification information stored locally; when there is identification information stored locally, check whether the above identification information is consistent with Offline identification information matching: when the above identification information matches the offline identification information, use the above identification information as the first identification information, and log in to the page. Account-based login has the advantage of ensuring the security of mobile terminals.
结合第一方面的第三种实现方式,本发明在第一方面的第四种实现方式中,上述依据被控终端对应第一标识信息登录页面,还包括:当上述标识信息与离线标识信息不匹配时,检测上述厂商信息是否与第三标识信息关联;当上述厂商信息不关联第三标识信息时,将上述标识信息作为上述厂商信息对应的第一标识信息,并登录页面;当厂商信息关联第三标识信息时,删除上述标识信息,以及采用上述厂商信息生成对应的第一标识信息,并登录页面。具有避免移动终端所保存数据泄露,保证移动终端数据安全的有益效果。In combination with the third implementation of the first aspect, in the fourth implementation of the first aspect of the present invention, the above-mentioned login page corresponding to the first identification information based on the controlled terminal further includes: when the above-mentioned identification information and the offline identification information are different When matching, detect whether the above-mentioned manufacturer information is associated with the third identification information; when the above-mentioned manufacturer information is not associated with the third identification information, use the above-mentioned identification information as the first identification information corresponding to the above-mentioned manufacturer information, and log in to the page; when the manufacturer information is associated For the third identification information, delete the above identification information, and use the above manufacturer information to generate corresponding first identification information, and log in to the page. The invention has the beneficial effect of avoiding data leakage stored in the mobile terminal and ensuring data security of the mobile terminal.
结合第一方面的第三种实现方式,本发明在第一方面的第五种实现方式中,上述依据被控终端对应第一标识信息登录页面,还包括:当本地没有存储标识信息时,检测服务器是否存储有上述厂商信息对应的第一标识信息;当检测到服务器存储有第一标识信息时,登录页面,并保存上述厂商信息;当服务器未存储第一标识信息时,通过服务器生成第一标识信息并保存,登录页面。具有根据服务器所保存的数据登录页面的好处。In combination with the third implementation of the first aspect, in the fifth implementation of the first aspect of the present invention, the above-mentioned basis that the controlled terminal corresponds to the first identification information login page further includes: when no identification information is stored locally, detecting Whether the server stores the first identification information corresponding to the above manufacturer information; when it is detected that the server stores the first identification information, log in to the page and save the above manufacturer information; when the server does not store the first identification information, generate the first identification information through the server Identify information and save, login page. Has the benefit of landing pages based on data held by the server.
结合第一方面的第三种实现方式,本发明在第一方面的第六种实现方式中,还包括:当未检测到厂商信息时,调用上述厂商信息对应的注册页面;依据上述注册页面接收的输入信息进行注册,生成厂商信息,以执行账号登录的步骤。具有在未存储账号登录对应厂商信息时,通过注册页面注册对应的厂商信息的好处。In combination with the third implementation of the first aspect, the sixth implementation of the first aspect of the present invention further includes: when the manufacturer information is not detected, calling the registration page corresponding to the above manufacturer information; receiving the registration page according to the above registration page Register with the input information, generate manufacturer information, and perform the steps of account login. It has the advantage of registering the corresponding manufacturer information through the registration page when the corresponding manufacturer information is registered with no account stored.
结合第一方面的第一种实现方式,本发明在第一方面的第七种实现方式中,上述依据在页面接收到输入信息,确定第二标识信息,包括:当接收到符合预设格式的输入信息时,校验上述输入信息的有效性;当检测到输入信息有效时,获取上述输入信息对应的第二标识信息。具有根据输入信息确定主控终端的好处。In combination with the first implementation of the first aspect, in the seventh implementation of the first aspect of the present invention, determining the second identification information based on receiving input information on the page includes: when receiving an When inputting information, verify the validity of the input information; when it is detected that the input information is valid, acquire the second identification information corresponding to the input information. It has the advantage of determining the master terminal according to the input information.
结合第一方面的第七种实现方式,本发明在第一方面的第八种实现方式中,上述向第二标识信息对应的主控终端发送第一连接请求,包括:检测上述第二标识信息是否与第一标识信息具有特征关系;当上述第二标识信息与第一标识信息不具有特征关系,向上述主控终端发送特征关系添加 请求,以创建上述第二标识信息与第一标识信息的特征关系;当第二标识信息与第一标识信息具有特征关系,向上述主控终端发送第一连接请求。具有向具有特征关系的主控主控终端发送第一连接请求的好处,从而保证被控终端安全。With reference to the seventh implementation of the first aspect, in the eighth implementation of the first aspect of the present invention, the sending of the first connection request to the master terminal corresponding to the second identification information includes: detecting the second identification information Whether it has a characteristic relationship with the first identification information; when the second identification information does not have a characteristic relationship with the first identification information, send a request for adding a characteristic relationship to the above-mentioned master terminal to create a combination of the second identification information and the first identification information A characteristic relationship: when the second identification information has a characteristic relationship with the first identification information, sending the first connection request to the above-mentioned main control terminal. It has the advantage of sending the first connection request to the master control terminal having a characteristic relationship, thereby ensuring the security of the controlled terminal.
结合第一方面的第一种实现方式,本发明在第一方面的第九种实现方式中,在上述发送第一连接请求后,还包括:判断在预设时间范围内是否检测到主控终端反馈的第一连接响应;当在预设时间范围内未检测到上述第一连接响应,确定上述控制连接建立失败;当在预设时间范围内检测到上述第一连接响应,执行建立上述控制连接的步骤,以及确定控制连接建立成功。具有验证第一连接请求的时效性的好处。In combination with the first implementation of the first aspect, in the ninth implementation of the first aspect of the present invention, after the above-mentioned sending of the first connection request, it further includes: judging whether the master terminal is detected within the preset time range Feedback of the first connection response; when the above-mentioned first connection response is not detected within the preset time range, it is determined that the above-mentioned control connection establishment fails; when the above-mentioned first connection response is detected within the preset time range, execute the establishment of the above-mentioned control connection Steps, and confirm that the control connection is established successfully. It has the advantage of verifying the timeliness of the first connection request.
结合第一方面,本发明在第一方面的第十种实现方式中,上述依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息,包括:获取被控终端的系统权限信息;基于上述系统权限信息对显示界面进行截屏,得到屏幕图像;对上述屏幕图像进行压缩处理,生成屏幕图像信息。具有减少数据传输量的好处。In combination with the first aspect, in the tenth implementation mode of the first aspect of the present invention, the above-mentioned screenshot of the current display interface according to the system authority information to generate screen image information includes: obtaining the system authority information of the controlled terminal; based on the above system The authority information screenshots the display interface to obtain a screen image; compresses the above screen image to generate screen image information. Has the benefit of reducing the amount of data transferred.
结合第一方面,本发明在第一方面的第十一种实现方式中,将上述屏幕图像信息发送给主控终端,包括:利用预设算法将屏幕图像信息发送给服务器,以通过服务器将上述屏幕图像信息转发给主控终端。具有实现远程控制移动终端的好处。With reference to the first aspect, in the eleventh implementation manner of the first aspect of the present invention, sending the above-mentioned screen image information to the main control terminal includes: using a preset algorithm to send the screen image information to the server, so that the above-mentioned The screen image information is forwarded to the main control terminal. It has the advantage of realizing remote control of the mobile terminal.
结合第一方面,本发明在第一方面的第十二种实现方式中,依据主控终端针对上述屏幕图像信息反馈的操作信息,确定操作事件并执行,包括:当接收到服务器转发主控终端所反馈的操作信息时,对上述操作信息进行解析,确定操作事件;通过调用应用程序编程接口,将上述操作事件添加到输入队列中,其中,上述输入队列用于按照添加顺序执行操作事件。具有按照添加顺序执行操作事件的好处。In combination with the first aspect, in the twelfth implementation of the first aspect of the present invention, according to the operation information fed back by the main control terminal for the above-mentioned screen image information, the operation event is determined and executed, including: when receiving the server forwarding the main control terminal When the operation information is fed back, the above operation information is analyzed to determine the operation event; by calling the application programming interface, the above operation event is added to the input queue, wherein the above input queue is used to execute the operation event according to the order of addition. Has the benefit of executing action events in the order they were added.
结合第一方面,本发明在第一方面的第十三种实现方式中,上述与主控终端建立控制连接,还包括:在登录页面后,接收服务器转发的主控终端所提交的第二连接请求;对上述第二连接请求进行响应,生成对应的第 二连接响应;将上述第二连接响应发送上述服务器,以建立上述控制连接,其中上述服务器用于将第二连接响应反馈给主控终端。具有根据主控终端发送的第二连接请求建立控制连接的好处,从而提高被控终端建立控制连接的操作简便性。In combination with the first aspect, in the thirteenth implementation of the first aspect of the present invention, the establishment of the control connection with the main control terminal further includes: after logging in to the page, receiving the second connection submitted by the main control terminal forwarded by the server request; respond to the above second connection request, and generate a corresponding second connection response; send the above second connection response to the above server to establish the above control connection, wherein the above server is used to feed back the second connection response to the main control terminal . It has the advantage of establishing a control connection according to the second connection request sent by the controlling terminal, thereby improving the operation convenience for the controlled terminal to establish the control connection.
在第二方面,本发明实施例还公开了一种控制移动终端的方法,包括:预先与被控终端建立控制连接;基于上述控制连接,接收上述被控终端所发送的屏幕图像信息;对屏幕图像信息进行解析处理,生成显示图像并展示;依据上述显示图像对应的输入操作,生成操作信息;将上述操作信息发送给被控终端,以控制被控终端。具有远程控制被控终端的好处,从而解决被控终端使用不方便的问题。In the second aspect, the embodiment of the present invention also discloses a method for controlling a mobile terminal, including: establishing a control connection with the controlled terminal in advance; based on the control connection, receiving the screen image information sent by the controlled terminal; The image information is analyzed and processed, and a display image is generated and displayed; operation information is generated according to the input operation corresponding to the display image; and the operation information is sent to the controlled terminal to control the controlled terminal. It has the advantage of remotely controlling the controlled terminal, thereby solving the problem of inconvenient use of the controlled terminal.
结合第二方面,本发明在第一方面的第一种实现方式中,上述预先与被控终端建立控制连接,包括:接收被控终端所发送的第一连接请求;对第一连接请求进行响应,生成对应的第一连接响应;将第一连接响应反馈给被控终端,以建立上述控制连接。具有根据被控终端发送的第一连接请求建立控制连接的好处。With reference to the second aspect, in the first implementation manner of the first aspect of the present invention, the above-mentioned establishment of a control connection with the controlled terminal in advance includes: receiving the first connection request sent by the controlled terminal; responding to the first connection request , generating a corresponding first connection response; feeding back the first connection response to the controlled terminal, so as to establish the above-mentioned control connection. It has the advantage of establishing a control connection according to the first connection request sent by the controlled terminal.
结合第二方面,本发明在第一方面的第二种实现方式中,上述预先与被控终端建立控制连接,包括:在登录页面后,向服务器发送第二连接请求,以通过服务器将第二连接请求转发给被控终端;当接收到服务器转发的被控终端反馈的第二连接响应时,建立上述控制连接。具有实现建立控制连接的好处。With reference to the second aspect, in the second implementation manner of the first aspect of the present invention, the above-mentioned establishment of a control connection with the controlled terminal in advance includes: after logging in to the page, sending a second connection request to the server, so that the second connection request is sent to the server through the server. The connection request is forwarded to the controlled terminal; when the second connection response fed back by the controlled terminal forwarded by the server is received, the aforementioned control connection is established. Has the benefit of enabling the establishment of a control connection.
结合第二方面,本发明在第一方面的第三种实现方式中,上述输入操作包括以下任意一项:点击操作、滑动操作或长按操作。With reference to the second aspect, in a third implementation manner of the first aspect of the present invention, the above-mentioned input operation includes any one of the following: a click operation, a slide operation, or a long press operation.
结合第二方面的第三种实现方式,本发明在第一方面的第四种实现方式中,当上述输入操作为长按操作时,上述依据上述显示图像对应的输入操作,生成操作信息,包括:获取上述长按操作在上述显示图像上的操作位置;计算上述长按操作的操作时间;采用上述操作时间和操作位置,生成对应的操作信息。具有根据长按操作控制被控终端的好处。In combination with the third implementation of the second aspect, in the fourth implementation of the first aspect of the present invention, when the input operation is a long press operation, the operation information is generated according to the input operation corresponding to the display image, including : Obtain the operation position of the above-mentioned long-press operation on the above-mentioned display image; calculate the operation time of the above-mentioned long-press operation; use the above-mentioned operation time and operation position to generate corresponding operation information. It has the advantage of controlling the controlled terminal according to the long press operation.
结合第二方面的第三种实现方式,本发明在第一方面的第五种实现方 式中,当上述输入操作为滑动操作时,上述依据上述显示图像对应的输入操作,生成操作信息,包括:检测滑动操作对应的滑动信息;基于上述滑动信息确定操作信息。具有根据滑动操作控制被控终端的好处。In combination with the third implementation of the second aspect, in the fifth implementation of the first aspect of the present invention, when the above-mentioned input operation is a sliding operation, the above-mentioned operation information is generated based on the input operation corresponding to the above-mentioned displayed image, including: Sliding information corresponding to the sliding operation is detected; and operation information is determined based on the sliding information. It has the advantage of controlling the controlled terminal according to the sliding operation.
结合第二方面的第三种实现方式,本发明在第一方面的第六种实现方式中,当上述输入操作为点击操作时,上述依据上述显示图像对应的输入操作,生成操作信息,包括:检测上述点击操作在上述显示图像上的点击位置,生成对应操作信息。具有根据点击操作控制被控终端的好处。In combination with the third implementation of the second aspect, in the sixth implementation of the first aspect of the present invention, when the above-mentioned input operation is a click operation, the above-mentioned operation information is generated based on the input operation corresponding to the above-mentioned displayed image, including: Detecting the click position of the above-mentioned click operation on the above-mentioned display image, and generating corresponding operation information. It has the advantage of controlling the controlled terminal according to the click operation.
结合第二方面的第三种实现方式,本发明在第一方面的第七种实现方式中,将上述操作信息发送给被控终端,包括:将操作信息发送给服务器,以通过上述服务器将上述操作信息转发给被控终端。With reference to the third implementation of the second aspect, in the seventh implementation of the first aspect of the present invention, sending the above-mentioned operation information to the controlled terminal includes: sending the operation information to a server, so that the above-mentioned The operation information is forwarded to the controlled terminal.
结合第二方面或第一方面,在一个可能的设计中,上述服务器包括:网络服务器或者应用服务器。With reference to the second aspect or the first aspect, in a possible design, the foregoing server includes: a network server or an application server.
在第三方面,本发明实施例公开了一种控制移动终端的装置,包括:第一连接建立模块,用于预先与主控终端建立控制连接;截屏模块,用于依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息;屏幕图像发送模块,用于基于上述控制连接,将上述屏幕图像信息发送给主控终端;操作执行模块,用于依据主控终端针对上述屏幕图像信息反馈的操作信息,确定操作事件并执行。通过本实施例,移动终端作为被控终端,可以用于主控终端建立控制连接,从而使得其他用户可以通过主控终端控制被控终端,帮助使用被控终端的用户解决遇到的移动终端问题,即解决移动终端使用不方便的问题。In the third aspect, the embodiment of the present invention discloses a device for controlling a mobile terminal, including: a first connection establishment module, used to establish a control connection with the main control terminal in advance; The interface takes screenshots to generate screen image information; the screen image sending module is used to send the above-mentioned screen image information to the main control terminal based on the above-mentioned control connection; the operation execution module is used to operate according to the feedback of the main control terminal on the above-mentioned screen image information information, identify operational events and execute them. Through this embodiment, the mobile terminal, as the controlled terminal, can be used to establish a control connection with the main control terminal, so that other users can control the controlled terminal through the main control terminal, and help the users using the controlled terminal to solve the mobile terminal problems encountered , which solves the problem of inconvenient use of mobile terminals.
结合第三方面,本发明在第三方面的第一种实现方式中,上述第一连接建立模块,包括:登录子模块,用于依据被控终端对应第一标识信息登录页面;输入信息接收子模块,用于依据在页面接收到输入信息,确定第二标识信息;第一请求发送子模块,用于向上述第二标识信息对应的主控终端发送第一连接请求;第一连接建立子模块,用于当接收到上述主控终端针对上述第一连接请求反馈的第一连接响应时,建立上述控制连接。In combination with the third aspect, in the first implementation manner of the third aspect of the present invention, the above-mentioned first connection establishment module includes: a login submodule, configured to log in to the page according to the first identification information corresponding to the controlled terminal; an input information receiving submodule The module is used to determine the second identification information according to the input information received on the page; the first request sending sub-module is used to send the first connection request to the main control terminal corresponding to the second identification information; the first connection establishment sub-module , configured to establish the control connection when the first connection response fed back by the master control terminal for the first connection request is received.
结合第三方面的第一种实现方式,本发明在第三方面的第二种实现方 式中,上述登录子模块,包括:第一本地检测单元,用于当检测到第一登录模式选择命令时,检测本地是否存存储有标识信息;第一关联检测单元,用于在本地存储有标识信息时,检测上述标识信息是否与厂商信息关联;标识信息确定单元,用于当上述标识信息不关联厂商信息,将上述标识信息作为第一标识信息;当本地没有存储标识信息,或者上述标识信息关联厂商信息时,通过服务器生成第一标识信息并保存;第一登录单元,用于基于上述第一标识信息执行第一登录模式选择命令,以登录页面。With reference to the first implementation of the third aspect, in the second implementation of the third aspect of the present invention, the above-mentioned login submodule includes: a first local detection unit, configured to Detecting whether identification information is stored locally; the first association detection unit is used to detect whether the identification information is associated with manufacturer information when the identification information is stored locally; the identification information determination unit is used to determine whether the identification information is not associated with the manufacturer. Information, using the above-mentioned identification information as the first identification information; when there is no identification information stored locally, or the above-mentioned identification information is associated with manufacturer information, the server generates and saves the first identification information; the first login unit is used to The message executes the first login mode selection command to log in to the page.
结合第三方面的第二种实现方式,本发明在第三方面的第三种实现方式中,上述登录子模块,包括:厂商信息检测单元,用于当检测到第二登录模式选择命令时,检测登录对应的厂商信息;账号登录单元,用于当检测到厂商信息时,采用上述厂商信息进行账号登录;第二本地检测单元,用于在账号登录后,检测本地是否存储有标识信息;标识信息匹配检测单元,用于当本地存储有标识信息时,检测上述标识信息是否与离线标识信息匹配;第二登录单元,用于当上述标识信息与离线标识信息匹配时,将上述标识信息作为第一标识信息,并登录页面。With reference to the second implementation of the third aspect, in the third implementation of the third aspect of the present invention, the above-mentioned login submodule includes: a vendor information detection unit, configured to, when a second login mode selection command is detected, Detect the manufacturer information corresponding to the login; the account login unit is used to log in the account using the above manufacturer information when the manufacturer information is detected; the second local detection unit is used to detect whether the identification information is stored locally after the account is logged in; The information matching detection unit is used to detect whether the identification information matches the offline identification information when the identification information is stored locally; the second login unit is used to use the identification information as the first identification information when the identification information matches the offline identification information An identification information, and a login page.
结合第三方面的第三种实现方式,本发明在第三方面的第四种实现方式中,上述登录子模块还包括:第二关联检测单元,用于当上述标识信息与离线标识信息不匹配时,检测上述厂商信息是否与第三标识信息关联。其中,上述第二登录单元,还用于当上述厂商信息不关联第三标识信息时,将上述标识信息作为上述厂商信息对应的第一标识信息,并登录页面;以及用于当上述厂商信息关联第三标识信息时,删除上述标识信息,以及采用上述厂商信息生成对应的第一标识信息,并登录页面。In combination with the third implementation of the third aspect, in the fourth implementation of the third aspect of the present invention, the above-mentioned login submodule further includes: a second association detection unit, configured to , it is detected whether the above vendor information is associated with the third identification information. Wherein, the above-mentioned second login unit is also used to use the above-mentioned identification information as the first identification information corresponding to the above-mentioned manufacturer information when the above-mentioned manufacturer information is not associated with the third identification information, and log in the page; For the third identification information, delete the above identification information, and use the above manufacturer information to generate corresponding first identification information, and log in to the page.
结合第三方面的第三种实现方式,本发明在第三方面的第五种实现方式中,上述登录子模块,还包括:服务器检测单元,用于当本地没有存储标识信息时,检测服务器是否存储有上述厂商信息对应的第一标识信息。其中,上述第二登录单元,还用于当检测到服务器存储有第一标识信息时,登录页面,并保存上述厂商信息;以及用于当服务器没有存储有上述第一标识信息时,通过服务器生成第一标识信息并保存,登录页面。In combination with the third implementation of the third aspect, in the fifth implementation of the third aspect of the present invention, the above login submodule further includes: a server detection unit, configured to detect whether the server The first identification information corresponding to the above vendor information is stored. Wherein, the above-mentioned second login unit is also used to log in to the page when it is detected that the server stores the first identification information, and save the above-mentioned manufacturer information; First identify the information and save it, and log in to the page.
结合第三方面的第三种实现方式,本发明在第三方面的第六种实现方式中,上述登录子模块,还包括:注册页面调用单元,用于当未检测到厂商信息时,调用上述厂商信息对注册页面;账号注册单元,用于依据上述注册页面接收的输入信息进行注册,生成厂商信息,并触发上述账号登录单元执行账号登录的步骤。In combination with the third implementation of the third aspect, in the sixth implementation of the third aspect of the present invention, the above-mentioned login submodule further includes: a registration page calling unit, used to call the above-mentioned The manufacturer information registration page; the account registration unit is used to register according to the input information received on the registration page, generate manufacturer information, and trigger the account registration unit to perform the steps of account registration.
结合第三方面的第一种实现方式,本发明在第三方面的第七种实现方式中,上述输入信息接收子模块,包括:校验单元,用于当接收到符合预设格式的输入信息时,校验上述输入信息的有效性;获取单元,用于当检测到输入信息有效时,获取上述输入信息对应的第二标识信息。In combination with the first implementation of the third aspect, in the seventh implementation of the third aspect of the present invention, the above-mentioned input information receiving submodule includes: a verification unit, configured to , verifying the validity of the above-mentioned input information; the obtaining unit is configured to obtain the second identification information corresponding to the above-mentioned input information when it is detected that the input information is valid.
结合第三方面的第七种实现方式,本发明在第三方面的第八种实现方式中,第一请求发送子模块,包括:特征关系检测单元,用于检测第二标识信息是否与第一标识信息具有特征关系;添加请求发送单元,用于当第二标识信息与第一标识信息不具有特征关系,向上述主控终端发送特征关系添加请求,以创建第二标识信息与第一标识信息的特征关系;第一请求发送单元,用于当第二标识信息与第一标识信息具有特征关系,向上述主控终端发送第一连接请求。With reference to the seventh implementation of the third aspect, in the eighth implementation of the third aspect of the present invention, the first request sending submodule includes: a feature relationship detection unit, configured to detect whether the second identification information is consistent with the first The identification information has a characteristic relationship; the adding request sending unit is configured to send a characteristic relationship addition request to the above-mentioned master control terminal when the second identification information and the first identification information do not have a characteristic relationship, so as to create the second identification information and the first identification information The characteristic relationship; the first request sending unit is configured to send the first connection request to the above-mentioned main control terminal when the second identification information has a characteristic relationship with the first identification information.
结合第三方面的第一种实现方式,本发明在第三方面的第九种实现方式中,第一连接建立模块,还包括:判断子模块,用于判断在预设时间范围内是否检测到主控终端反馈的第一连接响应;连接确定子模块,用于当在预设时间范围内未检测到上述第一连接响应,确定上述控制连接建立失败;当在预设时间范围内检测到上述第一连接响应,触发上述第一连接建立子模块执行建立上述控制连接的步骤,以及确定控制连接建立成功。In combination with the first implementation of the third aspect, in the ninth implementation of the third aspect of the present invention, the first connection establishment module further includes: a judging sub-module, configured to judge whether a connection is detected within a preset time range The first connection response fed back by the master control terminal; the connection determination submodule is used to determine that the establishment of the control connection fails when the above-mentioned first connection response is not detected within the preset time range; when the above-mentioned control connection is detected within the preset time range The first connection response triggers the first connection establishing submodule to execute the step of establishing the control connection, and determines that the control connection is established successfully.
结合第三方面,本发明在第三方面的第十种实现方式中,上述截屏模块,包括:权限获取子模块,用于获取被控终端的系统权限信息;截屏子模块,用于基于上述系统权限信息对显示界面进行截屏,得到屏幕图像;压缩子模块,用于对上述屏幕图像进行压缩处理,生成屏幕图像信息。In combination with the third aspect, in the tenth implementation manner of the third aspect of the present invention, the above-mentioned screen capture module includes: an authority acquisition sub-module for acquiring system authority information of the controlled terminal; a screen capture sub-module for The permission information captures the screen of the display interface to obtain a screen image; the compression sub-module is used to compress the above screen image to generate screen image information.
结合第三方面,本发明在第三方面的第十一种实现方式中,上述屏幕图像发送模块,具体用于利用预设算法将屏幕图像信息发送给服务器,以 通过服务器将上述屏幕图像信息转发给主控终端。With reference to the third aspect, in the eleventh implementation manner of the third aspect of the present invention, the above-mentioned screen image sending module is specifically configured to use a preset algorithm to send the screen image information to the server, so as to forward the above-mentioned screen image information through the server to the master terminal.
结合第三方面,本发明在第三方面的第十二种实现方式中,上述操作执行模块,具体用于当接收到服务器转发主控终端所反馈的操作信息时,对上述操作信息进行解析,确定操作事;以及,通过调用应用程序编程接口,将上述操作事件添加到输入队列中,其中,上述输入队列用于按照添加顺序执行操作事件。With reference to the third aspect, in the twelfth implementation manner of the third aspect of the present invention, the above-mentioned operation execution module is specifically configured to analyze the above-mentioned operation information when receiving the operation information fed back by the master control terminal forwarded by the server, determining the operation event; and adding the above operation event to an input queue by calling an application programming interface, wherein the above input queue is used to execute the operation event according to the order of adding.
结合第三方面,本发明在第三方面的第十三种实现方式中,上述第一连接建立模块,还包括:第二请求接收子模块,用于在登录页面后,接收服务器转发的主控终端所提交的第二连接请求;第二响应生成子模块,用于对上述第二连接请求进行响应,生成对应的第二连接响应;第二响应发送子模块,用于将上述第二连接响应发送上述服务器,并触发上述第一连接建立子模块建立上述控制连接,其中上述服务器用于将第二连接响应反馈给主控终端。With reference to the third aspect, in the thirteenth implementation of the third aspect of the present invention, the above-mentioned first connection establishment module further includes: a second request receiving submodule, configured to receive the main control message forwarded by the server after logging in to the page The second connection request submitted by the terminal; the second response generation submodule is used to respond to the above second connection request and generate a corresponding second connection response; the second response sending submodule is used to send the above second connection response Sending the above server, and triggering the above first connection establishment submodule to establish the above control connection, wherein the above server is used to feed back the second connection response to the main control terminal.
在第四方面,本发明实施例还公开了一种控制移动终端的装置,其特征在于,包括:第二连接建立模块,用于预先与被控终端建立控制连接;屏幕图像接收模块,用于基于上述控制连接,接收上述被控终端所发送的屏幕图像信息;屏幕图像解析模块,用于对屏幕图像信息进行解析处理,生成显示图像并展示;操作信息生成模块,用于依据上述显示图像对应的输入操作,生成操作信息;操作信息发送模块,用于将上述操作信息发送给被控终端,以控制被控终端。In the fourth aspect, the embodiment of the present invention also discloses a device for controlling a mobile terminal, which is characterized in that it includes: a second connection establishment module, used to establish a control connection with the controlled terminal in advance; a screen image receiving module, used to Based on the above-mentioned control connection, receive the screen image information sent by the above-mentioned controlled terminal; the screen image analysis module is used to analyze and process the screen image information, generate and display the display image; the operation information generation module is used to correspond to the above-mentioned display image The input operation generates operation information; the operation information sending module is used to send the above operation information to the controlled terminal, so as to control the controlled terminal.
结合第四方面,本发明在第一方面的第一种实现方式中,第二连接建立模块,包括:第一请求接收子模块,用于接收被控终端所发送的第一连接请求;第一响应生成子模块,用于对第一连接请求进行响应,生成对应的第一连接响应;第一响应发送子模块,用于将上述第一连接响应反馈给被控终端,以建立上述控制连接。With reference to the fourth aspect, in the first implementation manner of the first aspect of the present invention, the second connection establishment module includes: a first request receiving submodule, configured to receive the first connection request sent by the controlled terminal; the first The response generation submodule is configured to respond to the first connection request and generate a corresponding first connection response; the first response sending submodule is configured to feed back the first connection response to the controlled terminal to establish the control connection.
结合第四方面,本发明在第一方面的第二种实现方式中,第二连接建立模块,包括:第二发送子模块,用于在登录页面后,向服务器发送第二连接请求,以通过上述服务器将上述第二连接请求转发给被控终端;第二 连接建立子模块,用于当接收到服务器转发的被控终端反馈的第二连接响应时,建立上述控制连接。结合第四方面,本发明在第一方面的第三种实现方式中,上述输入操作包括以下任意一项:点击操作、滑动操作或长按操作。With reference to the fourth aspect, in the second implementation of the first aspect of the present invention, the second connection establishment module includes: a second sending submodule, configured to send a second connection request to the server after logging in to the page, to pass The server forwards the second connection request to the controlled terminal; the second connection establishing submodule is configured to establish the control connection when receiving the second connection response fed back by the controlled terminal forwarded by the server. With reference to the fourth aspect, in the third implementation manner of the first aspect of the present invention, the above input operation includes any one of the following: click operation, slide operation or long press operation.
结合第四方面的第三种实现方式,本发明在第一方面的第四种实现方式中,当上述输入操作为长按操作时,上述操作信息生成模块,具体用于获取上述长按操作在上述显示图像上的操作位置,计算上述长按操作的操作时间,以及采用上述操作时间和操作位置,生成对应的操作信息。In combination with the third implementation of the fourth aspect, in the fourth implementation of the first aspect of the present invention, when the above-mentioned input operation is a long press operation, the above-mentioned operation information generation module is specifically used to obtain the above-mentioned long-press operation. The operating position on the display image is used to calculate the operating time of the long press operation, and the corresponding operating information is generated by using the operating time and the operating position.
结合第四方面的第三种实现方式,本发明在第一方面的第五种实现方式中,当上述输入操作为滑动操作时,上述操作信息生成模块,具体用于检测滑动操作对应的滑动信息,基于上述滑动信息确定操作信息。In combination with the third implementation of the fourth aspect, in the fifth implementation of the first aspect of the present invention, when the above-mentioned input operation is a sliding operation, the above-mentioned operation information generation module is specifically used to detect the sliding information corresponding to the sliding operation , determining the operation information based on the above sliding information.
结合第四方面的第三种实现方式,本发明在第一方面的第六种实现方式中,当上述输入操作为点击操作时,上述操作信息生成模块,具体用于检测上述点击操作在上述显示图像上的点击位置,生成对应操作信息。With reference to the third implementation of the fourth aspect, in the sixth implementation of the first aspect of the present invention, when the above-mentioned input operation is a click operation, the above-mentioned operation information generation module is specifically used to detect the above-mentioned click operation on the above-mentioned display The click position on the image generates corresponding operation information.
结合第四方面的第三种实现方式,本发明在第一方面的第七种实现方式中,上述操作信息发送模块,具体用于将操作信息发送给服务器,以通过上述服务器将上述操作信息转发给被控终端。In combination with the third implementation of the fourth aspect, in the seventh implementation of the first aspect of the present invention, the above-mentioned operation information sending module is specifically configured to send the operation information to the server, so as to forward the above-mentioned operation information through the above-mentioned server to the controlled terminal.
结合第四方面或第三方面,在一个可能的设计中,上述服务器包括:网络服务器或者应用服务器。With reference to the fourth aspect or the third aspect, in a possible design, the foregoing server includes: a network server or an application server.
在第五方面,本发明实施例还公开了一种移动终端,包括:存储器,加载有多条可执行指令;处理器,执行上述多条可执行指令;上述多条可执行指令包括执行上述第一方面或第二方面任一的方法。In the fifth aspect, the embodiment of the present invention also discloses a mobile terminal, including: a memory loaded with multiple executable instructions; a processor for executing the above multiple executable instructions; the above multiple executable instructions include executing the above first The method of either the first aspect or the second aspect.
通过本实施例,用户若遇到移动终端的问题,可以将其所操作的移动终端作为被控终端,与其他用户所操作的移动终端,即主控终端,建立控制连接,从而使其他用户可以通过在主控终端上进行操作,即在主控终端显示的被控终端屏幕图像信息对应的显示图像上进行操作,来解决被控终端所存在的问题,即解决了移动终端使用不方便的问题,提高了用户体验。Through this embodiment, if a user encounters a problem with a mobile terminal, he can use the mobile terminal he operates as a controlled terminal to establish a control connection with the mobile terminal operated by other users, that is, the master terminal, so that other users can By operating on the main control terminal, that is, operating on the display image corresponding to the screen image information of the controlled terminal displayed by the main control terminal, the problems existing in the controlled terminal are solved, that is, the problem of inconvenient use of the mobile terminal is solved , improving the user experience.
上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.
附图说明Description of drawings
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.
图1是根据本发明的一种控制移动终端的方法实施例的步骤流程图。Fig. 1 is a flow chart of steps of an embodiment of a method for controlling a mobile terminal according to the present invention.
图2是根据本发明的一种控制移动终端的方法优选实施的步骤流程图。Fig. 2 is a flow chart of preferred implementation steps of a method for controlling a mobile terminal according to the present invention.
图3是根据本发明的一个具体示例中选择游客模式登录页面的示意图。Fig. 3 is a schematic diagram of a login page for selecting a visitor mode according to a specific example of the present invention.
图4是根据本发明的另一个具体示例中选择会员模式登录页面的示意图。Fig. 4 is a schematic diagram of a login page for selecting membership mode according to another specific example of the present invention.
图5是根据本发明的另一种控制移动终端的方法实施例的步骤流程图。Fig. 5 is a flow chart of steps in another embodiment of a method for controlling a mobile terminal according to the present invention.
图6是本发明实施例中主控终端对被控终端进行控制的示例图。Fig. 6 is an example diagram of controlling a controlled terminal by a controlling terminal in an embodiment of the present invention.
图7A是根据本发明的一种控制移动终端的装置实施例的结构框图。Fig. 7A is a structural block diagram of an embodiment of an apparatus for controlling a mobile terminal according to the present invention.
图7B是根据本发明的一种控制移动终端的装置优选实施例的结构框图。Fig. 7B is a structural block diagram of a preferred embodiment of an apparatus for controlling a mobile terminal according to the present invention.
图8A是根据本发明的另一种控制移动终端的装置实施例的结构框图。Fig. 8A is a structural block diagram of another embodiment of an apparatus for controlling a mobile terminal according to the present invention.
图8B是根据本发明的另一种控制移动终端的装置优选实施例的结构框图。Fig. 8B is a structural block diagram of another preferred embodiment of an apparatus for controlling a mobile terminal according to the present invention.
图9是根据本发明的一种移动终端的结构框图。Fig. 9 is a structural block diagram of a mobile terminal according to the present invention.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述。In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.
在本发明的说明书和权利要求书及上述附图中的描述的一些流程中,包 含了按照特定顺序出现的多个操作,但是应该清楚了解,这些操作可以不按照其在本文中出现的顺序来执行或并行执行,操作的序号如101、102等,仅仅是用于区分开各个不同的操作,序号本身不代表任何的执行顺序。另外,这些流程可以包括更多或更少的操作,并且这些操作可以按顺序执行或并行执行。需要说明的是,本文中的“第一”、“第二”等描述,是用于区分不同的消息、设备、模块等,不代表先后顺序,也不限定“第一”和“第二”是不同的类型。In some processes described in the specification and claims of the present invention and the above-mentioned drawings, a plurality of operations appearing in a specific order are contained, but it should be clearly understood that these operations may not be performed in the order in which they appear herein Execution or parallel execution, the serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. Additionally, these processes can include more or fewer operations, and these operations can be performed sequentially or in parallel. It should be noted that the descriptions of "first" and "second" in this article are used to distinguish different messages, devices, modules, etc. are different types.
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present invention.
名词解释:Glossary:
移动终端(Mobile Terminal,MT),又称为移动通信终端,是指可以在移动中使用的计算机设备,具体可以包括手机、平板电脑、POS机、车载电脑等。A mobile terminal (Mobile Terminal, MT), also known as a mobile communication terminal, refers to a computer device that can be used on the move, specifically including a mobile phone, a tablet computer, a POS machine, a vehicle-mounted computer, etc.
通常,用户在使用移动终端的过程中,可能会遇到各种各样的问题,导致其不能获得移动终端所提供的服务,即移动终端不能实现相应的功能。本发明实施例提出了一种控制移动终端的方法和装置,以对移动终端进行远程控制,从而可以帮助用户解决移动终端的问题,使移动终端可以实现相应的功能,以满足用户需求。Generally, a user may encounter various problems in the process of using a mobile terminal, resulting in that the user cannot obtain services provided by the mobile terminal, that is, the mobile terminal cannot implement corresponding functions. Embodiments of the present invention propose a method and device for controlling a mobile terminal, so as to remotely control the mobile terminal, so as to help users solve problems of the mobile terminal, and enable the mobile terminal to implement corresponding functions to meet user needs.
本发明实施例中可以将被控制的移动终端称为被控终端,如智能手机、平板电脑等;相应的,将对被控终端进行控制的移动终端称为主控终端。本发明实施在进行控制时,可以基于局域网或者互联网建立主控终端与被控终端之间的控制连接,从而使得主控终端可以对被控终端进行控制,以解决被控终端所存在的问题,实现被控终端相应的功能。In the embodiment of the present invention, the controlled mobile terminal may be called a controlled terminal, such as a smart phone, a tablet computer, etc.; correspondingly, the mobile terminal that controls the controlled terminal is called a master terminal. When the present invention is implemented for control, a control connection between the controlling terminal and the controlled terminal can be established based on a local area network or the Internet, so that the controlling terminal can control the controlled terminal to solve the problems existing in the controlled terminal. Realize the corresponding functions of the controlled terminal.
实施例一Embodiment one
本实施例论述被控终端侧的移动终端控制方法步骤。This embodiment discusses the steps of the mobile terminal control method at the controlled terminal side.
参照图1,示出了根据本发明的一种控制移动终端的方法实施例的步骤 流程图,具体可以包括如下步骤:Referring to Fig. 1, it shows a flow chart of steps according to a method embodiment of controlling a mobile terminal according to the present invention, which may specifically include the following steps:
步骤102,预先与主控终端建立控制连接。Step 102, establishing a control connection with the master terminal in advance.
在本发明实施例中,移动终端可以通过启动应用程序(Application,APP)进入登录界面,即登录页面,如登录APP的主页面,并生成对应的登录信息。其中,该登录信息可以携带有标识信息;该标识信息可以对应唯一的移动终端,即可以用于标识移动终端,如移动终端在网络中对应的用户标识符(User Identification,UID),具体可以包括:被控终端对应的第一标识信息、主控终端对应的第二标识信息等。In the embodiment of the present invention, the mobile terminal can enter a login interface, that is, a login page, such as a main page of the login APP, by starting an application program (Application, APP), and generate corresponding login information. Wherein, the login information may carry identification information; the identification information may correspond to a unique mobile terminal, that is, it may be used to identify the mobile terminal, such as a user identifier (User Identification, UID) corresponding to the mobile terminal in the network, which may specifically include : the first identification information corresponding to the controlled terminal, the second identification information corresponding to the controlling terminal, and the like.
作为本发明的一种具体应用场景,当用户通过操作被控终端,可以触发被控终端启动APP,从而登录页面,并生成相应的被控登录信息,该被控登录信息携带有被控终端对应的第一标识信息。被控端连接网络后,可以依据对应的第一标识信息登录页面,如登录控制应用的主页面,从而使得用户可以在页面上进行操作,如输入信息。被控终端可以基于用户在页面上提交的操作,向网络服务器发送消息,和/或接收服务器所转发消息。具体的,被控终端可以依据在页面上接收到的操作,生成对应的消息,如依据在页面上接收到的输入信息,确定主控终端对应的第二标识信息,以及向服务器发送第一连接请求,以邀请主控终端对其进行控制。其中,该使得该服务器将第一连接请求可以携带有第一标识信息和第二标识信息,第二标识信息可以用于确定主控终端,第一标识信息可以用于确定被控终端。服务器在接收到第一标识信息对应的被控终端所发送的第一连接请求时,可以依据第一连接请求所携带的第二标识信息,将第一连接请求发送给主控终端,当接收到主控终端针对该第一连接请求反馈的第一连接响应时,将第一连接响应反馈给被控终端,从而使得被控终端在接收到该反馈的第一连接响应时,建立与主控终端的控制连接,从而使得主控终端可以对该被控终端进行控制。As a specific application scenario of the present invention, when the user operates the controlled terminal, the controlled terminal can be triggered to start the APP, thereby logging in to the page, and generating corresponding controlled login information, which carries the corresponding information of the controlled terminal. The first identification information of . After the controlled terminal is connected to the network, it can log in to the page according to the corresponding first identification information, such as logging in to the main page of the control application, so that the user can perform operations on the page, such as inputting information. The controlled terminal can send a message to the network server and/or receive a message forwarded by the server based on the operation submitted by the user on the page. Specifically, the controlled terminal can generate a corresponding message according to the operation received on the page, such as determining the second identification information corresponding to the master terminal according to the input information received on the page, and sending the first connection to the server request to invite the master terminal to control it. Wherein, the server may carry the first identification information and second identification information in the first connection request, the second identification information may be used to determine the controlling terminal, and the first identification information may be used to determine the controlled terminal. When the server receives the first connection request sent by the controlled terminal corresponding to the first identification information, it can send the first connection request to the master terminal according to the second identification information carried in the first connection request. When the controlling terminal responds to the first connection response fed back by the first connection request, it feeds back the first connection response to the controlled terminal, so that the controlled terminal establishes a connection with the controlling terminal when receiving the fed back first connection response. control connection, so that the controlling terminal can control the controlled terminal.
当然,被控终端也可以采用其他方式与主控终端建立控制连接,如在登录页面后,可以接收到服务器所转发的第二连接请求,通过对该第二连接请求进行响应,生成对应的第二连接响应,并通过服务器将第二 连接响应反馈给主控终端,从而与主控终端建立了控制连接,使得主控终端可以对被控终端进行控制,本发明实施对此不作限制。其中,第二连接请求可以是主控终端针对被控终端生成的,可以携带有主控终端对应的第二标识信息、被控终端对应的第一标识信息等,可以用于主控终端请求控制被控终端。Of course, the controlled terminal can also establish a control connection with the controlling terminal in other ways. For example, after logging in to the page, it can receive the second connection request forwarded by the server, and generate a corresponding second connection request by responding to the second connection request. second connection response, and feed back the second connection response to the master terminal through the server, thereby establishing a control connection with the master terminal, so that the master terminal can control the controlled terminal, which is not limited in the implementation of the present invention. Wherein, the second connection request may be generated by the controlling terminal for the controlled terminal, may carry the second identification information corresponding to the controlling terminal, the first identification information corresponding to the controlled terminal, etc., and may be used for the controlling terminal to request control Controlled terminal.
步骤104,依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息。Step 104, taking a screenshot of the current display interface according to the system authority information to generate screen image information.
被控终端在建立与主控终端之间的控制连接后,可以通过获取操作系统的系统权限信息,如系统签名权限信息、系统中超级用户的权限root等,对当前显示的界面进行截屏,获取到实时的屏幕图像,即生成当前对应的屏幕图像信息。After the controlled terminal establishes a control connection with the master terminal, it can capture the currently displayed interface by obtaining the system authority information of the operating system, such as the system signature authority information, the authority root of the super user in the system, etc., to obtain To the real-time screen image, that is, to generate the current corresponding screen image information.
步骤106,基于所述控制连接,将所述屏幕图像信息发送给主控终端。Step 106: Send the screen image information to the main control terminal based on the control connection.
本实施例中,被控终端在屏幕图像信息后,可以基于与主控终端之间的控制连接,实时的将屏幕图像信息发送到主控终端,如将屏幕图像信息发送给服务器,使得服务器将接收到的屏幕图像信息转发给主控终端,从而使主控终端可以接收到被控终端的屏幕图像信息。主控终端在接收到被控终端所发送的屏幕图像信息,可以对屏幕图像信息进行解析处理,得到被控终端的屏幕图像,即生成被控终端对应的显示图像,从而可以依据在显示图像上接收到的输入操作,生成对应的操作信息,并将该操作信息发送服务器,以通过服务器将该操作信息反馈给被控终端。其中,该操作信息具体可以包括操作位置、操作时间,具体可以包括在该显示图像上的按压时间、按压操作的按压点的位置、按压操作对应的压力信息、滑动操作对应的滑动信息等。In this embodiment, after the screen image information, the controlled terminal can send the screen image information to the master terminal in real time based on the control connection with the master terminal, such as sending the screen image information to the server, so that the server will The received screen image information is forwarded to the master control terminal, so that the master control terminal can receive the screen image information of the controlled terminal. After receiving the screen image information sent by the controlled terminal, the master control terminal can analyze and process the screen image information to obtain the screen image of the controlled terminal, that is, generate the corresponding display image of the controlled terminal, so that it can be based on the displayed image. The received input operation generates corresponding operation information, and sends the operation information to the server, so that the operation information is fed back to the controlled terminal through the server. Wherein, the operation information may specifically include the operation position and operation time, specifically may include the pressing time on the display image, the position of the pressing point of the pressing operation, the pressure information corresponding to the pressing operation, the sliding information corresponding to the sliding operation, and the like.
步骤108,依据主控终端针对所述屏幕图像信息反馈的操作信息,确定操作事件并执行。Step 108: Determine and execute an operation event according to the operation information fed back by the master terminal for the screen image information.
被控终端在接收到主控终端所发送的操作信息后,如在接收到服务器所转发的操作信息后,可以确定采用该操作信息确定对应的操作事件,如依据操作信息所携带的操作时间2秒确定长按操作事件,并且可以操作信息所携 带的操作位置数据确定操作位置,即该长按操作事件在屏显示界面上对应的操作位置。在确定操作事件后,可以依据系统权限信息执行该操作事件,如通过系统签名权限信息调用应用程序编程接口(Application Programming Interface,API),将所确定的操作事件(Event)添加到操作系统的原始输入(Raw Input)队列中,从而实现主控终端对被控终端的控制,进而可以解决被控终端所存在的问题,以满足用户需求。After receiving the operation information sent by the master terminal, for example, after receiving the operation information forwarded by the server, the controlled terminal can determine to use the operation information to determine the corresponding operation event, for example, according to the operation time carried in the operation information 2 seconds to determine the long-press operation event, and the operation position data carried in the operation information can be used to determine the operation position, that is, the corresponding operation position of the long-press operation event on the screen display interface. After the operation event is determined, the operation event can be executed according to the system authority information, such as calling an application programming interface (Application Programming Interface, API) through the system signature authority information, and adding the determined operation event (Event) to the original operating system Input (Raw Input) into the queue, so as to realize the control of the controlled terminal by the master terminal, and then solve the problems existing in the controlled terminal to meet the needs of users.
综上,本实施例的被控终端通过与主控终端建立控制连接,从而可以将当前显示界面对应的屏幕图像信息发送给主控终端,以及获取到主控终端针对该屏幕图像信息反馈的操作信息,生成对应的操作事件,并执行所生成的操作事件,即实现主控终端对被控终端的控制。通过本实施例,用户若遇到移动终端的问题,可以将其所操作的移动终端作为被控终端,与其他用户所操作的移动终端,即主控终端,建立控制连接,从而使其他用户可以通过在被控终端上进行操作,即在主控终端显示的被控终端屏幕图像信息对应的显示图像上进行操作,来解决被控终端所存在的问题,即解决了移动终端使用不方便的问题,提高了用户体验。To sum up, by establishing a control connection with the main control terminal, the controlled terminal in this embodiment can send the screen image information corresponding to the current display interface to the main control terminal, and obtain the feedback operation of the main control terminal for the screen image information. Information, generate a corresponding operation event, and execute the generated operation event, that is, realize the control of the controlled terminal by the master terminal. Through this embodiment, if a user encounters a problem with a mobile terminal, he can use the mobile terminal he operates as a controlled terminal to establish a control connection with the mobile terminal operated by other users, that is, the master terminal, so that other users can By operating on the controlled terminal, that is, operating on the display image corresponding to the controlled terminal screen image information displayed by the master control terminal, the problems existing in the controlled terminal are solved, that is, the problem of inconvenient use of the mobile terminal is solved , improving the user experience.
参照图2,示出了根据本发明的一种控制移动终端的方法优选实施的步骤流程图,具体可以包括如下步骤:Referring to FIG. 2 , it shows a flow chart of preferred implementation steps of a method for controlling a mobile terminal according to the present invention, which may specifically include the following steps:
步骤202,预先与主控终端建立控制连接。Step 202, establishing a control connection with the master terminal in advance.
本发明实施例中,当被控终端启动所安装的APP后,即在用户打开客户端后,被控终端可以进行网络检验,以判断本机是否连接正常连接网络,即校验网络连接。若网络连接异常,则被控终端可以提示用户检测网络连接,如提示用户切换网络环境,即提示用户切换网络连接,以及可以对当前所连接的网路进行重新校验。若检测到网络连接正常,则被控终端可以依据第一标识信息登录APP的主页面,即依据被控终端对应的第一标识信息登录页面。具体的,当被控终端所连接的网络正常,用户可以选择不同的登录模式,登录APP的主页面,如用户可以选择游客模式登录APP的页面,也可以选择会员模式登录APP的页面,如用户选择账号模式进行登录。其中,登录的账号可以包括手机号码、用户账号、默认生成的账号(简称默认账号)等, 可以与移动终端的厂商信息具有对应的映射关系。该登录的账号可以用于确定操作用户,并且还可以确定对应的厂商信息、标识信息等,从而可以确定该操作用户所操作的移动终端,以及该移动终端的硬件信息和/或软件信息,如所安装的操作系统。被控终端在登录页面后,可以依据在页面接收到的输入信息,确定第二标识信息,从而可以向第二标识信息对应的主控终端发送第一连接请求,以邀请主控终端对其进行控制。当接收到主控终端针对所述第一连接请求反馈的第一连接响应时,被控终端可以建立与主控终端之间的控制连接,使得主控终端可以对其进行控制。In the embodiment of the present invention, after the controlled terminal starts the installed APP, that is, after the user opens the client, the controlled terminal can perform a network check to determine whether the terminal is connected to the normal network, that is, check the network connection. If the network connection is abnormal, the controlled terminal can prompt the user to check the network connection, such as prompting the user to switch the network environment, that is, prompting the user to switch the network connection, and re-check the currently connected network. If it is detected that the network connection is normal, the controlled terminal may log in to the main page of the APP according to the first identification information, that is, log in to the page according to the first identification information corresponding to the controlled terminal. Specifically, when the network connected to the controlled terminal is normal, the user can choose different login modes to log in to the main page of the APP. For example, the user can choose the visitor mode to log in to the APP page, or the member mode to log in to the APP page. Select account mode to log in. Wherein, the logged-in account may include a mobile phone number, a user account, an account generated by default (referred to as the default account), etc., and may have a corresponding mapping relationship with the manufacturer information of the mobile terminal. The logged-in account can be used to determine the operating user, and can also determine the corresponding manufacturer information, identification information, etc., so that the mobile terminal operated by the operating user and the hardware information and/or software information of the mobile terminal can be determined, such as The operating system installed. After the controlled terminal logs in to the page, it can determine the second identification information according to the input information received on the page, so that it can send the first connection request to the main control terminal corresponding to the second identification information, so as to invite the main control terminal to perform control. When receiving the first connection response fed back by the controlling terminal for the first connection request, the controlled terminal may establish a control connection with the controlling terminal, so that the controlling terminal can control it.
作为本发明实施例的一个具体应用场景,当用户选择第一登录模式进行登录时,被控终端可以依据用户提交的选择操作生成对应的第一登录模式选择命令。其中,第一登录模式具体可以包括快速登录模式,如游客模式。当用户选择游客模式,被控终端可以不需要用户输入账号信息,自动为该用户分配一个默认账号,从而使得用户可以快速登录到APP的页面。可选的,依据被控终端对应第一标识信息登录页面,具体可以包括:当检测到第一登录模式选择命令时,检测本地是否存储有标识信息;在本地存储有标识信息时,检测所述标识信息是否与厂商信息关联;当所述标识信息不关联厂商信息,将所述标识信息作为默认账号对应的第一标识信息;当本地没有存储标识信息,或者所述标识信息关联厂商信息时,通过服务器生成默认账号对应的第一标识信息并保存;基于所述第一标识信息执行第一登录模式选择命令,以登录页面。As a specific application scenario of the embodiment of the present invention, when the user selects the first login mode to log in, the controlled terminal may generate a corresponding first login mode selection command according to the selection operation submitted by the user. Wherein, the first login mode may specifically include a quick login mode, such as a visitor mode. When the user selects the visitor mode, the controlled terminal may automatically assign a default account to the user without the user inputting account information, so that the user can quickly log in to the APP page. Optionally, according to the login page corresponding to the first identification information of the controlled terminal, it may specifically include: when the first login mode selection command is detected, detecting whether identification information is locally stored; when identification information is locally stored, detecting the Whether the identification information is associated with manufacturer information; when the identification information is not associated with manufacturer information, use the identification information as the first identification information corresponding to the default account; when there is no identification information stored locally, or the identification information is associated with manufacturer information, The first identification information corresponding to the default account is generated by the server and stored; and the first login mode selection command is executed based on the first identification information to log in to the page.
其中,厂商信息可以确定移动终端对应的硬件信息,如可以确移动终端的中央处理器的版本信息、内存的版本信息,进而可以确定移动终端对应的驱动接口。例如,该厂商信息可以包括国际移动设备识别码(International Mobile Equipment Identity,IMEI),可以具有对应的账号信息。该账号信息可以包括:手机号码、会员账号、用户账号等。Wherein, the manufacturer information can determine the hardware information corresponding to the mobile terminal, such as the version information of the central processing unit and the version information of the memory of the mobile terminal, and then can determine the corresponding driver interface of the mobile terminal. For example, the vendor information may include an International Mobile Equipment Identity (International Mobile Equipment Identity, IMEI), and may have corresponding account information. The account information may include: a mobile phone number, a member account, a user account, and the like.
作为本发明的一个具体示例,如图3所示,在网络正常时,若用户选择游客模式登录,如在游客登录时,则被控终端可以生成对应的第一登录模式选择命令;并且可以查询本地的UID,以判断本地是否存储有UID,即检 测本地是否存储有标识信息。若本地未存储有UID,如本地无UID,即本地没有存储标识信息,则被控终端生成UID,如通过服务器生成该被控终端对应的新UID,并且将该新UID作为被控终端对应的第一标识信息,以及保存在服务器中。当然,被控终端也可以将该新UID保存在本地的数据库中。若本地存储有标识信息,则被控终端可以检测本地所存储的标识信息是否与厂商信息关联,如当被控终端有本地UID时,即在本地有UID时,被控终端可以检测该本地UID是否与厂商信息关联。当所述标识信息不关联厂商信息,如在本地UID与厂商账号信息不关联时,可以将本地UID作为被控终端对应的第一标识信息,即将本地所存储的标识信息作为第一标识信息。当本地所存储的标识信息关联厂商信息时,如在本地UID已经关联了厂商信息时,可以通过服务器生成第一标识信息并保存。在确定第一标识信息后,被控终端可以基于该第一标识信息执行第一登录模式选择命令,从而进入到APP的主页面,即登录页面。当然,在退出登录页面时,被控终端可以删除本地UID,以避免被控终端被非法控制,保证被控终端的安全。As a specific example of the present invention, as shown in Figure 3, when the network is normal, if the user selects the visitor mode login, such as when the visitor logs in, the controlled terminal can generate a corresponding first login mode selection command; and can query The local UID is used to determine whether the UID is stored locally, that is, to detect whether identification information is stored locally. If there is no UID stored locally, such as no UID locally, that is, no identification information stored locally, the controlled terminal generates a UID, such as generating a new UID corresponding to the controlled terminal through the server, and uses the new UID as the corresponding The first identification information is stored in the server. Certainly, the controlled terminal may also save the new UID in a local database. If the identification information is stored locally, the controlled terminal can detect whether the locally stored identification information is associated with the manufacturer information. For example, when the controlled terminal has a local UID, that is, when there is a local UID, the controlled terminal can detect the local UID Whether to associate with vendor information. When the identification information is not associated with vendor information, for example, when the local UID is not associated with vendor account information, the local UID can be used as the first identification information corresponding to the controlled terminal, that is, the locally stored identification information can be used as the first identification information. When the locally stored identification information is associated with manufacturer information, for example, when the local UID has been associated with manufacturer information, the first identification information may be generated and stored by the server. After determining the first identification information, the controlled terminal may execute a first login mode selection command based on the first identification information, thereby entering the main page of the APP, that is, the login page. Of course, when exiting the login page, the controlled terminal can delete the local UID, so as to prevent the controlled terminal from being illegally controlled and ensure the security of the controlled terminal.
作为本发明实施例的另一个具体应用场景,当用户选择第二登录模式进行登录时,被控终端可以依据用户提交的选择操作生成对应的第二登录模式选择命令。其中,第二登录模式具体可以包括会员登录模式,如账号模式。当用户选择账号模式,可以向被控终端输入账号信息,如手机号码、会员账号等登录账号,从而使得被控终端通过软件开发工具包(Software Development Kit,SDK)读取预置的本机账号信息,确定账号信息对应的厂商信息,并基于该厂商信息进行登录。其中,厂商信息可以用于确定移动终端,如IMEI。可选的,依据被控终端对应第一标识信息登录页面,具体可以包括:当检测到第二登录模式选择命令时,检测登录对应的厂商信息;当检测到厂商信息时,采用所述厂商信息进行账号登录;在账号登录后,检测本地是否存储有标识信息;当本地存储有标识信息时,检测所述标识信息是否与离线标识信息匹配;当所述标识信息与离线标识信息匹配时,将所述标识信息作为第一标识信息,并登录页面。As another specific application scenario of the embodiment of the present invention, when the user selects the second login mode to log in, the controlled terminal may generate a corresponding second login mode selection command according to the selection operation submitted by the user. Wherein, the second login mode may specifically include a member login mode, such as an account mode. When the user selects the account mode, he can input account information to the controlled terminal, such as mobile phone number, membership account and other login accounts, so that the controlled terminal can read the preset local account through the software development kit (Software Development Kit, SDK) information, determine the vendor information corresponding to the account information, and log in based on the vendor information. Among them, the vendor information can be used to determine the mobile terminal, such as IMEI. Optionally, according to the login page corresponding to the first identification information of the controlled terminal, it may specifically include: when detecting the second login mode selection command, detecting the manufacturer information corresponding to the login; when detecting the manufacturer information, using the manufacturer information Perform account login; after account login, detect whether identification information is stored locally; when identification information is stored locally, detect whether the identification information matches the offline identification information; when the identification information matches the offline identification information, set The identification information is used as the first identification information, and is logged into the page.
作为本发明的另一个具体示例,如图4所示,当用户选择会员模式登录时,如在账号登录时,被控终端可以生成对应的第二登录模式选择命令;并且可以检测账号信息对应的厂商信息,如通过预置的厂商账户SDK读取本机账户信息,以检测本地是否存储有登录的账号对应的厂商信息;或者检测用户提交的输入信息是否符合预置账号信息的数据格式,以判断输入信息是否为账号信息,当输入信息符合预置账号信息的数据格式,确定输入信息为账号信息,以及通过预置的厂商账户SDK检测该账号信息对应的厂商信息。当本地存储有厂商信息,可以确定被控终端对应的硬件信息,如确定被控终端对应的驱动接口、被控终端的处理器信息、内存信息等,并且可以采用检测到的厂商信息进行账号登录,即基于厂商信息进行账号登录。若被控终端未检测厂商信息时,如当本地未存储有厂商信息,被控终端可以调用该厂商信息对应的注册页面,从而使得用户可以通过该注册页面进行注册,如在注册页面上输入被控终端对应的IMEI,以完成厂商信息注册,如创建移动终端的厂商信息与用户的登录账号对应的映射关系,并进行保存。As another specific example of the present invention, as shown in FIG. 4, when the user selects membership mode login, such as account login, the controlled terminal can generate a corresponding second login mode selection command; and can detect the corresponding Manufacturer information, such as reading the local account information through the preset manufacturer account SDK to detect whether the manufacturer information corresponding to the logged-in account is stored locally; or to detect whether the input information submitted by the user conforms to the data format of the preset account information. Determine whether the input information is account information, and when the input information conforms to the data format of the preset account information, determine that the input information is account information, and detect the manufacturer information corresponding to the account information through the preset manufacturer account SDK. When the manufacturer information is stored locally, the hardware information corresponding to the controlled terminal can be determined, such as the driver interface corresponding to the controlled terminal, processor information, memory information, etc. of the controlled terminal, and the detected manufacturer information can be used for account login , that is, account login based on manufacturer information. If the controlled terminal does not detect the manufacturer information, such as when there is no manufacturer information stored locally, the controlled terminal can call the registration page corresponding to the manufacturer information, so that the user can register through the registration page. The IMEI corresponding to the control terminal is used to complete the registration of manufacturer information, such as creating a mapping relationship between the manufacturer information of the mobile terminal and the user's login account, and saving it.
在本发明的一种优选实施例中,依据被控终端对应第一标识信息登录页面,还包括:当未检测到厂商信息时,调用所述厂商信息对应的注册页面;依据所述注册页面,生成厂商信息,以执行账号登录的步骤。具体的,当用户选择第二登录模式,且没有对应的厂商信息时,被控终端可以调出厂商信息对应的注册页面,如调出厂商信息的注册页面并显示在显示屏上,从而使得用户可以在该注册页面上输入注册信息,以申请获得该厂商信息对应的账号信息。被控终端依据注册页面接收到的输入信息进行注册,如当用户在注册页面输入的注册信息时,被控终端可以根据该注册信息进行注册,生成对应的账号信息,从而可以基于生成的账号信息识别到被控终端的厂商信息,以及采用该生成的厂商信息进行账号登录,即执行账号登录的步骤。由此可见,本实施例在被控终端未检测到厂商信息时,可以通过调用对应的注册页面进行注册,生成厂商信息,实现了账号登录,从而可以基于该厂商信息建立控制连接。In a preferred embodiment of the present invention, according to the login page corresponding to the first identification information of the controlled terminal, it further includes: calling a registration page corresponding to the manufacturer information when no manufacturer information is detected; according to the registration page, Generate vendor information to perform account login steps. Specifically, when the user selects the second login mode and there is no corresponding manufacturer information, the controlled terminal can call out the registration page corresponding to the manufacturer information, such as calling out the registration page of the manufacturer information and displaying it on the display screen, so that the user You can enter the registration information on the registration page to apply for the account information corresponding to the manufacturer information. The controlled terminal registers according to the input information received on the registration page. For example, when the user enters the registration information on the registration page, the controlled terminal can register according to the registration information and generate corresponding account information, so that the account information can be generated based on the generated account information. Identifying the manufacturer information of the controlled terminal, and using the generated manufacturer information to log in the account is to execute the step of account login. It can be seen that in this embodiment, when the controlled terminal does not detect vendor information, it can register by calling the corresponding registration page, generate vendor information, and realize account login, so that a control connection can be established based on the vendor information.
在账号登录后,被控终端可以检测本地是否存储有标识信息,如检测本地是否有UID。当本地存储有标识信息时,如在本地存有UID时,被控终端可以检测本地所存储的标识信息是否与离线标识信息匹配,如检测本地UID是否与登录的厂商信息对应的离线UID匹配,即验证离线UID数据。若本地UID与离线UID匹配,则可以执行第二登录模式选择命令,以进入APP的主页面,即当本地所存储的标识信息与离线标识信息匹配时,将本地所存储的标识信息作为被控终端对应的第一标识信息,登录页面。After the account is logged in, the controlled terminal can detect whether identification information is stored locally, such as detecting whether there is a UID locally. When the identification information is stored locally, such as when there is a UID locally, the controlled terminal can detect whether the locally stored identification information matches the offline identification information, such as detecting whether the local UID matches the offline UID corresponding to the registered manufacturer information, That is, to verify offline UID data. If the local UID matches the offline UID, the second login mode selection command can be executed to enter the main page of the APP, that is, when the locally stored identification information matches the offline identification information, the locally stored identification information is used as the controlled The first identification information corresponding to the terminal, and the login page.
在本发明的一种优选实施例中,依据被控终端对应第一标识信息登录页面,还包括:当本地存储的标识信息与离线标识信息不匹配时,检测所述厂商信息是否与第三标识信息关联;当所述厂商信息不关联第三标识信息时,将所述标识信息作为所述厂商信息对应的第一标识信息,并登录页面;当所述厂商信息关联第三标识信息时,删除所述标识信息,以及采用所述厂商信息生成对应的第一标识信息,并登录页面。具体的,当被控终端检测到本地所存储的标识信息与离线标识信息不匹配时,如在本地UID与离线UID不一致时,可以检测登录的厂商信息是否与第三标识信息关联,如检测本地的厂商信息是否与其他UID关联,即判断本地账号是否关联其他UID。若厂商信息不关联第三标识信息,则被控终端可以将本地所存储的标识信息作为厂商信息对应的第一标识信息,如使用本地UID合并厂商信息,从而可以基于该第一标识信息进入到APP的主页面,从而可以连接到应用程序的服务器(简称应用服务器)。若厂商信息关联第三标识信息,则被控终端可以删除本地所存储的标识信息,如删除本地UID,然后采用该厂商信息生成对应的第一标识信息,即生成新的UID以进入到APP的主页面,如基于该厂商信息进行登录,从而可以连接到服务器。In a preferred embodiment of the present invention, according to the controlled terminal corresponding to the first identification information login page, it also includes: when the locally stored identification information does not match the offline identification information, detecting whether the vendor information is consistent with the third identification information Information association; when the vendor information is not associated with the third identification information, use the identification information as the first identification information corresponding to the vendor information, and log in to the page; when the vendor information is associated with the third identification information, delete The identification information, and using the manufacturer information to generate corresponding first identification information, and log in to the page. Specifically, when the controlled terminal detects that the locally stored identification information does not match the offline identification information, such as when the local UID is inconsistent with the offline UID, it can detect whether the registered manufacturer information is associated with the third identification information, such as detecting that the local Whether the vendor information is associated with other UIDs, that is, to determine whether the local account is associated with other UIDs. If the manufacturer information is not associated with the third identification information, the controlled terminal can use the locally stored identification information as the first identification information corresponding to the manufacturer information, for example, use the local UID to merge the manufacturer information, so that it can enter the The main page of the APP, so that it can be connected to the server of the application program (referred to as the application server). If the manufacturer information is associated with the third identification information, the controlled terminal can delete the locally stored identification information, such as deleting the local UID, and then use the manufacturer information to generate the corresponding first identification information, that is, generate a new UID to enter the APP. The main page, such as logging in based on the manufacturer information, can connect to the server.
可选的,依据被控终端对应第一标识信息登录页面,还包括:当本地没有存储标识信息时,检测服务器是否存储有所述厂商信息对应的第一标识信息;当检测到服务器存储有第一标识信息时,登录页面,并保存所述厂商信息;当服务器没有存储有所述第一标识信息时,通过服务器生成 第一标识信息并保存,登录页面。例如,当本地没有存储标识信息时,如在确定被控终端未存储有本地UID时,可以检测服务器是否存储有该厂商信息对应的第一标识信息,如校验服务器所存储的UID数据,以确定服务器是否存储有该厂商信息对应的UID。若服务器存储厂商信息对应的UID数据,则可以确定服务器存储有该第一标识信息,从而可以基于该第一标识信息登录页面;若服务器未存储厂商信息对应的UID数据,则可以确定服务器未存储该第一标识信息时,可以通过服务器针对该厂商信息生成第一标识信息,如生成登录的账号对应的UID,即生成该厂商信息对应的UID;并且可以对生成的UID进行保存,如将该第一标识信息保存在被控终端和/或服务器中,从而可以基于生成的第一标识信息进行登录,进入到APP的主页面。Optionally, according to the login page corresponding to the first identification information of the controlled terminal, it also includes: when no identification information is stored locally, detecting whether the server stores the first identification information corresponding to the manufacturer information; When there is identification information, log in to the page, and save the manufacturer information; when the server does not store the first identification information, generate and save the first identification information through the server, and log in to the page. For example, when there is no identification information stored locally, such as when it is determined that the controlled terminal does not store a local UID, it may be detected whether the server stores the first identification information corresponding to the vendor information, such as verifying the UID data stored by the server, to Determine whether the server stores the UID corresponding to the vendor information. If the server stores the UID data corresponding to the manufacturer information, it can be determined that the server stores the first identification information, so that the page can be logged in based on the first identification information; if the server does not store the UID data corresponding to the manufacturer information, it can be determined that the server does not store For the first identification information, the server can generate the first identification information for the vendor information, such as generating the UID corresponding to the account that is logged in, that is, generating the UID corresponding to the vendor information; and the generated UID can be saved, such as the The first identification information is stored in the controlled terminal and/or the server, so that a login can be performed based on the generated first identification information, and the main page of the APP can be entered.
在登录页面后,被控终端可以接收其他移动终端所发送的消息,如接收主控终端所发送的第二连接请求、接收主控终端所反馈的第一连接响应等;也可以向其他移动终端发送消息,如向主控终端发送第一连接请求、向被控终端发送第二连接响应等。After logging in to the page, the controlled terminal can receive messages sent by other mobile terminals, such as receiving the second connection request sent by the master terminal, receiving the first connection response fed back by the master terminal, etc.; Sending messages, such as sending a first connection request to the controlling terminal, sending a second connection response to the controlled terminal, and so on.
作为本发明的一个具体示例,当被控终端在进入APP的主页面后,用户可以在主页面输入信息。被控终端可以通过监听主页面,可以检测到用户在主页面上提交的输入信息,即在页面接收到输入信息,并且可以检测输入信息是否符合预设格式。当输入信息不符合预设格式时,被控终端可以确定输入信息错误,并且可以提示用户该输入信息不符合预设格式,即提示用户重新输入符合预设格式的信息。当接收到符合预设格式的输入信息时,被控终端可以检验该输入信息的有效性,以确定该输入信息是否具有对应的第二标识信息,如在接收到手机号码时,检测该手机号码是否为已经注册的手机号码;在检测到该输入信息有效时,如检测到输入的手机号码为注册的手机号码时,即该输入的手机号码具有对应的第二标识信息,被控终端可以获取该输入信息对应的第二标识信息,以确定主控终端。当然,被控终端可以检测到输入信息无效时,即在获取不到输入信息对应的第二标识信息时,如在手机号码未注册时, 获取不到该手机号码对应的第二标识信息时,可以用户提示该手机号码未注册,不能确定未注册的手机号码对应的移动终端,即不能确定主控终端。As a specific example of the present invention, after the controlled terminal enters the main page of the APP, the user can input information on the main page. The controlled terminal can detect the input information submitted by the user on the main page by monitoring the main page, that is, the input information is received on the page, and can detect whether the input information conforms to the preset format. When the input information does not conform to the preset format, the controlled terminal can determine that the input information is wrong, and can prompt the user that the input information does not conform to the preset format, that is, prompt the user to re-enter information conforming to the preset format. When receiving input information conforming to the preset format, the controlled terminal can check the validity of the input information to determine whether the input information has the corresponding second identification information, such as when receiving a mobile phone number, detect the mobile phone number Whether it is a registered mobile phone number; when it is detected that the input information is valid, such as when it is detected that the input mobile phone number is a registered mobile phone number, that is, the input mobile phone number has corresponding second identification information, and the controlled terminal can obtain The second identification information corresponding to the input information is used to determine the master terminal. Of course, when the controlled terminal can detect that the input information is invalid, that is, when the second identification information corresponding to the input information cannot be obtained, such as when the mobile phone number is not registered, when the second identification information corresponding to the mobile phone number cannot be obtained, The user may be prompted that the mobile phone number is not registered, and the mobile terminal corresponding to the unregistered mobile phone number cannot be determined, that is, the main control terminal cannot be determined.
在确定主控终端后,被控终端可以向主控终端发送第一连接请求,以邀请主控终端对其进行控制。本实施例中,被控终端在获取得到第二标识信息后,可以检测第二标识信息是否与第一标识信息具有特征关系,如检测第二标识信息对应的用户是否与第一标识信息对应的用户具有好友关系,即检测使用主控终端的用户是否为使用被控终端的用户的联系人。当第二标识信息与第一标识信息不具有特征关系,如在使用主控终端的用户不是使用被控终端的用户的联系人时,可以向主控终端发送特征关系添加请求,如被控终端可以向当前用户提示添加该输入信息对应的用户为好友或者联系人,从而可以在检测到当前用户针对好友添加提交的操作生成对应的好友添加请求,并将好友添加请求发送给输入信息对应的用户所操作的移动终端,即将特征关系添加请求发送给主控终端。当接收到主控终端针对该特征关系添加请求所反馈的确认响应消息时,可以创建第二标识信息与第一标识信息的特征关系。当第二标识信息与第一标识信息具有特征关系,被控终端可以向所述主控终端发送第一连接请求。After the controlling terminal is determined, the controlled terminal may send a first connection request to the controlling terminal to invite the controlling terminal to control it. In this embodiment, after obtaining the second identification information, the controlled terminal can detect whether the second identification information has a characteristic relationship with the first identification information, such as detecting whether the user corresponding to the second identification information corresponds to the first identification information The user has a friend relationship, that is, it is detected whether the user using the controlling terminal is a contact of the user using the controlled terminal. When the second identification information does not have a characteristic relationship with the first identification information, such as when the user using the controlling terminal is not a contact of the user using the controlled terminal, a request for adding a characteristic relationship may be sent to the controlling terminal, such as the controlled terminal The current user may be prompted to add that the user corresponding to the input information is a friend or a contact, so that when it is detected that the current user submits an operation for adding a friend, a corresponding friend addition request is generated, and the friend addition request is sent to the user corresponding to the input information The operated mobile terminal sends a feature relationship adding request to the main control terminal. When receiving the confirmation response message fed back by the master terminal for the feature relationship addition request, the feature relationship between the second identification information and the first identification information may be created. When the second identification information has a characteristic relationship with the first identification information, the controlled terminal may send a first connection request to the controlling terminal.
在发送第一连接请求后,被控终端可以判断在预设时间范围内是否检测到主控终端反馈的第一连接响应;当在预设时间范围内未检测到所述第一连接响应,确定所述控制连接建立失败;当在预设时间范围内检测到所述第一连接响应,执行建立所述控制连接的步骤,以及确定控制连接建立成功。例如,在第二标识信息与第一标识信息之间的特征关系成功创建后,如在主控终端所登录的账号信息与被控终端所登录的账号信息建立好友关系后,被控终端可以依据用户的操作生成第一连接请求,向服务器发送第一连接请求,该第一连接请求可以携带有主控终端所登录的账号信息。主控终端所登录的账号信息可以用于确定主控终端对应的第二标识信息。例如,服务器可以根据第一连接请求所携带的主控终端所登录的账号信息确定第二标识信息,从而可以将该第一连接请求发送给第二标识信息对应的主控终端。 在转发第一连接请求后,服务器可以获取当前的网络时间,以判断在预设时间范围内是否检测到主控终端针对第一连接请求反馈的第一连接响应,如判断在预设的10分钟内是否检测到主控终端反馈的第一连接响应。若在预设时间范围内未检测到第一连接响应,如在预设的10分钟内未检测到主控终端反馈的第一连接响应时,则服务器可以确定此次控制连接失败,并且可以生成连接失败的消息,以及将连接失败的消息发送给被控终端,以通知被控终端当前的控制连接失败。当然,服务器也可以在检测到主控终端连接服务器时,再次向主控终端发送第一连接请求。若在预设时间范围内检测到主控终端反馈的第一连接响应,则服务器可以将该第一连接响应转发给第一标识信息对应的被控终端,使得被控终端建立与主控终端之间的控制连接,即执行建立所述控制连接的步骤,如通过服务器建立被控终端与主控终端之间的控制连接,以及可以生成控制连接成功的消息,即确定控制连接建立成功。After sending the first connection request, the controlled terminal can determine whether the first connection response fed back by the master terminal is detected within the preset time range; if the first connection response is not detected within the preset time range, determine The establishment of the control connection fails; when the first connection response is detected within a preset time range, the step of establishing the control connection is performed, and it is determined that the control connection is successfully established. For example, after the feature relationship between the second identification information and the first identification information is successfully established, for example, after the account information logged in by the controlling terminal establishes a friend relationship with the account information logged in by the controlled terminal, the controlled terminal may, according to The user's operation generates a first connection request, and sends the first connection request to the server, where the first connection request may carry account information logged in by the master terminal. The account information logged in by the master control terminal may be used to determine the second identification information corresponding to the master control terminal. For example, the server may determine the second identification information according to the account information logged in by the main control terminal carried in the first connection request, so that the first connection request may be sent to the main control terminal corresponding to the second identification information. After forwarding the first connection request, the server can obtain the current network time to determine whether the first connection response fed back by the master terminal for the first connection request is detected within the preset time range, such as judging that within the preset 10 minutes Whether the first connection response fed back by the master control terminal is detected within. If the first connection response is not detected within the preset time range, for example, if the first connection response fed back by the main control terminal is not detected within the preset 10 minutes, the server may determine that the control connection failed this time, and may generate A connection failure message, and sending the connection failure message to the controlled terminal, so as to notify the controlled terminal that the current control connection fails. Certainly, the server may also send the first connection request to the main control terminal again when detecting that the main control terminal is connected to the server. If the first connection response fed back by the controlling terminal is detected within the preset time range, the server may forward the first connection response to the controlled terminal corresponding to the first identification information, so that the controlled terminal establishes a connection with the controlling terminal. The control connection between, that is, execute the step of establishing the control connection, such as establishing the control connection between the controlled terminal and the controlling terminal through the server, and may generate a message that the control connection is successful, that is, determine that the control connection is successfully established.
作为本发明的另一个具体示例,当被控终端在进入APP的主页面后,可以接收到其他移动终端所发送的消息,如在登录页面后,接收服务器转发的主控终端所提交的第二连接请求。在接收到第二连接请求后,被控终端可以基于用户针对该第二连接请求提交的操作,如提交的操作为确认操作,即在当前用户允许主控终端控制被控终端时,生成第二连接响应,即对所述第二连接请求进行响应,生成对应的第二连接响应;以及将所述第二连接响应发送所述服务器,以建立所述控制连接。其中,所述服务器用于将第二连接响应反馈给主控终端。As another specific example of the present invention, when the controlled terminal enters the main page of the APP, it can receive messages sent by other mobile terminals, such as after logging in to the page, receiving the second message submitted by the master terminal forwarded by the server. Connection request. After receiving the second connection request, the controlled terminal may generate a second connection request based on the operation submitted by the user for the second connection request, if the submitted operation is a confirmation operation, that is, when the current user allows the master terminal to control the controlled terminal A connection response, that is, responding to the second connection request, generating a corresponding second connection response; and sending the second connection response to the server, so as to establish the control connection. Wherein, the server is configured to feed back the second connection response to the main control terminal.
具体的,服务器在接收到主控终端针对被控终端所发送的第二连接请求时,可以根据第二连接请请求所携带的第一标识信息确定被控终端,从而将第二连接请求转发给被控终端,使得被控终端可以接接收到第二连接请求。被控终端在接收到第二连接请求时,可以依据该第二连接请求进行显示,以接收到用户针对该第二连接请求提交的操作,如确认操作或拒绝操作。当提交的操作为拒绝操作时,被控终端可以确定用户拒绝该连接请求,即用户不允许发送该第二连接请求的主控终端控制被控 终端,以及可以生成第二连接拒绝消息并反馈给服务器,从而可以通知主控终端建立控制连接失败。当提交的操作为确认操作时,被控终端可以确定用户允许发送该第二连接请求的主控终端对其进行控制,以及可以生成第二连接响应并反馈给服务器,从而可以通过服务器建立与主控终端之间的控制连接,并在控制连接建立后,可以生成对应的成功建立消息,以确定控制连接建立成功。Specifically, when the server receives the second connection request sent by the controlling terminal for the controlled terminal, it may determine the controlled terminal according to the first identification information carried in the second connection request, so as to forward the second connection request to the The controlled terminal enables the controlled terminal to receive the second connection request. When receiving the second connection request, the controlled terminal may display according to the second connection request, so as to receive an operation submitted by the user for the second connection request, such as a confirmation operation or a rejection operation. When the submitted operation is a rejection operation, the controlled terminal can determine that the user rejects the connection request, that is, the user does not allow the master terminal that sends the second connection request to control the controlled terminal, and can generate a second connection rejection message and feed it back to server, so that the main control terminal can be notified of the failure to establish a control connection. When the submitted operation is a confirmation operation, the controlled terminal can determine that the user allows the master terminal that sends the second connection request to control it, and can generate a second connection response and feed it back to the server, so that the server can establish a connection with the master The control connection between the control terminals can be established, and after the control connection is established, a corresponding successful establishment message can be generated to determine that the control connection is established successfully.
步骤204,依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息。Step 204, taking a screenshot of the current display interface according to the system authority information to generate screen image information.
在本发明的一种优选实施例中,依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息,具体可以包括如下子步骤:In a preferred embodiment of the present invention, the current display interface is screened according to the system authority information to generate screen image information, which may specifically include the following sub-steps:
子步骤2040,获取被控终端的系统权限信息。Sub-step 2040, acquire system authority information of the controlled terminal.
子步骤2042,基于所述系统权限信息对显示界面进行截屏,得到屏幕图像。Sub-step 2042, take a screenshot of the display interface based on the system authority information to obtain a screen image.
子步骤2044,对所述屏幕图像进行压缩处理,生成屏幕图像信息。Sub-step 2044, compressing the screen image to generate screen image information.
本实施例中,被控终端在建立与主控终端之间的控制连接后,可以获取操作系统的系统权限信息,从而可以实时地对显示界面进行截屏,如被控终端可以按照预设的截屏时间间隔对显示屏幕进行截屏,得到当前对应的屏幕图像;采用预设的压缩算法对屏幕图像进行压缩处理,生成压缩后的屏幕图像信息。In this embodiment, after the controlled terminal establishes a control connection with the main control terminal, it can obtain the system authority information of the operating system, so that it can capture the screen of the display interface in real time. For example, the controlled terminal can capture the screen according to the preset Take screenshots of the display screen at time intervals to obtain the current corresponding screen image; use a preset compression algorithm to compress the screen image to generate compressed screen image information.
步骤206,基于所述控制连接,将所述屏幕图像信息发送给主控终端。Step 206: Send the screen image information to the main control terminal based on the control connection.
本实施例中,被控终端可以利用预设算法将屏幕图像信息发送给服务器,以通过服务器将所述屏幕图像信息转发给主控终端。例如,被控终端基于控制连接,可以采用预设的差分算法将压缩后的屏幕图像信息发送给服务器,以通过服务器将该压缩后的屏幕图像信息转发给主控终端。其中,被控终端利用差分算法发送压缩后的屏幕图像信息,可以减少传送的数据量。其中,服务器可以包括网路服务器、应用服务器等。In this embodiment, the controlled terminal may use a preset algorithm to send the screen image information to the server, so as to forward the screen image information to the controlling terminal through the server. For example, based on the control connection, the controlled terminal may use a preset differential algorithm to send the compressed screen image information to the server, so that the compressed screen image information may be forwarded to the controlling terminal through the server. Wherein, the controlled terminal sends the compressed screen image information by using the differential algorithm, which can reduce the amount of transmitted data. Wherein, the server may include a network server, an application server, and the like.
步骤208,当接收到服务器转发主控终端所反馈的操作信息时,对所述操作信息进行解析,确定操作事件。Step 208, when receiving the operation information fed back by the master terminal forwarded by the server, analyze the operation information to determine the operation event.
在本实施例终端,主控终端在接收到服务器所转发的屏幕图像信息后,可以对该屏幕图像信息进行解析,生成对应的显示图像,以显示被控终端对应的显示界面。当用户在显示图像上进行操作时,主控终端可以基于用户操作生成操作信息,即依据显示图像对应的输入操作生成操作信息,并将该操作信息反馈给服务器,以通过服务器将该操作信息发送给第一标识信息对应的被控终端。被控终端在接收到服务器转发主控终端所反馈的操作信息时,可以对该操作信息进行解析,确定操作事件。例如,被控终端通过解析操作信息可以获取到操作位置信息和操作时间,从而可以基于该操作位置信息和操作时间确定长按操作事件;也可以通过解析操作信息获取到按压操作对应的按压信息,如按压操作的按压点的位置信息和按压操作对应的压力信息,从而可以确定对应的按压操作事件;还可以通过解析操作信息获取到滑动操作对应的滑动信息,如滑动的轨迹信息,确定滑动操作事件。In the terminal of this embodiment, after receiving the screen image information forwarded by the server, the master control terminal may analyze the screen image information to generate a corresponding display image to display the corresponding display interface of the controlled terminal. When the user operates on the displayed image, the main control terminal can generate operation information based on the user operation, that is, generate operation information according to the input operation corresponding to the displayed image, and feed back the operation information to the server, so that the operation information can be sent through the server to the controlled terminal corresponding to the first identification information. When the controlled terminal receives the operation information fed back by the master terminal forwarded by the server, it may analyze the operation information to determine the operation event. For example, the controlled terminal can obtain the operation location information and operation time by parsing the operation information, so that the long press operation event can be determined based on the operation location information and operation time; it can also obtain the press information corresponding to the press operation by parsing the operation information, For example, the position information of the pressing point of the pressing operation and the pressure information corresponding to the pressing operation, so that the corresponding pressing operation event can be determined; the sliding information corresponding to the sliding operation can also be obtained by analyzing the operation information, such as the sliding track information, to determine the sliding operation event.
步骤210,通过调用应用程序编程接口,将所述操作事件添加到输入队列中。Step 210, adding the operation event to an input queue by calling an application programming interface.
其中,所述输入队列用于按照添加顺序执行操作事件。例如,被控终端可以基于获取的系统权限信息,调用系统的API,以通过API将确定的操作事件event添加到输入队列raw input中,从而实现主控终端对被控终端的控制。Wherein, the input queue is used to execute operation events in the order of addition. For example, the controlled terminal can call the API of the system based on the obtained system authority information, so as to add the determined operation event event to the input queue raw input through the API, so as to realize the control of the controlled terminal by the controlling terminal.
实施例二Embodiment two
本实施例论述主控终端侧的移动终端控制方法步骤。This embodiment discusses the steps of the mobile terminal control method on the main control terminal side.
参照图5,示出了根据本发明的另一种控制移动终端的方法实施例的步骤流程图,具体可以包括如下步骤:Referring to FIG. 5 , it shows a flow chart of steps according to another embodiment of a method for controlling a mobile terminal according to the present invention, which may specifically include the following steps:
步骤502,预先与被控终端建立控制连接。Step 502, establishing a control connection with the controlled terminal in advance.
在本实施例中,主控终端可以通过启动应用程序登录页面,以及生成对应的主控登录信息,该主控登录信息可以携带有主控终端对应的第二标识信息。在登录页面后,主控终端可以依据用户在页面上提交的操作,生成针对被控终端的第二连接请求;并且可以通过连接网络,将第二连接请求发送服 务器,通过服务器将该第二连接请求转发给被控终端,以请求对被控终端进行控制。其中,第二连接请求可以携带有被控终端对应的第一标识信息、主控终端对应的第二标识信息等。若被控终端对第二连接请求进行响应,生成第二连接响应并反馈给服务器,则服务器可以将该第二连接响应转发给主控终端,从而建立主控终端与被控终端之间的控制连接,使得主控终端可以对被控终端进行控制。当然,主控终端在接收被控终端所发送的第一连接请求时,可以对该第一连接请求进行响应,生成第一连接响应并发送该服务器,通过服务器将第一连接响应转发给被控终端,以建立与被控终端之间的控制连接,从而可以对被控终端进行控制。In this embodiment, the master control terminal may log in to the page by starting the application program, and generate corresponding master control login information, and the master control login information may carry the second identification information corresponding to the master control terminal. After logging in to the page, the controlling terminal can generate a second connection request for the controlled terminal according to the operation submitted by the user on the page; The request is forwarded to the controlled terminal, so as to request to control the controlled terminal. Wherein, the second connection request may carry first identification information corresponding to the controlled terminal, second identification information corresponding to the controlling terminal, and the like. If the controlled terminal responds to the second connection request, generates a second connection response and feeds it back to the server, the server can forward the second connection response to the master terminal, thereby establishing a control between the master terminal and the controlled terminal. connection so that the controlling terminal can control the controlled terminal. Certainly, when receiving the first connection request sent by the controlled terminal, the controlling terminal may respond to the first connection request, generate a first connection response and send it to the server, and forward the first connection response to the controlled terminal through the server. terminal to establish a control connection with the controlled terminal, so that the controlled terminal can be controlled.
步骤504,基于所述控制连接,接收所述被控终端所发送的屏幕图像信息。Step 504: Based on the control connection, receive screen image information sent by the controlled terminal.
步骤506,对屏幕图像信息进行解析处理,生成显示图像并展示。Step 506, analyzing and processing the screen image information, generating and displaying a display image.
在建立控制连接后,主控终端可以通过服务器接收到被控终端所发送的屏幕图像信息,以及可以对接收到的屏幕图像信息进行解析处理,生成被控终端对应的显示图像,并展示在显示屏幕上,从而使得用户可以在该显示图像上进行操作,如输入信息、点击显示图像上某一位置或双击显示图像上某一显示图标等。After the control connection is established, the master control terminal can receive the screen image information sent by the controlled terminal through the server, and can analyze and process the received screen image information to generate a display image corresponding to the controlled terminal, and display it on the display on the screen, so that the user can perform operations on the displayed image, such as inputting information, clicking a certain position on the displayed image, or double-clicking a certain displayed icon on the displayed image, etc.
步骤508,依据所述显示图像对应的输入操作,生成操作信息。Step 508, generating operation information according to the input operation corresponding to the displayed image.
主控终端可以对显示图像进行监听,从而可以监听到用户在显示图像上提交的输入操作,如点击操作、长按操作、滑动操作、按压操作等,生成对应的操作信息。其中,该操作信息具体可以包括操作位置、操作时间,具体可以包括在该显示图像上的按压时间、按压操作的按压点的位置、按压操作对应的压力信息、滑动操作对应的滑动信息等。The main control terminal can monitor the displayed image, so as to monitor the input operation submitted by the user on the displayed image, such as click operation, long press operation, slide operation, press operation, etc., and generate corresponding operation information. Wherein, the operation information may specifically include the operation position and operation time, specifically may include the pressing time on the display image, the position of the pressing point of the pressing operation, the pressure information corresponding to the pressing operation, the sliding information corresponding to the sliding operation, and the like.
步骤510,将所述操作信息发送给被控终端,以控制被控终端。Step 510, sending the operation information to the controlled terminal, so as to control the controlled terminal.
主控终端在生成操作信息后,可以基于控制连接将所生成的操作信息发送给服务器,通过服务器将该操作信息转发给被控终端,以使被控终端依据该操作信息生成对应的操作事件并执行,从而实现了主控终端对被控终端的控制,即用户可以通过主控终端远程控制其他用户的被控终端,以帮助其他 用户解决其在使用被控终端过程中所遇到的问题,即远程控制被控终端,以解决被控终端所存在的使用不方便的问题。After the master control terminal generates the operation information, it can send the generated operation information to the server based on the control connection, and forward the operation information to the controlled terminal through the server, so that the controlled terminal generates a corresponding operation event based on the operation information and Execution, so as to realize the control of the controlled terminal by the main control terminal, that is, the user can remotely control the controlled terminal of other users through the main control terminal, so as to help other users solve the problems encountered in the process of using the controlled terminal, That is to remotely control the controlled terminal to solve the problem of inconvenient use of the controlled terminal.
需要说明的是,主控终端与被控终端建立控制连接的实现过程和被控终端与主控终端建立控制连接的实现过程基本一致,为避免重复,本实施例不再赘述。可选的,主控终端与被控终端建立控制连接,具体可以包括:接收被控终端所发送的第一连接请求;对第一连接请求进行响应,生成对应的第一连接响应;将所述第一连接响应反馈给被控终端,以建立所述控制连接。当然,主控终端在登录页面后,也可以向服务器发送第二连接请求,以通过所述服务器将所述第二连接请求转发给被控终端;当接收到服务器转发的被控终端反馈的第二连接响应时,建立所述控制连接。It should be noted that the implementation process of establishing a control connection between the controlling terminal and the controlled terminal is basically the same as that of establishing the control connection between the controlled terminal and the controlling terminal. To avoid repetition, this embodiment will not repeat them. Optionally, establishing a control connection between the controlling terminal and the controlled terminal may specifically include: receiving a first connection request sent by the controlled terminal; responding to the first connection request, and generating a corresponding first connection response; The first connection response is fed back to the controlled terminal, so as to establish the control connection. Of course, after logging in to the page, the master control terminal may also send a second connection request to the server, so as to forward the second connection request to the controlled terminal through the server; When the second connection responds, establish the control connection.
在本发明实施例的一种优选实施例中,当输入操作为长按操作时,主控终端终端依据所述显示图像对应的输入操作,生成操作信息,具体可以包括:获取所述长按操作在所述显示图像上的操作位置;计算所述长按操作的操作时间;采用所述操作时间和操作位置,生成对应的操作信息。In a preferred embodiment of the embodiment of the present invention, when the input operation is a long press operation, the main control terminal terminal generates operation information according to the input operation corresponding to the displayed image, which may specifically include: acquiring the long press operation The operation position on the display image; calculating the operation time of the long press operation; using the operation time and operation position to generate corresponding operation information.
作为本实施例的一种具体应用场景,主控终端在展示被控终端对应的显示图像后,若监听到用户在显示图像上提交的长按操作,则可以检测该长按操作的按压点,确定该按压点在显示图像上对应的操作位置,即获取所述长按操作在所述显示图像上的操作位置;并且可以计算长按操作的操作时间;从而可以基于该操作时间和操作位置,生成长按操作对应的操作信息。其中,该操作信息可以携带有在显示图像上的操作位置和对应的操作时间。当主控终端通过网络服务器或者打洞技术发送给被控终端时,被控终端在接收到该操作信息可以确定对应的操作位置和操作时间,生成对应长按操作事件,并将长按操作事件添加到输入队列中,以通过输入队列执行长按操作时间,实现主控终端对被控终端的控制。As a specific application scenario of this embodiment, after the master terminal displays the display image corresponding to the controlled terminal, if it detects the long press operation submitted by the user on the display image, it can detect the pressing point of the long press operation, Determine the operation position corresponding to the pressing point on the display image, that is, obtain the operation position of the long press operation on the display image; and calculate the operation time of the long press operation; thus, based on the operation time and operation position, Generate operation information corresponding to the long press operation. Wherein, the operation information may carry the operation position on the display image and the corresponding operation time. When the controlling terminal sends the controlled terminal to the controlled terminal through the network server or punching technology, the controlled terminal can determine the corresponding operation position and operation time after receiving the operation information, generate the corresponding long press operation event, and send the long press operation event Add it to the input queue to execute the long-press operation time through the input queue to realize the control of the controlled terminal by the master terminal.
当然,主控终端在监听到用户在被控终端对应的显示图像上提交的其他输入操作时,也可以生成对应的操作信息。作为本发明的一个具体示例,当输入操作为滑动操作时,所述依据所述显示图像对应的输入操作,生成操作信息,具体可以包括:检测滑动操作对应的滑动信息;基于所述滑动信息 确定操作信息。具体的,当用户在被控终端对应的显示图像上提交滑动操作时,如用户的手指在显示图像上进行滑动时,主控终端可以通过检测显示屏幕,检测到滑动操作对应的滑动信息,如滑动操作对应的滑动轨迹,从而可以基于检测到的滑动信息生成对应的操作信息,并基于控制连接将该操作信息发送该被控终端,实现对被控终端的控制。作为本发明的另一个具体示例,当所述输入操作为点击操作时,所述依据所述显示图像对应的输入操作,生成操作信息,具体可以包括:检测所述点击操作在所述显示图像上的点击位置,生成对应操作信息。具体的,当用户点击被控终端对应的显示图像上某一位置,主控终端可以通过检测显示屏,确定用户提交的点击操作对应的点击位置,从而可以检测到点击操作在显示图像上的点击位置,生成对应的操作信息,并发送给被控终端,使得被控终端可以接收到该操作信息,生成对应的点击事件。被控终端在生成对应的点击事件后,可以将该点击事件添加到输入队列中,通过输入队列执行该点击事件,进而实现了主控终端对被控终端的远程控制。Certainly, when the controlling terminal monitors other input operations submitted by the user on the corresponding display image of the controlled terminal, it may also generate corresponding operation information. As a specific example of the present invention, when the input operation is a sliding operation, the generating operation information according to the input operation corresponding to the displayed image may specifically include: detecting sliding information corresponding to the sliding operation; determining based on the sliding information Action information. Specifically, when the user submits a sliding operation on the display image corresponding to the controlled terminal, such as when the user's finger slides on the display image, the master control terminal can detect the sliding information corresponding to the sliding operation by detecting the display screen, such as Slide the corresponding slide track, so that corresponding operation information can be generated based on the detected slide information, and the operation information can be sent to the controlled terminal based on the control connection, so as to realize the control of the controlled terminal. As another specific example of the present invention, when the input operation is a click operation, generating operation information according to the input operation corresponding to the display image may specifically include: detecting that the click operation is on the display image The click position of , and generate the corresponding operation information. Specifically, when the user clicks a certain position on the display image corresponding to the controlled terminal, the master control terminal can determine the click position corresponding to the click operation submitted by the user by detecting the display screen, so that the click operation on the display image can be detected. position, generate corresponding operation information, and send it to the controlled terminal, so that the controlled terminal can receive the operation information and generate a corresponding click event. After the controlled terminal generates the corresponding click event, the click event can be added to the input queue, and the click event is executed through the input queue, thereby realizing the remote control of the controlled terminal by the master control terminal.
实施例三Embodiment three
本实施例结合被控终端和主控终端,对控制移动终端的方法进行论述。In this embodiment, a method for controlling a mobile terminal is discussed in conjunction with a controlled terminal and a controlling terminal.
参照图6,示出了本发明实施例中主控终端对被控终端进行控制的示例图,具体控制过程如下:Referring to FIG. 6 , it shows an example diagram of the controlling terminal controlling the controlled terminal in the embodiment of the present invention. The specific control process is as follows:
6.02,主控终端与被控终端建立控制连接。6.02, the controlling terminal establishes a control connection with the controlled terminal.
具体的,被控终端可以向主控终端发送第一连接请求,以邀请主控终端对其进行控制;当主控终端响应第一连接请求,即主控终端确定对被控终端进行控制,生成第一连接响应并反馈给服务器,服务器可以为主控终端与被控终端建立控制连接。当然,主控终端也可以向被控终端发送第二连接请求,以申请作为被控终端的主控终端;当被控终端响应第二连接请求,即允许主控终端对其进行控制,生成第二连接响应并反馈给服务器,服务器可以为主控终端与被控终端建立控制连接。Specifically, the controlled terminal may send a first connection request to the controlling terminal to invite the controlling terminal to control it; when the controlling terminal responds to the first connection request, that is, the controlling terminal determines to control the controlled terminal, generating The first connection responds and feeds back to the server, and the server can establish a control connection between the master terminal and the controlled terminal. Of course, the controlling terminal can also send a second connection request to the controlled terminal to apply for being the controlling terminal of the controlled terminal; when the controlled terminal responds to the second connection request, the controlling terminal is allowed to control it, generating the second The second connection responds and feeds back to the server, and the server can establish a control connection between the master terminal and the controlled terminal.
6.04,被控终端实时获取屏幕图像,并压缩处理得到屏幕图像信息,将 屏幕图像信息发送给主控终端。6.04, the controlled terminal obtains the screen image in real time, compresses and processes the screen image information, and sends the screen image information to the master terminal.
在获取屏幕图像后,被控终端对屏幕图像进行压缩处理,以及利用预设的差分算法将压缩后的屏幕图像信息发送给主控终端。After acquiring the screen image, the controlled terminal compresses the screen image, and sends the compressed screen image information to the master terminal by using a preset differential algorithm.
6.08,主控终端对屏幕图像信息进行解析,生成对应的显示图像。6.08, the main control terminal analyzes the screen image information and generates the corresponding display image.
在生成被控终端对应的显示图像后,用户可以在显示图像上进行操作。从而使得主控终端可以获取到对应的操作信息,如基于用户操作获取对应的操作事件event。After the display image corresponding to the controlled terminal is generated, the user can perform operations on the display image. In this way, the main control terminal can obtain corresponding operation information, such as obtaining a corresponding operation event event based on a user operation.
6.10,主控终端获取操作事件,并发送给被控终端。6.10. The master terminal obtains the operation event and sends it to the controlled terminal.
当用户在被控终端对应的显示图像进行操作时,主控终端可以基于用户操作获取对应的操作事件event,即获取到对应的操作信息;并且可以通过网络或者打洞技术,如用户数据报协议(User Datagram Protocol,UDP)打洞技术、传输控制协议(Transmission Control Protocol,TCP)打洞技术,发送给被控终端。本实施利用打洞技术,做了穿透,实现了端对端的传输,从而可以降低服务器的压力。When the user operates on the corresponding display image of the controlled terminal, the master control terminal can obtain the corresponding operation event event based on the user operation, that is, obtain the corresponding operation information; and can use the network or hole-punching technology, such as the user datagram protocol (User Datagram Protocol, UDP) hole-punching technology, Transmission Control Protocol (Transmission Control Protocol, TCP) hole-punching technology, and sent to the controlled terminal. This implementation uses hole-punching technology to achieve penetration and realize end-to-end transmission, which can reduce the pressure on the server.
6.12,被控终端执行操作事件。6.12, the controlled terminal executes the operation event.
从而实现主控终端对被控终端的控制。In this way, the controlling terminal can control the controlled terminal.
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明实施例并不受所描述的动作顺序的限制,因为依据本发明实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作并不一定是本发明实施例所必须的。It should be noted that, for the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the embodiment of the present invention is not limited by the described action sequence, because According to the embodiment of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
实施例四Embodiment Four
本实施例公开了一种控制移动终端的装置,可以具体应用于被控终端中。This embodiment discloses a device for controlling a mobile terminal, which can be specifically applied to a controlled terminal.
参照图7A,示出了根据本发明的一种控制移动终端的装置实施例的结构框图,具体可以包括如下模块:Referring to FIG. 7A, it shows a structural block diagram of an embodiment of an apparatus for controlling a mobile terminal according to the present invention, which may specifically include the following modules:
第一连接建立模块702,用于预先与主控终端建立控制连接。The first connection establishment module 702 is configured to establish a control connection with the main control terminal in advance.
截屏模块704,用于依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息。The screenshot module 704 is configured to take a screenshot of the current display interface according to the system authority information, and generate screen image information.
屏幕图像发送模块706,用于基于所述控制连接,将所述屏幕图像信息发送给主控终端。A screen image sending module 706, configured to send the screen image information to the main control terminal based on the control connection.
操作执行模块708,用于依据主控终端针对所述屏幕图像信息反馈的操作信息,确定操作事件并执行。The operation execution module 708 is configured to determine and execute an operation event according to the operation information fed back by the master terminal for the screen image information.
综上,被控终端可以与主控终端建立控制连接,从而可以将当前显示界面对应的屏幕图像信息发送给主控终端,以及获取到主控终端针对该屏幕图像信息反馈的操作信息,生成对应的操作事件,并执行所生成的操作事件,即实现主控终端对被控终端的控制。In summary, the controlled terminal can establish a control connection with the master terminal, so that the screen image information corresponding to the current display interface can be sent to the master terminal, and the operation information fed back by the master terminal for the screen image information can be obtained to generate a corresponding operation event, and execute the generated operation event, that is, to realize the control of the controlled terminal by the master terminal.
通过本发明实施,用户若遇到移动终端的问题,可以将其所操作的移动终端作为被控终端,与其他用户所操作的移动终端,即主控终端,建立控制连接,从而使的其他用户可以通过在被控终端上进行操作,即在主控终端显示的被控终端屏幕图像信息对应的显示图像上进行操作,来解决被控终端所存在的问题,即解决了移动终端使用不方便的问题,提高了用户体验。Through the implementation of the present invention, if a user encounters a problem with a mobile terminal, he can use the mobile terminal operated by him as the controlled terminal, and establish a control connection with the mobile terminal operated by other users, that is, the master terminal, so that other users The problem existing in the controlled terminal can be solved by operating on the controlled terminal, that is, operating on the display image corresponding to the controlled terminal screen image information displayed by the master controlling terminal, that is, solving the problem of inconvenient use of the mobile terminal problems and improve the user experience.
在图7A的基础上,可选的,第一连接建立模块702,可以包括:登录子模块70200、输入信息接收子模块70202、第一请求发送模块70204和第一连接建立子模块70206,参见图7B。On the basis of FIG. 7A, optionally, the first connection establishment module 702 may include: a login submodule 70200, an input information receiving submodule 70202, a first request sending module 70204 and a first connection establishment submodule 70206, see FIG. 7B.
登录子模块70200,用于依据被控终端对应第一标识信息登录页面。输入信息接收子模块70202,用于依据在页面接收到输入信息,确定第二标识信息。第一请求发送子模块70204,用于向所述第二标识信息对应的主控终端发送第一连接请求。第一连接建立子模块70206,用于当接收到所述主控终端针对所述第一连接请求反馈的第一连接响应时,建立所述控制连接。The login submodule 70200 is configured to log in the page according to the first identification information corresponding to the controlled terminal. The input information receiving sub-module 70202 is configured to determine the second identification information according to the input information received on the page. The first request sending submodule 70204 is configured to send a first connection request to the master terminal corresponding to the second identification information. The first connection establishment submodule 70206 is configured to establish the control connection when receiving the first connection response fed back by the master control terminal for the first connection request.
可选的,登录子模块70200,具体可以包括如下单元:Optionally, the login submodule 70200 may specifically include the following units:
第一本地检测单元,用于当检测到第一登录模式选择命令时,检测本地是否存存储有标识信息。The first local detection unit is configured to detect whether identification information is stored locally when the first login mode selection command is detected.
第一关联检测单元,用于在本地存储有标识信息时,检测所述标识 信息是否与厂商信息关联。The first association detection unit is configured to detect whether the identification information is associated with the vendor information when the identification information is locally stored.
标识信息确定单元,用于当所述标识信息不关联厂商信息,将所述标识信息作为第一标识信息。当本地没有存储标识信息,或者所述标识信息关联厂商信息时,通过服务器生成第一标识信息并保存。The identification information determining unit is configured to use the identification information as the first identification information when the identification information is not associated with manufacturer information. When the identification information is not stored locally, or the identification information is associated with manufacturer information, the first identification information is generated and saved by the server.
第一登录单元,用于基于所述第一标识信息执行第一登录模式选择命令,以登录页面。A first login unit, configured to execute a first login mode selection command based on the first identification information to log in to a page.
在本发明的一种优选实施例中,该登录子模块70200,可以如下包括单元:In a preferred embodiment of the present invention, the login submodule 70200 may include units as follows:
厂商信息检测单元,用于当检测到第二登录模式选择命令时,检测登录对应的厂商信息。The vendor information detection unit is configured to detect the vendor information corresponding to the login when the second login mode selection command is detected.
账号登录单元,用于当检测到厂商信息时,采用所述厂商信息进行账号登录。The account registration unit is configured to use the manufacturer information to log in the account when the manufacturer information is detected.
第二本地检测单元,用于在账号登录后,检测本地是否存储有标识信息。The second local detection unit is configured to detect whether identification information is locally stored after the account is logged in.
标识信息匹配检测单元,用于当本地存储有标识信息时,检测所述标识信息是否与离线标识信息匹配。The identification information matching detection unit is configured to detect whether the identification information matches the offline identification information when the identification information is stored locally.
第二登录单元,用于当所述标识信息与离线标识信息匹配时,将所述标识信息作为第一标识信息,并登录页面。The second login unit is configured to use the identification information as the first identification information when the identification information matches the offline identification information, and log in to the page.
可选的,所述登录子模块70200还包括:第二关联检测单元,用于当所述标识信息与离线标识信息不匹配时,检测所述厂商信息是否与第三标识信息关联。其中,所述第二登录单元,还可以用于当所述厂商信息不关联第三标识信息时,将所述标识信息作为所述厂商信息对应的第一标识信息,并登录页面;以及用于当所述厂商信息关联第三标识信息时,删除所述标识信息,以及采用所述厂商信息生成对应的第一标识信息,并登录页面。Optionally, the login submodule 70200 further includes: a second association detection unit, configured to detect whether the vendor information is associated with third identification information when the identification information does not match the offline identification information. Wherein, the second login unit can also be used to use the identification information as the first identification information corresponding to the manufacturer information when the manufacturer information is not associated with the third identification information, and log in to the page; and When the vendor information is associated with the third identification information, delete the identification information, use the vendor information to generate corresponding first identification information, and log in to the page.
在本发明的一种优选实施例中,登录子模块70200,还包括:服务器检测单元,用于当本地没有存储标识信息时,检测服务器是否存储有所述厂商信息对应的第一标识信息。其中,第二登录单元,还可以用于当检测到 服务器存储有第一标识信息时,登录页面,并保存所述厂商信息;以及用于当服务器没有存储有所述第一标识信息时,通过服务器生成第一标识信息并保存,登录页面。In a preferred embodiment of the present invention, the login submodule 70200 further includes: a server detection unit, configured to detect whether the server stores the first identification information corresponding to the vendor information when no identification information is stored locally. Wherein, the second login unit can also be used to log in to the page when it is detected that the server stores the first identification information, and save the manufacturer information; and when the server does not store the first identification information, through The server generates and saves the first identification information, and logs in to the page.
可选的,登录子模块70200,还可以包括:注册页面调用单元和账号注册单元。其中,注册页面调用单元,可以用于当未检测到厂商信息时,调用所述厂商信息对注册页面。账号注册单元,可以用于依据所述注册页面接收的输入信息进行注册,生成厂商信息,并触发所述账号登录单元执行账号登录的步骤。Optionally, the login submodule 70200 may also include: a registration page calling unit and an account registration unit. Wherein, the registration page calling unit can be used to call the registration page of the manufacturer information pair when no manufacturer information is detected. The account registration unit can be used to register according to the input information received by the registration page, generate manufacturer information, and trigger the account registration unit to perform the steps of account registration.
在本发明的一种优选实施例中,输入信息接收子模70202,具体可以包括如下单元:In a preferred embodiment of the present invention, the input information receiving sub-module 70202 may specifically include the following units:
校验单元,用于当接收到符合预设格式的输入信息时,校验所述输入信息的有效性。The verification unit is configured to verify the validity of the input information when receiving the input information conforming to the preset format.
获取单元,用于当检测到输入信息有效时,获取所述输入信息对应的第二标识信息。The obtaining unit is configured to obtain second identification information corresponding to the input information when it is detected that the input information is valid.
在本发明的一种优选实施例中,第一请求发送子模块,具体可以包括如下单元:In a preferred embodiment of the present invention, the first request sending submodule may specifically include the following units:
特征关系检测单元,用于检测所述第二标识信息是否与第一标识信息具有特征关系。A characteristic relationship detecting unit, configured to detect whether the second identification information has a characteristic relationship with the first identification information.
添加请求发送单元,用于当所述第二标识信息与第一标识信息不具有特征关系,向所述主控终端发送特征关系添加请求,以创建所述第二标识信息与第一标识信息的特征关系。An adding request sending unit, configured to send a request for adding a characteristic relationship to the master terminal when the second identification information does not have a characteristic relationship with the first identification information, so as to create a relationship between the second identification information and the first identification information characteristic relationship.
第一请求发送单元,用于当第二标识信息与第一标识信息具有特征关系,向所述主控终端发送第一连接请求。A first request sending unit, configured to send a first connection request to the master control terminal when the second identification information has a characteristic relationship with the first identification information.
在本发明的一种优选实施例中,第一连接建立模块702,还可以包括:In a preferred embodiment of the present invention, the first connection establishment module 702 may also include:
判断子模块70208,用于判断在预设时间范围内是否检测到主控终端反馈的第一连接响应。The judging sub-module 70208 is used to judge whether the first connection response fed back by the main control terminal is detected within the preset time range.
连接确定子模块70210,用于当在预设时间范围内未检测到所述第一连接响应,确定所述控制连接建立失败;当在预设时间范围内检测到所述第 一连接响应,触发所述第一连接建立子模块70206执行建立所述控制连接的步骤,以及确定控制连接建立成功。The connection determination sub-module 70210 is configured to determine that the establishment of the control connection fails when the first connection response is not detected within the preset time range; when the first connection response is detected within the preset time range, trigger The first connection establishing submodule 70206 executes the step of establishing the control connection, and determines that the control connection is established successfully.
在本发明的一种优选实施例中,截屏模块704可以包括如下子模块:In a preferred embodiment of the present invention, the screenshot module 704 may include the following submodules:
权限获取子模块70400,用于获取被控终端的系统权限信息。The authority acquisition sub-module 70400 is used to acquire the system authority information of the controlled terminal.
截屏子模块70402,用于基于所述系统权限信息对显示界面进行截屏,得到屏幕图像。The screenshot sub-module 70402 is configured to take a screenshot of the display interface based on the system authority information to obtain a screen image.
压缩子模块70404,用于对所述屏幕图像进行压缩处理,生成屏幕图像信息。The compression sub-module 70404 is configured to compress the screen image to generate screen image information.
可选的,屏幕图像发送模块706,具体可以用于利用预设算法将屏幕图像信息发送给服务器,以通过服务器将所述屏幕图像信息转发给主控终端。Optionally, the screen image sending module 706 may specifically be configured to use a preset algorithm to send the screen image information to the server, so as to forward the screen image information to the main control terminal through the server.
在本发明的一种优选实施例中,操作执行模块708,具体用于当接收到服务器转发主控终端所反馈的操作信息时,对所述操作信息进行解析,确定操作事;以及,通过调用应用程序编程接口,将所述操作事件添加到输入队列中。其中,所述输入队列用于按照添加顺序执行操作事件。In a preferred embodiment of the present invention, the operation execution module 708 is specifically configured to analyze the operation information and determine the operation when receiving the operation information fed back by the master terminal forwarded by the server; and, by calling An application programming interface that adds the operation event to an input queue. Wherein, the input queue is used to execute operation events in the order of addition.
在本发明的一种优选实施例中,所述第一连接建立模块702,还可以包括如下子模块:In a preferred embodiment of the present invention, the first connection establishing module 702 may also include the following submodules:
第二请求接收子模块70212,用于在登录页面后,接收服务器转发的主控终端所提交的第二连接请求。The second request receiving sub-module 70212 is configured to receive the second connection request submitted by the master control terminal forwarded by the server after logging in to the page.
第二响应生成子模块70214,用于对所述第二连接请求进行响应,生成对应的第二连接响应。The second response generating submodule 70214 is configured to respond to the second connection request and generate a corresponding second connection response.
第二响应发送子模块70216,用于将所述第二连接响应发送所述服务器,并触发所述第一连接建立子模块建立所述控制连接,其中所述服务器用于将第二连接响应反馈给主控终端。The second response sending submodule 70216, configured to send the second connection response to the server, and trigger the first connection establishment submodule to establish the control connection, wherein the server is configured to feed back the second connection response to the master terminal.
在本实施例中,被控终端可以向主控终端发送第一连接请求,以邀请主控终端对其进行控制;也可以响应主控终端所发送的第二连接请求,使得主控终端可以对其进行控制。并且,被控终端可以对截屏得到的屏幕图像信息进行压缩处理,以及利用预设算法将压缩后的屏幕图像信息 传输给主控终端,从而可以减少数据传输的数据量。In this embodiment, the controlled terminal may send a first connection request to the master terminal to invite the master terminal to control it; it may also respond to the second connection request sent by the master terminal, so that the master terminal can It controls. In addition, the controlled terminal can compress the screen image information obtained from the screen capture, and use a preset algorithm to transmit the compressed screen image information to the master terminal, thereby reducing the amount of data transmitted.
实施例五Embodiment five
本实施例公开了另一种控制移动终端的装置,具体可以应用于主控终端中。This embodiment discloses another device for controlling a mobile terminal, which can be specifically applied to a main control terminal.
参照图8A,示出了根据本发明的另一种控制移动终端的装置实施例的结构框图,具体可以包括如下模块:Referring to FIG. 8A, it shows a structural block diagram of another embodiment of an apparatus for controlling a mobile terminal according to the present invention, which may specifically include the following modules:
第二连接建立模块802,用于预先与被控终端建立控制连接。The second connection establishment module 802 is configured to establish a control connection with the controlled terminal in advance.
屏幕图像接收模块804,用于基于所述控制连接,接收所述被控终端所发送的屏幕图像信息。The screen image receiving module 804 is configured to receive screen image information sent by the controlled terminal based on the control connection.
屏幕图像解析模块806,用于对屏幕图像信息进行解析处理,生成显示图像并展示。The screen image analysis module 806 is configured to analyze and process the screen image information, generate and display a display image.
操作信息生成模块808,用于依据所述显示图像对应的输入操作,生成操作信息。The operation information generation module 808 is configured to generate operation information according to the input operation corresponding to the displayed image.
操作信息发送模块810,用于将所述操作信息发送给被控终端,以控制被控终端。The operation information sending module 810 is configured to send the operation information to the controlled terminal, so as to control the controlled terminal.
本实施例实现了主控终端对被控终端的控制,使得用户可以通过主控终端远程控制其他用户的被控终端,以帮助其他用户解决其在使用被控终端过程中所遇到的问题,即远程控制被控终端,以解决被控终端所存在的使用不方便的问题。This embodiment realizes the control of the controlled terminal by the main control terminal, so that the user can remotely control the controlled terminals of other users through the main control terminal, so as to help other users solve the problems encountered in the process of using the controlled terminal. That is to remotely control the controlled terminal to solve the problem of inconvenient use of the controlled terminal.
在图8A的基础上,可选的,第二连接建立模块802,可以包括:第一请求接收子模块80200、第一响应生成子模块80202和第一响应发送子模块80204,参见图8B。On the basis of FIG. 8A , optionally, the second connection establishing module 802 may include: a first request receiving submodule 80200 , a first response generating submodule 80202 and a first response sending submodule 80204 , see FIG. 8B .
第一请求接收子模块80200,用于接收被控终端所发送的第一连接请求。The first request receiving submodule 80200 is configured to receive the first connection request sent by the controlled terminal.
第一响应生成子模块80202,用于对第一连接请求进行响应,生成对应的第一连接响应。The first response generating submodule 80202 is configured to respond to the first connection request and generate a corresponding first connection response.
第一响应发送子模块80204,用于将所述第一连接响应反馈给被控终端,以建立所述控制连接。The first response sending submodule 80204 is configured to feed back the first connection response to the controlled terminal, so as to establish the control connection.
在本发明的一种优选实施例中,第二连接建立模块802,可以包括如下子模块:In a preferred embodiment of the present invention, the second connection establishment module 802 may include the following submodules:
第二发送子模块80206,用于在登录页面后,向服务器发送第二连接请求,以通过所述服务器将所述第二连接请求转发给被控终端。The second sending submodule 80206 is configured to send a second connection request to the server after logging in to the page, so as to forward the second connection request to the controlled terminal through the server.
第二连接建立子模块80208,用于当接收到服务器转发的被控终端反馈的第二连接响应时,建立所述控制连接。The second connection establishment submodule 80208 is configured to establish the control connection when receiving the second connection response fed back by the controlled terminal forwarded by the server.
可选的,本实施例中的输入操作可以包括以下任意一项:点击操作、滑动操作或长按操作。Optionally, the input operation in this embodiment may include any one of the following: click operation, slide operation or long press operation.
当所述输入操作为长按操作时,操作信息生成模块808具体可以用于获取所述长按操作在所述显示图像上的操作位置,计算所述长按操作的操作时间,以及采用所述操作时间和操作位置,生成对应的操作信息。When the input operation is a long press operation, the operation information generation module 808 may be specifically configured to acquire the operation position of the long press operation on the display image, calculate the operation time of the long press operation, and use the Operation time and operation location, generate corresponding operation information.
当所述输入操作为滑动操作时,操作信息生成模块808具体可以用于检测滑动操作对应的滑动信息,基于所述滑动信息确定操作信息。When the input operation is a sliding operation, the operation information generating module 808 may specifically be configured to detect sliding information corresponding to the sliding operation, and determine the operation information based on the sliding information.
当所述输入操作为点击操作时,操作信息生成模块808具体可以用于检测所述点击操作在所述显示图像上的点击位置,生成对应操作信息。When the input operation is a click operation, the operation information generating module 808 may specifically be configured to detect a click position of the click operation on the display image, and generate corresponding operation information.
在本发明的一种优选实施例中,操作信息发送模块810,具体可以用于将操作信息发送给服务器,以通过所述服务器将所述操作信息转发给被控终端。In a preferred embodiment of the present invention, the operation information sending module 810 may specifically be configured to send the operation information to a server, so as to forward the operation information to the controlled terminal through the server.
本发明实施例中,服务器可以包括:网络服务器或者应用服务器。In the embodiment of the present invention, the server may include: a network server or an application server.
通过本实施例,主控终端可以依据在被控终端对应的显示图像上接收到的操作,生成对应的操作信息,以及基于控制连接将所生成的操作信息反馈给被控终端,使得被控终端可以采用该操作信息确定操作事件并执行,实现了对被控终端的控制,从而使得用户可以通过主控终端控制其他用户所使用的被控终端,从而方便用户帮助其他用户解决使用被控终端所遇到的问题,即解决了移动终端使用不方便的问题。Through this embodiment, the master control terminal can generate corresponding operation information according to the operation received on the corresponding display image of the controlled terminal, and feed back the generated operation information to the controlled terminal based on the control connection, so that the controlled terminal The operation information can be used to determine and execute the operation event, realizing the control of the controlled terminal, so that the user can control the controlled terminal used by other users through the main control terminal, so that the user can help other users solve the problems caused by the use of the controlled terminal. The problem encountered is to solve the problem of inconvenient use of the mobile terminal.
对于装置实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.
实施例六Embodiment six
本发明实施例还提供了一种移动终端,如图9所示,为了便于说明,仅示出了与本发明实施例相关的部分,具体技术细节未揭示的,请参照本发明实施例方法部分。该移动终端可以为包括手机、平板电脑、PDA(Personal Digital Assistant,个人数字助理)、POS(Point of Sales,销售终端)、车载电脑等任意移动设备,以移动终端为手机为例:The embodiment of the present invention also provides a mobile terminal. As shown in FIG. 9, for the convenience of description, only the parts related to the embodiment of the present invention are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present invention. . The mobile terminal can be any mobile device including a mobile phone, tablet computer, PDA (Personal Digital Assistant, personal digital assistant), POS (Point of Sales, sales terminal), vehicle-mounted computer, etc. Taking the mobile terminal as a mobile phone as an example:
图9示出的是与本发明实施例提供的移动终端相关的手机的部分结构的框图。参考图9,手机包括:射频(Radio Frequency,RF)电路910、存储器920、输入单元930、显示单元940、传感器950、音频电路960、无线保真(wireless fidelity,WiFi)模块970、处理器980、以及电源990等部件。本领域技术人员可以理解,图9中示出的手机结构并不构成对手机的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。FIG. 9 shows a block diagram of a partial structure of a mobile phone related to the mobile terminal provided by the embodiment of the present invention. 9, the mobile phone includes: a radio frequency (Radio Frequency, RF) circuit 910, a memory 920, an input unit 930, a display unit 940, a sensor 950, an audio circuit 960, a wireless fidelity (wireless fidelity, WiFi) module 970, a processor 980 , and power supply 990 and other components. Those skilled in the art can understand that the structure of the mobile phone shown in FIG. 9 does not constitute a limitation to the mobile phone, and may include more or less components than shown in the figure, or combine some components, or arrange different components.
下面结合图9对手机的各个构成部件进行具体的介绍:The following is a specific introduction to each component of the mobile phone in conjunction with Figure 9:
RF电路910可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,给处理器980处理;另外,将设计上行的数据发送给基站。通常,RF电路910包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier,LNA)、双工器等。此外,RF电路910还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统(Global System of Mobile communication,GSM)、通用分组无线服务(General Packet Radio Service,GPRS)、码分多址(Code Division Multiple Access,CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution,LTE)、电子邮件、短消息服务(Short Messaging Service,SMS)等。The RF circuit 910 can be used for sending and receiving information or receiving and sending signals during a call. In particular, after receiving the downlink information from the base station, it is processed by the processor 980; in addition, it sends the designed uplink data to the base station. Generally, the RF circuit 910 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, and the like. In addition, RF circuitry 910 may also communicate with networks and other devices via wireless communications. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (Short Messaging Service, SMS), etc.
存储器920可用于存储软件程序以及模块,处理器980通过运行存储在存储器920的软件程序以及模块,从而执行手机的各种功能应用以及数据处理。存储器920可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播 放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器920可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 920 can be used to store software programs and modules, and the processor 980 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 920 . The memory 920 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 920 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
输入单元930可用于接收输入的数字或字符信息,以及产生与手机的用户设置以及功能控制有关的键信号输入。具体地,输入单元930可包括触控面板931以及其他输入设备932。触控面板931,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板931上或在触控面板931附近的操作),并根据预先设定的程式驱动相应的连接装置。可选的,触控面板931可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器980,并能接收处理器980发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板931。除了触控面板931,输入单元930还可以包括其他输入设备932。具体地,其他输入设备932可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。The input unit 930 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile phone. Specifically, the input unit 930 may include a touch panel 931 and other input devices 932 . The touch panel 931, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 931 or near the touch panel 931). operation), and drive the corresponding connection device according to the preset program. Optionally, the touch panel 931 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 980, and can receive and execute commands sent by the processor 980. In addition, the touch panel 931 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 931 , the input unit 930 may also include other input devices 932 . Specifically, other input devices 932 may include but not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackball, mouse, joystick, and the like.
显示单元940可用于显示由用户输入的信息或提供给用户的信息以及手机的各种菜单。显示单元940可包括显示面板941,可选的,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板941。进一步的,触控面板931可覆盖显示面板941,当触控面板931检测到在其上或附近的触摸操作后,传送给处理器980以确定触摸事件的类型,随后处理器980根据触摸事件的类型在显示面板941上提供相应的视觉输出。虽然在图9中,触控面板931与显示面板941是作为两个独立的部件来实现手机的输入和输入功能,但是在某些实施例中,可以将触控面板931与显示面板941集成而实现手机的输入和输出功能。The display unit 940 may be used to display information input by or provided to the user and various menus of the mobile phone. The display unit 940 may include a display panel 941. Optionally, the display panel 941 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like. Further, the touch panel 931 may cover the display panel 941, and when the touch panel 931 detects a touch operation on or near it, the touch operation is sent to the processor 980 to determine the type of the touch event, and then the processor 980 according to the touch event The type provides a corresponding visual output on the display panel 941 . Although in FIG. 9 , the touch panel 931 and the display panel 941 are used as two independent components to realize the input and input functions of the mobile phone, in some embodiments, the touch panel 931 and the display panel 941 can be integrated to form a mobile phone. Realize the input and output functions of the mobile phone.
手机还可包括至少一种传感器950,比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板941的亮度,接近传感器可在手机移动到耳边时,关闭显示面板941和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于手机还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。The handset may also include at least one sensor 950, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor can include an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 941 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 941 and/or when the mobile phone is moved to the ear. or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of mobile phone posture (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. repeat.
音频电路960、扬声器961,传声器962可提供用户与手机之间的音频接口。音频电路960可将接收到的音频数据转换后的电信号,传输到扬声器961,由扬声器961转换为声音信号输出;另一方面,传声器962将收集的声音信号转换为电信号,由音频电路960接收后转换为音频数据,再将音频数据输出处理器980处理后,经RF电路910以发送给比如另一手机,或者将音频数据输出至存储器920以便进一步处理。The audio circuit 960, the speaker 961, and the microphone 962 can provide an audio interface between the user and the mobile phone. The audio circuit 960 can transmit the electrical signal converted from the received audio data to the speaker 961, and the speaker 961 converts it into an audio signal for output; After being received, it is converted into audio data, and then the audio data is processed by the output processor 980, and then sent to another mobile phone through the RF circuit 910, or the audio data is output to the memory 920 for further processing.
WiFi属于短距离无线传输技术,手机通过WiFi模块970可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线的宽带互联网访问。虽然图9示出了WiFi模块970,但是可以理解的是,其并不属于手机的必须构成,完全可以根据需要在不改变发明的本质的范围内而省略。WiFi is a short-distance wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 970. It provides users with wireless broadband Internet access. Although FIG. 9 shows a WiFi module 970, it can be understood that it is not an essential component of the mobile phone, and can be completely omitted as required without changing the essence of the invention.
处理器980是手机的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器920内的软件程序和/或模块,以及调用存储在存储器920内的数据,执行手机的各种功能和处理数据,从而对手机进行整体监控。可选的,处理器980可包括一个或多个处理单元;优选的,处理器980可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器980中。The processor 980 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and/or modules stored in the memory 920, and calling data stored in the memory 920, execution Various functions and processing data of the mobile phone, so as to monitor the mobile phone as a whole. Optionally, the processor 980 may include one or more processing units; preferably, the processor 980 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that, the foregoing modem processor may not be integrated into the processor 980 .
手机还包括给各个部件供电的电源990(比如电池),优选的,电源可 以通过电源管理系统与处理器980逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The mobile phone also includes a power supply 990 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 980 through the power management system, so as to realize functions such as managing charging, discharging, and power consumption management through the power management system.
尽管未示出,手机还可以包括摄像头、蓝牙模块等,在此不再赘述。Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be repeated here.
在本发明实施例中,若移动终端作为被控终端,则该移动终端所包括的处理器1580还具有以下功能:预先与主控终端建立控制连接;依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息;基于所述控制连接,将所述屏幕图像信息发送给主控终端;依据主控终端针对所述屏幕图像信息反馈的操作信息,确定操作事件并执行。In the embodiment of the present invention, if the mobile terminal is used as the controlled terminal, the processor 1580 included in the mobile terminal also has the following functions: establish a control connection with the master terminal in advance; take a screenshot of the current display interface according to the system authority information, Generate screen image information; send the screen image information to the main control terminal based on the control connection; determine and execute an operation event according to the operation information fed back by the main control terminal for the screen image information.
当然,若移动终端作为主控终端,则移动终端所包括的处理器1580还具有以下功能:预先与被控终端建立控制连接;基于所述控制连接,接收所述被控终端所发送的屏幕图像信息;对屏幕图像信息进行解析处理,生成显示图像并展示;依据所述显示图像对应的输入操作,生成操作信息;将所述操作信息发送给被控终端,以控制被控终端。Of course, if the mobile terminal serves as the master terminal, the processor 1580 included in the mobile terminal also has the following functions: establish a control connection with the controlled terminal in advance; receive the screen image sent by the controlled terminal based on the control connection information; analyze and process the screen image information to generate and display a display image; generate operation information according to the input operation corresponding to the display image; send the operation information to the controlled terminal to control the controlled terminal.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
在本发明所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元 中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:只读存储器(ROM,Read Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: Read Only Memory (ROM, Read Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the method of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the above-mentioned storage The medium can be read-only memory, magnetic or optical disk, etc.
以上对本发明所提供的一种移动终端进行了详细介绍,对于本领域的一般技术人员,依据本发明实施例的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。Themobile terminal provided by the present invention has been introduced in detail above. For those of ordinary skill in the art, according to the idea of the embodiment of the present invention, there will be changes in the specific implementation and application range. In summary, However, the contents of this specification should not be construed as limiting the present invention.
本发明公开了A1一种控制移动终端的方法,包括:预先与主控终端建立控制连接;依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息;基于所述控制连接,将所述屏幕图像信息发送给主控终端;依据主控终端针对所述屏幕图像信息反馈的操作信息,确定操作事件并执行。The invention discloses A1 a method for controlling a mobile terminal, comprising: establishing a control connection with a main control terminal in advance; taking a screenshot of the current display interface according to system authority information to generate screen image information; based on the control connection, converting the screen The image information is sent to the main control terminal; according to the operation information fed back by the main control terminal for the screen image information, an operation event is determined and executed.
A2、根据A1所述的方法,所述与主控终端建立控制连接,包括:依据被控终端对应第一标识信息登录页面;依据在页面接收到输入信息,确定第二标识信息;向所述第二标识信息对应的主控终端发送第一连接请求;当接收到所述主控终端针对所述第一连接请求反馈的第一连接响应时,建立所述控制连接。A2. According to the method described in A1, the establishment of a control connection with the controlling terminal includes: logging in to the page according to the first identification information corresponding to the controlled terminal; determining the second identification information according to the input information received on the page; The master control terminal corresponding to the second identification information sends a first connection request; when a first connection response fed back by the master control terminal for the first connection request is received, the control connection is established.
A3、根据A2所述的方法,所述依据被控终端对应第一标识信息登录页面,包括:当检测到第一登录模式选择命令时,检测本地是否存储有标识信息;在本地存储有标识信息时,检测所述标识信息是否与厂商信息关联;当所述标识信息不关联厂商信息,将所述标识信息作为 第一标识信息;当本地没有存储标识信息,或者所述标识信息关联厂商信息时,通过服务器生成第一标识信息并保存;基于所述第一标识信息执行第一登录模式选择命令,以登录页面。A3. According to the method described in A2, the login page corresponding to the first identification information of the controlled terminal includes: when the first login mode selection command is detected, detecting whether identification information is stored locally; the identification information is stored locally , detect whether the identification information is associated with manufacturer information; when the identification information is not associated with manufacturer information, use the identification information as the first identification information; when there is no identification information stored locally, or the identification information is associated with manufacturer information , using the server to generate and save the first identification information; executing a first login mode selection command based on the first identification information to log in to the page.
A4、根据A2所述的方法,所述依据被控终端对应第一标识信息登录页面,包括:当检测到第二登录模式选择命令时,检测登录对应的厂商信息;当检测到厂商信息时,采用所述厂商信息进行账号登录;在账号登录后,检测本地是否存储有标识信息;当本地存储有标识信息时,检测所述标识信息是否与离线标识信息匹配;当所述标识信息与离线标识信息匹配时,将所述标识信息作为第一标识信息,并登录页面。A4. According to the method described in A2, the login page corresponding to the first identification information based on the controlled terminal includes: when detecting the second login mode selection command, detecting the corresponding manufacturer information for login; when detecting the manufacturer information, Use the manufacturer information for account login; after account login, detect whether identification information is stored locally; when identification information is stored locally, detect whether the identification information matches the offline identification information; when the identification information matches the offline identification When the information matches, the identification information is used as the first identification information, and the page is logged in.
A5、根据A4所述的方法,还包括:当所述标识信息与离线标识信息不匹配时,检测所述厂商信息是否与第三标识信息关联;当所述厂商信息不关联第三标识信息时,将所述标识信息作为所述厂商信息对应的第一标识信息,并登录页面;当所述厂商信息关联第三标识信息时,删除所述标识信息,以及采用所述厂商信息生成对应的第一标识信息,并登录页面。A5. The method according to A4, further comprising: when the identification information does not match the offline identification information, detecting whether the vendor information is associated with the third identification information; when the vendor information is not associated with the third identification information , using the identification information as the first identification information corresponding to the vendor information, and logging into the page; when the vendor information is associated with the third identification information, deleting the identification information, and using the vendor information to generate the corresponding third identification information An identification information, and a login page.
A6、根据A4所述的方法,还包括:当本地没有存储标识信息时,检测服务器是否存储有所述厂商信息对应的第一标识信息;当检测到服务器存储有第一标识信息时,登录页面,并保存所述厂商信息;当服务器未存储所述第一标识信息时,通过服务器生成第一标识信息并保存,登录页面。A6. The method according to A4, further comprising: when there is no identification information stored locally, detecting whether the server stores the first identification information corresponding to the manufacturer information; when it is detected that the server stores the first identification information, the login page , and save the manufacturer information; when the server does not store the first identification information, generate and save the first identification information through the server, and log in to the page.
A7、根据A4所述的方法,还包括:当未检测到厂商信息时,调用所述厂商信息对应的注册页面;依据所述注册页面接收的输入信息进行注册,生成厂商信息,以执行账号登录的步骤。A7. According to the method described in A4, it also includes: when no vendor information is detected, calling the registration page corresponding to the vendor information; registering according to the input information received on the registration page, generating vendor information to perform account login A step of.
A8、根据A2所述的方法,所述依据在页面接收到输入信息,确定第二标识信息,包括:当接收到符合预设格式的输入信息时,校验所述输入信息的有效性;当检测到输入信息有效时,获取所述输入信息对应的第二标识信息。A8. According to the method described in A2, the determination of the second identification information based on receiving input information on the page includes: when receiving input information conforming to a preset format, verifying the validity of the input information; when When it is detected that the input information is valid, second identification information corresponding to the input information is acquired.
A9、根据A8所述的方法,向所述第二标识信息对应的主控 终端发送第一连接请求,包括:检测所述第二标识信息是否与第一标识信息具有特征关系;当所述第二标识信息与第一标识信息不具有特征关系,向所述主控终端发送特征关系添加请求,以创建所述第二标识信息与第一标识信息的特征关系;当第二标识信息与第一标识信息具有特征关系,向所述主控终端发送第一连接请求。A9. According to the method described in A8, sending the first connection request to the master terminal corresponding to the second identification information includes: detecting whether the second identification information has a characteristic relationship with the first identification information; when the second identification information The second identification information does not have a characteristic relationship with the first identification information, and sends a characteristic relationship addition request to the master terminal to create a characteristic relationship between the second identification information and the first identification information; when the second identification information and the first identification information The identification information has a characteristic relationship, and the first connection request is sent to the master terminal.
A 10、根据A2所述的方法,在发送第一连接请求后,还包括:判断在预设时间范围内是否检测到主控终端反馈的第一连接响应;当在预设时间范围内未检测到所述第一连接响应,确定所述控制连接建立失败;当在预设时间范围内检测到所述第一连接响应,执行建立所述控制连接的步骤,以及确定控制连接建立成功。A 10. According to the method described in A2, after sending the first connection request, it further includes: judging whether the first connection response fed back by the main control terminal is detected within the preset time range; When the first connection response is received, it is determined that the establishment of the control connection fails; when the first connection response is detected within a preset time range, the step of establishing the control connection is performed, and it is determined that the control connection is successfully established.
A 11、根据A1所述的方法,依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息,包括:获取被控终端的系统权限信息;基于所述系统权限信息对显示界面进行截屏,得到屏幕图像;对所述屏幕图像进行压缩处理,生成屏幕图像信息。A11. According to the method described in A1, screenshot the current display interface according to the system authority information to generate screen image information, including: obtaining the system authority information of the controlled terminal; taking a screenshot of the display interface based on the system authority information to obtain A screen image; compressing the screen image to generate screen image information.
A 12、根据A 11所述的方法,所述将所述屏幕图像信息发送给主控终端,包括:利用预设算法将屏幕图像信息发送给服务器,以通过服务器将所述屏幕图像信息转发给主控终端。A 12. According to the method described in A 11, the sending the screen image information to the main control terminal includes: using a preset algorithm to send the screen image information to the server, so as to forward the screen image information to the server through the server Control terminal.
A 13、根据A 1所述的方法,依据主控终端针对所述屏幕图像信息反馈的操作信息,确定操作事件并执行,包括:当接收到服务器转发主控终端所反馈的操作信息时,对所述操作信息进行解析,确定操作事件;通过调用应用程序编程接口,将所述操作事件添加到输入队列中,其中,所述输入队列用于按照添加顺序执行操作事件。A13. According to the method described in A1, according to the operation information fed back by the main control terminal for the screen image information, determine and execute the operation event, including: when receiving the operation information fed back by the main control terminal forwarded by the server, to The operation information is analyzed to determine an operation event; the operation event is added to an input queue by calling an application programming interface, wherein the input queue is used to execute the operation event in an added order.
A 14、根据A 2所述的方法,所述与主控终端建立控制连接,还包括:在登录页面后,接收服务器转发的主控终端所提交的第二连接请求;对所述第二连接请求进行响应,生成对应的第二连接响应;将所述第二连接响应发送所述服务器,以建立所述控制连接,其中所述服务器用于将第二连接响应反馈给主控终端。A 14. According to the method described in A 2, the establishment of a control connection with the main control terminal further includes: after logging in to the page, receiving the second connection request submitted by the main control terminal forwarded by the server; requesting a response, and generating a corresponding second connection response; sending the second connection response to the server to establish the control connection, where the server is configured to feed back the second connection response to the main control terminal.
本发明还公开了B15、一种控制移动终端的方法,包括:预先与被控 终端建立控制连接;基于所述控制连接,接收所述被控终端所发送的屏幕图像信息;对屏幕图像信息进行解析处理,生成显示图像并展示;依据所述显示图像对应的输入操作,生成操作信息;将所述操作信息发送给被控终端,以控制被控终端。The present invention also discloses B15, a method for controlling a mobile terminal, including: establishing a control connection with the controlled terminal in advance; receiving screen image information sent by the controlled terminal based on the control connection; Analyzing and processing, generating and displaying a display image; generating operation information according to the input operation corresponding to the display image; sending the operation information to the controlled terminal, so as to control the controlled terminal.
B16、根据B15所述的方法,预先与被控终端建立控制连接,包括:接收被控终端所发送的第一连接请求;对第一连接请求进行响应,生成对应的第一连接响应;将所述第一连接响应反馈给被控终端,以建立所述控制连接。B16. According to the method described in B15, establishing a control connection with the controlled terminal in advance includes: receiving the first connection request sent by the controlled terminal; responding to the first connection request, and generating a corresponding first connection response; The first connection response is fed back to the controlled terminal, so as to establish the control connection.
B17、根据B15所述的方法,预先与被控终端建立控制连接,包括:在登录页面后,向服务器发送第二连接请求,以通过所述服务器将所述第二连接请求转发给被控终端;当接收到服务器转发的被控终端反馈的第二连接响应时,建立所述控制连接。B17. According to the method described in B15, establishing a control connection with the controlled terminal in advance includes: after logging in to the page, sending a second connection request to the server, so as to forward the second connection request to the controlled terminal through the server ; When receiving the second connection response fed back by the controlled terminal forwarded by the server, establishing the control connection.
B18、根据B15所述的方法,所述输入操作包括以下任意一项:点击操作、滑动操作或长按操作。B18. According to the method described in B15, the input operation includes any one of the following: click operation, slide operation or long press operation.
B19、根据B18所述的方法,当所述输入操作为长按操作时,所述依据所述显示图像对应的输入操作,生成操作信息,包括:获取所述长按操作在所述显示图像上的操作位置;计算所述长按操作的操作时间;采用所述操作时间和操作位置,生成对应的操作信息。B19. According to the method described in B18, when the input operation is a long press operation, generating operation information according to the input operation corresponding to the display image includes: acquiring the long press operation on the display image calculating the operation time of the long press operation; using the operation time and operation position to generate corresponding operation information.
B20、根据B18所述的方法,当所述输入操作为滑动操作时,所述依据所述显示图像对应的输入操作,生成操作信息,包括:检测滑动操作对应的滑动信息;基于所述滑动信息确定操作信息。B20. According to the method described in B18, when the input operation is a sliding operation, generating operation information according to the input operation corresponding to the display image includes: detecting sliding information corresponding to the sliding operation; based on the sliding information Identify operational information.
B21、根据B18所述的方法,当所述输入操作为点击操作时,所述依据所述显示图像对应的输入操作,生成操作信息,包括:检测所述点击操作在所述显示图像上的点击位置,生成对应操作信息。B21. According to the method described in B18, when the input operation is a click operation, the generating operation information according to the input operation corresponding to the display image includes: detecting the click of the click operation on the display image location to generate corresponding operation information.
B22、根据B15所述的方法,所述将所述操作信息发送给被控终端,包括:将操作信息发送给服务器,以通过所述服务器将所述操作信息转发给被控终端。B22. According to the method described in B15, the sending the operation information to the controlled terminal includes: sending the operation information to a server, so as to forward the operation information to the controlled terminal through the server.
B23、根据B22所述的方法,所述服务器包括:网络服务器或 者应用服务器。B23, according to the method described in B22, described server comprises: network server or application server.
本发明还公开了C24一种控制移动终端的装置,包括:第一连接建立模块,用于预先与主控终端建立控制连接;截屏模块,用于依据系统权限信息对当前显示界面进行截屏,生成屏幕图像信息;屏幕图像发送模块,用于基于所述控制连接,将所述屏幕图像信息发送给主控终端;操作执行模块,用于依据主控终端针对所述屏幕图像信息反馈的操作信息,确定操作事件并执行。The invention also discloses a C24 device for controlling a mobile terminal, including: a first connection establishment module, used to establish a control connection with the main control terminal in advance; a screen capture module, used to capture the current display interface according to system authority information, and generate Screen image information; a screen image sending module, configured to send the screen image information to the main control terminal based on the control connection; an operation execution module, used to feed back the operation information for the screen image information from the main control terminal, Identify operational events and execute them.
C25、根据C24所述的装置,所述第一连接建立模块,包括:登录子模块,用于依据被控终端对应第一标识信息登录页面;输入信息接收子模块,用于依据在页面接收到输入信息,确定第二标识信息;第一请求发送子模块,用于向所述第二标识信息对应的主控终端发送第一连接请求;第一连接建立子模块,用于当接收到所述主控终端针对所述第一连接请求反馈的第一连接响应时,建立所述控制连接。C25. According to the device described in C24, the first connection establishment module includes: a login submodule, used to log in to the page according to the first identification information corresponding to the controlled terminal; an input information receiving submodule, used to receive the information received on the page Input information to determine the second identification information; the first request sending submodule is configured to send a first connection request to the master terminal corresponding to the second identification information; the first connection establishment submodule is configured to receive the When the master control terminal responds to the first connection response fed back by the first connection request, establish the control connection.
C26、根据C25所述的装置,所述登录子模块,包括:第一本地检测单元,用于当检测到第一登录模式选择命令时,检测本地是否存存储有标识信息;第一关联检测单元,用于在本地存储有标识信息时,检测所述标识信息是否与厂商信息关联;标识信息确定单元,用于当所述标识信息不关联厂商信息,将所述标识信息作为第一标识信息;当本地没有存储标识信息,或者所述标识信息关联厂商信息时,通过服务器生成第一标识信息并保存;第一登录单元,用于基于所述第一标识信息执行第一登录模式选择命令,以登录页面。C26. According to the device described in C25, the login submodule includes: a first local detection unit, used to detect whether identification information is stored locally when a first login mode selection command is detected; the first association detection unit , for detecting whether the identification information is associated with vendor information when the identification information is locally stored; an identification information determining unit is configured to use the identification information as first identification information when the identification information is not associated with vendor information; When the identification information is not stored locally, or the identification information is associated with the manufacturer information, the first identification information is generated and saved by the server; the first login unit is configured to execute a first login mode selection command based on the first identification information, to log in page.
C27、根据C25所述的装置,所述登录子模块,包括:厂商信息检测单元,用于当检测到第二登录模式选择命令时,检测登录对应的厂商信息;账号登录单元,用于当检测到厂商信息时,采用所述厂商信息进行账号登录;第二本地检测单元,用于在账号登录后,检测本地是否存储有标识信息;标识信息匹配检测单元,用于当本地存储有标识信息时,检测所述标识信息是否与离线标识信息匹配;第二登录单元,用于当所述标识信息与离线标识信息匹配时,将所述标识信息作为第一标识 信息,并登录页面。C27. According to the device described in C25, the login submodule includes: a manufacturer information detection unit, used to detect the corresponding manufacturer information for login when the second login mode selection command is detected; an account login unit, used for when detecting When the manufacturer information is obtained, use the manufacturer information to log in the account; the second local detection unit is used to detect whether the identification information is stored locally after the account is logged in; the identification information matching detection unit is used for when the identification information is stored locally Detecting whether the identification information matches the offline identification information; a second login unit, configured to use the identification information as the first identification information when the identification information matches the offline identification information, and log in to the page.
C28、根据C27所述的装置,所述登录子模块还包括:第二关联检测单元,用于当所述标识信息与离线标识信息不匹配时,检测所述厂商信息是否与第三标识信息关联;其中,所述第二登录单元,还用于当所述厂商信息不关联第三标识信息时,将所述标识信息作为所述厂商信息对应的第一标识信息,并登录页面;以及用于当所述厂商信息关联第三标识信息时,删除所述标识信息,以及采用所述厂商信息生成对应的第一标识信息,并登录页面。C28. According to the device described in C27, the login submodule further includes: a second association detection unit, configured to detect whether the vendor information is associated with the third identification information when the identification information does not match the offline identification information ; Wherein, the second login unit is also used to use the identification information as the first identification information corresponding to the manufacturer information when the vendor information is not associated with the third identification information, and log in to the page; and for When the vendor information is associated with the third identification information, delete the identification information, use the vendor information to generate corresponding first identification information, and log in to the page.
C29、根据C27所述的装置,所述登录子模块,还包括:服务器检测单元,用于当本地没有存储标识信息时,检测服务器是否存储有所述厂商信息对应的第一标识信息;其中,所述第二登录单元,还用于当检测到服务器存储有第一标识信息时,登录页面,并保存所述厂商信息;以及用于当服务器没有存储有所述第一标识信息时,通过服务器生成第一标识信息并保存,登录页面。C29. According to the device described in C27, the login submodule further includes: a server detection unit, configured to detect whether the server stores the first identification information corresponding to the vendor information when no identification information is stored locally; wherein, The second login unit is also used to log in to the page when it is detected that the server stores the first identification information, and save the manufacturer information; Generate and save the first identification information, and log in to the page.
C30、根据C27所述的装置,所述登录子模块,还包括:注册页面调用单元,用于当未检测到厂商信息时,调用所述厂商信息对注册页面;账号注册单元,用于依据所述注册页面接收的输入信息进行注册,生成厂商信息,并触发所述账号登录单元执行账号登录的步骤。C30. According to the device described in C27, the login submodule also includes: a registration page calling unit, used to call the registration page of the manufacturer information pair when no manufacturer information is detected; an account registration unit, used to Registering with the input information received by the registration page, generating manufacturer information, and triggering the account registration unit to perform the steps of account registration.
C31、根据C25所述的装置,所述输入信息接收子模块,包括:校验单元,用于当接收到符合预设格式的输入信息时,校验所述输入信息的有效性;获取单元,用于当检测到输入信息有效时,获取所述输入信息对应的第二标识信息。C31. According to the device described in C25, the input information receiving submodule includes: a verification unit, configured to verify the validity of the input information when receiving input information conforming to a preset format; an acquisition unit, The method is configured to acquire second identification information corresponding to the input information when it is detected that the input information is valid.
C32、根据C31所述的装置,第一请求发送子模块,包括:特征关系检测单元,用于检测所述第二标识信息是否与第一标识信息具有特征关系;添加请求发送单元,用于当所述第二标识信息与第一标识信息不具有特征关系,向所述主控终端发送特征关系添加请求,以创建所述第二标识信息与第一标识信息的特征关系;第一请求发送单元,用于当第二标识信息与第一标识信息具有特征关系,向所述主控终端发送第一连接 请求。C32. According to the device described in C31, the first request sending submodule includes: a characteristic relationship detection unit, used to detect whether the second identification information has a characteristic relationship with the first identification information; add a request sending unit, used when The second identification information does not have a characteristic relationship with the first identification information, and sends a characteristic relationship addition request to the master terminal to create a characteristic relationship between the second identification information and the first identification information; the first request sending unit is configured to send a first connection request to the master control terminal when the second identification information has a characteristic relationship with the first identification information.
C33、根据C25所述的装置,第一连接建立模块,还包括:判断子模块,用于判断在预设时间范围内是否检测到主控终端反馈的第一连接响应;连接确定子模块,用于当在预设时间范围内未检测到所述第一连接响应,确定所述控制连接建立失败;当在预设时间范围内检测到所述第一连接响应,触发所述第一连接建立子模块执行建立所述控制连接的步骤,以及确定控制连接建立成功。C33. According to the device described in C25, the first connection establishment module further includes: a judging submodule for judging whether the first connection response fed back by the main control terminal is detected within a preset time range; the connection determination submodule is used When the first connection response is not detected within a preset time range, determine that the establishment of the control connection fails; when the first connection response is detected within a preset time range, trigger the first connection establishment sub- The module executes the step of establishing the control connection, and determines that the control connection is established successfully.
C34、根据C24所述的装置,所述截屏模块,包括:权限获取子模块,用于获取被控终端的系统权限信息;截屏子模块,用于基于所述系统权限信息对显示界面进行截屏,得到屏幕图像;压缩子模块,用于对所述屏幕图像进行压缩处理,生成屏幕图像信息。C34. According to the device described in C24, the screen capture module includes: an authority acquisition submodule for acquiring system authority information of the controlled terminal; a screen capture submodule for taking a screenshot of the display interface based on the system authority information, The screen image is obtained; the compression sub-module is used to compress the screen image to generate screen image information.
C35、根据C34所述的装置,所述屏幕图像发送模块,具体用于利用预设算法将屏幕图像信息发送给服务器,以通过服务器将所述屏幕图像信息转发给主控终端。C35. According to the device described in C34, the screen image sending module is specifically configured to use a preset algorithm to send the screen image information to the server, so as to forward the screen image information to the main control terminal through the server.
C36、根据C34所述的装置,所述操作执行模块,具体用于当接收到服务器转发主控终端所反馈的操作信息时,对所述操作信息进行解析,确定操作事;以及,通过调用应用程序编程接口,将所述操作事件添加到输入队列中,其中,所述输入队列用于按照添加顺序执行操作事件。C36. According to the device described in C34, the operation execution module is specifically configured to analyze the operation information and determine the operation when receiving the operation information fed back by the main control terminal forwarded by the server; and, by calling the application A program programming interface, adding the operation event to an input queue, wherein the input queue is used to execute the operation event in the order of adding.
C37、根据C25所述的装置,所述第一连接建立模块,还包括:第二请求接收子模块,用于在登录页面后,接收服务器转发的主控终端所提交的第二连接请求;第二响应生成子模块,用于对所述第二连接请求进行响应,生成对应的第二连接响应;第二响应发送子模块,用于将所述第二连接响应发送所述服务器,并触发所述第一连接建立子模块建立所述控制连接,其中所述服务器用于将第二连接响应反馈给主控终端。C37. According to the device described in C25, the first connection establishment module further includes: a second request receiving submodule, configured to receive the second connection request submitted by the master control terminal forwarded by the server after logging in to the page; The second response generation submodule is configured to respond to the second connection request and generate a corresponding second connection response; the second response sending submodule is configured to send the second connection response to the server and trigger the second connection response The first connection establishment submodule establishes the control connection, wherein the server is used to feed back the second connection response to the main control terminal.
本发明还公开了D38一种控制移动终端的装置,包括:第二连接建立模块,用于预先与被控终端建立控制连接;屏幕图像接收模块,用于 基于所述控制连接,接收所述被控终端所发送的屏幕图像信息;屏幕图像解析模块,用于对屏幕图像信息进行解析处理,生成显示图像并展示;The present invention also discloses D38 a device for controlling a mobile terminal, including: a second connection establishment module, used to establish a control connection with the controlled terminal in advance; a screen image receiving module, used to receive the controlled terminal based on the control connection The screen image information sent by the control terminal; the screen image analysis module is used to analyze and process the screen image information, generate and display the display image;
操作信息生成模块,用于依据所述显示图像对应的输入操作,生成操作信息;操作信息发送模块,用于将所述操作信息发送给被控终端,以控制被控终端。The operation information generation module is used to generate operation information according to the input operation corresponding to the displayed image; the operation information sending module is used to send the operation information to the controlled terminal to control the controlled terminal.
D39、根据D38所述的装置,第二连接建立模块,包括:第一请求接收子模块,用于接收被控终端所发送的第一连接请求;第一响应生成子模块,用于对第一连接请求进行响应,生成对应的第一连接响应;第一响应发送子模块,用于将所述第一连接响应反馈给被控终端,以建立所述控制连接。D39. According to the device described in D38, the second connection establishing module includes: a first request receiving submodule, configured to receive the first connection request sent by the controlled terminal; a first response generating submodule, configured to respond to the first Respond to the connection request, and generate a corresponding first connection response; the first response sending submodule is configured to feed back the first connection response to the controlled terminal, so as to establish the control connection.
D40、根据D38所述的装置,第二连接建立模块,包括:第二发送子模块,用于在登录页面后,向服务器发送第二连接请求,以通过所述服务器将所述第二连接请求转发给被控终端;第二连接建立子模块,用于当接收到服务器转发的被控终端反馈的第二连接响应时,建立所述控制连接。D40. According to the device described in D38, the second connection establishment module includes: a second sending submodule, configured to send a second connection request to the server after logging in to the page, so as to send the second connection request to the server through the server Forwarding to the controlled terminal; the second connection establishment submodule is configured to establish the control connection when receiving the second connection response fed back by the controlled terminal forwarded by the server.
D41、根据D38所述的装置,所述输入操作包括以下任意一项:点击操作、滑动操作或长按操作。D41. The device according to D38, wherein the input operation includes any one of the following: click operation, slide operation or long press operation.
D42、根据D41所述的装置,当所述输入操作为长按操作时,所述操作信息生成模块,具体用于获取所述长按操作在所述显示图像上的操作位置,计算所述长按操作的操作时间,以及采用所述操作时间和操作位置,生成对应的操作信息。D42. According to the device described in D41, when the input operation is a long press operation, the operation information generation module is specifically configured to obtain the operation position of the long press operation on the display image, and calculate the long press operation The corresponding operation information is generated according to the operation time of the operation and the operation time and the operation position.
D43、根据D41所述的装置,当所述输入操作为滑动操作时,所述操作信息生成模块,具体用于检测滑动操作对应的滑动信息,基于所述滑动信息确定操作信息。D43. The device according to D41, when the input operation is a slide operation, the operation information generation module is specifically configured to detect slide information corresponding to the slide operation, and determine the operation information based on the slide information.
D44、根据D41所述的装置,当所述输入操作为点击操作时,所述操作信息生成模块,具体用于检测所述点击操作在所述显示图像上的点击位置,生成对应操作信息。D44. The device according to D41, when the input operation is a click operation, the operation information generating module is specifically configured to detect a click position of the click operation on the display image, and generate corresponding operation information.
D45、根据D38所述的装置,所述操作信息发送模块,具体用 于将操作信息发送给服务器,以通过所述服务器将所述操作信息转发给被控终端。D45. According to the device described in D38, the operation information sending module is specifically configured to send the operation information to a server, so as to forward the operation information to the controlled terminal through the server.
D46、根据D45所述的装置,所述服务器包括:网络服务器或者应用服务器。D46. The device according to D45, wherein the server includes: a network server or an application server.
本发明还公开了E47一种移动终端,包括:存储器,加载有多条可执行指令;处理器,执行所述多条可执行指令;所述多条可执行指令包括执行A1至B23任一所述的方法。The present invention also discloses a mobile terminal E47, including: a memory loaded with multiple executable instructions; a processor for executing the multiple executable instructions; the multiple executable instructions include executing any one of A1 to B23 described method.
| Application Number | Priority Date | Filing Date | Title | 
|---|---|---|---|
| CN201610323815.2ACN105915527B (en) | 2016-05-16 | 2016-05-16 | A method and device for controlling a mobile terminal, and a mobile terminal | 
| Application Number | Priority Date | Filing Date | Title | 
|---|---|---|---|
| CN201610323815.2ACN105915527B (en) | 2016-05-16 | 2016-05-16 | A method and device for controlling a mobile terminal, and a mobile terminal | 
| Publication Number | Publication Date | 
|---|---|
| CN105915527Atrue CN105915527A (en) | 2016-08-31 | 
| CN105915527B CN105915527B (en) | 2019-03-08 | 
| Application Number | Title | Priority Date | Filing Date | 
|---|---|---|---|
| CN201610323815.2AActiveCN105915527B (en) | 2016-05-16 | 2016-05-16 | A method and device for controlling a mobile terminal, and a mobile terminal | 
| Country | Link | 
|---|---|
| CN (1) | CN105915527B (en) | 
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| CN107509051A (en)* | 2017-08-14 | 2017-12-22 | 宇龙计算机通信科技(深圳)有限公司 | Long-range control method, device, terminal and computer-readable recording medium | 
| CN108429810A (en)* | 2018-03-15 | 2018-08-21 | 广东小天才科技有限公司 | Remote control method and system based on family education equipment | 
| CN108446321A (en)* | 2018-02-10 | 2018-08-24 | 武汉市灯塔互动文化传播有限公司 | A kind of automatic question-answering method based on deep learning | 
| CN108737337A (en)* | 2017-04-18 | 2018-11-02 | 腾讯科技(深圳)有限公司 | Equipment processing method, device, server and system | 
| CN108833963A (en)* | 2018-05-31 | 2018-11-16 | 腾讯科技(上海)有限公司 | Method for displaying interface screen, computer device, readable storage medium and system | 
| CN109165062A (en)* | 2018-07-24 | 2019-01-08 | 苏宁易购集团股份有限公司 | A kind of terminal remote assists control method and system | 
| CN109495573A (en)* | 2018-11-26 | 2019-03-19 | Oppo广东移动通信有限公司 | Data transmission method, device, storage medium and terminal | 
| CN109600685A (en)* | 2019-02-19 | 2019-04-09 | 上海闻泰信息技术有限公司 | Long-range control method and device | 
| CN109683780A (en)* | 2018-12-26 | 2019-04-26 | 上海司南卫星导航技术股份有限公司 | Control method, system and the controlled terminal of mobile terminal | 
| CN110365657A (en)* | 2019-06-21 | 2019-10-22 | 北京奇艺世纪科技有限公司 | Remote assistance method, device and readable storage medium storing program for executing | 
| CN110752963A (en)* | 2018-07-24 | 2020-02-04 | 腾讯科技(深圳)有限公司 | Event processing method and device, storage medium and electronic device | 
| CN111275427A (en)* | 2020-01-20 | 2020-06-12 | 维沃移动通信有限公司 | Receipt and payment method and electronic equipment | 
| CN114968023A (en)* | 2022-05-12 | 2022-08-30 | 百富计算机技术(深圳)有限公司 | Terminal control method, terminal control device, electronic equipment and storage medium | 
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| CN104394191A (en)* | 2014-10-22 | 2015-03-04 | 腾讯科技(深圳)有限公司 | Method, control terminal, and system for remotely controlling mobile terminal | 
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| CN104394191A (en)* | 2014-10-22 | 2015-03-04 | 腾讯科技(深圳)有限公司 | Method, control terminal, and system for remotely controlling mobile terminal | 
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| CN108737337A (en)* | 2017-04-18 | 2018-11-02 | 腾讯科技(深圳)有限公司 | Equipment processing method, device, server and system | 
| CN108737337B (en)* | 2017-04-18 | 2021-07-27 | 腾讯科技(深圳)有限公司 | Device processing method, device, server and system | 
| CN107509051A (en)* | 2017-08-14 | 2017-12-22 | 宇龙计算机通信科技(深圳)有限公司 | Long-range control method, device, terminal and computer-readable recording medium | 
| CN108446321A (en)* | 2018-02-10 | 2018-08-24 | 武汉市灯塔互动文化传播有限公司 | A kind of automatic question-answering method based on deep learning | 
| CN108429810B (en)* | 2018-03-15 | 2021-06-25 | 广东小天才科技有限公司 | A remote control method and system based on home education equipment | 
| CN108429810A (en)* | 2018-03-15 | 2018-08-21 | 广东小天才科技有限公司 | Remote control method and system based on family education equipment | 
| CN108833963A (en)* | 2018-05-31 | 2018-11-16 | 腾讯科技(上海)有限公司 | Method for displaying interface screen, computer device, readable storage medium and system | 
| CN110752963A (en)* | 2018-07-24 | 2020-02-04 | 腾讯科技(深圳)有限公司 | Event processing method and device, storage medium and electronic device | 
| CN109165062A (en)* | 2018-07-24 | 2019-01-08 | 苏宁易购集团股份有限公司 | A kind of terminal remote assists control method and system | 
| CN110752963B (en)* | 2018-07-24 | 2022-02-22 | 腾讯科技(深圳)有限公司 | Event processing method and device, storage medium and electronic device | 
| CN109495573A (en)* | 2018-11-26 | 2019-03-19 | Oppo广东移动通信有限公司 | Data transmission method, device, storage medium and terminal | 
| CN109683780A (en)* | 2018-12-26 | 2019-04-26 | 上海司南卫星导航技术股份有限公司 | Control method, system and the controlled terminal of mobile terminal | 
| CN109600685A (en)* | 2019-02-19 | 2019-04-09 | 上海闻泰信息技术有限公司 | Long-range control method and device | 
| CN110365657A (en)* | 2019-06-21 | 2019-10-22 | 北京奇艺世纪科技有限公司 | Remote assistance method, device and readable storage medium storing program for executing | 
| CN111275427A (en)* | 2020-01-20 | 2020-06-12 | 维沃移动通信有限公司 | Receipt and payment method and electronic equipment | 
| CN114968023A (en)* | 2022-05-12 | 2022-08-30 | 百富计算机技术(深圳)有限公司 | Terminal control method, terminal control device, electronic equipment and storage medium | 
| Publication number | Publication date | 
|---|---|
| CN105915527B (en) | 2019-03-08 | 
| Publication | Publication Date | Title | 
|---|---|---|
| CN105915527A (en) | Mobile terminal, method and device for controlling same | |
| US10834237B2 (en) | Method, apparatus, and storage medium for controlling cooperation of multiple intelligent devices with social application platform | |
| US11057376B2 (en) | Method, apparatus, and system for controlling intelligent device, and storage medium | |
| CN106341300B (en) | Method, device and system for task release | |
| WO2016150270A1 (en) | Method and apparatus for processing group session message | |
| CN110166439B (en) | Device sharing method, terminal, router and server | |
| WO2018045487A1 (en) | Data sharing method and terminal | |
| CN108156329A (en) | Method, mobile terminal and the computer readable storage medium that message is sent | |
| CN111478849B (en) | Service access method, device and storage medium | |
| CN111756696A (en) | Application login method, first electronic device and second electronic device | |
| WO2021078215A1 (en) | Method for cross-terminal switching of cloud game and related device | |
| CN106250122A (en) | A kind of information cuing method and device | |
| CN104581993A (en) | Method for establishing wireless connection, method for data transmission, and terminal | |
| CN104660769B (en) | A kind of methods, devices and systems for adding associated person information | |
| CN107046595A (en) | Notification information processing method, device and mobile terminal | |
| CN104202301B (en) | Numeric value transfer and device | |
| CN108733993A (en) | A kind of method for information display and terminal | |
| CN107786423B (en) | A kind of method and system of instant messaging | |
| CN106331301B (en) | A kind of method and apparatus adding contact person | |
| CN106874045A (en) | A kind of startup method of application program, device and mobile terminal | |
| CN106713386A (en) | Projection equipment binding communication method, projection equipment and intelligent terminal | |
| CN107592289B (en) | Password setting method and device | |
| CN104580251B (en) | A kind of method and apparatus for carrying out authorizing quick registration | |
| CN114501449B (en) | Information query method, device, electronic equipment and storage medium | |
| CN105991510A (en) | Session synchronization method, device and system among multiple terminals | 
| Date | Code | Title | Description | 
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right | Effective date of registration:20161129 Address after:100088 Beijing city Xicheng District xinjiekouwai Street 28, block D room 112 (Desheng Park) Applicant after:Beijing Qihu Technology Co., Ltd. Address before:100088 Beijing city Xicheng District xinjiekouwai Street 28, block D room 112 (Desheng Park) Applicant before:Beijing Qihu Technology Co., Ltd. Applicant before:Our Internet Network Technology (Shenzhen) Co., Ltd. | |
| TA01 | Transfer of patent application right | Effective date of registration:20170802 Address after:100102, 18 floor, building 2, Wangjing street, Beijing, Chaoyang District, 1801 Applicant after:BEIJING ANYUN SHIJI SCIENCE AND TECHNOLOGY CO., LTD. Address before:100088 Beijing city Xicheng District xinjiekouwai Street 28, block D room 112 (Desheng Park) Applicant before:Beijing Qihu Technology Co., Ltd. | |
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |