技术领域technical field
本发明涉及到嵌入式电子设备技术领域，特别涉及到嵌入式设备远程协控方法和系统。The invention relates to the technical field of embedded electronic equipment, in particular to a method and system for remote coordinated control of embedded equipment.
背景技术Background technique
科技发展日新月异，电视行业也发生一次又一次的重大变革，相继推出3D电视、智能电视以及云电视，电视的智能化水平逐步提高，功能也越来越多。用户在使用电视的过程中难免会遇到一些问题，如果想立刻解决，唯有向售后工程师请求帮助。然而售后工程师并不能立刻上门帮助用户解决问题，只能暂时通过电话交流的方式进行问题询问，并指导用户自行修复。由于电话交流即费时又容易出错，而且有些问题通过电话说不清楚，可能会因用户理解或操作上的偏差将简单的问题复杂化，进一步严重影响了用户正常的使用。With the rapid development of science and technology, the TV industry has undergone major changes again and again. 3D TVs, smart TVs and cloud TVs have been launched one after another. Users will inevitably encounter some problems in the process of using the TV. If they want to solve them immediately, they can only ask the after-sales engineers for help. However, after-sales engineers cannot come to the door immediately to help users solve problems. They can only ask questions through telephone communication temporarily, and guide users to repair themselves. Because telephone communication is time-consuming and error-prone, and some problems can not be explained clearly through the phone, simple problems may be complicated due to user understanding or operational deviation, which further seriously affects the normal use of users.
发明内容Contents of the invention
本发明的主要目的为提供一种及时、准确的进行嵌入式电子设备维修服务的嵌入式设备远程协控方法和系统。The main purpose of the present invention is to provide a method and system for remote coordinated control of embedded devices for timely and accurate maintenance of embedded electronic devices.
本发明提出一种嵌入式设备远程协控方法，包括步骤：The present invention proposes a remote coordinated control method for embedded devices, including steps:
售后服务端接收用户端发送的所述用户端的外网IP和端口信息，并根据所述用户端的外网IP和端口信息，连接所述用户端；The after-sales service terminal receives the external network IP and port information of the user terminal sent by the user terminal, and connects the user terminal according to the external network IP and port information of the user terminal;
所述售后服务端接收所述用户端发送的所述用户端的屏幕参数和当前显示界面数据，并根据所述用户端的屏幕参数和当前显示界面数据，在所述售后服务端的屏幕上显示所述用户端的当前显示界面；The after-sales service end receives the screen parameters and current display interface data of the user end sent by the user end, and displays the user information on the screen of the after-sales service end according to the screen parameters and current display interface data of the user end. The current display interface of the terminal;
所述售后服务端捕捉所述售后服务端的鼠标或键盘操控指令，并发送至所述用户端，实现对所述用户端的操控。The after-sales service terminal captures the mouse or keyboard control commands of the after-sales service terminal, and sends them to the user terminal to realize the control of the user terminal.
优选地，所述售后服务端根据用户端的外网IP和端口信息，连接所述用户端的步骤之前还包括：Preferably, the after-sales service terminal further includes before the step of connecting the user terminal according to the external network IP and port information of the user terminal:
所述用户端分别建立内网IP与外网IP、内网端口与外网端口之间的映射关系，获得所述用户端的外网IP和端口信息；The user end establishes the mapping relationship between the internal network IP and the external network IP, the internal network port and the external network port respectively, and obtains the external network IP and port information of the user end;
所述用户端根据所述售后服务端的网络地址，向所述售后服务端发送所述用户端的外网IP和端口信息。The user end sends the external network IP and port information of the user end to the after-sales service end according to the network address of the after-sales service end.
优选地，所述售后服务端接收所述用户端发送的所述用户端的屏幕参数和当前显示界面数据，并根据所述用户端的屏幕参数和当前显示界面数据，在所述售后服务端的屏幕上显示所述用户端的当前显示界面的步骤具体包括：Preferably, the after-sales service end receives the screen parameters and current display interface data of the user end sent by the user end, and displays on the screen of the after-sales service end according to the screen parameters and current display interface data of the user end The steps of the current display interface of the client specifically include:
所述售后服务端接收所述用户端发送的所述用户端的屏幕参数；The after-sales service terminal receives the screen parameters of the user terminal sent by the user terminal;
所述售后服务端根据所述用户端的屏幕参数，建立屏幕映射表；The after-sales service end establishes a screen mapping table according to the screen parameters of the user end;
所述售后服务端接收所述用户端发送的所述用户端的当前显示界面数据；The after-sales service terminal receives the current display interface data of the user terminal sent by the user terminal;
所述售后服务端根据所述屏幕映射表和用户端的当前显示界面数据，在所述售后服务端的屏幕上显示所述用户端的当前显示界面。The after-sales service terminal displays the current display interface of the user terminal on the screen of the after-sales service terminal according to the screen mapping table and the current display interface data of the user terminal.
优选地，所述售后服务端接收所述用户端发送的所述用户端的屏幕参数的步骤之前还包括：Preferably, before the step of receiving the screen parameters of the user terminal sent by the user terminal, the after-sales service terminal further includes:
所述用户端读取所述用户端的设备文件；The client reads the device file of the client;
所述用户端从所述用户端的设备文件中解析出所述用户端的屏幕参数；The client parses out the screen parameters of the client from the device file of the client;
所述用户端将所述用户端的屏幕参数发送至所述售后服务端。The user terminal sends the screen parameters of the user terminal to the after-sales service terminal.
优选地，所述售后服务端接收所述用户端发送的所述用户端的当前显示界面数据的步骤之前还包括：Preferably, before the step of receiving the current display interface data of the user terminal sent by the user terminal, the after-sales service terminal further includes:
所述用户端对所述用户端的当前显示界面进行截屏处理；The user terminal performs screenshot processing on the current display interface of the user terminal;
所述用户端对截屏处理后的当前显示界面数据进行压缩编码处理；The user end compresses and encodes the current display interface data after the screenshot processing;
所述用户端将压缩编码处理后的当前显示界面数据发送至所述售后服务端。The user end sends the current display interface data processed by compression encoding to the after-sales service end.
优选地，所述售后服务端捕捉所述售后服务端的鼠标或键盘操控指令，并发送至所述用户端的步骤之后还包括：Preferably, after the after-sales service terminal captures the mouse or keyboard manipulation instructions of the after-sales service terminal and sends them to the user terminal, it further includes:
所述用户端解析所述售后服务端的鼠标或键盘操控指令，并注入到所述用户端的设备文件中；The user end parses the mouse or keyboard control command of the after-sales service end, and injects it into the device file of the user end;
所述用户端执行所述售后服务端的鼠标或键盘操控指令对应的操作；The user end executes the operation corresponding to the mouse or keyboard control command of the after-sales service end;
所述用户端将所述对应的操作显示在所述用户端的当前显示界面，并返回所述用户端对所述用户端的当前显示界面进行截屏处理的步骤。The user terminal displays the corresponding operation on the current display interface of the user terminal, and returns to the step where the user terminal takes a screenshot of the current display interface of the user terminal.
本发明还提出一种嵌入式设备远程协控系统，包括售后服务端和用户端，所述售后服务端包括：The present invention also proposes a remote coordinated control system for embedded devices, including an after-sales service terminal and a user terminal, and the after-sales service terminal includes:
第一连接模块，用于接收所述用户端发送的所述用户端的外网IP和端口信息，并根据所述用户端的外网IP和端口信息，连接所述用户端；The first connection module is configured to receive the external network IP and port information of the user terminal sent by the user terminal, and connect the user terminal according to the external network IP and port information of the user terminal;
屏幕处理模块，用于接收所述用户端发送的所述用户端的屏幕参数和当前显示界面数据，并根据所述用户端的屏幕参数和当前显示界面数据，在所述售后服务端的屏幕上显示所述用户端的当前显示界面；A screen processing module, configured to receive the screen parameters and current display interface data of the user terminal sent by the user terminal, and display the The current display interface of the client;
操控模块，用于捕捉所述售后服务端的鼠标或键盘操控指令，并发送至所述用户端，实现对所述用户端的操控。The control module is used to capture the mouse or keyboard control command of the after-sales service terminal, and send it to the user terminal, so as to realize the control of the user terminal.
优选地，所述用户端包括第二连接模块，所述第二连接模块具体包括：Preferably, the user end includes a second connection module, and the second connection module specifically includes:
网络映射子模块，用于分别建立内网IP与外网IP、内网端口与外网端口之间的映射关系，获得所述用户端的外网IP和端口信息；The network mapping submodule is used to respectively establish the mapping relationship between the internal network IP and the external network IP, the internal network port and the external network port, and obtain the external network IP and port information of the client;
IP/端口发送子模块，用于根据所述售后服务端的网络地址，向所述售后服务端发送所述用户端的外网IP和端口信息。The IP/port sending sub-module is configured to send the external network IP and port information of the user terminal to the after-sales service terminal according to the network address of the after-sales service terminal.
优选地，所述售后服务端的屏幕处理模块具体包括：Preferably, the screen processing module of the after-sales service terminal specifically includes:
屏幕参数接收子模块，用于接收所述用户端发送的所述用户端的屏幕参数；A screen parameter receiving submodule, configured to receive the screen parameters of the client sent by the client;
屏幕映射子模块，用于根据所述用户端的屏幕参数，建立屏幕映射表；A screen mapping submodule, configured to create a screen mapping table according to the screen parameters of the client;
界面数据接受子模块，用于接收所述用户端发送的所述用户端的当前显示界面数据；The interface data receiving submodule is used to receive the current display interface data of the user terminal sent by the user terminal;
界面显示子模块，用于根据所述屏幕映射表和用户端的当前显示界面数据，在所述售后服务端的屏幕上显示所述用户端的当前显示界面。The interface display sub-module is used to display the current display interface of the user terminal on the screen of the after-sales service terminal according to the screen mapping table and the current display interface data of the user terminal.
优选地，所述用户端还包括屏幕参数生成模块，所述屏幕参数生成模块具体包括：Preferably, the client further includes a screen parameter generation module, and the screen parameter generation module specifically includes:
设备文件读取子模块，用于读取所述用户端的设备文件；The device file reading submodule is used to read the device file of the client;
屏幕参数解析子模块，用于从所述用户端的设备文件中解析出所述用户端的屏幕参数；A screen parameter parsing submodule, configured to parse out the screen parameters of the client from the device file of the client;
屏幕参数发送子模块，将所述用户端的屏幕参数发送至所述售后服务端。The screen parameter sending sub-module sends the screen parameters of the user end to the after-sales service end.
优选地，所述用户端还包括界面数据生成模块，所述界面数据生成模块具体包括：Preferably, the user terminal further includes an interface data generation module, and the interface data generation module specifically includes:
截屏子模块，用于对所述用户端的当前显示界面进行截屏处理；A screen capture sub-module, configured to perform screen capture processing on the current display interface of the client;
压缩编码子模块，用于对截屏处理后的当前显示界面数据进行压缩编码处理；The compression encoding sub-module is used to compress and encode the current display interface data after the screenshot processing;
界面数据发送子模块，用于将压缩编码处理后的当前显示界面数据发送至所述售后服务端。The interface data sending sub-module is used to send the current display interface data processed by compression encoding to the after-sales service end.
优选地，所述用户端还包括操控指令处理模块，所述操控指令处理模块具体包括：Preferably, the user terminal further includes a manipulation instruction processing module, and the manipulation instruction processing module specifically includes:
操控指令解析模块，用于解析所述售后服务端的鼠标或键盘操控指令，并注入到所述用户端的设备文件中；A manipulation command parsing module, configured to parse the mouse or keyboard manipulation command of the after-sales service end, and inject it into the device file of the client end;
操控指令执行模块，用于执行所述售后服务端的鼠标或键盘操控指令对应的操作；A manipulation instruction execution module, configured to execute operations corresponding to the mouse or keyboard manipulation instructions at the after-sales service end;
操控处理显示模块，用于将所述对应的操作显示在所述用户端的当前显示界面；a manipulation processing display module, configured to display the corresponding operation on the current display interface of the client;
所述界面数据生成模块的截屏子模块还用于，在所述操控处理显示模块完成将所述对应的操作显示在所述用户端的当前显示界面后，重新对所述用户端的当前显示界面进行截屏处理。The screen capture sub-module of the interface data generation module is also used to, after the manipulation processing display module finishes displaying the corresponding operation on the current display interface of the user terminal, take a screenshot of the current display interface of the user terminal again deal with.
本发明结合了嵌入式技术与云计算技术，让售后服务端主动找到处于内网的用户端，将屏幕数据流和控制命令流构造成一个统一的结构体，有效实现远程操控，降低网络要求，减小售后服务端的压力，并发能力显著提高，有利于及时、准确的进行嵌入式电子设备远程维修服务。The present invention combines embedded technology and cloud computing technology, allowing the after-sales service end to actively find the user end in the intranet, constructing a unified structure of screen data flow and control command flow, effectively realizing remote control, reducing network requirements, The pressure on the after-sales service end is reduced, and the concurrency capability is significantly improved, which is conducive to timely and accurate remote maintenance services for embedded electronic devices.
附图说明Description of drawings
图1为本发明嵌入式设备远程协控方法第一实施例的流程图；Fig. 1 is a flow chart of the first embodiment of the embedded device remote coordinated control method of the present invention;
图2为本发明嵌入式设备远程协控方法第二实施例的流程图；FIG. 2 is a flow chart of the second embodiment of the remote coordinated control method for embedded devices of the present invention;
图3为本发明嵌入式设备远程协控方法第三实施例的流程图；FIG. 3 is a flow chart of a third embodiment of the method for remote coordinated control of an embedded device according to the present invention;
图4为本发明嵌入式设备远程协控方法第四实施例的流程图；FIG. 4 is a flow chart of a fourth embodiment of the embedded device remote coordinated control method of the present invention;
图5为本发明嵌入式设备远程协控方法第五实施例的流程图；FIG. 5 is a flowchart of a fifth embodiment of the embedded device remote coordinated control method of the present invention;
图6为本发明嵌入式设备远程协控方法第六实施例的流程图；FIG. 6 is a flowchart of a sixth embodiment of a method for remote coordinated control of an embedded device according to the present invention;
图7为本发明嵌入式设备远程协控系统第一实施例的结构示意图；7 is a schematic structural diagram of the first embodiment of the embedded device remote coordinated control system of the present invention;
图8为本发明嵌入式设备远程协控系统第二实施例的结构示意图；FIG. 8 is a schematic structural diagram of a second embodiment of the embedded device remote coordinated control system of the present invention;
图9为本发明嵌入式设备远程协控系统第三实施例的结构示意图；9 is a schematic structural diagram of a third embodiment of the embedded device remote coordinated control system of the present invention;
图10为本发明嵌入式设备远程协控系统第四实施例的结构示意图；FIG. 10 is a schematic structural diagram of a fourth embodiment of the embedded device remote coordinated control system of the present invention;
图11为本发明嵌入式设备远程协控系统第五实施例的结构示意图；FIG. 11 is a schematic structural diagram of a fifth embodiment of the embedded device remote coordinated control system of the present invention;
图12为本发明嵌入式设备远程协控系统第六实施例的结构示意图。FIG. 12 is a schematic structural diagram of a sixth embodiment of an embedded device remote cooperative control system according to the present invention.
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
具体实施方式detailed description
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
如图1所示，图1为本发明嵌入式设备远程协控方法第一实施例的流程图，该实施例提到的嵌入式设备远程协控方法，包括：As shown in Figure 1, Figure 1 is a flow chart of the first embodiment of the embedded device remote coordinated control method of the present invention, the embedded device remote coordinated control method mentioned in this embodiment includes:
步骤S10，售后服务端接收用户端发送的用户端的外网IP和端口信息，并根据用户端的外网IP和端口信息，连接用户端；Step S10, the after-sales service terminal receives the external network IP and port information of the user terminal sent by the user terminal, and connects to the user terminal according to the external network IP and port information of the user terminal;
本实施例的用户端为嵌入式电子设备，例如，智能电视机、网络电视等。用户端在发送用户端的外网IP和端口信息时，用户端还向售后服务端发送协助请求，售后服务端接收到协助请求后，解析用户端的外网IP和端口信息，根据IP和端口信息，与用户端建立连接。若连接成功，则可向用户端发送屏幕获取请求。通过用户端发送的用户端的外网IP和端口信息，使处于外网的售后服务端主动找到处于内网的用户端，并可以实时的发送屏幕获取请求，实现用户端与售后服务端之间点对点的通信。The client in this embodiment is an embedded electronic device, such as a smart TV, an Internet TV, and the like. When the user end sends the external network IP and port information of the user end, the user end also sends an assistance request to the after-sales service end. After receiving the assistance request, the after-sales service end analyzes the external network IP and port information of the user end. According to the IP and port information, Establish a connection with the client. If the connection is successful, a screen acquisition request may be sent to the client. Through the external network IP and port information of the user terminal sent by the user terminal, the after-sales service terminal in the external network can actively find the user terminal in the internal network, and can send a screen acquisition request in real time, realizing point-to-point between the user terminal and the after-sales service terminal Communication.
步骤S20，售后服务端接收用户端发送的用户端的屏幕参数和当前显示界面数据，并根据用户端的屏幕参数和当前显示界面数据，在售后服务端的屏幕上显示用户端的当前显示界面；Step S20, the after-sales service terminal receives the screen parameters of the user terminal and the current display interface data sent by the user terminal, and displays the current display interface of the user terminal on the screen of the after-sales service terminal according to the screen parameters of the user terminal and the current display interface data;
用户端在向售后服务端发送协助请求的同时，还可向售后服务端发送用户端的屏幕参数，用户端在接收到售后服务端发送的屏幕获取请求后，将用户端的当前显示界面数据发送给售后服务端；或者用户端在接收到售后服务端发送的屏幕获取请求后，将用户端的屏幕参数和当前显示界面数据一同发送给售后服务端；或者在售后服务端的鼠标或键盘首次发生操作事件后，用户端再向售后服务端发生用户端的屏幕参数和当前显示界面数据。售后服务端将用户端的屏幕参数与售后服务端的屏幕参数之间建立屏幕映射关系，并在接收到用户端的当前显示界面数据后，将用户端的当前显示界面显示在售后服务端的屏幕上，实现用户端与售后服务端之间的屏幕传递。While sending an assistance request to the after-sales service terminal, the user terminal can also send the screen parameters of the user terminal to the after-sales service terminal. After receiving the screen acquisition request sent by the after-sales service terminal, the user terminal sends the current display interface data of the user terminal to the after-sales service terminal The server; or the user end, after receiving the screen acquisition request sent by the after-sales service end, sends the screen parameters of the user end and the current display interface data to the after-sales service end; The user end then sends the user end screen parameters and current display interface data to the after-sales service end. The after-sales service terminal establishes a screen mapping relationship between the screen parameters of the user terminal and the screen parameters of the after-sales service terminal, and after receiving the current display interface data of the user terminal, displays the current display interface of the user terminal on the screen of the after-sales service terminal. Screen transmission with the after-sales service end.
步骤S30，售后服务端捕捉售后服务端的鼠标或键盘操控指令，并发送至用户端，实现对用户端的操控。In step S30, the after-sales service terminal captures the mouse or keyboard control command of the after-sales service terminal, and sends it to the user terminal, so as to control the user terminal.
售后服务端在实现与用户端之间的屏幕传递后，注册鼠标/键盘监听器，对售后服务端的鼠标或键盘进行监听。由于用户端的当前显示界面已显示在售后服务端的屏幕上，售后工程师可通过售后服务端的屏幕查看到用户端的当前显示界面。当售后工程师通过售后服务端的鼠标或键盘在售后服务端的屏幕上进行相应的操作时，售后服务端实时捕捉到鼠标或键盘事件，生成鼠标或键盘操控指令，并将这些事件对应的操控指令传输到用户端，随后注入电视机系统中，从而实现电视机的远程操控功能，为远程控制嵌入式设备提供了一条新的途径。After the after-sales service terminal realizes the screen transmission with the user terminal, it registers a mouse/keyboard listener to monitor the mouse or keyboard of the after-sales service terminal. Since the current display interface of the user terminal has been displayed on the screen of the after-sales service terminal, the after-sales engineer can check the current display interface of the user terminal through the screen of the after-sales service terminal. When the after-sales engineer performs corresponding operations on the screen of the after-sales service terminal through the mouse or keyboard of the after-sales service terminal, the after-sales service terminal captures mouse or keyboard events in real time, generates mouse or keyboard control commands, and transmits the control commands corresponding to these events to The user end is then injected into the TV system, thereby realizing the remote control function of the TV, and providing a new way for remote control of embedded devices.
本实施例结合了嵌入式技术与云计算技术，让售后服务端主动找到处于内网的用户端，将屏幕数据流和控制命令流构造成一个统一的结构体，有效实现远程操控，降低网络要求，减小售后服务端的压力，并发能力显著提高，有利于及时、准确的进行嵌入式电子设备远程维修服务。This embodiment combines embedded technology and cloud computing technology, allowing the after-sales service end to actively find the user end in the intranet, constructing a unified structure of screen data flow and control command flow, effectively realizing remote control and reducing network requirements , reduce the pressure on the after-sales service end, and significantly improve the concurrency capability, which is conducive to timely and accurate remote maintenance services for embedded electronic devices.
如图2所示，图2为本发明嵌入式设备远程协控方法第二实施例的流程图。步骤S10之前还包括：As shown in FIG. 2 , FIG. 2 is a flowchart of a second embodiment of a method for remote coordinated control of an embedded device according to the present invention. Also include before step S10:
步骤S41，用户端分别建立内网IP与外网IP、内网端口与外网端口之间的映射关系，获得用户端的外网IP和端口信息；Step S41, the user terminal respectively establishes the mapping relationship between the internal network IP and the external network IP, the internal network port and the external network port, and obtains the external network IP and port information of the user terminal;
用户端利用UPNP协议，实现处于内网的用户端与外部网络之间的网络映射，获得用户端对应的外网IP和端口，例如内网的电视机与路由器的端口映射。售后服务端可通过用户端对应的外网IP和端口主动找到处于内网的用户端，并实时发送屏幕获取请求。The client uses the UPNP protocol to implement network mapping between the client on the internal network and the external network, and obtains the corresponding external network IP and port of the client, such as port mapping between a TV set on the internal network and a router. The after-sales service terminal can actively find the client terminal in the internal network through the external network IP and port corresponding to the client terminal, and send a screen acquisition request in real time.
步骤S42，用户端根据售后服务端的网络地址，向售后服务端发送用户端的外网IP和端口信息。Step S42, the user terminal sends the external network IP and port information of the user terminal to the after-sales service terminal according to the network address of the after-sales service terminal.
用户端将外网IP和端口组成数据包，根据内置的售后服务端的网络地址建立连接，并将组装好的数据包和协助请求发送出去。若发送请求成功，则在本地映射好的端口建立监听程序，来监听售后服务端的请求。The user terminal composes data packets from the external network IP and port, establishes a connection according to the network address of the built-in after-sales service terminal, and sends out the assembled data packets and assistance requests. If the request is sent successfully, a listening program will be established on the locally mapped port to listen to the request from the after-sales service end.
本实施例利用UPNP协议，实现处于内网的用户端与外部网络之间的网络映射，获得用户端对应的外网IP和端口，有利于售后服务端通过用户端的外网IP和端口主动找到处于内网的用户端，成功实现用户端和售后服务端之间点对点的通信。This embodiment utilizes the UPNP protocol to realize the network mapping between the client in the internal network and the external network, and obtain the corresponding external network IP and port of the client, which is beneficial for the after-sales service terminal to actively find the user in the network through the external network IP and port of the client. The client end of the intranet has successfully realized point-to-point communication between the client end and the after-sales service end.
如图3所示，图3为本发明嵌入式设备远程协控方法第三实施例的流程图。步骤S20具体包括：As shown in FIG. 3 , FIG. 3 is a flow chart of a third embodiment of a method for remote coordinated control of an embedded device according to the present invention. Step S20 specifically includes:
步骤S21，售后服务端接收用户端发送的用户端的屏幕参数；Step S21, the after-sales service end receives the screen parameters of the user end sent by the user end;
步骤S22，售后服务端根据用户端的屏幕参数，建立屏幕映射表；Step S22, the after-sales service end creates a screen mapping table according to the screen parameters of the user end;
售后服务端在用户端的屏幕参数与售后服务端自身的屏幕参数之间建立映射关系，生成屏幕映射表，等待用户端发送的当前显示界面数据。The after-sales service end establishes a mapping relationship between the screen parameters of the user end and the screen parameters of the after-sales end itself, generates a screen mapping table, and waits for the current display interface data sent by the user end.
步骤S23，售后服务端接收用户端发送的用户端的当前显示界面数据；Step S23, the after-sales service terminal receives the current display interface data of the user terminal sent by the user terminal;
步骤S24，售后服务端根据屏幕映射表和用户端的当前显示界面数据，在售后服务端的屏幕上显示用户端的当前显示界面。Step S24, the after-sales service terminal displays the current display interface of the user terminal on the screen of the after-sales service terminal according to the screen mapping table and the current display interface data of the user terminal.
售后服务端在接收到用户端的当前显示界面数据后，将用户端的当前显示界面显示在售后服务端的屏幕上，实现用户端与售后服务端之间的屏幕传递。由于用户端的当前显示界面已显示在售后服务端的屏幕上，售后工程师可通过售后服务端的屏幕查看到用户端的当前显示界面。After the after-sales service terminal receives the current display interface data of the user terminal, it displays the current display interface of the user terminal on the screen of the after-sales service terminal, so as to realize screen transmission between the user terminal and the after-sales service terminal. Since the current display interface of the user terminal has been displayed on the screen of the after-sales service terminal, the after-sales engineer can check the current display interface of the user terminal through the screen of the after-sales service terminal.
本实施例通过屏幕映射，实现用户端与售后服务端之间的屏幕传递，售后工程师不用到达现场就可以看到用户端的当前状况，有利于及时对用户端的情况做出判断，制定出快速、准确的维修方针。This embodiment realizes the screen transfer between the user end and the after-sales service end through screen mapping. maintenance policy.
如图4所示，图4为本发明嵌入式设备远程协控方法第四实施例的流程图。步骤S21之前还包括：As shown in FIG. 4 , FIG. 4 is a flowchart of a fourth embodiment of a method for remote coordinated control of an embedded device according to the present invention. Also include before step S21:
步骤S51，用户端读取用户端的设备文件；Step S51, the client reads the device file of the client;
步骤S52，用户端从用户端的设备文件中解析出用户端的屏幕参数；Step S52, the client parses out the screen parameters of the client from the device file of the client;
用户端在启动远程协控软件后，主动读取本地系统的底层设备文件，从文件中解析出当前屏幕参数，分析出用户端的屏幕信息。After starting the remote collaborative control software, the client actively reads the underlying device file of the local system, parses the current screen parameters from the file, and analyzes the screen information of the client.
步骤S53，用户端将用户端的屏幕参数发送至售后服务端。In step S53, the user terminal sends the screen parameters of the user terminal to the after-sales service terminal.
用户端将用户端的屏幕参数打包成数据包，发送至售后服务端；或者用户端在向售后服务端发送协助请求的同时，还将用户端的屏幕参数、外网IP和端口一同打包成数据包发送至售后服务端；或者用户端在接收到售后服务端发送的屏幕获取请求后，将用户端的屏幕参数和当前显示界面数据一同打包发送给售后服务端。The user end packs the screen parameters of the user end into a data packet and sends it to the after-sales service end; or when the user end sends an assistance request to the after-sales service end, it also packs the screen parameters of the user end, external network IP and port into a data packet and sends it to the after-sales service end; or after receiving the screen acquisition request sent by the after-sales end, the user end packs the screen parameters of the user end together with the current display interface data and sends them to the after-sales service end.
本实施例的用户端将屏幕参数发送至售后服务端，供售后服务端实现用户端与售后服务端之间的屏幕映射，待接收到用户端发送的当前显示界面数据后，将用户端的当前显示界面显示在售后服务端的屏幕上，有利于售后工程师及时了解用户端状况，制定出快速、准确的维修方针。The user end of this embodiment sends the screen parameters to the after-sales service end for the after-sales service end to realize the screen mapping between the user end and the after-sales service end. After receiving the current display interface data sent by the user end, the current display interface data of the user end will be The interface is displayed on the screen of the after-sales service end, which is helpful for after-sales engineers to understand the status of the user end in a timely manner and formulate a fast and accurate maintenance policy.
如图5所示，图5为本发明嵌入式设备远程协控方法第五实施例的流程图。步骤S23之前还包括：As shown in FIG. 5 , FIG. 5 is a flowchart of a fifth embodiment of a method for remote coordinated control of an embedded device according to the present invention. Also include before step S23:
步骤S61，用户端对用户端的当前显示界面进行截屏处理；Step S61, the user terminal performs screenshot processing on the current display interface of the user terminal;
用户端接收到售后服务端的屏幕获取请求后，进行截屏处理，获得用户端的当前显示界面的屏幕图片。After receiving the screen acquisition request from the after-sales service terminal, the user terminal performs screenshot processing to obtain a screen picture of the current display interface of the user terminal.
步骤S62，用户端对截屏处理后的当前显示界面数据进行压缩编码处理；Step S62, the user end compresses and encodes the current display interface data after the screenshot processing;
用户端对截取的屏幕图片进行压缩编码处理，形成视频流。The user terminal compresses and codes the intercepted screen picture to form a video stream.
步骤S63，用户端将压缩编码处理后的当前显示界面数据发送至售后服务端。In step S63, the user end sends the current display interface data after compression and encoding processing to the after-sales service end.
本实施例的用户端将形成视频流的当前显示界面数据发送至售后服务端，供售后服务端实现用户端与售后服务端之间的屏幕传递，有利于售后工程师及时了解用户端状况，制定出快速、准确的维修方针。The user end of this embodiment sends the current display interface data forming the video stream to the after-sales service end for the after-sales service end to realize the screen transfer between the user end and the after-sales service end, which is beneficial for the after-sales engineer to know the status of the user end in time and formulate Fast and accurate maintenance policy.
如图6所示，图6为本发明嵌入式设备远程协控方法第六实施例的流程图。步骤S23之后还包括：As shown in FIG. 6 , FIG. 6 is a flowchart of a sixth embodiment of a method for remote coordinated control of an embedded device according to the present invention. Also include after step S23:
步骤S71，用户端解析售后服务端的鼠标或键盘操控指令，并注入到用户端的设备文件中；Step S71, the user end parses the mouse or keyboard control command of the after-sales service end, and injects it into the device file of the user end;
用户端接收到操控指令后，解析事件类型，并把事件注册到设备底层文件中。After receiving the manipulation command, the client side parses the event type and registers the event in the underlying file of the device.
步骤S72，用户端执行售后服务端的鼠标或键盘操控指令对应的操作；Step S72, the user end executes the operation corresponding to the mouse or keyboard control instruction of the after-sales service end;
用户端的设备底层文件在收到注册事件后会自动响应事件，完成操控指令对应的操作，即实现售后服务端对用户端的远程操控。After receiving the registration event, the underlying file of the device on the client side will automatically respond to the event and complete the operation corresponding to the control command, that is, to realize the remote control of the client side from the after-sales service end.
步骤S73，用户端将对应的操作显示在用户端的当前显示界面，并返回用户端对用户端的当前显示界面进行截屏处理的步骤。In step S73, the user terminal displays the corresponding operation on the current display interface of the user terminal, and returns to the step where the user terminal performs screenshot processing on the current display interface of the user terminal.
用户端在完成操控指令的同时，还在用户端的屏幕上显示相应的操作，并重新对显示界面进行截屏，发送至售后服务端。例如：若是鼠标事件，就会在界面上显示鼠标的移动，同时向售后服务端传送界面数据，售后服务端的屏幕上也会显示出鼠标的移动。When the user end completes the control instruction, it also displays the corresponding operation on the screen of the user end, and takes a screenshot of the display interface again, and sends it to the after-sales service end. For example: if it is a mouse event, the movement of the mouse will be displayed on the interface, and the interface data will be transmitted to the after-sales service end, and the movement of the mouse will also be displayed on the screen of the after-sales service end.
本实施例通过用户端对操控指令的响应，实现售后服务端对用户端的远程操控，售后工程师可在售后服务端的操作电脑上，及时、准确的帮助用户解决问题，同时还可以提示用户如何解决问题。In this embodiment, the remote control of the after-sales service end to the user end is realized through the response of the user terminal to the control command. The after-sales engineer can help the user solve the problem in a timely and accurate manner on the operation computer of the after-sales service end, and at the same time can prompt the user how to solve the problem .
如图7所示，图7为本发明嵌入式设备远程协控系统第一实施例的结构示意图，该实施例提到的嵌入式设备远程协控系统，包括售后服务端100和用户端200，售后服务端100包括：As shown in FIG. 7, FIG. 7 is a schematic structural diagram of the first embodiment of the embedded device remote coordinated control system of the present invention. The embedded device remote coordinated control system mentioned in this embodiment includes an after-sales service terminal 100 and a user terminal 200. The after-sales service terminal 100 includes:
第一连接模块110，用于接收用户端200发送的用户端200的外网IP和端口信息，并根据用户端200的外网IP和端口信息，连接用户端200；The first connection module 110 is configured to receive the external network IP and port information of the user terminal 200 sent by the user terminal 200, and connect the user terminal 200 according to the external network IP and port information of the user terminal 200;
屏幕处理模块120，用于接收用户端200发送的用户端200的屏幕参数和当前显示界面数据，并根据用户端200的屏幕参数和当前显示界面数据，在售后服务端100的屏幕上显示用户端200的当前显示界面；The screen processing module 120 is configured to receive the screen parameters and current display interface data of the user terminal 200 sent by the user terminal 200, and display the user terminal on the screen of the after-sales service terminal 100 according to the screen parameters of the user terminal 200 and the current display interface data. 200 current display interface;
操控模块130，用于捕捉售后服务端100的鼠标或键盘操控指令，并发送至用户端200，实现对用户端200的操控。The control module 130 is used to capture the mouse or keyboard control command of the after-sales service terminal 100 and send it to the user terminal 200 to realize the control of the user terminal 200 .
本实施例的用户端200为嵌入式电子设备，例如，智能电视机、网络电视等。用户端200在发送用户端200的外网IP和端口信息时，用户端200还向售后服务端100发送协助请求，第一连接模块110接收到协助请求后，解析用户端200的外网IP和端口信息，根据IP和端口信息，与用户端200建立连接。若连接成功，则可向用户端200发送屏幕获取请求。通过用户端200发送的用户端200的外网IP和端口信息，使处于外网的售后服务端100主动找到处于内网的用户端200，并可以实时的发送屏幕获取请求，实现用户端200与售后服务端100之间点对点的通信。用户端200在向售后服务端100发送协助请求的同时，还可向售后服务端100发送用户端200的屏幕参数，用户端200在接收到售后服务端100发送的屏幕获取请求后，将用户端200的当前显示界面数据发送给售后服务端100；或者用户端200在接收到售后服务端100发送的屏幕获取请求后，将用户端200的屏幕参数和当前显示界面数据一同发送给售后服务端100；或者在售后服务端100的鼠标或键盘首次发生操作事件后，用户端200再向售后服务端100发生用户端200的屏幕参数和当前显示界面数据。屏幕处理模块120将用户端200的屏幕参数与售后服务端100的屏幕参数之间建立屏幕映射关系，并在接收到用户端200的当前显示界面数据后，将用户端200的当前显示界面显示在售后服务端100的屏幕上，实现用户端200与售后服务端100之间的屏幕传递。屏幕处理模块120在实现与用户端200之间的屏幕传递后，操控模块130注册鼠标/键盘监听器，对售后服务端100的鼠标或键盘进行监听。由于用户端200的当前显示界面已显示在售后服务端100的屏幕上，售后工程师可通过售后服务端100的屏幕查看到用户端200的当前显示界面。当售后工程师通过售后服务端100的鼠标或键盘在售后服务端100的屏幕上进行相应的操作时，操控模块130实时捕捉到鼠标或键盘事件，生成鼠标或键盘操控指令，并将这些事件对应的操控指令传输到用户端200，随后注入电视机系统中，从而实现电视机的远程操控功能，为远程控制嵌入式设备提供了一条新的途径。本实施例结合了嵌入式技术与云计算技术，让售后服务端100主动找到处于内网的用户端200，将屏幕数据流和控制命令流构造成一个统一的结构体，有效实现远程操控，降低网络要求，减小售后服务端100的压力，并发能力显著提高，有利于及时、准确的进行嵌入式电子设备远程维修服务。The client 200 in this embodiment is an embedded electronic device, such as a smart TV, an Internet TV, and the like. When the user terminal 200 sends the external network IP and port information of the user terminal 200, the user terminal 200 also sends an assistance request to the after-sales service terminal 100. After receiving the assistance request, the first connection module 110 analyzes the external network IP and port information of the user terminal 200. Port information, establish a connection with the client 200 according to the IP and port information. If the connection is successful, a screen acquisition request may be sent to the client terminal 200 . The external network IP and port information of the user terminal 200 sent by the user terminal 200 enables the after-sales service terminal 100 in the external network to actively find the user terminal 200 in the internal network, and can send a screen acquisition request in real time to realize the connection between the user terminal 200 and the internal network. Point-to-point communication between after-sales service terminals 100 . When the user terminal 200 sends an assistance request to the after-sales service terminal 100, it can also send the screen parameters of the user terminal 200 to the after-sales service terminal 100. After the user terminal 200 receives the screen acquisition request sent by the after-sales service terminal 100, it 200 to send the current display interface data to the after-sales service end 100; or after the mouse or keyboard of the after-sales service terminal 100 is operated for the first time, the user terminal 200 sends the user terminal 200 screen parameters and current display interface data to the after-sales service terminal 100. The screen processing module 120 establishes a screen mapping relationship between the screen parameters of the user terminal 200 and the screen parameters of the after-sales service terminal 100, and after receiving the current display interface data of the user terminal 200, displays the current display interface of the user terminal 200 on the The screen transfer between the user terminal 200 and the after-sales service terminal 100 is realized on the screen of the after-sales service terminal 100 . After the screen processing module 120 realizes the screen transmission with the client terminal 200 , the control module 130 registers a mouse/keyboard listener to monitor the mouse or keyboard of the after-sales service terminal 100 . Since the current display interface of the user terminal 200 has been displayed on the screen of the after-sales service terminal 100 , the after-sales engineer can view the current display interface of the user terminal 200 through the screen of the after-sales service terminal 100 . When the after-sales engineer performs corresponding operations on the screen of the after-sales terminal 100 through the mouse or keyboard of the after-sales terminal 100, the control module 130 captures mouse or keyboard events in real time, generates mouse or keyboard manipulation commands, and The control command is transmitted to the user terminal 200, and then injected into the TV system, so as to realize the remote control function of the TV and provide a new way for remote control of embedded devices. This embodiment combines embedded technology and cloud computing technology, allowing the after-sales service terminal 100 to actively find the user terminal 200 in the intranet, constructing a unified structure of the screen data stream and the control command stream, effectively realizing remote control, reducing Network requirements reduce the pressure on the after-sales service end 100, and the concurrency capability is significantly improved, which is conducive to timely and accurate remote maintenance services for embedded electronic devices.
如图8所示，图8为本发明嵌入式设备远程协控系统第二实施例的结构示意图。As shown in FIG. 8 , FIG. 8 is a schematic structural diagram of a second embodiment of an embedded device remote coordination control system according to the present invention.
用户端200包括第二连接模块210，第二连接模块210具体包括：The user terminal 200 includes a second connection module 210, and the second connection module 210 specifically includes:
网络映射子模块211，用于分别建立内网IP与外网IP、内网端口与外网端口之间的映射关系，获得用户端200的外网IP和端口信息；The network mapping submodule 211 is used to respectively establish the mapping relationship between the internal network IP and the external network IP, the internal network port and the external network port, and obtain the external network IP and port information of the client 200;
IP/端口发送子模块212，用于根据售后服务端100的网络地址，向售后服务端100发送用户端200的外网IP和端口信息。The IP/port sending sub-module 212 is configured to send the external network IP and port information of the user terminal 200 to the after-sales service terminal 100 according to the network address of the after-sales service terminal 100 .
本实施例中，第二连接模块210的网络映射子模块211利用UPNP协议，实现处于内网的用户端200与外部网络之间的网络映射，获得用户端200对应的外网IP和端口，例如内网的电视机与路由器的端口映射。售后服务端100可通过用户端200对应的外网IP和端口主动找到处于内网的用户端200，并实时发送屏幕获取请求。IP/端口发送子模块212将外网IP和端口组成数据包，根据内置的售后服务端100的网络地址建立连接，并将组装好的数据包和协助请求发送出去。若发送请求成功，则在本地映射好的端口建立监听程序，来监听售后服务端100的请求。本实施例利用UPNP协议，实现处于内网的用户端200与外部网络之间的网络映射，获得用户端200对应的外网IP和端口，有利于售后服务端100通过用户端200的外网IP和端口主动找到处于内网的用户端200，成功实现用户端200和售后服务端100之间点对点的通信。In this embodiment, the network mapping submodule 211 of the second connection module 210 utilizes the UPNP protocol to implement network mapping between the client 200 in the internal network and the external network, and obtain the external network IP and port corresponding to the client 200, for example Intranet TV and router port mapping. The after-sales service terminal 100 can actively find the client terminal 200 in the internal network through the external network IP and port corresponding to the client terminal 200, and send a screen acquisition request in real time. The IP/port sending sub-module 212 forms a data packet from the external network IP and port, establishes a connection according to the network address of the built-in after-sales service terminal 100, and sends out the assembled data packet and assistance request. If the request is sent successfully, then a listener program is established at the locally mapped port to monitor the request from the after-sales service terminal 100 . This embodiment utilizes the UPNP protocol to realize the network mapping between the client 200 of the internal network and the external network, and obtain the corresponding external network IP and port of the client 200, which is beneficial for the after-sales service terminal 100 to pass the external network IP of the client 200 The port actively finds the client terminal 200 in the intranet, and successfully realizes the point-to-point communication between the client terminal 200 and the after-sales service terminal 100 .
如图9所示，图9为本发明嵌入式设备远程协控系统第三实施例的结构示意图。As shown in FIG. 9 , FIG. 9 is a schematic structural diagram of a third embodiment of an embedded device remote coordination control system according to the present invention.
售后服务端100的屏幕处理模块120具体包括：The screen processing module 120 of the after-sales service terminal 100 specifically includes:
屏幕参数接收子模块121，用于接收用户端200发送的用户端200的屏幕参数；The screen parameter receiving submodule 121 is configured to receive the screen parameters of the client 200 sent by the client 200;
屏幕映射子模块122，用于根据用户端200的屏幕参数，建立屏幕映射表；The screen mapping submodule 122 is configured to create a screen mapping table according to the screen parameters of the client 200;
界面数据接受子模块123，用于接收用户端200发送的用户端200的当前显示界面数据；The interface data accepting submodule 123 is used to receive the current display interface data of the user terminal 200 sent by the user terminal 200;
界面显示子模块124，用于根据屏幕映射表和用户端200的当前显示界面数据，在售后服务端100的屏幕上显示用户端200的当前显示界面。The interface display sub-module 124 is configured to display the current display interface of the user terminal 200 on the screen of the after-sales service terminal 100 according to the screen mapping table and the current display interface data of the user terminal 200 .
本实施例中，屏幕处理模块120的屏幕映射子模块122在用户端200的屏幕参数与售后服务端100自身的屏幕参数之间建立映射关系，生成屏幕映射表，等待用户端200发送的当前显示界面数据。界面数据接受子模块123在接收到用户端200的当前显示界面数据后，界面显示子模块124将用户端200的当前显示界面显示在售后服务端100的屏幕上，实现用户端200与售后服务端100之间的屏幕传递。由于用户端200的当前显示界面已显示在售后服务端100的屏幕上，售后工程师可通过售后服务端100的屏幕查看到用户端200的当前显示界面。本实施例通过屏幕映射，实现用户端200与售后服务端100之间的屏幕传递，售后工程师不用到达现场就可以看到用户端200的当前状况，有利于及时对用户端200的情况做出判断，制定出快速、准确的维修方针。In this embodiment, the screen mapping submodule 122 of the screen processing module 120 establishes a mapping relationship between the screen parameters of the user terminal 200 and the screen parameters of the after-sales service terminal 100 itself, generates a screen mapping table, and waits for the current display information sent by the user terminal 200. interface data. After the interface data accepting sub-module 123 receives the current display interface data of the user terminal 200, the interface display sub-module 124 displays the current display interface of the user terminal 200 on the screen of the after-sales service terminal 100 to realize the connection between the user terminal 200 and the after-sales service terminal. 100 screen passes between. Since the current display interface of the user terminal 200 has been displayed on the screen of the after-sales service terminal 100 , the after-sales engineer can view the current display interface of the user terminal 200 through the screen of the after-sales service terminal 100 . In this embodiment, the screen transfer between the user terminal 200 and the after-sales service terminal 100 is realized through screen mapping, and the after-sales engineer can see the current status of the user terminal 200 without arriving at the scene, which is conducive to making judgments on the situation of the user terminal 200 in time , to develop a fast and accurate maintenance policy.
如图10所示，图10为本发明嵌入式设备远程协控系统第四实施例的结构示意图。As shown in FIG. 10 , FIG. 10 is a schematic structural diagram of a fourth embodiment of an embedded device remote coordination control system according to the present invention.
用户端200还包括屏幕参数生成模块220，屏幕参数生成模块220具体包括：The client terminal 200 also includes a screen parameter generation module 220, and the screen parameter generation module 220 specifically includes:
设备文件读取子模块221，用于读取用户端200的设备文件；The device file reading submodule 221 is used to read the device file of the client 200;
屏幕参数解析子模块222，用于从用户端200的设备文件中解析出用户端200的屏幕参数；The screen parameter parsing submodule 222 is used to parse out the screen parameters of the client terminal 200 from the device file of the client terminal 200;
屏幕参数发送子模块223，将用户端200的屏幕参数发送至售后服务端100。The screen parameter sending sub-module 223 sends the screen parameters of the user terminal 200 to the after-sales service terminal 100 .
本实施例的用户端200在启动远程协控软件后，屏幕参数生成模块220的设备文件读取子模块221主动读取本地系统的底层设备文件，屏幕参数解析子模块222从文件中解析出当前屏幕参数，分析出用户端200的屏幕信息。屏幕参数发送子模块223将用户端200的屏幕参数打包成数据包，发送至售后服务端100；或者用户端200在向售后服务端100发送协助请求的同时，还将用户端200的屏幕参数、外网IP和端口一同打包成数据包发送至售后服务端100；或者用户端200在接收到售后服务端100发送的屏幕获取请求后，将用户端200的屏幕参数和当前显示界面数据一同打包发送给售后服务端100。本实施例的用户端200将屏幕参数发送至售后服务端100，供售后服务端100实现用户端200与售后服务端100之间的屏幕映射，待接收到用户端200发送的当前显示界面数据后，将用户端200的当前显示界面显示在售后服务端100的屏幕上，有利于售后工程师及时了解用户端200状况，制定出快速、准确的维修方针。After the client terminal 200 of this embodiment starts the remote cooperative control software, the device file reading sub-module 221 of the screen parameter generation module 220 actively reads the underlying device file of the local system, and the screen parameter analysis sub-module 222 parses the current The screen parameters are used to analyze the screen information of the client terminal 200 . The screen parameter sending submodule 223 packs the screen parameters of the user terminal 200 into data packets and sends them to the after-sales service terminal 100; The external network IP and port are packaged together into a data packet and sent to the after-sales service terminal 100; or after the user terminal 200 receives the screen acquisition request sent by the after-sales service terminal 100, the screen parameters of the user terminal 200 and the current display interface data are packaged and sent together 100 to the after-sales service end. The user terminal 200 of this embodiment sends the screen parameters to the after-sales service terminal 100 for the after-sales service terminal 100 to realize the screen mapping between the user terminal 200 and the after-sales service terminal 100, after receiving the current display interface data sent by the user terminal 200 , displaying the current display interface of the user terminal 200 on the screen of the after-sales service terminal 100 is beneficial for the after-sales engineer to know the status of the user terminal 200 in time and formulate a fast and accurate maintenance policy.
如图11所示，图11为本发明嵌入式设备远程协控系统第五实施例的结构示意图。As shown in FIG. 11 , FIG. 11 is a schematic structural diagram of a fifth embodiment of an embedded device remote coordination control system according to the present invention.
用户端200还包括界面数据生成模块230，界面数据生成模块230具体包括：The client terminal 200 also includes an interface data generation module 230, and the interface data generation module 230 specifically includes:
截屏子模块231，用于对用户端200的当前显示界面进行截屏处理；The screenshot sub-module 231 is configured to perform screenshot processing on the current display interface of the user terminal 200;
压缩编码子模块232，用于对截屏处理后的当前显示界面数据进行压缩编码处理；The compression encoding sub-module 232 is used to compress and encode the current display interface data after the screenshot processing;
界面数据发送子模块233，用于将压缩编码处理后的当前显示界面数据发送至售后服务端100。The interface data sending sub-module 233 is configured to send the currently displayed interface data after compression and coding processing to the after-sales service terminal 100 .
本实施例的用户端200接收到售后服务端100的屏幕获取请求后，界面数据生成模块230的截屏子模块231进行截屏处理，获得用户端200的当前显示界面的屏幕图片。压缩编码子模块232对截取的屏幕图片进行压缩编码处理，形成视频流。本实施例的用户端200将形成视频流的当前显示界面数据发送至售后服务端100，供售后服务端100实现用户端200与售后服务端100之间的屏幕传递，有利于售后工程师及时了解用户端200状况，制定出快速、准确的维修方针。After the user terminal 200 of this embodiment receives the screen capture request from the after-sales service terminal 100, the screen capture sub-module 231 of the interface data generation module 230 performs screen capture processing to obtain a screen image of the current display interface of the user terminal 200. The compression encoding sub-module 232 performs compression encoding processing on the intercepted screen picture to form a video stream. The user terminal 200 of this embodiment sends the current display interface data forming the video stream to the after-sales service terminal 100, so that the after-sales service terminal 100 can realize the screen transmission between the user terminal 200 and the after-sales service terminal 100, which is beneficial for the after-sales engineer to understand the user in time According to the status of terminal 200, a fast and accurate maintenance policy is formulated.
如图12所示，图12为本发明嵌入式设备远程协控系统第六实施例的结构示意图。As shown in FIG. 12 , FIG. 12 is a schematic structural diagram of a sixth embodiment of an embedded device remote coordination control system according to the present invention.
用户端200还包括操控指令处理模块240，操控指令处理模块240具体包括：The client terminal 200 also includes a manipulation instruction processing module 240, and the manipulation instruction processing module 240 specifically includes:
操控指令解析模块241，用于解析售后服务端100的鼠标或键盘操控指令，并注入到用户端200的设备文件中；The manipulation command parsing module 241 is used to parse the mouse or keyboard manipulation command of the after-sales service terminal 100, and inject it into the device file of the client terminal 200;
操控指令执行模块242，用于执行售后服务端100的鼠标或键盘操控指令对应的操作；The manipulation instruction execution module 242 is configured to execute the operation corresponding to the mouse or keyboard manipulation instruction of the after-sales service terminal 100;
操控处理显示模块243，用于将对应的操作显示在用户端200的当前显示界面；The manipulation processing display module 243 is configured to display the corresponding operation on the current display interface of the user terminal 200;
界面数据生成模块230的截屏子模块231还用于，在操控处理显示模块243完成将对应的操作显示在用户端200的当前显示界面后，重新对用户端200的当前显示界面进行截屏处理。The screen capture sub-module 231 of the interface data generation module 230 is also used to re-screenshot the current display interface of the user terminal 200 after the manipulation processing display module 243 finishes displaying the corresponding operation on the current display interface of the user terminal 200 .
本实施例的用户端200接收到操控指令后，操控指令处理模块240的操控指令解析模块241解析事件类型，并把事件注册到设备底层文件中。在用户端200的设备底层文件收到注册事件后，操控指令执行模块242会自动响应事件，完成操控指令对应的操作，即实现售后服务端100对用户端200的远程操控。After the client terminal 200 of this embodiment receives the manipulation command, the manipulation command parsing module 241 of the manipulation command processing module 240 parses the event type, and registers the event into the bottom layer file of the device. After the device underlying file of the client 200 receives the registration event, the control command execution module 242 will automatically respond to the event and complete the operation corresponding to the control command, that is, realize the remote control of the client 200 by the after-sales service terminal 100 .
在操控指令执行模块242完成操控指令的同时，操控处理显示模块243还在用户端200的屏幕上显示相应的操作，同时，界面数据生成模块230的截屏子模块231重新对显示界面进行截屏，发送至售后服务端100。例如：若是鼠标事件，就会在界面上显示鼠标的移动，同时向售后服务端100传送界面数据，售后服务端100的屏幕上也会显示出鼠标的移动。本实施例通过用户端200对操控指令的响应，实现售后服务端100对用户端200的远程操控，售后工程师可在售后服务端100的操作电脑上，及时、准确的帮助用户解决问题，同时还可以提示用户如何解决问题。While the manipulation command execution module 242 completes the manipulation command, the manipulation processing display module 243 also displays the corresponding operation on the screen of the user terminal 200, and at the same time, the screenshot sub-module 231 of the interface data generation module 230 takes a screenshot of the display interface again, and sends To the after-sales service terminal 100. For example: if it is a mouse event, the movement of the mouse will be displayed on the interface, and the interface data will be transmitted to the after-sales service terminal 100 at the same time, and the movement of the mouse will also be displayed on the screen of the after-sales service terminal 100 . In this embodiment, through the response of the user terminal 200 to the control command, the remote control of the after-sales service terminal 100 to the user terminal 200 is realized. The user can be prompted how to solve the problem.
以上所述仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related All technical fields are equally included in the scope of patent protection of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210282274.5ACN102833321B (en) | 2012-08-09 | 2012-08-09 | Embedded device remotely assists control method and system |
| HK13107158.8AHK1180472B (en) | 2013-06-19 | Embedded type equipment long-distance control method and system |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210282274.5ACN102833321B (en) | 2012-08-09 | 2012-08-09 | Embedded device remotely assists control method and system |
| Publication Number | Publication Date |
|---|---|
| CN102833321A CN102833321A (en) | 2012-12-19 |
| CN102833321Btrue CN102833321B (en) | 2016-06-22 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210282274.5AActiveCN102833321B (en) | 2012-08-09 | 2012-08-09 | Embedded device remotely assists control method and system |
| Country | Link |
|---|---|
| CN (1) | CN102833321B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104426990A (en)* | 2013-09-09 | 2015-03-18 | 联想(北京)有限公司 | Control method and control device |
| CN103488452A (en)* | 2013-09-11 | 2014-01-01 | 天脉聚源(北京)传媒科技有限公司 | Controller |
| CN103942044B (en)* | 2014-03-18 | 2017-08-25 | 北京领通科技有限公司 | remote assistance method and system in mobile terminal application |
| CN104093080A (en)* | 2014-06-27 | 2014-10-08 | 四川长虹电器股份有限公司 | Intelligent television remote debugging system and method |
| CN109660581B (en)* | 2017-10-11 | 2021-11-16 | 阿里巴巴集团控股有限公司 | Physical machine management method, device and system |
| CN108508799A (en)* | 2018-04-02 | 2018-09-07 | 珠海安联锐视科技股份有限公司 | A kind of long-range control method |
| CN110557510A (en)* | 2018-05-31 | 2019-12-10 | 京瓷办公信息系统株式会社 | Image forming apparatus, image forming system, and communication processing method |
| CN109996121A (en)* | 2019-04-12 | 2019-07-09 | 晶晨半导体(上海)股份有限公司 | A kind of method of remote control video playing terminal |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1002407B1 (en)* | 1997-06-25 | 2005-12-28 | Samsung Electronics Co. Ltd. | Method and apparatus for a home network auto-tree builder |
| CN101132571A (en)* | 2006-08-22 | 2008-02-27 | 薛飞 | Method and system for displaying and operating remote computer on mobile phone |
| CN102355606A (en)* | 2011-09-27 | 2012-02-15 | 青岛海信电器股份有限公司 | Method for remotely controlling intelligent television |
| CN102438173A (en)* | 2011-07-30 | 2012-05-02 | 华为技术有限公司 | A method and system for remotely controlling a set-top box |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101719927A (en)* | 2009-11-18 | 2010-06-02 | 中兴通讯股份有限公司 | Method and system thereof for carrying out remote management on gateway down-hanging device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1002407B1 (en)* | 1997-06-25 | 2005-12-28 | Samsung Electronics Co. Ltd. | Method and apparatus for a home network auto-tree builder |
| CN101132571A (en)* | 2006-08-22 | 2008-02-27 | 薛飞 | Method and system for displaying and operating remote computer on mobile phone |
| CN102438173A (en)* | 2011-07-30 | 2012-05-02 | 华为技术有限公司 | A method and system for remotely controlling a set-top box |
| CN102355606A (en)* | 2011-09-27 | 2012-02-15 | 青岛海信电器股份有限公司 | Method for remotely controlling intelligent television |
| Publication number | Publication date |
|---|---|
| CN102833321A (en) | 2012-12-19 |
| HK1180472A1 (en) | 2013-10-18 |
| Publication | Publication Date | Title |
|---|---|---|
| CN102833321B (en) | Embedded device remotely assists control method and system | |
| CN103024503B (en) | System and method for achieving remote control through mobile communication equipment terminal | |
| US10805380B2 (en) | Data transmission method and device | |
| CN103414751B (en) | A kind of PC screen content sharing/interaction control method | |
| CN104270662A (en) | System of terminal equipment for controlling intelligent television through browser | |
| WO2022062623A1 (en) | Remote control method and apparatus, and device, and storage medium, and system | |
| CN104093080A (en) | Intelligent television remote debugging system and method | |
| CN103458087A (en) | Remote mobile phone test experiencing method based on RTMP | |
| CN103577320A (en) | Testing method and system of remote terminals | |
| WO2012149851A1 (en) | Method and system for remotely controlling set top box | |
| CN112799891A (en) | iOS device test method, device, system, storage medium and computer device | |
| WO2015176648A1 (en) | Method and device for transmitting data in intelligent terminal to television terminal | |
| CN104426951A (en) | An intelligent set-top box remote network real-time monitoring system and method thereof | |
| CN102802081B (en) | The method of virtual peripheral is realized based on Intelligent television terminal and handheld device | |
| CN103024457A (en) | Method and device for controlling server touch screen | |
| CN117676241A (en) | Digital factory large scene display method and system based on server three-dimensional rendering | |
| WO2011130962A1 (en) | Remote processing method, device and system | |
| CN114710568A (en) | Audio and video data communication method, equipment and storage medium | |
| CN113015019B (en) | Data processing method, device and system | |
| CN104394199B (en) | A kind of mobile terminal remote post-sale support method and device | |
| CN103581695A (en) | System and method for achieving access of mobile terminal to global eye | |
| WO2025016443A1 (en) | Bulk endpoint-based wireless auxiliary stream data transmission method, and device | |
| TWI734195B (en) | Image transmission device with control feedback function and method for controlling feedback | |
| CN112804323B (en) | Remote vehicle-mounted terminal desktop control system and method | |
| CN114666561B (en) | Video fusion method, device and system |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code | Ref country code:HK Ref legal event code:DE Ref document number:1180472 Country of ref document:HK | |
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| REG | Reference to a national code | Ref country code:HK Ref legal event code:GR Ref document number:1180472 Country of ref document:HK |