






技术领域technical field
本申请涉及计算机技术领域,特别是涉及一种同步显示方法、装置、电子设备和可读存储介质。The present application relates to the field of computer technology, and in particular, to a synchronous display method, apparatus, electronic device and readable storage medium.
背景技术Background technique
随着计算机技术的发展,目前人们可以通过共享屏幕的方式来展示图像、文本、演示文稿等等。With the development of computer technology, people can present images, texts, presentations, etc. by sharing the screen.
在相关技术中,用户可以通过控制目标终端将目标终端的显示画面共享给另一个终端,以实现屏幕共享的目的。In the related art, the user can share the display screen of the target terminal with another terminal by controlling the target terminal, so as to realize the purpose of screen sharing.
但是,当目标终端向不同型号的一个或多个终端屏幕共享时,目标终端和接受屏幕共享的终端可能会由于显示屏尺寸不同、操作系统不同等原因,出现接受屏幕共享的终端的显示画面不正常的问题。However, when the target terminal shares the screen with one or more terminals of different models, the target terminal and the terminal accepting screen sharing may appear different in the display screen of the terminal accepting screen sharing due to different display screen sizes and different operating systems. normal question.
发明内容SUMMARY OF THE INVENTION
有鉴于此,本申请实施例提供一种同步显示方法、装置、电子设备和可读存储介质,以保证屏幕共享时各个同步终端均可以正常显示相同的画面。In view of this, the embodiments of the present application provide a synchronous display method, apparatus, electronic device, and readable storage medium, so as to ensure that each synchronous terminal can normally display the same picture during screen sharing.
第一方面,提供了一种同步显示方法,所述方法包括:In a first aspect, a synchronous display method is provided, the method comprising:
服务器向各同步终端广播编码同步图像;The server broadcasts the coded synchronization image to each synchronization terminal;
各所述同步终端中的目标终端根据接收的控制指令确定触控坐标;The target terminal in each of the synchronization terminals determines the touch coordinates according to the received control instruction;
所述目标终端向所述服务器发送所述触控坐标,并执行所述控制指令;以及The target terminal sends the touch coordinates to the server, and executes the control instruction; and
所述服务器接收所述目标终端发送的触控坐标,并基于所述触控坐标和所述编码同步图像执行同步操作,以使得各所述同步终端中除目标终端以外的同步终端进行同步显示。The server receives the touch coordinates sent by the target terminal, and performs a synchronization operation based on the touch coordinates and the encoded synchronization image, so that synchronization terminals other than the target terminal among the synchronization terminals are displayed in synchronization.
在一些实施例中,所述基于所述触控坐标和所述编码同步图像执行同步操作,包括:In some embodiments, performing a synchronization operation based on the touch coordinates and the encoded synchronization image includes:
服务器向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标;以及The server sends the touch coordinates to the synchronization terminals other than the target terminal among the synchronization terminals; and
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示。After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal.
在一些实施例中,所述目标终端向所述服务器发送所述触控坐标,包括:In some embodiments, the target terminal sending the touch coordinates to the server includes:
所述目标终端向所述服务器发送操作请求;The target terminal sends an operation request to the server;
所述服务器响应于所述操作请求,向所述目标终端返回操作响应,所述操作响应用于表征所述目标终端获取操作权限;以及In response to the operation request, the server returns an operation response to the target terminal, where the operation response is used to represent that the target terminal obtains an operation authority; and
所述目标终端响应于所述操作相应,向所述服务器发送触控坐标。The target terminal sends touch coordinates to the server in response to the operation.
在一些实施例中,在向所述目标终端返回操作响应之后,所述方法还包括:In some embodiments, after returning an operation response to the target terminal, the method further includes:
所述服务器响应于接收到各所述同步终端中除目标终端以外的同步终端发送的操作请求,向发送操作请求的同步终端返回拒绝响应;以及In response to receiving the operation request sent by the synchronization terminal other than the target terminal among the synchronization terminals, the server returns a rejection response to the synchronization terminal that sent the operation request; and
所述同步终端响应于接收到所述服务器返回的拒绝响应,接收服务器发送的触控坐标,并基于所述触控坐标和所述编码同步图像进行同步显示。In response to receiving the rejection response returned by the server, the synchronization terminal receives the touch coordinates sent by the server, and performs synchronous display based on the touch coordinates and the encoded synchronization image.
在一些实施例中,所述同步终端包括高优先级终端和低优先级终端,所述目标终端为高优先级终端;In some embodiments, the synchronization terminal includes a high-priority terminal and a low-priority terminal, and the target terminal is a high-priority terminal;
所述基于所述触控坐标和所述编码同步图像执行同步操作,包括:The performing a synchronization operation based on the touch coordinates and the encoded synchronization image includes:
所述服务器响应于所述触控坐标对应目标低优先级终端的选择控件,向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标;The server, in response to the selection control of the target low-priority terminal corresponding to the touch coordinates, sends the touch coordinates to synchronization terminals other than the target terminal among the synchronization terminals;
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示;以及After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal; and
所述服务器将所述目标终端的全部或部分操作权限转移至所述目标低优先级终端。The server transfers all or part of the operation authority of the target terminal to the target low-priority terminal.
在一些实施例中,所述同步终端包括高优先级终端和低优先级终端,所述目标终端为低优先级终端;In some embodiments, the synchronization terminal includes a high-priority terminal and a low-priority terminal, and the target terminal is a low-priority terminal;
所述基于所述触控坐标和所述编码同步图像执行同步操作,包括:The performing a synchronization operation based on the touch coordinates and the encoded synchronization image includes:
所述服务器响应于所述触控坐标对应结束操作的选择控件,向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标;The server sends the touch coordinates to the synchronization terminals other than the target terminal among the synchronization terminals in response to the selection control corresponding to the end operation of the touch coordinates;
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示;以及After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal; and
所述服务器将所述目标终端的全部或部分操作权限转移至所述高优先级终端。The server transfers all or part of the operation authority of the target terminal to the high-priority terminal.
在一些实施例中,所述方法还包括:In some embodiments, the method further includes:
所述服务器响应于接收到所述高优先级终端的权限收回指令,将所述目标终端的全部或部分操作权限转移至所述高优先级终端。The server transfers all or part of the operation authority of the target terminal to the high-priority terminal in response to receiving the authority revocation instruction of the high-priority terminal.
第二方面,提供了一种同步显示系统,所述系统包括服务器和同步终端,所述同步终端包括目标终端:In a second aspect, a synchronous display system is provided, the system includes a server and a synchronization terminal, and the synchronization terminal includes a target terminal:
所述服务器,被配置为执行向各同步终端广播编码同步图像,接收所述目标终端发送的触控坐标,并基于所述触控坐标和所述编码同步图像执行同步操作,以使得各所述同步终端中除目标终端以外的同步终端进行同步显示;The server is configured to broadcast an encoded synchronization image to each synchronization terminal, receive the touch coordinates sent by the target terminal, and perform a synchronization operation based on the touch coordinates and the encoded synchronization image, so that each of the The synchronization terminals other than the target terminal among the synchronization terminals are displayed synchronously;
所述同步终端,被配置为执行接收编码同步图像;The synchronization terminal is configured to perform receiving and encoding a synchronization image;
所述目标终端,被配置为执行向所述服务器发送所述触控坐标,并执行所述控制指令。The target terminal is configured to execute sending the touch coordinates to the server and execute the control instruction.
第三方面,提供了一种同步显示装置,所述装置包括:In a third aspect, a synchronous display device is provided, the device comprising:
广播模块,用于服务器向各同步终端广播编码同步图像;The broadcasting module is used for the server to broadcast the encoded synchronous image to each synchronous terminal;
触控坐标确定模块,用于各所述同步终端中的目标终端根据接收的控制指令确定触控坐标;a touch coordinate determination module, used for the target terminal in each of the synchronization terminals to determine the touch coordinate according to the received control instruction;
触控坐标发送模块,用于所述目标终端向所述服务器发送所述触控坐标,并执行所述控制指令;以及a touch coordinate sending module, used for the target terminal to send the touch coordinate to the server and execute the control instruction; and
同步模块,用于所述服务器接收所述目标终端发送的触控坐标,并基于所述触控坐标和所述编码同步图像执行同步操作,以使得各所述同步终端中除目标终端以外的同步终端进行同步显示。A synchronization module, used for the server to receive the touch coordinates sent by the target terminal, and to perform a synchronization operation based on the touch coordinates and the encoded synchronization image, so as to synchronize the synchronization between the synchronization terminals except the target terminal The terminal performs synchronous display.
在一些实施例中,所述同步模块,具体用于:In some embodiments, the synchronization module is specifically used for:
服务器向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标。The server sends the touch coordinates to the synchronization terminals other than the target terminal among the synchronization terminals.
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示。After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal.
在一些实施例中,所述触控坐标发送模块,具体用于:In some embodiments, the touch coordinate sending module is specifically used for:
所述目标终端向所述服务器发送操作请求。The target terminal sends an operation request to the server.
所述服务器响应于所述操作请求,向所述目标终端返回操作响应,所述操作响应用于表征所述目标终端获取操作权限。In response to the operation request, the server returns an operation response to the target terminal, where the operation response is used to represent that the target terminal obtains operation authority.
所述目标终端响应于所述操作相应,向所述服务器发送触控坐标。The target terminal sends touch coordinates to the server in response to the operation.
在一些实施例中,所述装置还包括:In some embodiments, the apparatus further includes:
响应模块,用于所述服务器响应于接收到各所述同步终端中除目标终端以外的同步终端发送的操作请求,向发送操作请求的同步终端返回拒绝响应;以及a response module, used for the server to return a rejection response to the synchronization terminal that sent the operation request in response to receiving the operation request sent by the synchronization terminal other than the target terminal among the synchronization terminals; and
同步显示模块,用于所述同步终端响应于接收到所述服务器返回的拒绝响应,接收服务器发送的触控坐标,并基于所述触控坐标和所述编码同步图像进行同步显示。The synchronization display module is used for the synchronization terminal to receive the touch coordinates sent by the server in response to receiving the rejection response returned by the server, and to perform synchronous display based on the touch coordinates and the encoded synchronization image.
在一些实施例中,所述同步终端包括高优先级终端和低优先级终端,所述目标终端为高优先级终端。In some embodiments, the synchronization terminals include high-priority terminals and low-priority terminals, and the target terminal is a high-priority terminal.
所述同步模块,具体用于:The synchronization module is specifically used for:
所述服务器响应于所述触控坐标对应目标低优先级终端的选择控件,向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标。The server sends the touch coordinates to synchronization terminals other than the target terminal among the synchronization terminals in response to the selection control of the touch coordinates corresponding to the target low-priority terminal.
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示。After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal.
所述服务器将所述目标终端的全部或部分操作权限转移至所述目标低优先级终端。The server transfers all or part of the operation authority of the target terminal to the target low-priority terminal.
在一些实施例中,所述同步终端包括高优先级终端和低优先级终端,所述目标终端为低优先级终端。In some embodiments, the synchronization terminals include high-priority terminals and low-priority terminals, and the target terminal is a low-priority terminal.
所述同步模块,具体用于:The synchronization module is specifically used for:
所述服务器响应于所述触控坐标对应结束操作的选择控件,向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标。The server sends the touch coordinates to the synchronization terminals other than the target terminal among the synchronization terminals in response to the selection control corresponding to the end operation of the touch coordinates.
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示。After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal.
所述服务器将所述目标终端的全部或部分操作权限转移至所述高优先级终端。The server transfers all or part of the operation authority of the target terminal to the high-priority terminal.
在一些实施例中,所述装置还包括:In some embodiments, the apparatus further includes:
权限收回模块,用于所述服务器响应于接收到所述高优先级终端的权限收回指令,将所述目标终端的全部或部分操作权限转移至所述高优先级终端。A rights revocation module, used for the server to transfer all or part of the operation rights of the target terminal to the high-priority terminal in response to receiving the rights revocation instruction of the high-priority terminal.
第四方面,本申请实施例提供了一种电子设备,包括存储器和处理器,所述存储器用于存储一条或多条计算机程序指令,其中,所述一条或多条计算机程序指令被所述处理器执行以实现如第一方面所述的方法。In a fourth aspect, an embodiment of the present application provides an electronic device, including a memory and a processor, where the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are processed by the The controller executes to implement the method as described in the first aspect.
第五方面,本申请实施例提供了一种计算机可读存储介质,其上存储计算机程序指令,所述计算机程序指令在被处理器执行时实现如第一方面所述的方法。In a fifth aspect, embodiments of the present application provide a computer-readable storage medium storing computer program instructions thereon, the computer program instructions implementing the method according to the first aspect when executed by a processor.
通过本申请实施例,服务器可以向各同步终端广播编码同步图像,以使得各同步终端接收到相同的显示画面图像并进行显示。当进行同步显示时,目标终端可以根据接收的控制指令确定触控坐标,并将该触控坐标发送至服务器,进而,当服务器接收到目标终端发送的触控坐标后,服务器可以基于触控坐标和编码同步图像执行同步操作,以实现各同步终端的同步显示。在此过程中,由于各同步终端的同步显示是基于触控坐标和编码同步图像实现的,而且各同步终端显示的编码同步图像又是相同的图像,因此,即使各同步终端之间存在显示屏尺寸不同、操作系统不同、应用程序版本不同等因素,也不会影响基于触控坐标和编码同步图像执行的同步操作,保证了屏幕共享时各个同步终端均可以正常显示相同的画面。Through the embodiment of the present application, the server can broadcast the encoded synchronization image to each synchronization terminal, so that each synchronization terminal receives and displays the same display screen image. When performing synchronous display, the target terminal can determine the touch coordinates according to the received control instructions, and send the touch coordinates to the server. Further, after the server receives the touch coordinates sent by the target terminal, the server can determine the touch coordinates based on the touch coordinates. Perform synchronous operation with the coded synchronous image to realize synchronous display of each synchronous terminal. In this process, since the synchronous display of each synchronous terminal is realized based on the touch coordinates and the coded synchronous image, and the coded synchronous image displayed by each synchronous terminal is the same image, even if there is a display screen between each synchronous terminal Factors such as different sizes, different operating systems, and different application versions will not affect the synchronization operations performed based on touch coordinates and coded synchronization images, ensuring that each synchronization terminal can display the same screen normally during screen sharing.
附图说明Description of drawings
通过以下参照附图对本申请实施例的描述,本申请实施例的上述以及其它目的、特征和优点将更为清楚,在附图中:The above-mentioned and other objects, features and advantages of the embodiments of the present application will be more apparent from the following description of the embodiments of the present application with reference to the accompanying drawings, in which:
图1为本申请实施例同步显示系统的示意图;1 is a schematic diagram of a synchronous display system according to an embodiment of the present application;
图2为本申请实施例同步显示方法的流程图;2 is a flowchart of a synchronous display method according to an embodiment of the present application;
图3为本申请实施例编码同步图像的示意图;FIG. 3 is a schematic diagram of encoding a synchronous image according to an embodiment of the present application;
图4为本申请实施例服务器进行权限分发的流程图;FIG. 4 is a flowchart of permission distribution performed by a server according to an embodiment of the present application;
图5为本申请实施例同步显示过程的流程性示意图;FIG. 5 is a schematic flowchart of a synchronous display process according to an embodiment of the present application;
图6为本申请实施例同步显示装置的结构示意图;6 is a schematic structural diagram of a synchronous display device according to an embodiment of the present application;
图7为本申请实施例电子设备的结构示意图。FIG. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
具体实施方式Detailed ways
以下基于实施例对本申请进行描述,但是本申请并不仅仅限于这些实施例。在下文对本申请的细节描述中,详尽描述了一些特定的细节部分。对本领域技术人员来说没有这些细节部分的描述也可以完全理解本申请。为了避免混淆本申请的实质,公知的方法、过程、流程、元件和电路并没有详细叙述。The present application is described below based on examples, but the present application is not limited to these examples only. In the following detailed description of the application, some specific details are described in detail. Those skilled in the art can fully understand the present application without the description of these detailed parts. Well-known methods, procedures, procedures, components and circuits have not been described in detail in order to avoid obscuring the essence of this application.
此外,本领域普通技术人员应当理解,在此提供的附图都是为了说明的目的,并且附图不一定是按比例绘制的。Furthermore, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale.
除非上下文明确要求,否则在说明书的“包括”、“包含”等类似词语应当解释为包含的含义而不是排他或穷举的含义;也就是说,是“包括但不限于”的含义。Unless clearly required by the context, words such as "including", "comprising" and the like in the specification should be construed in an inclusive rather than an exclusive or exhaustive sense; that is, in the sense of "including but not limited to".
在本申请的描述中,需要理解的是,术语“第一”、“第二”等仅用于描述目的,而不能理解为指示或暗示相对重要性。此外,在本申请的描述中,除非另有说明,“多个”的含义是两个或两个以上。In the description of the present application, it should be understood that the terms "first", "second" and the like are used for descriptive purposes only, and should not be construed as indicating or implying relative importance. Also, in the description of this application, unless otherwise specified, "plurality" means two or more.
在相关技术中,用户可以通过控制目标终端将目标终端的显示画面共享给另一个终端A,以实现在终端A可以同步展示目标终端所显示的图像、文本、演示文稿等文件。In the related art, the user can control the target terminal to share the display screen of the target terminal with another terminal A, so that the terminal A can display the image, text, presentation and other files displayed by the target terminal synchronously.
然而,在屏幕共享过程中,由于客观原因可能会出现接受屏幕共享的终端A的显示画面不正常的问题。例如,由于目标终端和终端A的操作系统不同,可能会导致终端A即使接收到目标终端发送的数据也无法正常显示的问题。再例如,由于目标终端和终端A显示屏尺寸的不同,可能会导致终端A同步展示的内容出现偏移等问题。再例如,目标终端和终端A中应用程序的版本不同,目标终端和终端A所显示的显示画面会由于版本的不同而出现差异,进而可能会出现同步展示的内容无法同步至显示界面中相应的位置。However, during the screen sharing process, there may be a problem that the display screen of the terminal A that accepts the screen sharing is abnormal due to objective reasons. For example, since the operating systems of the target terminal and terminal A are different, it may cause a problem that terminal A cannot display the data sent by the target terminal normally even if it receives data from the target terminal. For another example, due to the difference in the size of the display screen of the target terminal and the terminal A, problems such as offset may occur in the content displayed by the terminal A synchronously. For another example, if the versions of the application programs in the target terminal and terminal A are different, the display screen displayed by the target terminal and terminal A will be different due to the different versions, and it may happen that the content displayed synchronously cannot be synchronized to the corresponding display interface in the display interface. Location.
因此,如何保证屏幕共享时各个终端均可以显示正常的画面是目前亟需解决的问题。Therefore, how to ensure that each terminal can display a normal picture during screen sharing is an urgent problem to be solved at present.
为了解决上述问题,本申请实施例提供一种同步显示方法,该方法可以应用至同步显示系统中的电子设备,其中,电子设备包括同步终端和服务器,同步终端可以是智能手机、平板电脑、个人计算机(Personal Computer,PC)或者虚拟现实(Virtual Reality,VR)设备等,服务器可以是单个服务器,也可以是以分布式方式配置的服务器集群,还可以是云服务器。其中,VR技术是基于计算机技术产生的电子信号,通过VR设备向用户展示三维模型、二维图像、视频的技术。In order to solve the above problem, an embodiment of the present application provides a synchronous display method, which can be applied to electronic equipment in a synchronous display system, wherein the electronic equipment includes a synchronization terminal and a server, and the synchronization terminal can be a smart phone, a tablet computer, a personal A computer (Personal Computer, PC) or a virtual reality (Virtual Reality, VR) device, etc., the server may be a single server, a server cluster configured in a distributed manner, or a cloud server. Among them, VR technology is a technology based on electronic signals generated by computer technology to display three-dimensional models, two-dimensional images and videos to users through VR equipment.
在本申请实施例中,同步终端包括目标终端,其中,目标终端为向服务器发送数据,并使得各同步终端中除目标终端以外的同步终端基于同步显示的终端。In the embodiment of the present application, the synchronization terminal includes a target terminal, wherein the target terminal is a terminal that sends data to the server, and makes the synchronization terminals other than the target terminal among the synchronization terminals based on the synchronization display.
如图1所示,图1为本申请实施例同步显示系统的示意图,该示意图包括:服务器11、目标终端12、同步终端13和同步终端14。As shown in FIG. 1 , FIG. 1 is a schematic diagram of a synchronous display system according to an embodiment of the present application. The schematic diagram includes: a
其中,服务器11、目标终端12、同步终端13和同步终端14可以通过图1所示的网络连接方式实现在线数据传输,在另一种情况下,服务器11、目标终端12、同步终端13和同步终端14也可以通过有线连接的方式实现数据传输。Among them, the
在本申请实施例中,目标终端可以是可操作且具有显示功能的终端,同步终端可以是具有显示功能的终端。例如,如图1所示,目标终端12为计算机设备,同步终端13为移动终端设备,同步终端14为VR设备。当然,图1中的目标终端和同步终端仅为本申请实施例的一种举例说明,在实际应用中,目标终端和同步终端也可以是其它类型的终端,例如平板电脑、智能显示屏等等,目标终端和同步终端的数量也不仅限于图1所示的数量。In this embodiment of the present application, the target terminal may be an operable terminal with a display function, and the synchronization terminal may be a terminal with a display function. For example, as shown in FIG. 1 , the
服务器11在与多个设备(目标终端12、同步终端13和同步终端14)进行通信连接之后,服务器11可以通过该通信连接接收目标终端12设备发送的数据,然后向同步终端13和同步终端14下发目标终端12发送的数据,以实现同步终端13和同步终端14可以与目标终端12同步显示。After the
具体的,为了保证屏幕共享时各个终端均可以显示正常的画面,同步显示系统中的服务器可以被配置为执行:向各同步终端广播编码同步图像,接收目标终端发送的触控坐标,并基于触控坐标和编码同步图像执行同步操作,以使得各同步终端中除目标终端以外的同步终端进行同步显示。Specifically, in order to ensure that each terminal can display a normal picture when the screen is shared, the server in the synchronous display system can be configured to: broadcast the encoded synchronous image to each synchronous terminal, receive the touch coordinates sent by the target terminal, and based on the touch A synchronization operation is performed on the control coordinates and the coded synchronization image, so that the synchronization terminals other than the target terminal among the synchronization terminals are synchronously displayed.
同步显示系统中的同步终端可以被配置为执行:接收编码同步图像。A sync terminal in a sync display system may be configured to perform: receive an encoded sync image.
同步显示系统中的目标终端可以被配置为执行:向服务器发送触控坐标,并执行控制指令。The target terminal in the synchronous display system can be configured to perform: send touch coordinates to the server, and execute control instructions.
其中,编码同步图像是指经过数字编码后的显示画面,其具有较小的数据体量。在数据传输过程中,由于编码同步图像占用的数据量较小,因此,传输编码同步图像所需的时间较少,传输的效率较高。在本申请实施例中,服务器通过向各同步终端广播编码同步图像,可以使得各同步终端接收到相同的显示画面图像并进行显示。The coded synchronization image refers to a digitally coded display image, which has a small data volume. In the process of data transmission, since the amount of data occupied by the coded synchronous image is small, the time required to transmit the coded synchronous image is less, and the transmission efficiency is higher. In the embodiment of the present application, the server broadcasts the encoded synchronization image to each synchronization terminal, so that each synchronization terminal can receive and display the same display screen image.
另外,编码同步图像还包括对应的坐标系,当目标终端接收到用户通过外接设备(例如鼠标、键盘等)或者点触操作(例如用户通过触摸显示屏、通过触控笔点击显示屏等)输入的控制指令后,可以确定控制指令对应的触控坐标,而该触控坐标即为编码同步图像对应坐标系中的坐标。In addition, the coded synchronous image also includes a corresponding coordinate system. When the target terminal receives the input from the user through an external device (such as a mouse, keyboard, etc.) or a touch operation (such as the user touches the display screen, clicks the display screen with a stylus, etc.) After the control command is generated, the touch coordinates corresponding to the control command can be determined, and the touch coordinates are the coordinates in the coordinate system corresponding to the coded synchronization image.
进而,当服务器接收到目标终端发送的触控坐标后,服务器可以基于触控坐标和编码同步图像的坐标系执行同步操作。例如,服务器可以将触控坐标所对应的操作还原至编码同步图像,并将还原操作后的编码同步图像发送至各同步终端,以使得各同步终端中除目标终端以外的同步终端进行同步显示。再例如,服务器也可以将触控坐标发送至各同步终端,以使得各同步终端中除目标终端以外的同步终端基于触控坐标和编码同步图像进行同步显示。Furthermore, after the server receives the touch coordinates sent by the target terminal, the server may perform a synchronization operation based on the touch coordinates and the coordinate system of the encoded synchronization image. For example, the server can restore the operation corresponding to the touch coordinates to the coded synchronous image, and send the coded synchronous image after the restoration operation to each synchronous terminal, so that the synchronous terminals other than the target terminal among the synchronous terminals can display synchronously. For another example, the server may also send the touch coordinates to each synchronization terminal, so that the synchronization terminals other than the target terminal among the synchronization terminals perform synchronous display based on the touch coordinates and the encoded synchronization image.
通过本申请实施例,服务器可以向各同步终端广播编码同步图像,以使得各同步终端接收到相同的显示画面图像并进行显示。当进行同步显示时,目标终端可以根据接收的控制指令确定触控坐标,并将该触控坐标发送至服务器,进而,当服务器接收到目标终端发送的触控坐标后,服务器可以基于触控坐标和编码同步图像执行同步操作,以实现各同步终端的同步显示。在此过程中,由于各同步终端的同步显示是基于触控坐标和编码同步图像实现的,而且各同步终端显示的编码同步图像又是相同的图像,因此,即使各同步终端之间存在显示屏尺寸不同、操作系统不同、应用程序版本不同等因素,也不会影响基于触控坐标和编码同步图像执行的同步操作,保证了屏幕共享时各个同步终端均可以正常显示相同的画面。Through the embodiment of the present application, the server can broadcast the encoded synchronization image to each synchronization terminal, so that each synchronization terminal receives and displays the same display screen image. When performing synchronous display, the target terminal can determine the touch coordinates according to the received control instructions, and send the touch coordinates to the server. Further, after the server receives the touch coordinates sent by the target terminal, the server can determine the touch coordinates based on the touch coordinates. Perform synchronous operation with the coded synchronous image to realize synchronous display of each synchronous terminal. In this process, since the synchronous display of each synchronous terminal is realized based on the touch coordinates and the coded synchronous image, and the coded synchronous image displayed by each synchronous terminal is the same image, even if there is a display screen between each synchronous terminal Factors such as different sizes, different operating systems, and different application versions will not affect the synchronization operations performed based on touch coordinates and coded synchronization images, ensuring that each synchronization terminal can display the same screen normally during screen sharing.
针对应用于上述同步显示系统的同步显示方法,如图2所示,图2为本申请实施例同步显示方法的流程图,具体的,该方法可以包括如下步骤:For the synchronous display method applied to the above-mentioned synchronous display system, as shown in FIG. 2, FIG. 2 is a flowchart of the synchronous display method according to an embodiment of the present application. Specifically, the method may include the following steps:
在步骤21,服务器向各同步终端广播编码同步图像,相应的,各同步终端接收服务器广播的编码同步图像。In step 21, the server broadcasts the encoded synchronization image to each synchronization terminal, and accordingly, each synchronization terminal receives the encoded synchronization image broadcast by the server.
各同步终端接收到编码同步图像之后,可以在显示装置(例如自身的显示屏、外接的显示屏等)中显示该编码同步图像。其中,由于各同步终端中显示的编码同步图像是服务器统一下发的,因此,各同步终端所显示的界面图像相同。After receiving the encoded synchronization image, each synchronization terminal may display the encoded synchronization image on a display device (eg, its own display screen, an external display screen, etc.). Wherein, since the coded synchronization images displayed in each synchronization terminal are uniformly distributed by the server, the interface images displayed by each synchronization terminal are the same.
另外,编码同步图像还包括对应的坐标系,当目标终端接收到用户通过外接设备(例如鼠标、键盘等)或者点触操作(例如用户通过触摸显示屏、通过触控笔点击显示屏等)输入的控制指令后,可以确定控制指令对应的触控坐标,而该触控坐标即为编码同步图像对应坐标系中的坐标。In addition, the coded synchronous image also includes a corresponding coordinate system. When the target terminal receives the input from the user through an external device (such as a mouse, keyboard, etc.) or a touch operation (such as the user touches the display screen, clicks the display screen with a stylus, etc.) After the control command is generated, the touch coordinates corresponding to the control command can be determined, and the touch coordinates are the coordinates in the coordinate system corresponding to the coded synchronization image.
在步骤22,各同步终端中的目标终端根据接收的控制指令确定触控坐标。In step 22, the target terminal in each synchronization terminal determines the touch coordinates according to the received control instruction.
其中,触控坐标可以用于表征用户操作的位置与编码同步图像之间的相对位置,即用户操作的位置在编码同步图像中的位置。The touch coordinates may be used to represent the relative position between the position of the user operation and the encoded synchronization image, that is, the position of the user operated position in the encoded synchronization image.
例如,如图3所示,图3为本申请实施例编码同步图像的示意图,其中,该示意图包括:编码同步图像30、触控坐标31、触控坐标32、触控坐标33、触控坐标34、提供给用户进行选择的工具栏35、提供给用户进行选择的选择按钮36以及提供给用户进行其它操作(例如书写、绘画等)的空白区域。For example, as shown in FIG. 3 , FIG. 3 is a schematic diagram of an encoded synchronous image according to an embodiment of the present application, wherein the schematic diagram includes: an encoded
其中,编码同步图像30是在各同步终端的显示装置中所显示的画面。当编码同步图像30是目标终端显示的画面时,用户可以通过触控笔、触控板、手指、鼠标、键盘或其他方式来触控显示屏中的工具栏35、选择按钮36或者空白区域,以实现输入控制指令的目的。Here, the coded
当目标终端接收到用户输入的控制指令后,目标终端可以根据接收的控制指令确定触控坐标。After the target terminal receives the control instruction input by the user, the target terminal can determine the touch coordinates according to the received control instruction.
例如,如图3所示,当用户输入控制指令以实现在空白区域书写“人”字时,目标终端可以根据用户输入的控制指令(即用户在空白区域书写“人”字时所划过的路径)确定用户在操作过程中对应的各触控坐标31(a,b)、触控坐标32(c,d)、触控坐标33(e,f)、触控坐标34(g,h)。For example, as shown in FIG. 3 , when the user inputs a control instruction to write the character "person" in the blank area, the target terminal can write the character "person" in the blank area according to the control instruction input by the user (that is, the line drawn by the user when writing the character "person" in the blank area path) to determine the touch coordinates 31 (a, b), touch coordinates 32 (c, d), touch coordinates 33 (e, f), and touch coordinates 34 (g, h) corresponding to the user during the operation .
需要说明的,图3仅示例性的列出4个触控坐标以说明本申请实施例中触控坐标的含义,实际上,用户在空白区域书写“人”字时,除了笔画起始点和终止点之外,目标终端还会确定书写过程中其它若干触控坐标。通过这些触控坐标以及预设的渲染方式,目标终端可以在空白区域显示用户所书写的“人”字。It should be noted that, FIG. 3 only exemplarily lists four touch coordinates to illustrate the meaning of the touch coordinates in the embodiment of the present application. In addition to the point, the target terminal will also determine several other touch coordinates during the writing process. Through these touch coordinates and a preset rendering method, the target terminal can display the character "person" written by the user in the blank area.
还需要说明的,在一种情况下,若用户输入的控制指令是带有执行顺序的(例如在书写时,用户需要按照先后顺序依次画出笔画),则目标终端在确定触控坐标的同时,还需要确定各触控坐标的执行顺序。其中,各触控坐标的执行顺序可以根据目标终端接收控制指令的顺序确定,即先接收到的控制指令对应触控坐标的执行顺序在先,后接收到的控制指令对应触控坐标的执行顺序在后。例如,如图3所示,若用户在书写“人”字时,先从触控坐标31开始按照图3所示的方向书写至触控坐标32,再从触控坐标33开始按照图3所示的方向书写至触控坐标34已完成书写,那么,图3所示的4个触控坐标的执行顺序从先到后分别为:触控坐标31、触控坐标32、触控坐标33、触控坐标34。It should also be noted that, in one case, if the control command input by the user has an execution order (for example, when writing, the user needs to draw strokes in sequence), the target terminal determines the touch coordinates while determining the touch coordinates. , and also need to determine the execution order of each touch coordinate. The execution order of each touch coordinate can be determined according to the order in which the target terminal receives the control instructions, that is, the execution order of the first received control instruction corresponding to the touch coordinate comes first, and the later received control instruction corresponds to the execution order of the touch coordinate is behind. For example, as shown in FIG. 3 , if the user is writing the word “人”, he first starts from the touch coordinate 31 and writes to the touch coordinate 32 in the direction shown in FIG. 3 , and then starts from the touch coordinate 33 according to the direction shown in FIG. 3 . After writing in the direction shown to the touch coordinates 34, the execution order of the four touch coordinates shown in FIG. 3 is from first to last: touch coordinates 31, touch coordinates 32, touch coordinates 33, Touch coordinates 34.
在另一种情况下,若用户输入的控制指令是不带有执行顺序的(例如在绘画时,用户可以通过填充选项对一定区域进行填充),则目标终端在确定触控坐标后无需确定各触控坐标的执行顺序。也就是说,若各触控坐标是同时目标终端同时确定的,则目标终端无需确定各触控坐标的执行顺序。In another case, if the control instructions input by the user do not have an execution order (for example, when drawing, the user can fill a certain area through the fill option), the target terminal does not need to determine each touch coordinate after determining the touch coordinates. The execution order of touch coordinates. That is, if each touch coordinate is determined by the target terminal at the same time, the target terminal does not need to determine the execution order of each touch coordinate.
在另一种情况下,若用户输入的控制指令是既带有执行顺序又不带有执行顺序的(例如在绘画时,用户可以先按照一定顺序绘制图形,然后再通过填充选项对图形进行填充),则目标终端在确定触控坐标的同时,还需要确定各触控坐标的执行顺序,而且,同一执行顺序下可能存在多个触控坐标(例如对图形进行填充时确定的触控坐标)。In another case, if the control command input by the user has both execution order and no execution order (for example, when drawing, the user can first draw graphics in a certain order, and then fill the graphics through the fill option) ), when the target terminal determines the touch coordinates, it also needs to determine the execution order of each touch coordinate, and there may be multiple touch coordinates in the same execution order (for example, the touch coordinates determined when filling the graphics) .
在步骤23,目标终端向服务器发送触控坐标,相应的,服务器接收目标终端发送的触控坐标。In step 23, the target terminal sends the touch coordinates to the server, and correspondingly, the server receives the touch coordinates sent by the target terminal.
在步骤24,目标终端执行控制指令。In step 24, the target terminal executes the control instruction.
需要说明的,本申请实施例对步骤23和步骤24的执行顺序不进行限定,也就是说,本申请实施例既可以先执行步骤23再执行步骤24,也可以先执行步骤24再执行步骤23,还可以同时执行步骤23和骤24。It should be noted that the embodiment of the present application does not limit the execution order of step 23 and step 24, that is to say, the embodiment of the present application can either execute step 23 first and then execute step 24, or execute step 24 first and then execute step 23 , and step 23 and step 24 may also be performed at the same time.
在一种可选的实施方式中,步骤23可以执行为:目标终端向服务器发送操作请求,服务器响应于操作请求,向目标终端返回操作响应,目标终端响应于操作相应,向服务器发送触控坐标。In an optional implementation manner, step 23 may be performed as follows: the target terminal sends an operation request to the server, the server responds to the operation request and returns an operation response to the target terminal, and the target terminal responds to the operation and sends touch coordinates to the server .
其中,操作响应用于表征目标终端获取操作权限。The operation response is used to represent that the target terminal obtains the operation authority.
在本申请实施例中,在目标终端向服务器发送触控坐标之前,需要先向服务器获取相应的操作权限。也就是说,在各同步终端中,只有获取到操作权限的终端可以作为目标终端向服务器发送触控坐标,以实现同步显示的目的。这样,可以使得服务器在执行同步操作时,只接收目标终端发送的触控坐标,避免了其它同步终端的干扰,提高了同步过程的稳定性。In this embodiment of the present application, before the target terminal sends the touch coordinates to the server, it needs to obtain the corresponding operation authority from the server. That is to say, in each synchronous terminal, only the terminal that has obtained the operation authority can send the touch coordinates to the server as the target terminal, so as to realize the purpose of synchronous display. In this way, the server can only receive the touch coordinates sent by the target terminal when performing the synchronization operation, thereby avoiding the interference of other synchronization terminals and improving the stability of the synchronization process.
在一种可选的实施方式中,若服务器接收到同步终端中除目标终端以外的同步终端发送的操作请求,则本申请实施例可以执行:服务器响应于接收到各同步终端中除目标终端以外的同步终端发送的操作请求,向发送操作请求的同步终端返回拒绝响应,同步终端响应于接收到服务器返回的拒绝响应,接收服务器发送的触控坐标,并基于触控坐标和编码同步图像进行同步显示。In an optional implementation manner, if the server receives an operation request sent by a synchronization terminal other than the target terminal among the synchronization terminals, this embodiment of the present application may execute: the server responds to receiving an operation request among the synchronization terminals other than the target terminal In response to the operation request sent by the synchronization terminal, the synchronization terminal returns a rejection response to the synchronization terminal that sent the operation request. In response to receiving the rejection response returned by the server, the synchronization terminal receives the touch coordinates sent by the server, and synchronizes based on the touch coordinates and the encoded synchronization image. show.
例如,如图4所示,图4为本申请实施例服务器进行权限分发的流程图,具体包括如下步骤:For example, as shown in FIG. 4 , FIG. 4 is a flow chart of rights distribution performed by a server according to an embodiment of the present application, which specifically includes the following steps:
在步骤41,服务器向各同步终端广播编码同步图像,相应的,各同步终端接收服务器广播的编码同步图像。In step 41, the server broadcasts the encoded synchronization image to each synchronization terminal, and correspondingly, each synchronization terminal receives the encoded synchronization image broadcast by the server.
在步骤42,同步终端中的目标终端向服务器发送操作请求,相应的,服务器接收目标终端发送的操作请求。In step 42, the target terminal in the synchronization terminal sends an operation request to the server, and correspondingly, the server receives the operation request sent by the target terminal.
在步骤43,服务器向目标终端返回操作响应,相应的,目标终端接收服务器返回的操作响应。In step 43, the server returns an operation response to the target terminal, and accordingly, the target terminal receives the operation response returned by the server.
其中,当目标终端接收到服务器发送的操作响应后,即表征目标终端获取到了相应的操作权限,进而,目标终端可以在相应的权限内执行相应的操作。Wherein, when the target terminal receives the operation response sent by the server, it means that the target terminal has obtained the corresponding operation authority, and further, the target terminal can perform the corresponding operation within the corresponding authority.
在步骤44,同步终端中除目标终端以外的同步终端向服务器发送操作请求,相应的,服务器接收同步终端发送的操作请求。In step 44, the synchronization terminals other than the target terminal among the synchronization terminals send an operation request to the server, and correspondingly, the server receives the operation request sent by the synchronization terminal.
在步骤45,服务器向对应的同步终端返回拒绝响应,相应的,该同步终端接收服务器返回的拒绝响应。In step 45, the server returns a rejection response to the corresponding synchronization terminal, and correspondingly, the synchronization terminal receives the rejection response returned by the server.
也就是说,当各同步终端中存在已经获取到权限的终端(即目标终端)时,若其它的同步终端向服务器发送操作请求以获取操作权限,则服务器会拒绝该同步终端并返回拒绝响应。这样,可以使得服务器在执行同步操作时,只接收目标终端发送的触控坐标,避免了其它同步终端的干扰,提高了同步过程的稳定性。That is to say, when there is a terminal (ie, target terminal) that has obtained permission in each synchronization terminal, if other synchronization terminals send operation requests to the server to obtain operation rights, the server will reject the synchronization terminal and return a rejection response. In this way, the server can only receive the touch coordinates sent by the target terminal when performing the synchronization operation, thereby avoiding the interference of other synchronization terminals and improving the stability of the synchronization process.
在步骤25,服务器执行同步操作,以使得各同步终端中除目标终端以外的同步终端进行同步显示。In step 25, the server performs a synchronization operation, so that the synchronization terminals other than the target terminal among the synchronization terminals perform synchronization display.
其中,服务器在执行同步操作时,可以基于触控坐标和编码同步图像使得各同步终端中除目标终端以外的同步终端进行同步显示。例如,服务器可以将触控坐标所对应的操作还原至编码同步图像,并将还原操作后的编码同步图像发送至各同步终端,以使得各同步终端中除目标终端以外的同步终端进行同步显示。再例如,服务器也可以将触控坐标发送至各同步终端,以使得各同步终端中除目标终端以外的同步终端基于触控坐标和编码同步图像进行同步显示。Wherein, when the server performs the synchronization operation, the synchronization terminal other than the target terminal among the synchronization terminals can be displayed synchronously based on the touch coordinates and the encoded synchronization image. For example, the server can restore the operation corresponding to the touch coordinates to the coded synchronous image, and send the coded synchronous image after the restoration operation to each synchronous terminal, so that the synchronous terminals other than the target terminal among the synchronous terminals can display synchronously. For another example, the server may also send the touch coordinates to each synchronization terminal, so that the synchronization terminals other than the target terminal among the synchronization terminals perform synchronous display based on the touch coordinates and the encoded synchronization image.
例如,如图5所示,图5为本申请实施例同步显示过程的流程性示意图,其中,该示意图包括服务器511、同步终端中的目标终端512和其它同步终端513。For example, as shown in FIG. 5 , FIG. 5 is a schematic flowchart of a synchronization display process according to an embodiment of the present application, wherein the schematic diagram includes a
在步骤521,当目标终端512获取到相应的操作权限后,目标终端512可以根据控制指令确定触控坐标,然后向服务器511发送该触控坐标。In step 521 , after the
其中,触控坐标可以是单个坐标,也可以是多个触控坐标的集合。若目标终端512发送的是多个触控坐标的集合,则该集合中的多个触控坐标可以带有执行顺序,也可以不带有执行顺序。The touch coordinates may be a single coordinate, or may be a collection of multiple touch coordinates. If the
在步骤522,当服务器511接收到目标终端512发送的触控坐标后,服务器511可以根据该触控坐标执行同步操作,以使得各同步终端513与目标终端512同步显示。In step 522 , after the
其中,服务器511可以将触控坐标所对应的操作还原至编码同步图像,并将还原操作后的编码同步图像发送至各同步终端513。服务器511也可以将触控坐标发送至各同步终端513,以使得各同步终端513基于触控坐标和编码同步图像进行同步显示。The
如图5所示,目标终端512的空白区域中显示了“人”字,同步终端513在同步显示之前空白区域中没有内容,同步终端513在同步显示之后的空白区域中显示了“人”字。也就是说,通过本申请实施例,服务器可以向各同步终端广播编码同步图像,以使得各同步终端接收到相同的显示画面图像并进行显示。当进行同步显示时,目标终端可以根据接收的控制指令确定触控坐标,并将该触控坐标发送至服务器,进而,当服务器接收到目标终端发送的触控坐标后,服务器可以基于触控坐标和编码同步图像执行同步操作,以实现各同步终端的同步显示。在此过程中,由于各同步终端的同步显示是基于触控坐标和编码同步图像实现的,而且各同步终端显示的编码同步图像又是相同的图像,因此,即使各同步终端之间存在显示屏尺寸不同、操作系统不同、应用程序版本不同等因素,也不会影响基于触控坐标和编码同步图像执行的同步操作,保证了屏幕共享时各个同步终端均可以正常显示相同的画面。As shown in FIG. 5 , the word "person" is displayed in the blank area of the
在一种可选的实施方式中,上述步骤25具体可以执行为:服务器向各同步终端中除目标终端以外的同步终端发送触控坐标,同步终端接收到触控坐标后,解析触控坐标并与目标终端进行同步显示。In an optional implementation manner, the above step 25 may be specifically performed as follows: the server sends touch coordinates to the synchronization terminals other than the target terminal among the synchronization terminals, and after the synchronization terminal receives the touch coordinates, parses the touch coordinates and generates Synchronized display with the target terminal.
在此情况下,服务器在接收到目标终端发送的触控坐标后,可以直接将该触控坐标发送给各同步终端,这样,当服务器需要处理大量数据时,通过本申请实施例可以减轻运算压力,提高处理效率。In this case, after receiving the touch coordinates sent by the target terminal, the server can directly send the touch coordinates to each synchronous terminal. In this way, when the server needs to process a large amount of data, the embodiment of the present application can reduce the computational pressure , improve processing efficiency.
相应的,同步终端解析触控坐标后,由于触控坐标是表征用户操作的位置与编码同步图像之间的相对位置,即用户操作的位置在编码同步图像中的位置。因此,同步终端通过触控坐标可以准确确定对应操作在编码同步图像中的位置,保证了屏幕共享时各个同步终端均可以正常显示相同的画面。Correspondingly, after the synchronization terminal parses the touch coordinates, since the touch coordinates represent the relative position between the position of the user's operation and the encoded synchronization image, that is, the position of the user's operation in the encoded synchronization image. Therefore, the synchronization terminal can accurately determine the position of the corresponding operation in the encoded synchronization image through the touch coordinates, which ensures that each synchronization terminal can normally display the same picture when the screen is shared.
在一种可选的实施方式中,同步终端可以包括高优先级终端和低优先级终端,目标终端为高优先级终端。In an optional implementation manner, the synchronization terminals may include high-priority terminals and low-priority terminals, and the target terminal is a high-priority terminal.
具体的,上述步骤25具体可以执行为:服务器响应于触控坐标对应目标低优先级终端的选择控件,向各同步终端中除目标终端以外的同步终端发送触控坐标,同步终端接收到触控坐标后,解析触控坐标并与目标终端进行同步显示,服务器将目标终端的全部或部分操作权限转移至目标低优先级终端。Specifically, the above step 25 can be specifically executed as follows: the server, in response to the selection control of the touch coordinates corresponding to the target low-priority terminal, sends the touch coordinates to the synchronous terminals other than the target terminal among the synchronous terminals, and the synchronous terminal receives the touch After the coordinates are obtained, the touch coordinates are parsed and displayed synchronously with the target terminal, and the server transfers all or part of the operation authority of the target terminal to the target low-priority terminal.
也就是说,在目标终端为高优先级终端时,使用目标终端的用户可以选择任意目标低优先级终端,并将自身的全部或部分权限转移至该目标低优先级终端。That is, when the target terminal is a high-priority terminal, the user using the target terminal can select any target low-priority terminal, and transfer all or part of his own authority to the target low-priority terminal.
例如,在会议场景下,目标终端(高优先级终端)可以是会议主持人,其它同步终端可以是会议参与者。以图3为例,图3中的编码同步图像30是目标终端显示的画面,其中的各选择按钮36可以分别对应不同的同步终端。当会议主持人通过目标终端点击某一选择按钮36(例如选择按钮A)时,目标终端可以将对应的触控坐标发送给服务器,以使得服务器进行同步操作的同时,将目标终端的全部或部分权限转移给该选择按钮36对应的同步终端。For example, in a conference scenario, the target terminal (high-priority terminal) may be the conference host, and other synchronous terminals may be conference participants. Taking FIG. 3 as an example, the
然后,当该选择按钮36对应的同步终端获取到相应的操作权限后,使用该同步终端的会议参与者可以向该同步终端输入控制指令,以使得该同步终端将控制指令对应的触控坐标发送至服务器,进而使得服务器执行同步操作。Then, after the synchronization terminal corresponding to the
在本申请实施例中,通过设置同步终端的优先级,可以使得权限的控制更加规范化,扩大了系统的适用性。In the embodiment of the present application, by setting the priority of the synchronization terminal, the control of the authority can be more standardized, and the applicability of the system can be expanded.
在另一种可选的实施方式中,同步终端可以包括高优先级终端和低优先级终端,目标终端为低优先级终端。In another optional implementation manner, the synchronization terminals may include high-priority terminals and low-priority terminals, and the target terminal is a low-priority terminal.
具体的,上述步骤25具体可以执行为:服务器响应于触控坐标对应结束操作的选择控件,向各同步终端中除目标终端以外的同步终端发送触控坐标,同步终端接收到触控坐标后,解析触控坐标并与目标终端进行同步显示,服务器将目标终端的全部或部分操作权限转移至高优先级终端。Specifically, the above step 25 can be specifically executed as follows: the server sends the touch coordinates to the synchronization terminals other than the target terminal among the synchronization terminals in response to the selection control corresponding to the end operation corresponding to the touch coordinates, and after the synchronization terminal receives the touch coordinates, The touch coordinates are parsed and displayed synchronously with the target terminal, and the server transfers all or part of the operation authority of the target terminal to the high-priority terminal.
例如,在教学场景下,目标终端(低优先级终端)可以是课堂中的学生,其它同步终端包括其他学生(低优先级终端)以及课堂的老师(高优先级终端)。以图3为例,图3中的编码同步图像30是目标终端显示的画面,其中的选择按钮E可以是结束操作的选择控件。For example, in a teaching scenario, the target terminal (low-priority terminal) may be a student in the classroom, and other synchronous terminals include other students (low-priority terminal) and the teacher of the classroom (high-priority terminal). Taking FIG. 3 as an example, the
当学生通过目标终端点击选择按钮E时,目标终端可以将对应的触控坐标发送给服务器,以使得服务器进行同步操作的同时,将目标终端的全部或部分权限转移给老师对应的高优先级终端。When the student clicks the selection button E through the target terminal, the target terminal can send the corresponding touch coordinates to the server, so that the server can transfer all or part of the authority of the target terminal to the high-priority terminal corresponding to the teacher while the server performs the synchronous operation. .
进一步的,在一种可选的实施方式中,高优先级终端还可以主动收回权限,具体的,该过程具体可以执行为:服务器响应于接收到高优先级终端的权限收回指令,将目标终端的全部或部分操作权限转移至高优先级终端。Further, in an optional implementation manner, the high-priority terminal can also take the initiative to revoke the authority. Specifically, the process can be specifically performed as follows: the server responds to receiving the authority revocation instruction of the high-priority terminal, and reclaims the target terminal. All or part of the operation rights are transferred to the high-priority terminal.
例如,在教学场景下,目标终端(低优先级终端)可以是课堂中的学生,其它同步终端包括其他学生(低优先级终端)以及课堂的老师(高优先级终端)。以图3为例,图3中的编码同步图像30是老师所使用的同步终端显示的画面,其中的选择按钮E可以是用于发送权限收回指令的选择控件。For example, in a teaching scenario, the target terminal (low-priority terminal) may be a student in the classroom, and other synchronous terminals include other students (low-priority terminal) and the teacher of the classroom (high-priority terminal). Taking FIG. 3 as an example, the coded
当老师通过高优先级终端点击选择按钮E时,该高优先级终端可以将对应的触控坐标发送给服务器,以使得服务器进行同步操作的同时,将目标终端的全部或部分权限转移给老师对应的高优先级终端,即实现了权限收回操作。When the teacher clicks the selection button E through the high-priority terminal, the high-priority terminal can send the corresponding touch coordinates to the server, so that the server can transfer all or part of the authority of the target terminal to the corresponding teacher while performing the synchronous operation. The high-priority terminal implements the permission revocation operation.
在本申请实施例中,通过设置同步终端的优先级,可以使得权限的控制更加规范化,扩大了系统的适用性。In the embodiment of the present application, by setting the priority of the synchronization terminal, the control of the authority can be more standardized, and the applicability of the system can be expanded.
基于相同的技术构思,本申请实施例还提供了一种同步显示装置,如图6所示,该装置包括:广播模块61、触控坐标确定模块62、触控坐标发送模块63和同步模块64。Based on the same technical concept, an embodiment of the present application also provides a synchronous display device. As shown in FIG. 6 , the device includes: a broadcast module 61 , a touch coordinate
广播模块61,用于服务器向各同步终端广播编码同步图像。The broadcasting module 61 is used for the server to broadcast the encoded synchronization image to each synchronization terminal.
触控坐标确定模块62,用于各所述同步终端中的目标终端根据接收的控制指令确定触控坐标。The touch coordinate
触控坐标发送模块63,用于所述目标终端向所述服务器发送所述触控坐标,并执行所述控制指令。The touch coordinate sending
同步模块64,用于所述服务器接收所述目标终端发送的触控坐标,并基于所述触控坐标和所述编码同步图像执行同步操作,以使得各所述同步终端中除目标终端以外的同步终端进行同步显示。The synchronization module 64 is used for the server to receive the touch coordinates sent by the target terminal, and to perform a synchronization operation based on the touch coordinates and the encoded synchronization image, so that the synchronization terminals except the target terminal The synchronous terminal performs synchronous display.
在一些实施例中,所述同步模块64,具体用于:In some embodiments, the synchronization module 64 is specifically configured to:
服务器向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标。The server sends the touch coordinates to the synchronization terminals other than the target terminal among the synchronization terminals.
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示。After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal.
在一些实施例中,所述触控坐标发送模块63,具体用于:In some embodiments, the touch coordinate sending
所述目标终端向所述服务器发送操作请求。The target terminal sends an operation request to the server.
所述服务器响应于所述操作请求,向所述目标终端返回操作响应,所述操作响应用于表征所述目标终端获取操作权限。In response to the operation request, the server returns an operation response to the target terminal, where the operation response is used to represent that the target terminal obtains operation authority.
所述目标终端响应于所述操作相应,向所述服务器发送触控坐标。The target terminal sends touch coordinates to the server in response to the operation.
在一些实施例中,所述装置还包括:In some embodiments, the apparatus further includes:
响应模块,用于所述服务器响应于接收到各所述同步终端中除目标终端以外的同步终端发送的操作请求,向发送操作请求的同步终端返回拒绝响应;以及a response module, used for the server to return a rejection response to the synchronization terminal that sent the operation request in response to receiving the operation request sent by the synchronization terminal other than the target terminal among the synchronization terminals; and
同步显示模块,用于所述同步终端响应于接收到所述服务器返回的拒绝响应,接收服务器发送的触控坐标,并基于所述触控坐标和所述编码同步图像进行同步显示。The synchronization display module is used for the synchronization terminal to receive the touch coordinates sent by the server in response to receiving the rejection response returned by the server, and to perform synchronous display based on the touch coordinates and the encoded synchronization image.
在一些实施例中,所述同步终端包括高优先级终端和低优先级终端,所述目标终端为高优先级终端。In some embodiments, the synchronization terminals include high-priority terminals and low-priority terminals, and the target terminal is a high-priority terminal.
所述同步模块64,具体用于:The synchronization module 64 is specifically used for:
所述服务器响应于所述触控坐标对应目标低优先级终端的选择控件,向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标。The server sends the touch coordinates to synchronization terminals other than the target terminal among the synchronization terminals in response to the selection control of the touch coordinates corresponding to the target low-priority terminal.
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示。After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal.
所述服务器将所述目标终端的全部或部分操作权限转移至所述目标低优先级终端。The server transfers all or part of the operation authority of the target terminal to the target low-priority terminal.
在一些实施例中,所述同步终端包括高优先级终端和低优先级终端,所述目标终端为低优先级终端。In some embodiments, the synchronization terminals include high-priority terminals and low-priority terminals, and the target terminal is a low-priority terminal.
所述同步模块64,具体用于:The synchronization module 64 is specifically used for:
所述服务器响应于所述触控坐标对应结束操作的选择控件,向各所述同步终端中除目标终端以外的同步终端发送所述触控坐标。The server sends the touch coordinates to the synchronization terminals other than the target terminal among the synchronization terminals in response to the selection control corresponding to the end operation of the touch coordinates.
所述同步终端接收到所述触控坐标后,解析所述触控坐标并与所述目标终端进行同步显示。After receiving the touch coordinates, the synchronization terminal parses the touch coordinates and displays them synchronously with the target terminal.
所述服务器将所述目标终端的全部或部分操作权限转移至所述高优先级终端。The server transfers all or part of the operation authority of the target terminal to the high-priority terminal.
在一些实施例中,所述装置还包括:In some embodiments, the apparatus further includes:
权限收回模块,用于所述服务器响应于接收到所述高优先级终端的权限收回指令,将所述目标终端的全部或部分操作权限转移至所述高优先级终端。A rights revocation module, used for the server to transfer all or part of the operation rights of the target terminal to the high-priority terminal in response to receiving the rights revocation instruction of the high-priority terminal.
通过本申请实施例,服务器可以向各同步终端广播编码同步图像,以使得各同步终端接收到相同的显示画面图像并进行显示。当进行同步显示时,目标终端可以根据接收的控制指令确定触控坐标,并将该触控坐标发送至服务器,进而,当服务器接收到目标终端发送的触控坐标后,服务器可以基于触控坐标和编码同步图像执行同步操作,以实现各同步终端的同步显示。在此过程中,由于各同步终端的同步显示是基于触控坐标和编码同步图像实现的,而且各同步终端显示的编码同步图像又是相同的图像,因此,即使各同步终端之间存在显示屏尺寸不同、操作系统不同、应用程序版本不同等因素,也不会影响基于触控坐标和编码同步图像执行的同步操作,保证了屏幕共享时各个同步终端均可以正常显示相同的画面。Through the embodiment of the present application, the server can broadcast the encoded synchronization image to each synchronization terminal, so that each synchronization terminal receives and displays the same display screen image. When performing synchronous display, the target terminal can determine the touch coordinates according to the received control instructions, and send the touch coordinates to the server. Further, after the server receives the touch coordinates sent by the target terminal, the server can determine the touch coordinates based on the touch coordinates. Perform synchronous operation with the coded synchronous image to realize synchronous display of each synchronous terminal. In this process, since the synchronous display of each synchronous terminal is realized based on the touch coordinates and the coded synchronous image, and the coded synchronous image displayed by each synchronous terminal is the same image, even if there is a display screen between each synchronous terminal Factors such as different sizes, different operating systems, and different application versions will not affect the synchronization operations performed based on touch coordinates and coded synchronization images, ensuring that each synchronization terminal can display the same screen normally during screen sharing.
图7是本申请实施例的电子设备的示意图。如图7所示,图7所示的电子设备为通用地址查询装置,其包括通用的计算机硬件结构,其至少包括处理器71和存储器72。处理器71和存储器72通过总线73连接。存储器72适于存储处理器71可执行的指令或程序。处理器71可以是独立的微处理器,也可以是一个或者多个微处理器集合。由此,处理器71通过执行存储器72所存储的指令,从而执行如上所述的本申请实施例的方法流程实现对于数据的处理和对于其它装置的控制。总线73将上述多个组件连接在一起,同时将上述组件连接到显示控制器74和显示装置以及输入/输出(I/O)装置75。输入/输出(I/O)装置75可以是鼠标、键盘、调制解调器、网络接口、触控输入装置、体感输入装置、打印机以及本领域公知的其他装置。典型地,输入/输出装置75通过输入/输出(I/O)控制器76与系统相连。FIG. 7 is a schematic diagram of an electronic device according to an embodiment of the present application. As shown in FIG. 7 , the electronic device shown in FIG. 7 is a general address query device, which includes a general computer hardware structure, which at least includes a processor 71 and a memory 72 . The processor 71 and the memory 72 are connected by a bus 73 . The memory 72 is adapted to store instructions or programs executable by the processor 71 . The processor 71 may be an independent microprocessor, or may be a set of one or more microprocessors. Thus, the processor 71 executes the instructions stored in the memory 72 to execute the above-described method flow of the embodiments of the present application to process data and control other devices. The bus 73 connects the above-mentioned various components together, while connecting the above-mentioned components to the display controller 74 and the display device and input/output (I/O) device 75 . The input/output (I/O) device 75 may be a mouse, keyboard, modem, network interface, touch input device, somatosensory input device, printer, and other devices known in the art. Typically, input/output devices 75 are connected to the system through an input/output (I/O) controller 76 .
本领域的技术人员应明白,本申请的实施例可提供为方法、装置(设备)或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可读存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品。It should be understood by those skilled in the art that the embodiments of the present application may be provided as a method, an apparatus (apparatus) or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may employ a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本申请是参照根据本申请实施例的方法、装置(设备)和计算机程序产品的流程图来描述的。应理解可由计算机程序指令实现流程图中的每一流程。The present application is described with reference to flowchart illustrations of methods, apparatus (apparatus) and computer program products according to embodiments of the present application. It will be understood that each process in the flowchart can be implemented by computer program instructions.
这些计算机程序指令可以存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现流程图一个流程或多个流程中指定的功能。These computer program instructions may be stored in a computer readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory result in an article of manufacture comprising instruction means, the instruction means Implements the function specified in a flow chart or flows.
也可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程中指定的功能的装置。These computer program instructions may also be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flows of a flowchart.
本申请的另一实施例涉及一种非易失性存储介质,用于存储计算机可读程序,所述计算机可读程序用于供计算机执行上述部分或全部的方法实施例。Another embodiment of the present application relates to a non-volatile storage medium for storing a computer-readable program, where the computer-readable program is used for a computer to execute some or all of the above method embodiments.
即,本领域技术人员可以理解,实现上述实施例方法中的全部或部分步骤是可以通过程序来指定相关的硬件来完成,该程序存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-OnlyMemory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。That is, those skilled in the art can understand that all or part of the steps in the method of implementing the above embodiments can be completed by specifying relevant hardware through a program, and the program is stored in a storage medium and includes several instructions to make a device ( It may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. The aforementioned storage medium includes: U disk, removable hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes.
以上所述仅为本申请的优选实施例,并不用于限制本申请,对于本领域技术人员而言,本申请可以有各种改动和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。The above descriptions are only preferred embodiments of the present application, and are not intended to limit the present application. For those skilled in the art, the present application may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the protection scope of this application.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210134039.7ACN114615535A (en) | 2022-02-14 | 2022-02-14 | Synchronous display method and device, electronic equipment and readable storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210134039.7ACN114615535A (en) | 2022-02-14 | 2022-02-14 | Synchronous display method and device, electronic equipment and readable storage medium |
| Publication Number | Publication Date |
|---|---|
| CN114615535Atrue CN114615535A (en) | 2022-06-10 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210134039.7APendingCN114615535A (en) | 2022-02-14 | 2022-02-14 | Synchronous display method and device, electronic equipment and readable storage medium |
| Country | Link |
|---|---|
| CN (1) | CN114615535A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115328372A (en)* | 2022-07-30 | 2022-11-11 | 深圳乐播科技有限公司 | Synchronous display method, device, electronic equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104464412A (en)* | 2014-12-23 | 2015-03-25 | 成都韬睿教育咨询有限公司 | Remote education system and implementation method thereof |
| CN104539436A (en)* | 2014-12-22 | 2015-04-22 | 杭州施强网络科技有限公司 | Lesson content real-time live broadcasting method and system |
| JP2015230532A (en)* | 2014-06-04 | 2015-12-21 | 日本電信電話株式会社 | Web conferencing system, method of delegating organizer authority of web conferencing system and web conferencing system |
| WO2018076866A1 (en)* | 2016-10-25 | 2018-05-03 | 广东欧珀移动通信有限公司 | Data processing method, device, storage medium, electronic device and server |
| CN109495573A (en)* | 2018-11-26 | 2019-03-19 | Oppo广东移动通信有限公司 | Data transmission method, device, storage medium and terminal |
| CN110554831A (en)* | 2019-09-06 | 2019-12-10 | 腾讯科技(深圳)有限公司 | Operation synchronization method, device, equipment and storage medium |
| US20200310555A1 (en)* | 2019-03-29 | 2020-10-01 | Boe Technology Group Co., Ltd. | Remote information input method, device and system |
| CN111880695A (en)* | 2020-08-03 | 2020-11-03 | 腾讯科技(深圳)有限公司 | Screen sharing method, device, equipment and storage medium |
| CN111985191A (en)* | 2020-08-05 | 2020-11-24 | 北京同创永益科技发展有限公司 | Multi-person collaborative online document editing method and device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2015230532A (en)* | 2014-06-04 | 2015-12-21 | 日本電信電話株式会社 | Web conferencing system, method of delegating organizer authority of web conferencing system and web conferencing system |
| CN104539436A (en)* | 2014-12-22 | 2015-04-22 | 杭州施强网络科技有限公司 | Lesson content real-time live broadcasting method and system |
| CN104464412A (en)* | 2014-12-23 | 2015-03-25 | 成都韬睿教育咨询有限公司 | Remote education system and implementation method thereof |
| WO2018076866A1 (en)* | 2016-10-25 | 2018-05-03 | 广东欧珀移动通信有限公司 | Data processing method, device, storage medium, electronic device and server |
| CN109495573A (en)* | 2018-11-26 | 2019-03-19 | Oppo广东移动通信有限公司 | Data transmission method, device, storage medium and terminal |
| US20200310555A1 (en)* | 2019-03-29 | 2020-10-01 | Boe Technology Group Co., Ltd. | Remote information input method, device and system |
| CN110554831A (en)* | 2019-09-06 | 2019-12-10 | 腾讯科技(深圳)有限公司 | Operation synchronization method, device, equipment and storage medium |
| CN111880695A (en)* | 2020-08-03 | 2020-11-03 | 腾讯科技(深圳)有限公司 | Screen sharing method, device, equipment and storage medium |
| CN111985191A (en)* | 2020-08-05 | 2020-11-24 | 北京同创永益科技发展有限公司 | Multi-person collaborative online document editing method and device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115328372A (en)* | 2022-07-30 | 2022-11-11 | 深圳乐播科技有限公司 | Synchronous display method, device, electronic equipment and storage medium |
| CN115328372B (en)* | 2022-07-30 | 2024-01-09 | 深圳乐播科技有限公司 | Synchronous display method, synchronous display device, electronic equipment and storage medium |
| Publication | Publication Date | Title |
|---|---|---|
| US12079940B2 (en) | Multi-endpoint mixed-reality meetings | |
| US20190251884A1 (en) | Shared content display with concurrent views | |
| US11418551B2 (en) | Method and system for providing virtual whiteboard based collaboration service | |
| EP2423844A1 (en) | Electronic whiteboard system, electronic whiteboard device, and method of controlling electronic whiteboard | |
| EP3447631B1 (en) | Writing trajectory synchronization method and system for multiple clients | |
| CN109697004B (en) | Method, device, device and storage medium for writing annotations on touch devices | |
| JP6035971B2 (en) | Information processing apparatus, program, and image processing system | |
| CN109213316B (en) | Automatic layout engine | |
| US10965743B2 (en) | Synchronized annotations in fixed digital documents | |
| CN112394859A (en) | Form dynamic adjustment method and terminal equipment | |
| CN114615535A (en) | Synchronous display method and device, electronic equipment and readable storage medium | |
| US20150138077A1 (en) | Display system and display controll device | |
| EP4290361A1 (en) | Display control method and apparatus for pointer in window, device, and storage medium | |
| EP3329351A1 (en) | Executing multiple pen inputs | |
| CN107562331A (en) | Display method, device and equipment of handwritten characters and storage medium | |
| CN107516334B (en) | A method, device, device and storage medium for displaying handwritten track | |
| CN114327140B (en) | Screen touch method, device, system, equipment and storage medium | |
| CN107562330A (en) | Display method, device and equipment of handwritten content and storage medium | |
| CN116546232A (en) | Method, device, device and storage medium for interface interaction | |
| CN119156591A (en) | Sharing of captured content | |
| CN107679219A (en) | Matching method and device, interactive intelligent panel and storage medium | |
| CN110851097B (en) | Control method, device, medium and electronic equipment for consistency of handwriting data | |
| CN112492381A (en) | Information display method and device and electronic equipment | |
| CN114025194B (en) | Virtual gift giving method, system, device, equipment and storage medium | |
| CN114637414B (en) | Method, device, equipment and storage medium for binding display elements of electronic whiteboard |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20220610 | |
| RJ01 | Rejection of invention patent application after publication |