CN108462729B - Method and device for realizing interaction of terminal equipment, terminal equipment and server - Google Patents

Abstract

A method and a device for realizing terminal equipment interaction, terminal equipment and a server are provided. The method comprises the following steps: (A) Determining shared content to be shared to a second terminal device in the content currently provided by a first terminal device for a user; (B) And sending the determined shared content to the second terminal equipment for sharing. According to the method, the transmission quantity of the shared data can be effectively reduced.

Description

Translated fromChinese

实现终端设备交互的方法和装置、终端设备及服务器Method and device for realizing terminal device interaction, terminal device and server

技术领域technical field

本发明总体说来涉及终端设备交互技术领域，更具体地讲，涉及一种实现终端设备交互的方法和装置、终端设备及服务器。The present invention generally relates to the technical field of terminal device interaction, and more specifically, relates to a method and device for realizing terminal device interaction, a terminal device and a server.

背景技术Background technique

在现有技术中，可实时将终端设备当前显示的内容共享到与其连接的其他终端设备上进行显示，以使其他终端设备的用户也能够观看到该终端设备显示的内容。但通常需要该终端设备与其他终端设备通过有线连接、或者在同一个局域网络中，保证网络环境良好并且可控，才能实现实时将大量的内容共享给其他终端设备。而在有些情况下，例如，终端设备需要与远端的其他终端设备进行远程共享而进行远距离内容传输时，难以实现实时传输大量的图像数据，无法保证实时交互。In the prior art, the content currently displayed by the terminal device can be shared and displayed on other terminal devices connected to it in real time, so that users of other terminal devices can also watch the content displayed by the terminal device. However, it is usually necessary for the terminal device to be connected to other terminal devices through a wired connection or in the same local area network to ensure that the network environment is good and controllable, so that a large amount of content can be shared with other terminal devices in real time. However, in some cases, for example, when a terminal device needs to be shared with other remote terminal devices for long-distance content transmission, it is difficult to transmit a large amount of image data in real time, and real-time interaction cannot be guaranteed.

发明内容Contents of the invention

本发明的示例性实施例在于提供一种实现终端设备交互的方法和装置、终端设备及服务器，其能够有效减少共享数据的传输量。Exemplary embodiments of the present invention provide a method and device for realizing terminal device interaction, a terminal device and a server, which can effectively reduce the transmission amount of shared data.

根据本发明的示例性实施例，提供一种实现终端设备交互的方法，包括：(A)在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容；(B)将确定出的共享内容发送到第二终端设备进行共享。According to an exemplary embodiment of the present invention, a method for realizing terminal device interaction is provided, including: (A) determining the shared content to be shared to the second terminal device among the contents currently provided by the first terminal device for the user; (B) ) to send the determined shared content to the second terminal device for sharing.

可选地，所述第一终端设备和/或第二终端设备为虚拟现实设备。Optionally, the first terminal device and/or the second terminal device is a virtual reality device.

可选地，根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作。Optionally, the shared content to be shared with the second terminal device is determined according to at least one of the following: the object of interest of the user corresponding to the first terminal device, the content corresponding to the shared area, the content corresponding to the specified event, the second terminal device The object of interest of the user corresponding to the device, the changed content including valid content, and the operation of the user of the second terminal device on the received shared content.

可选地，根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性；和/或，根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性；和/或，所述共享区域包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域；和/或，所述指定事件包括系统相关事件、内容相关事件中的至少一项；和/或，所述变化内容是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容，其中，在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。Optionally, the object of interest of the user corresponding to the first terminal device is determined according to at least one of the following items: user behavior corresponding to the first terminal device, association between objects in the content currently provided to the user relationship, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device; and/or, determine the user's object of interest corresponding to the second terminal device according to at least one of the following items: The user behavior corresponding to the second terminal device, the user attribute corresponding to the second terminal device; and/or, the shared area includes at least one of the following areas: the shared area set for the first terminal device, the shared area set for the second terminal device The sharing area set by the device, the area where the object of interest of the user corresponding to the first terminal device is located, and the area where the object of interest of the user corresponding to the second terminal device is located; and/or, the specified event includes a system-related event and a content-related event at least one of; and/or, the changed content is part of the content currently provided to the user that has changed compared to the shared content sent last time, wherein, when at least one of the following conditions is met, Determine that the changed content contains valid content: the ratio of the changed content to the content currently provided to users is not less than the first predetermined threshold; the changed content includes the content corresponding to the shared area; the changed content includes the content corresponding to the specified event Content: the change content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the change content includes an operable object.

可选地，当满足下述至少一项时，执行步骤(A)：第一终端设备的运动速度不大于第二预定阈值；当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。Optionally, step (A) is performed when at least one of the following is satisfied: the movement speed of the first terminal device is not greater than the second predetermined threshold; the content currently provided to the user includes the content corresponding to the shared area and the specified event corresponding to At least one of the content of the user, the object of interest of the user corresponding to the first terminal device, the object of interest of the user corresponding to the second terminal device, the operable object, and the changed content including valid content.

可选地，步骤(B)包括：按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。Optionally, step (B) includes: reconstructing the shared content according to a preset method, and sending the reconstructed content to the second terminal device for sharing.

可选地，所述预设方式包括以下项之中的至少一项：获取包括所述共享内容的最小区域内的内容；根据第二终端设备的设备属性调整所述共享内容；根据冗余区域对所述共享内容进行重构；根据当前的网络状况调整所述共享内容；基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；基于过滤条件对所述共享内容进行过滤；根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。Optionally, the preset method includes at least one of the following items: obtaining content in the smallest area including the shared content; adjusting the shared content according to the device attributes of the second terminal device; according to the redundant area Reconstructing the shared content; adjusting the shared content according to the current network conditions; correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device; based on filtering The shared content is filtered by the condition; and the shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.

可选地，所述方法还包括：从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径；根据接收到的所述位置信息和/或所述运动路径，指导第一终端设备的用户移动观看视角和/或自动切换第一终端设备的用户的观看视角。Optionally, the method further includes: receiving from the second terminal device: the location information of the target object selected by the user from the received shared content, and/or the position information of the target object from the current viewing angle of the first terminal device The movement path of the viewing angle: according to the received position information and/or the movement path, instruct the user of the first terminal device to move the viewing angle and/or automatically switch the viewing angle of the user of the first terminal device.

可选地，所述方法还包括：从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息；对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。Optionally, the method further includes: receiving, from the second terminal device, operation information that the user operates on the received shared content; and executing a function corresponding to the received operation information on the content currently provided to the user.

可选地，所述方法还包括：响应于用户对第一终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置；当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。Optionally, the method further includes: in response to the user's operation on the external operation device of the first terminal device, acquiring the location of the operation focus of the external operation device in the content currently provided to the user; When the above-mentioned external operation device is invalidly moved, the current operation focus is adjusted to the position of the operation focus before the movement.

可选地，所述方法还包括：在步骤(A)之前，获取第一终端设备当前为用户提供的内容。Optionally, the method further includes: before step (A), acquiring content currently provided by the first terminal device to the user.

可选地，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，获取第一终端设备当前为用户提供的内容的步骤包括：获取第一终端设备当前的全景视图；接收第一终端设备对应的当前观看视角信息；根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。Optionally, the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein the step of acquiring the content currently provided by the first terminal device to the user includes: acquiring the current Panoramic view: receiving current viewing angle information corresponding to the first terminal device; determining content currently displayed to the user by the first terminal device according to the current viewing angle information and the current panoramic view.

可选地，所述方法还包括：从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息；执行与接收到的操作信息对应的功能，以获取第一终端设备当前为用户提供的内容。Optionally, the method further includes: receiving from the first terminal device operation information that the user operates on the content currently provided to the user by the first terminal device; executing a function corresponding to the received operation information to obtain the first terminal device What the device is currently serving to the user.

根据本发明的另一示例性实施例，提供一种实现终端设备交互的装置，包括：共享内容确定单元，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容；共享单元，将确定出的共享内容发送到第二终端设备进行共享。According to another exemplary embodiment of the present invention, there is provided an apparatus for realizing terminal device interaction, including: a shared content determination unit, which determines the shared content to be shared to the second terminal device from the content currently provided by the first terminal device to the user Content: a sharing unit, configured to send the determined shared content to the second terminal device for sharing.

可选地，所述第一终端设备和/或第二终端设备为虚拟现实设备。Optionally, the first terminal device and/or the second terminal device is a virtual reality device.

可选地，共享内容确定单元根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作。Optionally, the shared content determining unit determines the shared content to be shared with the second terminal device according to at least one of the following: the user's object of interest corresponding to the first terminal device, the content corresponding to the sharing area, and the content corresponding to the specified event , the object of interest of the user corresponding to the second terminal device, the changed content including valid content, and the operation of the user of the second terminal device on the received shared content.

可选地，共享内容确定单元根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性；和/或，共享内容确定单元根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性；和/或，所述共享区域包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域；和/或，所述指定事件包括系统相关事件、内容相关事件中的至少一项；和/或，所述变化内容是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容，其中，共享内容确定单元在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。Optionally, the shared content determining unit determines the object of interest of the user corresponding to the first terminal device according to at least one of the following items: user behavior corresponding to the first terminal device, each object in the content currently provided to the user The association relationship between, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device; and/or, the shared content determination unit determines the second terminal according to at least one of the following items The object of interest of the user corresponding to the device: the user behavior corresponding to the second terminal device, the user attribute corresponding to the second terminal device; and/or, the shared area includes at least one of the following areas: set for the first terminal device The shared area of the user, the shared area set for the second terminal device, the area where the object of interest of the user corresponding to the first terminal device is located, the area where the object of interest of the user corresponding to the second terminal device is located; and/or, the specified event Including at least one of system-related events and content-related events; and/or, the changed content is part of the content currently provided to the user that has changed compared to the shared content sent last time, wherein the shared content determination unit is in When at least one of the following conditions is met, it is determined that the changed content contains valid content: the ratio of the changed content to the content currently provided to users is not less than the first predetermined threshold; The changed content includes the content corresponding to the specified event; the changed content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the changed content includes the operable object.

可选地，共享内容确定单元当确定满足下述至少一项时，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容：第一终端设备的运动速度不大于第二预定阈值；当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。Optionally, the shared content determining unit determines the shared content to be shared with the second terminal device from the content currently provided by the first terminal device to the user when at least one of the following is satisfied: the movement speed of the first terminal device is not greater than the second predetermined threshold; the content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the user's interested object corresponding to the first terminal device, the user's interested object corresponding to the second terminal device, and operable At least one of object, variable content containing valid content.

可选地，共享单元按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。Optionally, the sharing unit reconstructs the shared content according to a preset method, and sends the reconstructed content to the second terminal device for sharing.

可选地，所述预设方式包括以下项之中的至少一项：获取包括所述共享内容的最小区域内的内容；根据第二终端设备的设备属性调整所述共享内容；根据冗余区域对所述共享内容进行重构；根据当前的网络状况调整所述共享内容；基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；基于过滤条件对所述共享内容进行过滤；根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。Optionally, the preset method includes at least one of the following items: obtaining content in the smallest area including the shared content; adjusting the shared content according to the device attributes of the second terminal device; according to the redundant area Reconstructing the shared content; adjusting the shared content according to the current network conditions; correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device; based on filtering The shared content is filtered by the condition; and the shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.

可选地，所述装置还包括：接收单元，从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径；视角转换单元，根据接收到的所述位置信息和/或所述运动路径，指导第一终端设备的用户移动观看视角和/或自动切换第一终端设备的用户的观看视角。Optionally, the apparatus further includes: a receiving unit, configured to receive from the second terminal device: the position information of the target object selected by the user from the received shared content, and/or from the current viewing angle of the first terminal device to the target object The movement path of the viewing angle corresponding to the object; the angle conversion unit guides the user of the first terminal device to move the viewing angle and/or automatically switches the user of the first terminal device according to the received position information and/or the movement path viewing angle.

可选地，所述装置还包括：操作信息接收单元，从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息；执行单元，对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。Optionally, the apparatus further includes: an operation information receiving unit, which receives from the second terminal device operation information for the user to operate on the received shared content; an execution unit, which executes and receives the content currently provided to the user. The function corresponding to the operation information received.

可选地，所述装置还包括：焦点获取单元，响应于用户对第一终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置；焦点调整单元，当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。Optionally, the apparatus further includes: a focus acquisition unit, in response to the user's operation on the external operation device of the first terminal device, to obtain the position of the operation focus of the external operation device in the content currently provided to the user; The focus adjustment unit adjusts the current operation focus to the position of the operation focus before the movement when invalid movement of the external operation device is detected.

可选地，所述装置还包括：获取单元，在共享内容确定单元在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容之前，获取第一终端设备当前为用户提供的内容。Optionally, the apparatus further includes: an acquiring unit, before the shared content determining unit determines the shared content to be shared with the second terminal device among the content currently provided by the first terminal device to the user, acquires the current content of the first terminal device User Contributed Content.

可选地，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，获取单元包括：全景视图获取单元，获取第一终端设备当前的全景视图；视角信息接收单元，接收第一终端设备对应的当前观看视角信息；确定单元，根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。Optionally, the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein the acquisition unit includes: a panoramic view acquisition unit, which acquires the current panoramic view of the first terminal device; The unit is configured to receive the current viewing angle information corresponding to the first terminal device; the determining unit is configured to determine the content currently displayed to the user by the first terminal device according to the current viewing angle information and the current panoramic view.

可选地，所述装置还包括：操作信息接收单元，从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息；执行单元，执行与接收到的操作信息对应的功能，以获取第一终端设备当前为用户提供的内容。Optionally, the apparatus further includes: an operation information receiving unit, configured to receive from the first terminal device the operation information that the user operates on the content currently provided to the user by the first terminal device; an executing unit, configured to execute the operation corresponding to the received operation information function to obtain the content currently provided by the first terminal device to the user.

根据本发明的另一示例性实施例，提供一种终端设备，包括：共享内容确定单元，在所述终端设备当前为用户提供的内容中确定待共享给另一终端设备的共享内容；共享单元，将确定出的共享内容发送到所述另一终端设备进行共享。According to another exemplary embodiment of the present invention, a terminal device is provided, including: a shared content determination unit, which determines the shared content to be shared with another terminal device among the content currently provided by the terminal device to the user; the sharing unit , sending the determined shared content to the other terminal device for sharing.

可选地，所述终端设备和/或所述另一终端设备为虚拟现实设备。Optionally, the terminal device and/or the other terminal device is a virtual reality device.

可选地，共享内容确定单元根据下述中的至少一项确定待共享给所述另一终端设备的共享内容：所述终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、所述另一终端设备对应的用户感兴趣对象、包含有效内容的变化内容、所述另一终端设备的用户对接收到的共享内容的操作。Optionally, the shared content determining unit determines the shared content to be shared with the other terminal device according to at least one of the following: the user's object of interest corresponding to the terminal device, the content corresponding to the sharing area, the content corresponding to the designated event The content of the other terminal device, the object of interest of the user corresponding to the other terminal device, the changed content including valid content, and the operation of the user of the other terminal device on the received shared content.

可选地，共享内容确定单元根据以下项之中的至少一项来确定所述终端设备对应的用户感兴趣对象：所述终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、所述终端设备对应的用户属性；和/或，共享内容确定单元根据以下项之中的至少一项来确定所述另一终端设备对应的用户感兴趣对象：所述另一终端设备对应的用户行为、所述另一终端设备对应的用户属性；和/或，所述共享区域包括以下区域之中的至少一项：针对所述终端设备设置的共享区域、针对所述另一终端设备设置的共享区域、所述终端设备对应的用户感兴趣对象所在的区域、所述另一终端设备对应的用户感兴趣对象所在的区域；和/或，所述指定事件包括系统相关事件、内容相关事件中的至少一项；和/或，所述变化内容是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容，其中，共享内容确定单元在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或所述另一终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。Optionally, the shared content determining unit determines the user's interest object corresponding to the terminal device according to at least one of the following items: user behavior corresponding to the terminal device, each object in the content currently provided to the user The association relationship between the content, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the terminal device; and/or, the shared content determining unit determines the other according to at least one of the following items The object of user interest corresponding to a terminal device: the user behavior corresponding to the other terminal device, the user attribute corresponding to the other terminal device; and/or, the shared area includes at least one of the following areas: The sharing area set for the terminal device, the sharing area set for the other terminal device, the area where the object of interest of the user corresponding to the terminal device is located, the area where the object of interest of the user corresponding to the other terminal device is located area; and/or, the specified event includes at least one of a system-related event and a content-related event; and/or, the change content is that the content currently provided to the user has changed compared to the shared content sent last time partial content, wherein the shared content determination unit determines that the changed content contains effective content when at least one of the following conditions is met: the ratio of the changed content to the content currently provided to users is not less than the first predetermined Threshold; the change content includes content corresponding to the shared area; the change content includes content corresponding to a specified event; the change content includes the user's interest object corresponding to the first terminal device and/or the other terminal device; The above changes include operable objects.

可选地，共享内容确定单元当确定满足下述至少一项时，在所述终端设备当前为用户提供的内容中确定待共享给所述另一终端设备的共享内容：所述终端设备的运动速度不大于第二预定阈值；当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、所述终端设备对应的用户感兴趣对象、所述另一终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。Optionally, the shared content determining unit determines the shared content to be shared with the other terminal device among the content currently provided by the terminal device to the user when at least one of the following is satisfied: the movement of the terminal device The speed is not greater than the second predetermined threshold; the content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the user's interested object corresponding to the terminal device, and the user's interested object corresponding to the other terminal device. At least one of object, operable object, and variable content including valid content.

可选地，共享单元按照预设方式对所述共享内容进行重构，并将重构后的内容发送到所述另一终端设备进行共享。Optionally, the sharing unit reconstructs the shared content according to a preset method, and sends the reconstructed content to the other terminal device for sharing.

可选地，所述预设方式包括以下项之中的至少一项：获取包括所述共享内容的最小区域内的内容；根据所述另一终端设备的设备属性调整所述共享内容；根据冗余区域对所述共享内容进行重构；根据当前的网络状况调整所述共享内容；基于所述终端设备对应的用户属性和/或所述另一终端设备对应的用户属性对所述共享内容进行校正；基于过滤条件对所述共享内容进行过滤；根据所述终端设备和/或所述另一终端设备的用户针对共享内容的操作对共享内容进行优化。Optionally, the preset method includes at least one of the following items: obtaining content in the smallest area including the shared content; adjusting the shared content according to the device attribute of the other terminal device; The remaining area reconstructs the shared content; adjusts the shared content according to the current network condition; and performs the shared content based on the user attribute corresponding to the terminal device and/or the user attribute corresponding to the other terminal device Correcting; filtering the shared content based on a filtering condition; optimizing the shared content according to an operation of the user of the terminal device and/or the other terminal device on the shared content.

可选地，所述终端设备还包括：接收单元，从所述另一终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从所述终端设备的当前观看视角到目标对象对应的观看视角的运动路径；视角转换单元，根据接收到的所述位置信息和/或所述运动路径，指导所述终端设备的用户移动观看视角和/或自动切换所述终端设备的用户的观看视角。Optionally, the terminal device further includes: a receiving unit, configured to receive from the other terminal device: the location information of the target object selected by the user from the received shared content, and/or the currently viewed content from the terminal device From the angle of view to the movement path of the viewing angle corresponding to the target object; the angle of view conversion unit guides the user of the terminal device to move the viewing angle of view and/or automatically switch the terminal according to the received position information and/or the movement path The viewing angle of the user of the device.

可选地，所述终端设备还包括：操作信息接收单元，从所述另一终端设备接收用户针对接收到的共享内容进行操作的操作信息；执行单元，对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。Optionally, the terminal device further includes: an operation information receiving unit, configured to receive, from the other terminal device, operation information for the user to operate on the received shared content; an executing unit, for the content currently provided to the user, Execute the function corresponding to the received operation information.

可选地，所述终端设备还包括：焦点获取单元，响应于用户对所述终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置；焦点调整单元，当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。Optionally, the terminal device further includes: a focus acquisition unit, in response to the user's operation on the external operation device of the terminal device, acquiring the position of the operation focus of the external operation device in the content currently provided to the user ; The focus adjustment unit, when detecting invalid movement of the external operation device, adjusts the current operation focus to the position of the operation focus before the movement.

根据本发明的另一示例性实施例，提供一种终端设备，包括：共享内容接收单元，接收另一终端设备发送的共享内容，其中，所述共享内容为在所述另一终端设备当前为用户提供的内容中确定出的；显示单元，将接收到的共享内容进行显示。According to another exemplary embodiment of the present invention, a terminal device is provided, including: a shared content receiving unit, configured to receive shared content sent by another terminal device, wherein the shared content is currently Determined from the content provided by the user; the display unit displays the received shared content.

可选地，所述终端设备还包括：发送单元，用于向所述另一终端设备发送：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从所述另一终端设备的当前观看视角到目标对象对应的观看视角的运动路径。Optionally, the terminal device further includes: a sending unit, configured to send to the other terminal device: the location information of the target object selected by the user from the received shared content, and/or the The movement path from the current viewing angle of the device to the corresponding viewing angle of the target object.

可选地，所述终端设备还包括：操作接收单元，用于接收用户针对接收到的共享内容进行操作的操作信息；发送单元，用于将所述操作信息发送给所述另一终端设备。Optionally, the terminal device further includes: an operation receiving unit, configured to receive operation information that the user operates on the received shared content; and a sending unit, configured to send the operation information to the other terminal device.

根据本发明的另一示例性实施例，提供一种服务器，包括：获取单元，获取第一终端设备当前为用户提供的内容；共享内容确定单元，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容；共享单元，将确定出的共享内容发送到第二终端设备进行共享。According to another exemplary embodiment of the present invention, a server is provided, including: an obtaining unit, which obtains the content currently provided by the first terminal device for the user; Determine the shared content to be shared with the second terminal device; the sharing unit sends the determined shared content to the second terminal device for sharing.

可选地，所述第一终端设备和/或第二终端设备为虚拟现实设备。Optionally, the first terminal device and/or the second terminal device is a virtual reality device.

可选地，共享内容确定单元根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作。Optionally, the shared content determining unit determines the shared content to be shared with the second terminal device according to at least one of the following: the user's object of interest corresponding to the first terminal device, the content corresponding to the sharing area, and the content corresponding to the designated event , the object of interest of the user corresponding to the second terminal device, the changed content including valid content, and the operation of the user of the second terminal device on the received shared content.

可选地，共享内容确定单元根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性；和/或，共享内容确定单元根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性；和/或，所述共享区域包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域；和/或，所述指定事件包括系统相关事件、内容相关事件中的至少一项；和/或，所述变化内容是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容，其中，共享内容确定单元在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。Optionally, the shared content determining unit determines the object of interest of the user corresponding to the first terminal device according to at least one of the following items: user behavior corresponding to the first terminal device, each object in the content currently provided to the user The association relationship between, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device; and/or, the shared content determination unit determines the second terminal according to at least one of the following items The object of interest of the user corresponding to the device: the user behavior corresponding to the second terminal device, the user attribute corresponding to the second terminal device; and/or, the shared area includes at least one of the following areas: set for the first terminal device The shared area of the user, the shared area set for the second terminal device, the area where the object of interest of the user corresponding to the first terminal device is located, the area where the object of interest of the user corresponding to the second terminal device is located; and/or, the specified event Including at least one of system-related events and content-related events; and/or, the changed content is part of the content currently provided to the user that has changed compared to the shared content sent last time, wherein the shared content determination unit is in When at least one of the following conditions is met, it is determined that the changed content contains valid content: the ratio of the changed content to the content currently provided to users is not less than the first predetermined threshold; The changed content includes the content corresponding to the specified event; the changed content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the changed content includes the operable object.

可选地，共享内容确定单元当确定满足下述至少一项时，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容：第一终端设备的运动速度不大于第二预定阈值；当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。Optionally, the shared content determining unit determines the shared content to be shared with the second terminal device from the content currently provided by the first terminal device to the user when at least one of the following is satisfied: the movement speed of the first terminal device is not greater than the second predetermined threshold; the content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the user's interested object corresponding to the first terminal device, the user's interested object corresponding to the second terminal device, and operable At least one of object, variable content containing valid content.

可选地，共享单元按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。Optionally, the sharing unit reconstructs the shared content according to a preset method, and sends the reconstructed content to the second terminal device for sharing.

可选地，所述预设方式包括以下项之中的至少一项：获取包括所述共享内容的最小区域内的内容；根据第二终端设备的设备属性调整所述共享内容；根据冗余区域对所述共享内容进行重构；根据当前的网络状况调整所述共享内容；基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；基于过滤条件对所述共享内容进行过滤；根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。Optionally, the preset method includes at least one of the following items: obtaining content in the smallest area including the shared content; adjusting the shared content according to the device attributes of the second terminal device; according to the redundant area Reconstructing the shared content; adjusting the shared content according to the current network conditions; correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device; based on filtering The shared content is filtered by the condition; and the shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.

可选地，所述服务器还包括：接收单元，从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息；路径确定单元，根据接收到的所述位置信息确定第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径，并将所述运动路径发送到第一终端设备。Optionally, the server further includes: a receiving unit, configured to receive from the second terminal device: location information of the target object selected by the user from the received shared content; a path determining unit, configured to determine the second location information according to the received location information. A movement path from the current viewing angle of the terminal device to the viewing angle corresponding to the target object, and sending the movement path to the first terminal device.

可选地，所述服务器还包括：操作信息接收单元，从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息；执行单元，对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能，并将所述操作信息发送到第一终端设备。Optionally, the server further includes: an operation information receiving unit, which receives from the second terminal device the operation information that the user operates on the received shared content; an execution unit, which executes and receives the content currently provided to the user function corresponding to the received operation information, and send the operation information to the first terminal device.

可选地，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，获取单元包括：全景视图获取单元，获取第一终端设备当前的全景视图；视角信息接收单元，接收第一终端设备对应的当前观看视角信息；确定单元，根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。Optionally, the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein the acquisition unit includes: a panoramic view acquisition unit, which acquires the current panoramic view of the first terminal device; The unit is configured to receive the current viewing angle information corresponding to the first terminal device; the determining unit is configured to determine the content currently displayed to the user by the first terminal device according to the current viewing angle information and the current panoramic view.

可选地，所述服务器还包括：操作信息接收单元，从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息；执行单元，执行与接收到的操作信息对应的功能，以获取第一终端设备当前为用户提供的内容。Optionally, the server further includes: an operation information receiving unit, configured to receive from the first terminal device operation information for the user to operate on content currently provided to the user by the first terminal device; an execution unit, configured to execute the function to obtain the content currently provided by the first terminal device to the user.

在根据本发明示例性实施例的实现终端设备交互的方法和装置、终端设备及服务器中，仅将终端设备为用户提供的内容之中需要共享的部分内容发送到其他终端设备进行共享，从而减少冗余数据的传输，降低了设备间的数据传输量，节省了传输资源，提高了设备间沟通的实时性。此外，还可实现终端设备之间的操作共享。In the method and device for realizing terminal device interaction, the terminal device and the server according to the exemplary embodiments of the present invention, only part of the content that needs to be shared among the content provided by the terminal device to the user is sent to other terminal devices for sharing, thereby reducing The transmission of redundant data reduces the amount of data transmission between devices, saves transmission resources, and improves the real-time communication between devices. In addition, operation sharing between terminal devices can also be realized.

将在接下来的描述中部分阐述本发明总体构思另外的方面和/或优点，还有一部分通过描述将是清楚的，或者可以经过本发明总体构思的实施而得知。Additional aspects and/or advantages of the present general inventive concept will be partially set forth in the following description, and some will be clear from the description, or can be learned through practice of the present general inventive concept.

附图说明Description of drawings

通过下面结合示例性地示出实施例的附图进行的描述，本发明示例性实施例的上述和其他目的和特点将会变得更加清楚，其中：The above and other objects and features of exemplary embodiments of the present invention will become more apparent from the following descriptions in conjunction with the accompanying drawings exemplarily showing the embodiments, in which:

图1示出根据本发明示例性实施例的实现终端设备交互的方法的流程图；FIG. 1 shows a flowchart of a method for implementing terminal device interaction according to an exemplary embodiment of the present invention;

图2示出根据本发明示例性实施例的确定第一终端设备对应的用户感兴趣对象的示例；FIG. 2 shows an example of determining an object of interest to a user corresponding to a first terminal device according to an exemplary embodiment of the present invention;

图3示出根据本发明示例性实施例的确定第一终端设备对应的用户感兴趣对象的另一示例；FIG. 3 shows another example of determining an object of interest to a user corresponding to a first terminal device according to an exemplary embodiment of the present invention;

图4示出根据本发明示例性实施例的根据共享区域对应的内容确定共享内容的示例；FIG. 4 shows an example of determining shared content according to content corresponding to a shared area according to an exemplary embodiment of the present invention;

图5示出根据本发明示例性实施例的根据包含有效内容的变化内容确定共享内容的示例；Fig. 5 shows an example of determining shared content according to changing content including effective content according to an exemplary embodiment of the present invention;

图6示出根据本发明示例性实施例的根据运动速度确定是否共享内容的示例；FIG. 6 shows an example of determining whether to share content according to a motion speed according to an exemplary embodiment of the present invention;

图7示出根据本发明示例性实施例的对共享内容进行重构的示例；FIG. 7 shows an example of reconstructing shared content according to an exemplary embodiment of the present invention;

图8示出根据本发明示例性实施例的对共享内容进行重构的另一示例；FIG. 8 shows another example of reconstructing shared content according to an exemplary embodiment of the present invention;

图9示出根据本发明示例性实施例的对共享内容进行重构的另一示例；FIG. 9 shows another example of reconstructing shared content according to an exemplary embodiment of the present invention;

图10示出根据本发明示例性实施例的对共享内容进行重构的另一示例；FIG. 10 shows another example of reconstructing shared content according to an exemplary embodiment of the present invention;

图11示出根据本发明示例性实施例的对共享内容进行重构的示例；Fig. 11 shows an example of reconstructing shared content according to an exemplary embodiment of the present invention;

图12示出根据本发明的另一示例性实施例的实现终端设备交互的方法的流程图；Fig. 12 shows a flowchart of a method for implementing terminal device interaction according to another exemplary embodiment of the present invention;

图13-图15示出根据本发明示例性实施例的指导第一终端设备的用户移动观看视角的示例；13-15 show an example of instructing a user of a first terminal device to move a viewing angle according to an exemplary embodiment of the present invention;

图16示出根据本发明的另一示例性实施例的指导第一终端设备的用户移动观看视角的示例；FIG. 16 shows an example of instructing a user of a first terminal device to move a viewing angle according to another exemplary embodiment of the present invention;

图17示出根据本发明的另一示例性实施例的实现终端设备交互的方法的流程图；Fig. 17 shows a flowchart of a method for implementing terminal device interaction according to another exemplary embodiment of the present invention;

图18-图19示出根据本发明示例性实施例的不同的操作设备间的对应关系的示例；18-19 show examples of correspondence between different operating devices according to an exemplary embodiment of the present invention;

图20示出根据本发明示例性实施例的不同的操作设备间的操作参数匹配的示例；FIG. 20 shows an example of matching operation parameters between different operation devices according to an exemplary embodiment of the present invention;

图21示出根据本发明示例性实施例的共享手势操作的示例；FIG. 21 shows an example of sharing gesture operations according to an exemplary embodiment of the present invention;

图22示出根据本发明示例性实施例的自适应调整操作焦点的示例；FIG. 22 shows an example of adaptively adjusting the operating focus according to an exemplary embodiment of the present invention;

图23示出根据本发明的另一示例性实施例的实现终端设备交互的方法的流程图；Fig. 23 shows a flowchart of a method for implementing terminal device interaction according to another exemplary embodiment of the present invention;

图24示出根据本发明示例性实施例的实现终端设备交互的装置的框图；Fig. 24 shows a block diagram of an apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention;

图25示出根据本发明的另一示例性实施例的终端设备的框图；Figure 25 shows a block diagram of a terminal device according to another exemplary embodiment of the present invention;

图26示出根据本发明的另一示例性实施例的服务器的框图；Figure 26 shows a block diagram of a server according to another exemplary embodiment of the present invention;

图27示出根据本发明的另一示例性实施例的终端设备的框图。FIG. 27 shows a block diagram of a terminal device according to another exemplary embodiment of the present invention.

具体实施方式detailed description

现将详细参照本发明的实施例，所述实施例的示例在附图中示出，其中，相同的标号始终指的是相同的部件。以下将通过参照附图来说明所述实施例，以便解释本发明。Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like numerals refer to like parts throughout. The embodiments are described below in order to explain the present invention by referring to the figures.

图1示出根据本发明示例性实施例的实现终端设备交互的方法的流程图。所述方法可由终端设备来执行，也可由服务器来执行。所述方法可通过计算机程序来实现。例如，所述方法可通过安装在终端设备或服务器中的用于交互的应用来执行，或者通过终端设备或服务器的操作系统中实现的功能程序来执行。Fig. 1 shows a flowchart of a method for implementing terminal device interaction according to an exemplary embodiment of the present invention. The method can be executed by a terminal device or by a server. The method can be implemented by a computer program. For example, the method may be executed by an application for interaction installed in a terminal device or a server, or by a function program implemented in an operating system of a terminal device or a server.

在步骤S10，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容。In step S10, the shared content to be shared to the second terminal device is determined from the content currently provided by the first terminal device to the user.

作为示例，第一终端设备和/或第二终端设备可为虚拟现实设备。As an example, the first terminal device and/or the second terminal device may be a virtual reality device.

在步骤S20，将确定出的共享内容发送到第二终端设备进行共享。In step S20, the determined shared content is sent to the second terminal device for sharing.

作为示例，根据本发明示例性实施例的实现终端设备交互的方法还可包括：在步骤S10之前，建立第一终端设备和第二终端设备之间的连接以进行交互。发起连接请求的可以是第一终端设备，也可以是第二终端设备。连接请求的发起方可视具体情景而定：例如，第一终端设备的用户想要和第二终端设备的用户一起观看第一终端设备为用户提供的内容，则可通过第一终端设备请求与第二终端设备建立连接，当第二终端设备的用户通过第二终端设备接受连接请求后，即完成了连接建立的过程；例如，第二终端设备的用户想要通过第二终端设备观看第一终端设备为用户提供的内容，则可通过第二终端设备请求与第一终端设备建立连接，当第一终端设备接受连接请求后，即完成了连接建立的过程。As an example, the method for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: before step S10, establishing a connection between the first terminal device and the second terminal device for interaction. The one that initiates the connection request may be the first terminal device or the second terminal device. The originator of the connection request depends on the specific situation: for example, if the user of the first terminal device wants to watch the content provided by the first terminal device for the user together with the user of the second terminal device, he can request the connection with the user through the first terminal device. The second terminal device establishes a connection. When the user of the second terminal device accepts the connection request through the second terminal device, the process of establishing the connection is completed; for example, the user of the second terminal device wants to watch the first The content provided by the terminal device to the user may be requested by the second terminal device to establish a connection with the first terminal device, and the connection establishment process is completed when the first terminal device accepts the connection request.

作为示例，当第一终端设备是连接请求发起方时，第二终端设备接受第一终端设备的请求并建立连接后，可返回以下信息之中的至少一项到第一终端设备：第二终端设备的设备属性、第二终端设备的网络状况、第二终端设备对应的用户属性、第二终端设备对应的用户需求(例如，第二终端设备对应的用户感兴趣对象、针对第二终端设备设置的共享区域等)，以便与第一终端设备进行更好的交互。如果连接请求发起方是第二终端设备，则第二终端设备可在连接请求中将上述信息之中的至少一项发送到第一终端设备，也可当第一终端设备接受连接请求后，将上述信息之中的至少一项发送到第一终端设备。As an example, when the first terminal device is the initiator of the connection request, after the second terminal device accepts the request of the first terminal device and establishes the connection, it may return at least one of the following information to the first terminal device: the second terminal device The device attributes of the device, the network status of the second terminal device, the user attributes corresponding to the second terminal device, and the user requirements corresponding to the second terminal device (for example, the user's interest object corresponding to the second terminal device, the settings for the second terminal device sharing area, etc.), so as to perform better interaction with the first terminal device. If the initiator of the connection request is the second terminal device, the second terminal device may send at least one item of the above information to the first terminal device in the connection request, or send the At least one item of the above information is sent to the first terminal device.

在步骤S10，可通过各种适合的方式来在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容。In step S10, the shared content to be shared to the second terminal device may be determined from the content currently provided by the first terminal device to the user in various suitable ways.

应该理解，第一终端设备当前为用户提供的内容可以是当前向用户显示的内容，也可以是包括当前向用户显示的内容和由于用户的观看视角当前未能向用户显示的为用户提供的内容。例如，以第一终端设备为虚拟现实设备为例，第一终端设备当前为用户提供的内容可以是当前呈现在用户的虚拟视野内的内容，也可以是当前整个虚拟场景的内容，即当前的全景视图的内容。It should be understood that the content currently provided by the first terminal device to the user may be the content currently displayed to the user, or may include the content currently displayed to the user and the content currently not displayed to the user due to the viewing angle of the user. . For example, taking the first terminal device as a virtual reality device as an example, the content currently provided by the first terminal device to the user may be the content currently presented in the user's virtual field of view, or the content of the current entire virtual scene, that is, the current The content of the panorama view.

作为优选示例，可根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作。As a preferred example, the shared content to be shared with the second terminal device can be determined according to at least one of the following: the user's interested object corresponding to the first terminal device, the content corresponding to the shared area, the content corresponding to the specified event, the second The object of interest of the user corresponding to the terminal device, the changed content including valid content, and the operation of the user of the second terminal device on the received shared content.

以下将结合具体的示例性实施例进行详细说明：The following will be described in detail in conjunction with specific exemplary embodiments:

(A)根据第一终端设备对应的用户感兴趣对象确定共享内容(A) Determine the shared content according to the object of interest of the user corresponding to the first terminal device

作为示例，可根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、第一终端设备对应的用户属性、所述当前为用户提供的内容所对应的场景。As an example, the user's object of interest corresponding to the first terminal device may be determined according to at least one of the following items: user behavior corresponding to the first terminal device, the association between objects in the content currently provided to the user relationship, the user attribute corresponding to the first terminal device, and the scene corresponding to the content currently provided for the user.

(a1)根据第一终端设备对应的用户行为确定第一终端设备对应的用户感兴趣对象(a1) Determine the user's object of interest corresponding to the first terminal device according to the user behavior corresponding to the first terminal device

作为示例，可根据第一终端设备的用户在第一终端设备当前为用户提供的内容中所操作的对象来确定第一终端设备对应的用户感兴趣对象。例如，可直接将用户当前所操作的对象确定为用户感兴趣对象，还可将与当前所操作的对象相关联的对象一起确定为用户感兴趣对象。图2示出根据本发明示例性实施例的确定第一终端设备对应的用户感兴趣对象的示例。如图2所示，当前为用户提供的内容呈现的是桌球游戏场景，第一终端设备的用户当前所操作的对象是灰色球，因此，可将当前所操作的球确定为用户感兴趣对象，同时，也可将桌面上的其他球(编号为1、5、6、8的球)也确定为用户感兴趣对象。As an example, the object of interest to the user corresponding to the first terminal device may be determined according to the object operated by the user of the first terminal device in the content currently provided to the user by the first terminal device. For example, the object currently operated by the user may be directly determined as the object of interest to the user, and objects associated with the object currently operated may also be determined as the object of interest to the user. Fig. 2 shows an example of determining an object of interest to a user corresponding to a first terminal device according to an exemplary embodiment of the present invention. As shown in FIG. 2, the content currently provided to the user presents a billiard game scene, and the object currently operated by the user of the first terminal device is a gray ball. Therefore, the currently operated ball can be determined as the user's interested object. At the same time, other balls on the table (balls numbered 1, 5, 6, and 8) may also be determined as objects of interest to the user.

作为示例，可根据第一终端设备的用户对第一终端设备当前为用户提供的内容的操作来确定第一终端设备对应的用户感兴趣对象。图3示出根据本发明示例性实施例的确定第一终端设备对应的用户感兴趣对象的另一示例。如图3所示，在射击游戏中，大部分用户进行射击操作时，感兴趣的对象是作为射击目标的某个类型的对象。因此，可根据用户的射击操作，确定用户感兴趣对象是作为射击目标的该类对象。作为示例，可通过关于不同操作及其分别对应的用户感兴趣对象的预测模型，根据第一终端设备的用户当前的操作来预测用户感兴趣对象。这里，可基于当前用户或其他用户的各种历史操作所对应的感兴趣对象来训练得到预测模型或优化已有的预测模型。As an example, the user's interest object corresponding to the first terminal device may be determined according to the operation of the user of the first terminal device on the content currently provided to the user by the first terminal device. Fig. 3 shows another example of determining an object of interest to a user corresponding to a first terminal device according to an exemplary embodiment of the present invention. As shown in FIG. 3 , in a shooting game, when most users perform a shooting operation, the object of interest is a certain type of object as a shooting target. Therefore, according to the shooting operation of the user, it can be determined that the object of interest of the user is the object of this type as the shooting target. As an example, the object of interest of the user may be predicted according to the current operation of the user of the first terminal device through a prediction model about different operations and their corresponding object of interest to the user. Here, a prediction model can be trained or an existing prediction model can be optimized based on the objects of interest corresponding to various historical operations of the current user or other users.

作为示例，可根据第一终端设备的用户当前的动作来确定第一终端设备对应的用户感兴趣对象。作为示例，可将第一终端设备的用户当前的动作所对应的对象确定为用户感兴趣对象。例如，大部分用户如果眼睛注视某一对象超过3秒以上，则感兴趣的对象通常是该对象。因此，可根据用户的注视动作，确定用户感兴趣对象是当前所注视的对象。作为另一示例，可对第一终端设备的用户当前的动作(例如，手势等)进行语义分析，得到与该动作相匹配的对象作为用户感兴趣对象。例如，如果第一终端设备的用户做出写字动作，则可将当前为用户提供的内容中的笔、纸、书等对象确定为用户感兴趣对象；如果用户做出喝水动作，则可将当前为用户提供的内容中的水杯、饮料瓶等对象确定为用户感兴趣对象。As an example, the user's interested object corresponding to the first terminal device may be determined according to the current action of the user of the first terminal device. As an example, the object corresponding to the current action of the user of the first terminal device may be determined as the object of interest to the user. For example, if most users fixate on a certain object for more than 3 seconds, the object of interest is usually the object. Therefore, according to the gaze action of the user, it can be determined that the object of interest of the user is the object currently gazed at. As another example, semantic analysis may be performed on the current action (eg, gesture, etc.) of the user of the first terminal device, and an object matching the action may be obtained as an object of interest to the user. For example, if the user of the first terminal device makes a writing action, objects such as pens, paper, and books in the content currently provided to the user can be determined as objects of interest to the user; Objects such as water cups and beverage bottles in the content currently provided to the user are determined as objects of interest to the user.

此外，作为示例，还可根据第一终端设备的用户当前的动作和用户在第一终端设备当前为用户提供的内容中所操作的对象两者来确定更精确的用户感兴趣对象。例如，用户在第一终端设备当前为用户提供的内容中所操作的对象是手写笔，通过对用户当前的动作进行语义分析，如果确定用户当前的动作是模拟蘸墨的动作，则确定用户感兴趣对象是手写笔和墨水瓶；如果确定用户当前的动作是模拟书写的动作，则确定用户感兴趣对象是手写笔和书写纸。In addition, as an example, a more precise object of interest to the user may also be determined according to both the current action of the user of the first terminal device and the object the user operates in the content currently provided to the user by the first terminal device. For example, the object operated by the user in the content currently provided to the user by the first terminal device is a stylus. By performing semantic analysis on the user's current action, if it is determined that the user's current action is an action of simulating dipping ink, then determine the user's feeling. The object of interest is a stylus and an ink bottle; if it is determined that the user's current action is an action of simulating writing, then it is determined that the object of interest of the user is a stylus and writing paper.

作为示例，可根据第一终端设备的用户当前的语音来确定第一终端设备对应的用户感兴趣对象。具体说来，第一终端设备的用户在使用第一终端设备的过程中，通常会伴随着语言交流，而语言中时常包含着关于用户感兴趣的对象的信息。因此，可通过语言识别技术识别出第一终端设备的用户的语音中提及到的对象，并将该对象确定为用户感兴趣对象。例如：在桌球游戏中，第一终端设备的用户的语音中提及到了白球，则可将白色的球确定为用户感兴趣对象。例如，当前为用户提供的内容呈现的是游戏场景时，如果第一终端设备的用户通过远程连接向第二终端设备的用户发送语音“看看这些管道”，则可根据语音内容确定出“管道”为第一终端设备对应的用户感兴趣对象。As an example, the user's interested object corresponding to the first terminal device may be determined according to the current voice of the user of the first terminal device. Specifically, in the process of using the first terminal device, the user of the first terminal device usually communicates with language, and the language often contains information about objects that the user is interested in. Therefore, the object mentioned in the voice of the user of the first terminal device can be recognized through the language recognition technology, and the object can be determined as the object of interest to the user. For example: in a game of billiards, if the voice of the user of the first terminal device mentions a white ball, then the white ball may be determined as an object of interest to the user. For example, when the content currently provided to the user presents a game scene, if the user of the first terminal device sends the voice "Look at these pipes" to the user of the second terminal device through a remote connection, the "pipeline channel" can be determined according to the voice content. " is the object of interest of the user corresponding to the first terminal device.

作为示例，可根据第一终端设备的用户设置来确定第一终端设备对应的用户感兴趣对象。例如，第一终端设备的用户可预先设置感兴趣对象，如果检测到当前为用户提供的内容中包含预先设置的感兴趣对象，则可将检测到的对象确定为用户感兴趣对象。此外，用户也可实时指定当前为用户提供的内容之中的对象作为用户感兴趣对象。As an example, the user's interested object corresponding to the first terminal device may be determined according to user settings of the first terminal device. For example, the user of the first terminal device may preset an object of interest, and if it is detected that the content currently provided to the user contains the preset object of interest, the detected object may be determined as the object of interest of the user. In addition, the user may also specify in real time an object among the contents currently provided to the user as the object of interest to the user.

作为示例，可根据第一终端设备的用户的历史行为来确定第一终端设备对应的用户感兴趣对象。具体说来，用户的历史行为在一定意义上反映了用户过去某个时刻的需求，同时也是将来某个时刻的潜在需求，因此，可从当前为用户提供的内容中检测符合用户历史行为的对象作为用户感兴趣对象。作为示例，历史行为可以是眼睛注视行为、搜索行为、分享行为、浏览行为、编辑行为、点击行为等历史行为。As an example, the object of interest of the user corresponding to the first terminal device may be determined according to the historical behavior of the user of the first terminal device. Specifically, the user's historical behavior reflects the user's needs at a certain point in the past in a certain sense, and it is also the potential demand at a certain point in the future. Therefore, objects that match the user's historical behavior can be detected from the content currently provided to the user as the user's object of interest. As an example, the historical behavior may be historical behaviors such as eye gaze behavior, search behavior, sharing behavior, browsing behavior, editing behavior, and clicking behavior.

(a2)根据当前为用户提供的内容中各对象之间的关联关系确定第一终端设备对应的用户感兴趣对象(a2) Determine the user's interested object corresponding to the first terminal device according to the association relationship between the objects in the content currently provided to the user

由于场景中的对象往往不是独立的，与其他对象之间存在某种相互关联的关系，因此，可根据对象之间的关联关系，得到与用户感兴趣对象相关联的对象一起作为用户感兴趣对象。例如，可将与用户当前所操作的对象相关联的对象一起确定为用户感兴趣对象。Since the objects in the scene are often not independent, there is a certain interrelated relationship with other objects, therefore, according to the association relationship between objects, the objects associated with the user's interested object can be obtained as the user's interested object . For example, the objects associated with the object currently operated by the user may be determined together as the object of interest to the user.

作为示例，相关联的对象可以是与用户感兴趣对象属于同一类型的对象、相匹配的对象等。应该理解，可根据各种适合的方式来确定相关联的对象，例如，可根据场景中预先设置的关联关系来确定相关联的对象；或者可根据类别、颜色、形状等属性来确定是否属于同一类型的对象；或者可根据类别等属性、匹配关系等来确定是否是相匹配的对象。例如，在当前为用户提供的内容中被用户操作的对象是笔，则可将笔和与其相关联的对象(例如，本子、书、白板等)均确定为用户感兴趣对象。As an example, the associated object may be an object of the same type as the object of interest to the user, a matching object, and the like. It should be understood that the associated objects can be determined in various suitable ways, for example, the associated objects can be determined according to the preset association relationship in the scene; or whether they belong to the same object can be determined according to attributes such as category, color, and shape type of object; or it can be determined whether it is a matching object according to attributes such as category, matching relationship, etc. For example, if the object operated by the user in the content currently provided to the user is a pen, then both the pen and its associated objects (eg, notebook, book, whiteboard, etc.) may be determined as the user's interested object.

(a3)根据当前为用户提供的内容所对应的场景确定第一终端设备对应的用户感兴趣对象(a3) Determine the user's interest object corresponding to the first terminal device according to the scene corresponding to the content currently provided for the user

例如，在桌球游戏场景中，大部分用户感兴趣的对象都是桌球。因此，可根据当前为用户提供的内容所对应的桌球游戏场景确定用户感兴趣对象是桌球。For example, in a billiards game scene, most users are interested in billiards. Therefore, it may be determined that the object of interest of the user is billiards according to the billiard game scene corresponding to the content currently provided to the user.

作为示例，可通过关于不同场景及其分别对应的用户感兴趣对象的预测模型，根据当前为用户提供的内容所对应的场景来预测用户感兴趣对象。这里，可基于当前用户或其他用户在各种场景下所对应的感兴趣对象来训练得到预测模型或优化已有的预测模型。As an example, the object of interest to the user may be predicted according to the scene corresponding to the content currently provided to the user by using a prediction model about different scenes and their corresponding object of interest to the user. Here, the prediction model can be trained or the existing prediction model can be optimized based on the objects of interest corresponding to the current user or other users in various scenarios.

(a4)根据第一终端设备对应的用户属性确定第一终端设备对应的用户感兴趣对象(a4) Determine the user's object of interest corresponding to the first terminal device according to the user attribute corresponding to the first terminal device

作为示例，用户属性可包括以下项之中的至少一项：用户的学历、用户的身份、用户的收入状况、用户的兴趣、用户的习惯。As an example, the user attributes may include at least one of the following items: education background of the user, identity of the user, income status of the user, interest of the user, and habit of the user.

(B)根据共享区域对应的内容确定共享内容(B) Determine the shared content according to the content corresponding to the shared area

作为示例，所述共享区域可包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域。应该理解，所述共享区域可包括一个或多个区域。As an example, the sharing area may include at least one of the following areas: a sharing area set for the first terminal device, a sharing area set for the second terminal device, and an area where the object of interest of the user corresponding to the first terminal device is located. The area, the area where the object of interest of the user corresponding to the second terminal device is located. It should be understood that the shared area may include one or more areas.

(b1)关于针对第一终端设备设置的共享区域(b1) Regarding the shared area set for the first terminal device

第一终端设备的用户可预先设置固定位置和固定大小的共享区域，也可随着用户的指定而实时更新共享区域的位置和大小。用户可通过各种适合的操作来指定共享区域，例如，用户可使用眼睛注视、手势、点击、圈选等方式。例如，可统计用户在某个时间段内眼睛注视的位置点，得到位置点分布图，然后根据该分布图确定出用户所关注的区域，从而将该区域设置为共享区域。The user of the first terminal device can preset a shared area with a fixed position and a fixed size, and can also update the position and size of the shared area in real time as specified by the user. The user may designate the sharing area through various appropriate operations, for example, the user may use eye gaze, gesture, click, circle selection, and the like. For example, it is possible to count the position points of the user's eyes in a certain period of time to obtain a distribution map of the position points, and then determine the area that the user pays attention to according to the distribution map, so as to set the area as a shared area.

图4示出根据本发明示例性实施例的根据共享区域对应的内容确定共享内容的示例。如图4所示，当前为用户提供的内容包含个人银行卡和足球比赛，用户只想将关于足球比赛的内容共享给第二终端设备的用户，因此，第一终端设备的用户可通过手势操作指定共享区域(图4中的虚线方框所对应的区域)，从而仅将共享区域对应的内容共享给第二终端设备的用户。Fig. 4 shows an example of determining shared content according to content corresponding to a shared area according to an exemplary embodiment of the present invention. As shown in Figure 4, the content currently provided to the user includes personal bank cards and football matches. The user only wants to share the content about the football match with the user of the second terminal device. Therefore, the user of the first terminal device can use gestures to operate Designate a sharing area (the area corresponding to the dashed box in FIG. 4 ), so that only the content corresponding to the sharing area is shared with the user of the second terminal device.

(b2)关于第一终端设备对应的用户感兴趣对象所在的区域(b2) About the area where the object of interest of the user corresponding to the first terminal device is located

这里，共享区域可自适应调整，可随着用户感兴趣对象的大小和位置的变化而实时更新共享区域的位置和大小。例如，用户可先设置用户感兴趣对象(例如，可实时指定，也可预先设定)，然后将包含用户感兴趣对象的最小区域确定为当前的共享区域。Here, the shared area can be adaptively adjusted, and the position and size of the shared area can be updated in real time as the size and position of the object of interest to the user changes. For example, the user may first set the user's interested object (for example, it may be specified in real time or preset), and then determine the smallest area containing the user's interested object as the current shared area.

此外，用户还可先将动态的用户感兴趣对象在第一终端设备当前为用户提供的内容中可能出现的区域指定为共享区域，第一终端设备实时将该共享区域内的内容共享给第二终端设备。当检测到动态的用户感兴趣对象出现后，可根据第一终端设备和/或第二终端设备的用户的需求保持当前的共享区域不变，或者选择将该动态的用户感兴趣对象所在的区域作为共享区域，即，随着该用户感兴趣对象的变化而自适应的调整共享区域。In addition, the user can first designate the area where the dynamic object of user interest may appear in the content currently provided to the user by the first terminal device as the shared area, and the first terminal device will share the content in the shared area with the second terminal device in real time. Terminal Equipment. When a dynamic user interest object is detected, the current sharing area can be kept unchanged according to the needs of the users of the first terminal device and/or the second terminal device, or the area where the dynamic user interest object is located can be selected As a shared area, that is, the shared area is adaptively adjusted as the object of interest of the user changes.

(b3)关于针对第二终端设备设置的共享区域和第二终端设备对应的用户感兴趣对象所在的区域(b3) About the sharing area set for the second terminal device and the area where the object of interest of the user corresponding to the second terminal device is located

在设置共享区域时，不仅需要满足第一终端设备的用户的需求，也可根据第二终端设备的用户的需求，将第二终端设备的用户所需的共享区域作为共享区域，和/或第二终端设备对应的用户感兴趣对象所在的区域作为共享区域。When setting the shared area, it is not only necessary to meet the needs of the users of the first terminal device, but also to use the shared area required by the users of the second terminal device as the shared area according to the needs of the users of the second terminal device, and/or the second terminal device The area where the object of interest of the user corresponding to the second terminal device is located serves as the shared area.

(C)根据指定事件对应的内容确定共享内容(C) Determine the shared content according to the content corresponding to the specified event

在第一终端设备向第二终端设备分享内容的过程中，第一终端设备中时常伴随着一些事件的发生，对于一些指定事件的发生，需要提醒第二终端设备的用户。因此，可将指定事件对应的内容作为共享内容。In the process of sharing content from the first terminal device to the second terminal device, some events often occur in the first terminal device, and the user of the second terminal device needs to be reminded of the occurrence of some specified events. Therefore, the content corresponding to the specified event can be used as the shared content.

作为示例，指定事件可包括系统相关事件和/或内容相关事件。As examples, specified events may include system-related events and/or content-related events.

(c1)关于系统相关事件(c1) Regarding system-related events

作为示例，系统相关事件可包括以下项之中的至少一项：系统通知、错误提醒、定时提醒，低电量、网速异常、设备温度异常等系统弹窗事件。例如，当第一终端设备发出低电量警报时，可选择将该事件提示窗口发送给第二终端设备，以第一时间告知第二终端设备的用户第一终端设备处于低电量，内容的分享可能会被中断或者分享的内容的分辨率可能会降低。As an example, the system-related events may include at least one of the following items: system notifications, error reminders, timing reminders, system pop-up events such as low battery, abnormal network speed, and abnormal device temperature. For example, when the first terminal device sends out a low battery alarm, you can choose to send the event prompt window to the second terminal device to inform the user of the second terminal device that the first terminal device is in low battery and that content sharing is possible. Content that will be interrupted or shared may be reduced in resolution.

(c2)关于内容相关事件(c2) Regarding content-related events

作为示例，内容相关事件可包括当前为用户提供的内容中出现第一终端设备和/或第二终端设备对应的用户感兴趣对象。例如，当当前为用户提供的内容中出现了第一终端设备和/或第二终端设备对应的用户感兴趣对象时，可将该用户感兴趣对象或该用户感兴趣对象所在的区域的内容分享给第二终端设备。As an example, the content-related event may include that an object of interest to the user corresponding to the first terminal device and/or the second terminal device appears in the content currently provided to the user. For example, when an object of interest to the user corresponding to the first terminal device and/or the second terminal device appears in the content currently provided to the user, the content of the object of interest to the user or the area where the object of interest to the user is located can be shared to the second terminal device.

应该理解，指定事件可由第一终端设备的用户设置，也可由第二终端设备的用户设置。例如，第二终端设备的用户可请求当出现某一用户感兴趣对象时，将该用户感兴趣对象所在的区域的内容发送到第二终端设备进行共享。It should be understood that the designated event may be set by the user of the first terminal device, or may be set by the user of the second terminal device. For example, the user of the second terminal device may request that when a user's interested object appears, the content of the area where the user's interested object is located is sent to the second terminal device for sharing.

此外，当第二终端设备接收到指定事件对应的内容时，在显示接收到的内容的同时，还可以语音、震动等方式提示第二终端设备的用户。In addition, when the second terminal device receives the content corresponding to the specified event, it can also prompt the user of the second terminal device by means of voice, vibration, etc. while displaying the received content.

(D)根据第二终端设备对应的用户感兴趣对象确定共享内容(D) Determine the shared content according to the user's object of interest corresponding to the second terminal device

作为示例，可根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性。As an example, the user interest object corresponding to the second terminal device may be determined according to at least one of the following items: user behavior corresponding to the second terminal device, user attribute corresponding to the second terminal device.

(d1)根据第二终端设备对应的用户行为确定第二终端设备对应的用户感兴趣对象(d1) Determine the user's interest object corresponding to the second terminal device according to the user behavior corresponding to the second terminal device

作为示例，可根据第二终端设备的用户对第二终端设备显示的内容的操作、在显示的内容中所操作的对象、当前的动作、语音、设置的感兴趣对象、历史行为中的至少一项来确定第二终端设备对应的用户感兴趣对象。As an example, according to at least one of the operation of the user of the second terminal device on the content displayed on the second terminal device, the object operated in the displayed content, the current action, the voice, the set object of interest, and the historical behavior item to determine the user's object of interest corresponding to the second terminal device.

(d2)根据第二终端设备对应的用户属性确定第二终端设备对应的用户感兴趣对象(d2) Determine the object of interest of the user corresponding to the second terminal device according to the user attribute corresponding to the second terminal device

作为示例，用户属性可包括以下项之中的至少一项：用户的学历、用户的身份、用户的收入状况、用户的兴趣、用户的习惯。As an example, the user attributes may include at least one of the following items: education background of the user, identity of the user, income status of the user, interest of the user, and habit of the user.

(E)根据包含有效内容的变化内容确定共享内容(E) Determine the shared content according to the changed content containing valid content

作为示例，所述变化内容可以是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容。作为示例，可在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。As an example, the changed content may be part of the content currently provided to the user that has changed compared with the shared content sent last time. As an example, it may be determined that the changed content contains effective content when at least one of the following conditions is met: the ratio of the changed content to the content currently provided to the user is not less than a first predetermined threshold; the changed The content includes the content corresponding to the shared area; the changed content includes the content corresponding to the specified event; the changed content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the changed content includes the operable object .

作为示例，第一预定阈值可以是默认的固定值(例如，30％)，也可以是根据第一终端设备和/或第二终端设备的用户需求所设置的值。As an example, the first predetermined threshold may be a default fixed value (for example, 30%), or may be a value set according to user requirements of the first terminal device and/or the second terminal device.

图5示出根据本发明示例性实施例的根据包含有效内容的变化内容确定共享内容的示例。如图5所示，图5中的(a)示出上一次发送到第二终端设备的共享内容，以下称为画面一，当前为用户提供的内容(以下称为画面二)相对于画面一发生变化，如图5中的(b)所示。如果画面二相对于画面一发生变化的部分不包含有效内容，则可不共享当前为用户提供的内容，如图5中的(c)所示，第二终端设备仍继续显示上一次接收到共享内容；如果画面二相对于画面一发生变化的部分包含有效内容，则可将画面二相对于画面一发生变化的部分的内容确定为共享内容，第二终端设备可根据画面一和本次接收到的发生变化的部分的内容合成变化后的图像的内容(即，画面二)进行显示，如图5中的(d)所示。Fig. 5 shows an example of determining shared content according to changing content including effective content according to an exemplary embodiment of the present invention. As shown in Figure 5, (a) in Figure 5 shows the shared content sent to the second terminal device last time, hereinafter referred to asscreen 1, and the content currently provided to the user (hereinafter referred to as screen 2) is compared toscreen 1 changes, as shown in (b) in Figure 5. If the part of screen 2 that changes relative toscreen 1 does not contain valid content, the content currently provided to the user may not be shared, as shown in (c) in Figure 5, the second terminal device still continues to display the shared content received last time ; If the changed part of picture 2 relative to picture 1 contains valid content, then the content of the changed part of picture 2 relative to picture 1 can be determined as shared content, and the second terminal device can The content of the changed part is combined with the content of the changed image (that is, the second screen) for display, as shown in (d) in FIG. 5 .

(F)根据第二终端设备的用户对接收到的共享内容的操作确定共享内容(F) Determine the shared content according to the operation of the user of the second terminal device on the received shared content

作为示例，可根据第二终端设备的用户对接收到的共享内容的操作来确定第二终端设备对应的用户感兴趣对象和/或针对第二终端设备设置的共享区域，从而根据确定的第二终端设备对应的用户感兴趣对象和/或针对第二终端设备设置的共享区域来确定共享内容。As an example, the object of interest of the user corresponding to the second terminal device and/or the sharing area set for the second terminal device may be determined according to the operation of the user of the second terminal device on the received shared content, so that according to the determined second The user interest object corresponding to the terminal device and/or the sharing area set for the second terminal device determines the shared content.

此外，作为示例，根据本发明示例性实施例的实现终端设备交互的方法还可包括：当满足下述至少一项时，执行步骤S10：第一终端设备的运动速度不大于第二预定阈值；当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。In addition, as an example, the method for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: when at least one of the following is satisfied, performing step S10: the movement speed of the first terminal device is not greater than a second predetermined threshold; The content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the object of interest of the user corresponding to the first terminal device, the object of interest of the user corresponding to the second terminal device, operable object, and the content containing valid content. At least one of the changed content.

作为示例，可在以下条件之中的至少一项被满足时，确定不执行步骤S10：第一终端设备的运动速度超过第二预定阈值；第一终端设备的运动速度超过第三预定阈值且当前为用户提供的内容中不包含需要共享的内容。作为示例，需要共享的内容可包括以下项之中的至少一项：包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容。As an example, it may be determined not to perform step S10 when at least one of the following conditions is met: the moving speed of the first terminal device exceeds a second predetermined threshold; the moving speed of the first terminal device exceeds a third predetermined threshold and the current Content provided to users does not include content that needs to be shared. As an example, the content that needs to be shared may include at least one of the following items: content corresponding to the shared area, content corresponding to a specified event, user interest objects corresponding to the first terminal device, and user sense objects corresponding to the second terminal device. Objects of interest, operable objects, and variable content containing valid content.

应该理解，可通过各种适合的方式来获取第一终端设备的运动速度。例如，当第一终端设备是虚拟现实设备时，可通过第一终端设备内置的陀螺仪和加速度传感器来检测用户的头部运动，进而控制第一终端设备向用户呈现变化的内容。而通过陀螺仪和加速度传感器检测到的数据也反映了第一终端设备的运动状态，即转动角度的大小和转动速度的快慢。因此，可根据第一终端设备中的陀螺仪和加速度传感器的数据对第一终端设备进行运动分析，得出第一终端设备的运动状态(例如，运动速度等)，如果根据第一终端设备的运动状态(例如，运动速度超过第二预定阈值)获知第一终端设备的用户的头部转动较快，则可认为用户对转动过程中所呈现的内容不感兴趣，因此可确定不执行步骤S10。It should be understood that the moving speed of the first terminal device may be acquired in various suitable manners. For example, when the first terminal device is a virtual reality device, the built-in gyroscope and acceleration sensor of the first terminal device can detect the user's head movement, and then control the first terminal device to present changing content to the user. The data detected by the gyroscope and the acceleration sensor also reflect the motion state of the first terminal device, that is, the magnitude of the rotation angle and the speed of the rotation speed. Therefore, the motion analysis of the first terminal device can be performed according to the data of the gyroscope and the acceleration sensor in the first terminal device, and the motion state (for example, motion speed, etc.) of the first terminal device can be obtained. If the motion status (for example, the motion speed exceeds the second predetermined threshold) is known that the head of the user of the first terminal device rotates faster, it may be considered that the user is not interested in the content presented during the rotation, so it may be determined not to perform step S10.

图6示出根据本发明示例性实施例的根据运动速度确定是否共享内容的示例。如图6所示，当第一终端设备的用户转动头部时，可通过第一终端设备内置的陀螺仪和加速度传感器可检测第一终端设备的运动状态，当检测到当前的运动速度超过第二预定阈值时，可确定用户对当前为用户提供的内容不感兴趣，不共享当前为用户提供的内容，如图6中的(a)所示，第二终端设备仍显示上一次从第一终端设备接收到的共享内容，如果检测到运动速度不超过第二预定阈值，说明用户可能对当前为用户提供的内容感兴趣，则可执行步骤S10和步骤S20，将确定出的共享内容发送到第二终端设备进行共享，如图6中的(b)所示。FIG. 6 illustrates an example of determining whether to share content according to a motion speed according to an exemplary embodiment of the present invention. As shown in Figure 6, when the user of the first terminal device turns his head, the motion state of the first terminal device can be detected by the built-in gyroscope and acceleration sensor of the first terminal device. When the predetermined threshold is reached, it can be determined that the user is not interested in the content currently provided for the user, and does not share the content currently provided for the user. As shown in (a) in Figure 6, the second terminal device still displays the content from the first terminal last time. If the shared content received by the device detects that the motion speed does not exceed the second predetermined threshold, it means that the user may be interested in the content currently provided to the user, and then step S10 and step S20 can be executed to send the determined shared content to the second The two terminal devices share, as shown in (b) in FIG. 6 .

作为另一示例，除了根据第一终端设备的运动状态，还可结合当前为用户提供的内容来确定是否执行步骤S10。具体说来，可根据第一终端设备内置的陀螺仪和加速度传感器的数据对第一终端设备进行运动分析，得出第一终端设备的运动状态(例如，运动速度等)，如果根据第一终端设备的运动状态(例如，运动速度超过第三预定阈值)获知第一终端设备的用户的头部转动较快，则可进一步对当前的虚拟视野图像的内容进行分析，若分析得到第一终端设备的用户在较快地转动头部的过程中，第一终端设备为用户提供的内容不包含需要共享的内容，则可认为用户对转动过程中第一终端设备为用户提供的内容不感兴趣，因此可不执行步骤S10。As another example, in addition to the motion state of the first terminal device, it may also be determined whether to perform step S10 in combination with content currently provided to the user. Specifically, the motion analysis of the first terminal device can be performed according to the data of the built-in gyroscope and acceleration sensor of the first terminal device, and the motion state (for example, motion speed, etc.) of the first terminal device can be obtained. If the motion state of the device (for example, the motion speed exceeds the third predetermined threshold), it is known that the head of the user of the first terminal device is turning faster, then the content of the current virtual field of view image can be further analyzed. If the analysis shows that the first terminal device In the process of turning the head of the user quickly, if the content provided by the first terminal device for the user does not include the content to be shared, it can be considered that the user is not interested in the content provided by the first terminal device for the user during the rotation process, so Step S10 may not be executed.

应该理解，第二预定阈值和第三预定阈值可以相同，也可以不同。作为优选示例，第二预定阈值可大于第三预定阈值，第二预定阈值可为较大值，第三预定阈值可为较小值，即，只有当第一终端设备的用户非常快速地转动头部时，才确定不执行步骤S10；而如果第一终端设备的用户比较快速地转动头部，则可进一步根据当前为用户提供的内容来判断是否执行步骤S10。It should be understood that the second predetermined threshold and the third predetermined threshold may be the same or different. As a preferred example, the second predetermined threshold may be greater than the third predetermined threshold, the second predetermined threshold may be a large value, and the third predetermined threshold may be a small value, that is, only when the user of the first terminal device turns his head very quickly If the user of the first terminal device turns his head relatively quickly, it may be further determined whether to perform step S10 according to the content currently provided to the user.

作为优选示例，在步骤S20，可按照预设方式对共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。As a preferred example, in step S20, the shared content may be reconstructed according to a preset method, and the reconstructed content may be sent to the second terminal device for sharing.

作为示例，所述预设方式包括以下项之中的至少一项：获取包括所述共享内容的最小区域内的内容；根据第二终端设备的设备属性调整所述共享内容；根据冗余区域对所述共享内容进行重构；根据当前的网络状况调整所述共享内容；基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；基于过滤条件对所述共享内容进行过滤；根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。As an example, the preset method includes at least one of the following items: obtaining content in the smallest area including the shared content; adjusting the shared content according to the device attributes of the second terminal device; The shared content is reconstructed; the shared content is adjusted according to the current network conditions; the shared content is corrected based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device; based on the filtering conditions Filtering the shared content; optimizing the shared content according to operations of users of the first terminal device and/or the second terminal device on the shared content.

以下将结合具体的示例性实施例进行详细说明：The following will be described in detail in conjunction with specific exemplary embodiments:

(A)获取包括所述共享内容的最小区域内的内容(A) Obtain the content in the smallest area including the shared content

当共享内容是对象时，为了使第二终端设备的用户能够通过除对象外的背景等内容增强观看感受，可从当前为用户提供的内容中获取包括共享内容的最小区域内的内容。图7示出根据本发明示例性实施例的对共享内容进行重构的示例。如图7所示，如果确定出共享内容是第一终端设备对应的用户感兴趣对象“管道”，则可将包括“管道”的最小区域内的内容发送到第二终端设备进行共享。When the shared content is an object, in order to enable the user of the second terminal device to enhance viewing experience through content other than the background of the object, the content within the smallest area including the shared content may be obtained from the content currently provided to the user. Fig. 7 shows an example of reconstructing shared content according to an exemplary embodiment of the present invention. As shown in FIG. 7 , if it is determined that the shared content is the user's interested object "pipe" corresponding to the first terminal device, the content within the smallest area including "pipe" may be sent to the second terminal device for sharing.

(B)根据第二终端设备的设备属性调整所述共享内容(B) adjusting the shared content according to the device attributes of the second terminal device

作为示例，设备属性可包括以下项之中的至少一项：屏幕尺寸、能够显示的图像的类型(例如，2D、3D等)、屏幕的分辨率、内存、处理器。As an example, the device attributes may include at least one of the following items: screen size, type of image that can be displayed (eg, 2D, 3D, etc.), resolution of the screen, memory, processor.

作为示例，可根据第二终端设备的屏幕尺寸调整共享内容的大小，例如，可根据第二终端设备的屏幕尺寸将共享内容进行放大，以能够使得共享内容在第二终端设备的有限的屏幕内尽可能地放大显示；可根据第二终端设备的屏幕大小将共享内容进行缩小，以使共享内容能够全部显示在第二终端设备的有限的屏幕内，从而提升共享效果。As an example, the size of the shared content can be adjusted according to the screen size of the second terminal device, for example, the shared content can be enlarged according to the screen size of the second terminal device, so that the shared content can fit within the limited screen of the second terminal device The display is enlarged as much as possible; the shared content can be reduced according to the screen size of the second terminal device, so that all the shared content can be displayed on the limited screen of the second terminal device, thereby improving the sharing effect.

作为示例，如果第二终端设备只能够显示2D图像，则可将共享内容由3D内容形式转换为2D内容形式。As an example, if the second terminal device can only display 2D images, the shared content may be converted from a 3D content form to a 2D content form.

作为示例，如果第二终端设备的屏幕的分辨率较低，则可将共享内容的分辨率降低。As an example, if the resolution of the screen of the second terminal device is low, the resolution of the shared content may be reduced.

(C)根据冗余区域对所述共享内容进行重构(C) reconstructing the shared content according to the redundant area

应该理解，确定出的共享内容可能包含多个共享内容，因此，根据本发明的示例性实施例，可按照共享内容在为用户提供的内容中的位置关系，将共享内容紧凑地排列在一起，以将冗余的空白区域尽可能缩小。此外，也可根据第一终端设备和/或第二终端设备的用户需求，确定共享内容的排列位置。It should be understood that the determined shared content may include multiple shared contents. Therefore, according to an exemplary embodiment of the present invention, the shared contents may be compactly arranged according to the positional relationship of the shared contents in the content provided to the user. In order to reduce the redundant white space as much as possible. In addition, the arrangement position of the shared content may also be determined according to user requirements of the first terminal device and/or the second terminal device.

图8示出根据本发明示例性实施例的对共享内容进行重构的另一示例。如图8所示，如果确定出的共享内容是第一终端设备对应的用户感兴趣对象“应用图标”，则可按照“应用图标”在当前为用户提供的内容中彼此之间的位置关系，将“应用图标”放大后紧凑地排列在一起，尽可能较少冗余区域。Fig. 8 shows another example of reconstructing shared content according to an exemplary embodiment of the present invention. As shown in FIG. 8, if the determined shared content is the user's interested object "application icon" corresponding to the first terminal device, then the positional relationship between the "application icons" in the content currently provided to the user can be determined. The "app icons" are enlarged and arranged compactly together, with as few redundant areas as possible.

(D)根据当前的网络状况调整所述共享内容(D) Adjusting the shared content according to the current network conditions

作为示例，如果当前的网络状况较好，则可将共享内容的分辨率提高；如果当前的网络状况较差，则可将共享内容的分辨率降低。As an example, if the current network condition is good, the resolution of the shared content may be increased; if the current network condition is poor, the resolution of the shared content may be decreased.

(E)基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正(E) Correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device

对于第一终端设备的用户和第二终端设备的用户，其自身有某些特定的属性，这些属性反映了用户的特定需求，根据用户属性来重构共享内容，反映了用户的个性化需求，增加了用户体验感。作为示例，用户属性可包括以下项之中的至少一项：用户的学历、用户的身份、用户的收入状况、用户的兴趣、用户的习惯、用户的身体状况。For users of the first terminal device and the user of the second terminal device, they have certain specific attributes, which reflect the specific needs of the users, and reconstruct the shared content according to the user attributes, reflecting the personalized needs of the users. Increased user experience. As an example, the user attributes may include at least one of the following items: the user's educational background, the user's identity, the user's income status, the user's interest, the user's habits, and the user's physical condition.

作为示例，如果通过对第一终端设备的用户的眼睛属性的分析，确定用户属于色盲群体，则可根据用户的色盲属性自动对共享内容进行校正，如图9所示，根据第一终端设备的用户的语音可确定第一终端设备对应的用户感兴趣对象为“红色球”，但根据第一终端设备对应的用户属性，发现该用户属于红绿色盲群体，因此通过校正后将“绿色球”所在区域的内容发送到第二终端设备进行共享。As an example, if the analysis of the user's eye attributes of the first terminal device determines that the user belongs to a color-blind group, the shared content can be automatically corrected according to the user's color-blindness attributes, as shown in FIG. 9 , according to the first terminal device's The user's voice can determine that the user's object of interest corresponding to the first terminal device is "red ball", but according to the user attributes corresponding to the first terminal device, it is found that the user belongs to the group of red-green color blindness, so after correction, the "green ball" The content in the local area is sent to the second terminal device for sharing.

作为示例，如果通过对第一终端设备和/或第二终端设备的用户的惯用手属性的分析，确定用户习惯使用左手，则可根据用户的左手习惯属性自动对共享内容进行校正。As an example, if it is determined through the analysis of the handedness attribute of the user of the first terminal device and/or the second terminal device that the user is habitually left-handed, the shared content may be automatically corrected according to the user's left-handed attribute.

作为示例，还可根据第一终端设备和/或第二终端设备的用户的学历/身份/收入等状况对用户进行人物画像分析，获知用户的偏好，用来对共享内容进行校正，达到个性化的目的。As an example, according to the educational background/identity/income of the user of the first terminal device and/or the second terminal device, the profile analysis of the user can also be performed to learn the user's preference, which can be used to correct the shared content and achieve personalization the goal of.

(F)基于过滤条件对所述共享内容进行过滤(F) Filtering the shared content based on filtering conditions

作为示例，过滤条件可以是第一终端设备的用户预设的过滤条件和/或第二终端设备的用户预设的过滤条件，例如，第二终端设备的用户预设过滤掉系统弹出的事件窗口等，以免影响体验。As an example, the filter condition may be a filter condition preset by the user of the first terminal device and/or a filter condition preset by the user of the second terminal device, for example, the user preset of the second terminal device filters out the event window popped up by the system Wait, so as not to affect the experience.

作为示例，过滤条件可以是根据第一终端设备和/或第二终端设备的用户的历史行为所确定的过滤条件。用户的历史行为在一定意义上反映了用户的兴趣点，因此可通过对用户的历史行为的分析确定相应的过滤条件。例如，在绘画虚拟场景中，用户一直都使用毛笔创作水墨画，而很少使用铅笔进行素描，因此，可将共享内容中的铅笔自动过滤掉。As an example, the filter condition may be a filter condition determined according to historical behaviors of users of the first terminal device and/or the second terminal device. The user's historical behavior reflects the user's points of interest in a certain sense, so the corresponding filter conditions can be determined by analyzing the user's historical behavior. For example, in painting a virtual scene, users always use brushes to create ink paintings, but seldom use pencils for sketching. Therefore, the pencils in the shared content can be automatically filtered out.

作为示例，过滤条件可以是根据用户属性所确定的过滤条件。这里，用户属性可包括以下项之中的至少一项：第一终端设备对应的用户属性、第二终端设备对应的用户属性、为用户提供的内容中的角色的属性。例如，可过滤掉与用户属性不匹配的对象，例如，如果第一终端设备的用户是学生，则可将与学生相关的内容之外的内容均过滤掉。As an example, the filter condition may be a filter condition determined according to user attributes. Here, the user attribute may include at least one of the following items: a user attribute corresponding to the first terminal device, a user attribute corresponding to the second terminal device, and an attribute of a role in content provided to the user. For example, objects that do not match user attributes may be filtered out. For example, if the user of the first terminal device is a student, all content other than student-related content may be filtered out.

作为示例，过滤条件可以是根据第一终端设备的用户设置的共享设备的用户权限所确定的过滤条件。As an example, the filter condition may be a filter condition determined according to the user authority of the sharing device set by the user of the first terminal device.

对于不同的共享设备的用户或共享设备，可设置不同的用户权限以保护第一终端设备的用户的隐私内容不被泄露，或避免共享设备的用户对共享内容进行误操作而引起不必要的损失。例如，第一终端设备的用户当前正在进行游戏，此时如果第二终端设备的用户不小心将游戏关闭，则使的第一终端设备的用户无法回到正常游戏中。For different shared device users or shared devices, different user permissions can be set to protect the private content of the user of the first terminal device from being leaked, or to avoid unnecessary losses caused by the user of the shared device misoperating the shared content . For example, the user of the first terminal device is currently playing a game, and if the user of the second terminal device accidentally closes the game, the user of the first terminal device cannot return to the normal game.

作为示例，用户权限可包括以下项之中的至少一项：系统设置权限、用户隐私权限、应用程序范围权限。As an example, user permissions may include at least one of the following: system setting permissions, user privacy permissions, application scope permissions.

关于系统设置权限，涉及哪些系统设置可以共享，哪些系统设置不能共享。例如，可将对声音、亮度、震动反馈等系统参数的设定设置为不能共享，以避免由于第二终端设备的用户的错误操作而导致第一终端设备的用户受到不必要的影响。Regarding system setting permissions, which system settings can be shared and which system settings cannot be shared. For example, the settings of system parameters such as sound, brightness, and vibration feedback can be set as non-shareable, so as to avoid unnecessary influence on the user of the first terminal device due to wrong operations by the user of the second terminal device.

关于用户隐私权限，涉及哪些关于用户隐私的内容不能共享。例如，可将包含第一终端设备的用户的银行卡、个人账户、好友信息等的内容设置为不能共享，以保护第一终端设备的用户的个人隐私不被第二终端设备的用户随意查看。With regard to user privacy permissions, the content related to user privacy cannot be shared. For example, the content including the bank card, personal account, and friend information of the user of the first terminal device can be set as non-shareable, so as to protect the personal privacy of the user of the first terminal device from being freely viewed by the user of the second terminal device.

关于应用程序范围权限，涉及设置哪些应用程序的内容可以共享，哪些应用程序的内容不能共享，针对可以共享的应用程序，可进一步设置应用程序界面中的哪些内容可以共享，哪些内容不能共享。例如，第一终端设备的用户同时在聊天和看视频，对于聊天应用程序中的对话框，由于包含着与其他人的聊天记录，不想被第二终端设备的用户看到，因此，可将聊天应用程序的内容设置为不能共享。Regarding application-wide permissions, it involves setting which application content can be shared and which application content cannot be shared. For applications that can be shared, you can further set which content in the application interface can be shared and which content cannot be shared. For example, the user of the first terminal device is chatting and watching a video at the same time. For the dialog box in the chat application program, since it contains chat records with other people, it does not want to be seen by the user of the second terminal device. Therefore, the chat The content of the application is set not to be shared.

此外，还可设置具体的权限级别，例如，可设置为不可见(即，不能共享)、只读、可操作等不同的权限级别，第一终端设备的用户可灵活地设置权限以对共享内容进行保护。如图10所示，需要共享的内容包含个人银行卡信息和足球比赛视频界面，对于第二终端设备的用户A，其权限等级对银行卡是不可见的，因此将需要共享的内容中的银行卡信息过滤掉，仅将包含足球比赛视频界面的共享内容发送给用户A。而对于第二终端设备的用户B，其权限等级对银行卡是可见的，所以将包含个人银行卡信息和足球比赛视频界面的共享内容直接发送给用户B。In addition, specific permission levels can also be set, for example, it can be set to different permission levels such as invisible (that is, cannot be shared), read-only, and operable, and the user of the first terminal device can flexibly set permissions to control the shared content. for protection. As shown in Figure 10, the content to be shared includes personal bank card information and football game video interface. For user A of the second terminal device, its authority level is invisible to the bank card, so the bank card in the shared content will need to The card information is filtered out, and only the shared content including the football game video interface is sent to user A. As for user B of the second terminal device, its authority level is visible to the bank card, so the shared content including personal bank card information and football game video interface is directly sent to user B.

通过基于过滤条件对需要共享的内容进行过滤，既可以缩小共享内容的范围，较少共享数据的传输量，也可以保护第一终端设备的用户的隐私。By filtering the content to be shared based on the filter condition, the scope of shared content can be narrowed, the transmission amount of shared data can be reduced, and the privacy of the user of the first terminal device can also be protected.

(G)根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化(G) Optimizing the shared content according to the operation of the user of the first terminal device and/or the second terminal device on the shared content

第一终端设备和第二终端设备在共享内容的过程中，可能会对共享内容进行某些操作，例如，放大操作等，用户的这些操作，在一定程度上反映了用户的共享需求，例如，放大操作反映了对共享内容的质量需求。During the process of sharing content, the first terminal device and the second terminal device may perform certain operations on the shared content, for example, a zoom-in operation, etc. These user operations reflect the user's sharing needs to a certain extent, for example, Zooming in reflects the need for quality in shared content.

基于第一终端设备和/或第二终端设备的用户的这些操作，可对共享内容进行重构后再共享，例如，提高共享内容的质量(例如，提高共享内容的分辨率)。Based on these operations of the user of the first terminal device and/or the second terminal device, the shared content can be restructured before sharing, for example, the quality of the shared content can be improved (for example, the resolution of the shared content can be increased).

例如，第一终端设备的用户对共享内容执行了放大操作，则可将共享内容的更细粒度(高分辨率)的图像发送给第二终端设备进行共享。For example, if the user of the first terminal device performs a zoom-in operation on the shared content, a finer-grained (high-resolution) image of the shared content may be sent to the second terminal device for sharing.

作为示例，步骤S20可包括：将共享内容以高分辨率的形式、并将所述当前为用户提供的内容中除所述共享内容之外的内容以低分辨率的形式发送到第二终端设备。As an example, step S20 may include: sending the shared content to the second terminal device in a high-resolution form, and sending content other than the shared content in the content currently provided to the user to the second terminal device in a low-resolution form .

此外，作为示例，步骤S10还可包括：基于第二终端设备的屏幕尺寸确定所述当前为用户提供的内容之中不能在第二终端设备的屏幕中进行显示的部分；将所述不能进行显示的部分之中需要共享的内容和/或可操作对象叠加到所述当前为用户提供的内容之中能够在第二终端设备的屏幕中进行显示的部分，并将叠加后的内容作为待共享给第二终端设备的共享内容。In addition, as an example, step S10 may further include: determining, based on the screen size of the second terminal device, the portion of the content currently provided to the user that cannot be displayed on the screen of the second terminal device; Among the parts that need to be shared, the content and/or operable objects that need to be shared are superimposed on the part that can be displayed on the screen of the second terminal device among the content currently provided to the user, and the superimposed content is used as the content to be shared with Shared content of the second terminal device.

如图11所示，第二终端设备的屏幕较小，显示的内容有限，为了在有限的显示区域内尽可能多地显示共享内容，可根据第二终端设备的屏幕尺寸，确定共享内容。例如，图11中的(a)示出当前为用户提供的内容，图11中的(b)示出如果直接将当前为用户提供的内容直接发送到第二终端设备进行共享，第二终端设备能够显示的内容，根据本发明的示例性实施例，可将第二终端设备不能显示的部分中的第一终端设备对应的用户感兴趣对象提取出来，如图11中的(a)中的方框内的内容，并将提取出的感兴趣对象叠加到第二终端设备的屏幕中能够显示的部分，如图11中的(c)所示，从而第二终端设备的用户能够在有限的显示区域中获得更多的信息，此外，为了方便第二终端设备的用户准确认知后叠加的对象的实际位置，可将能够指示叠加的对象的实际位置的当前为用户提供的内容的缩略图也发送到第二终端设备一同显示。As shown in FIG. 11 , the screen of the second terminal device is small and the displayed content is limited. In order to display as much shared content as possible in the limited display area, the shared content can be determined according to the screen size of the second terminal device. For example, (a) in Figure 11 shows the content currently provided for the user, and (b) in Figure 11 shows that if the content currently provided for the user is directly sent to the second terminal device for sharing, the second terminal device For the content that can be displayed, according to an exemplary embodiment of the present invention, the object of interest of the user corresponding to the first terminal device in the part that the second terminal device cannot display can be extracted, as shown in the method in (a) in Figure 11 frame, and superimpose the extracted object of interest on the displayable part of the screen of the second terminal device, as shown in (c) in Figure 11, so that the user of the second terminal device can display In addition, in order to facilitate the user of the second terminal device to accurately recognize the actual location of the superimposed object, the thumbnail image of the content currently provided to the user that can indicate the actual location of the superimposed object can also be displayed. Send it to the second terminal device and display it together.

此外，作为示例，根据本发明示例性实施例的实现终端设备交互的方法还可包括：根据第二终端设备的用户对接收到的共享内容的操作来对所述共享内容进行优化，并将优化后的内容发送到第二终端设备。In addition, as an example, the method for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: optimizing the received shared content according to the operation of the user of the second terminal device on the received shared content, and optimizing the The final content is sent to the second terminal device.

第一终端设备和第二终端设备在内容共享的过程中，第二终端设备的用户可能会对接收到的共享内容进行某些操作，如放大操作等，第二终端设备的用户的这些操作，在一定程度上反映了第二终端设备的用户的共享需求，例如，放大操作反映了对共享内容的质量需求。基于第二终端设备的用户的这些操作，第一终端设备可对所述共享内容进行优化，并将优化后的内容发送到第二终端设备。During the content sharing process between the first terminal device and the second terminal device, the user of the second terminal device may perform certain operations on the received shared content, such as zooming in, etc. These operations of the user of the second terminal device, To a certain extent, it reflects the sharing requirement of the user of the second terminal device, for example, the zoom-in operation reflects the quality requirement for the shared content. Based on these operations of the user of the second terminal device, the first terminal device may optimize the shared content, and send the optimized content to the second terminal device.

例如，第一终端设备将共享内容发送给第二终端设备后，第二终端设备的用户对共享内容执行了放大操作，第二终端设备将指示用户的放大操作的信息发送给第一终端设备，第一终端设备就会将该共享内容或用户放大后查看的区域的更细粒度(高分辨率)的图像发送给第二终端设备的用户进行显示，从而满足第二终端设备的用户的需求。For example, after the first terminal device sends the shared content to the second terminal device, the user of the second terminal device performs a zoom-in operation on the shared content, and the second terminal device sends information indicating the user's zoom-in operation to the first terminal device, The first terminal device will send the shared content or the finer-grained (high-resolution) image of the area viewed by the user after zooming in to the user of the second terminal device for display, thereby meeting the needs of the user of the second terminal device.

图12示出根据本发明的另一示例性实施例的实现终端设备交互的方法的流程图。其中，步骤S10和步骤S20可参照根据图1描述的具体实施方式来实现，在此不再赘述。Fig. 12 shows a flowchart of a method for implementing terminal device interaction according to another exemplary embodiment of the present invention. Wherein, step S10 and step S20 can be implemented with reference to the specific implementation manner described in FIG. 1 , and will not be repeated here.

在步骤S30，从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径。In step S30, receiving from the second terminal device: location information of the target object selected by the user from the received shared content, and/or a movement path from the current viewing angle of the first terminal device to the corresponding viewing angle of the target object.

具体说来，第二终端设备的用户可选择观看之前已接收到的共享内容，不必观看当前实时共享的内容，即，第二终端设备的用户和第一终端设备的用户当前所观看的内容可以不同，换言之，观看全景视图的视角可以不同。作为示例，可预先将全景视图共享给第二终端设备，第二终端设备也可基于之前接收到的共享内容重构出全景视图，从而第二终端设备的用户可通过全景视图来观看之前已共享的内容。Specifically, the user of the second terminal device can choose to watch the shared content received before, without having to watch the content currently shared in real time, that is, the content currently watched by the user of the second terminal device and the user of the first terminal device can be different, in other words, viewing angles of the panoramic view may be different. As an example, the panoramic view can be shared with the second terminal device in advance, and the second terminal device can also reconstruct the panoramic view based on the previously received shared content, so that the user of the second terminal device can watch the previously shared content through the panoramic view. Content.

在步骤S40，根据接收到的所述位置信息和/或所述运动路径，指导第一终端设备的用户移动观看视角和/或自动切换第一终端设备的用户的观看视角。In step S40, according to the received position information and/or the movement path, guide the user of the first terminal device to move the viewing angle and/or automatically switch the viewing angle of the user of the first terminal device.

作为示例，当接收到的是目标对象的位置信息时，可根据接收到的目标对象的位置信息和用户当前的观看视角，计算从当前的观看视角到目标对象对应的观看视角(即，使目标对象出现在第一终端设备的用户的视野内时的观看视角)的运动路径，然后可根据计算出的运动路径指导用户移动观看视角和/或自动切换第一终端设备的用户的观看视角。As an example, when the position information of the target object is received, the viewing angle corresponding to the target object from the current viewing angle can be calculated according to the received position information of the target object and the user's current viewing angle (that is, the target The viewing angle when the object appears in the user's field of view of the first terminal device) and then guide the user to move the viewing angle and/or automatically switch the viewing angle of the user of the first terminal device according to the calculated motion path.

作为示例，可通过语音、显示移动路径、提示音等方式来指导用户移动观看视角。以提示音为例，如果第一终端设备的用户通过提示音慢慢接近目标对象，则提示音越来越大，间隔越短；如果用户在远离目标对象，则声音越来越小，间隔越长。As an example, the user may be guided to move the viewing angle by means of voice, displaying a moving path, prompting sound, and the like. Taking the prompt sound as an example, if the user of the first terminal device slowly approaches the target object through the prompt sound, the prompt sound will become louder and the interval will be shorter; long.

如图13所示，第二终端设备的用户可选择观看之前已接收到的共享内容，即，第二终端设备的用户和第一终端设备的用户当前所观看的内容不同；如图14所示，用户可从之前已接收到的共享内容中选择目标对象“电脑”，并将选择的目标对象的位置信息发送到第一终端设备，第一终端设备根据接收到的“电脑”的位置信息，指导用户移动观看视角以使“电脑”出现在第一终端设备的用户的视野内，如图15所示，并且应该理解，由于第一终端设备的用户的观看视角发生改变，第一终端设备当前为用户提供的内容可能也发生了改变，因此，可返回执行步骤S10和S20，从而第二终端设备的用户能够确定第一终端设备的用户是否已经移动到所选择的目标对象所在的位置。As shown in Figure 13, the user of the second terminal device can choose to watch the shared content received before, that is, the content currently watched by the user of the second terminal device and the user of the first terminal device is different; as shown in Figure 14 , the user can select the target object "computer" from the previously received shared content, and send the location information of the selected target object to the first terminal device, and the first terminal device, according to the received location information of "computer", Guide the user to move the viewing angle so that "computer" appears in the field of view of the user of the first terminal device, as shown in Figure 15, and it should be understood that due to the change of the viewing angle of the user of the first terminal device, the first terminal device currently The content provided to the user may also have changed, therefore, steps S10 and S20 may be performed back, so that the user of the second terminal device can determine whether the user of the first terminal device has moved to the location where the selected target object is located.

作为另一示例，可直接从第二终端设备接收：从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径。As another example, the second terminal device may directly receive: a movement path from the current viewing angle of the first terminal device to the viewing angle corresponding to the target object.

具体说来，第二终端设备的用户可从之前已接收到的共享内容中选择目标对象，并可基于第一终端设备的用户当前的观看视角(例如，可根据当前的共享内容确定)和选择的目标对象的位置信息计算出第一终端设备的用户从当前的观看视角到目标对象对应的观看视角的运动路径，并可将计算出的运动路径发送到第一终端设备，从而第一终端设备可根据接收到的运动路径指导其用户移动观看视角和/或自动切换其用户的观看视角。Specifically, the user of the second terminal device can select the target object from the previously received shared content, and based on the current viewing angle of the user of the first terminal device (for example, it can be determined according to the current shared content) and the selection The location information of the target object calculates the movement path of the user of the first terminal device from the current viewing angle to the viewing angle corresponding to the target object, and can send the calculated movement path to the first terminal device, so that the first terminal device It can guide its user to move the viewing angle of view and/or automatically switch its user's viewing angle of view according to the received motion path.

图16中的(a)示出当前的共享内容，图16中的(b)示出第二终端设备当前显示全景视图，并可在显示的全景视图上同步显示第一终端设备的用户当前的观看视角，第二终端设备根据其用户在全景视图中选择的目标对象的位置信息和第一终端设备的用户当前的观看视角，计算出第一终端设备的用户从当前的观看视角到目标对象对应的观看视角的运动路径，并将计算出的运动路径发送到第一终端设备，第一终端设备根据接收到的运动路径指导其用户移动观看视角或自动切换其用户的观看视角，并且应该理解，由于第一终端设备的用户的观看视角发生改变，第一终端设备当前为用户提供的内容可能也发生了改变，因此，第一终端设备可返回执行步骤S10和S20，从而第二终端设备的用户能够确定第一终端设备的用户是否已经移动到目标对象所在的位置，如图16中的(c)所示。(a) in FIG. 16 shows the current shared content, and (b) in FIG. 16 shows that the second terminal device is currently displaying a panoramic view, and can simultaneously display the current content of the user of the first terminal device on the displayed panoramic view. Viewing angle, the second terminal device calculates the correspondence between the user of the first terminal device from the current viewing angle to the target object according to the position information of the target object selected by the user in the panoramic view and the current viewing angle of the user of the first terminal device. The movement path of the viewing angle of view, and the calculated movement path is sent to the first terminal device, and the first terminal device guides its user to move the viewing angle of view or automatically switches the viewing angle of its user according to the received movement path, and it should be understood that, Since the viewing angle of the user of the first terminal device changes, the content currently provided to the user by the first terminal device may also change. Therefore, the first terminal device may return to perform steps S10 and S20, so that the user of the second terminal device It can be determined whether the user of the first terminal device has moved to the location where the target object is located, as shown in (c) in FIG. 16 .

图17示出根据本发明的另一示例性实施例的实现终端设备交互的方法的流程图。其中，步骤S10和步骤S20可参照根据图1描述的具体实施方式来实现，在此不再赘述。Fig. 17 shows a flowchart of a method for implementing terminal device interaction according to another exemplary embodiment of the present invention. Wherein, step S10 and step S20 can be implemented with reference to the specific implementation manner described in FIG. 1 , and will not be repeated here.

第一终端设备的用户在使用第一终端设备时，可能对某些操纵不熟悉，想要通过与第二终端设备的内容共享，得到第二终端设备的用户的操作指导。第二终端设备接收到共享内容后，第二终端设备的用户可能会进行一系列的指导操作。可选择地，根据本发明的另一示例性实施例的实现终端设备交互的方法可包括步骤S30和步骤S40，提示第一终端设备的用户如何从当前的观看视角移动到第二终端设备的用户所操作的对象的位置处，使第一终端设备的用户找到第二终端设备的用户所操作的对象。此外，也可不执行步骤S30和步骤S40，例如，第二终端设备的用户所操作的对象就在第一终端设备的用户当前的观看视角内。The user of the first terminal device may not be familiar with certain operations when using the first terminal device, and wants to obtain operation guidance from the user of the second terminal device through content sharing with the second terminal device. After the second terminal device receives the shared content, the user of the second terminal device may perform a series of guiding operations. Optionally, the method for implementing terminal device interaction according to another exemplary embodiment of the present invention may include step S30 and step S40, prompting the user of the first terminal device how to move from the current viewing angle to the user of the second terminal device At the position of the operated object, the user of the first terminal device is enabled to find the object operated by the user of the second terminal device. In addition, steps S30 and S40 may not be executed, for example, the object operated by the user of the second terminal device is within the current viewing angle of view of the user of the first terminal device.

在步骤S50，从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息。In step S50, the operation information of the user operating on the received shared content is received from the second terminal device.

作为示例，第二终端设备的用户针对接收到的共享内容进行操作的操作信息可包括以下项之中的至少一项：操作设备的属性信息和操作参数；关于手势操作的操作信息；关于语音操作的操作信息。例如，操作设备可以是外连的手柄、键盘、鼠标等操作设备，也可以是第二终端设备本身的触摸屏幕、按键等。例如，操作参数可以是点击、滑动、长按等具体的操作参数。As an example, the operation information that the user of the second terminal device operates on the received shared content may include at least one of the following items: attribute information and operation parameters of the operation device; operation information about gesture operations; operation information. For example, the operating device may be an external handle, keyboard, mouse, or other operating device, or may be a touch screen, buttons, etc. of the second terminal device itself. For example, the operation parameter may be specific operation parameters such as click, slide, and long press.

在步骤S60，对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。In step S60, the function corresponding to the received operation information is executed on the content currently provided to the user.

作为示例，可首先根据接收到的操作信息确定用于对当前为用户提供的内容进行相同的操作的对应的操作信息，然后执行与确定的操作信息对应的功能。从而实现第一终端设备与第二终端设备之间的操作共享，第二终端设备的用户对共享内容的操作能够反映到第一终端设备为用户提供的内容中。As an example, the corresponding operation information for performing the same operation on the content currently provided to the user may be firstly determined according to the received operation information, and then the function corresponding to the determined operation information is executed. Thus, the operation sharing between the first terminal device and the second terminal device is realized, and the operation of the user of the second terminal device on the shared content can be reflected in the content provided for the user by the first terminal device.

第一终端设备与第二终端设备针对同一对象，实现相同处理所对应的操作可能不同。例如，第一终端设备的用户通过手柄操作，可以达到将观看视角向右移动的处理结果，而第二终端设备的用户则需要在屏幕上向右滑动才能实现向右移动观看视角的处理结果。因此，实际中第二终端设备的用户在指导第一终端设备的用户操作共享内容时，需要对第二终端设备的用户的当前操作进行匹配，匹配到第一终端设备的操作设备上，并可在第一终端设备上实时显示匹配后的操作，以指导第一终端设备的用户可以按照该操作达到上述操作效果。For the same object, the first terminal device and the second terminal device may perform different operations corresponding to the same processing. For example, the user of the first terminal device can achieve the processing result of moving the viewing angle to the right through the operation of the handle, while the user of the second terminal device needs to slide to the right on the screen to realize the processing result of moving the viewing angle to the right. Therefore, in practice, when the user of the second terminal device instructs the user of the first terminal device to operate the shared content, it needs to match the current operation of the user of the second terminal device to the operating device of the first terminal device, and can The matched operation is displayed on the first terminal device in real time, so as to guide the user of the first terminal device to follow the operation to achieve the above operation effect.

作为示例，当操作信息包括第二终端设备的操作设备的属性信息和操作参数时，可先根据第二终端设备的操作设备的属性信息确定第二终端设备的操作设备是否和第一终端设备的操作设备一致或匹配，如果一致或匹配，则可将操作参数直接作用在第一终端设备上，否则，需要将操作参数转换为用于对第一终端设备当前为用户提供的内容进行相同的操作的对应的操作参数，并将转换后的操作参数作用在第一终端设备上，应该理解，由于第一终端设备执行与转换后的操作信息对应的功能，当前为用户提供的内容也发生了改变，因此，可返回执行步骤S10和S20，将操作产生的效果实时反馈给第二终端设备的用户，从而达到操作的实时共享。此外，还可在第一终端设备中实时显示匹配后的操作参数。As an example, when the operation information includes the attribute information and operation parameters of the operating device of the second terminal device, it may first be determined according to the attribute information of the operating device of the second terminal device whether the operating device of the second terminal device is consistent with the operating device of the first terminal device. The operating devices are consistent or matching, if they are consistent or matching, the operating parameters can be directly applied to the first terminal device, otherwise, the operating parameters need to be converted to perform the same operation on the content currently provided by the first terminal device to the user It should be understood that since the first terminal device performs the function corresponding to the converted operation information, the content currently provided to the user has also changed , therefore, steps S10 and S20 can be performed back, and the effect of the operation is fed back to the user of the second terminal device in real time, so as to achieve real-time sharing of the operation. In addition, the matched operating parameters can also be displayed in real time in the first terminal device.

如图18所示，第一终端设备可预先存储不同手柄间的操作参数的对应关系，如图19所示，第二终端设备连接的手柄与第一终端设备连接的手柄是不同的，通过设备的属性信息的匹配，第二终端设备所连接的手柄的“○”键与第一终端设备所连接的手柄“A”键具有相同功能。因此当第二终端设备的用户操作所连接的手柄的“○”键时，第一终端设备自动匹配到所连接的手柄中的“A”键，并根据“A”键的功能对第一终端设备当前为用户提供的内容进行相应的处理。此外，还可在第一终端设备中显示出匹配后的手柄操作，如图20所示。As shown in Figure 18, the first terminal device can pre-store the corresponding relationship of operating parameters between different handles. As shown in Figure 19, the handle connected to the second terminal device is different from the handle connected to the first terminal device. Matching the attribute information, the "○" key of the handle connected to the second terminal device has the same function as the "A" key of the handle connected to the first terminal device. Therefore, when the user of the second terminal device operates the "○" key of the connected handle, the first terminal device automatically matches the "A" key in the connected handle, and according to the function of the "A" key, the first terminal The device currently processes the content provided by the user accordingly. In addition, the matched handle operation may also be displayed in the first terminal device, as shown in FIG. 20 .

第二终端设备的用户指导第一终端设备的用户进行操作时，如果该操作为手势操作，如图21所示，第二终端设备的用户可先选定操作对象，然后第二终端设备的图像采集装置(例如，前置摄像头等)采集第二终端设备的用户的手势，第二终端设备将操作对象的信息以及采集到的手势操作发送给第一终端设备，第一终端设备根据接收到的操作信息，对该操作对象进行相应处理，应该理解，由于第一终端设备对该操作对象进行了相应处理，第一终端设备当前为用户提供的内容也发生了改变，因此，可返回执行步骤S10和S20，将操作产生的效果实时反馈给第二终端设备的用户，此外，还可向第一终端设备的用户显示第二终端设备的用户的手势操作，以便第一终端设备的用户能够了解具体的操作方式。When the user of the second terminal device instructs the user of the first terminal device to perform an operation, if the operation is a gesture operation, as shown in Figure 21, the user of the second terminal device can first select the operation object, and then the image of the second terminal device The collection device (for example, a front camera, etc.) collects gestures of the user of the second terminal device, and the second terminal device sends the information of the operation object and the collected gesture operations to the first terminal device, and the first terminal device according to the received It should be understood that because the first terminal device has processed the operation object accordingly, the content currently provided by the first terminal device for the user has also changed, so it can return to step S10 and S20, feedback the effect of the operation to the user of the second terminal device in real time, and also display the gesture operation of the user of the second terminal device to the user of the first terminal device, so that the user of the first terminal device can understand the specific mode of operation.

作为示例，在实际场景中，第二终端设备的用户对选定的操作对象进行操作时，第二终端设备可根据操作对象可以接受的操作类型对冗余操作进行过滤。在第二终端设备的用户做手势的过程中，由于手势的连续性，操作过程中往往会带有一些冗余的手势操作，也可能通过动作和行为识别为一些其他动作和行为操作。例如，在桌球游戏中，完成一个击球动作时，通过摄像头可以捕捉到的动作有击球动作、弯腰俯身动作、瞄准动作等，但对于操作对象“桌球”来说，根据其操作属性可知，它仅接受击球动作，因此可把弯腰俯身，瞄准等冗余操作过滤掉。As an example, in an actual scenario, when the user of the second terminal device operates the selected operation object, the second terminal device may filter the redundant operations according to the operation types acceptable to the operation object. When the user of the second terminal device makes a gesture, due to the continuity of the gesture, there are often some redundant gesture operations in the operation process, and may also be recognized as some other actions and behavior operations through actions and behaviors. For example, in a billiards game, when a ball hitting action is completed, the actions that can be captured by the camera include hitting the ball, bending over and leaning over, aiming, etc. It can be seen that it only accepts the hitting action, so it can filter out redundant operations such as bending over, aiming and so on.

此外，图1、图12和图17所示的根据本发明示例性实施例的实现终端设备交互的方法还可包括：响应于用户对第一终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置；当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。In addition, the method for implementing terminal device interaction according to exemplary embodiments of the present invention shown in FIG. 1 , FIG. 12 and FIG. 17 may further include: obtaining the current The position of the operation focus of the external operation device in the content provided to the user; when invalid movement of the external operation device is detected, the current operation focus is adjusted to the position of the operation focus before the movement.

作为示例，所述无效移动可以是第一终端设备的用户和第二终端设备的用户传递外接操作设备所导致的外接操作设备的移动。As an example, the invalid movement may be the movement of the external operation device caused by the transfer of the external operation device by the user of the first terminal device and the user of the second terminal device.

例如，当第一终端设备的用户和第二终端设备的用户近距离共享时，为了知道第二终端设备的用户如何通过外接操作设备(例如，手柄等)操作第一终端设备当前为用户提供的内容，第一终端设备的用户可能会在指导过程中将外接操作设备传递给第二终端设备的用户，由第二终端设备的用户来操作该外接操作设备，第一终端设备实时显示操作结果，并可显示第二终端设备的用户对外接操作设备的具体操作信息。For example, when the user of the first terminal device and the user of the second terminal device share a short distance, in order to know how the user of the second terminal device operates the first terminal device through an external operation device (such as a handle, etc.), the currently provided user Content, the user of the first terminal device may pass the external operation device to the user of the second terminal device during the guidance process, and the user of the second terminal device operates the external operation device, and the first terminal device displays the operation result in real time, And it can display the specific operation information of the user of the second terminal device on the external operation device.

然而在外接操作设备的传递(即，无效移动)过程中，外接操作设备的操作焦点可能会发生移动，因此，可当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。However, during the transfer (that is, invalid movement) of the external operation device, the operation focus of the external operation device may move. Therefore, when an invalid movement of the external operation device is detected, the current operation focus can be adjusted to The position of the operation focus before moving.

例如，第一终端设备的用户和第二终端设备的用户在传递外接操作设备时，第一终端设备的用户在传递前可先按下外接操作设备上的某个设定按键，第一终端设备接收到该按键信号时，可记录当前的操作焦点所在的位置，当完成传递后，第二终端设备的用户可以再次按下上述设定按键，第一终端设备获知传递结束(即，外接操作设备发生无效移动)，则将外接操作设备当前的操作焦点调整到所记录的位置处(即，传递前的操作焦点所在的位置处)。For example, when the user of the first terminal device and the user of the second terminal device transfer the external operation device, the user of the first terminal device can press a certain setting button on the external operation device before transferring, and the first terminal device When the button signal is received, the position of the current operating focus can be recorded. After the transfer is completed, the user of the second terminal device can press the above-mentioned setting button again, and the first terminal device will know that the transfer is completed (that is, the external operation device Invalid movement occurs), adjust the current operation focus of the external operation device to the recorded position (that is, the position of the operation focus before the transfer).

如图22所示，在桌球游戏中，外接操作设备的操作焦点指向了“白色球”，但是由于外接操作设备的传递过程中改变了外接操作设备上陀螺仪和加速度计等传感器数据，使外接操作设备在传递后操作焦点指向了“1号球”。此时，如果外接操作设备的操作焦点不进行调整，第二终端设备的用户直接进行操作，则将会产生误操作。因此，可以根据外接操作设备传递前的操作焦点的位置对传递后的操作焦点的位置进行自适应调整，使其与传递前的位置保持一致。As shown in Figure 22, in the game of billiards, the operating focus of the external operating device points to the "white ball", but because the data of sensors such as the gyroscope and accelerometer on the external operating device are changed during the transfer process of the external operating device, the external operating device After the transfer, the operating device focuses on the "No. 1 ball". At this time, if the operation focus of the external operation device is not adjusted and the user of the second terminal device directly operates, misoperation will occur. Therefore, the position of the operating focus after the transfer can be adaptively adjusted according to the position of the operating focus of the external operation device before the transfer, so as to keep it consistent with the position before the transfer.

图23示出根据本发明的另一示例性实施例的实现终端设备交互的方法的流程图。所述方法可由服务器来执行，也可通过计算机程序来实现。例如，所述方法可通过安装在服务器中的用于交互的应用来执行，或者通过服务器的操作系统中实现的功能程序来执行。其中，步骤S10和步骤S20可参照根据图1描述的具体实施方式来实现，在此不再赘述。Fig. 23 shows a flowchart of a method for implementing terminal device interaction according to another exemplary embodiment of the present invention. The method can be executed by a server, and can also be realized by a computer program. For example, the method may be performed by an application installed in the server for interaction, or by a functional program implemented in the operating system of the server. Wherein, step S10 and step S20 can be implemented with reference to the specific implementation manner described in FIG. 1 , and will not be repeated here.

在步骤S70，在步骤S10之前，获取第一终端设备当前为用户提供的内容。In step S70, prior to step S10, the content currently provided by the first terminal device to the user is obtained.

这里，在内容共享前，第一终端设备与需要进行共享的第二终端设备需要分别与服务器建立连接，需要共享的第二终端设备可向服务器发送以下信息之中的至少一项：第二终端设备的标识信息(例如，ID等)、第二终端设备的设备属性、第二终端设备的网络状况、第二终端设备对应的用户属性、第二终端设备对应的用户需求(例如，第二终端设备对应的用户感兴趣对象、针对第二终端设备设置的共享区域等)，以便与第一终端设备进行更好的交互。Here, before content sharing, the first terminal device and the second terminal device that needs to be shared need to respectively establish a connection with the server, and the second terminal device that needs to be shared can send at least one of the following information to the server: the second terminal The identification information of the device (for example, ID, etc.), the device attributes of the second terminal device, the network status of the second terminal device, the user attributes corresponding to the second terminal device, and the user requirements corresponding to the second terminal device (for example, the second terminal device The object of interest of the user corresponding to the device, the shared area set for the second terminal device, etc.), so as to perform better interaction with the first terminal device.

作为示例，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，步骤S70可包括：获取第一终端设备当前的全景视图；接收第一终端设备对应的当前观看视角信息；根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。As an example, the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein step S70 may include: acquiring the current panoramic view of the first terminal device; receiving the current Viewing angle information: determine the content currently displayed to the user by the first terminal device according to the current viewing angle information and the current panoramic view.

作为示例，可直接从第一终端设备获取第一终端设备当前的全景视图。作为另一示例，可不用从第一终端设备获取其当前的全景视图，可由服务器运行与第一终端设备当前运行的应用程序相同的应用程序，并实时从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息；执行与接收到的操作信息对应的功能，从而保证始终能够得到与第一终端设备当前的全景视图一致的图像，以获取第一终端设备当前为用户提供的内容。As an example, the current panoramic view of the first terminal device may be acquired directly from the first terminal device. As another example, instead of acquiring its current panoramic view from the first terminal device, the server may run the same application program as the application program currently running on the first terminal device, and receive the user's feedback on the first terminal device from the first terminal device in real time. The operation information that the device currently provides for the user to operate on the content; execute the function corresponding to the received operation information, so as to ensure that the image consistent with the current panoramic view of the first terminal device can always be obtained, so as to obtain the current panoramic view of the first terminal device. User Contributed Content.

并且，第一终端设备与第二终端设备的共享方式可分为以下几种：In addition, the sharing methods of the first terminal device and the second terminal device can be divided into the following types:

(a)一对一交互方式：一个第一终端设备与一个第二终端设备交互。(a) One-to-one interaction mode: a first terminal device interacts with a second terminal device.

(b)一对多交互方式：一个第一终端设备与多个第二终端设备交互，即，多个第二终端设备通过服务器来获取同一个第一终端设备中的内容。(b) One-to-many interaction mode: one first terminal device interacts with multiple second terminal devices, that is, multiple second terminal devices acquire content in the same first terminal device through the server.

(c)多对一交互方式：多个第一终端设备与一个第二终端设备交互，一个第二终端设备可以同时获取多个第一终端设备上的内容，此时第二终端设备可以通过任意切换的方式选择显示一个第一终端设备的共享内容，也可以同时在同一个屏幕上同时显示多个第一终端设备的共享内容，并对其进行操作。(c) Many-to-one interaction mode: multiple first terminal devices interact with one second terminal device, and one second terminal device can simultaneously acquire the content on multiple first terminal devices, at this time, the second terminal device can pass any The switching method may select to display the shared content of one first terminal device, or simultaneously display the shared content of multiple first terminal devices on the same screen, and perform operations on them.

(d)多对多交互方式：多个第一终端设备与多个第二终端设备交互。(d) Many-to-many interaction mode: multiple first terminal devices interact with multiple second terminal devices.

实施例一，第一终端设备与第二终端设备A和第二终端设备B共享第一终端设备的用户当前观看的某一视频的画面。Embodiment 1, the first terminal device shares with the second terminal device A and the second terminal device B a picture of a certain video currently watched by the user of the first terminal device.

第二终端设备A的用户可预先设置一个指定事件：当视频画面中出现目标1时，则将目标1所在的区域的画面发送给第二终端设备A。当目标1出现在第一终端设备当前为用户提供的内容时，第一终端设备(或服务器)识别出目标1所在的区域，并把该区域的内容自动发送给第二终端设备A。并且，如果第二终端设备A的用户在第二终端设备A上放大共享内容，第二终端设备A则将指示其用户的放大操作的信息发送给第一终端设备(或服务器)，第一终端设备(或服务器)可将该区域内更细粒度(高分辨率)的图像发送给第二终端设备A，从而满足第二终端设备A的用户的需求。The user of the second terminal device A can preset a specified event: when thetarget 1 appears in the video picture, the picture of the area where thetarget 1 is located is sent to the second terminal device A. When theobject 1 appears in the content currently provided by the first terminal device for the user, the first terminal device (or server) recognizes the area where theobject 1 is located, and automatically sends the content of the area to the second terminal device A. And, if the user of the second terminal device A zooms in on the shared content on the second terminal device A, the second terminal device A sends information indicating the user's zoom-in operation to the first terminal device (or server), and the first terminal The device (or server) can send the more fine-grained (high resolution) images in the area to the second terminal device A, so as to meet the needs of the users of the second terminal device A.

另外，第一终端设备(或服务器)可实时将当前的全景视图共享给第二终端设备B，第二终端设备B的用户能看到当前的全景视图，由于视频画面中的目标过多，当第一终端设备的用户无法找到目标2在什么位置，则可寻求第二终端设备B的用户的帮助。第二终端设备B的用户通过观看当前的全景视图，选择了目标2的位置，第二终端设备就将目标2的位置信息发送给第一终端设备，或发送给服务器，由服务器转发给第一终端设备。第一终端设备接收到该位置信息后，可指导其用户如何移动观看视角，以到达目标2所在的方位，例如，可通过提示音的大小通知其用户与目标2的远近关系，通过提示，第一终端设备的用户最终可以找到目标2。In addition, the first terminal device (or server) can share the current panoramic view with the second terminal device B in real time, and the user of the second terminal device B can see the current panoramic view. If the user of the first terminal device cannot find out where the target 2 is, he may seek help from the user of the second terminal device B. The user of the second terminal device B selects the position of the target 2 by viewing the current panoramic view, and the second terminal device sends the position information of the target 2 to the first terminal device or to the server, and the server forwards it to the first terminal device. Terminal Equipment. After the first terminal device receives the location information, it can instruct its user how to move the viewing angle to reach the location of the target 2. For example, it can notify the distance between the user and the target 2 through the size of the prompt sound. Through the prompt, the second The user of an end device can finally find the target 2 .

实施例二，第一终端设备当前为用户提供的内容是射击游戏中的场景，第一终端设备和第二终端设备分别连接不同型号的手柄。当第一终端设备当前为用户提供的内容中出现射击对象时，第二终端设备的用户使用手柄并点击“○”键射击共享内容中的射击对象。第二终端设备将操作信息发送到第一终端设备(或服务器)上，由第一终端设备(或服务器)进行解析，通过对比不同手柄的型号参数，将第二终端设备的用户使用的手柄的操作，映射到第一终端设备的用户的手柄“A”键上，并执行与“A”键相应的功能，进而完成对射击对象的射击，因此第二终端设备的用户对射击对象的射击会呈现在第一终端设备当前为用户提供的内容中，此外，也会将第一终端设备的手柄对应的按键位置提示给其用户，以帮助第一终端设备的用户了解如何使用自己的手柄。Embodiment 2, the content currently provided by the first terminal device to the user is the scene in the shooting game, and the first terminal device and the second terminal device are respectively connected to handles of different models. When the shooting object appears in the content currently provided by the first terminal device for the user, the user of the second terminal device uses the handle and clicks the "○" button to shoot the shooting object in the shared content. The second terminal device sends the operation information to the first terminal device (or server), and the first terminal device (or server) analyzes it. By comparing the model parameters of different handles, the user of the second terminal device uses the handle Operation, mapped to the "A" key of the handle of the user of the first terminal device, and executes the function corresponding to the "A" key, and then completes the shooting of the shooting object, so the shooting of the shooting object by the user of the second terminal device will be Presented in the content currently provided by the first terminal device to the user, in addition, the position of the button corresponding to the handle of the first terminal device will also be prompted to the user, so as to help the user of the first terminal device understand how to use his handle.

图24示出根据本发明示例性实施例的实现终端设备交互的装置的框图。如图24所示，根据本发明示例性实施例的实现终端设备交互的装置包括共享内容确定单元101和共享单元102。Fig. 24 shows a block diagram of an apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention. As shown in FIG. 24 , the apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention includes a shared content determining unit 101 and a sharing unit 102 .

具体说来，共享内容确定单元101用于在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容。Specifically, the shared content determining unit 101 is configured to determine the shared content to be shared with the second terminal device among the contents currently provided by the first terminal device to the user.

共享单元102用于将确定出的共享内容发送到第二终端设备进行共享。The sharing unit 102 is configured to send the determined shared content to the second terminal device for sharing.

作为示例，所述第一终端设备和/或第二终端设备为虚拟现实设备。As an example, the first terminal device and/or the second terminal device is a virtual reality device.

作为示例，共享内容确定单元101可根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作。As an example, the shared content determining unit 101 may determine the shared content to be shared with the second terminal device according to at least one of the following: the object of interest of the user corresponding to the first terminal device, the content corresponding to the sharing area, the content corresponding to the designated event The content, the object of interest of the user corresponding to the second terminal device, the changed content including valid content, and the operation of the user of the second terminal device on the received shared content.

作为示例，共享内容确定单元101可根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性。As an example, the shared content determining unit 101 may determine the user's interest object corresponding to the first terminal device according to at least one of the following items: user behavior corresponding to the first terminal device, each of the content currently provided to the user The association relationship between objects, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device.

作为示例，共享内容确定单元101可根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性。As an example, the shared content determining unit 101 may determine the user interest object corresponding to the second terminal device according to at least one of the following items: user behavior corresponding to the second terminal device, user attribute corresponding to the second terminal device.

作为示例，所述共享区域可包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域。As an example, the sharing area may include at least one of the following areas: a sharing area set for the first terminal device, a sharing area set for the second terminal device, and an area where the object of interest of the user corresponding to the first terminal device is located. The area, the area where the object of interest of the user corresponding to the second terminal device is located.

作为示例，所述指定事件可包括系统相关事件、内容相关事件中的至少一项。As an example, the specified event may include at least one of a system-related event and a content-related event.

作为示例，所述变化内容可以是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容，其中，共享内容确定单元101可在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。As an example, the changed content may be part of the content currently provided to the user that has changed compared to the shared content sent last time, wherein the shared content determining unit 101 may satisfy at least one of the following conditions: Determine that the changed content contains valid content: the ratio of the changed content to the content currently provided to users is not less than the first predetermined threshold; the changed content includes the content corresponding to the shared area; the changed content includes the content corresponding to the specified event Content: the change content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the change content includes an operable object.

作为示例，共享内容确定单元101可当确定满足下述至少一项时，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容：第一终端设备的运动速度不大于第二预定阈值；当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。As an example, the shared content determining unit 101 may determine the shared content to be shared with the second terminal device from the content currently provided by the first terminal device to the user when at least one of the following is satisfied: the movement speed of the first terminal device Not greater than the second predetermined threshold; the content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the user's interested object corresponding to the first terminal device, the user's interested object corresponding to the second terminal device, At least one of operation object, change content including valid content.

作为示例，共享单元102可按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。As an example, the sharing unit 102 may reconstruct the shared content in a preset manner, and send the reconstructed content to the second terminal device for sharing.

作为示例，所述预设方式可包括以下项之中的至少一项：获取包括所述共享内容的最小区域内的内容；根据第二终端设备的设备属性调整所述共享内容；根据冗余区域对所述共享内容进行重构；根据当前的网络状况调整所述共享内容；基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；基于过滤条件对所述共享内容进行过滤；根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。As an example, the preset method may include at least one of the following items: obtaining content in the smallest area including the shared content; adjusting the shared content according to the device attributes of the second terminal device; Reconstructing the shared content; adjusting the shared content according to the current network conditions; correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device; based on filtering The shared content is filtered by the condition; and the shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.

作为示例，根据本发明示例性实施例的实现终端设备交互的装置还可包括：接收单元(未示出)和视角转换单元(未示出)。As an example, the apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: a receiving unit (not shown) and a viewing angle conversion unit (not shown).

接收单元用于从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径。The receiving unit is configured to receive from the second terminal device: position information of the target object selected by the user from the received shared content, and/or a movement path from the current viewing angle of the first terminal device to the corresponding viewing angle of the target object.

视角转换单元用于根据接收到的所述位置信息和/或所述运动路径，指导第一终端设备的用户移动观看视角和/或自动切换第一终端设备的用户的观看视角。The viewing angle conversion unit is configured to guide the user of the first terminal device to move the viewing angle and/or automatically switch the viewing angle of the user of the first terminal device according to the received position information and/or the moving path.

作为示例，根据本发明示例性实施例的实现终端设备交互的装置还可包括：操作信息接收单元(未示出)和执行单元(未示出)。As an example, the apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: an operation information receiving unit (not shown) and an executing unit (not shown).

操作信息接收单元用于从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息。The operation information receiving unit is configured to receive, from the second terminal device, operation information for the user to operate on the received shared content.

执行单元用于对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。The executing unit is configured to execute the function corresponding to the received operation information on the content currently provided to the user.

作为示例，根据本发明示例性实施例的实现终端设备交互的装置还可包括：焦点获取单元(未示出)和焦点调整单元(未示出)。As an example, the apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: a focus acquisition unit (not shown) and a focus adjustment unit (not shown).

焦点获取单元用于响应于用户对第一终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置。焦点调整单元用于当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。The focus obtaining unit is configured to, in response to the user's operation on the external operation device of the first terminal device, obtain the operation focus position of the external operation device in the content currently provided to the user. The focus adjustment unit is configured to adjust the current operation focus to the position of the operation focus before the movement when invalid movement of the external operation device is detected.

作为示例，根据本发明示例性实施例的实现终端设备交互的装置还可包括：获取单元(未示出)。As an example, the apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: an acquiring unit (not shown).

获取单元用于在共享内容确定单元在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容之前，获取第一终端设备当前为用户提供的内容。The acquiring unit is configured to acquire the content currently provided by the first terminal device for the user before the shared content determining unit determines the shared content to be shared to the second terminal device among the content currently provided by the first terminal device for the user.

作为示例，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，获取单元可包括：全景视图获取单元(未示出)、视角信息接收单元(未示出)和确定单元(未示出)。As an example, the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein the acquisition unit may include: a panorama view acquisition unit (not shown), an angle information receiving unit (not shown ) and a determination unit (not shown).

全景视图获取单元用于获取第一终端设备当前的全景视图。视角信息接收单元用于接收第一终端设备对应的当前观看视角信息。确定单元用于根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。The panoramic view acquiring unit is configured to acquire the current panoramic view of the first terminal device. The angle of view information receiving unit is configured to receive current viewing angle information corresponding to the first terminal device. The determining unit is configured to determine the content currently displayed to the user by the first terminal device according to the current viewing angle information and the current panoramic view.

作为示例，根据本发明示例性实施例的实现终端设备交互的装置还可包括：操作信息接收单元(未示出)和执行单元(未示出)。As an example, the apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: an operation information receiving unit (not shown) and an executing unit (not shown).

操作信息接收单元用于从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息。执行单元用于执行与接收到的操作信息对应的功能，以获取第一终端设备当前为用户提供的内容。The operation information receiving unit is configured to receive, from the first terminal device, operation information for the user to operate on content currently provided to the user by the first terminal device. The executing unit is configured to execute a function corresponding to the received operation information, so as to obtain the content currently provided by the first terminal device to the user.

应该理解，根据本发明示例性实施例的实现终端设备交互的装置的具体实现方式可参照结合图1-图23描述的相关具体实现方式来实现，在此不再赘述。It should be understood that the specific implementation manner of the apparatus for realizing terminal device interaction according to the exemplary embodiment of the present invention may be implemented by referring to the relevant specific implementation manners described in conjunction with FIGS. 1-23 , and details are not repeated here.

图25示出根据本发明示例性实施例的终端设备的框图。如图25所示，根据本发明示例性实施例的终端设备包括共享内容确定单元201和共享单元202。FIG. 25 shows a block diagram of a terminal device according to an exemplary embodiment of the present invention. As shown in FIG. 25 , a terminal device according to an exemplary embodiment of the present invention includes a shared content determining unit 201 and a sharing unit 202 .

以下，将所述终端设备称为第一终端设备。应该理解，第一终端设备除具有共享内容确定单元201和共享单元202之外，还可具有其作为终端设备执行其自身功能的其它器件，例如，显示器件等。Hereinafter, the terminal device is referred to as a first terminal device. It should be understood that, in addition to the shared content determining unit 201 and the sharing unit 202, the first terminal device may also have other devices for performing its own functions as a terminal device, for example, a display device and the like.

具体说来，共享内容确定单元201用于在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容。Specifically, the shared content determining unit 201 is configured to determine the shared content to be shared with the second terminal device among the contents currently provided by the first terminal device to the user.

共享单元202用于将确定出的共享内容发送到第二终端设备进行共享。The sharing unit 202 is configured to send the determined shared content to the second terminal device for sharing.

作为示例，所述第一终端设备和/或第二终端设备为虚拟现实设备。As an example, the first terminal device and/or the second terminal device is a virtual reality device.

作为示例，共享内容确定单元201可根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作。As an example, the shared content determining unit 201 may determine the shared content to be shared with the second terminal device according to at least one of the following: the object of interest of the user corresponding to the first terminal device, the content corresponding to the sharing area, the content corresponding to the designated event The content, the object of interest of the user corresponding to the second terminal device, the changed content including valid content, and the operation of the user of the second terminal device on the received shared content.

作为示例，共享内容确定单元201可根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性。As an example, the shared content determining unit 201 may determine the user's interested object corresponding to the first terminal device according to at least one of the following items: user behavior corresponding to the first terminal device, each of the content currently provided to the user The association relationship between objects, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device.

作为示例，共享内容确定单元201可根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性。As an example, the shared content determining unit 201 may determine the user interest object corresponding to the second terminal device according to at least one of the following items: user behavior corresponding to the second terminal device, user attribute corresponding to the second terminal device.

作为示例，所述共享区域可包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域。As an example, the sharing area may include at least one of the following areas: a sharing area set for the first terminal device, a sharing area set for the second terminal device, and an area where the object of interest of the user corresponding to the first terminal device is located. The area, the area where the object of interest of the user corresponding to the second terminal device is located.

作为示例，所述指定事件可包括系统相关事件、内容相关事件中的至少一项。As an example, the specified event may include at least one of a system-related event and a content-related event.

作为示例，所述变化内容可以是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容，其中，共享内容确定单元201可在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。As an example, the changed content may be part of the content currently provided to the user that has changed compared to the shared content sent last time, wherein the shared content determining unit 201 may satisfy at least one of the following conditions: Determine that the changed content contains valid content: the ratio of the changed content to the content currently provided to users is not less than the first predetermined threshold; the changed content includes the content corresponding to the shared area; the changed content includes the content corresponding to the specified event Content: the change content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the change content includes an operable object.

作为示例，共享内容确定单元201可当确定满足下述至少一项时，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容：第一终端设备的运动速度不大于第二预定阈值；当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。As an example, the shared content determining unit 201 may determine the shared content to be shared with the second terminal device from the content currently provided by the first terminal device to the user when at least one of the following is satisfied: the movement speed of the first terminal device Not greater than the second predetermined threshold; the content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the user's interested object corresponding to the first terminal device, the user's interested object corresponding to the second terminal device, At least one of operation object, change content including valid content.

作为示例，共享单元202可按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。As an example, the sharing unit 202 may reconstruct the shared content in a preset manner, and send the reconstructed content to the second terminal device for sharing.

作为示例，所述预设方式可包括以下项之中的至少一项：获取包括所述共享内容的最小区域内的内容；根据第二终端设备的设备属性调整所述共享内容；根据冗余区域对所述共享内容进行重构；根据当前的网络状况调整所述共享内容；基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；基于过滤条件对所述共享内容进行过滤；根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。As an example, the preset method may include at least one of the following items: obtaining content in the smallest area including the shared content; adjusting the shared content according to the device attributes of the second terminal device; Reconstructing the shared content; adjusting the shared content according to the current network conditions; correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device; based on filtering The shared content is filtered by the condition; and the shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.

作为示例，根据本发明示例性实施例的终端设备还可包括：接收单元(未示出)和视角转换单元(未示出)。As an example, a terminal device according to an exemplary embodiment of the present invention may further include: a receiving unit (not shown) and a viewing angle converting unit (not shown).

接收单元用于从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径。The receiving unit is configured to receive from the second terminal device: position information of the target object selected by the user from the received shared content, and/or a movement path from the current viewing angle of the first terminal device to the corresponding viewing angle of the target object.

视角转换单元用于根据接收到的所述位置信息和/或所述运动路径，指导第一终端设备的用户移动观看视角和/或自动切换第一终端设备的用户的观看视角。The viewing angle conversion unit is configured to guide the user of the first terminal device to move the viewing angle and/or automatically switch the viewing angle of the user of the first terminal device according to the received position information and/or the moving path.

作为示例，根据本发明示例性实施例的终端设备还可包括：操作信息接收单元(未示出)和执行单元(未示出)。As an example, a terminal device according to an exemplary embodiment of the present invention may further include: an operation information receiving unit (not shown) and an executing unit (not shown).

操作信息接收单元用于从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息。The operation information receiving unit is configured to receive, from the second terminal device, operation information for the user to operate on the received shared content.

执行单元用于对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。The executing unit is configured to execute the function corresponding to the received operation information on the content currently provided to the user.

作为示例，根据本发明示例性实施例的终端设备还可包括：焦点获取单元(未示出)和焦点调整单元(未示出)。As an example, a terminal device according to an exemplary embodiment of the present invention may further include: a focus acquisition unit (not shown) and a focus adjustment unit (not shown).

焦点获取单元用于响应于用户对第一终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置。焦点调整单元用于当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。The focus obtaining unit is configured to, in response to the user's operation on the external operation device of the first terminal device, obtain the operation focus position of the external operation device in the content currently provided to the user. The focus adjustment unit is configured to adjust the current operation focus to the position of the operation focus before the movement when invalid movement of the external operation device is detected.

应该理解，根据本发明示例性实施例的终端设备的具体实现方式可参照结合图1-图22描述的相关具体实现方式来实现，在此不再赘述。It should be understood that the specific implementation manners of the terminal device according to the exemplary embodiments of the present invention may be implemented by referring to the relevant specific implementation manners described in conjunction with FIG. 1-FIG. 22 , and details are not repeated here.

图26示出根据本发明示例性实施例的服务器的框图。如图26所示，根据本发明示例性实施例的服务器包括：获取单元301、共享内容确定单元302和共享单元303。FIG. 26 shows a block diagram of a server according to an exemplary embodiment of the present invention. As shown in FIG. 26 , the server according to the exemplary embodiment of the present invention includes: an acquiringunit 301 , a shared content determining unit 302 and a sharing unit 303 .

具体说来，获取单元301用于获取第一终端设备当前为用户提供的内容。Specifically, the obtainingunit 301 is configured to obtain content currently provided by the first terminal device to the user.

共享内容确定单元302用于在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容。The shared content determining unit 302 is configured to determine the shared content to be shared with the second terminal device among the contents currently provided by the first terminal device to the user.

共享单元303用于将确定出的共享内容发送到第二终端设备进行共享。The sharing unit 303 is configured to send the determined shared content to the second terminal device for sharing.

作为示例，所述第一终端设备和/或第二终端设备为虚拟现实设备。As an example, the first terminal device and/or the second terminal device is a virtual reality device.

作为示例，共享内容确定单元302可根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作。As an example, the shared content determining unit 302 may determine the shared content to be shared with the second terminal device according to at least one of the following: the object of interest of the user corresponding to the first terminal device, the content corresponding to the sharing area, the content corresponding to the designated event The content, the object of interest of the user corresponding to the second terminal device, the changed content including valid content, and the operation of the user of the second terminal device on the received shared content.

作为示例，共享内容确定单元302可根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性。As an example, the shared content determining unit 302 may determine the user's interested object corresponding to the first terminal device according to at least one of the following items: user behavior corresponding to the first terminal device, each of the content currently provided to the user The association relationship between objects, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device.

作为示例，共享内容确定单元302可根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性。As an example, the shared content determining unit 302 may determine the user interest object corresponding to the second terminal device according to at least one of the following items: user behavior corresponding to the second terminal device, user attribute corresponding to the second terminal device.

作为示例，所述共享区域可包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域。As an example, the sharing area may include at least one of the following areas: a sharing area set for the first terminal device, a sharing area set for the second terminal device, and an area where the object of interest of the user corresponding to the first terminal device is located. The area, the area where the object of interest of the user corresponding to the second terminal device is located.

作为示例，所述指定事件可包括系统相关事件、内容相关事件中的至少一项。As an example, the specified event may include at least one of a system-related event and a content-related event.

作为示例，所述变化内容可以是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容，其中，共享内容确定单元302可在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。As an example, the changed content may be part of the content currently provided to the user that has changed compared to the shared content sent last time, wherein the shared content determining unit 302 may satisfy at least one of the following conditions: Determine that the changed content contains valid content: the ratio of the changed content to the content currently provided to users is not less than the first predetermined threshold; the changed content includes the content corresponding to the shared area; the changed content includes the content corresponding to the specified event Content: the change content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the change content includes an operable object.

作为示例，共享内容确定单元302可当确定满足下述至少一项时，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容：第一终端设备的运动速度不大于第二预定阈值；当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。As an example, the shared content determining unit 302 may determine the shared content to be shared with the second terminal device from the content currently provided by the first terminal device to the user when at least one of the following is satisfied: the movement speed of the first terminal device Not greater than the second predetermined threshold; the content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the user's interested object corresponding to the first terminal device, the user's interested object corresponding to the second terminal device, At least one of operation object, change content including valid content.

作为示例，共享单元303可按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。As an example, the sharing unit 303 may reconstruct the shared content in a preset manner, and send the reconstructed content to the second terminal device for sharing.

作为示例，所述预设方式可包括以下项之中的至少一项：获取包括所述共享内容的最小区域内的内容；根据第二终端设备的设备属性调整所述共享内容；根据冗余区域对所述共享内容进行重构；根据当前的网络状况调整所述共享内容；基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；基于过滤条件对所述共享内容进行过滤；根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。As an example, the preset method may include at least one of the following items: obtaining content in the smallest area including the shared content; adjusting the shared content according to the device attributes of the second terminal device; Reconstructing the shared content; adjusting the shared content according to the current network conditions; correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device; based on filtering The shared content is filtered by the condition; and the shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.

作为示例，根据本发明示例性实施例的服务器还可包括：接收单元(未示出)和路径确定单元(未示出)。As an example, the server according to the exemplary embodiment of the present invention may further include: a receiving unit (not shown) and a path determining unit (not shown).

接收单元用于从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息。The receiving unit is configured to receive from the second terminal device: location information of the target object selected by the user from the received shared content.

路径确定单元用于根据接收到的所述位置信息确定第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径，并将所述运动路径发送到第一终端设备。The path determination unit is configured to determine a movement path from the current viewing angle of the first terminal device to the viewing angle corresponding to the target object according to the received position information, and send the movement path to the first terminal device.

作为示例，根据本发明示例性实施例的服务器还可包括：操作信息接收单元(未示出)和执行单元(未示出)。As an example, the server according to the exemplary embodiment of the present invention may further include: an operation information receiving unit (not shown) and an executing unit (not shown).

操作信息接收单元用于从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息。The operation information receiving unit is configured to receive, from the second terminal device, operation information for the user to operate on the received shared content.

执行单元用于对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能，并将所述操作信息发送到第一终端设备。The execution unit is configured to execute the function corresponding to the received operation information on the content currently provided to the user, and send the operation information to the first terminal device.

作为示例，根据本发明示例性实施例的实现终端设备交互的装置还可包括：焦点获取单元(未示出)和焦点调整单元(未示出)。As an example, the apparatus for implementing terminal device interaction according to an exemplary embodiment of the present invention may further include: a focus acquisition unit (not shown) and a focus adjustment unit (not shown).

作为示例，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，获取单元301可包括：全景视图获取单元(未示出)、视角信息接收单元(未示出)和确定单元(未示出)。As an example, the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein theacquisition unit 301 may include: a panorama view acquisition unit (not shown), an angle information receiving unit (not shown out) and a determination unit (not shown).

全景视图获取单元用于获取第一终端设备当前的全景视图。视角信息接收单元用于接收第一终端设备对应的当前观看视角信息。确定单元用于根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。The panoramic view acquiring unit is configured to acquire the current panoramic view of the first terminal device. The angle of view information receiving unit is configured to receive current viewing angle information corresponding to the first terminal device. The determining unit is configured to determine the content currently displayed to the user by the first terminal device according to the current viewing angle information and the current panoramic view.

作为示例，根据本发明示例性实施例的服务器还可包括：操作信息接收单元(未示出)和执行单元(未示出)。As an example, the server according to the exemplary embodiment of the present invention may further include: an operation information receiving unit (not shown) and an executing unit (not shown).

操作信息接收单元用于从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息。执行单元用于执行与接收到的操作信息对应的功能，以获取第一终端设备当前为用户提供的内容。The operation information receiving unit is configured to receive, from the first terminal device, operation information for the user to operate on content currently provided to the user by the first terminal device. The executing unit is configured to execute a function corresponding to the received operation information, so as to obtain the content currently provided by the first terminal device to the user.

应该理解，根据本发明示例性实施例的服务器的具体实现方式可参照结合图1-图23描述的相关具体实现方式来实现，在此不再赘述。It should be understood that the specific implementation manners of the server according to the exemplary embodiment of the present invention may be implemented by referring to the relevant specific implementation manners described in conjunction with FIG. 1-FIG.

图27示出根据本发明的另一示例性实施例的终端设备的框图。如图27所示，根据本发明示例性实施例的终端设备包括：共享内容接收单元401和显示单元402。这里，所述终端设备可以是上述示例性实施例中的第二终端设备。FIG. 27 shows a block diagram of a terminal device according to another exemplary embodiment of the present invention. As shown in FIG. 27 , a terminal device according to an exemplary embodiment of the present invention includes: a shared content receiving unit 401 and a display unit 402 . Here, the terminal device may be the second terminal device in the foregoing exemplary embodiments.

具体说来，共享内容接收单元401用于接收第一终端设备发送的共享内容，其中，所述共享内容为在第一终端设备当前为用户提供的内容中确定出的。Specifically, the shared content receiving unit 401 is configured to receive the shared content sent by the first terminal device, wherein the shared content is determined from the content currently provided by the first terminal device to the user.

显示单元402用于将接收到的共享内容进行显示。The display unit 402 is configured to display the received shared content.

作为示例，根据本发明的另一示例性实施例的终端设备还可包括：发送单元(未示出)。As an example, a terminal device according to another exemplary embodiment of the present invention may further include: a sending unit (not shown).

发送单元用于向第一终端设备发送：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径。The sending unit is configured to send to the first terminal device: position information of the target object selected by the user from the received shared content, and/or a movement path from the current viewing angle of the first terminal device to the corresponding viewing angle of the target object.

作为示例，根据本发明的另一示例性实施例的终端设备还可包括：操作接收单元(未示出)。As an example, a terminal device according to another exemplary embodiment of the present invention may further include: an operation receiving unit (not shown).

操作接收单元用于接收用户针对接收到的共享内容进行操作的操作信息，其中，发送单元将所述操作信息发送给第一终端设备。The operation receiving unit is configured to receive operation information that the user operates on the received shared content, wherein the sending unit sends the operation information to the first terminal device.

应该理解，根据本发明示例性实施例的终端设备的具体实现方式可参照结合图1-图23描述的相关具体实现方式来实现，在此不再赘述。It should be understood that the specific implementation manners of the terminal device according to the exemplary embodiments of the present invention may be implemented by referring to the relevant specific implementation manners described in conjunction with FIG. 1-FIG. 23 , and details are not repeated here.

根据本发明示例性实施例的实现终端设备交互的方法和装置、终端设备及服务器，仅将终端设备为用户提供的内容之中需要共享的部分内容发送到其他终端设备进行共享，从而减少冗余数据的传输，降低了设备间的数据传输量，节省了传输资源，提高了设备间沟通的实时性。此外，还可实现终端设备之间的操作共享。According to the method and device for realizing terminal device interaction, the terminal device and the server according to the exemplary embodiments of the present invention, only part of the content that needs to be shared among the content provided by the terminal device to the user is sent to other terminal devices for sharing, thereby reducing redundancy Data transmission reduces the amount of data transmission between devices, saves transmission resources, and improves the real-time communication between devices. In addition, operation sharing between terminal devices can also be realized.

此外，应该理解，根据本发明示例性实施例的实现终端设备交互的装置、终端设备及服务器中的各个单元可被实现硬件组件和/或软件组件。本领域技术人员根据限定的各个单元所执行的处理，可以例如使用现场可编程门阵列(FPGA)或专用集成电路(ASIC)来实现各个单元。In addition, it should be understood that the apparatus for realizing terminal device interaction, each unit in the terminal device and the server according to the exemplary embodiment of the present invention may be implemented as hardware components and/or software components. Those skilled in the art may implement each unit, for example, by using a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC) according to the defined processing performed by each unit.

此外，根据本发明示例性实施例的实现终端设备交互的方法可以被实现为计算机可读记录介质中的计算机代码。本领域技术人员可以根据对上述方法的描述来实现所述计算机代码。当所述计算机代码在计算机中被执行时实现本发明的上述方法。In addition, the method for implementing terminal device interaction according to the exemplary embodiments of the present invention may be implemented as computer codes in a computer-readable recording medium. Those skilled in the art can implement the computer code according to the description of the above method. The above method of the present invention is realized when the computer code is executed in a computer.

虽然已表示和描述了本发明的一些示例性实施例，但本领域技术人员应该理解，在不脱离由权利要求及其等同物限定其范围的本发明的原理和精神的情况下，可以对这些实施例进行修改。While a few exemplary embodiments of the present invention have been shown and described, it should be understood by those skilled in the art that such modifications may be made without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents. Examples are modified.

Claims (47)

Translated fromChinese

1.一种实现终端设备交互的方法，包括：1. A method for realizing terminal device interaction, comprising:(A)在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容；(A) determining the shared content to be shared to the second terminal device in the content currently provided by the first terminal device to the user;(B)将确定出的共享内容发送到第二终端设备进行共享，(B) sending the determined shared content to the second terminal device for sharing,其中，所述方法还包括：Wherein, the method also includes:从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径；Receive from the second terminal device: the location information of the target object selected by the user from the received shared content, and/or the movement path from the current viewing angle of the first terminal device to the corresponding viewing angle of the target object;根据接收到的所述位置信息和/或所述运动路径，指导第一终端设备的用户移动观看视角和/或自动切换第一终端设备的用户的观看视角。According to the received position information and/or the movement path, guide the user of the first terminal device to move the viewing angle and/or automatically switch the viewing angle of the user of the first terminal device.2.根据权利要求1所述的方法，其中，第一终端设备和/或第二终端设备为虚拟现实设备。2. The method according to claim 1, wherein the first terminal device and/or the second terminal device is a virtual reality device.3.根据权利要求1所述的方法，其中，根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作，3. The method according to claim 1, wherein the shared content to be shared with the second terminal device is determined according to at least one of the following: the user's object of interest corresponding to the first terminal device, the content corresponding to the shared area, Specify the content corresponding to the event, the object of interest of the user corresponding to the second terminal device, the changed content including valid content, and the operation of the user of the second terminal device on the received shared content,其中，所述指定事件包括系统相关事件、内容相关事件中的至少一项；Wherein, the specified event includes at least one of a system-related event and a content-related event;其中，在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。Wherein, when at least one of the following conditions is met, it is determined that the changed content contains valid content: the ratio of the changed content to the content currently provided to the user is not less than a first predetermined threshold; the changed content includes The content corresponding to the sharing area; the changed content includes the content corresponding to the specified event; the changed content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the changed content includes the operable object.4.根据权利要求3所述的方法，其中，根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性；4. The method according to claim 3, wherein the user interest object corresponding to the first terminal device is determined according to at least one of the following items: the user behavior corresponding to the first terminal device, the current The association relationship between objects in the content, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device;和/或，根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性；And/or, determine the user interest object corresponding to the second terminal device according to at least one of the following items: user behavior corresponding to the second terminal device, user attribute corresponding to the second terminal device;和/或，所述共享区域包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域；And/or, the sharing area includes at least one of the following areas: a sharing area set for the first terminal device, a sharing area set for the second terminal device, and an area where the object of interest of the user corresponding to the first terminal device is located. area, the area where the object of interest of the user corresponding to the second terminal device is located;和/或，所述变化内容是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容。And/or, the changed content is part of the content currently provided to the user that has changed compared with the shared content sent last time.5.根据权利要求3所述的方法，其中，5. The method of claim 3, wherein,当满足下述至少一项时，执行步骤(A)：When at least one of the following is met, step (A) is performed:第一终端设备的运动速度不大于第二预定阈值；the movement speed of the first terminal device is not greater than a second predetermined threshold;当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。The content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the object of interest of the user corresponding to the first terminal device, the object of interest of the user corresponding to the second terminal device, operable object, and the content containing valid content. At least one of the changed content.6.根据权利要求1至5任一项所述的方法，其中，步骤(B)包括：6. The method according to any one of claims 1 to 5, wherein step (B) comprises:按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。The shared content is reconstructed in a preset manner, and the reconstructed content is sent to the second terminal device for sharing.7.根据权利要求6所述的方法，其中，所述预设方式包括以下项之中的至少一项：7. The method according to claim 6, wherein the preset manner comprises at least one of the following:获取包括所述共享内容的最小区域内的内容；obtaining the content within the smallest area including the shared content;根据第二终端设备的设备属性调整所述共享内容；adjusting the shared content according to the device attribute of the second terminal device;根据冗余区域对所述共享内容进行重构；reconstructing the shared content according to the redundant area;根据当前的网络状况调整所述共享内容；Adjust the shared content according to the current network conditions;基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device;基于过滤条件对所述共享内容进行过滤；filtering the shared content based on filtering conditions;根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。The shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.8.根据权利要求1至5任一项所述的方法，还包括：8. The method according to any one of claims 1 to 5, further comprising:从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息；receiving, from the second terminal device, operation information that the user operates on the received shared content;对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。Execute the function corresponding to the received operation information on the content currently provided to the user.9.根据权利要求1至5任一项所述的方法，还包括：9. The method according to any one of claims 1 to 5, further comprising:响应于用户对第一终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置；Responding to the user's operation on the external operation device of the first terminal device, acquiring the operation focus position of the external operation device in the content currently provided to the user;当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。When an invalid movement of the external operation device is detected, the current operation focus is adjusted to the position of the operation focus before the movement.10.根据权利要求1至5任一项所述的方法，还包括：10. The method according to any one of claims 1 to 5, further comprising:在步骤(A)之前，获取第一终端设备当前为用户提供的内容。Before step (A), the content currently provided by the first terminal device to the user is acquired.11.根据权利要求10所述的方法，其中，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，获取第一终端设备当前为用户提供的内容的步骤包括：11. The method according to claim 10, wherein the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein the step of acquiring the content currently provided by the first terminal device to the user include:获取第一终端设备当前的全景视图；Obtain the current panoramic view of the first terminal device;接收第一终端设备对应的当前观看视角信息；receiving current viewing angle information corresponding to the first terminal device;根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。The content currently displayed to the user by the first terminal device is determined according to the current viewing angle information and the current panoramic view.12.根据权利要求10所述的方法，还包括：12. The method of claim 10, further comprising:从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息；receiving, from the first terminal device, operation information for the user to operate on the content currently provided to the user by the first terminal device;执行与接收到的操作信息对应的功能，以获取第一终端设备当前为用户提供的内容。Execute the function corresponding to the received operation information, so as to obtain the content currently provided by the first terminal device for the user.13.一种实现终端设备交互的装置，包括：13. A device for realizing terminal device interaction, comprising:共享内容确定单元，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容；The shared content determining unit is configured to determine the shared content to be shared with the second terminal device among the contents currently provided by the first terminal device to the user;共享单元，将确定出的共享内容发送到第二终端设备进行共享，a sharing unit, configured to send the determined shared content to the second terminal device for sharing,其中，所述装置还包括：Wherein, the device also includes:接收单元，从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径；The receiving unit receives from the second terminal device: position information of the target object selected by the user from the received shared content, and/or a movement path from the current viewing angle of the first terminal device to the corresponding viewing angle of the target object;视角转换单元，根据接收到的所述位置信息和/或所述运动路径，指导第一终端设备的用户移动观看视角和/或自动切换第一终端设备的用户的观看视角。The viewing angle conversion unit guides the user of the first terminal device to move the viewing angle and/or automatically switches the viewing angle of the user of the first terminal device according to the received position information and/or the movement path.14.根据权利要求13所述的装置，其中，第一终端设备和/或第二终端设备为虚拟现实设备。14. The apparatus according to claim 13, wherein the first terminal device and/or the second terminal device is a virtual reality device.15.根据权利要求13所述的装置，其中，共享内容确定单元根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作，15. The apparatus according to claim 13, wherein the shared content determination unit determines the shared content to be shared with the second terminal device according to at least one of the following: the user's object of interest corresponding to the first terminal device, the shared area The corresponding content, the content corresponding to the specified event, the object of interest of the user corresponding to the second terminal device, the changed content including valid content, the operation of the user of the second terminal device on the received shared content,其中，所述指定事件包括系统相关事件、内容相关事件中的至少一项；Wherein, the specified event includes at least one of a system-related event and a content-related event;其中，共享内容确定单元在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。Wherein, the shared content determination unit determines that the changed content contains valid content when at least one of the following conditions is met: the ratio of the changed content to the content currently provided to the user is not less than a first predetermined threshold; The changed content includes the content corresponding to the shared area; the changed content includes the content corresponding to the specified event; the changed content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the changed content includes operation object.16.根据权利要求15所述的装置，其中，共享内容确定单元根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性；16. The apparatus according to claim 15, wherein the shared content determining unit determines the user interest object corresponding to the first terminal device according to at least one of the following items: user behavior corresponding to the first terminal device, the The association relationship between objects in the content currently provided to the user, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device;和/或，共享内容确定单元根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性；And/or, the shared content determining unit determines the user interest object corresponding to the second terminal device according to at least one of the following items: user behavior corresponding to the second terminal device, user attribute corresponding to the second terminal device;和/或，所述共享区域包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域；And/or, the sharing area includes at least one of the following areas: a sharing area set for the first terminal device, a sharing area set for the second terminal device, and an area where the object of interest of the user corresponding to the first terminal device is located. area, the area where the object of interest of the user corresponding to the second terminal device is located;和/或，所述变化内容是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容。And/or, the changed content is part of the content currently provided to the user that has changed compared with the shared content sent last time.17.根据权利要求15所述的装置，其中，17. The apparatus of claim 15, wherein,共享内容确定单元当确定满足下述至少一项时，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容：The shared content determining unit determines the shared content to be shared to the second terminal device from among the content currently provided by the first terminal device to the user when it is determined that at least one of the following is satisfied:第一终端设备的运动速度不大于第二预定阈值；the movement speed of the first terminal device is not greater than a second predetermined threshold;当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。The content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the object of interest of the user corresponding to the first terminal device, the object of interest of the user corresponding to the second terminal device, operable object, and the content containing valid content. At least one of the changed content.18.根据权利要求13至17任一项所述的装置，其中，18. Apparatus according to any one of claims 13 to 17, wherein,共享单元按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。The sharing unit reconstructs the shared content according to a preset method, and sends the reconstructed content to the second terminal device for sharing.19.根据权利要求18所述的装置，其中，所述预设方式包括以下项之中的至少一项：19. The device according to claim 18, wherein the preset manner comprises at least one of the following:获取包括所述共享内容的最小区域内的内容；obtaining the content within the smallest area including the shared content;根据第二终端设备的设备属性调整所述共享内容；adjusting the shared content according to the device attribute of the second terminal device;根据冗余区域对所述共享内容进行重构；reconstructing the shared content according to the redundant area;根据当前的网络状况调整所述共享内容；Adjust the shared content according to the current network conditions;基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device;基于过滤条件对所述共享内容进行过滤；filtering the shared content based on filtering conditions;根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。The shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.20.根据权利要求13至17任一项所述的装置，还包括：20. The apparatus according to any one of claims 13 to 17, further comprising:操作信息接收单元，从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息；An operation information receiving unit, configured to receive, from the second terminal device, operation information for the user to operate on the received shared content;执行单元，对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。The executing unit executes the function corresponding to the received operation information on the content currently provided to the user.21.根据权利要求13至17任一项所述的装置，还包括：21. The apparatus according to any one of claims 13 to 17, further comprising:焦点获取单元，响应于用户对第一终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置；A focus acquisition unit, in response to the user's operation on the external operation device of the first terminal device, obtains the position of the operation focus of the external operation device in the content currently provided to the user;焦点调整单元，当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。The focus adjustment unit adjusts the current operation focus to the position of the operation focus before the movement when invalid movement of the external operation device is detected.22.根据权利要求13至17任一项所述的装置，还包括：22. Apparatus according to any one of claims 13 to 17, further comprising:获取单元，在共享内容确定单元在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容之前，获取第一终端设备当前为用户提供的内容。The acquiring unit is configured to acquire the content currently provided by the first terminal device to the user before the shared content determining unit determines the shared content to be shared to the second terminal device among the contents currently provided by the first terminal device to the user.23.根据权利要求22所述的装置，其中，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，获取单元包括：23. The apparatus according to claim 22, wherein the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein the acquiring unit includes:全景视图获取单元，获取第一终端设备当前的全景视图；a panoramic view acquiring unit, configured to acquire the current panoramic view of the first terminal device;视角信息接收单元，接收第一终端设备对应的当前观看视角信息；a viewing angle information receiving unit, configured to receive current viewing viewing angle information corresponding to the first terminal device;确定单元，根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。The determining unit is configured to determine the content currently displayed to the user by the first terminal device according to the current viewing angle information and the current panoramic view.24.根据权利要求22所述的装置，还包括：24. The apparatus of claim 22, further comprising:操作信息接收单元，从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息；An operation information receiving unit, configured to receive, from the first terminal device, operation information for the user to operate on content currently provided to the user by the first terminal device;执行单元，执行与接收到的操作信息对应的功能，以获取第一终端设备当前为用户提供的内容。The execution unit is configured to execute a function corresponding to the received operation information, so as to acquire the content currently provided by the first terminal device to the user.25.一种终端设备，包括：25. A terminal device, comprising:共享内容确定单元，在所述终端设备当前为用户提供的内容中确定待共享给另一终端设备的共享内容；A shared content determining unit, configured to determine the shared content to be shared with another terminal device among the content currently provided by the terminal device to the user;共享单元，将确定出的共享内容发送到所述另一终端设备进行共享，a sharing unit, configured to send the determined shared content to the other terminal device for sharing,其中，所述终端设备还包括：Wherein, the terminal equipment also includes:接收单元，从所述另一终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息，和/或从所述终端设备的当前观看视角到目标对象对应的观看视角的运动路径；The receiving unit receives from the other terminal device: the position information of the target object selected by the user from the received shared content, and/or the movement path from the current viewing angle of the terminal device to the corresponding viewing angle of the target object ;视角转换单元，根据接收到的所述位置信息和/或所述运动路径，指导所述终端设备的用户移动观看视角和/或自动切换所述终端设备的用户的观看视角。The viewing angle conversion unit guides the user of the terminal device to move the viewing angle and/or automatically switches the viewing angle of the user of the terminal device according to the received position information and/or the movement path.26.根据权利要求25所述的终端设备，其中，所述终端设备和/或所述另一终端设备为虚拟现实设备。26. The terminal device according to claim 25, wherein the terminal device and/or the other terminal device is a virtual reality device.27.根据权利要求25所述的终端设备，其中，共享内容确定单元根据下述中的至少一项确定待共享给所述另一终端设备的共享内容：所述终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、所述另一终端设备对应的用户感兴趣对象、包含有效内容的变化内容、所述另一终端设备的用户对接收到的共享内容的操作，27. The terminal device according to claim 25, wherein the shared content determining unit determines the shared content to be shared with the other terminal device according to at least one of the following: the user interest object corresponding to the terminal device , the content corresponding to the shared area, the content corresponding to the specified event, the object of interest of the user corresponding to the other terminal device, the changed content including valid content, the operation of the user of the other terminal device on the received shared content,其中，所述指定事件包括系统相关事件、内容相关事件中的至少一项；Wherein, the specified event includes at least one of a system-related event and a content-related event;其中，共享内容确定单元在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或所述另一终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。Wherein, the shared content determination unit determines that the changed content contains valid content when at least one of the following conditions is met: the ratio of the changed content to the content currently provided to the user is not less than a first predetermined threshold; The change content includes the content corresponding to the shared area; the change content includes the content corresponding to the specified event; the change content includes the user's interest object corresponding to the first terminal device and/or the other terminal device; the change content Contains operable objects.28.根据权利要求27所述的终端设备，其中，共享内容确定单元根据以下项之中的至少一项来确定所述终端设备对应的用户感兴趣对象：所述终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、所述终端设备对应的用户属性；28. The terminal device according to claim 27, wherein the shared content determining unit determines the user interest object corresponding to the terminal device according to at least one of the following items: the user behavior corresponding to the terminal device, the Describe the association relationship between objects in the content currently provided for the user, the scene corresponding to the content currently provided for the user, and the user attributes corresponding to the terminal device;和/或，共享内容确定单元根据以下项之中的至少一项来确定所述另一终端设备对应的用户感兴趣对象：所述另一终端设备对应的用户行为、所述另一终端设备对应的用户属性；And/or, the shared content determining unit determines the user interest object corresponding to the other terminal device according to at least one of the following items: user behavior corresponding to the other terminal device, user behavior corresponding to the other terminal device, user properties;和/或，所述共享区域包括以下区域之中的至少一项：针对所述终端设备设置的共享区域、针对所述另一终端设备设置的共享区域、所述终端设备对应的用户感兴趣对象所在的区域、所述另一终端设备对应的用户感兴趣对象所在的区域；And/or, the sharing area includes at least one of the following areas: a sharing area set for the terminal device, a sharing area set for the other terminal device, and a user interest object corresponding to the terminal device The area where the other terminal device is located, the area where the object of interest of the user corresponding to the other terminal device is located;和/或，所述变化内容是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容。And/or, the changed content is part of the content currently provided to the user that has changed compared with the shared content sent last time.29.根据权利要求27所述的终端设备，其中，29. The terminal device of claim 27, wherein:共享内容确定单元当确定满足下述至少一项时，在所述终端设备当前为用户提供的内容中确定待共享给所述另一终端设备的共享内容：The shared content determining unit determines the shared content to be shared with the other terminal device from the content currently provided by the terminal device to the user when at least one of the following is satisfied:所述终端设备的运动速度不大于第二预定阈值；The movement speed of the terminal device is not greater than a second predetermined threshold;当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、所述终端设备对应的用户感兴趣对象、所述另一终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。The content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the user's interested object corresponding to the terminal device, the user's interested object corresponding to the other terminal device, operable objects, and valid At least one item of the change content of the content.30.根据权利要求25至29任一项所述的终端设备，其中，30. The terminal device according to any one of claims 25 to 29, wherein,共享单元按照预设方式对所述共享内容进行重构，并将重构后的内容发送到所述另一终端设备进行共享。The sharing unit reconstructs the shared content according to a preset method, and sends the reconstructed content to the other terminal device for sharing.31.根据权利要求30所述的终端设备，其中，所述预设方式包括以下项之中的至少一项：31. The terminal device according to claim 30, wherein the preset mode includes at least one of the following items:获取包括所述共享内容的最小区域内的内容；obtaining the content within the smallest area including the shared content;根据所述另一终端设备的设备属性调整所述共享内容；adjusting the shared content according to the device attribute of the other terminal device;根据冗余区域对所述共享内容进行重构；reconstructing the shared content according to the redundant area;根据当前的网络状况调整所述共享内容；Adjust the shared content according to the current network conditions;基于所述终端设备对应的用户属性和/或所述另一终端设备对应的用户属性对所述共享内容进行校正；Correcting the shared content based on the user attribute corresponding to the terminal device and/or the user attribute corresponding to the another terminal device;基于过滤条件对所述共享内容进行过滤；filtering the shared content based on filtering conditions;根据所述终端设备和/或所述另一终端设备的用户针对共享内容的操作对共享内容进行优化。The shared content is optimized according to the operation of the user of the terminal device and/or the other terminal device on the shared content.32.根据权利要求25至29任一项所述的终端设备，还包括：32. The terminal device according to any one of claims 25 to 29, further comprising:操作信息接收单元，从所述另一终端设备接收用户针对接收到的共享内容进行操作的操作信息；An operation information receiving unit, configured to receive, from the other terminal device, operation information for the user to operate on the received shared content;执行单元，对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能。The executing unit executes the function corresponding to the received operation information on the content currently provided to the user.33.根据权利要求25至29任一项所述的终端设备，还包括：33. The terminal device according to any one of claims 25 to 29, further comprising:焦点获取单元，响应于用户对所述终端设备的外接操作设备的操作，获取所述当前为用户提供的内容中所述外接操作设备的操作焦点所在位置；a focus acquisition unit, in response to the user's operation on the external operation device of the terminal device, to obtain the operation focus position of the external operation device in the content currently provided to the user;焦点调整单元，当检测到所述外接操作设备发生无效移动时，将当前的操作焦点调整到移动前的操作焦点所在位置处。The focus adjustment unit adjusts the current operation focus to the position of the operation focus before the movement when invalid movement of the external operation device is detected.34.一种终端设备，包括：34. A terminal device comprising:共享内容接收单元，接收另一终端设备发送的共享内容，其中，所述共享内容为在所述另一终端设备当前为用户提供的内容中确定出的；The shared content receiving unit is configured to receive the shared content sent by another terminal device, wherein the shared content is determined from the content currently provided to the user by the other terminal device;显示单元，将接收到的共享内容进行显示；a display unit for displaying the received shared content;发送单元，用于向所述另一终端设备发送以下项之中的至少一项：用户从接收到的共享内容中选择的目标对象的位置信息、从所述另一终端设备的当前观看视角到目标对象对应的观看视角的运动路径。A sending unit, configured to send at least one of the following items to the other terminal device: the position information of the target object selected by the user from the received shared content, the current viewing angle from the other terminal device to The movement path of the viewing angle corresponding to the target object.35.根据权利要求34所述的终端设备，还包括：35. The terminal device of claim 34, further comprising:操作接收单元，用于接收用户针对接收到的共享内容进行操作的操作信息；an operation receiving unit, configured to receive operation information for the user to operate on the received shared content;其中，发送单元用于将所述操作信息发送给所述另一终端设备。Wherein, the sending unit is configured to send the operation information to the other terminal device.36.一种服务器，包括：36. A server comprising:获取单元，获取第一终端设备当前为用户提供的内容；an acquiring unit, configured to acquire content currently provided by the first terminal device to the user;共享内容确定单元，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容；The shared content determining unit is configured to determine the shared content to be shared with the second terminal device among the contents currently provided by the first terminal device to the user;共享单元，将确定出的共享内容发送到第二终端设备进行共享，a sharing unit, configured to send the determined shared content to the second terminal device for sharing,其中，所述服务器还包括：Wherein, the server also includes:接收单元，从第二终端设备接收：用户从接收到的共享内容中选择的目标对象的位置信息；The receiving unit receives from the second terminal device: the location information of the target object selected by the user from the received shared content;路径确定单元，根据接收到的所述位置信息确定第一终端设备的当前观看视角到目标对象对应的观看视角的运动路径，并将所述运动路径发送到第一终端设备。The path determination unit is configured to determine a movement path from the current viewing angle of the first terminal device to the viewing angle corresponding to the target object according to the received position information, and send the movement path to the first terminal device.37.根据权利要求36所述的服务器，还包括：37. The server of claim 36, further comprising:操作信息接收单元，从第二终端设备接收用户针对接收到的共享内容进行操作的操作信息；An operation information receiving unit, configured to receive, from the second terminal device, operation information for the user to operate on the received shared content;执行单元，对所述当前为用户提供的内容，执行与接收到的操作信息对应的功能，并将所述操作信息发送到第一终端设备。The execution unit executes the function corresponding to the received operation information on the content currently provided to the user, and sends the operation information to the first terminal device.38.根据权利要求36所述的服务器，其中，第一终端设备当前为用户提供的内容是第一终端设备当前向用户显示的内容，其中，获取单元包括：38. The server according to claim 36, wherein the content currently provided by the first terminal device to the user is the content currently displayed by the first terminal device to the user, wherein the obtaining unit comprises:全景视图获取单元，获取第一终端设备当前的全景视图；a panoramic view acquiring unit, configured to acquire the current panoramic view of the first terminal device;视角信息接收单元，接收第一终端设备对应的当前观看视角信息；a viewing angle information receiving unit, configured to receive current viewing viewing angle information corresponding to the first terminal device;确定单元，根据所述当前观看视角信息和当前的全景视图来确定第一终端设备当前向用户显示的内容。The determining unit is configured to determine the content currently displayed to the user by the first terminal device according to the current viewing angle information and the current panoramic view.39.根据权利要求36所述的服务器，其中，第一终端设备和/或第二终端设备为虚拟现实设备。39. The server according to claim 36, wherein the first terminal device and/or the second terminal device is a virtual reality device.40.根据权利要求36所述的服务器，其中，共享内容确定单元根据下述中的至少一项确定待共享给第二终端设备的共享内容：第一终端设备对应的用户感兴趣对象、共享区域对应的内容、指定事件对应的内容、第二终端设备对应的用户感兴趣对象、包含有效内容的变化内容、第二终端设备的用户对接收到的共享内容的操作，40. The server according to claim 36, wherein the shared content determination unit determines the shared content to be shared with the second terminal device according to at least one of the following: the user's object of interest corresponding to the first terminal device, the shared area The corresponding content, the content corresponding to the specified event, the object of interest of the user corresponding to the second terminal device, the changed content including valid content, the operation of the user of the second terminal device on the received shared content,其中，所述指定事件包括系统相关事件、内容相关事件中的至少一项；Wherein, the specified event includes at least one of a system-related event and a content-related event;其中，共享内容确定单元在以下条件之中的至少一项被满足时，确定所述变化内容中包含有效内容：所述变化内容占当前为用户提供的内容的比率不小于第一预定阈值；所述变化内容包含共享区域对应的内容；所述变化内容包含指定事件对应的内容；所述变化内容包含第一终端设备和/或第二终端设备对应的用户感兴趣对象；所述变化内容包含可操作对象。Wherein, the shared content determination unit determines that the changed content contains valid content when at least one of the following conditions is met: the ratio of the changed content to the content currently provided to the user is not less than a first predetermined threshold; The changed content includes the content corresponding to the shared area; the changed content includes the content corresponding to the specified event; the changed content includes the object of interest of the user corresponding to the first terminal device and/or the second terminal device; the changed content includes operation object.41.根据权利要求40所述的服务器，其中，共享内容确定单元根据以下项之中的至少一项来确定第一终端设备对应的用户感兴趣对象：第一终端设备对应的用户行为、所述当前为用户提供的内容中各对象之间的关联关系、所述当前为用户提供的内容所对应的场景、第一终端设备对应的用户属性；41. The server according to claim 40, wherein the shared content determining unit determines the user interest object corresponding to the first terminal device according to at least one of the following items: user behavior corresponding to the first terminal device, the The association relationship between objects in the content currently provided to the user, the scene corresponding to the content currently provided to the user, and the user attribute corresponding to the first terminal device;和/或，共享内容确定单元根据以下项之中的至少一项来确定第二终端设备对应的用户感兴趣对象：第二终端设备对应的用户行为、第二终端设备对应的用户属性；And/or, the shared content determining unit determines the user interest object corresponding to the second terminal device according to at least one of the following items: user behavior corresponding to the second terminal device, user attribute corresponding to the second terminal device;和/或，所述共享区域包括以下区域之中的至少一项：针对第一终端设备设置的共享区域、针对第二终端设备设置的共享区域、第一终端设备对应的用户感兴趣对象所在的区域、第二终端设备对应的用户感兴趣对象所在的区域；And/or, the sharing area includes at least one of the following areas: a sharing area set for the first terminal device, a sharing area set for the second terminal device, and an area where the object of interest of the user corresponding to the first terminal device is located. area, the area where the object of interest of the user corresponding to the second terminal device is located;和/或，所述变化内容是当前为用户提供的内容相对于上一次发送的共享内容发生变化的部分内容。And/or, the changed content is part of the content currently provided to the user that has changed compared with the shared content sent last time.42.根据权利要求40所述的服务器，其中，42. The server of claim 40, wherein:共享内容确定单元当确定满足下述至少一项时，在第一终端设备当前为用户提供的内容中确定待共享给第二终端设备的共享内容：The shared content determining unit determines the shared content to be shared to the second terminal device from among the content currently provided by the first terminal device to the user when it is determined that at least one of the following is satisfied:第一终端设备的运动速度不大于第二预定阈值；the movement speed of the first terminal device is not greater than a second predetermined threshold;当前为用户提供的内容中包含共享区域对应的内容、指定事件对应的内容、第一终端设备对应的用户感兴趣对象、第二终端设备对应的用户感兴趣对象、可操作对象、包含有效内容的变化内容中的至少一项。The content currently provided to the user includes the content corresponding to the shared area, the content corresponding to the specified event, the object of interest of the user corresponding to the first terminal device, the object of interest of the user corresponding to the second terminal device, operable object, and the content containing valid content. At least one of the changed content.43.根据权利要求36至42任一项所述的服务器，其中，43. A server according to any one of claims 36 to 42, wherein共享单元按照预设方式对所述共享内容进行重构，并将重构后的内容发送到第二终端设备进行共享。The sharing unit reconstructs the shared content according to a preset method, and sends the reconstructed content to the second terminal device for sharing.44.根据权利要求43所述的服务器，其中，所述预设方式包括以下项之中的至少一项：44. The server according to claim 43, wherein the preset manner comprises at least one of the following:获取包括所述共享内容的最小区域内的内容；obtaining the content within the smallest area including the shared content;根据第二终端设备的设备属性调整所述共享内容；adjusting the shared content according to the device attribute of the second terminal device;根据冗余区域对所述共享内容进行重构；reconstructing the shared content according to the redundant area;根据当前的网络状况调整所述共享内容；Adjust the shared content according to the current network conditions;基于第一终端设备对应的用户属性和/或第二终端设备对应的用户属性对所述共享内容进行校正；correcting the shared content based on the user attributes corresponding to the first terminal device and/or the user attributes corresponding to the second terminal device;基于过滤条件对所述共享内容进行过滤；filtering the shared content based on filtering conditions;根据第一终端设备和/或第二终端设备的用户针对共享内容的操作对共享内容进行优化。The shared content is optimized according to the operation of the user of the first terminal device and/or the second terminal device on the shared content.45.根据权利要求36所述的服务器，还包括：45. The server of claim 36, further comprising:操作信息接收单元，从第一终端设备接收用户对第一终端设备当前为用户提供的内容进行操作的操作信息；An operation information receiving unit, configured to receive, from the first terminal device, operation information for the user to operate on content currently provided to the user by the first terminal device;执行单元，执行与接收到的操作信息对应的功能，以获取第一终端设备当前为用户提供的内容。The execution unit is configured to execute a function corresponding to the received operation information, so as to acquire the content currently provided by the first terminal device to the user.46.一种终端设备，其中，所述终端设备包括：46. A terminal device, wherein the terminal device comprises:处理器；processor;存储器，存储有计算机程序，当所述计算机程序被处理器执行时，实现如权利要求1至12之中任意一项所述的实现终端设备交互的方法。The memory stores a computer program, and when the computer program is executed by the processor, the method for realizing terminal device interaction according to any one of claims 1 to 12 is implemented.47.一种服务器，其中，所述服务器包括：47. A server, wherein the server comprises:处理器；processor;存储器，存储有计算机程序，当所述计算机程序被处理器执行时，实现如权利要求1至12之中任意一项所述的实现终端设备交互的方法。The memory stores a computer program, and when the computer program is executed by the processor, the method for realizing terminal device interaction according to any one of claims 1 to 12 is implemented.

Images