CN103699211A - Electronic equipment and interconnecting and control method thereof - Google Patents
Electronic equipment and interconnecting and control method thereofDownload PDFInfo
- Publication number
- CN103699211A CN103699211ACN201210374581.6ACN201210374581ACN103699211ACN 103699211 ACN103699211 ACN 103699211ACN 201210374581 ACN201210374581 ACN 201210374581ACN 103699211 ACN103699211 ACN 103699211A
- Authority
- CN
- China
- Prior art keywords
- slave
- position information
- relative
- master
- relative position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Telephone Function (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本申请涉及通信和控制技术，特别涉及一种电子设备及其互联和控制方法。The present application relates to communication and control technologies, in particular to an electronic device and its interconnection and control methods.
背景技术Background technique
人们对智能手机等电子设备的期待是便捷、强大的功能，操作的方便。一方面，从便捷的角度来说应该是体积小巧，携带方便为好；而另一方面，从功能强大的角度来讲，最好是能达到台式机的功能。从技术上讲，经过艰难的突破后，芯片可以做到足够的小，性能足够大，但是，也解决不了人们对大屏幕的期待和类似PC键盘的操作感觉，这就形成一个几乎无法解决的矛盾。What people expect from electronic devices such as smartphones is convenience, powerful functions, and easy operation. On the one hand, from the point of view of convenience, it should be compact and easy to carry; on the other hand, from the point of view of powerful functions, it is best to achieve the functions of a desktop computer. Technically speaking, after a difficult breakthrough, the chip can be made small enough and the performance is large enough, but it can't solve people's expectations for a large screen and the operating feeling similar to a PC keyboard, which forms an almost unsolvable problem. contradiction.
因此，目前存在一种需求是：实现一种既能将电子设备做得足够小巧，又能将电子设备的操纵性和性能都有大幅度提升。Therefore, there is a need at present: to realize a device that can not only make the electronic device compact enough, but also greatly improve the maneuverability and performance of the electronic device.
在现有技术中，如NFC、DLNA、M2M等均可以实现部分（电子）移动互联的功能，其中，上述移动互联技术的具体应用场景如下：In the existing technologies, such as NFC, DLNA, M2M, etc., can realize some (electronic) mobile Internet functions, among which, the specific application scenarios of the above mobile Internet technologies are as follows:
NFC-近场通信的问题，范围0.1m以内，主要应用在手机支付领域。The problem of NFC-near field communication, the range is within 0.1m, and it is mainly used in the field of mobile payment.
DLNA-主要应用于智能家居领域，完成媒体资源的共享。DLNA-mainly used in the field of smart home to complete the sharing of media resources.
M2M技术，以实现人与机器（Man to Machine）、机器与机器（Machine to Machine）之间畅通无阻、随时随地的通信。通过M2M技术提供的统一网络平台，能够实现数字化城市中的信息资源共享和数据资源共享，对硬件的操作主要是在传感器级别的，或者内容的共享。M2M technology to realize unimpeded, anytime, anywhere communication between man and machine (Man to Machine) and machine to machine (Machine to Machine). The unified network platform provided by M2M technology can realize the sharing of information resources and data resources in the digital city, and the operation of hardware is mainly at the sensor level, or the sharing of content.
虽然上述几种移动互联功能能够实现部分电子设备的互联，但是互联设备的范围有限，也不具备通用性，从而也就无法解决上面提到的电子设备的小巧与强大功能间的矛盾问题。Although the above-mentioned mobile interconnection functions can realize the interconnection of some electronic devices, the range of interconnected devices is limited, and they are not universal, so it is impossible to solve the contradiction between the small size and powerful functions of electronic devices mentioned above.
发明内容Contents of the invention
本申请提供一种电子设备及其互联和控制方法，为电子设备的组成设备间进行互联和控制提供了通用性更强的实现方式，进而使小巧的电子设备实现更强的操纵性和性能。The present application provides an electronic device and its interconnection and control method, which provides a more versatile implementation method for the interconnection and control among the components of the electronic device, thereby enabling the compact electronic device to achieve stronger maneuverability and performance.
一种电子设备的互联和控制方法，包括：A method for interconnection and control of electronic equipment, comprising:
a、作为主机的一电子设备与至少一个共享其组成设备且作为从机的电子设备建立连接；a. An electronic device acting as a master establishes a connection with at least one electronic device that shares its constituent devices and acts as a slave;
b、所述主机利用建立的所述连接获取所述从机共享的组成设备的属性信息；b. The host uses the established connection to obtain the attribute information of the component devices shared by the slave;
c、根据所述组成设备的属性信息对待执行的应用进行任务分配，根据分配给所述组成设备的任务操作并控制所述组成设备。c. Assign tasks to the applications to be executed according to the attribute information of the component devices, and operate and control the component devices according to the tasks assigned to the component devices.
较佳地，所述组成设备包括输入设备和/或输出设备。Preferably, the constituent devices include input devices and/or output devices.
较佳地，在所述步骤a和所述步骤c之间，该方法进一步包括：所述主机获取自身到所述从机的相对位置信息；Preferably, between the step a and the step c, the method further includes: the master obtains the relative position information of itself to the slave;
所述步骤c中进一步根据所述相对位置信息进行所述任务分配。In the step c, the task allocation is further performed according to the relative position information.
较佳地，所述主机获取自身到所述从机的相对位置信息包括：Preferably, the relative position information obtained by the master from itself to the slave includes:
所述主机接收输入的所述相对位置信息；The host receives the input relative position information;
或者，所述主机根据所述从机提供的位置信息确定所述相对位置信息；Or, the master determines the relative position information according to the position information provided by the slave;
或者，所述主机测量并确定所述相对位置信息。Alternatively, the host measures and determines the relative position information.
较佳地，所述相对位置信息包括：所述从机到所述主机的相对距离和相对方位；Preferably, the relative position information includes: the relative distance and relative orientation from the slave to the master;
所述主机根据从机提供的位置信息确定所述相对位置信息包括：所述主机获取所述从机测量的该从机到主机的相对距离，所述主机获取所述从机到自身的相对方位；The determining of the relative position information by the master according to the position information provided by the slave includes: the master obtains the relative distance from the slave to the master measured by the slave, and the master obtains the relative orientation from the slave to itself ;
所述主机测量并确定所述相对位置信息包括：所述主机测量自身到所述从机的相对距离以及所述从机到自身的相对方位。The master measuring and determining the relative position information includes: the master measuring the relative distance from itself to the slave and the relative orientation from the slave to itself.
较佳地，所述主机获取从机到自身的相对方位a的方式为：所述主机计算该相对方位a=2*∏*t/T，其中，t为360度的扫描周期内所述主机捕获所述从机的时间，T为360度的扫描周期时长。Preferably, the way for the host to obtain the relative orientation a from the slave to itself is: the host calculates the relative orientation a=2*∏*t/T, where t is the host within a scanning period of 360 degrees The time for capturing the slave, where T is the duration of the 360-degree scan cycle.
较佳地，当所述主机与至少两个从机连接、且其中第一从机在第二从机与所述主机间成为遮挡、所述第二从机和所述主机均无法测量相互之间的相对距离时，所述主机确定所述第二从机与自身的相对距离的方式包括：Preferably, when the master is connected to at least two slaves, and the first slave is blocked between the second slave and the master, neither the second slave nor the master can measure the mutual When the relative distance between the master and itself is determined by the master, the manner of determining the relative distance between the second slave and itself includes:
主机接收所述第一从机上报的第一从机与所述主机间的相对距离，对所述第一从机和第二从机进行拍照，根据照片中所述第一从机和第二从机的相对距离、以及所述第一从机与所述主机间的相对距离、所述主机的焦距和距离所述第一从机和第二从机所在平面的距离，计算所述主机与所述第二从机间的相对距离。The master receives the relative distance between the first slave and the master reported by the first slave, takes a photo of the first slave and the second slave, and according to the first slave and the second slave in the photo The relative distance of the slave, the relative distance between the first slave and the master, the focal length of the master and the distance from the plane where the first slave and the second slave are located, calculate the distance between the master and the plane where the first slave and the second slave are located. The relative distance between the second slaves.
较佳地，所述相对位置信息包括：所述从机相对于所述主机的摆放方向；Preferably, the relative position information includes: the placement direction of the slave relative to the master;
所述主机根据从机提供的位置信息确定所述相对位置信息中的摆放方向包括：所述主机获取自身摆放的绝对方向和所述从机发送的从机自身摆放的绝对方向，并将自身摆放的绝对方向与所述从机摆放绝对方向间的夹角作为所述从机相对于所述主机的摆放方向。The master determines the placement direction in the relative position information according to the position information provided by the slave, including: the master obtains the absolute direction of its own placement and the absolute direction of the slave itself sent by the slave, and The included angle between the absolute direction in which the slave is placed and the absolute direction in which the slave is placed is taken as the direction in which the slave is placed relative to the master.
较佳地，当所述应用为可视电话应用、所述从机共享的组成设备为音视频输入输出设备时，所述主机与一个从机建立连接，步骤c中所述主机根据所述组成设备的属性信息对待执行的应用进行任务分配包括：Preferably, when the application is a videophone application and the component device shared by the slave is an audio and video input and output device, the host establishes a connection with a slave, and in step c, the host establishes a connection according to the composition The attribute information of the device is used to assign tasks to the application to be executed, including:
所述主机和从机中的一个作为语音输入输出设备，另一个作为视频输入输出设备；或One of the host and the slave is used as a voice input and output device, and the other is used as a video input and output device; or
所述主机和从机中的一个作为语音输入以及视频输入设备，另一个作为语音输出以及视频输出设备。One of the host and the slave is used as a voice input and video input device, and the other is used as a voice output and video output device.
较佳地，预先设置多种联机策略，在进行任务分配或者操作并控制所述组成设备时进一步根据选择的最佳联机策略进行。Preferably, multiple online strategies are preset, and the optimal online strategy is further selected when performing task assignment or operating and controlling the component devices.
较佳地，所述联机策略包括设备利用率最大化策略和/或用户感受最佳策略和/或特定应用策略。Preferably, the online policy includes a policy for maximizing equipment utilization and/or a policy for optimizing user experience and/or a policy for a specific application.
较佳地，当所述应用为位置依赖型的输入输出应用、且所述从机共享的组成设备包括屏幕、且所述相对位置信息包括所述从机相对于所述主机的摆放方向时；Preferably, when the application is a position-dependent input and output application, and the component device shared by the slave includes a screen, and the relative position information includes the placement direction of the slave relative to the host ;
所述进行任务分配包括：所述主机和从机中的部分屏幕作为输入设备，其他屏幕作为输出设备；The task allocation includes: part of the screens in the master and the slave are used as input devices, and other screens are used as output devices;
若所述选择的策略为用户感受最佳策略，则操作并控制所述组成设备包括：根据所述从机相对于主机的摆放方向在所述从机的屏幕上进行显示，使从机的显示正向与主机的显示正向平行；If the selected strategy is the best strategy for user experience, then operating and controlling the component devices includes: displaying on the screen of the slave according to the placement direction of the slave relative to the master, so that the The display direction is parallel to the display direction of the host;
若所述选择的策略为设备利用率最大化策略，则操作并控制所述组成设备包括：根据所述从机的屏幕属性进行显示，使所有参与联机显示的电子设备的屏幕利用率最大化。If the selected strategy is a device utilization maximization strategy, then operating and controlling the component devices includes: displaying according to the screen attributes of the slaves, so as to maximize the screen utilization of all electronic devices participating in the online display.
较佳地，当所述应用为多屏互联显示应用、且所述从机共享的组成设备包括屏幕、且所述相对位置信息包括所述从机相对于所述主机的摆放方向时；Preferably, when the application is a multi-screen interconnected display application, and the component devices shared by the slave include screens, and the relative position information includes the placement direction of the slave relative to the host;
所述进行任务分配包括：将主机和从机的屏幕均作为输出设备，并根据主机和从机的屏幕属性、多屏互联后的目标输出尺寸和所述相对位置信息分配主机和从机的输出内容；The task allocation includes: using the screens of the master and the slave as output devices, and assigning the output of the master and the slave according to the screen properties of the master and the slave, the target output size after multi-screen interconnection, and the relative position information content;
若所述选择的策略为用户感受最佳策略，则操作并控制所述组成设备包括：根据所述从机相对于主机的摆放方向在屏幕上进行显示，使从机的显示正向与主机的显示正向平行；If the selected strategy is the best strategy for user experience, then operating and controlling the component devices includes: displaying on the screen according to the placement direction of the slave relative to the master, so that the display of the slave is in the same direction as the master The display is positively parallel;
若所述选择的策略为设备利用率最大化策略，则操作控制所述组成设备包括：根据所述从机的屏幕属性进行显示，使从机的屏幕利用率最大化。If the selected strategy is a device utilization maximization strategy, then operating and controlling the component devices includes: displaying according to the screen attributes of the slaves, so as to maximize the screen utilization of the slaves.
较佳地，当所述应用为音频输出应用、且所述从机共享的组成设备包括音频输出设备、且所述相对位置信息包括所述从机到所述主机的相对距离和相对方位时，Preferably, when the application is an audio output application, and the component device shared by the slave includes an audio output device, and the relative position information includes the relative distance and relative orientation from the slave to the master,
若所述选择的策略为设备利用率最大化策略，则所述进行任务分配包括：将输出的音频分成N个声道，每个音频输出设备输出一个声道的内容，并根据所述从机到主机的相对距离和相对方位，确定从机的每个音频输出设备的声道类型；其中，N为所述应用中主机和从机的总数；If the selected strategy is the device utilization maximization strategy, then the task allocation includes: dividing the output audio into N channels, and each audio output device outputs the content of one channel, and according to the slave To the relative distance and relative orientation of the host, determine the channel type of each audio output device of the slave; wherein, N is the total number of the host and the slave in the application;
若选择的策略为用户感受最佳策略，则所述进行任务分配包括：将主旋律的音频内容分成两个声道，其他声道根据播放模式输出不同的低音效果内容，并根据所述相对位置信息确定所述从机的音频输出设备输出的声道类型。If the selected strategy is the best strategy for user experience, then the task allocation includes: dividing the audio content of the main theme into two channels, and the other channels output different bass effect content according to the playback mode, and according to the relative position information Determine the channel type output by the audio output device of the slave.
较佳地，当所述应用为集成3D摄影应用、且所述从机共享的组成设备包括视频输入设备、且所述相对位置信息包括所述从机到所述主机的相对距离和相对方位时，Preferably, when the application is an integrated 3D photography application, and the component device shared by the slave includes a video input device, and the relative position information includes the relative distance and relative orientation from the slave to the host ,
所述操作并控制所述组成设备包括：操作并控制所述从机的视频输入设备进行视频获取；The operating and controlling the component device includes: operating and controlling the video input device of the slave machine to acquire video;
在所述步骤c后，该方法进一步包括：接收主机和从机获取的视频，并根据所述相对位置信息，对获取的视频进行统一处理，形成3D图像。After the step c, the method further includes: receiving the videos acquired by the master and the slaves, and performing unified processing on the acquired videos according to the relative position information to form a 3D image.
较佳地，该方法进一步包括：所述主机周期性获取所述相对位置信息，当所述相对位置信息发生变化时，根据变化后的相对位置信息重新进行所述任务分配。Preferably, the method further includes: the host periodically acquires the relative position information, and when the relative position information changes, redoes the task allocation according to the changed relative position information.
一种电子设备，包括：连接控制单元和操作控制单元；An electronic device, comprising: a connection control unit and an operation control unit;
所述连接控制单元，用于与至少一个共享其组成设备且作为从机的设备建立连接，并利用建立的连接获取所述从机共享的组成设备的属性信息；The connection control unit is configured to establish a connection with at least one device that shares its constituent devices and acts as a slave, and uses the established connection to obtain attribute information of the constituent devices shared by the slave;
所述操作控制单元，用于根据所述连接控制单元保存的所述组成设备的属性信息对待执行的应用进行任务分配，根据分配给所述组成设备的任务操作并控制所述组成设备。The operation control unit is configured to assign tasks to applications to be executed according to the attribute information of the component devices stored by the connection control unit, and operate and control the component devices according to the tasks assigned to the component devices.
较佳地，所述电子设备的组成设备包括输入设备和/或输出设备。Preferably, the components of the electronic device include input devices and/or output devices.
较佳地，所述电子设备进一步包括相对位置信息获取单元，用于获取自身到所述从机的相对位置信息；Preferably, the electronic device further includes a relative position information acquisition unit, configured to acquire relative position information from itself to the slave;
所述操作控制单元，用于进一步根据所述相对位置信息获取单元获取的自身到所述从机的相对位置信息，操作并控制所述从机共享的组成设备。The operation control unit is configured to further operate and control the component equipment shared by the slave according to the relative position information of itself and the slave acquired by the relative position information acquisition unit.
较佳地，所述相对位置信息包括：所述从机相对于所述主机的相对距离和相对方位；且Preferably, the relative position information includes: the relative distance and relative orientation of the slave relative to the master; and
所述相对位置信息获取单元，进一步用于接收输入的所述相对位置信息；或者，The relative position information acquiring unit is further configured to receive the input relative position information; or,
所述相对位置信息获取单元包括相对距离获取子单元和相对方位获取子单元，所述相对距离获取子单元用于接收所述从机测量的该从机到自身的相对距离；所述相对方位获取子单元，用于获取所述从机到自身的相对方位；或者，The relative position information acquisition unit includes a relative distance acquisition subunit and a relative orientation acquisition subunit, the relative distance acquisition subunit is used to receive the relative distance from the slave to itself measured by the slave; the relative orientation acquisition A subunit, configured to obtain the relative orientation from the slave to itself; or,
所述相对位置信息获取单元，进一步用于测量自身到所述从机的相对距离以及所述从机到自身的相对方位。The relative position information acquisition unit is further configured to measure the relative distance from itself to the slave and the relative orientation from the slave to itself.
较佳地，所述相对位置信息包括所述从机相对于自身的摆放方向；且Preferably, the relative position information includes the placement direction of the slave relative to itself; and
所述相对位置信息获取单元包括接收子单元和确定子单元，所述接收子单元，用于接收所述从机发送的从机自身摆放的绝对方向；所述确定子单元，用于测量自身的摆放正向，并将所述自身摆放的绝对方向与所述从机摆放绝对方向间的夹角作为所述从机相对于自身的摆放方向。The relative position information acquisition unit includes a receiving subunit and a determination subunit, the receiving subunit is used to receive the absolute direction of the slave itself sent by the slave; the determination subunit is used to measure its own The placement direction of the slave is forward, and the angle between the absolute direction of the self placement and the absolute direction of the slave placement is taken as the placement direction of the slave relative to itself.
较佳地，所述电子设备进一步包括遮挡从机相对距离获取单元，当所述电子设备与至少两个从机连接、且其中第一从机在第二从机与自身间成为遮挡、所述第二从机和所述电子设备均无法测量相互之间的相对距离时，用于对所述第一从机和第二从机进行拍照，根据照片中所述第一从机和第二从机的相对距离、所述相对位置信息获取单元获取的自身与第一从机间的相对距离、自身的焦距和距离所述第一从机和第二从机所在平面的距离，计算自身与所述第二从机间的相对距离。Preferably, the electronic device further includes a blocking slave relative distance acquisition unit, when the electronic device is connected to at least two slaves, and the first slave is blocked between the second slave and itself, the When neither the second slave nor the electronic device can measure the relative distance between each other, it is used to take pictures of the first slave and the second slave, according to the first slave and the second slave in the photo The relative distance of the machine, the relative distance between itself and the first slave obtained by the relative position information acquisition unit, the focal length of itself and the distance from the plane where the first slave and the second slave are located, calculate the distance between itself and the first slave Describe the relative distance between the second slaves.
较佳地，所述操作控制单元包括任务分配子单元和控制子单元；当所述应用为可视电话应用、所述从机共享的组成设备为音视频输入输出设备时，所述电子设备与一个从机建立连接，Preferably, the operation control unit includes a task allocation subunit and a control subunit; when the application is a videophone application and the component device shared by the slave is an audio and video input and output device, the electronic device and A slave establishes a connection,
所述任务分配子单元，用于分配自身和从机中的一个作为语音输入输出设备，另一个作为视频输入输出设备；或者，用于分配自身和从机中的一个作为语音输入以及视频输入设备，另一个作为语音输出以及视频输出设备；The task allocation subunit is used to assign one of itself and the slave as a voice input and output device, and the other as a video input and output device; or, for assigning one of itself and the slave as a voice input and video input device , the other as a voice output and video output device;
所述控制子单元，用于按照所述任务分配子单元分配的任务，控制所述从机进行相应的输入输出。The control subunit is configured to control the slave to perform corresponding input and output according to the tasks assigned by the task assignment subunit.
较佳地，所述电子设备进一步包括策略预置单元和当前策略选择单元；Preferably, the electronic device further includes a policy preset unit and a current policy selection unit;
所述策略预置单元，用于通过预先设置保存多种联机策略；The policy preset unit is used to save multiple online policies through preset settings;
所述当前策略选择单元，用于从所述策略预置单元保存的多种联机策略中选择当前应用采用的联机策略，并发送给所述操作控制单元；The current policy selection unit is configured to select the online policy adopted by the current application from the multiple online policies stored in the policy preset unit, and send it to the operation control unit;
所述操作控制单元，进一步用于根据选择的当前应用采用的联机策略，进行任务分配或者操作并控制所述组成设备。The operation control unit is further configured to perform task assignment or operate and control the component devices according to the selected online strategy adopted by the current application.
较佳地，所述操作控制单元包括任务分配子单元和控制子单元；当所述应用为位置依赖型的输入输出应用、且所述从机共享的组成设备包括屏幕、且所述相对位置信息包括所述从机相对于自身的摆放方向时，Preferably, the operation control unit includes a task allocation subunit and a control subunit; when the application is a position-dependent input and output application, and the component device shared by the slave includes a screen, and the relative position information When including the placement direction of the slave relative to itself,
所述任务分配子单元，用于将自身和所述从机中的部分屏幕作为输入设备，其他屏幕作为输出设备；The task allocation subunit is used to use itself and some screens in the slave as input devices, and other screens as output devices;
所述控制子单元，用于接收所述当前策略选择单元发送的联机策略；在所述当前策略选择单元发来用户感受最佳策略时，根据所述从机相对于自身的摆放方向和所述任务分配子单元分配的输出内容，控制所述从机屏幕上的内容显示，使从机的显示正向与自身的显示正向平行；在所述当前策略选择单元发来设备利用率最大化策略时，根据所述从机的屏幕属性和所述任务分配子单元分配的输出内容，控制所述从机的内容显示，使所有参与联机显示的电子设备的屏幕利用率最大化。The control subunit is used to receive the online strategy sent by the current strategy selection unit; when the current strategy selection unit sends the best strategy for the user to experience, according to the placement direction of the slave relative to itself and the The output content assigned by the task allocation subunit controls the content display on the screen of the slave, so that the display of the slave is positively parallel to the display of itself; the utilization rate of the device sent by the current strategy selection unit is maximized In strategy, according to the screen attributes of the slaves and the output content assigned by the task allocation subunit, the content display of the slaves is controlled, so as to maximize the screen utilization of all electronic devices participating in the online display.
较佳地，所述操作控制单元包括任务分配子单元和控制子单元；当所述应用为多屏互联显示应用、且所述从机共享的组成设备包括屏幕、且所述相对位置信息包括所述从机相对于自身的摆放方向时；Preferably, the operation control unit includes a task allocation subunit and a control subunit; when the application is a multi-screen interconnected display application, and the component devices shared by the slave include screens, and the relative position information includes the When describing the placement direction of the slave relative to itself;
所述任务分配子单元，用于将自身和从机的屏幕均作为输出设备，并根据自身和从机的屏幕属性、多屏互联后的目标输出尺寸和所述相对位置信息分配自身和从机的输出内容；The task allocation subunit is used to use the screens of itself and the slave as output devices, and allocate itself and the slave according to the screen attributes of itself and the slave, the target output size after multi-screen interconnection, and the relative position information. output content of
所述控制子单元，用于接收所述当前策略选择单元发送的联机策略；在所述当前策略选择单元发来用户感受最佳策略时，根据所述从机相对于自身的摆放方向和所述任务分配子单元分配的输出内容，控制自身和从机屏幕上的内容显示，使从机的显示正向与自身的显示正向平行；在所述当前策略选择单元发来设备利用率最大化策略时，根据所述从机的屏幕属性和所述任务分配子单元分配的输出内容，控制所述从机的内容显示，使从机的屏幕利用率最大化。The control subunit is used to receive the online strategy sent by the current strategy selection unit; when the current strategy selection unit sends the best strategy for the user to experience, according to the placement direction of the slave relative to itself and the The output content assigned by the task allocation subunit controls the content display on the screen of itself and the slave machine, so that the display of the slave machine is positively parallel to the display of its own; the utilization rate of the equipment sent by the current strategy selection unit is maximized In strategy, according to the screen attributes of the slaves and the output content assigned by the task assignment subunit, the content display of the slaves is controlled to maximize the screen utilization of the slaves.
较佳地，所述操作控制单元包括任务分配子单元和控制子单元；当所述应用为音频输出应用、且所述从机共享的组成设备包括音频输出设备、且所述相对位置信息包括所述从机到自身的相对距离和相对方位时，Preferably, the operation control unit includes a task allocation subunit and a control subunit; when the application is an audio output application, and the component device shared by the slave includes an audio output device, and the relative position information includes the When describing the relative distance and relative orientation from the slave to itself,
所述任务分配子单元，用于接收所述当前策略选择单元发送的联机策略；在所述当前策略选择单元发来用户感受最佳策略时，将主旋律的音频内容分成两个声道，其他声道根据播放模式输出不同的低音效果内容，并根据所述相对位置信息确定所述从机的音频输出设备输出的声道类型；在所述当前策略选择单元发来设备利用率最大化策略时，将输出的音频分成N个声道，每个音频输出设备输出一个声道的内容，并根据所述从机到所述电子设备的相对距离和相对方位，确定从机的每个音频输出设备的声道类型；其中，N为所述应用中所述电子设备和从机的总数；The task allocation subunit is used to receive the online strategy sent by the current strategy selection unit; when the current strategy selection unit sends the best strategy for the user to feel, divide the audio content of the main theme into two channels, and the other audio channels The channel outputs different bass effect content according to the playback mode, and determines the channel type output by the audio output device of the slave according to the relative position information; when the current strategy selection unit sends a device utilization maximization strategy, Divide the output audio into N channels, each audio output device outputs the content of one channel, and determine the position of each audio output device of the slave according to the relative distance and relative orientation from the slave to the electronic device channel type; wherein, N is the total number of electronic devices and slaves in the application;
所述控制子单元，用于根据任务分配子单元分配的任务进行所述从机的控制。The control subunit is configured to control the slave according to the tasks assigned by the task assignment subunit.
较佳地，当所述应用为集成3D摄影应用、且所述从机共享的组成设备包括视频输入设备、且所述相对位置信息包括所述从机到自身的相对距离和相对方位时，Preferably, when the application is an integrated 3D photography application, and the component device shared by the slave includes a video input device, and the relative position information includes the relative distance and relative orientation from the slave to itself,
所述操作控制单元，进一步用于操作并控制所述从机的视频输入设备进行视频获取。The operation control unit is further configured to operate and control the video input device of the slave machine to acquire video.
较佳地，所述相对位置信息获取单元，进一步用于周期性获取所述相对位置信息，当所述相对位置信息发生变化时，通知所述操作控制单元；Preferably, the relative position information obtaining unit is further configured to periodically obtain the relative position information, and notify the operation control unit when the relative position information changes;
所述操作控制单元，进一步用于根据变化后的相对位置信息重新进行所述任务分配。The operation control unit is further configured to redo the assignment of tasks according to the changed relative position information.
较佳地，所述连接控制单元，进一步用于向建立连接的对端设备发送退出连接的请求，并在对端同意退出后，从所述连接控制单元中删除所述退出的连接中相关组成设备的属性信息，断开所述退出的连接。Preferably, the connection control unit is further configured to send a request for exiting the connection to the peer device that established the connection, and after the peer device agrees to exit, delete the relevant components in the exited connection from the connection control unit property information of the device, and disconnect the exited connection.
由上述技术方案可见，本申请中主机向从机发出连接请求，其中，从机共享其组成设备；在从机允许连接后，建立主机和从机间的连接；从机利用建立的连接将其共享的组成设备的属性信息发送给主机，供主机对组成设备进行操作和控制；主机利用从机组成设备的属性信息对待执行的应用进行任务分配，操作和控制从机共享的组成设备。通过上述方式，为电子设备的组成设备进行互联操控提供了一种通用性更强的实现方式，连接的多个电子设备可以共享其组成设备，并基于共享的组成设备共同协助完成应用，从而实现更丰富的应用和更强的运算能力。It can be seen from the above-mentioned technical scheme that in the present application, the host sends a connection request to the slave, wherein the slave shares its component equipment; after the slave allows the connection, the connection between the host and the slave is established; the slave utilizes the established connection to connect its The attribute information of the shared component device is sent to the host for the host to operate and control the component device; the host uses the attribute information of the slave component device to assign tasks to the application to be executed, operate and control the component device shared by the slave. Through the above method, a more versatile implementation method is provided for the interconnection and control of the component devices of electronic devices. Multiple connected electronic devices can share their component devices, and based on the shared component devices, they can cooperate to complete the application, thereby realizing Richer applications and stronger computing power.
附图说明Description of drawings
图1为本申请电子设备的协议栈结构示意图；Fig. 1 is the schematic diagram of the protocol stack structure of the electronic equipment of the present application;
图2为本申请中的电子设备互联和控制方法的具体流程图；FIG. 2 is a specific flowchart of the electronic device interconnection and control method in the present application;
图3为相对位置信息的示意图；Fig. 3 is a schematic diagram of relative position information;
图4为双机互联时位置依赖型的输入输出应用示意图；Figure 4 is a schematic diagram of a position-dependent input and output application when two machines are interconnected;
图5为三机互联的音响系统应用示意图；Figure 5 is a schematic diagram of the application of the audio system of the three-machine interconnection;
图6a和图6b分别为双机互联显示的位置示意图一和示意图二；Figure 6a and Figure 6b are schematic diagrams 1 and 2 of the positions displayed by the dual-machine interconnection, respectively;
图7a和图7b分别为三机互联显示的位置示意图一和示意图二；Figure 7a and Figure 7b are schematic diagrams 1 and 2 of the locations displayed by the three-machine interconnection, respectively;
图8为四机互联显示清明上河图的示意图；Fig. 8 is a schematic diagram of four-computer interconnection displaying the Qingming Festival;
图9为四机互联显示的示意图一；Figure 9 is a schematic diagram 1 of four-device interconnection display;
图10为四机互联显示的示意图二；Figure 10 is the second schematic diagram of the four-device interconnection display;
图11为四机互联显示的示意图三；Figure 11 is the third schematic diagram of the four-device interconnection display;
图12为特定应用策略下图片显示的示意图；FIG. 12 is a schematic diagram of picture display under a specific application policy;
图13为本申请中电子设备的具体结构示意图。FIG. 13 is a schematic diagram of the specific structure of the electronic device in this application.
具体实施方式Detailed ways
为了使本申请的目的、技术手段和优点更加清楚明白，以下结合附图对本申请做进一步详细说明。In order to make the purpose, technical means and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings.
本申请中的电子设备通常具备图1所示的协议栈结构，从而保证不同电子设备可以实现互联和相互操作。如图1所示，该协议栈结构包括应用层、互联层、承载层和设备层。其中，本申请通过在互联层引入对设备的连接管理，从而实现不同设备间的通用性互联和控制；应用层主要面向用户，可以提供多设备互联的应用和业务；承载层主要用于支持电子设备的互联，其中包括多种协议层，例如，设备发现、设备（如UPNP）、传输层（支持TCP/IP等）、物理层（支持以太网、WLAN、蓝牙等）；设备层可以由中间件、驱动以及硬件（屏、音频、传感器等）组成。The electronic devices in this application usually have the protocol stack structure shown in FIG. 1 , so as to ensure that different electronic devices can be interconnected and interoperable. As shown in Figure 1, the protocol stack structure includes an application layer, an interconnection layer, a bearer layer and a device layer. Among them, this application introduces the connection management of devices at the interconnection layer, so as to realize the universal interconnection and control between different devices; the application layer is mainly user-oriented, and can provide applications and services for multi-device interconnection; the bearer layer is mainly used to support electronic Interconnection of devices, including multiple protocol layers, for example, device discovery, device (such as UPNP), transport layer (supporting TCP/IP, etc.), physical layer (supporting Ethernet, WLAN, Bluetooth, etc.); the device layer can be composed of intermediate components, drivers and hardware (screen, audio, sensor, etc.).
具体地，本申请中电子设备的互联和控制方法的基本流程包括：Specifically, the basic flow of the interconnection and control method of electronic equipment in this application includes:
步骤a、电子设备共享其组成设备；Step a, the electronic equipment shares its component equipment;
这里，共享的组成设备可以是任意硬件单元，例如：Here, the shared component device can be any hardware unit, for example:
1）计算设备，包括CPU和内存等；1) Computing equipment, including CPU and memory, etc.;
2）输入设备，包括屏、按键和摄像头等；2) Input devices, including screens, buttons, and cameras;
3）输出设备，包括屏、耳机插口、听筒和喇叭等；3) Output devices, including screens, headphone jacks, earpieces and speakers, etc.;
4）通信设备，包括WIFI单元和3G单元等。4) Communication equipment, including WIFI unit and 3G unit, etc.
电子设备可以根据需要共享自身的组成设备。尤其是，本申请对于输入输出设备进行共享，从而利用后续的处理过程，可以实现对于其他电子设备的输入输出设备的操作和控制。Electronic devices can share their constituent devices as needed. In particular, the present application shares the input and output devices, so that the operation and control of the input and output devices of other electronic devices can be realized through subsequent processing.
步骤b、主机向至少一个从机发出连接请求，在从机允许连接后，建立主机和从机间的连接；Step b, the host sends a connection request to at least one slave, and establishes a connection between the host and the slave after the slave allows the connection;
任何一台上述电子设备都可以作为主机发起连接，主机在连接建立过程具有主要的控制功能。作为主机的电子设备可以共享自身的组成设备也可以不共享。作为从机的电子设备一定需要通过步骤a共享自身的组成设备，只有共享的组成设备才能在后续处理中供主机操作和控制。从机接收主机的连接请求后，可以手动确认，完成鉴权。Any one of the above-mentioned electronic devices can serve as a host to initiate a connection, and the host has a main control function during the connection establishment process. An electronic device serving as a host may or may not share its constituent devices. An electronic device as a slave must share its own component devices through step a, and only the shared component devices can be operated and controlled by the host in subsequent processing. After receiving the connection request from the master, the slave can manually confirm and complete the authentication.
步骤c、从机利用建立的连接将自身共享的组成设备的属性信息发送给主机；Step c, the slave uses the established connection to send the attribute information of the component devices shared by itself to the master;
主机将与自身连接的各个从机共享的组成设备的属性信息进行统一保存。其中，属性信息主要包括组成设备的相关参数，例如，屏幕分辨率、内存大小等，优选地，其中还可以包括句柄，主机利用该句柄可以实现对从机共享组成设备的操作。The host computer uniformly saves the attribute information of the constituent devices shared with each slave computer connected to itself. Wherein, the attribute information mainly includes relevant parameters of the component devices, such as screen resolution, memory size, etc., preferably, it may also include a handle, and the master can use the handle to realize the operation of the slave shared component devices.
步骤d、主机根据组成设备的属性信息和应用的需求进行任务分配，根据分配给各从机的组成设备的任务，操作并控制相应的组成设备。Step d. The master assigns tasks according to the attribute information of the constituent devices and application requirements, and operates and controls the corresponding constituent devices according to the tasks assigned to the constituent devices of each slave.
对于需要进行的应用，主机进行任务分配，在任务分配时参考统一保存的各从机组成设备的属性信息（例如屏幕尺寸、分辨率、输入输出类型等），统一调配各从机的组成设备，联机实现应用的需求，再根据任务分配的内容，操作并控制共享的各组成设备。For the application that needs to be carried out, the host assigns tasks. When assigning tasks, it refers to the attribute information of each slave device that is stored uniformly (such as screen size, resolution, input and output type, etc.), and uniformly deploys the constituent devices of each slave. Realize the requirements of the application online, and then operate and control the shared components according to the content of the task assignment.
至此，本申请中最基本的电子设备互联和控制方法流程结束。在上述方法流程中，基于特殊的应用需求，可以利用从机手动进行连接鉴权，以保障从机组成设备操作的安全性。同时，上述流程中，通过电子设备的互联，能够对电子设备的任意共享硬件设备进行操作，使小巧的电子设备实现更强的操纵性和性能，带给用户更丰富的应用体验。So far, the flow of the most basic electronic device interconnection and control method in this application is completed. In the process of the above method, based on special application requirements, the slave machine can be used to manually perform connection authentication, so as to ensure the security of the device operation of the slave machine. At the same time, in the above process, through the interconnection of electronic devices, any shared hardware device of the electronic device can be operated, so that the compact electronic device can achieve stronger operability and performance, and bring users a richer application experience.
进一步地，在上述电子设备互联和控制方法中，还可以利用建立的连接传输主机和从机的位置关系信息，主机可以依照位置关系信息，更好地进行任务分配和组成设备的操作与控制。并且，考虑到对于各种不同的需求，可以预先设置多种联机策略，根据实际需求采用选择的最佳联机策略进行任务分配和/或对从机进行操作控制，以带给用户更多的选择和更丰富的应用体验。Further, in the above electronic device interconnection and control method, the established connection can also be used to transmit the positional relationship information between the master and the slaves, and the master can better perform task assignment and operation and control of component devices according to the positional relationship information. Moreover, considering various requirements, multiple online strategies can be set in advance, and the optimal online strategy can be selected according to actual needs for task assignment and/or operation control for slave machines, so as to bring more choices to users and a richer application experience.
下面通过图2所示的流程对本申请中的电子设备互联和控制方法进行详细介绍。如图2所示，该流程具体包括：The electronic device interconnection and control method in this application will be described in detail below through the process shown in FIG. 2 . As shown in Figure 2, the process specifically includes:
步骤201，电子设备将自身的组成设备共享。In step 201, the electronic device shares its constituent devices.
步骤202，主机向至少一个从机发起连接请求，在从机允许连接后，建立主机和从机间的连接。Step 202, the master initiates a connection request to at least one slave, and establishes a connection between the master and the slave after the slave allows the connection.
其中，主机需要与多个从机建立连接时，可以逐个向各个从机发起连接请求并建立相应的连接。Wherein, when the host needs to establish a connection with multiple slaves, it can initiate a connection request to each slave one by one and establish a corresponding connection.
步骤203，从机利用建立的连接将其共享的组成设备的属性信息和句柄发送给主机。In step 203, the slave sends the attribute information and handles of its shared component devices to the master through the established connection.
其中，步骤202～203的操作与前述步骤a和步骤b相同。主机可以和一个或多个从机分别建立连接，获取各个从机组成设备的属性信息进行保存，建立共享资源的信息。具体向哪些从机发起连接请求，可以依据联机应用的需求进行，也可以直接向探测到的所有共享组成设备的从机发起连接请求。Wherein, the operations of steps 202-203 are the same as the aforementioned steps a and b. The host can establish a connection with one or more slaves, obtain and save the attribute information of each slave to form a device, and establish shared resource information. Specifically, which slaves to initiate connection requests to can be performed according to the requirements of online applications, or can directly initiate connection requests to all detected slaves that share component devices.
具体进行共享设备探测和连接建立的处理，可以利用现有方式进行，这里就不再赘述。The specific processing of shared device detection and connection establishment can be performed in an existing manner, and will not be repeated here.
另外，对于某些应用，是与位置相关的，本申请中称为位置依赖型应用，例如，多个电子显示屏幕拼接成一个完整屏幕进行图像显示等。基于此，优选地，如前所述，为更好地进行任务分配，主机还可以获取从机相对于主机的相对位置信息，具体可以利用如下操作实现：In addition, some applications are location-related, which are called location-dependent applications in this application. For example, multiple electronic display screens are spliced into a complete screen for image display. Based on this, preferably, as mentioned above, in order to better perform task assignment, the master can also obtain the relative position information of the slave relative to the master, which can be implemented specifically by using the following operations:
步骤204，主机获取自身到从机的相对位置信息。Step 204, the master acquires relative position information from itself to the slave.
主机获取相对位置信息的方式可以是接收用户的手动输入，或者也可以通过传感器、指南针等进行自动探测。The manner in which the host obtains the relative position information may be to receive manual input from the user, or to perform automatic detection through a sensor, a compass, or the like.
相对位置信息的表示方式可以根据需要进行预先设定，主机在互联过程中，按照设定的表示方式获取相应的位置信息。The expression mode of the relative position information can be preset according to the needs, and the host obtains the corresponding position information according to the set expression mode during the interconnection process.
这里，给出两种典型的相对位置信息表示方式，对应两种拓扑结构：Here, two typical representations of relative position information are given, corresponding to two topological structures:
环形拓扑，只关心主机到从机的相对距离和相对方位，相对位置信息包括主机到从机的相对距离L和相对方位a；Ring topology, only care about the relative distance and relative orientation from the master to the slave, the relative position information includes the relative distance L and the relative orientation a from the master to the slave;
平面拓扑，关心主机到从机的相对距离（可选获取参数）、相对方位（可选获取参数）和从机的摆放方向，相对位置信息包括主机到从机的相对距离L（可选获取参数）、相对方位a（可选获取参数）和从机的摆放方向b。具体如图3所示。Plane topology, concerned with the relative distance from the master to the slave (optional acquisition parameter), relative orientation (optional acquisition parameter) and placement direction of the slave, the relative position information includes the relative distance L from the master to the slave (optional acquisition parameter), relative orientation a (optional acquisition parameter) and placement direction b of the slave. Specifically shown in Figure 3.
下面结合图3，介绍通过自动探测的方式获取上述相对距离L、相对方位a和摆放方向b的具体方式：In combination with Figure 3, the specific way to obtain the above-mentioned relative distance L, relative orientation a and placement direction b through automatic detection is introduced below:
1）从机通过自身的位置传感器确定从机到主机的相对距离L，发送给主机；或者，还可以由主机通过自身的位置传感器确定该相对距离L；其中，开始计算距离的起点是位置传感器所在的位置。1) The slave determines the relative distance L from the slave to the master through its own position sensor, and sends it to the master; or, the master can also determine the relative distance L through its own position sensor; where the starting point for calculating the distance is the position sensor location.
2）主机通过扫描时间获取相对方位a=2*∏*t/T，其中，t为360度的扫描周期内捕获从机的时间，T为360度的扫描周期时长。例如，从手机水平放置的x轴方向开始逆时针360度的扫描，在时刻t=1ms扫描到从机，整个扫描周期为10ms，则从机位于手机水平放置的正向36度方向上；具体地，主机可以通过红外、超声波等探测传感器扫描从机。2) The master obtains the relative orientation a=2*∏*t/T through the scan time, where t is the time to capture the slave in the 360-degree scan cycle, and T is the 360-degree scan cycle duration. For example, start scanning 360 degrees counterclockwise from the x-axis direction where the mobile phone is placed horizontally, scan to the slave at time t=1ms, and the entire scanning period is 10ms, then the slave is located in the positive 36-degree direction where the mobile phone is placed horizontally; Ground, the master can scan the slave through infrared, ultrasonic and other detection sensors.
3）从机利用指南针等获取自身摆放的绝对方向（例如相对于正北方向的夹角）并发送给主机，主机根据自身摆放的绝对方向和接收到的从机摆放绝对方向，确定从机相对于主机的摆放方向b，具体可以将主机摆放的绝对方向与从机摆放的绝对方向间的夹角作为摆放方向b。3) The slave uses the compass to obtain the absolute direction of its own placement (such as the angle relative to the true north direction) and sends it to the master. The master determines the absolute direction according to its own placement and the received absolute direction of the slave. The placement direction b of the slave relative to the master, specifically, the angle between the absolute direction of the master and the absolute direction of the slave can be taken as the placement direction b.
上述对于相对位置信息的测量和获取，可以适用于主机和从机位于同一平面的情况。通过上述方式主机可以获取从机的相对位置信息，可以将该相对位置信息与前述组成设备的属性信息一同进行保存，形成共享资源的信息，如下表：The above measurement and acquisition of relative position information can be applied to the case where the master and the slave are located on the same plane. Through the above method, the master can obtain the relative position information of the slave, and can save the relative position information together with the attribute information of the aforementioned component devices to form shared resource information, as shown in the following table:
表1Table 1
步骤205，主机根据组成设备的属性信息对待执行的应用进行任务分配，根据分配给各从机组成设备的任务和获取的组成设备的句柄，操作并控制相应的组成设备。Step 205 , the master assigns tasks to the applications to be executed according to the attribute information of the constituent devices, and operates and controls the corresponding constituent devices according to the tasks assigned to the slave constituent devices and the obtained handles of the constituent devices.
对于非位置依赖型的应用，不需要考虑主机相对于从机的相对位置关系，可以仅根据组成设备的属性信息对应用进行任务分配。而对于位置依赖型应用，在进行任务分配时，除根据组成设备的属性信息进行外，还需要额外考虑相对位置信息对应用进行任务分配，从而能够使任务分配更加合理，有效利用多电子设备的联机实现联机应用。For non-location-dependent applications, there is no need to consider the relative positional relationship between the master and the slave, and tasks can be assigned to the application only based on the attribute information of the constituent devices. For location-dependent applications, in addition to assigning tasks based on the attribute information of the component devices, it is also necessary to consider the relative location information to assign tasks to the application, so that the task assignment can be made more reasonable and the use of multiple electronic devices can be effectively utilized. Online implementation of online applications.
另外，对于位置依赖型应用，通过设置不同的联机策略，可以实现不同的联机效果。具体地，可以预先设置多种联机策略，在实现具体应用时，根据选择的联机策略，进行任务分配和/或共享组成设备的操作和控制，以实现不同的联机应用效果。具体设置的联机策略可以包括：In addition, for location-dependent applications, different online effects can be achieved by setting different online policies. Specifically, multiple online strategies can be preset, and when implementing a specific application, according to the selected online strategy, task assignment and/or operation and control of shared component devices are performed to achieve different online application effects. Specific online policies can include:
1）设备利用率最大化策略，比如图片的输出面积最大；1) The strategy of maximizing equipment utilization, such as the largest output area of pictures;
2）用户感受最佳策略，从视觉听觉的感受，比如输出可视内容的正方向一致；2) The best strategy for users to feel, from visual and auditory senses, such as outputting visual content in the same positive direction;
3）特定应用策略，比如根据变化的相对位置信息，动态调整输出的内容。3) Specific application strategies, such as dynamically adjusting the output content according to the changing relative position information.
其中，上述联机策略可以在联机工作时由主机自动计算完成，也可以手动定义。Wherein, the above-mentioned online policy can be automatically calculated by the host computer during online work, or can be manually defined.
在进行组成设备的操作和具体控制时，根据任务分配的结果和选择的联机策略进行，并利用获取的组成设备的句柄实现对于组成设备的操作和控制。When performing the operation and specific control of the component equipment, it is carried out according to the result of task assignment and the selected online strategy, and realizes the operation and control of the component equipment by using the obtained handle of the component equipment.
步骤206，当需要退出联机处理时，主机或从机向对端发出退出连接的请求，对端收到后，响应允许退出；发出退出连接请求的电子设备收到后断开建立的连接。Step 206, when the online processing needs to be exited, the master or the slave sends a connection exit request to the opposite end, and the opposite end responds to allow exit after receiving it; the electronic device that sends the exit connection request disconnects the established connection after receiving it.
在进行连接退出处理时，主机需要在退出连接前，需要将退出的连接所涉及的从机组成设备的相应信息删除，包括组成设备的属性信息和相对位置信息。When performing connection exit processing, the master needs to delete the corresponding information of the slave components involved in the exit connection before exiting the connection, including the attribute information and relative position information of the component devices.
至此，图2所示的方法流程结束。在上述流程中，对于位置依赖型应用，对于相对位置信息的获取操作（即步骤204）与步骤203的执行顺序可以是任意的，可以先后执行或同时执行。另外，优选地，主机对于相对位置信息的获取还可以是周期性进行的，当主机发现相对位置信息发生变化时，可以根据变化后的相对位置信息重新进行相应的任务分配，从而使应用能够更好地适应电子设备的位置变化。So far, the flow of the method shown in FIG. 2 ends. In the above process, for a location-dependent application, the execution order of the relative location information acquisition operation (that is, step 204 ) and step 203 may be arbitrary, and may be executed sequentially or simultaneously. In addition, preferably, the host can also periodically acquire the relative position information. When the host finds that the relative position information has changed, it can re-allocate the corresponding tasks according to the changed relative position information, so that the application can be more Adapts well to changes in the position of electronic equipment.
下面给出几种典型联机应用下，任务分配的具体方式以及不同联机策略下对组成设备的操作和控制。The specific ways of task assignment and the operation and control of component devices under different online strategies are given below in several typical online applications.
例一：双机互联，即一个主机与一个从机建立连接Example 1: Two-machine interconnection, that is, a host establishes a connection with a slave
a）可视电话应用a) Videophone application
可视电话应用为非位置依赖型的应用，因此在进行任务分配时不需要考虑主机到从机的相对位置信息。从机共享的组成设备为音视频输入输出设备时，可以实现可视电话应用。在进行任务分配时，可以将主机和从机中的一个作为语音输入输出设备，另一个作为视频输出设备。例如，两个手机作为电子设备互联，当从机共享摄像头和作为输出显示的屏幕时，可以将主机的手机作为电话机，将从机的手机作为视频查看窗口和视频拍摄工具。或者，在进行任务分配时，可以将主机和从机中的一个作为语音输入以及视频输入设备，另一个作为语音输出以及视频输出设备。Videophone applications are non-location-dependent applications, so there is no need to consider the relative location information from the master to the slave when assigning tasks. When the component devices shared by the slaves are audio and video input and output devices, videophone applications can be realized. When assigning tasks, one of the master and the slave can be used as a voice input and output device, and the other as a video output device. For example, two mobile phones are interconnected as electronic devices. When the slave machine shares the camera and the screen as the output display, the host mobile phone can be used as a phone, and the slave mobile phone can be used as a video viewing window and a video shooting tool. Or, when performing task assignment, one of the master and the slave can be used as a voice input and video input device, and the other can be used as a voice output and video output device.
b）位置依赖型的输入输出应用b) Position-dependent input and output applications
典型的应用可以如图4所示，共享的组成设备包括作为输入输出设备的屏幕，拓扑结果为平面拓扑结构，相对位置信息包括主机与从机的相对距离、相对方位和从机的摆放方向。A typical application can be shown in Figure 4. The shared component devices include the screen as an input and output device. The topology result is a plane topology structure. The relative position information includes the relative distance, relative orientation and placement direction of the master and slave. .
在进行任务分配时，可以将任务分解为输入和输出两个部分，根据需要可能主机更适合作为输入，则将主机的屏幕作为输入，将从机的屏幕作为输出；When assigning tasks, the task can be decomposed into two parts: input and output. According to the needs, the master may be more suitable as the input, and the screen of the master is used as the input, and the screen of the slave is used as the output;
在进行从机输出内容的显示时，可以根据相对位置信息进行显示。例如，当选择的策略为用户感受最佳策略时，往往希望输入屏幕和输出屏幕的显示正向是一致，以使用户获得最好的视觉体验，则可以根据从机相对于主机的摆放方向在从机的屏幕上进行显示，使从机的显示正向与主机的显示正向平行；当选择的策略为设备利用率最大化策略时，往往希望在整个屏幕上显示更多的信息内容，则可以根据从机的屏幕属性进行显示，使从机的屏幕利用率最大化，即显示内容最多。在进行从机屏幕的控制时，可以利用RPC(远程过程调用)来操作从机屏幕的输出显示。When displaying the output content of the slave, it can be displayed according to the relative position information. For example, when the selected strategy is the best strategy for the user to experience, it is often hoped that the display of the input screen and the output screen are in the same direction so that the user can obtain the best visual experience, then the placement direction of the slave relative to the master can be Display on the screen of the slave machine so that the display direction of the slave machine is parallel to the display direction of the master machine; when the selected strategy is the strategy of maximizing equipment utilization, it is often desired to display more information content on the entire screen, Then, it can be displayed according to the screen properties of the slave machine, so as to maximize the utilization rate of the screen of the slave machine, that is, to display the most content. When controlling the slave screen, RPC (Remote Procedure Call) can be used to operate the output display of the slave screen.
对于与位置相关的输入输出应用，当然不仅限于双机互联，还可以是主机分别与两个或三个等更多的从机连接，从而实现三机互联、四机互联等。在这种互联方式下，仍然可以沿用上述的处理，只是其中用于作为输入设备的可能不只一个电子设备的屏幕，而是多个电子设备的屏幕拼接后作为统一的输入设备；输出设备同理，可以由多个电子设备的屏幕拼接后作为统一的输出设备。进行任务分配和从机屏幕输出的控制上与上述类似即可。For position-related input and output applications, of course, it is not limited to two-machine interconnection, but the master can also be connected to two or three or more slave machines, so as to realize three-machine interconnection, four-machine interconnection, etc. In this interconnection mode, the above-mentioned processing can still be used, but the screen used as an input device may not only be the screen of one electronic device, but the screens of multiple electronic devices are spliced as a unified input device; the same is true for output devices , can be used as a unified output device after splicing the screens of multiple electronic devices. The task allocation and the control of slave screen output are similar to the above.
例二：三机互联，即一个主机分别与两个从机建立连接Example 2: Three-machine interconnection, that is, one master establishes a connection with two slaves respectively
典型的应用可以是音频输出应用，例如图5所示的音响系统应用。这里应用属于位置依赖型应用，拓扑结构为环形拓扑，即相对位置信息包括主机到从机的相对距离和相对方位，可以不考虑从机的摆放方向。A typical application may be an audio output application, such as the sound system application shown in FIG. 5 . The application here is a position-dependent application, and the topology is a ring topology, that is, the relative position information includes the relative distance and relative orientation from the master to the slave, and the placement direction of the slave may not be considered.
假定三个电子设备均是2.1声道，每一个电子设备可以提供两个声音源，三个电子设备可以提供六个声音源，构成一个5.1声道系统。组成联机系统后，每个电子设备的一个音频输出设备输出一个声道的内容，他们是L左声道，R右声道，C中置，LS左后，RS右后，和SW低音部分构成。当然，大于三个电子设备的互联也可完成5.1声道组合。Assuming that the three electronic devices are all 2.1-channel, each electronic device can provide two sound sources, and the three electronic devices can provide six sound sources, forming a 5.1-channel system. After forming the online system, one audio output device of each electronic device outputs the content of one channel, they are L left channel, R right channel, C center, LS left rear, RS right rear, and SW bass part . Of course, the interconnection of more than three electronic devices can also complete the 5.1-channel combination.
在进行任务分配时，若选择的策略为设备利用率最大化策略，那么可以将音频输出内容分为尽可能多的声道播放，并根据从机到主机的相对距离和相对方位，确定从机的每个音频输出设备的声道类型，即左右声道等；若用户感受最佳的策略下，可以分配播放声音内容的主旋律占用两个声道，同时利用其他声道根据播出的模式调整低音效果，如爵士乐，加重低音等，并根据从机到主机的相对距离和相对方位确定从机的音频输出设备输出的声道类型和音量等；若选择的策略为特定应用策略，可以周期性获取主机到从机的相对距离和相对方位，在更新该相对距离和相对方位后，重新分配不同音频输出设备输出的声道内容和音量，使用户在联机范围内的任意位置，感受到的音乐是没有差别的。When assigning tasks, if the selected strategy is the strategy of maximizing equipment utilization, then the audio output content can be divided into as many channels as possible to play, and the slave can be determined according to the relative distance and relative orientation from the slave to the master. The channel type of each audio output device, that is, the left and right channels, etc.; if the user feels the best strategy, the main melody of the audio content can be assigned to occupy two channels, and other channels can be used to adjust according to the broadcast mode Bass effects, such as jazz, bass emphasis, etc., and determine the channel type and volume output by the audio output device of the slave according to the relative distance and relative orientation from the slave to the master; if the selected strategy is a specific application strategy, it can be periodically Obtain the relative distance and relative orientation from the master to the slave. After updating the relative distance and relative orientation, redistribute the channel content and volume output by different audio output devices, so that the user can feel the music at any position within the online range. There is no difference.
例三：多屏互联显示输出Example 3: Multi-screen interconnection display output
该应用为典型的位置依赖型应用，且拓扑结构为平面结构，共享的组成设备为作为输出设备的屏幕，相对位置信息可以包括主机到从机的相对距离、相对方位和从机的摆放方向。This application is a typical location-dependent application, and the topology is a planar structure. The shared component device is the screen as the output device. The relative position information can include the relative distance from the master to the slave, the relative orientation and the placement direction of the slave. .
多屏互联可以有多种组合，以4：3的屏幕为例计算，可以实现X2（3：2，8：3）完成不同尺寸比例的图片输出。X3（9：4，4：1）等，可以实现任意多屏的动态互联的组合，形成不同比例的屏幕显示，如图6-图8所示。其中，图6a和图6b分别为两个4：3屏幕拼接为3：2的屏幕显示和8：3的屏幕显示；图7a和图7b分别为三个4：3的屏幕拼接为9：4的屏幕显示和4：1的屏幕显示；图8为四个4：3的屏幕拼接显示16：3尺寸的清明上河图。There can be various combinations of multi-screen interconnection. Taking the 4:3 screen as an example, it can realize X2 (3:2, 8:3) to complete the image output of different size ratios. X3 (9:4, 4:1), etc., can realize any combination of multi-screen dynamic interconnection to form screen displays with different ratios, as shown in Figure 6-8. Among them, Figure 6a and Figure 6b are respectively two 4:3 screen splicing into 3:2 screen display and 8:3 screen display; Figure 7a and Figure 7b are three 4:3 screen splicing into 9:4 screen display and 4:1 screen display; Figure 8 is a 16:3 Qingming Riverside Picture displayed by four 4:3 screen splicing.
其中，对于图7a、7b和图8的情况，三机甚至四机互联、且均在一条直线上。如果位置传感器无法探测和测量位于遮挡物后面的物体时，可能被遮挡的从机就无法获取自身到主机的相对距离。这种情况下，可以将主机平移出原本所在的平面（即主机和所有从机所在的平面），例如，若原本各主机和从机都在桌面上，可以将主机平移抬高，在移动主机的过程中，主机可以记录自身的移动轨迹，测量出其自身被抬高的距离。将主机平移到合适的位置（一般保证与其他手机的水平距离不变）后，对其他从机进行拍照，根据对图片的分析计算图片中其他从机间的相对距离L1，再根据其中未被遮挡的从机向主机上报的该从机与主机的相对距离L2、主机距离原本所在平面的距离L3和主机的焦距L4及L1，计算主机与被遮挡从机间的相对距离。Among them, for the situation in Fig. 7a, 7b and Fig. 8, three machines or even four machines are interconnected and all are on a straight line. If the position sensor cannot detect and measure an object located behind an occluder, the slave that may be occluded cannot obtain the relative distance from itself to the master. In this case, the master can be moved out of the original plane (that is, the plane where the master and all slaves are located). During the process, the host can record its own movement trajectory and measure the distance it is raised. After moving the master to a suitable position (generally, the horizontal distance with other mobile phones remains unchanged), take pictures of other slaves, calculate the relative distance L1 between other slaves in the picture according to the analysis of the pictures, and then calculate the The blocked slave reports to the master the relative distance L2 between the slave and the master, the distance L3 between the master and the original plane, and the focal lengths L4 and L1 of the master, to calculate the relative distance between the master and the blocked slave.
在进行任务分配时，将主机和从机的屏幕均作为输出设备，并根据主机和从机的屏幕属性、多屏互联后的目标输出尺寸和相对位置信息分配主机和从机的输出内容。When assigning tasks, the screens of the master and slave are used as output devices, and the output content of the master and slave is assigned according to the screen properties of the master and slave, the target output size and relative position information after multi-screen interconnection.
在进行从机输出内容的显示时，可以进一步根据选择的策略进行。当选择的策略为用户感受最佳策略，则可以根据从机相对于主机的摆放方向在从机的屏幕上进行显示，使从机的显示正向与主机的显示正向平行；当选择的策略为设备利用率最大化策略，则可以根据从机的屏幕属性进行显示，使从机的屏幕利用率最大化；当选择的策略为特定应用策略时，可以周期性获取主机到从机的相对距离、相对方位和从机的摆放方向，在更新相应的相对位置信息后，重新分配从机屏幕的输出内容。When displaying the output content of the slave machine, it can further be performed according to a selected strategy. When the selected strategy is the best strategy for the user experience, it can be displayed on the screen of the slave according to the placement direction of the slave relative to the master, so that the display of the slave is positively parallel to the display of the master; when the selected If the strategy is the device utilization maximization strategy, it can be displayed according to the screen properties of the slave to maximize the screen utilization of the slave; when the selected strategy is a specific application strategy, the relative After updating the corresponding relative position information, redistribute the output content of the slave screen.
在位置摆放恰当的情况下，往往几种策略显示的结果是相似的，如图9所示。但是位置出现偏差时不同的显示策略显示的结果就是不同的。在设备利用率最大化的策略下，任务被分解输出面积最大的组合，在这种模式下，4机显示图片，会呈现图10所示的效果；在用户感受最佳策略下，用户看到的图片是接近完整没有倾斜的，如图11所示。在特定应用策略模式下，用户可以根据不同的位置显示完整图片的某一个部分，而图片是不动的，如图12所示。In the case of proper positioning, the results of several strategies are often similar, as shown in Figure 9. However, when the position deviates, the results displayed by different display strategies are different. Under the strategy of maximizing equipment utilization, tasks are decomposed into the combination with the largest output area. In this mode, 4 machines display pictures, and the effect shown in Figure 10 will appear; under the strategy of best user experience, users see The picture is nearly complete without tilt, as shown in Figure 11. In the specific application policy mode, the user can display a certain part of the complete picture according to different positions, while the picture is not moving, as shown in Figure 12.
例四：3D摄影机应用Example 4: 3D camera application
该应用属于位置依赖型应用，拓扑结构为环形结构，相对位置信息可以包括主机到从机的相对距离和相对方位，可以不考虑从机的摆放方向；从机共享的组成设备包括视频输入设备。This application is a position-dependent application, and the topology is a ring structure. The relative position information can include the relative distance and relative orientation from the master to the slave, regardless of the placement direction of the slave; the components shared by the slave include video input devices .
在进行联机操作时，操作和控制从机的视频输入设备进行视频获取。统一接收各个视频输入设备采集的视频内容，并根据相对位置信息进行统一处理，形成3D图像。这样，可以在不同的角度拍摄的景象通过统一的处理，即可形成3D图像，为移动终端上面集成小型的3D摄影机提供可行性。During online operation, operate and control the video input device of the slave machine for video acquisition. The video content collected by each video input device is uniformly received, and processed according to the relative position information to form a 3D image. In this way, scenes that can be photographed at different angles can be processed uniformly to form a 3D image, which provides feasibility for integrating a small 3D camera on a mobile terminal.
上述即为本申请中电子设备的互联和控制方法的具体实现，当然，多个电子设备联机工作的应用不仅限于上述几种，上述仅为几个示例，本领域技术人员可以根据实际需要在不同的应用下采用本申请的互联和控制方法。The above is the specific implementation of the interconnection and control method of electronic equipment in this application. Of course, the application of multiple electronic equipment working online is not limited to the above-mentioned ones. Under the application of the application, the interconnection and control method of the present application is adopted.
通过上述本申请的方法，实现多机的互连，可以使平台的性能更强大，业务更丰富；同时，通过位置依赖的互联方法，使得组合更加灵活；解决了任意多个设备任意连接的通用方法；进一步地，通过最佳联机策略的适配，使得应用更灵活。Through the above-mentioned method of this application, the interconnection of multiple machines can be realized, which can make the performance of the platform more powerful and the business more abundant; at the same time, through the interconnection method of location dependence, the combination is more flexible; it solves the general problem of arbitrary connection of any number of devices. method; further, through the adaptation of the best online strategy, the application is more flexible.
本申请还提供了一种电子设备的具体结构，用于实施上述本申请的互联和控制方法。如图13所示，该电子设备的基本结构包括：连接控制单元和操作控制单元。The present application also provides a specific structure of electronic equipment, which is used to implement the above-mentioned interconnection and control method of the present application. As shown in FIG. 13 , the basic structure of the electronic device includes: a connection control unit and an operation control unit.
其中，连接控制单元，用于向至少一个其他共享其组成设备的作为从机的电子设备发出连接请求，在从机允许连接后，建立自身和从机间的连接，并利用建立的连接获取从机共享的组成设备的属性信息进行保存；其中，属性信息包括用于操作所述组成设备的句柄。Wherein, the connection control unit is used to send a connection request to at least one other electronic device as a slave that shares its component equipment, and establish a connection between itself and the slave after the slave allows the connection, and use the established connection to obtain the slave Save the attribute information of the component equipment shared by the computer; wherein, the attribute information includes a handle for operating the component equipment.
操作控制单元，用于根据应用的需求和连接控制单元保存的组成设备的属性信息进行任务分配，根据分配给组成设备的任务操作并控制所述组成设备。The operation control unit is configured to assign tasks according to application requirements and the attribute information of the component devices saved by the connection control unit, and operate and control the component devices according to the tasks assigned to the component devices.
进一步地，考虑到位置依赖型应用的需求，本申请提供的电子设备还可以进一步包括相对位置信息获取单元，用于获取自身到从机的相对位置信息。相应地，操作控制单元，用于进一步根据相对位置信息获取单元获取的自身到从机的相对位置信息，操作并控制从机共享的组成设备。Further, considering the requirements of position-dependent applications, the electronic device provided in the present application may further include a relative position information acquisition unit, configured to acquire relative position information from itself to the slave. Correspondingly, the operation control unit is used to further operate and control the component equipment shared by the slave machine according to the relative position information of itself and the slave machine acquired by the relative position information acquisition unit.
其中，具体地，当相对位置信息包括从机相对于自身的相对距离和相对方位时，相对位置信息获取单元，可以进一步用于接收输入的相对位置信息。或者，相对位置信息获取单元还可以包括相对距离获取子单元和相对方位获取子单元，其中，相对距离获取子单元用于接收从机测量的该从机到主机的相对距离；相对方位获取子单元，用于获取从机到自身的相对方位。或者，相对位置信息获取单元，还进一步用于测量自身到从机的相对距离以及从机到自身的相对方位。Wherein, specifically, when the relative position information includes the relative distance and relative orientation of the slave relative to itself, the relative position information acquisition unit may be further configured to receive the input relative position information. Alternatively, the relative position information acquisition unit may also include a relative distance acquisition subunit and a relative orientation acquisition subunit, wherein the relative distance acquisition subunit is used to receive the relative distance from the slave to the master measured by the slave; the relative orientation acquisition subunit , used to obtain the relative orientation from the slave to itself. Alternatively, the relative position information acquisition unit is further used to measure the relative distance from itself to the slave and the relative orientation from the slave to itself.
当相对位置信息包括从机相对于自身的摆放方向时，相对位置信息获取单元可以包括接收子单元和确定子单元。其中，接收子单元，用于接收从机发送的从机自身摆放的绝对方向；确定子单元，用于测量自身的摆放正向，并将自身摆放的绝对方向与从机摆放绝对方向间的夹角作为从机相对于自身的摆放方向。When the relative position information includes the placement direction of the slave relative to itself, the relative position information acquiring unit may include a receiving subunit and a determining subunit. Among them, the receiving subunit is used to receive the absolute direction of the slave itself sent by the slave; the determination subunit is used to measure the positive direction of its own placement, and compare the absolute direction of its own placement with that of the slave. The angle between the directions is used as the placement direction of the slave relative to itself.
同时，为在存在遮挡情况下仍能够实现相对距离的测量，还可以在本申请提供的电子设备中增加遮挡从机相对距离获取单元，当电子设备与至少两个从机连接、且其中第一从机在第二从机与自身间成为遮挡、第二从机和主机均无法测量相互之间的相对距离时，用于对第一从机和第二从机进行拍照，根据照片中第一从机和第二从机的相对距离、相对位置信息获取单元获取的主机与第一从机间的相对距离、主机的焦距和距离第一从机和第二从机所在平面的距离，计算主机与第二从机间的相对距离。At the same time, in order to still be able to measure the relative distance in the presence of occlusion, an occlusion slave relative distance acquisition unit can also be added to the electronic device provided by this application. When the electronic device is connected to at least two slaves, and the first When the slave machine becomes blocked between the second slave machine and itself, and the second slave machine and the master machine cannot measure the relative distance between each other, it is used to take pictures of the first slave machine and the second slave machine, according to the first The relative distance between the slave and the second slave, the relative distance between the master and the first slave obtained by the relative position information acquisition unit, the focal length of the master and the distance from the plane where the first slave and the second slave are located, calculate the master The relative distance to the second slave.
另外，与前述方法相类似地，可以设置多种联机策略，以适应不同的需求。具体地，可以在电子设备中进一步包括策略预置单元和当前策略选择单元。其中，策略预置单元，用于通过预先设置保存多种联机策略；当前策略选择单元，用于从策略预置单元保存的多种联机策略中选择当前应用采用的联机策略，并发送给操作控制单元；操作控制单元，进一步用于根据选择的当前应用采用的联机策略，进行任务分配或者操作并控制组成设备。In addition, similar to the aforementioned method, multiple online policies can be set to meet different requirements. Specifically, a policy preset unit and a current policy selection unit may be further included in the electronic device. Among them, the policy preset unit is used to save multiple online policies through preset settings; the current policy selection unit is used to select the online policy adopted by the current application from the multiple online policies saved in the policy preset unit, and send it to the operation control A unit; an operation control unit, further configured to perform task assignment or operate and control component devices according to the selected online strategy adopted by the current application.
具体地，操作控制单元可以包括任务分配子单元和控制子单元，根据不同类型的应用、不同的联机策略，任务分配子单元和控制子单元可以实现如下的功能：Specifically, the operation control unit may include a task allocation subunit and a control subunit. According to different types of applications and different online strategies, the task allocation subunit and the control subunit may implement the following functions:
当应用为可视电话应用、从机共享的组成设备为音视频输入输出设备时，主机（即本申请提供的电子设备本身，以下同）与一个从机建立连接，When the application is a videophone application and the component shared by the slave is an audio and video input and output device, the host (that is, the electronic device itself provided by this application, the same below) establishes a connection with a slave,
任务分配子单元，用于分配主机和从机中的一个作为语音输入输出设备，另一个作为视频输入输出设备；或者，用于分配主机和从机中的一个作为语音输入以及视频输入设备，另一个作为语音输出以及视频输出设备；控制子单元，用于按照任务分配子单元分配的任务，控制从机进行相应的输入输出。The task allocation subunit is used to assign one of the master and the slave as a voice input and output device, and the other as a video input and output device; or, for assigning one of the master and the slave as a voice input and video input device, and the other One is used as a voice output and video output device; the control subunit is used to control the slave to perform corresponding input and output according to the tasks assigned by the task assignment subunit.
当应用为位置依赖型的输入输出应用、且从机共享的组成设备包括屏幕、且相对位置信息包括从机相对于主机（即本申请提供的电子设备本身，以下同）的摆放方向时，When the application is a position-dependent input and output application, and the component devices shared by the slave include screens, and the relative position information includes the placement direction of the slave relative to the host (that is, the electronic device itself provided by this application, the same below),
任务分配子单元，可以用于将主机和从机中的部分屏幕作为输入设备，其他屏幕作为输出设备。控制子单元，可以用于接收当前策略选择单元发送的联机策略；在当前策略选择单元发来用户感受最佳策略时，根据从机相对于主机的摆放方向和任务分配子单元分配的输出内容，控制从机屏幕上的内容显示，使从机的显示正向与主机的显示正向平行；在当前策略选择单元发来设备利用率最大化策略时，根据从机的屏幕属性和任务分配子单元分配的输出内容，控制从机的内容显示，使所有参与联机显示的电子设备的屏幕利用率最大化。The task allocation subunit can be used to use some screens in the master and slave as input devices, and other screens as output devices. The control subunit can be used to receive the online strategy sent by the current strategy selection unit; when the current strategy selection unit sends the user the best strategy, according to the placement direction of the slave relative to the master and the output content assigned by the task assignment subunit , to control the content display on the screen of the slave, so that the display of the slave is positively parallel to the display of the master; when the current strategy selection unit sends the equipment utilization maximization strategy, according to the screen attributes of the slave and the task assignment sub The output content assigned by the unit controls the content display of the slave unit to maximize the screen utilization of all electronic devices participating in the online display.
当应用为多屏互联显示应用、且从机共享的组成设备包括屏幕、且相对位置信息包括从机相对于主机的摆放方向时，When the application is a multi-screen interconnected display application, and the components shared by the slave include screens, and the relative position information includes the placement direction of the slave relative to the host,
任务分配子单元，可以用于将自身和从机的屏幕均作为输出设备，并根据主机和从机的屏幕属性、多屏互联后的目标输出尺寸和相对位置信息分配主机和从机的输出内容。控制子单元，可以用于接收当前策略选择单元发送的联机策略；在当前策略选择单元发来用户感受最佳策略时，根据从机相对于主机的摆放方向和任务分配子单元分配的输出内容，控制主机和从机屏幕上的内容显示，使从机的显示正向与主机的显示正向平行；在当前策略选择单元发来设备利用率最大化策略时，根据从机的屏幕属性和任务分配子单元分配的输出内容，控制从机的内容显示，使从机的屏幕利用率最大化。The task allocation subunit can be used to use the screens of itself and the slave as output devices, and distribute the output content of the master and slave according to the screen properties of the master and slave, the target output size and relative position information after multi-screen interconnection . The control subunit can be used to receive the online strategy sent by the current strategy selection unit; when the current strategy selection unit sends the user the best strategy, according to the placement direction of the slave relative to the master and the output content assigned by the task assignment subunit , to control the content display on the screen of the master and the slave, so that the display of the slave is forward parallel to the display of the master; when the current policy selection unit sends the equipment utilization maximization strategy, according to the screen attributes and tasks of the slave Allocate the output content assigned by the sub-units, control the content display of the slave, and maximize the screen utilization of the slave.
当应用为音频输出应用、且从机共享的组成设备包括音频输出设备、且相对位置信息包括从机到主机的相对距离和相对方位时，When the application is an audio output application, and the component devices shared by the slave include audio output devices, and the relative position information includes the relative distance and relative orientation from the slave to the master,
任务分配子单元，可以用于接收当前策略选择单元发送的联机策略；在当前策略选择单元发来用户感受最佳策略时，将主旋律的音频内容分成两个声道，其他声道根据播放模式输出不同的低音效果内容，并根据相对位置信息确定从机的音频输出设备输出的声道类型；在当前策略选择单元发来设备利用率最大化策略时，将输出的音频分成N个声道，每个音频输出设备输出一个声道的内容，并根据从机到主机的相对距离和相对方位，确定从机的每个音频输出设备的声道类型；其中，N为应用中主机和从机的总数。控制子单元，用于根据任务分配子单元分配的任务进行从机的控制。The task allocation subunit can be used to receive the online strategy sent by the current strategy selection unit; when the current strategy selection unit sends the best strategy for the user to experience, the audio content of the main theme is divided into two channels, and the other channels are output according to the playback mode Different bass effect content, and determine the channel type output by the audio output device of the slave according to the relative position information; when the current policy selection unit sends the equipment utilization maximization strategy, the output audio is divided into N channels, Each audio output device outputs the content of one channel, and according to the relative distance and relative orientation from the slave to the master, determine the channel type of each audio output device of the slave; where, N is the total number of master and slave in the application . The control subunit is used to control the slave machine according to the tasks assigned by the task assignment subunit.
当应用为集成3D摄影应用、且从机共享的组成设备包括视频输入设备、且相对位置信息包括从机到主机的相对距离和相对方位时，操作控制单元，进一步用于操作并控制从机的视频输入设备进行视频获取。When the application is an integrated 3D photography application, and the components shared by the slave include a video input device, and the relative position information includes the relative distance and relative orientation from the slave to the master, the operation control unit is further used to operate and control the slave Video input device for video acquisition.
为实现设备随位置变化而自适应改变内容的显示，相对位置信息获取单元，还可以进一步用于周期性获取相对位置信息，当该相对位置信息发生变化时，通知操作控制单元；操作控制单元，可以进一步用于根据变化后的相对位置信息重新进行任务分配。In order to realize that the display of the device adaptively changes the content as the position changes, the relative position information acquisition unit can also be further used to periodically acquire the relative position information, and when the relative position information changes, the operation control unit is notified; the operation control unit, It can be further used to re-allocate tasks according to the changed relative position information.
最后，为退出联机工作，电子设备的连接控制单元，进一步用于向建立连接的对端设备发送退出连接的请求，并在对端同意退出后，从连接控制单元中删除退出的连接中相关组成设备的属性信息，断开退出的连接。Finally, in order to exit the online work, the connection control unit of the electronic device is further used to send a request for exiting the connection to the peer device that established the connection, and after the peer agrees to exit, delete the relevant components in the exited connection from the connection control unit The attribute information of the device, disconnect the exited connection.
以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本发明保护的范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the present invention. within the scope of protection.
Claims (29)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210374581.6ACN103699211A (en) | 2012-09-27 | 2012-09-27 | Electronic equipment and interconnecting and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210374581.6ACN103699211A (en) | 2012-09-27 | 2012-09-27 | Electronic equipment and interconnecting and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103699211Atrue CN103699211A (en) | 2014-04-02 |
Family
ID=50360767
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210374581.6APendingCN103699211A (en) | 2012-09-27 | 2012-09-27 | Electronic equipment and interconnecting and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103699211A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105704110A (en)* | 2014-11-27 | 2016-06-22 | 华为终端（东莞）有限公司 | Media transmission method, media control method and device |
| CN106155293A (en)* | 2015-04-16 | 2016-11-23 | 北京智谷睿拓技术服务有限公司 | Exchange method, interactive device and subscriber equipment |
| CN106303287A (en)* | 2015-05-26 | 2017-01-04 | 中国移动通信集团公司 | A kind of multi-mobile-terminal screen splicing method based on near-field communication, equipment and system |
| CN106488363A (en)* | 2016-09-29 | 2017-03-08 | Tcl通力电子（惠州）有限公司 | Sound channel distribution method and device of audio output system |
| CN107180348A (en)* | 2017-05-16 | 2017-09-19 | 北京望远传媒有限公司 | A kind of multi-medium play method and device |
| CN107368186A (en)* | 2017-07-11 | 2017-11-21 | 青岛海信移动通信技术股份有限公司 | AR or VR systems and the method for calculating wherein slave feedback sense change in gain amount |
| CN108289341A (en)* | 2016-09-29 | 2018-07-17 | 努比亚技术有限公司 | A kind of apparatus for processing audio and method |
| CN108958690A (en)* | 2018-08-16 | 2018-12-07 | 上海星视度科技有限公司 | Multi-screen interaction method, device, terminal device, server and storage medium |
| CN109246545A (en)* | 2018-09-04 | 2019-01-18 | 福建星网智慧科技股份有限公司 | A kind of double screen audio-frequency inputting method |
| CN112088528A (en)* | 2018-05-11 | 2020-12-15 | 富士胶片株式会社 | Image capturing system |
| CN114840156A (en)* | 2021-01-30 | 2022-08-02 | 华为技术有限公司 | Multi-screen equipment control method and communication system |
| CN117059080A (en)* | 2017-12-08 | 2023-11-14 | 谷歌有限责任公司 | Detection of duplicate packetized data transmissions |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6340957B1 (en)* | 1997-08-29 | 2002-01-22 | Xerox Corporation | Dynamically relocatable tileable displays |
| CN101674364A (en)* | 2009-09-28 | 2010-03-17 | 深圳华为通信技术有限公司 | Wireless screen splicing display method, mobile communication terminal and device |
| US20110252317A1 (en)* | 2010-04-08 | 2011-10-13 | Nokia Corporation | Method, apparatus and computer program product for joining the displays of multiple devices |
| CN102222493A (en)* | 2010-04-19 | 2011-10-19 | 英业达股份有限公司 | Method and device for expanding and displaying images |
| CN102263789A (en)* | 2011-07-15 | 2011-11-30 | 同济大学 | Graphical Assisted Conversation System |
| CN102298917A (en)* | 2011-05-24 | 2011-12-28 | 福州瑞芯微电子有限公司 | Wireless automatic detection screen associated display method and devices |
| CN102316609A (en)* | 2011-09-07 | 2012-01-11 | 何天华 | Detachable dual-communication handheld device |
| CN102495712A (en)* | 2011-12-15 | 2012-06-13 | 王飞 | Map splicing display method based on a plurality of display terminals |
| CN102638610A (en)* | 2011-02-15 | 2012-08-15 | Lg电子株式会社 | Method of transmitting and receiving data, display device and mobile terminal using the same |
- 2012
- 2012-09-27CNCN201210374581.6Apatent/CN103699211A/enactivePending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6340957B1 (en)* | 1997-08-29 | 2002-01-22 | Xerox Corporation | Dynamically relocatable tileable displays |
| CN101674364A (en)* | 2009-09-28 | 2010-03-17 | 深圳华为通信技术有限公司 | Wireless screen splicing display method, mobile communication terminal and device |
| US20110252317A1 (en)* | 2010-04-08 | 2011-10-13 | Nokia Corporation | Method, apparatus and computer program product for joining the displays of multiple devices |
| CN102222493A (en)* | 2010-04-19 | 2011-10-19 | 英业达股份有限公司 | Method and device for expanding and displaying images |
| CN102638610A (en)* | 2011-02-15 | 2012-08-15 | Lg电子株式会社 | Method of transmitting and receiving data, display device and mobile terminal using the same |
| CN102298917A (en)* | 2011-05-24 | 2011-12-28 | 福州瑞芯微电子有限公司 | Wireless automatic detection screen associated display method and devices |
| CN102263789A (en)* | 2011-07-15 | 2011-11-30 | 同济大学 | Graphical Assisted Conversation System |
| CN102316609A (en)* | 2011-09-07 | 2012-01-11 | 何天华 | Detachable dual-communication handheld device |
| CN102495712A (en)* | 2011-12-15 | 2012-06-13 | 王飞 | Map splicing display method based on a plurality of display terminals |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105704110A (en)* | 2014-11-27 | 2016-06-22 | 华为终端（东莞）有限公司 | Media transmission method, media control method and device |
| CN105704110B (en)* | 2014-11-27 | 2020-02-14 | 华为终端有限公司 | Media transmission method, media control method and device |
| CN106155293A (en)* | 2015-04-16 | 2016-11-23 | 北京智谷睿拓技术服务有限公司 | Exchange method, interactive device and subscriber equipment |
| CN106303287B (en)* | 2015-05-26 | 2019-06-25 | 中国移动通信集团公司 | A kind of multi-mobile-terminal screen splicing method, equipment and system based on near-field communication |
| CN106303287A (en)* | 2015-05-26 | 2017-01-04 | 中国移动通信集团公司 | A kind of multi-mobile-terminal screen splicing method based on near-field communication, equipment and system |
| CN106488363A (en)* | 2016-09-29 | 2017-03-08 | Tcl通力电子（惠州）有限公司 | Sound channel distribution method and device of audio output system |
| CN108289341A (en)* | 2016-09-29 | 2018-07-17 | 努比亚技术有限公司 | A kind of apparatus for processing audio and method |
| CN107180348A (en)* | 2017-05-16 | 2017-09-19 | 北京望远传媒有限公司 | A kind of multi-medium play method and device |
| CN107368186A (en)* | 2017-07-11 | 2017-11-21 | 青岛海信移动通信技术股份有限公司 | AR or VR systems and the method for calculating wherein slave feedback sense change in gain amount |
| CN107368186B (en)* | 2017-07-11 | 2020-07-07 | 青岛海信移动通信技术股份有限公司 | AR or VR system and method for calculating variation of slave feed inductance gain therein |
| CN117059080A (en)* | 2017-12-08 | 2023-11-14 | 谷歌有限责任公司 | Detection of duplicate packetized data transmissions |
| CN112088528A (en)* | 2018-05-11 | 2020-12-15 | 富士胶片株式会社 | Image capturing system |
| CN112088528B (en)* | 2018-05-11 | 2022-01-11 | 富士胶片株式会社 | Image capturing system |
| CN108958690A (en)* | 2018-08-16 | 2018-12-07 | 上海星视度科技有限公司 | Multi-screen interaction method, device, terminal device, server and storage medium |
| CN108958690B (en)* | 2018-08-16 | 2021-11-23 | 上海星视度科技有限公司 | Multi-screen interaction method and device, terminal equipment, server and storage medium |
| CN109246545A (en)* | 2018-09-04 | 2019-01-18 | 福建星网智慧科技股份有限公司 | A kind of double screen audio-frequency inputting method |
| CN109246545B (en)* | 2018-09-04 | 2020-09-11 | 福建星网智慧科技股份有限公司 | Double-screen audio output method |
| CN114840156A (en)* | 2021-01-30 | 2022-08-02 | 华为技术有限公司 | Multi-screen equipment control method and communication system |
| WO2022161220A1 (en)* | 2021-01-30 | 2022-08-04 | 华为技术有限公司 | Method for controlling multiple screen devices, and communication system |
| US12236155B2 (en) | 2021-01-30 | 2025-02-25 | Huawei Technologies Co., Ltd. | Method and communication system for controlling plurality of screen devices |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103699211A (en) | Electronic equipment and interconnecting and control method thereof | |
| JP5849484B2 (en) | Transmission terminal, display data transmission method, program, information providing apparatus, and transmission system | |
| US11153110B2 (en) | Communication method and terminal in live webcast channel and storage medium thereof | |
| EP2640100B1 (en) | Method and apparatus for providing an enhanced wi-fi display session in a wi-fi display network | |
| RU2681373C2 (en) | Peripheral devices in wireless docking system | |
| TWI533706B (en) | Unified communication based multi-screen video system | |
| AU2011318896B2 (en) | Transmission management system, transmission system, transmission management method, transmission management program, computer readable information recording medium, program providing system, and maintenance system | |
| JP6182911B2 (en) | Transmission terminal, transmission system, program | |
| EP4064759A1 (en) | Method and device for accessing network by network node, electronic equipment, and storage medium | |
| US8395651B2 (en) | System and method for providing a token in a video environment | |
| CN107409060A (en) | Adjacent Resource Pooling in Video/Audio Telecommunications | |
| WO2015078336A1 (en) | Method and terminal for shooting media | |
| KR20150027771A (en) | System and method for clustering of mobile devices and applications | |
| US20130329114A1 (en) | Image magnifier for pin-point control | |
| CN111245854B (en) | Media transmission method, media control method and device | |
| CN114629932B (en) | Cooperative method between electronic devices, electronic device and storage medium | |
| EP2849422A2 (en) | Apparatus, system, and method of managing data, and carrier means | |
| CN103327287A (en) | A method and device for playing conference signals, a video conference terminal, and a mobile device | |
| CN106412432A (en) | Photographing method and mobile terminal | |
| EP2849436A2 (en) | Apparatus, system, and method of managing data, and carrier means | |
| US20150189151A1 (en) | Information processing apparatus, imaging apparatus, information processing method, information processing program, and imaging system | |
| WO2013166762A1 (en) | Networking method and system for personal area network devices | |
| CN107360364B (en) | Image capturing method, terminal and computer-readable storage medium | |
| EP2482549A1 (en) | Apparatus and method for synchronizing media capture in a wireless device | |
| JP2016177097A (en) | COMMUNICATION DEVICE, COMMUNICATION DEVICE CONTROL METHOD, AND DISPLAY SYSTEM |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20140402 |