本申请要求于2023年8月16日提交中国专利局、申请号为202311034703.1、发明名称为“需求功能的提供方法、装置、设备及介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed with the China Patent Office on August 16, 2023, with application number 202311034703.1 and invention name “Method, device, equipment and medium for providing demand functions”, all contents of which are incorporated by reference in this application.
随着科技与经济的发展，头戴显示设备(例如AR设备及VR设备等)已经被越来越广泛的使用。With the development of science and technology and economy, head-mounted display devices (such as AR devices and VR devices, etc.) have been used more and more widely.
头戴显示设备分为分体式头戴设备以及一体式头戴设备这两种类型。然而，分体式头戴设备相比于一体式头戴设备，具备功耗、续航、重量以及散热性优良，因此，分体式头戴设备成为市场以及技术发展的趋势。对于分体式头戴设备，其通常适配有作为处理单元的PUCK设备。Head-mounted display devices are divided into two types: split head-mounted devices and integrated head-mounted devices. However, compared with integrated head-mounted devices, split head-mounted devices have better power consumption, battery life, weight and heat dissipation. Therefore, split head-mounted devices have become a trend in market and technological development. For split head-mounted devices, they are usually equipped with a PUCK device as a processing unit.
目前，提供给用户的PUCK设备所能实现的功能固定的。因此，PUCK设备无法为用户提供个性化的服务。Currently, the functions that can be realized by the PUCK devices provided to users are fixed. Therefore, the PUCK devices cannot provide personalized services for users.
发明内容Summary of the invention
本发明的一个目的是提供一种用于提供需求功能的新技术方案。An object of the present invention is to provide a new technical solution for providing the required functionality.
根据本发明的第一方面，提供了一种需求功能的提供方法，应用于头戴设备的控制设备，包括：According to a first aspect of the present invention, there is provided a method for providing a required function, which is applied to a control device of a head mounted device, comprising:
接收多个可执行所述控制设备的第一需求功能的第一子程序，其中，所述第一需求功能中至少包括多设备融合功能以及对所述头戴设备的串流设备的控制功能；Receiving a plurality of first subprograms capable of executing first required functions of the control device, wherein the first required functions at least include a multi-device fusion function and a control function of a streaming device of the head mounted device;
根据所述第一子程序，生成对应第一需求功能的第一子功能模块；According to the first subprogram, generating a first sub-function module corresponding to the first required function;
接收选择所述第一子功能模块中目标第一子功能模块的第一输入；receiving a first input for selecting a target first sub-functional module among the first sub-functional modules;
响应于所述第一输入，提供所述目标第一子功能模块的接口以及接口说明信息。In response to the first input, an interface and interface description information of the target first sub-function module are provided.
可选地，所述方法还包括：Optionally, the method further comprises:
接收基于目标接口对应的接口说明信息的第二输入；receiving a second input based on the interface description information corresponding to the target interface;
响应于所述第二输入，运行与所述目标接口对应目标第一子功能模块。In response to the second input, a first sub-function module corresponding to the target interface is executed.
可选地，所述目标接口为多设备融合功能对应的目标第一子功能模块的接口，所述响应于所述第二输入，运行与所述目标接口对应目标第一子功能模块，包括：Optionally, the target interface is an interface of a target first sub-function module corresponding to the multi-device fusion function, and in response to the second input, running the target first sub-function module corresponding to the target interface includes:
按照所述目标接口对应接口说明信息获取至少一个串流设备的图像以及所述控制设备本地的图像；Acquire an image of at least one streaming device and a local image of the control device according to the interface description information corresponding to the target interface;
融合至少一个串流设备的图像以及所述控制设备本地的图像，得到融合图像；fusing an image of at least one streaming device and a local image of the control device to obtain a fused image;
将所述融合图像发送至所述头戴设备，以由所述头戴设备显示所述融合图像。The fused image is sent to the head mounted device so that the head mounted device displays the fused image.
可选地，所述方法还包括：Optionally, the method further comprises:
在眼动交互模式下，获取所述头戴设备的佩戴者的注视状态，以及执行与所述注视状态相匹配的操作；In an eye movement interaction mode, obtaining a gaze state of a wearer of the head mounted device, and performing an operation matching the gaze state;
在虚拟标识与眼动双重交互模式下，获取所述头戴设备的注视位置以及所述虚拟标识在所述融合图像中的投射位置，执行与所述注视位置以及所述投射位置相匹配的操作。In the virtual marker and eye movement dual interaction mode, the gaze position of the head mounted device and the projection position of the virtual marker in the fused image are obtained, and an operation matching the gaze position and the projection position is performed.
可选地，接收至少一个作为可执行所述控制设备的第二需求功能的第二子程序，所述第二需求功能为新增需求功能；Optionally, receiving at least one second subprogram capable of executing a second required function of the control device, wherein the second required function is a newly added required function;
根据所述第二子程序，生成所述第二需求功能的第二子功能模块；generating a second sub-function module of the second required function according to the second sub-program;
在接收到选择所述第二子功能模块的第三输入的情况下，响应于所述第三输入，提供第二子功能模块的接口以及接口说明信息。When a third input for selecting the second sub-functional module is received, an interface and interface description information of the second sub-functional module are provided in response to the third input.
可选地，接收多个可执行所述头戴设备的第三需求功能的第三子程序；Optionally, receiving a plurality of third subroutines capable of executing a third required function of the head mounted device;
根据所述第三子程序，生成对应第三需求功能的第三子功能模块；According to the third subprogram, generating a third sub-function module corresponding to the third required function;
在所述控制设备与所述头戴设备通信连接的情况下，向所述头戴设备发送所述第三子功能模块的接口以及接口说明信息。When the control device is in communication connection with the head mounted device, the interface and interface description information of the third sub-functional module are sent to the head mounted device.
可选地，接收多个可执行所述串流设备的第四需求功能的第四子程序；Optionally, receiving a plurality of fourth subprograms capable of executing a fourth required function of the streaming device;
根据所述第四子程序，生成对应第四需求功能的第四子功能模块；According to the fourth subprogram, generating a fourth sub-function module corresponding to the fourth required function;
在所述控制设备与所述串流设备通信连接的情况下，向所述串流设备发送所述第四子功能模块的接口以及接口说明信息。When the control device is in communication connection with the streaming device, the interface and interface description information of the fourth sub-function module are sent to the streaming device.
可选地，所述响应于所述第一输入，提供所述目标第一子功能模块的接口以及接口说明信息，包括：Optionally, in response to the first input, providing the interface and interface description information of the target first sub-function module includes:
响应于所述第一输入，按照软件安装包的方式提供所述目标第一子功能模块的接口以及接口说明信息。In response to the first input, the interface and interface description information of the target first sub-function module are provided in the form of a software installation package.
根据本发明的第二方面，提供了一种需求功能的提供装置，应用于头戴设备的控制设备，包括：According to a second aspect of the present invention, there is provided a device for providing a required function, which is applied to a control device of a head mounted device, comprising:
第一接收模块，用于接收多个可执行所述控制设备的第一需求功能的第一子程序，其中，所述第一需求功能中至少包括多设备融合功能以及对所述头戴设备的串流设备的控制功能；A first receiving module, configured to receive a plurality of first subprograms capable of executing first required functions of the control device, wherein the first required functions at least include a multi-device fusion function and a control function of a streaming device of the head mounted device;
生成模块，用于根据所述第一子程序，生成对应第一需求功能的第一子功能模块；A generating module, used for generating a first sub-function module corresponding to a first required function according to the first sub-program;
第二接收模块，用于接收选择所述第一子功能模块中目标第一子功能模块的第一输入；A second receiving module, configured to receive a first input for selecting a target first sub-functional module in the first sub-functional modules;
提供模块，用于响应于所述第一输入，提供所述目标第一子功能模块的接口以及接口说明信息。A providing module is used to provide the interface and interface description information of the target first sub-function module in response to the first input.
根据本发明的第三方面，提供了一种控制设备，所述控制设备包括如第二方面所述的需求功能的提供装置；或者，According to a third aspect of the present invention, a control device is provided, the control device comprising the device for providing the demand function as described in the second aspect; or,
所述控制设备包括存储器和处理器，所述存储器用于存储计算机指令，所述处理器用于从所述存储器中调用所述计算机指令，以执行如第一方面中任一项所述的需求功能的提供方法。The control device includes a memory and a processor, the memory is used to store computer instructions, and the processor is used to call the computer instructions from the memory to execute the method for providing the required function as described in any one of the first aspects.
根据本发明的第四方面，提供了一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序在被处理器执行时实现根据第一方面中任一项所述的需求功能的提供方法。According to a fourth aspect of the present invention, there is provided a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the computer program implements the method for providing the required function according to any one of the first aspects.
在本发明实施例中，提供了一种需求功能的提供方法，该方法应用于头戴设备的控制设备，以及该方法通过接收多个可执行控制设备的第一需求功能的第一子程序，其中，第一需求功能中至少包括多设备融合功能以及对头戴设备的串流设备的控制功能，以及根据第一子程序，生成对应第一需求功能的第一子功能模块这两个步骤，可完成对控制设备的第一需求功能的模块化，得到每一第一需求功能对应的第一子功能模块。进一步的，基于接收选择第一子功能模块中目标第一子功能模块的第一输入，响应于第一输入，提供目标第一子功能模块的接口以及接口说明信息这两个步骤，可完成对符合需求的目标第一需求功能的指定，以及对控制设备中的第一需求功能的定制。在此基础上，控制设备可向用户提供符合需求的服务。即控制设备可为用户提供个性化服务。In an embodiment of the present invention, a method for providing a required function is provided, and the method is applied to a control device of a head-mounted device, and the method can complete the modularization of the first required function of the control device by receiving a plurality of first subprograms that can execute the first required function of the control device, wherein the first required function includes at least a multi-device fusion function and a control function of a streaming device of the head-mounted device, and generating a first sub-function module corresponding to the first required function according to the first subprogram, so as to obtain a first sub-function module corresponding to each first required function. Furthermore, based on the two steps of receiving a first input of selecting a target first sub-function module in the first sub-function module, and providing an interface and interface description information of the target first sub-function module in response to the first input, the specification of the target first required function that meets the requirements and the customization of the first required function in the control device can be completed. On this basis, the control device can provide users with services that meet their needs. That is, the control device can provide users with personalized services.
通过以下参照附图对本发明的示例性实施例的详细描述，本发明的其它特征及其优点将会变得清楚。Further features and advantages of the present invention will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the attached drawings.
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图示出的结构获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.
图1是实现本发明实施例提供的一种需求功能的提供方法的控制设备的硬件配置的框图一；1 is a block diagram 1 of the hardware configuration of a control device for implementing a method for providing a demand function provided by an embodiment of the present invention;
图2是实现本发明实施例提供的一种需求功能的提供方法的流程示意图；2 is a schematic flow chart of a method for providing a demand function according to an embodiment of the present invention;
图3是实现本发明实施例提供的一种控制设备、头戴设备以及串流设备的功能架构的示意图；3 is a schematic diagram of a functional architecture of a control device, a head-mounted device, and a streaming device provided by an embodiment of the present invention;
图4是实现本发明实施例提供的一种需求功能的提供装置的结构示意图；4 is a schematic diagram of the structure of a device for providing a demand function provided by an embodiment of the present invention;
图5是实现本发明实施例提供的一种需求功能的提供方法的控制设备的硬件配置的框图二。FIG. 5 is a second block diagram of the hardware configuration of a control device for implementing a method for providing a demand function provided in an embodiment of the present invention.
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings.
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本发明的一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
需要说明，若本发明实施例中有涉及方向性指示(诸如上、下、左、右、前、后……)，则该方向性指示仅用于解释在某一特定姿态(如附图所示)下各部件之间的相对位置关系、运动情况等，如果该特定姿态发生改变时，则该方向性指示也相应地随之改变。It should be noted that if there are directional indications (such as up, down, left, right, front, back, ...), the directional indication is only used to explain the relative position relationship, movement, etc. between the components under a specific posture (as shown in the attached figure). If the specific posture changes, the directional indication will also change accordingly.
另外，若本发明实施例中有涉及“第一”、“第二”等的描述，则该“第一”、“第二”等的描述仅用于描述目的，而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。另外，全文中出现的“和/或”的含义，包括三个并列的方案，以“A和/或B”为例，包括A方案、或B方案、或A和B同时满足的方案。另外，各个实施例之间的技术方案可以相互结合，但是必须是以本领域普通技术人员能够实现为基础，当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在，也不在本发明要求的保护范围之内。In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the meaning of "and/or" appearing in the full text includes three parallel schemes. Taking "A and/or B" as an example, it includes scheme A, or scheme B, or a scheme that satisfies both A and B. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in the field to implement. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.
图1是实现本发明实施例提供的一种需求功能的提供方法的控制设备的硬件配置的框图一。FIG. 1 is a block diagram 1 of the hardware configuration of a control device for implementing a method for providing a demand function provided by an embodiment of the present invention.
其中，控制设备具体为头戴设备的数据处理单元。控制设备为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统，可以为ios操作系统，当然还可以为其他可能的操作系统，对此本发明实施例不作具体限定。以及，头戴设备为分体式头戴设备。分体式头戴设备可以为AR、MR、VR或XR等分体式头戴设备。The control device is specifically a data processing unit of the head-mounted device. The control device is a device with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present invention. Also, the head-mounted device is a split head-mounted device. The split head-mounted device may be a split head-mounted device such as AR, MR, VR or XR.
控制设备1000可以包括处理器1100、存储器1200、接口装置1300、通信装置1400、显示装置1500、输入装置1600、扬声器1700、麦克风1800，等等。其中，处理器1100可以是中央处理器CPU、微处理器MCU等。存储器1200例如包括ROM(只读存储器)、RAM(随机存取存储器)、诸如硬盘的非易失性存储器等。接口装置1300例如包括USB接口、耳机接口等。通信装置1400例如能够进行有线或无线通信。显示装置1500例如是液晶显示屏、触摸显示屏等。输入装置1600例如可以包括触摸屏、键盘等。用户可以通过扬声器1700和麦克风1800输入/输出语音信息。The control device 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and the like. The processor 1100 may be a central processing unit CPU, a microprocessor MCU, and the like. The memory 1200 may include, for example, a ROM (read-only memory), a RAM (random access memory), a non-volatile memory such as a hard disk, and the like. The interface device 1300 may include, for example, a USB interface, a headphone interface, and the like. The communication device 1400 may, for example, be capable of wired or wireless communication. The display device 1500 may be, for example, a liquid crystal display screen, a touch display screen, and the like. The input device 1600 may include, for example, a touch screen, a keyboard, and the like. The user may input/output voice information through the speaker 1700 and the microphone 1800.
尽管在图1中对控制设备1000均示出了多个装置，但是，本发明可以仅涉及其中的部分装置，例如，控制设备1000只涉及存储器1200和处理器1100。Although FIG. 1 shows a plurality of devices for the control device 1000 , the present invention may only involve some of the devices. For example, the control device 1000 may only involve the memory 1200 and the processor 1100 .
应用于本发明的实施例中，控制设备1000的存储器1200用于存储指令，该指令用于控制处理器1100执行本发明实施例提供的需求功能的提供方法。In the embodiment of the present invention, the memory 1200 of the control device 1000 is used to store instructions. The instruction is used to control the processor 1100 to execute the method for providing the required function provided by the embodiment of the present invention.
在上述描述中，技术人员可以根据本发明所公开方案设计指令。指令如何控制处理器进行操作，这是本领域公知，故在此不再详细描述。In the above description, a technician can design instructions according to the scheme disclosed in the present invention. How instructions control the processor to operate is well known in the art, so it will not be described in detail here.
本发明实施例提供了一种需求功能的提供方法，该方法应用于头戴设备的控制设备，如图2所示，该方法包括如下S2100-S2400:An embodiment of the present invention provides a method for providing a required function, which is applied to a control device of a head mounted device. As shown in FIG. 2 , the method includes the following steps S2100-S2400:
S2100、接收多个可执行控制设备的第一需求功能的第一子程序。S2100, receiving a plurality of first subroutines capable of executing a first required function of a control device.
其中，第一需求功能中至少包括设备融合以及对头戴设备的串流设备的控制。Among them, the first required function includes at least device integration and control of the streaming device of the head-mounted device.
需要说明的是，在本发明实施例提供的需求功能提供方法应用于串流场景。该场景包括控制设备、头戴设备以及串流设备，以及，头戴设备和串流设备分别与控制设备通信连接。其中，通信连接的方式可以为Wifi或者USB的方式。串流设备可示例性的为手机、PAD或PC等。It should be noted that the method for providing the required function provided in the embodiment of the present invention is applied to the streaming scenario. The scenario includes a control device, a head-mounted device and a streaming device, and the head-mounted device and the streaming device are respectively connected to the control device in communication. The communication connection method can be Wifi or USB. The streaming device can be exemplarily a mobile phone, a PAD or a PC.
在本发明实施例中，第一需求功能为初始状态下控制设备默认的需求功能。一个第一需求功能对应一个第一子程序，即第一需求功能和第一子程序为一一对应关系。In the embodiment of the present invention, the first demand function is a default demand function of the control device in the initial state. One first demand function corresponds to one first subprogram, that is, the first demand function and the first subprogram are in a one-to-one correspondence.
在本发明的一个实施例中，第一需求功能可示例性的分别包括：串流/通信功能、对头戴设备的串流设备的控制功能、对控制设备本地的控制功能、应用多开功能、第三方算法功能、插件功能、OpenXR Loader功能、多设备融合功能。其中，多设备融合功能可通过XRRuntime功能来实现。In one embodiment of the present invention, the first required functions may exemplarily include: streaming/communication function, control function of streaming device of head mounted device, control function of local control device, multi-application opening function, third-party algorithm function, plug-in function, OpenXR Loader function, multi-device fusion function. Among them, the multi-device fusion function can be realized by XRRuntime function.
对于上述内容，串流/通信功能包括串流功能和通信功能，其中串流功能具体值的是：接收串流设备的显示图像的功能，对串流设备的显示图像进行显示的功能，以及通信功能具体指的是：串流设备和控制设备之间的控制命令传输功能，以及控制设备与头戴设备之间的3Dof/6Dof、Audio、Camera等数据的传输功能；For the above content, the streaming/communication function includes a streaming function and a communication function, wherein the streaming function specifically refers to: a function of receiving a display image of a streaming device, a function of displaying a display image of a streaming device, and the communication function specifically refers to: a control command transmission function between a streaming device and a control device, and a transmission function of 3Dof/6Dof, Audio, Camera and other data between a control device and a head-mounted device;
多设备融合功能具体指的是：完成控制设备本地显示图像和串流设备的显示图像的融合，以及将融合得到的图像传输至头戴设备的功能；The multi-device fusion function specifically refers to: completing the fusion of the local display image of the control device and the display image of the streaming device, and transmitting the fused image to the head-mounted device;
应用多开功能具体指的是：同时启动多个应用(本地应用和/或串流设备上的应用)，使得每个应用运行在头戴设备的不同的屏幕上，这些应用都处于前台，并且应用启动的后续应用、窗口等必须和该应用运行在同一屏幕上，该功能需要Framework层进行定制；The multi-application function specifically means: launching multiple applications (local applications and/or applications on the streaming device) at the same time, so that each application runs on a different screen of the head-mounted device, these applications are in the foreground, and subsequent applications, windows, etc. launched by the application must run on the same screen as the application. This function requires customization at the Framework layer;
对头戴设备的串流设备的控制功能具体指的是：支持射线、手势、语音等多种交互方式控制串流设备上的应用，以及支持多开后头戴设备上的每个屏幕的鼠标、键盘交互，支持基于屏幕的音量控制等，该功能需要Framework层进行定制；The control function of the streaming device of the head-mounted device specifically refers to: supporting multiple interactive methods such as rays, gestures, and voice to control the application on the streaming device, supporting mouse and keyboard interaction on each screen of the head-mounted device after multiple openings, supporting screen-based volume control, etc. This function needs to be customized at the Framework layer;
对控制设备本地的控制功能具体指的是：支持射线、手势、语音等多种交互方式控制本地应用，以及支持多开后头戴设备上的每个屏幕的鼠标、键盘交互，支持基于屏幕的音量控制等，该功能需要Framework层进行定制；The local control function of the control device specifically refers to: supporting multiple interactive methods such as ray, gesture, voice, etc. to control local applications, supporting mouse and keyboard interaction on each screen of the head-mounted device after multiple openings, supporting screen-based volume control, etc. This function needs to be customized at the Framework layer;
第三方算法功能具体指的是：使用头戴设备的3Dof/6Dof、Camera数据实现空间锚定、手势识别、平面检测等功能。The third-party algorithm function specifically refers to: using the 3Dof/6Dof and Camera data of the head-mounted device to achieve spatial anchoring, gesture recognition, plane detection and other functions.
对于上述任一第一需求功能，由开发人员向控制设备输入可执行(即实现)第一需求功能的程序。在本发明实施例中，将前述程序记为第一子程序。基于此，控制设备接收到多个可执行控制设备的第一需求功能的第一子程序。For any of the above-mentioned first required functions, the developer inputs a program that can execute (i.e., realize) the first required function into the control device. In the embodiment of the present invention, the above-mentioned program is recorded as a first subroutine. Based on this, the control device receives multiple first subroutines that can execute the first required function of the control device.
S2200、根据第一子程序，生成对应第一需求功能的第一子功能模块。S2200: Generate a first sub-function module corresponding to a first required function according to a first sub-program.
在本发明实施例中，对于任一第一子程序，控制设备将第一子程序进行封装保护，得到对应第一子功能模块。以及，第一子功能模块具备调用其中第一子程序的接口以及该接口的接口说明信息。其中，接口说明信息用于描述如何使用该接口。In the embodiment of the present invention, for any first subprogram, the control device encapsulates and protects the first subprogram to obtain a corresponding first sub-function module. In addition, the first sub-function module has an interface for calling the first subprogram therein and interface description information of the interface. The interface description information is used to describe how to use the interface.
基于上述S2100和S2200，可实现对控制设备的第一需求功能的模块化。这样可为后续的用户定制符合自身需求的第一需求功能提供定制基础。Based on the above S2100 and S2200, the modularization of the first requirement function of the control device can be achieved, which can provide a customization basis for subsequent users to customize the first requirement function that meets their own needs.
S2300、接收选择第一子功能模块中目标第一子功能模块的第一输入。S2300: Receive a first input for selecting a target first sub-functional module in a first sub-functional module.
在本发明实施例中，将第一子功能模块中符合用户需求的第一子功能模块记为目标第一子功能模块。第一输入为从第一子功能模块中选择目标第一子功能模块的输入。In the embodiment of the present invention, the first sub-function module that meets the user's requirements among the first sub-function modules is recorded as the target first sub-function module. The first input is an input for selecting the target first sub-function module from the first sub-function modules.
目标第一子功能可以至少一个。需要说明的是，在本发明实施例中目标第一子功能的数量不做限定。There can be at least one target first sub-function. It should be noted that in the embodiment of the present invention, the number of target first sub-functions is not limited.
通过上述S2300可完成对符合需求的目标第一需求功能的指定。The above S2300 can complete the designation of the target first requirement function that meets the requirements.
S2400、响应于第一输入，提供目标第一子功能模块的接口以及接口说明信息。S2400 . In response to a first input, provide an interface and interface description information of a target first sub-function module.
在本发明实施例中，将基于第一输入所选择的第一子功能模块作为目标第一子功能模块。在确定出目标第一子功能模块后，提供目标第一子功能模块的接口以及接口说明信息。这样，基于接口的说明信息，可确定对应接口如何调用。以及，基于接口的说明信息对接口调用后，可使得控制设备可执行接口对应的目标第一子功能模块所对应的第一需求功能。In an embodiment of the present invention, the first sub-function module selected based on the first input is used as the target first sub-function module. After the target first sub-function module is determined, the interface and interface description information of the target first sub-function module are provided. In this way, based on the description information of the interface, it can be determined how to call the corresponding interface. And, after calling the interface based on the description information of the interface, the control device can execute the first required function corresponding to the target first sub-function module corresponding to the interface.
在一个示例中，在目标第一子功能模块为多设备融合功能以及对头戴设备的串流设备的控制功能的第一子功能模块的情况下，基于上述S2400，控制设备可仅实现多设备融合功能以及对头戴设备的串流设备的控制功能。In one example, when the target first sub-function module is the first sub-function module of the multi-device fusion function and the control function of the streaming device of the head-mounted device, based on the above S2400, the control device may only implement the multi-device fusion function and the control function of the streaming device of the head-mounted device.
通过上述S2400，则可完成对控制设备中的第一需求功能的定制。这样，可使得控制设备向用户提供符合需求的服务。即控制设备可为用户提供个性化服务。Through the above S2400, the customization of the first required function in the control device can be completed. In this way, the control device can provide the user with a service that meets the user's needs. That is, the control device can provide personalized services for the user.
在本发明的一个实施例中，上述S2400可示例性的按照如下S2410来实现：In one embodiment of the present invention, the above S2400 may be implemented illustratively according to the following S2410:
S2410、响应于第一输入，按照软件安装包的方式提供目标第一子功能模块的接口以及接口信息。S2410. In response to the first input, provide an interface and interface information of a target first sub-function module in the form of a software installation package.
在本发明实施例中，目标第一子功能接口以及接口信息通过软件安装包(Software Development Kit，SDK)的方式向用户呈现。由于SDK为用户常用的方式，且按照软件安装包的方式所提供的接口信息中还包括接口操作示例等信息，因此通过上述S2410，可使得用户便于对控制设备的使用。In an embodiment of the present invention, the target first sub-function interface and interface information are presented to the user in the form of a software installation package (Software Development Kit, SDK). Since SDK is a common method used by users, and the interface information provided in the form of a software installation package also includes information such as interface operation examples, the above S2410 can facilitate the user to use the control device.
在本发明实施例中，提供了一种需求功能的提供方法，该方法应用于头戴设备的控制设备，以及该方法通过接收多个可执行控制设备的第一需求功能的第一子程序，其中，第一需求功能中至少包括多设备融合功能以及对头戴设备的串流设备的控制功能，以及根据第一子程序，生成对应第一需求功能的第一子功能模块这两个步骤，可完成对控制设备的第一需求功能的模块化，得到每一第一需求功能对应的第一子功能模块。进一步的，基于接收选择第一子功能模块中目标第一子功能模块的第一输入，响应于第一输入，提供目标第一子功能模块的接口以及接口说明信息这两个步骤，可完成对符合需求的目标第一需求功能的指定，以及对控制设备中的第一需求功能的定制。在此基础上，控制设备可向用户提供符合需求的服务。即控制设备可为用户提供个性化服务。In an embodiment of the present invention, a method for providing a demand function is provided, and the method is applied to a control device of a head-mounted device, and the method can complete the modularization of the first demand function of the control device by receiving a plurality of first subprograms that can execute the first demand function of the control device, wherein the first demand function includes at least a multi-device fusion function and a control function of the streaming device of the head-mounted device, and generating a first sub-function module corresponding to the first demand function according to the first subprogram. The first sub-function module corresponding to each first demand function is obtained. Furthermore, based on receiving a first input of selecting a target first sub-function module in the first sub-function module, in response to the first input, providing The two steps of providing the interface of the target first sub-function module and the interface description information can complete the designation of the target first requirement function that meets the requirements and the customization of the first requirement function in the control device. On this basis, the control device can provide the user with services that meet the requirements. That is, the control device can provide personalized services for the user.
在本发明的一个实施例中，本发明实施例提供的需求功能的提供方法还包括如下S2510和S2511：In one embodiment of the present invention, the method for providing the required function provided by the embodiment of the present invention further includes the following S2510 and S2511:
S2510、接收基于目标接口对应的接口说明信息的第二输入。S2510. Receive a second input based on interface description information corresponding to the target interface.
在本发明实施例中，目标接口为符合用户调用需求的接口。用户根据目标接口的接口说明信息，执行对目标接口调用操作的输入。基于此，控制设备接收到第二输入。In the embodiment of the present invention, the target interface is an interface that meets the user's calling requirements. The user performs input of the target interface calling operation according to the interface description information of the target interface. Based on this, the control device receives the second input.
S2511、响应于第二输入，运行目标接口对应目标第一子功能模块。S2511. In response to the second input, run the target first sub-function module corresponding to the target interface.
在本发明实施例中，在接收到第二输入的情况下，控制设备执行第二输所调用的目标第一子功能模块所对应的第一子程序。此时，控制设备可完成第二输入所调用的目标第一子功能模块对应的需求功能。In the embodiment of the present invention, when receiving the second input, the control device executes the first subroutine corresponding to the target first sub-function module called by the second input. At this time, the control device can complete the required function corresponding to the target first sub-function module called by the second input.
在上述S2510和S2511所示实施例的基础上，在目标接口为多设备融合功能对应的目标第一子功能模块的接口的情况下，上述S2511具体通过下述S2511-1至S2511-3来实现：On the basis of the embodiments shown in S2510 and S2511 above, when the target interface is the interface of the target first sub-function module corresponding to the multi-device fusion function, the above S2511 is specifically implemented by the following S2511-1 to S2511-3:
S2511-1、按照目标接口对应接口说明信息获取至少一个串流设备的图像以及控制设备本地的图像。S2511-1. Obtain an image of at least one streaming device and a local image of the control device according to the interface description information corresponding to the target interface.
SS2511-2、融合至少一个串流设备的图像以及控制设备本地的图像，得到融合图像。SS2511-2. Fuse the image of at least one streaming device and the local image of the control device to obtain a fused image.
S2511-3、将融合图像发送至头戴设备，以由头戴设备显示融合图像。S2511-3. Send the fused image to the head mounted device so that the head mounted device displays the fused image.
在本发明实施例中，按照目标接口对应接口说明信息所规定的获取方式，获取至少一个串流设备的图像以及控制设备本地的图像。以及，将至少一个串流设备的图像以及控制设备本地的图像进行拼接，得到融合图像。基于此完成图像融合。进一步的，控制设备将融合图像发送至头戴设备，以由头戴设备进行显示。In an embodiment of the present invention, an image of at least one streaming device and an image of a local control device are acquired in accordance with an acquisition method specified by the interface description information corresponding to the target interface. Furthermore, the image of at least one streaming device and the image of the local control device are spliced to obtain a fused image. Based on this, image fusion is completed. Further, the control device sends the fused image to the head-mounted device for display by the head-mounted device.
在本发明实施例中，在用户调用多设备融合功能对应的目标第一子功能模块的接口的情况下，通过上述S2511-1至S2511-3，控制设备可完成多设备融合功能。In the embodiment of the present invention, when the user calls the target first sub-function corresponding to the multi-device fusion function In the case of a module interface, through the above S2511-1 to S2511-3, the control device can complete the multi-device fusion function.
在上述S2511-1至S2511-3所示实施例的基础上，本发明实施例提供的需求功能的提供方法还包括如下S2511-4和S2511-5：On the basis of the embodiments shown in S2511-1 to S2511-3 above, the method for providing the required function provided in the embodiment of the present invention further includes the following S2511-4 and S2511-5:
S2511-4、在眼动交互模式下，获取头戴设备的佩戴者的注视状态，以及执行与注视状态相匹配的操作。S2511-4. In the eye movement interaction mode, obtain the gaze state of the wearer of the head mounted device, and perform operations matching the gaze state.
S2511-5、在虚拟标识与眼动双重交互模式下，获取头戴设备的佩戴者的注视位置以及虚拟标识在融合图像中的投射位置，执行与注视位置以及投射位置相匹配的操作。S2511-5. In the dual interaction mode of virtual identification and eye movement, obtain the gaze position of the wearer of the head mounted device and the projection position of the virtual identification in the fused image, and perform operations matching the gaze position and the projection position.
在本发明实施例中，对融合图像的交互，具备两种交互模式。这两种交互模式分别为：眼动交互模式、虚拟标识与眼动双重交互模式。In the embodiment of the present invention, the interaction of the fused image has two interaction modes, which are eye movement interaction mode and virtual marker and eye movement dual interaction mode.
在本发明实施例中，眼动交互模式指的是由头戴设备的佩戴者的眼睛与融合图像进行交互的方式。In the embodiment of the present invention, the eye movement interaction mode refers to the way in which the eyes of the wearer of the head mounted device interact with the fused image.
虚拟标识与眼动双重交互模式指的是由控制设备所发射的虚拟标识与头戴设备的佩戴者的眼睛共同与融合图像进行交互的方式。在本发明的一个实施例中，虚拟标识用于描述在佩戴者手执控制设备以指向融合图像上的交互位置的情况下，控制设备与交互位置所在路径。在一个示例中，虚拟标识可以是直线、射线或曲线，对此本发明实施例不做限定。The virtual marker and eye movement dual interaction mode refers to the way in which the virtual marker emitted by the control device and the eyes of the wearer of the head-mounted device interact with the fused image together. In one embodiment of the present invention, the virtual marker is used to describe the path between the control device and the interaction location when the wearer holds the control device to point to the interaction location on the fused image. In one example, the virtual marker can be a straight line, a ray, or a curve, which is not limited in this embodiment of the present invention.
在本发明的一个实施例中，上述的两种交互模式可由用户根据自身需求进行选择，或者根据控制设备当前运行应用的应用类型进行自动选择。对此，本发明实施例不做限定。In an embodiment of the present invention, the above two interaction modes can be selected by the user according to his/her own needs, or can be automatically selected according to the application type currently running on the control device. This embodiment of the present invention does not limit this.
在本发明的一个实施例中，在眼动追踪模式下，可通过眼动追踪算法确定出佩戴者在融合图像上的注视位置以及注视位置对应的注视时间段。在本发明实施例中，将注视位置以及注视时间段记为注视状态。In one embodiment of the present invention, in the eye tracking mode, the gaze position of the wearer on the fused image and the gaze time period corresponding to the gaze position can be determined by an eye tracking algorithm. In the embodiment of the present invention, the gaze position and the gaze time period are recorded as the gaze state.
以及，在眼动追踪模式下，对于不同的注视状态，控制设备执行不同的操作。例如，在注视状态表示注视位置不发生变化，该注视位置对应的注视时间段达到预设时长的情况下，则确定佩戴者为凝视注视位置的状态，此时执行与凝视注视位置的状态相匹配的操作。其中，与凝视注视位置的状态相匹配的操作可预先进行指定。在一个示例性中，与凝视注视位置的状态相匹配的操作，可以为确认操作。Also, in the eye tracking mode, for different gaze states, the control device performs different operations. For example, when the gaze state indicates that the gaze position does not change and the gaze time period corresponding to the gaze position reaches a preset time length, it is determined that the wearer is in the state of gazing at the gaze position, and an operation matching the state of gazing at the gaze position is performed. The matching operation can be specified in advance. In an exemplary embodiment, the operation matching the state of the gaze position can be a confirmation operation.
又例如，在注视状态表示注视位置不变，但是该注视位置对应的注视时间段为不连续的两个较短的时间段的情况下，则确定佩戴者为两次眨眼的状态，此时执行与对注视位置进行两次眨眼的状态相匹配的操作。相同的，与对注视位置进行眨眼的状态相匹配的操作可预先进行指定。在一个示例性中，与对注视位置进行眨眼的状态相匹配的操作，可以为复制操作。For another example, when the gaze state indicates that the gaze position remains unchanged, but the gaze time period corresponding to the gaze position is two discontinuous shorter time periods, it is determined that the wearer is in a state of blinking twice, and an operation matching the state of blinking twice at the gaze position is performed. Similarly, the operation matching the state of blinking at the gaze position can be specified in advance. In an exemplary embodiment, the operation matching the state of blinking at the gaze position can be a copy operation.
在本发明的一个实施例中，在虚拟标识与眼动双重交互模式下，则可通过眼动追踪算法确定出佩戴者在融合图像上的注视位置。以及通过传统的确定虚拟标识在融合图像上的投射位置的方式，获取虚拟标识在融合图像中的投射位置。在上述内容的基础上，上述S2511-5中的执行与注视位置以及所述投射位置相匹配的操作的操作具体为：In one embodiment of the present invention, in the virtual marker and eye movement dual interaction mode, the gaze position of the wearer on the fused image can be determined by an eye movement tracking algorithm. And the projection position of the virtual marker on the fused image is obtained by a traditional method of determining the projection position of the virtual marker on the fused image. Based on the above content, the operation of performing the operation matching the gaze position and the projection position in the above S2511-5 is specifically:
在虚拟标识在融合图像上的位置与佩戴者的注视位置的差距小于预设阈值的情况下，则确定虚拟标识在融合图像上的位置与佩戴者的注视位置重合，此时执行注视位置和/或虚拟标识在投射位置处对应的操作。例如，在注视位置和/或虚拟标识在投射位置处对应的按钮为“确认”按钮的情况下，则执行该按钮对应的确认操作。When the difference between the position of the virtual marker on the fused image and the gaze position of the wearer is less than a preset threshold, it is determined that the position of the virtual marker on the fused image coincides with the gaze position of the wearer, and the operation corresponding to the gaze position and/or the virtual marker at the projected position is performed. For example, when the button corresponding to the gaze position and/or the virtual marker at the projected position is a "confirm" button, the confirmation operation corresponding to the button is performed.
对应的，在虚拟标识在融合图像上的位置与佩戴者的注视位置的差距小于预设阈值的情况下，则确定虚拟标识在融合图像上的位置与佩戴者的注视位置不重合，此时则不执行任何操作。Correspondingly, when the difference between the position of the virtual marker on the fused image and the wearer's gaze position is less than a preset threshold, it is determined that the position of the virtual marker on the fused image does not coincide with the wearer's gaze position, and no operation is performed at this time.
对于虚拟标识和眼动双重交互模式，对于其中的眼动追踪的精度要求低，这样可降低控制设备的功耗。对应的，在眼动交互模式下，对眼动追踪的精度要求高。For the virtual identification and eye movement dual interaction mode, the eye movement tracking accuracy requirement is low, which can reduce the power consumption of the control device. Correspondingly, in the eye movement interaction mode, the eye movement tracking accuracy requirement is high.
在本发明的一个实施例中，本发明实施例提供的需求功能的提供方法还包括如下S2610-S2612：In one embodiment of the present invention, the method for providing the required function provided by the embodiment of the present invention further includes the following S2610-S2612:
S2610、接收至少一个作为可执行控制设备的第二需求功能的第二子程序。S2610, receiving at least one second subroutine as a second required function of an executable control device.
其中，第二需求功能为新增需求功能。Among them, the second demand function is a new demand function.
在本发明实施例中，在开发人员在默认的需求功能即第一需求功能的基础上，增加新的需求功能即第二需求功能的情况下，开发人员向控制设备输入可执行第二需求功能的程序。在本发明实施例中，将前述程序记为第二子程序。基于此，控制设备接收到至少一个可执行控制设备的第二需求功能的第二子程序。In the embodiment of the present invention, when the developer adds a new requirement function, namely the second requirement function, on the basis of the default requirement function, namely the first requirement function, the developer inputs a program capable of executing the second requirement function into the control device. In the embodiment of the present invention, the aforementioned program is recorded as a second subroutine. Based on this, the control device receives at least one second subroutine capable of executing the second requirement function of the control device.
S2611、根据第二子程序，生成第二需求功能的第二子功能模块。S2611. Generate a second sub-function module of the second required function according to the second sub-program.
在本发明实施例中，上述S2611的具体实现与上述S2200的具体实现相同，这里不再赘述。In the embodiment of the present invention, the specific implementation of the above S2611 is the same as the specific implementation of the above S2200, which will not be repeated here.
S2612、在接收到选择第二子功能模块的第三输入的情况下，响应于第三输入，提供第二子功能模块的接口以及接口说明信息。S2612: When a third input for selecting the second sub-functional module is received, provide an interface and interface description information of the second sub-functional module in response to the third input.
在本发明的一个实施例中，上述S2612的具体实现可以为：在接收到选择第二子功能模块的第三输入的情况下，按照软件安装包的方式响应于第三输入，提供第二子功能模块的接口以及接口说明信息。In one embodiment of the present invention, the specific implementation of the above S2612 may be: upon receiving a third input for selecting the second sub-function module, responding to the third input in the form of a software installation package to provide an interface and interface description information of the second sub-function module.
在本发明实施例中，第三输入为用户选择第二子功能模块的输入。在接收到第三输入的情况下，则说明用户希望控制设备能够实现第二子功能模块对应的第二需求功能。此时，控制设备提供第二子功能模块的接口以及接口说明信息以供用户对第二子功能模块的调用。In the embodiment of the present invention, the third input is an input for the user to select the second sub-function module. When the third input is received, it means that the user hopes that the control device can realize the second required function corresponding to the second sub-function module. At this time, the control device provides the interface and interface description information of the second sub-function module for the user to call the second sub-function module.
在本发明实施例中，通过上述S2610-S2612可实现对控制设备的需求功能的新增。以及，供用户对新增的需求功能的调用。In the embodiment of the present invention, the above S2610-S2612 can realize the addition of the required functions of the control device, and the user can call the newly added required functions.
在本发明的一个实施例中，本发明实施例提供的需求功能的提供方法还包括如下S2710-S2712：In one embodiment of the present invention, the method for providing the required function provided by the embodiment of the present invention further includes the following S2710-S2712:
S2710、接收多个可执行头戴设备的第三需求功能的第三子程序。S2710, receiving a plurality of third subroutines capable of executing a third required function of the head mounted device.
S2711、根据第三子程序，生成对应第三需求功能的第三子功能模块。S2711. Generate a third sub-function module corresponding to the third required function according to the third sub-program.
S2712、在控制模块与头戴设备通信连接的情况下，向头戴设备发送第三子功能模块的接口以及接口说明信息。S2712: When the control module is in communication connection with the head mounted device, send the interface and interface description information of the third sub-function module to the head mounted device.
需要说明的是，上述S2710和S2711的具体实现与上述S2100与S2200的具体实现相同，这里不再赘述。It should be noted that the specific implementation of the above S2710 and S2711 is the same as the specific implementation of the above S2100 and S2200, and will not be repeated here.
在本发明的一个实施例中，上述S2712的具体实现可以为：在控制模块与头戴设备通信连接的情况下，向头戴设备发送按照软件安装包的方式提供的第三子功能模块的接口以及接口说明信息。In one embodiment of the present invention, the specific implementation of the above S2712 may be: in the control module When communicating with the head mounted device, the interface and interface description information of the third sub-function module provided in the form of a software installation package are sent to the head mounted device.
在本发明实施例中，头戴设备与控制设备相适配，两者之间相辅相成。因此，头戴设备需实现适配于控制设备的需求功能。在本发明实施例中，将头戴设备适配于控制设备的需求的功能，记为第三需求功能。In the embodiment of the present invention, the head mounted device and the control device are adapted to each other, and the two complement each other. Therefore, the head mounted device needs to realize the required function adapted to the control device. In the embodiment of the present invention, the function of the head mounted device to adapt to the requirements of the control device is recorded as the third required function.
以及，由控制设备生成第三需求功能的第三子功能模块，以及将第三子功能模块的接口以及接口说明信息，基于控制设备与头戴设备之间的通信连接，发送至头戴设备。这样，在头戴设备适配控制设备的情况下，无需在头戴设备侧进行改进。Furthermore, the control device generates a third sub-function module of the third required function, and sends the interface and interface description information of the third sub-function module to the head-mounted device based on the communication connection between the control device and the head-mounted device. In this way, when the head-mounted device is adapted to the control device, no improvement is required on the head-mounted device side.
在本发明的一个实施例中，第三需求功能可示例性的分别包括：获取头戴设备侧的Camera数据的功能、获取头戴设备侧的Audio数据的功能、向控制设备提供头戴设备侧的3Dof/6Dof数据的功能、编解码功能、TimeWarp功能、渲染上屏功能、串流/通信功能等。In one embodiment of the present invention, the third required functions may exemplarily include: a function of obtaining Camera data on the head-mounted device side, a function of obtaining Audio data on the head-mounted device side, a function of providing 3Dof/6Dof data on the head-mounted device side to the control device, a coding function, a TimeWarp function, a rendering on-screen function, a streaming/communication function, etc.
对应于上一实施例，在本发明的一个实施例中，本发明实施例提供的需求功能的提供方法还包括如下S2810-S2812：Corresponding to the previous embodiment, in one embodiment of the present invention, the method for providing the required function provided by the embodiment of the present invention further includes the following S2810-S2812:
S2810、根据多个可执行所述串流设备的第四需求功能的第四子程序。S2810, executing a fourth subprogram of the streaming device according to a plurality of fourth required functions.
S2811、根据所述第四子程序，生成对应第四需求功能的第四子功能模块。S2811. Generate a fourth sub-function module corresponding to a fourth required function according to the fourth sub-program.
S2812、在所述控制设备与所述串流设备通信连接的情况下，向所述串流设备发送所述第四子功能模块的接口以及接口说明信息。S2812: When the control device is in communication connection with the streaming device, send the interface and interface description information of the fourth sub-function module to the streaming device.
需要说明的是，上述S2810和S2811的具体实现与上述S2100与S2200的具体实现相同，这里不再赘述。It should be noted that the specific implementation of the above S2810 and S2811 is the same as the specific implementation of the above S2100 and S2200, and will not be repeated here.
在本发明的一个实施例中，上述S2812的具体实现可以为：在控制模块与串流设备通信连接的情况下，向串流设备发送按照软件安装包的方式提供的第四子功能模块的接口以及接口说明信息。In one embodiment of the present invention, the above S2812 may be specifically implemented as follows: when the control module is in communication connection with the streaming device, the interface and interface description information of the fourth sub-function module provided in the form of a software installation package are sent to the streaming device.
在本发明实施例中，串流设备与控制设备相适配，两者之间相辅相成。因此，串流设备需实现适配于控制设备的需求功能。在本发明实施例中，将串流设备适配于控制设备的需求的功能，记为第四需求功能。In the embodiment of the present invention, the streaming device and the control device are adapted to each other, and the two complement each other. Therefore, the streaming device needs to realize the function of adapting to the requirements of the control device. In the embodiment of the present invention, the function of adapting the streaming device to the requirements of the control device is recorded as the fourth required function.
以及，由控制设备生成第四需求功能的第四子功能模块，以及将第四子功能模块的接口以及接口说明信息，基于控制设备与串流设备之间的通信连接，发送至串流设备。这样，在串流设备适配控制设备的情况下，无需在串流设备侧进行改进。and generating, by the control device, a fourth sub-function module of the fourth required function, and transmitting the interface and interface description information of the fourth sub-function module to the control device based on the communication connection between the control device and the streaming device. In this way, when the streaming device is adapted to the control device, no improvement is required on the streaming device side.
在本发明的一个实施例中，第四需求功能可示例性的分别包括：串流/通信功能、接收控制设备侧的控制指令的功能、将控制指令转换成坐标时间上报给串流设备的应用的功能。In one embodiment of the present invention, the fourth required function may illustratively include: a streaming/communication function, a function of receiving control instructions from the control device side, and a function of converting the control instructions into coordinate time and reporting it to the application of the streaming device.
结合上述内容，本发明实施例中的控制设备、头戴设备以及串流设备的功能架构如图3所示。In combination with the above content, the functional architecture of the control device, the head mounted device and the streaming device in the embodiment of the present invention is shown in FIG3 .
其中，图3中以控制设备支持OpenXR标准，且具备的操作系统为安卓操作系统为例进行示出。基于此，控制设备的软件安装包SDK划分为：Plugin层、Graphic Plugin层、Platform Plugin层、Runtime process层。且SDK作为APP层的服务层。以及，对头戴设备的串流设备的控制功能、对控制设备本地的控制功能以及应用多开实质上是基于framework层实现。以及，在基于framework层实现对头戴设备的串流设备的控制功能、对控制设备本地的控制功能以及应用多开时，framework层包括：应用管理、权限管理、屏幕管理、Audio管理、显示管理、窗口管理、Input管理以及Camera管理。Among them, FIG3 shows an example in which the control device supports the OpenXR standard and has an Android operating system. Based on this, the software installation package SDK of the control device is divided into: Plugin layer, Graphic Plugin layer, Platform Plugin layer, and Runtime process layer. And SDK serves as the service layer of the APP layer. In addition, the control function of the streaming device of the head-mounted device, the control function of the local control device, and the multi-application opening are essentially implemented based on the framework layer. In addition, when the control function of the streaming device of the head-mounted device, the control function of the local control device, and the multi-application opening are implemented based on the framework layer, the framework layer includes: application management, permission management, screen management, Audio management, display management, window management, Input management, and Camera management.
本发明实施例还提供了一种需求功能的提供装置400，应用于头戴设备的控制设备，如图4所示，包括：The embodiment of the present invention further provides a device 400 for providing a required function, which is applied to a control device of a head mounted device, as shown in FIG4 , and includes:
第一接收模块410，用于接收多个可执行所述控制设备的第一需求功能的第一子程序，其中，所述第一需求功能中至少包括多设备融合功能以及对所述头戴设备的串流设备的控制功能；A first receiving module 410 is used to receive a plurality of first subprograms capable of executing first required functions of the control device, wherein the first required functions at least include a multi-device fusion function and a control function of a streaming device of the head mounted device;
生成模块420，用于根据所述第一子程序，生成对应第一需求功能的第一子功能模块；A generating module 420, configured to generate a first sub-function module corresponding to a first required function according to the first sub-program;
第二接收模块430，用于接收选择所述第一子功能模块中目标第一子功能模块的第一输入；A second receiving module 430, configured to receive a first input for selecting a target first sub-functional module among the first sub-functional modules;
提供模块440，用于响应于所述第一输入，提供所述目标第一子功能模块的接口以及接口说明信息。The providing module 440 is used to provide the interface and interface description information of the target first sub-function module in response to the first input.
基于本发明实施例提供的需求功能的提供装置，控制设备可向用户提供符合需求的服务。即控制设备可为用户提供个性化服务。Based on the device for providing the required function provided by the embodiment of the present invention, the control device can provide the user with services that meet the requirements, that is, the control device can provide the user with personalized services.
在本发明的一个实施例中，本发明实施例提供的需求功能的提供装置400还包括：In one embodiment of the present invention, the device 400 for providing the required function provided by the embodiment of the present invention further includes:
第三接收模块，接收基于目标接口对应的接口说明信息的第二输入；A third receiving module receives a second input based on the interface description information corresponding to the target interface;
运行模块，响应于所述第二输入，运行与所述目标接口对应目标第一子功能模块。The running module runs the first sub-function module corresponding to the target interface in response to the second input.
在本发明的一个实施例中，所述目标接口为多设备融合功能对应的目标第一子功能模块的接口，运行模块具体用于：In one embodiment of the present invention, the target interface is an interface of a target first sub-function module corresponding to the multi-device fusion function, and the operation module is specifically used for:
按照所述目标接口对应接口说明信息获取至少一个串流设备的图像以及所述控制设备本地的图像；Acquire an image of at least one streaming device and a local image of the control device according to the interface description information corresponding to the target interface;
融合至少一个串流设备的图像以及所述控制设备本地的图像，得到融合图像；fusing an image of at least one streaming device and a local image of the control device to obtain a fused image;
将所述融合图像发送至所述头戴设备，以由所述头戴设备显示所述融合图像。The fused image is sent to the head mounted device so that the head mounted device displays the fused image.
在本发明的一个实施例中，运行模块还用于：In one embodiment of the present invention, the operation module is further used for:
在眼动交互模式下，获取所述头戴设备的佩戴者的注视状态，以及执行与所述注视状态相匹配的操作；In an eye movement interaction mode, obtaining a gaze state of a wearer of the head mounted device, and performing an operation matching the gaze state;
在虚拟标识与眼动双重交互模式下，获取所述头戴设备的注视位置以及所述虚拟标识在所述融合图像中的投射位置，执行与所述注视位置以及所述投射位置相匹配的操作。In the virtual marker and eye movement dual interaction mode, the gaze position of the head mounted device and the projection position of the virtual marker in the fused image are obtained, and an operation matching the gaze position and the projection position is performed.
在本发明的一个实施例中，第一接收模块410，还用于接收至少一个作为可执行所述控制设备的第二需求功能的第二子程序，所述第二需求功能为新增需求功能；In one embodiment of the present invention, the first receiving module 410 is further configured to receive at least one second subprogram that can execute a second required function of the control device, where the second required function is a newly added required function;
生成模块420，还用于根据所述第二子程序，生成所述第二需求功能的第二子功能模块；The generating module 420 is further used to generate a second sub-function module of the second required function according to the second sub-program;
提供模块440，还用于在接收到选择所述第二子功能模块的第三输入的情况下，响应于所述第三输入，提供第二子功能模块的接口以及接口说明信息。The providing module 440 is further configured to provide an interface and interface description information of the second sub-functional module in response to a third input for selecting the second sub-functional module when the third input is received.
在本发明的一个实施例中，第一接收模块410，还用于接收多个可执行所述头戴设备的第三需求功能的第三子程序；In one embodiment of the present invention, the first receiving module 410 is further configured to receive a plurality of third subprograms capable of executing a third required function of the head mounted device;
生成模块420，还用于根据所述第三子程序，生成对应第三需求功能的第三子功能模块；The generating module 420 is further used to generate a third sub-function module corresponding to the third required function according to the third sub-program;
在本实施例中，需求功能的提供装置400还包括：In this embodiment, the demand function providing device 400 further includes:
发送模块，用于在所述控制设备与所述头戴设备通信连接的情况下，向所述头戴设备发送所述第三子功能模块的接口以及接口说明信息。A sending module is used to send the interface and interface description information of the third sub-function module to the head mounted device when the control device is in communication connection with the head mounted device.
在本发明的一个实施例中，第一接收模块410，还用于接收多个可执行所述串流设备的第四需求功能的第四子程序；In one embodiment of the present invention, the first receiving module 410 is further configured to receive a plurality of fourth subprograms capable of executing a fourth required function of the streaming device;
生成模块420，还用于根据所述第四子程序，生成对应第四需求功能的第四子功能模块；The generating module 420 is further used to generate a fourth sub-function module corresponding to the fourth required function according to the fourth sub-program;
发送模块，还用于在所述控制设备与所述串流设备通信连接的情况下，向所述串流设备发送所述第四子功能模块的接口以及接口说明信息。The sending module is further used to send the interface and interface description information of the fourth sub-function module to the streaming device when the control device is communicatively connected to the streaming device.
在本发明的一个实施例中，提供模块440，具体用于响应于所述第一输入，按照软件安装包的方式提供所述目标第一子功能模块的接口以及接口说明信息。In one embodiment of the present invention, the providing module 440 is specifically configured to provide the interface and interface description information of the target first sub-function module in the form of a software installation package in response to the first input.
本发明实施例还提供了一种控制设备500，该控制设备500包括如上述任一装置实施例提供的需求功能的提供装置400。The embodiment of the present invention further provides a control device 500, which includes a demand function providing device 400 as provided in any of the above device embodiments.
或者，如图5所示，控制设备500包括存储器510和处理器520，所述存储器510用于存储计算机指令，所述处理器520用于从所述存储器510中调用所述计算机指令，以执行如上述方法实施例中任一项所述的需求功能的提供方法。Alternatively, as shown in FIG. 5 , the control device 500 includes a memory 510 and a processor 520 , wherein the memory 510 is used to store computer instructions, and the processor 520 is used to call the computer instructions from the memory 510 to execute a method for providing a demand function as described in any one of the above method embodiments.
本发明实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序在被处理器执行时实现根据上述方法实施例中任一项所述的需求功能的提供方法。An embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method for providing a required function according to any one of the above method embodiments is implemented.
本发明可以是系统、方法和/或计算机程序产品。计算机程序产品可以包括计算机可读存储介质，其上载有用于使处理器实现本发明的各个方面的计算机可读程序指令。The present invention may be a system, a method and/or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present invention.
计算机可读存储介质可以是可以保持和存储由指令执行设备使用的指令的有形设备。计算机可读存储介质例如可以是――但不限于――电存储设备、磁存储设备、光存储设备、电磁存储设备、半导体存储设备或者上述的任意合适的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、静态随机存取存储器(SRAM)、便携式压缩盘只读存储器(CD-ROM)、数字多功能盘(DVD)、记忆棒、软盘、机械编码设备、例如其上存储有指令的打孔卡或凹槽内凸起结构、以及上述的任意合适的组合。这里所使用的计算机可读存储介质不被解释为瞬时信号本身，诸如无线电波或者其他自由传播的电磁波、通过波导或其他传输媒介传播的电磁波(例如，通过光纤电缆的光脉冲)、或者通过电线传输的电信号。A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any of the above. Suitable combinations. More specific examples of computer-readable storage media (a non-exhaustive list) include: portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), static random access memories (SRAM), portable compact disk read-only memories (CD-ROM), digital versatile disks (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or raised structures in grooves on which instructions are stored, and any suitable combination of the above. Computer-readable storage media as used herein are not to be interpreted as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.
这里所描述的计算机可读程序指令可以从计算机可读存储介质下载到各个计算/处理设备，或者通过网络、例如因特网、局域网、广域网和/或无线网下载到外部计算机或外部存储设备。网络可以包括铜传输电缆、光纤传输、无线传输、路由器、防火墙、交换机、网关计算机和/或边缘服务器。每个计算/处理设备中的网络适配卡或者网络接口从网络接收计算机可读程序指令，并转发该计算机可读程序指令，以供存储在各个计算/处理设备中的计算机可读存储介质中。The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing/processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and/or edge servers. The network adapter card or network interface in each computing/processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device.
用于执行本发明操作的计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者以一种或多种编程语言的任意组合编写的源代码或目标代码，所述编程语言包括面向对象的编程语言—诸如Smalltalk、C++等，以及常规的过程式编程语言—诸如“C”语言或类似的编程语言。计算机可读程序指令可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络—包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。在一些实施例中，通过利用计算机可读程序指令的状态信息来个性化定制电子电路，例如可编程逻辑电路、现场可编程门阵列(FPGA)或可编程逻辑阵列(PLA)，该电子电路可以执行计算机可读程序指令，从而实现本发明的各个方面。The computer program instructions for performing the operation of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be personalized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present invention.
这里参照根据本发明实施例的方法、装置(系统)和计算机程序产品的流程图和/或框图描述了本发明的各个方面。应当理解，流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合，都可以由计算机可读程序指令实现。Various aspects of the present invention are described herein with reference to the flow charts and/or block diagrams of the methods, devices (systems) and computer program products according to embodiments of the present invention. It should be understood that each box of the flow chart and/or block diagram and the combination of each box in the flow chart and/or block diagram can be implemented by computer-readable program instructions.
这些计算机可读程序指令可以提供给通用计算机、专用计算机或其它可编程数据处理装置的处理器，从而生产出一种机器，使得这些指令在通过计算机或其它可编程数据处理装置的处理器执行时，产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以把这些计算机可读程序指令存储在计算机可读存储介质中，这些指令使得计算机、可编程数据处理装置和/或其他设备以特定方式工作，从而，存储有指令的计算机可读介质则包括一个制造品，其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions/actions specified in one or more boxes in the flowchart and/or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and/or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions/actions specified in one or more boxes in the flowchart and/or block diagram.
也可以把计算机可读程序指令加载到计算机、其它可编程数据处理装置、或其它设备上，使得在计算机、其它可编程数据处理装置或其它设备上执行一系列操作步骤，以产生计算机实现的过程，从而使得在计算机、其它可编程数据处理装置、或其它设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions/actions specified in one or more boxes in the flowchart and/or block diagram.
附图中的流程图和框图显示了根据本发明的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分，所述模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个连续的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或动作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。对于本领域技术人员来说公知的是，通过硬件方式实现、通过软件方式实现以及通过软件和硬件结合的方式实现都是等价的。需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram may represent a module, a program segment or a part of an instruction, and the module, a program segment or a part of an instruction contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they may sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and/or flowchart, and the combination of boxes in the block diagram and/or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are all equivalent. It should be noted that, in this article, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or a combination of a series of elements is included. The system includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article or system. In the absence of more restrictions, an element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article or system that includes the element.
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在如上的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，电视机，或者网络设备等)执行本发明各个实施例的方法。Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as above, including a number of instructions for a terminal device (which can be a mobile phone, computer, server, television, or network device, etc.) to execute the methods of various embodiments of the present invention.
以上所述仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是在本发明的发明构思下，利用本发明说明书及附图内容所作的等效结构变换，或直接/间接运用在其他相关的技术领域均包括在本发明的专利保护范围。The above description is only a preferred embodiment of the present invention, and does not limit the patent scope of the present invention. All equivalent structural changes made by using the contents of the present invention specification and drawings under the inventive concept of the present invention, or directly/indirectly applied in other related technical fields are included in the patent protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311034703.1 | 2023-08-16 | ||
| CN202311034703.1ACN117032462B (en) | 2023-08-16 | 2023-08-16 | Method, device, equipment and medium for providing demand function |
| Publication Number | Publication Date |
|---|---|
| WO2025035951A1true WO2025035951A1 (en) | 2025-02-20 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2024/099760PendingWO2025035951A1 (en) | 2023-08-16 | 2024-06-18 | Demand function providing method and apparatus, device, and medium |
| Country | Link |
|---|---|
| CN (1) | CN117032462B (en) |
| WO (1) | WO2025035951A1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117032461A (en)* | 2023-08-16 | 2023-11-10 | 歌尔股份有限公司 | Method, device, equipment and medium for providing demand functions |
| CN117032462B (en)* | 2023-08-16 | 2025-04-22 | 歌尔股份有限公司 | Method, device, equipment and medium for providing demand function |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20190063590A (en)* | 2017-11-30 | 2019-06-10 | 전자부품연구원 | Operating Method for Live Streaming Service of Virtual Contents based on Tiled Encoding image and electronic device supporting the same |
| US20190250896A1 (en)* | 2018-02-09 | 2019-08-15 | Cognizant Technology Solutions India Pvt. Ltd. | System and method for developing software applications of wearable devices |
| CN112533002A (en)* | 2020-11-17 | 2021-03-19 | 南京邮电大学 | Dynamic image fusion method and system for VR panoramic live broadcast |
| CN113994361A (en)* | 2017-04-25 | 2022-01-28 | 金玄珉 | Personalized service operation system and method for smart devices and robots using smart mobile devices |
| CN116567289A (en)* | 2023-04-14 | 2023-08-08 | 歌尔股份有限公司 | Data processing method, device, head-mounted display device and medium |
| CN117032462A (en)* | 2023-08-16 | 2023-11-10 | 歌尔股份有限公司 | Method, device, equipment and medium for providing demand functions |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10262462B2 (en)* | 2014-04-18 | 2019-04-16 | Magic Leap, Inc. | Systems and methods for augmented and virtual reality |
| CN115103138A (en)* | 2022-07-11 | 2022-09-23 | 北京梦想绽放科技有限公司 | Method and system for generating virtual-real fusion image based on space-time consistency |
| CN115373818A (en)* | 2022-08-24 | 2022-11-22 | 歌尔科技有限公司 | Application method, device and medium of floating window based on head-mounted device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113994361A (en)* | 2017-04-25 | 2022-01-28 | 金玄珉 | Personalized service operation system and method for smart devices and robots using smart mobile devices |
| KR20190063590A (en)* | 2017-11-30 | 2019-06-10 | 전자부품연구원 | Operating Method for Live Streaming Service of Virtual Contents based on Tiled Encoding image and electronic device supporting the same |
| US20190250896A1 (en)* | 2018-02-09 | 2019-08-15 | Cognizant Technology Solutions India Pvt. Ltd. | System and method for developing software applications of wearable devices |
| CN112533002A (en)* | 2020-11-17 | 2021-03-19 | 南京邮电大学 | Dynamic image fusion method and system for VR panoramic live broadcast |
| CN116567289A (en)* | 2023-04-14 | 2023-08-08 | 歌尔股份有限公司 | Data processing method, device, head-mounted display device and medium |
| CN117032462A (en)* | 2023-08-16 | 2023-11-10 | 歌尔股份有限公司 | Method, device, equipment and medium for providing demand functions |
| Publication number | Publication date |
|---|---|
| CN117032462B (en) | 2025-04-22 |
| CN117032462A (en) | 2023-11-10 |
| Publication | Publication Date | Title |
|---|---|---|
| WO2025035951A1 (en) | Demand function providing method and apparatus, device, and medium | |
| EP3821330B1 (en) | Electronic device and method for generating short cut of quick command | |
| EP3389230B1 (en) | System for providing dialog content | |
| CN105589555B (en) | Information processing method, information processing apparatus, and electronic apparatus | |
| US10402625B2 (en) | Intelligent electronic device and method of operating the same | |
| US20170011557A1 (en) | Method for providing augmented reality and virtual reality and electronic device using the same | |
| TWI709070B (en) | Data processing method and device, terminal equipment, server | |
| US10802674B2 (en) | Method and apparatus for displaying function interface | |
| KR20160042739A (en) | Method for sharing a display and electronic device thereof | |
| US10805293B2 (en) | Method for providing service update and electronic device supporting the same | |
| EP3690604A1 (en) | Display control method and system, and virtual reality device | |
| KR20190079375A (en) | Electronic apparatus that send and receives messages containing emoji | |
| KR20200048701A (en) | Electronic apparatus for sharing customized voice command and thereof control method | |
| WO2025035949A1 (en) | Method and apparatus for providing requirement function, and device and medium | |
| CN112420217A (en) | Message pushing method, device, equipment and storage medium | |
| KR20200113349A (en) | Electronic Device and the Method for Supporting Multitasking thereof | |
| WO2024066754A1 (en) | Interaction control method and apparatus, and electronic device | |
| CN108231076A (en) | Voice control method, device, equipment and storage medium | |
| WO2025035950A1 (en) | Interaction control method and apparatus, and electronic device and medium | |
| KR20150050200A (en) | Method for controlling output data and an electronic device thereof | |
| CN107038024B (en) | Operation configuration method and equipment thereof | |
| CN105549809B (en) | Method and apparatus for notifying content changes | |
| CN113407241A (en) | Interactive configuration method, device and system and electronic equipment | |
| US20200304631A1 (en) | Information providing method and electronic device supporting same | |
| KR20200063585A (en) | Method for inputting key and Electronic device using the same |
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | Ref document number:24853366 Country of ref document:EP Kind code of ref document:A1 |