技术领域Technical Field
本公开涉及视频投影技术领域，尤其涉及基于视频投影的数据融合方法和装置。The present disclosure relates to the technical field of video projection, and in particular to a data fusion method and device based on video projection.
背景技术Background Art
随着信息量增加，信息的呈现方式越来越多元化。信息技术的发展，使得虚拟现实，增强现实技术的实现成为可能。在这类技术诞生之前，我们所处的真实世界难以呈现超越时间与空间的信息。但是通过虚拟技术与模拟仿真，任意信息可以叠加至真实世界，让用户感知到丰富的视觉信息，从而达到超越现实的感官体验。虚拟现实的目标是将物理世界的信息与虚拟世界的信息无缝对接，实现从原子到比特的一一映射。目前的增强现实项目多通过头盔显示器和眼镜实现。另一增强现实方案是使用智能手机，调用摄像头捕捉的图像，并在图像上渲染所需展示的信息。As the amount of information increases, the way information is presented becomes more and more diversified. The development of information technology has made it possible to realize virtual reality and augmented reality technologies. Before the birth of such technologies, it was difficult for the real world we live in to present information beyond time and space. However, through virtual technology and simulation, any information can be superimposed on the real world, allowing users to perceive rich visual information, thereby achieving a sensory experience beyond reality. The goal of virtual reality is to seamlessly connect the information of the physical world with the information of the virtual world, and realize a one-to-one mapping from atoms to bits. Currently, most augmented reality projects are implemented through helmet displays and glasses. Another augmented reality solution is to use a smartphone to call the image captured by the camera and render the information to be displayed on the image.
现有的办公环境，通常是在前端分开操作，然后再后台服务器根据操作指令进行数据更新，尤其对于联合办公的场景，一方面占用了大量的办公空间、需要大量的办公设备，增加了办公成本，另一方面，缺乏对联合办公进度的直观展示，降低了办公效率，影响了用户体验。In the existing office environment, operations are usually performed separately at the front end, and then the back-end server updates the data according to the operating instructions. This is especially true for the scenario of joint office. On the one hand, it takes up a lot of office space, requires a lot of office equipment, and increases office costs. On the other hand, there is a lack of intuitive display of the progress of the joint office, which reduces office efficiency and affects the user experience.
发明内容Summary of the invention
为解决现有技术中存在的上述技术问题，本公开实施例提供了一种基于视频投影的数据融合方法和装置。In order to solve the above technical problems existing in the prior art, the embodiments of the present disclosure provide a data fusion method and device based on video projection.
在本公开的第一方面，提供一种基于视频投影的数据融合方法，包括：In a first aspect of the present disclosure, a data fusion method based on video projection is provided, comprising:
将第一投影帧图像投影到目标区域，获取所述目标区域内的多个用户针对所述第一投影帧图像进行操作的第一操作帧图像；Projecting a first projection frame image onto a target area, and acquiring a first operation frame image in which a plurality of users in the target area operate on the first projection frame image;
分别确定单一用户对所述第一操作帧图像进行操作后所述第一操作帧图像的数据变化内容，将所述多个用户的操作对应的数据变化内容进行融合，生成第二投影帧图像；respectively determining data change contents of the first operation frame image after a single user operates the first operation frame image, and fusing the data change contents corresponding to the operations of the multiple users to generate a second projection frame image;
将所述第二投影帧图像投影到所述目标区域，以获取所述目标区域内的多个用户针对所述第二投影帧图像进行操作的第二操作帧图像。The second projection frame image is projected onto the target area to obtain a second operation frame image in which a plurality of users in the target area operate on the second projection frame image.
在一些实施例中，还包括：In some embodiments, it also includes:
接收目标用户发送的投影数据内容，将所述投影数据内容作为第一投影帧图像投影到所述目标区域，或者，receiving projection data content sent by a target user, and projecting the projection data content as a first projection frame image to the target area, or,
获取所述目标区域内的实物图像，根据所述实物图像从云端服务器获取对应的投影内容，作为第一投影帧图像投影到所述目标区域。An image of a real object in the target area is obtained, and corresponding projection content is obtained from a cloud server according to the real object image, and is projected onto the target area as a first projection frame image.
在一些实施例中，所述获取目标区域内的多个用户针对所述第一投影帧图像进行操作的第一操作帧图像，包括：In some embodiments, the acquiring of a first operation frame image in which a plurality of users in the target area perform operations on the first projection frame image includes:
获取多个用户针对目标区域内的虚拟投影图像进行操作的第一操作帧图像。A first operation frame image of multiple users operating a virtual projection image in a target area is acquired.
在一些实施例中，所述虚拟投影图像包括虚拟输入设备或者模型投影内容；In some embodiments, the virtual projection image includes a virtual input device or model projection content;
所述对目标区域内的虚拟投影图像进行操作，包括：The operating of the virtual projection image in the target area includes:
对目标区域内的虚拟输入设备进行按键操作，或者，对目标区域内的模型投影内容进行手势操作。A key operation is performed on a virtual input device in the target area, or a gesture operation is performed on the model projection content in the target area.
在一些实施例中，所述目标区域内的多个用户针对所述第一投影帧图像进行操作的第一操作帧图像，包括：In some embodiments, the first operation frame image in which multiple users in the target area perform operations on the first projection frame image includes:
获取多个用户针对目标区域内的实物输入设备进行操作的第一操作帧图像。A first operation frame image of multiple users operating a physical input device in a target area is acquired.
在一些实施例中，所述分别确定单一用户对所述第一操作帧图像进行操作后所述第一操作帧图像的数据变化内容，包括：In some embodiments, respectively determining the data change content of the first operation frame image after a single user operates the first operation frame image includes:
对于对所述第一投影帧图像进行操作的多个用户中的单一用户，根据第一操作帧图像确定对应的操作指令，根据所述操作指令确定所述第一投影帧图像中对应的变化数据。For a single user among the multiple users operating the first projection frame image, a corresponding operation instruction is determined according to the first operation frame image, and corresponding change data in the first projection frame image is determined according to the operation instruction.
在一些实施例中，所述将所述多个用户的操作对应的数据变化内容进行融合，生成第二投影帧图像，包括：In some embodiments, fusing the data change contents corresponding to the operations of the multiple users to generate a second projection frame image includes:
将多个用户的操作指令对应的变化数据进行汇总，对所述第一投影帧图像中对应的区域进行修改，生成第二投影帧图像。The change data corresponding to the operation instructions of multiple users are summarized, and the corresponding area in the first projection frame image is modified to generate a second projection frame image.
在本公开的第二方面，提供一种基于视频投影的数据融合装置，包括：In a second aspect of the present disclosure, a data fusion device based on video projection is provided, comprising:
第一操作帧图像获取模块，用于将第一投影帧图像投影到目标区域，获取所述目标区域内的多个用户针对所述第一投影帧图像进行操作的第一操作帧图像；将第二投影帧图像投影到所述目标区域，以获取所述目标区域内的多个用户针对所述第二投影帧图像进行操作的第二操作帧图像；A first operation frame image acquisition module is used to project a first projection frame image onto a target area to acquire a first operation frame image in which multiple users in the target area operate on the first projection frame image; and project a second projection frame image onto the target area to acquire a second operation frame image in which multiple users in the target area operate on the second projection frame image;
数据处理模块，用于分别确定单一用户对所述第一操作帧图像进行操作后所述第一操作帧图像的数据变化内容，将所述多个用户的操作对应的数据变化内容进行融合，生成第二投影帧图像。The data processing module is used to respectively determine the data change content of the first operation frame image after a single user operates the first operation frame image, merge the data change content corresponding to the operations of the multiple users, and generate a second projection frame image.
根据本公开的第三方面，提供了一种电子设备。该电子设备包括：存储器和处理器，所述存储器上存储有计算机程序，所述处理器执行所述程序时实现如以上第一方面所述的方法。According to a third aspect of the present disclosure, an electronic device is provided, comprising: a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the program, the method described in the first aspect is implemented.
根据本公开的第四方面，提供了一种计算机可读存储介质，其上存储有计算机程序，所述程序被处理器执行时实现如以上第一方面所述的方法。According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method described in the first aspect above is implemented.
应当理解，发明内容部分中所描述的内容并非旨在限定本公开的实施例的关键或重要特征，亦非用于限制本公开的范围。本公开的其它特征将通过以下的描述变得容易理解。It should be understood that the contents described in the summary of the invention are not intended to limit the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description.
通过本公开实施例的基于视频投影的数据融合方法，能够降低对办公设备数量的需求，降低了办公成本，同时能够对联合办公进度的直观展示，提高办公效率。Through the data fusion method based on video projection in the embodiment of the present disclosure, the demand for the number of office equipment can be reduced, the office cost can be reduced, and at the same time, the progress of joint office can be intuitively displayed, thereby improving office efficiency.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
结合附图并参考以下详细说明，本公开各实施例的上述和其他特征、优点及方面将变得更加明显。附图用于更好地理解本方案，不构成对本公开的限定在附图中，相同或相似的附图标记表示相同或相似的元素，其中：The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, among which:
图1示出了根据本公开的实施例的基于视频投影的数据融合方法的流程图；FIG1 shows a flow chart of a data fusion method based on video projection according to an embodiment of the present disclosure;
图2示出了根据本公开的实施例的基于视频投影的数据融合装置的结构框图；FIG2 shows a structural block diagram of a data fusion device based on video projection according to an embodiment of the present disclosure;
图3示出了能够实施本公开的实施例的示例性电子设备的方框图。FIG. 3 illustrates a block diagram of an exemplary electronic device capable of implementing embodiments of the present disclosure.
具体实施方式DETAILED DESCRIPTION
为使本公开实施例的目的、技术方案和优点更加清楚，下面将结合本公开实施例中的附图，对本公开实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本公开一部分实施例，而不是全部的实施例。基于本公开中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的全部其他实施例，都属于本公开保护的范围。In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.
另外，本文中术语“和/或”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。In addition, the term "and/or" in this article is only a description of the association relationship between the associated objects, indicating that there can be three relationships. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character "/" in this article generally indicates that the associated objects before and after are in an "or" relationship.
本公开实施例的基于视频投影的数据融合方法，可以应用于联合办公，通过投影设备将需要展示的内容投影至目标区域(例如投影到贴有全息膜的透明屏幕上)，这样，所有人员都能够看到目标区域的投影内容，可以对目标区域的投影内容进行直接操作或者间接操作，然后用户的操作指令对投影至目标区域的投影内容进行即时更新，从而可以直观的显示联合办公的进程，提高用户体验。The data fusion method based on video projection of the disclosed embodiment can be applied to joint office. The content to be displayed is projected to the target area through the projection equipment (for example, projected to a transparent screen with a holographic film). In this way, all personnel can see the projected content of the target area and can directly or indirectly operate the projected content of the target area. Then, the user's operation instructions will instantly update the projected content projected to the target area, so that the progress of the joint office can be intuitively displayed, thereby improving the user experience.
具体地，如图1所示，为本公开实施例的基于视频投影的数据融合方法的流程图。本实施例的基于视频投影的数据融合方法，可以包括以下步骤：Specifically, as shown in Figure 1, it is a flow chart of the data fusion method based on video projection of an embodiment of the present disclosure. The data fusion method based on video projection of this embodiment may include the following steps:
S101：将第一投影帧图像投影到目标区域，获取所述目标区域内的多个用户针对所述第一投影帧图像进行操作的第一操作帧图像。S101: Projecting a first projection frame image onto a target area, and acquiring a first operation frame image in which a plurality of users in the target area perform operations on the first projection frame image.
在本实施例中，可以预先获取投影内容，将投影内容投影到目标区域，供联合办公场景下的多用户操作。在投影过程中，可以按照预设时间间隔将图像投影到目标区域供用户操作，在用户操作后，根据用户的操作对投影到目标区域内的图像进行更新，通过循环重复上述过程，用户的操作对应数据的融合。而对于循环过程中的一个环节，先将第一投影帧图像投影到目标区域，获取所述目标区域内的多个用户针对所述第一投影帧图像进行操作的第一操作帧图像。本实施例的方法，可以借助投影设备和图像采集设备，通过投影设备将投影内容投影至目标区域，供用户操作，通过图像采集设备采集用户对投影内容进行操作的图像帧，通过对用户对投影内容进行操作的图像帧进行识别和分析，确定用户的操作指令和操作指令针对的投影内容中的对像，根据操作指令对操作指令针对的投影内容中的对像的数据进行更新，并且同时对多个用户操作指令针对的投影内容中的对像的数据进行更新，从而生成下一帧图像，并将下一帧图像投影到目标区域中。In this embodiment, the projection content can be acquired in advance, and the projection content can be projected to the target area for multi-user operation in the joint office scene. During the projection process, the image can be projected to the target area for user operation at a preset time interval. After the user operates, the image projected to the target area is updated according to the user's operation. By repeating the above process in a loop, the user's operation corresponds to the fusion of data. For one link in the loop process, the first projection frame image is first projected to the target area, and the first operation frame image of multiple users in the target area operating on the first projection frame image is acquired. The method of this embodiment can project the projection content to the target area through the projection device with the help of a projection device and an image acquisition device, and collect the image frame of the user operating the projection content through the image acquisition device. By identifying and analyzing the image frame of the user operating the projection content, the user's operation instruction and the object in the projection content targeted by the operation instruction are determined, and the data of the object in the projection content targeted by the operation instruction is updated according to the operation instruction, and the data of the object in the projection content targeted by the operation instruction of multiple users are updated at the same time, thereby generating the next frame image, and projecting the next frame image into the target area.
作为本公开的一个可选实施例，可以接收目标用户发送的投影数据内容，将所述投影数据内容作为第一投影帧图像投影到所述目标区域，或者，获取所述目标区域内的实物图像，根据所述实物图像从云端服务器获取对应的投影内容，作为第一投影帧图像投影到所述目标区域。例如，可以接收用户发送的数据连接，通过点击数据连接从云端获取投影数据内容，将所述投影数据内容作为初始投影内容投影到目标区域，供用户操作。或者，可以接收用户发送的文档，将接收的文档作为初始投影内容投影到目标区域，供用户操作。再或者，可以通过图像采集装置采集用户提供的位于所述目标区域内的实物图像，根据所述实物图像从云端服务器获取对应的实物的模型作为投影内容投影到到目标区域，供用户操作。As an optional embodiment of the present disclosure, the projection data content sent by the target user can be received, and the projection data content can be projected to the target area as the first projection frame image, or the physical image in the target area can be obtained, and the corresponding projection content can be obtained from the cloud server according to the physical image, and projected to the target area as the first projection frame image. For example, a data connection sent by a user can be received, and the projection data content can be obtained from the cloud by clicking on the data connection, and the projection data content can be projected to the target area as the initial projection content for user operation. Alternatively, a document sent by a user can be received, and the received document can be projected to the target area as the initial projection content for user operation. Alternatively, an image acquisition device can be used to acquire a physical image provided by a user and located in the target area, and a corresponding physical model can be obtained from the cloud server according to the physical image and projected to the target area as the projection content for user operation.
S102：分别确定单一用户对所述第一操作帧图像进行操作后所述第一操作帧图像的数据变化内容，将所述多个用户的操作对应的数据变化内容进行融合，生成第二投影帧图像。S102: respectively determining data change contents of the first operation frame image after a single user operates the first operation frame image, and fusing the data change contents corresponding to the operations of the multiple users to generate a second projection frame image.
在本实施例中，当将第一投影帧图像投影到目标区域获取所述目标区域内的多个用户针对所述第一投影帧图像进行操作的第一操作帧图像后，可以分别确定单一用户对所述第一操作帧图像进行操作后所述第一操作帧图像的数据变化内容，将所述多个用户的操作对应的数据变化内容进行融合，生成第二投影帧图像。In this embodiment, after the first projection frame image is projected onto the target area to obtain the first operation frame image in which multiple users in the target area operate on the first projection frame image, the data change content of the first operation frame image after a single user operates on the first operation frame image can be determined separately, and the data change contents corresponding to the operations of the multiple users can be fused to generate a second projection frame image.
在本实施例中，多个用户对所述第一操作帧图像进行操作可以是对目标区域内的虚拟投影图像进行操作的第一操作帧图像。例如，在目标区域投影虚拟输入设备(例如虚拟键盘和鼠标)，用户可以正常对虚拟输入设备进行操作，通过图像采集装置采集用户对虚拟输入设备进行操作的图像(例如用户针对虚拟键盘或者鼠标的点击操作)，确定对应的操作指令，然后对多个用户的操作指令进行融合，确定第一投影帧图像中的数据变化内容，生成第二投影帧图像。In this embodiment, the operation of the first operation frame image by multiple users may be the first operation frame image of the operation of the virtual projection image in the target area. For example, a virtual input device (such as a virtual keyboard and a mouse) is projected in the target area, and the user can operate the virtual input device normally, and the image acquisition device acquires the image of the user operating the virtual input device (such as the user clicking the virtual keyboard or the mouse), determines the corresponding operation instruction, and then fuses the operation instructions of multiple users to determine the data change content in the first projection frame image, and generates the second projection frame image.
当投影内容是虚拟模型时，可以根据预先定义的手势规则获取多个用户的手势操作内容，分别确定对应的操作指令，进而确定第一投影帧图像中的数据变化内容，生成第二投影帧图像。例如，投影内容是一辆车的模型，用户A的手势是放大，用户B的手势是旋转，用户C的手势操作是打开车门，这在第一操作帧图像中可以确定这三个用户的手势，进而确定对应的操作指令，确定第一投影帧图像中的数据变化内容，即对车辆模型进行放大、旋转和打开车门，则放大、旋转和打开车门后的车辆模型即为第二投影帧图像。When the projection content is a virtual model, the gesture operation contents of multiple users can be obtained according to the predefined gesture rules, and the corresponding operation instructions can be determined respectively, and then the data change content in the first projection frame image can be determined to generate the second projection frame image. For example, the projection content is a model of a car, the gesture of user A is to enlarge, the gesture of user B is to rotate, and the gesture operation of user C is to open the door. In the first operation frame image, the gestures of these three users can be determined, and then the corresponding operation instructions are determined, and the data change content in the first projection frame image is determined, that is, the vehicle model is enlarged, rotated, and the door is opened. The vehicle model after enlargement, rotation, and opening the door is the second projection frame image.
当然，在一些实施例中，可以获取多个用户针对目标区域内的实物输入设备进行操作的第一操作帧图像。例如实物的键盘鼠标等，实物键盘鼠标不连接任何设备，只是用户来提高用户的操作感，即用户点击键盘鼠标导致的投影内容的变化是通过图像识别的方式进行传输的，即通过获取用户对实物输入设备的操作的图像来确定第一投影帧图像中的数据变化内容，而并非根据用户对实物输入设备的操作产生的电信号来确定第一投影帧图像中的数据变化内容，在确定第一投影帧图像中的数据变化内容后，生成第二投影帧图像。Of course, in some embodiments, the first operation frame images of multiple users operating the physical input devices in the target area can be obtained. For example, the physical keyboard and mouse are not connected to any device, but are used by the user to improve the user's sense of operation, that is, the change of the projection content caused by the user clicking the keyboard and mouse is transmitted by image recognition, that is, the data change content in the first projection frame image is determined by obtaining the image of the user's operation on the physical input device, rather than determining the data change content in the first projection frame image according to the electrical signal generated by the user's operation on the physical input device. After determining the data change content in the first projection frame image, the second projection frame image is generated.
S103：将所述第二投影帧图像投影到所述目标区域，以获取所述目标区域内的多个用户针对所述第二投影帧图像进行操作的第二操作帧图像。S103: Projecting the second projection frame image onto the target area to obtain a second operation frame image in which a plurality of users in the target area perform operations on the second projection frame image.
在本实施例中，当生成第二投影帧图像后，可以将所述第二投影帧图像投影到所述目标区域，以获取所述目标区域内的多个用户针对所述第二投影帧图像进行操作的第二操作帧图像。In this embodiment, after the second projection frame image is generated, the second projection frame image may be projected onto the target area to obtain a second operation frame image in which multiple users in the target area perform operations on the second projection frame image.
本公开实施例的基于视频投影的数据融合方法，能够降低对办公设备数量的需求，降低了办公成本，同时能够对联合办公进度的直观展示，提高办公效率。The data fusion method based on video projection in the embodiment of the present disclosure can reduce the demand for the number of office equipment and reduce office costs, while being able to intuitively display the progress of joint office work and improve office efficiency.
在本公开的实施例中，可以每秒投影128帧图像，这样，可以即时捕捉用户对投影内容的操作，另一方面，可以快速对投影内容进行更新，从而提高办公效率。In the embodiments of the present disclosure, 128 frames of images can be projected per second, so that the user's operation on the projected content can be captured instantly. On the other hand, the projected content can be quickly updated, thereby improving office efficiency.
需要说明的是，对于前述的各方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本公开并不受所描述的动作顺序的限制，因为依据本公开，某些步骤可以采用其他顺序或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于可选实施例，所涉及的动作和模块并不一定是本公开所必须的。It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present disclosure is not limited by the order of the actions described, because according to the present disclosure, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present disclosure.
以上是关于方法实施例的介绍，以下通过装置实施例，对本公开所述方案进行进一步说明。The above is an introduction to the method embodiment. The following is a further explanation of the scheme disclosed in the present invention through an apparatus embodiment.
如图2所示，为根据本公开的实施例的基于视频投影的数据融合装置的结构框图。本实施例的基于视频投影的数据融合装置，包括：As shown in FIG2 , it is a structural block diagram of a data fusion device based on video projection according to an embodiment of the present disclosure. The data fusion device based on video projection of this embodiment includes:
第一操作帧图像获取模块201，用于将第一投影帧图像投影到目标区域，获取所述目标区域内的多个用户针对所述第一投影帧图像进行操作的第一操作帧图像；将第二投影帧图像投影到所述目标区域，以获取所述目标区域内的多个用户针对所述第二投影帧图像进行操作的第二操作帧图像。The first operation frame image acquisition module 201 is used to project the first projection frame image to the target area to obtain the first operation frame image in which multiple users in the target area operate on the first projection frame image; and project the second projection frame image to the target area to obtain the second operation frame image in which multiple users in the target area operate on the second projection frame image.
数据处理模块202，用于分别确定单一用户对所述第一操作帧图像进行操作后所述第一操作帧图像的数据变化内容，将所述多个用户的操作对应的数据变化内容进行融合，生成第二投影帧图像。The data processing module 202 is used to respectively determine the data change content of the first operation frame image after a single user operates on the first operation frame image, merge the data change content corresponding to the operations of the multiple users, and generate a second projection frame image.
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，所述描述的模块的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the described module can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
根据本公开的实施例，本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.
图3示出了可以用来实施本公开的实施例方法的电子设备300的示意性框图。如图所示，设备300包括中央处理单元(CPU)301，其可以根据存储在只读存储器(ROM)302中的计算机程序指令或者从存储单元308加载到随机访问存储器(RAM)303中的计算机程序指令，来执行各种适当的动作和处理。在RAM 303中，还可以存储设备300操作所需的各种程序和数据。CPU 301、ROM 302以及RAM 303通过总线304彼此相连。输入/输出(I/O)接口305也连接至总线304。Fig. 3 shows a schematic block diagram of an electronic device 300 that can be used to implement the embodiment method of the present disclosure. As shown in the figure, the device 300 includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes according to computer program instructions stored in a read-only memory (ROM) 302 or computer program instructions loaded from a storage unit 308 into a random access memory (RAM) 303. In RAM 303, various programs and data required for the operation of the device 300 can also be stored. CPU 301, ROM 302 and RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to the bus 304.
设备300中的多个部件连接至I/O接口305，包括：输入单元306，例如键盘、鼠标等；输出单元307，例如各种类型的显示器、扬声器等；存储单元308，例如磁盘、光盘等；以及通信单元309，例如网卡、调制解调器、无线通信收发机等。通信单元309允许设备300通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。A number of components in the device 300 are connected to the I/O interface 305, including: an input unit 306, such as a keyboard, a mouse, etc.; an output unit 307, such as various types of displays, speakers, etc.; a storage unit 308, such as a disk, an optical disk, etc.; and a communication unit 309, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 309 allows the device 300 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.
处理单元301执行上文所描述的各个方法和处理，其被有形地包含于机器可读介质，例如存储单元308。在一些实施例中，计算机程序的部分或者全部可以经由ROM 302和/或通信单元309而被载入和/或安装到设备300上。当计算机程序加载到RAM 703并由CPU301执行时，可以执行上文描述的方法的一个或多个步骤。备选地，在其他实施例中，CPU301可以通过其他任何适当的方式(例如，借助于固件)而被配置为执行上述方法。The processing unit 301 performs the various methods and processes described above, which are tangibly contained in a machine-readable medium, such as a storage unit 308. In some embodiments, part or all of the computer program can be loaded and/or installed on the device 300 via the ROM 302 and/or the communication unit 309. When the computer program is loaded into the RAM 703 and executed by the CPU 301, one or more steps of the method described above can be performed. Alternatively, in other embodiments, the CPU 301 can be configured to perform the above method in any other suitable manner (e.g., by means of firmware).
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)等等。The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip systems (SOCs), load programmable logic devices (CPLDs), and the like.
用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器，使得程序代码当由处理器或控制器执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行，作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions/operations specified in the flow chart and/or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
此外，虽然采用特定次序描绘了各操作，但是这应当理解为要求这样操作以所示出的特定次序或以顺序次序执行，或者要求所有图示的操作应被执行以取得期望的结果。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实现中。相反地，在单个实现的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实现中。In addition, although each operation is described in a specific order, this should be understood as requiring such operation to be performed in the specific order shown or in a sequential order, or requiring that all illustrated operations should be performed to obtain desired results. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single implementation in combination. On the contrary, the various features described in the context of a single implementation can also be implemented in multiple implementations individually or in any suitable sub-combination mode.
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。Although the subject matter has been described in language specific to structural features and/or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111415533.2ACN114793274B (en) | 2021-11-25 | 2021-11-25 | Data fusion method and device based on video projection |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111415533.2ACN114793274B (en) | 2021-11-25 | 2021-11-25 | Data fusion method and device based on video projection |
| Publication Number | Publication Date |
|---|---|
| CN114793274A CN114793274A (en) | 2022-07-26 |
| CN114793274Btrue CN114793274B (en) | 2024-10-29 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111415533.2AActiveCN114793274B (en) | 2021-11-25 | 2021-11-25 | Data fusion method and device based on video projection |
| Country | Link |
|---|---|
| CN (1) | CN114793274B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116471391A (en)* | 2023-03-20 | 2023-07-21 | 科大讯飞股份有限公司 | Projection method, device, equipment and storage medium for reading result |
| CN119496881A (en)* | 2024-05-11 | 2025-02-21 | 北京优酷科技有限公司 | Projection control method and device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108205823A (en)* | 2017-12-29 | 2018-06-26 | 妫汭智能科技（上海）有限公司 | MR holographies vacuum experiences shop and experiential method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2077496A1 (en)* | 2008-01-03 | 2009-07-08 | WunderWorks B.V. | Multi-user collaboration system |
| US8390718B2 (en)* | 2009-01-28 | 2013-03-05 | Hewlett-Packard Development Company, L.P. | Methods and systems for performing visual collaboration between remotely situated participants |
| JP5776201B2 (en)* | 2011-02-10 | 2015-09-09 | ソニー株式会社 | Information processing apparatus, information sharing method, program, and terminal apparatus |
| US20150193979A1 (en)* | 2014-01-08 | 2015-07-09 | Andrej Grek | Multi-user virtual reality interaction environment |
| US9928656B2 (en)* | 2015-09-11 | 2018-03-27 | Futurewei Technologies, Inc. | Markerless multi-user, multi-object augmented reality on mobile devices |
| US20190251884A1 (en)* | 2018-02-14 | 2019-08-15 | Microsoft Technology Licensing, Llc | Shared content display with concurrent views |
| US11297164B2 (en)* | 2018-05-07 | 2022-04-05 | Eolian VR, Inc. | Device and content agnostic, interactive, collaborative, synchronized mixed reality system and method |
| CN111277893B (en)* | 2020-02-12 | 2021-06-25 | 北京字节跳动网络技术有限公司 | Video processing method and device, readable medium and electronic equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108205823A (en)* | 2017-12-29 | 2018-06-26 | 妫汭智能科技（上海）有限公司 | MR holographies vacuum experiences shop and experiential method |
| Publication number | Publication date |
|---|---|
| CN114793274A (en) | 2022-07-26 |
| Publication | Publication Date | Title |
|---|---|---|
| JP7222031B2 (en) | Image projection method, apparatus, device and storage medium | |
| EP2972950B1 (en) | Segmentation of content delivery | |
| CN111586319B (en) | Video processing method and device | |
| CN111815755A (en) | Method, device and terminal device for determining the area where a virtual object is occluded | |
| JP7553582B2 (en) | Method and apparatus for processing special image effects | |
| CN114793274B (en) | Data fusion method and device based on video projection | |
| CN112487973B (en) | Method and device for updating user image recognition model | |
| CN107451272B (en) | Information display method, medium, device and computing equipment | |
| CN113220118A (en) | Virtual interface display method, head-mounted display device and computer readable medium | |
| US20250085984A1 (en) | Data processing method and apparatus, and electronic device and readable medium | |
| CN112907496A (en) | Image fusion method and device | |
| WO2024174862A1 (en) | Virtual object mounting method and apparatus, device, and medium | |
| US12198175B2 (en) | Object comparison method, and device | |
| CN112634404A (en) | Layer fusion method, device and system | |
| CN112862934B (en) | Method, apparatus, apparatus, medium and product for processing animation | |
| US11195248B2 (en) | Method and apparatus for processing pixel data of a video frame | |
| CN113434551B (en) | Data processing method, apparatus, device and computer storage medium | |
| WO2024251165A1 (en) | Cross-dimensional interaction method in hybrid application, and device | |
| CN107315970B (en) | Sensitive data interaction method and device | |
| WO2024094158A1 (en) | Special effect processing method and apparatus, device, and storage medium | |
| CN112053450B (en) | Text display method, device, electronic device and storage medium | |
| CN115578299A (en) | Image generation method, device, equipment and storage medium | |
| CN113963181A (en) | Color recognition method, device, equipment and storage medium | |
| US20250245959A1 (en) | Systems and methods for generating target image sets from source images using neural network architectures | |
| CN110161827A (en) | A kind of 3D hologram projecting method and device and equipment based on graphical model |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information | Inventor after:Shi Xuan Inventor after:Kang Hua Inventor after:Wang Hongguang Inventor before:Wang Hongguang | |
| GR01 | Patent grant | ||
| GR01 | Patent grant |