CN113012270A - Stereoscopic display method and device, electronic equipment and storage medium - Google Patents
Stereoscopic display method and device, electronic equipment and storage mediumDownload PDFInfo
- Publication number
- CN113012270A CN113012270ACN202110315690.XACN202110315690ACN113012270ACN 113012270 ACN113012270 ACN 113012270ACN 202110315690 ACN202110315690 ACN 202110315690ACN 113012270 ACN113012270 ACN 113012270A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- model
- target model
- encoded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- General Engineering & Computer Science (AREA)
- Architecture (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明实施例涉及3D显示技术，尤其涉及一种立体显示的方法、装置、电子设备及存储介质。Embodiments of the present invention relate to a 3D display technology, and in particular, to a method, an apparatus, an electronic device, and a storage medium for stereoscopic display.
背景技术Background technique
在三维建模软件的使用过程中，用户习惯于采用2D(二维)显示设备来观看自己的设计内容，若需要查看3D(三维)模型，则需要频繁的旋转或移动虚拟摄像机来辨别虚拟模型中各组件的前后关系。During the use of 3D modeling software, users are accustomed to using 2D (two-dimensional) display devices to view their design content. If they need to view 3D (three-dimensional) models, they need to frequently rotate or move the virtual camera to identify the virtual model. the context of each component.
现有技术中，可以采用立体显示设备查看3D模型，如红蓝眼镜、偏光快门眼镜套件或头戴式显示设备等。在立体和非立体的切换过程中需要人工干预，存在切换步骤繁琐的问题，例如，需要用户反复摘戴眼睛，3D模型的显示效率较低。In the prior art, a stereoscopic display device can be used to view a 3D model, such as red and blue glasses, a polarized shutter glasses set, or a head-mounted display device. Manual intervention is required in the process of switching between stereoscopic and non-stereoscopic, and there is a problem that the switching steps are cumbersome. For example, the user needs to take off and put on his eyes repeatedly, and the display efficiency of the 3D model is low.
发明内容SUMMARY OF THE INVENTION
本发明实施例提供一种立体显示的方法、装置、电子设备及存储介质，以提高模型立体显示的效率。Embodiments of the present invention provide a method, an apparatus, an electronic device, and a storage medium for stereoscopic display, so as to improve the efficiency of stereoscopic display of a model.
第一方面，本发明实施例提供了一种立体显示的方法，该方法包括：In a first aspect, an embodiment of the present invention provides a method for stereoscopic display, and the method includes:
响应于模型立体显示指令，获取目标模型的数学描述，对所述目标模型的数学描述进行兴趣区域提取，得到目标模型的网格数据；In response to the model three-dimensional display instruction, obtain the mathematical description of the target model, extract the region of interest on the mathematical description of the target model, and obtain the grid data of the target model;
采用预设的有损或无损算法对所述网格数据进行数据处理，得到目标数据；Perform data processing on the grid data by using a preset lossy or lossless algorithm to obtain target data;
将所述目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示。The target data is encoded and stored based on the preset file format, and the encoded data is transmitted to the stereo rendering end for the software of the stereo rendering end to render the encoded target model by using the physical simulation rendering method, and perform on the screen. Stereoscopic display.
第二方面，本发明实施例还提供了一种立体显示的装置，该装置包括：In a second aspect, an embodiment of the present invention further provides a device for stereoscopic display, the device comprising:
网格数据获得模块，用于响应于模型立体显示指令，获取目标模型的数学描述，对所述目标模型的数学描述进行兴趣区域提取，得到目标模型的网格数据；The grid data acquisition module is used for acquiring the mathematical description of the target model in response to the model three-dimensional display instruction, and extracting the region of interest from the mathematical description of the target model to obtain grid data of the target model;
目标数据获得模块，用于采用预设的有损或无损算法对所述网格数据进行数据处理，得到目标数据；a target data acquisition module, configured to perform data processing on the grid data by using a preset lossy or lossless algorithm to obtain target data;
模型立体显示模块，用于将所述目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示。The model stereoscopic display module is used to encode and store the target data based on a preset file format, and transmit the encoded data to the stereoscopic rendering end for the software of the stereoscopic rendering end to render the encoded target by using the physical simulation rendering method model and display it stereoscopically on the screen.
第三方面，本发明实施例还提供了一种电子设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现如本发明任意实施例所述的立体显示的方法。In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, the processor implementing the program as described in the present invention when the processor executes the program The method for stereoscopic display described in any embodiment.
第四方面，本发明实施例还提供了一种包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行如本发明任意实施例所述的立体显示的方法。In a fourth aspect, an embodiment of the present invention further provides a storage medium containing computer-executable instructions, when executed by a computer processor, the computer-executable instructions are used to execute the stereoscopic display according to any embodiment of the present invention. method.
本发明实施例通过对目标模型原始的数学描述进行数据处理，减少数据量，提高2D与3D的切换速度。将处理后的目标数据进行编码，可以将目标模型传输给立体渲染端软件，使立体渲染端的软件可以直接将3D模型显示在屏幕上。解决了现有技术中，需要依靠眼镜等设备查看3D模型的问题，减少用户的切换操作，实现用户裸眼进行3D立体预览的效果，提高3D立体模型的显示效率。The embodiment of the present invention reduces the amount of data and improves the switching speed between 2D and 3D by performing data processing on the original mathematical description of the target model. After encoding the processed target data, the target model can be transmitted to the software of the stereo rendering end, so that the software of the stereo rendering end can directly display the 3D model on the screen. The problem in the prior art that the 3D model needs to be viewed by devices such as glasses is solved, the user's switching operation is reduced, the effect of the user's naked eye 3D stereo preview is realized, and the display efficiency of the 3D stereo model is improved.
附图说明Description of drawings
图1是本发明实施例一中的一种立体显示方法的流程示意图；1 is a schematic flowchart of a stereoscopic display method in Embodiment 1 of the present invention;
图2是本发明实施例二中的一种立体显示方法的流程示意图；2 is a schematic flowchart of a stereoscopic display method in Embodiment 2 of the present invention;
图3是本发明实施例三中的一种立体显示装置的结构框图；3 is a structural block diagram of a stereoscopic display device in Embodiment 3 of the present invention;
图4是本发明实施例四中的一种立体显示设备的结构示意图。FIG. 4 is a schematic structural diagram of a stereoscopic display device in Embodiment 4 of the present invention.
具体实施方式Detailed ways
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本发明，而非对本发明的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本发明相关的部分而非全部结构。The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all structures related to the present invention.
实施例一Example 1
图1为本发明实施例一所提供的一种立体显示方法的流程示意图，本实施例可适用于将二维模型切换为三维模型的情况，该方法由立体显示插件的一种立体显示装置执行，立体显示插件安装于建模软件上。如图1所示，该方法具体包括如下步骤：FIG. 1 is a schematic flowchart of a stereoscopic display method according to Embodiment 1 of the present invention. This embodiment is applicable to the case of switching a two-dimensional model to a three-dimensional model, and the method is executed by a stereoscopic display device with a stereoscopic display plug-in. , the stereoscopic display plug-in is installed on the modeling software. As shown in Figure 1, the method specifically includes the following steps:
步骤110、响应于模型立体显示指令，获取目标模型的数学描述，对目标模型的数学描述进行兴趣区域提取，得到目标模型的网格数据。Step 110: Obtain a mathematical description of the target model in response to the model stereoscopic display instruction, and extract the region of interest from the mathematical description of the target model to obtain grid data of the target model.
其中，本实施例针对网格数据进行立体显示。用户可以在建模软件导入目标模型原始的数学描述，建模软件可以是CAD(Computer Aided Design，计算机辅助设计)软件，用于进行三维模型的设计等。本实施例中的计算机辅助设计软件指的是三维计算机辅助设计软件，例如，可以是Creo(PTC公司开发的一款建模软件)、Catia(达索公司开发的一款建模软件)和NX(西门子公司开发的一款建模软件)等。用户绘制或导入的目标模型可以是二维图像，若要将二维切换为三维，则可以点击屏幕上预设的切换按键，发出对二维模型的立体显示指令。若立体显示插件响应到用户发出的模型立体显示指令，则获取目标模型的数学描述，数学描述可以是对模型曲线和曲面的二维描述数据，例如，可以是非均匀有理B样条。建模软件的SDK(Software Development Kit，软件开发包)中预先设置有三角化的转换接口函数，调用该转换接口函数，将目标模型中曲面和曲线等的数学描述转换为三角网格格式，即将二维的矢量数据转换为多块三角形的网格数据，得到目标模型的网格数据。Among them, this embodiment performs stereoscopic display for grid data. The user can import the original mathematical description of the target model into the modeling software, and the modeling software can be CAD (Computer Aided Design, computer-aided design) software, which is used to design the three-dimensional model. The computer-aided design software in this embodiment refers to three-dimensional computer-aided design software, for example, it can be Creo (a modeling software developed by PTC), Catia (a modeling software developed by Dassault) and NX (a modeling software developed by Siemens) and so on. The target model drawn or imported by the user can be a two-dimensional image. If you want to switch from two-dimensional to three-dimensional, you can click a preset switch button on the screen to issue a three-dimensional display command for the two-dimensional model. If the stereoscopic display plug-in responds to the model stereoscopic display instruction issued by the user, it obtains the mathematical description of the target model. The mathematical description may be two-dimensional description data of model curves and surfaces, such as non-uniform rational B-splines. A triangulation conversion interface function is preset in the SDK (Software Development Kit) of the modeling software, and the conversion interface function is called to convert the mathematical description of surfaces and curves in the target model into a triangular mesh format. The two-dimensional vector data is converted into multi-triangle mesh data to obtain the mesh data of the target model.
本实施例中，可选的，对目标模型的数学描述进行兴趣区域提取，得到目标模型的网格数据，包括：使用建模软件提供的软件开发包获取三角化转换接口函数，对目标模型的数学描述进行三角化处理，得到目标模型的网格数据；或者，使用建模软件提供的软件开发包绘制多角度模型视图，并进行三维重建，获得目标模型的网格数据。In this embodiment, optionally, extracting the region of interest from the mathematical description of the target model to obtain the grid data of the target model includes: using a software development kit provided by modeling software to obtain a triangulation conversion interface function, The mathematical description is triangulated to obtain the mesh data of the target model; or, the multi-angle model view is drawn using the software development kit provided by the modeling software, and three-dimensional reconstruction is performed to obtain the mesh data of the target model.
具体的，对目标模型进行完整或局部兴趣区域抽取，若信息安全不允许传递数学描述模型，或立体渲染端软件不支持数学描述模型的加载，则可以进行网格化流程，例如，可以对目标模型的数学描述进行三角化处理。兴趣区域是指需要进行数据描述与网格数据转换的区域。三角化可以负责将曲面和曲线等的数学描述采样转为三角网格格式。建模软件中设置有软件开发包，软件开发包中含有三角化的转换接口函数，调用三角化的转换接口函数，实现对目标模型的数学描述进行三角化处理，从而得到三角网格格式的网格数据。例如，在Creo软件开发包中可以通过ProSurfaceTessellationGet()函数接口取得三角化接口句柄，进行调用实现。也可以采用建模软件中的三维虚拟相机对目标模型的虚拟物体进行围绕，使用建模软件提供的软件开发包绘制目标模型的多角度模型视图，并进行三维重建，得到网格数据。这样设置的有益效果在于，可以采用多种方式获得网格数据，实现对二维矢量数据的转换，便于根据三角网格格式的数据进行立体显示。Specifically, complete or partial region of interest extraction is performed on the target model. If the information security does not allow the transfer of the mathematical description model, or the stereo rendering software does not support the loading of the mathematical description model, the meshing process can be performed. For example, the target The mathematical description of the model is triangulated. The area of interest refers to the area where data description and grid data conversion are required. Triangulation can be responsible for sampling mathematical descriptions of surfaces, curves, etc. into a triangular mesh format. A software development kit is set in the modeling software, and the software development kit contains a triangulation conversion interface function, and the triangulation conversion interface function is called to realize triangulation of the mathematical description of the target model, so as to obtain a grid in triangular mesh format. grid data. For example, in the Creo software development kit, the triangulation interface handle can be obtained through the ProSurfaceTessellationGet() function interface, and the implementation can be called. It is also possible to use the 3D virtual camera in the modeling software to surround the virtual object of the target model, use the software development kit provided by the modeling software to draw a multi-angle model view of the target model, and perform 3D reconstruction to obtain grid data. The beneficial effect of this arrangement is that the grid data can be obtained in various ways, the conversion of the two-dimensional vector data can be realized, and the three-dimensional display can be facilitated according to the data in the triangular grid format.
步骤120、采用预设的有损或无损算法对网格数据进行数据处理，得到目标数据。Step 120: Use a preset lossy or lossless algorithm to perform data processing on the grid data to obtain target data.
其中，在得到三角网格格式的数据后，可以采用预设的有损或无损算法对网格数据进行数据处理，例如，可以对数据进行轻量化处理。预设的有损或无损算法可以是开源算法或私有算法，轻量化处理是指对网格数据进行压缩、减面和合并等处理，将处理后得到的数据作为目标模型的目标数据。Wherein, after obtaining the data in the triangular mesh format, a preset lossy or lossless algorithm may be used to perform data processing on the mesh data, for example, the data may be light-weighted. The preset lossy or lossless algorithm can be an open source algorithm or a proprietary algorithm. Lightweight processing refers to the processing of mesh data such as compression, area reduction, and merging, and the processed data is used as the target data of the target model.
本实施例中，可选的，采用预设的有损或无损算法对网格数据进行数据处理，包括：采用预设数据处理算法对网格数据进行无损压缩或有损减面；根据目标模型的材质和形状，对网格数据进行同材质合并和/或同形状合并。In this embodiment, optionally, using a preset lossy or lossless algorithm to perform data processing on the grid data includes: using a preset data processing algorithm to perform lossless compression or lossy surface reduction on the grid data; The material and shape of the mesh data are merged with the same material and/or with the same shape.
具体的，所采用的预设数据处理算法可以是开源算法，例如，可以是Draco算法和Fast-Quadric-Mesh-Simplification(快速二次曲面网格简化算法)算法等，Draco算法是由谷歌发布的一种开源算法，既支持有损模式，也支持无损模式。采用Draco算法可以对网格数据进行无损压缩，采用Fast-Quadric-Mesh-Simplification算法可以对网格数据进行有损减面。除了压缩和减面之外，还可以进行合并操作。例如，可以先确定目标模型的虚拟装置中各个面的材质和形状，根据确定的材质和形状，确定同材质和/或同形状所对应的网格数据，例如，可以比对各装配件的模型形状，确定同形状的网格数据。对网格数据进行同材质合并和/或同形状合并，即将同材质的网格数据连接在一起，将同形状的网格数据连接在一起，减少网格数据的数量，使一个材质对应一个网格数据，一个形状对应一个网格数据。这样设置的有益效果在于，通过对网格数据进行轻量化处理，有效减小数据量，提高后续立体渲染的效率。Specifically, the preset data processing algorithm used may be an open source algorithm, for example, the Draco algorithm and the Fast-Quadric-Mesh-Simplification (fast quadric surface mesh simplification algorithm) algorithm, etc. The Draco algorithm is published by Google An open source algorithm that supports both lossy and lossless modes. The Draco algorithm can be used to compress the mesh data losslessly, and the Fast-Quadric-Mesh-Simplification algorithm can be used to reduce the mesh data lossy. In addition to compression and face reduction, merge operations are also possible. For example, the material and shape of each surface in the virtual device of the target model can be determined first, and the mesh data corresponding to the same material and/or the same shape can be determined according to the determined material and shape. For example, the models of each assembly can be compared. Shape, determine the mesh data of the same shape. The mesh data is merged with the same material and/or the same shape, that is, the mesh data of the same material is connected together, and the mesh data of the same shape is connected together to reduce the number of mesh data, so that one material corresponds to one mesh. Grid data, a shape corresponds to a grid data. The beneficial effect of this setting is that, by performing lightweight processing on mesh data, the amount of data is effectively reduced, and the efficiency of subsequent stereo rendering is improved.
还可以对网格顶点数据进行细微偏移，例如，对网格顶点数据的坐标偏移0.01，细微的偏移不会对目标模型的呈现造成太大影响。用户可以针对细微偏移的数据，增加自己的数字签名，例如，用户可以采用自己的私钥进行签名，表明该目标模型属于该用户，实现了版权保护，对于导出的模型能追踪到它的来源。It is also possible to slightly offset the mesh vertex data, for example, offset the coordinates of the mesh vertex data by 0.01, and the slight offset will not have much effect on the rendering of the target model. Users can add their own digital signatures for slightly offset data. For example, users can use their own private key to sign, indicating that the target model belongs to the user, which realizes copyright protection, and can trace the source of the exported model. .
本实施例中，可选的，在采用预设的有损或无损算法对网格数据进行数据处理，得到目标数据之后，还包括：根据建模软件对目标模型的材质描述，将目标模型中的材质描述方式转换为物理模拟渲染方式。In this embodiment, optionally, after using a preset lossy or lossless algorithm to perform data processing on the mesh data to obtain the target data, the method further includes: according to the material description of the target model by the modeling software, converting the target model into the target model. The material description method is converted to the physical simulation rendering method.
具体的，不同的建模软件对同一个目标模型可以有不同的材质描述，材质的描述还会收建模软件中光照模型的影响。根据目标模型原始的材质描述，确定目标模型的虚拟装置的各个部分的材质，根据确定的材质，将材质以物理模拟渲染方式进行描述，即可以将目标模型中的材质描述方式转换为统一的物理模拟渲染方式，实现对材质的映射，便于对目标模型进行精确渲染。材质映射步骤可以是将原始的材质描述中的材质部分自动转换为立体渲染端软件采用的PBR(Physically Based Rendering，物理渲染模式)。PBR是基于物理的渲染过程，用于更精确的描述光如何与物体表面互动，在任何光照环境都能表现出正确的结果。在Creo插件中，可以实施一套将Creo材质描述的mtl(Material Library File，材质库文件)文件转为立体渲染器使用的实时渲染PBR的工程处理流程。这样设置的有益效果在于，通过进行材质映射，有利于提高目标模型立体渲染的精度。Specifically, different modeling software can have different material descriptions for the same target model, and the material description will also be affected by the lighting model in the modeling software. According to the original material description of the target model, the material of each part of the virtual device of the target model is determined, and according to the determined material, the material is described in a physical simulation rendering method, that is, the material description method in the target model can be converted into a unified physical Simulate the rendering method, realize the mapping of materials, and facilitate accurate rendering of the target model. The material mapping step may be to automatically convert the material part in the original material description into PBR (Physically Based Rendering, physical rendering mode) adopted by the stereo rendering software. PBR is a physically based rendering process used to more accurately describe how light interacts with the surface of an object, giving correct results in any lighting environment. In the Creo plug-in, it is possible to implement a set of engineering processing procedures for converting mtl (Material Library File) files described by Creo materials into real-time rendering PBR used by the stereo renderer. The beneficial effect of this setting is that, by performing material mapping, it is beneficial to improve the accuracy of stereo rendering of the target model.
步骤130、将目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示。Step 130: Encode and store the target data based on the preset file format, and transmit the encoded data to the stereo rendering terminal for the software of the stereo rendering terminal to render the encoded target model by using a physical simulation rendering method, and display the encoded target model on the screen. Stereoscopic display.
其中，在得到目标数据后，进行文件格式的编码。目标数据位于内存中，属于网格数据，将内存中的网格数据编码为磁盘上存储的文件格式。例如，可以使用GLTF(GraphicsLanguage Transmission Format，图形语言传输格式)格式进行存储，或使用USD((Universal Scene Description，通用场景描述)格式进行存储。若目标模型中含有虚拟装置的装配动画或骨骼动画等信息，则可以将装配动画或骨骼动画信息进行导出存储。可以设置增量导出方式，所要存储的文件可以按照装配件的名称进行拆分，存放为独立文件，当一个装配件被修改时，仅更新该装配件的描述文件。另外，还可以将模型扩展信息采用写入到独立描述文件的方式进行传输，不修改数据源文件，以此提高交互速度。模型扩展信息是一种元数据(Metadata)，可以表示虚拟装置中各装配件的结构和装配方式等信息。在对目标数据进行编码转换后，可以按照约定的通讯协议启动和连接立体渲染器，由立体渲染端软件对3D模型进行展示。例如，可以通过winexec(外部调用)或其他方式启动立体渲染服务程序，发送TCP连接请求，立体渲染服务端建立套接字连接，打开指定资源，将立体模型显示在屏幕上。本实施例中，屏幕硬件部分可以采用二维和三维可切换式裸眼3D立体显示器，不需要借助3D眼镜等外部设备。Wherein, after obtaining the target data, the encoding of the file format is performed. The target data is located in memory and belongs to grid data, and the grid data in memory is encoded into a file format stored on disk. For example, you can use GLTF (GraphicsLanguage Transmission Format, Graphics Language Transmission Format) format for storage, or use USD ((Universal Scene Description, Universal Scene Description) format for storage. If the target model contains the assembly animation or skeletal animation of the virtual device, etc. information, the assembly animation or skeletal animation information can be exported and stored. Incremental export mode can be set. The files to be stored can be split according to the name of the assembly and stored as independent files. When an assembly is modified, only Update the description file of the assembly. In addition, the model extension information can be transmitted by writing to an independent description file, without modifying the data source file, so as to improve the interaction speed. The model extension information is a kind of metadata (Metadata). ), which can represent information such as the structure and assembly method of each assembly in the virtual device. After encoding and converting the target data, the stereo rendering device can be started and connected according to the agreed communication protocol, and the 3D model can be displayed by the stereo rendering software. For example, the stereo rendering service program can be started through winexec (external call) or other methods, sending a TCP connection request, the stereo rendering server establishes a socket connection, opens the specified resource, and displays the stereo model on the screen. In this embodiment , the screen hardware part can use two-dimensional and three-dimensional switchable naked-eye 3D stereoscopic display, without external equipment such as 3D glasses.
本实施例中，可选的，在将目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示之后，还包括：根据用户对立体显示的目标模型的调整指令，对目标模型进行旋转、移动、缩放、拆解、组装、二次着色或剖面调整。In this embodiment, optionally, the target data is encoded and stored based on a preset file format, and the encoded data is transmitted to the stereo rendering end for the software of the stereo rendering end to render the encoded image by using a physical simulation rendering method. After the target model is stereoscopically displayed on the screen, the method further includes: rotating, moving, scaling, dismantling, assembling, secondary coloring or adjusting the section of the target model according to the user's adjustment instruction on the stereoscopically displayed target model.
具体的，独立的立体渲染端软件采用约定的物理模拟渲染方式渲染目标网格数据的模型，模型显示的初始状态在屏幕中是居中并位于出屏位置。用户可以在模型的3D立体显示状态时发出目标模型调整指令，例如，用户可以通过鼠标、键盘、手势和语音控制器等交互介质对模型进行实时交互控制，调整操作可以是旋转、移动、缩放、拆解和组装、二次着色和剖面调整等。本实施例中，支持将模型缩放到真实大小尺寸，并在入屏空间进行立体渲染，有助于设计者对模型最终的体积尺寸进行直观把控。另外，还可以通过配置的方式实现自定义的灯光、天空盒和真实场景映射的立体渲染，以及通过实时光线追踪方式进行立体渲染。通过监测渲染负载情况，可以动态调整立体渲染中的灯光、阴影绘制和图像处理的质量。在裸眼3D立体显示模式下，对3D目标模型的空间姿态支持做六自由度的调整。也支持直接对3D目标模型进行3D空间内的文字、图像和声音标注，支持测距、测角和测量体积等。可以将模型的立体视图通过在线协同会议的方式分享给互联网上的其它显示终端，进行同步展示。这样设置的有益效果在于，启动立体渲染和交互操作，实现用户对目标模型的实时调整，有利于用户操作和查看，提升用户体验。本发明实施例制定了一种模型立体渲染工作流的立体显示方法，并按照具体描述支撑立体空间切换功能的实施。Specifically, the independent stereo rendering software uses the agreed physical simulation rendering method to render the model of the target mesh data, and the initial state of the model display is centered on the screen and located at the out-screen position. The user can issue the target model adjustment instruction when the model is in the 3D stereoscopic display state. For example, the user can interactively control the model in real time through interactive media such as mouse, keyboard, gesture, and voice controller. The adjustment operations can be rotation, movement, scaling, Disassembly and assembly, secondary coloring and section adjustment, etc. In this embodiment, the model is supported to be scaled to the real size, and stereoscopic rendering is performed in the screen entry space, which helps the designer to intuitively control the final volume size of the model. In addition, stereo rendering of custom lights, skyboxes and real scene mapping can be achieved through configuration, as well as stereo rendering through real-time ray tracing. By monitoring the rendering load, the quality of lighting, shadow rendering and image processing in stereo rendering can be dynamically adjusted. In the naked-eye 3D stereoscopic display mode, the spatial attitude of the 3D target model can be adjusted with six degrees of freedom. It also supports direct annotation of text, images and sounds in 3D space to the 3D target model, and supports ranging, angle measurement, and volume measurement. The stereoscopic view of the model can be shared with other display terminals on the Internet through an online collaborative meeting for synchronous display. The beneficial effect of such a setting is that three-dimensional rendering and interactive operation are started, so that the user can adjust the target model in real time, which is beneficial to the user's operation and viewing, and improves the user experience. The embodiment of the present invention formulates a stereoscopic display method for a model stereoscopic rendering workflow, and supports the implementation of the stereoscopic space switching function according to the specific description.
本实施例的技术方案，通过对目标模型的数学描述进行数据处理，减少数据量，提高2D与3D的切换速度。将处理后的目标数据进行编码，可以将目标模型可以传输给立体渲染端软件，使立体渲染端的软件可以直接将3D模型显示在屏幕上。解决了现有技术中，需要依靠眼镜等设备查看3D模型的问题，减少用户的切换操作，实现二维与三维的一键切换，以及用户裸眼进行3D立体预览的效果，提高3D立体模型的显示效率。通过模型轻量化、材质转化、文件传输和自动屏幕切换一系列功能的结合，可快速传输的模型数据，实现了2D工作空间和3D立体工作空间的一键式切换，减少用户操作过程，使模型3D立体预览更加便捷。The technical solution of this embodiment reduces the amount of data and improves the switching speed between 2D and 3D by performing data processing on the mathematical description of the target model. After encoding the processed target data, the target model can be transmitted to the software of the stereo rendering end, so that the software of the stereo rendering end can directly display the 3D model on the screen. It solves the problem that in the prior art, it is necessary to rely on glasses and other devices to view 3D models, reduces the user's switching operation, realizes one-key switching between two-dimensional and three-dimensional, and the effect of the user's naked-eye 3D stereoscopic preview, and improves the display of 3D stereoscopic models. efficiency. Through the combination of a series of functions such as model lightweighting, material conversion, file transfer and automatic screen switching, the model data that can be quickly transferred realizes one-click switching between 2D workspace and 3D stereoscopic workspace, reducing the user operation process and making the model 3D stereo preview is more convenient.
实施例二Embodiment 2
图2为本发明实施例二所提供的一种立体显示方法的流程示意图，本实施例以上述实施例为基础进行进一步的优化，该方法可以由一种立体显示装置来执行。如图2所示，该方法具体包括如下步骤：FIG. 2 is a schematic flowchart of a stereoscopic display method according to Embodiment 2 of the present invention. This embodiment is further optimized on the basis of the above-mentioned embodiment, and the method can be executed by a stereoscopic display device. As shown in Figure 2, the method specifically includes the following steps:
步骤210、获取用户的双眼位置和屏幕参数，根据双眼位置和屏幕参数架设建模软件中的虚拟双目相机。Step 210: Acquire the user's binocular positions and screen parameters, and set up a virtual binocular camera in the modeling software according to the binocular positions and screen parameters.
其中，本实施例针对媒体数据方式立体显示。显示屏上可以设置有人眼追踪硬件模块，可以安装在屏幕顶部或屏幕底部，人眼追踪硬件模块可以是单目摄像机、多目摄像机或其它类型的深度摄像机。通过人眼追踪硬件模块可以获取用户的双眼位置，双眼位置是指双眼映射在显示屏上的坐标位置。预先确定屏幕参数，屏幕参数可以是指屏幕尺寸和安装角度等参数。根据双眼位置和屏幕参数，可以架设建模软件中的虚拟双目相机，从而进行体积感逼真的立体渲染设置，使用户所看到的立体模型更接近真实情况。例如，双眼位置在屏幕的下方，则可以在屏幕下方架设虚拟双目相机。可以实时获取用户的双眼位置，若用户双眼移动，则可以架设新的虚拟双目相机，提升用户的观看体验。屏幕上也可以不设置人眼追踪硬件模块，通过获取预设的双目位置进行虚拟双目相机的架设。Among them, this embodiment is directed to stereoscopic display of media data. An eye-tracking hardware module can be provided on the display screen, which can be installed at the top or bottom of the screen, and the eye-tracking hardware module can be a monocular camera, a multi-eye camera, or other types of depth cameras. The user's binocular position can be obtained through the human eye tracking hardware module, and the binocular position refers to the coordinate position of the two eyes mapped on the display screen. The screen parameters are predetermined, and the screen parameters may refer to parameters such as screen size and installation angle. According to the position of the eyes and the parameters of the screen, a virtual binocular camera in the modeling software can be set up, so as to set up a stereoscopic rendering with a realistic sense of volume, so that the stereoscopic model seen by the user is closer to the real situation. For example, if the eyes are positioned below the screen, a virtual binocular camera can be set up below the screen. The position of the user's eyes can be obtained in real time. If the user's eyes move, a new virtual binocular camera can be set up to improve the user's viewing experience. It is also possible to set up a virtual binocular camera by obtaining a preset binocular position without setting an eye tracking hardware module on the screen.
步骤220、获取目标模型的立体多视图，根据虚拟双目相机的位置和建模软件提供的软件开发包，对目标模型的立体多视图进行立体渲染和画面拼接，生成目标数据。Step 220: Acquire stereo multi-views of the target model, and perform stereo rendering and image stitching on the stereo multi-views of the target model according to the position of the virtual binocular camera and the software development kit provided by the modeling software to generate target data.
其中，用户可以在多个任意指定位置观看目标模型的立体多视图，例如，主视图、左视图和右视图等。根据虚拟双目相机的位置，确定模型的立体渲染位参数。可以指定本人观看显示器时的双眼位置，或指定最终场景下的双眼位置，例如，可以在电梯的墙上设置显示屏，由于人们在电梯里需要仰头观看显示屏，因此，可以设置渲染位置为屏幕的下前方偏左。模型的立体渲染位参数可以包括立体双目相机的视场角、间距、零平面位置以及空间位置和姿态等。获取目标模型的立体多视图，通过调用三维建模软件提供的SDK进行立体渲染和画面拼接，并将渲染和拼接后的数据作为目标数据。Wherein, the user can view the stereoscopic multi-views of the target model at multiple arbitrary designated positions, for example, the main view, the left view, and the right view. According to the position of the virtual binocular camera, the stereo rendering bit parameters of the model are determined. You can specify the position of your eyes when you watch the display, or specify the position of your eyes in the final scene. For example, you can set the display screen on the wall of the elevator. Since people need to look up at the display screen in the elevator, you can set the rendering position as The lower front of the screen is to the left. The stereo rendering bit parameters of the model can include the field of view, distance, zero plane position, and spatial position and attitude of the stereo binocular camera. Obtain the stereo multi-view of the target model, perform stereo rendering and screen stitching by calling the SDK provided by the 3D modeling software, and use the rendered and stitched data as the target data.
可以使用草图模式进行快速渲染，或使用产品模式进行慢速渲染，例如开启光线追踪后进行双目同步离线渲染。You can use sketch mode for fast rendering, or use production mode for slow rendering, such as binocular offline rendering with ray tracing turned on.
步骤230、将目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件获取建模软件的视口渲染结果，并在屏幕上进行立体显示。Step 230: Encode and store the target data based on the preset file format, and transmit the encoded data to the stereo rendering terminal for the software of the stereo rendering terminal to obtain the viewport rendering result of the modeling software, and perform stereo rendering on the screen. show.
其中，在得到目标数据后，对目标数据进行编码，使连接的立体渲染端软件可以将编码后的数据显示在屏幕上。由于建模软件里的视口只用于渲染非立体的画面，因此，可以采用立体渲染端软件来进行全屏立体渲染，并且开展各种交互和协同设计功能。建模软件可以按照立体插件的要求，进行双目立体渲染，生成左右两幅图，对左右两幅图进行立体插件拼接，传输给独立的立体渲染软件，由立体渲染软件控制立体显示器进行呈现。Wherein, after obtaining the target data, the target data is encoded, so that the connected stereo rendering software can display the encoded data on the screen. Since the viewport in the modeling software is only used to render non-stereoscopic images, the stereoscopic rendering software can be used to perform full-screen stereoscopic rendering and carry out various interactive and collaborative design functions. The modeling software can perform binocular stereo rendering according to the requirements of the stereo plug-in, generate two left and right images, splicing the left and right images with a stereo plug-in, and transmit them to an independent stereo rendering software, which will control the stereo display for presentation.
本实施例中，可选的，目标数据为图片帧数据；相应地，将目标数据基于预设的文件格式进行编码和存储，包括：将渲染的图片帧编码为预设格式的媒体文件，将媒体文件放置在磁盘或共享内存中进行存储。In this embodiment, optionally, the target data is picture frame data; correspondingly, encoding and storing the target data based on a preset file format includes: encoding the rendered picture frame into a media file in a preset format, Media files are placed on disk or shared memory for storage.
具体的，用户导入的数据可以是目标模型的立体多视图的图片数据，目标数据是渲染的图片帧。将渲染的图片帧编码为预设格式的媒体文件进行存储，可以存储在磁盘上或共享内存中。按照预设的通讯协议启动和连接立体渲染器，实现立体模型的显示。用户在查看立体模型时，可以进行立体效果调整。立体渲染器的程序对编码后的媒体文件进行解码和裸眼3D立体呈现，用户在看到立体虚像的用户界面上，对立体效果进行微调。立体渲染程序可以通过按键触发，将微调结果反馈回建模软件的插件端程序，插件端程序基于该结果更新虚拟双目相机架设的参数，并重新进行立体渲染。在立体呈现时，同样可以通过按键对模型所在的建模软件窗口进行空间位置、姿态和缩放的控制，并刷新立体画面。这样设置的有益效果在于，实现对不同格式的目标数据进行编码和存储，减少对立体显示的限制，提高立体显示的效率。对于图片帧，立体画面的内容是建模软件渲染的，立体渲染端软件获取建模软件渲染后的结果，控制裸眼3D立体显示器进行状态切换和立体交织，将建模软件的渲染结果以立体的形式进行显示。本发明实施例制定了一种媒体立体渲染工作流的立体显示方法，并按照具体描述支撑立体空间切换功能的实施。Specifically, the data imported by the user may be stereoscopic multi-view picture data of the target model, and the target data is a rendered picture frame. Encode the rendered picture frame into a preset format media file for storage, which can be stored on disk or in shared memory. Start and connect the stereo renderer according to the preset communication protocol to realize the display of the stereo model. When viewing the three-dimensional model, the user can adjust the three-dimensional effect. The program of the stereo renderer decodes the encoded media file and presents the naked-eye 3D stereo. The user can fine-tune the stereo effect on the user interface where the stereo virtual image is seen. The stereo rendering program can be triggered by a button, and the fine-tuning results are fed back to the plug-in side program of the modeling software. The plug-in side program updates the parameters of the virtual binocular camera based on the results, and performs stereo rendering again. During stereoscopic presentation, you can also control the spatial position, attitude and zoom of the modeling software window where the model is located by pressing buttons, and refresh the stereoscopic image. The beneficial effect of this arrangement is that the target data in different formats can be encoded and stored, the restriction on stereoscopic display is reduced, and the efficiency of stereoscopic display is improved. For picture frames, the content of the stereoscopic image is rendered by the modeling software, and the stereo rendering software obtains the results rendered by the modeling software, controls the naked-eye 3D stereoscopic display to perform state switching and stereo interleaving, and converts the rendering results of the modeling software into stereoscopic displayed in the form. The embodiment of the present invention formulates a stereoscopic display method for a media stereoscopic rendering workflow, and supports the implementation of the stereoscopic space switching function according to the specific description.
本发明通过获取用户的双眼位置，可以实时架设虚拟双目相机，为用户呈现更逼真的视觉效果。通过获取立体多视图，对模型进行立体渲染和画面拼接，实现了采用媒体数据的方式进行立体显示。解决了现有技术中，需要依靠眼镜等设备查看3D模型的问题，减少用户的切换操作，实现二维与三维的一键切换，以及用户裸眼进行3D立体预览的效果，提高3D立体模型的显示效率。通过立体参数的自动和直观配置、使用媒体文件传输立体数据以及自动屏幕切换等一系列功能的结合，使切换到立体渲染状态快，模型着色效果也能和原建模软件窗口完全一致。By acquiring the user's binocular position, the present invention can set up a virtual binocular camera in real time to present a more realistic visual effect for the user. By acquiring stereoscopic multi-views, stereoscopic rendering and image splicing are performed on the model, and the stereoscopic display by means of media data is realized. It solves the problem that in the prior art, it is necessary to rely on glasses and other devices to view 3D models, reduces the user's switching operation, realizes one-key switching between two-dimensional and three-dimensional, and the effect of the user's naked-eye 3D stereoscopic preview, and improves the display of 3D stereoscopic models. efficiency. Through the combination of a series of functions such as automatic and intuitive configuration of stereo parameters, transmission of stereo data using media files, and automatic screen switching, switching to stereo rendering is fast, and the model shading effect can be completely consistent with the original modeling software window.
实施例三Embodiment 3
图3为本发明实施例三所提供的一种立体显示装置的结构示意图，可执行本发明任意实施例所提供的立体显示方法，该装置配置于立体显示插件，立体显示插件安装于建模软件上，该装置具备执行方法相应的功能模块和有益效果。如图3所示，该装置具体包括：3 is a schematic structural diagram of a stereoscopic display device according to Embodiment 3 of the present invention, which can execute the stereoscopic display method provided by any embodiment of the present invention. The device is configured in a stereoscopic display plug-in, and the stereoscopic display plug-in is installed in a modeling software Above, the device has functional modules and beneficial effects corresponding to the execution method. As shown in Figure 3, the device specifically includes:
网格数据获得模块301，用于响应于模型立体显示指令，获取目标模型的数学描述，对所述目标模型的数学描述进行兴趣区域提取，得到目标模型的网格数据；The grid
目标数据获得模块302，用于采用预设的有损或无损算法对所述网格数据进行数据处理，得到目标数据；a target
模型立体显示模块303，用于将所述目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示。The model
可选的，网格数据获得模块301，具体用于：Optionally, the grid
使用建模软件提供的软件开发包获取三角化转换接口函数，对所述目标模型的数学描述进行三角化处理，得到目标模型的网格数据；或者，Use the software development kit provided by the modeling software to obtain the triangulation conversion interface function, perform triangulation processing on the mathematical description of the target model, and obtain the grid data of the target model; or,
使用建模软件提供的软件开发包绘制多角度模型视图，并进行三维重建，获得目标模型的网格数据。Use the software development kit provided by the modeling software to draw multi-angle model views, and perform 3D reconstruction to obtain the mesh data of the target model.
可选的，目标数据获得模块302，具体用于：Optionally, the target
采用预设数据处理算法对所述网格数据进行无损压缩和/或有损减面；Use preset data processing algorithms to perform lossless compression and/or lossy surface reduction on the mesh data;
根据目标模型的材质和形状，对所述网格数据进行同材质合并和/或同形状合并。According to the material and shape of the target model, the mesh data is merged with the same material and/or with the same shape.
可选的，该装置还包括：Optionally, the device further includes:
材质转换模块，用于在采用预设的有损或无损算法对所述网格数据进行数据处理，得到目标数据之后，根据建模软件对目标模型的材质描述，将所述目标模型中的材质描述方式转换为物理模拟渲染方式。The material conversion module is used to perform data processing on the mesh data by using a preset lossy or lossless algorithm to obtain target data, and convert the material in the target model according to the material description of the target model by the modeling software. The description mode is converted to the physical simulation rendering mode.
可选的，该装置还包括：Optionally, the device further includes:
模型调整模块，用于在将所述目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示之后，根据用户对立体显示的目标模型的调整指令，对所述目标模型进行旋转、移动、缩放、拆解、组装、二次着色或剖面调整。The model adjustment module is used to encode and store the target data based on a preset file format, and transmit the encoded data to the stereo rendering end for the software of the stereo rendering end to render the encoded target by using physical simulation rendering After the stereoscopic display is performed on the screen, the target model is rotated, moved, scaled, disassembled, assembled, recolored or section adjusted according to the user's adjustment instruction on the stereoscopically displayed target model.
可选的，该装置还包括：Optionally, the device further includes:
虚拟相机架设模块，用于在将所述目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示之前，获取用户的双眼位置和屏幕参数，根据所述双眼位置和屏幕参数架设建模软件中的虚拟双目相机；The virtual camera erection module is used to encode and store the target data based on a preset file format, and transmit the encoded data to the stereo rendering end for the software of the stereo rendering end to render the encoded image by using physical simulation rendering. target model, and before performing stereoscopic display on the screen, obtain the user's binocular position and screen parameters, and set up a virtual binocular camera in the modeling software according to the binocular position and screen parameters;
目标数据生成模块，用于获取目标模型的立体多视图，根据虚拟双目相机的位置和建模软件提供的软件开发包，对目标模型的立体多视图进行立体渲染和画面拼接，生成目标数据。The target data generation module is used to obtain the stereo multi-view of the target model. According to the position of the virtual binocular camera and the software development kit provided by the modeling software, stereo rendering and image stitching are performed on the stereo multi-view of the target model to generate target data.
可选的，目标数据为图片帧数据；Optionally, the target data is picture frame data;
相应地，模型立体显示模块303，具体用于：Correspondingly, the model
将渲染的图片帧编码为预设格式的媒体文件，将所述媒体文件放置在磁盘或共享内存中进行存储。The rendered picture frame is encoded into a media file in a preset format, and the media file is placed on a disk or in a shared memory for storage.
本发明实施例通过对目标模型的数学描述进行数据处理，减少数据量，提高2D与3D的切换速度。将处理后的目标数据进行编码，可以将目标模型可以传输给立体渲染端软件，使立体渲染端的软件可以直接将3D模型显示在屏幕上。解决了现有技术中，需要依靠眼镜等设备查看3D模型的问题，减少用户的切换操作，实现二维与三维的一键切换，以及用户裸眼进行3D立体预览的效果，提高3D立体模型的显示效率。The embodiment of the present invention reduces the amount of data and improves the switching speed between 2D and 3D by performing data processing on the mathematical description of the target model. After encoding the processed target data, the target model can be transmitted to the software of the stereo rendering end, so that the software of the stereo rendering end can directly display the 3D model on the screen. It solves the problem that in the prior art, it is necessary to rely on glasses and other devices to view 3D models, reduces the user's switching operation, realizes one-key switching between two-dimensional and three-dimensional, and the effect of the user's naked-eye 3D stereoscopic preview, and improves the display of 3D stereoscopic models. efficiency.
实施例四Embodiment 4
图4是本发明实施例四提供的一种立体显示设备的结构示意图。立体显示设备是一种电子设备，图4示出了适于用来实现本发明实施方式的示例性电子设备400的框图。图4显示的电子设备400仅仅是一个示例，不应对本发明实施例的功能和使用范围带来任何限制。FIG. 4 is a schematic structural diagram of a stereoscopic display device according to Embodiment 4 of the present invention. A stereoscopic display device is an electronic device, and FIG. 4 shows a block diagram of an exemplary
如图4所示，电子设备400以通用计算设备的形式表现。电子设备400的组件可以包括但不限于：一个或者多个处理器或者处理单元401，系统存储器402，连接不同系统组件(包括系统存储器402和处理单元401)的总线403。As shown in FIG. 4,
总线403表示几类总线结构中的一种或多种，包括存储器总线或者存储器控制器，外围总线，图形加速端口，处理器或者使用多种总线结构中的任意总线结构的局域总线。举例来说，这些体系结构包括但不限于工业标准体系结构(ISA)总线，微通道体系结构(MAC)总线，增强型ISA总线、视频电子标准协会(VESA)局域总线以及外围组件互连(PCI)总线。
电子设备400典型地包括多种计算机系统可读介质。这些介质可以是任何能够被电子设备400访问的可用介质，包括易失性和非易失性介质，可移动的和不可移动的介质。
系统存储器402可以包括易失性存储器形式的计算机系统可读介质，例如随机存取存储器(RAM)404和/或高速缓存存储器405。电子设备400可以进一步包括其它可移动/不可移动的、易失性/非易失性计算机系统存储介质。仅作为举例，存储系统406可以用于读写不可移动的、非易失性磁介质(图4未显示，通常称为“硬盘驱动器”)。尽管图4中未示出，可以提供用于对可移动非易失性磁盘(例如“软盘”)读写的磁盘驱动器，以及对可移动非易失性光盘(例如CD-ROM,DVD-ROM或者其它光介质)读写的光盘驱动器。在这些情况下，每个驱动器可以通过一个或者多个数据介质接口与总线403相连。存储器402可以包括至少一个程序产品，该程序产品具有一组(例如至少一个)程序模块，这些程序模块被配置以执行本发明各实施例的功能。
具有一组(至少一个)程序模块407的程序/实用工具408，可以存储在例如存储器402中，这样的程序模块407包括但不限于操作系统、一个或者多个应用程序、其它程序模块以及程序数据，这些示例中的每一个或某种组合中可能包括网络环境的实现。程序模块407通常执行本发明所描述的实施例中的功能和/或方法。A program/utility 408 having a set (at least one) of
电子设备400也可以与一个或多个外部设备409(例如键盘、指向设备、显示器410等)通信，还可与一个或者多个使得用户能与该电子设备400交互的设备通信，和/或与使得该电子设备400能与一个或多个其它计算设备进行通信的任何设备(例如网卡，调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口411进行。并且，电子设备400还可以通过网络适配器412与一个或者多个网络(例如局域网(LAN)，广域网(WAN)和/或公共网络，例如因特网)通信。如图4所示，网络适配器412通过总线403与电子设备400的其它模块通信。应当明白，尽管图4中未示出，可以结合电子设备400使用其它硬件和/或软件模块，包括但不限于：微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。The
处理单元401通过运行存储在系统存储器402中的程序，从而执行各种功能应用以及数据处理，例如实现本发明实施例所提供的一种立体显示的方法，包括：The
响应于模型立体显示指令，获取目标模型的数学描述，对所述目标模型的数学描述进行兴趣区域提取，得到目标模型的网格数据；In response to the model three-dimensional display instruction, obtain the mathematical description of the target model, extract the region of interest on the mathematical description of the target model, and obtain the grid data of the target model;
采用预设的有损或无损算法对所述网格数据进行数据处理，得到目标数据；Perform data processing on the grid data by using a preset lossy or lossless algorithm to obtain target data;
将所述目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示。The target data is encoded and stored based on the preset file format, and the encoded data is transmitted to the stereo rendering end for the software of the stereo rendering end to render the encoded target model by using the physical simulation rendering method, and perform on the screen. Stereoscopic display.
实施例五Embodiment 5
本发明实施例五还提供一种包含计算机可执行指令的存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本发明实施例所提供的一种立体显示的方法，包括：The fifth embodiment of the present invention also provides a storage medium containing computer-executable instructions, and a computer program is stored thereon. When the program is executed by a processor, a method for stereoscopic display as provided by the embodiment of the present invention is implemented, including:
响应于模型立体显示指令，获取目标模型的数学描述，对所述目标模型的数学描述进行兴趣区域提取，得到目标模型的网格数据；In response to the model three-dimensional display instruction, obtain the mathematical description of the target model, extract the region of interest on the mathematical description of the target model, and obtain the grid data of the target model;
采用预设的有损或无损算法对所述网格数据进行数据处理，得到目标数据；Perform data processing on the grid data by using a preset lossy or lossless algorithm to obtain target data;
将所述目标数据基于预设的文件格式进行编码和存储，并将编码后的数据传输至立体渲染端，供立体渲染端软件采用物理模拟渲染方式渲染编码后的目标模型，并在屏幕上进行立体显示。The target data is encoded and stored based on the preset file format, and the encoded data is transmitted to the stereo rendering end for the software of the stereo rendering end to render the encoded target model by using the physical simulation rendering method, and perform on the screen. Stereoscopic display.
本发明实施例的计算机存储介质，可以采用一个或多个计算机可读的介质的任意组合。计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。The computer storage medium in the embodiments of the present invention may adopt any combination of one or more computer-readable mediums. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (a non-exhaustive list) of computer readable storage media include: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), Erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。A computer-readable signal medium may include a propagated data signal in baseband or as part of a carrier wave, with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device .
计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于无线、电线、光缆、RF等等，或者上述的任意合适的组合。Program code embodied on a computer readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
可以以一种或多种程序设计语言或其组合来编写用于执行本发明操作的计算机程序代码，所述程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络，包括局域网(LAN)或广域网(WAN)，连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。Computer program code for carrying out operations of the present invention may be written in one or more programming languages, including object-oriented programming languages—such as Java, Smalltalk, C++, but also conventional Procedural programming language - such as the "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or wide area network (WAN), or may be connected to an external computer (eg, through the Internet using an Internet service provider) connect).
注意，上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解，本发明不限于这里所述的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此，虽然通过以上实施例对本发明进行了较为详细的说明，但是本发明不仅仅限于以上实施例，在不脱离本发明构思的情况下，还可以包括更多其他等效实施例，而本发明的范围由所附的权利要求范围决定。Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention. The scope is determined by the scope of the appended claims.
Claims (10)
Translated fromChinesePriority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110315690.XACN113012270A (en) | 2021-03-24 | 2021-03-24 | Stereoscopic display method and device, electronic equipment and storage medium |
| ATGM9028/2022UAT18289U1 (en) | 2021-03-24 | 2022-03-16 | METHOD AND DEVICE FOR STEREOSCOPIC DISPLAY, ELECTRONIC DEVICE, STORAGE MEDIUM |
| PCT/CN2022/081123WO2022199437A1 (en) | 2021-03-24 | 2022-03-16 | Method and apparatus for stereoscopic display, and electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110315690.XACN113012270A (en) | 2021-03-24 | 2021-03-24 | Stereoscopic display method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113012270Atrue CN113012270A (en) | 2021-06-22 |
Family
ID=76406551
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110315690.XAPendingCN113012270A (en) | 2021-03-24 | 2021-03-24 | Stereoscopic display method and device, electronic equipment and storage medium |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN113012270A (en) |
| AT (1) | AT18289U1 (en) |
| WO (1) | WO2022199437A1 (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113256803A (en)* | 2021-06-23 | 2021-08-13 | 合肥量圳建筑科技有限公司 | Data compression method, device, equipment and storage medium |
| CN113963100A (en)* | 2021-10-25 | 2022-01-21 | 广东工业大学 | A 3D model rendering method and system for a digital twin simulation scene |
| CN114064028A (en)* | 2021-11-04 | 2022-02-18 | 深圳航天智慧城市系统技术研究院有限公司 | Spatial analysis modeling method based on online visual editing |
| CN114461959A (en)* | 2021-12-22 | 2022-05-10 | 北京驭瓴科技有限公司 | WEB terminal online display method, device and electronic equipment of BIM data |
| CN114529623A (en)* | 2022-01-18 | 2022-05-24 | 深圳易可达科技有限公司 | Data display mode switching method, device, equipment and storage medium |
| WO2022199437A1 (en)* | 2021-03-24 | 2022-09-29 | 纵深视觉科技(南京)有限责任公司 | Method and apparatus for stereoscopic display, and electronic device and storage medium |
| WO2024205611A3 (en)* | 2022-05-13 | 2024-11-14 | President And Fellows Of Harvard College | Minimal memory differentiation |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040102938A1 (en)* | 2002-11-21 | 2004-05-27 | Mitsubishi Denki Kabushiki Kaisha | Method and device for creating analytical mesh data |
| CN102801994A (en)* | 2012-06-19 | 2012-11-28 | 西北工业大学 | Physical image information fusion device and method |
| JP2014032473A (en)* | 2012-08-01 | 2014-02-20 | Canon Inc | Information processing device and method |
| CN103714549A (en)* | 2013-12-30 | 2014-04-09 | 南京大学 | Stereo image object segmentation method based on rapid local matching |
| CN103763495A (en)* | 2014-02-11 | 2014-04-30 | 上海大象无形展览展示有限公司 | L-shaped vertical curtain and ground curtain 3D projection display method |
| CN104020177A (en)* | 2014-06-26 | 2014-09-03 | 重庆大学 | Dual-CCD (Charge Coupled Device) scanning imaging detection method for continuous casting slab surface defects |
| CN104809755A (en)* | 2015-04-09 | 2015-07-29 | 福州大学 | Single-image-based cultural relic three-dimensional reconstruction method |
| US20160014391A1 (en)* | 2014-07-08 | 2016-01-14 | Zspace, Inc. | User Input Device Camera |
| CN105869103A (en)* | 2016-03-25 | 2016-08-17 | 南京信息职业技术学院 | Encryption and decryption method of three-dimensional grid model based on content |
| CN106131530A (en)* | 2016-08-26 | 2016-11-16 | 万象三维视觉科技（北京）有限公司 | A kind of bore hole 3D virtual reality display system and methods of exhibiting thereof |
| US20180101777A1 (en)* | 2016-10-12 | 2018-04-12 | Anuthep Benja-Athon | EM Oracle |
| CN107993230A (en)* | 2017-12-18 | 2018-05-04 | 辽宁师范大学 | Distorted image detection method based on triangle gridding comprehensive characteristics |
| CN108573524A (en)* | 2018-04-12 | 2018-09-25 | 东南大学 | Interactive real-time autostereoscopic display method based on rendering pipeline |
| CN109272567A (en)* | 2018-11-29 | 2019-01-25 | 成都四方伟业软件股份有限公司 | Model optimization method and apparatus |
| CN110414101A (en)* | 2019-07-15 | 2019-11-05 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | A simulation scene measurement method, accuracy measurement method and system |
| CN111210521A (en)* | 2020-01-06 | 2020-05-29 | 江南造船(集团)有限责任公司 | Ship giant data model lightweight method, system, terminal and medium for VR |
| CN111986307A (en)* | 2019-05-24 | 2020-11-24 | 奥多比公司 | 3D object reconstruction using photometric grid representation |
| CN112307553A (en)* | 2020-12-03 | 2021-02-02 | 之江实验室 | A Method of Extracting and Simplifying 3D Road Model |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111563956A (en)* | 2020-04-28 | 2020-08-21 | 珠海市魅族科技有限公司 | A three-dimensional display method, device, equipment and medium of a two-dimensional picture |
| CN113012270A (en)* | 2021-03-24 | 2021-06-22 | 纵深视觉科技(南京)有限责任公司 | Stereoscopic display method and device, electronic equipment and storage medium |
- 2021
- 2021-03-24CNCN202110315690.XApatent/CN113012270A/enactivePending
- 2022
- 2022-03-16WOPCT/CN2022/081123patent/WO2022199437A1/ennot_activeCeased
- 2022-03-16ATATGM9028/2022Upatent/AT18289U1/enunknown
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040102938A1 (en)* | 2002-11-21 | 2004-05-27 | Mitsubishi Denki Kabushiki Kaisha | Method and device for creating analytical mesh data |
| CN102801994A (en)* | 2012-06-19 | 2012-11-28 | 西北工业大学 | Physical image information fusion device and method |
| JP2014032473A (en)* | 2012-08-01 | 2014-02-20 | Canon Inc | Information processing device and method |
| CN103714549A (en)* | 2013-12-30 | 2014-04-09 | 南京大学 | Stereo image object segmentation method based on rapid local matching |
| CN103763495A (en)* | 2014-02-11 | 2014-04-30 | 上海大象无形展览展示有限公司 | L-shaped vertical curtain and ground curtain 3D projection display method |
| CN104020177A (en)* | 2014-06-26 | 2014-09-03 | 重庆大学 | Dual-CCD (Charge Coupled Device) scanning imaging detection method for continuous casting slab surface defects |
| US20160014391A1 (en)* | 2014-07-08 | 2016-01-14 | Zspace, Inc. | User Input Device Camera |
| CN104809755A (en)* | 2015-04-09 | 2015-07-29 | 福州大学 | Single-image-based cultural relic three-dimensional reconstruction method |
| CN105869103A (en)* | 2016-03-25 | 2016-08-17 | 南京信息职业技术学院 | Encryption and decryption method of three-dimensional grid model based on content |
| CN106131530A (en)* | 2016-08-26 | 2016-11-16 | 万象三维视觉科技（北京）有限公司 | A kind of bore hole 3D virtual reality display system and methods of exhibiting thereof |
| US20180101777A1 (en)* | 2016-10-12 | 2018-04-12 | Anuthep Benja-Athon | EM Oracle |
| CN107993230A (en)* | 2017-12-18 | 2018-05-04 | 辽宁师范大学 | Distorted image detection method based on triangle gridding comprehensive characteristics |
| CN108573524A (en)* | 2018-04-12 | 2018-09-25 | 东南大学 | Interactive real-time autostereoscopic display method based on rendering pipeline |
| CN109272567A (en)* | 2018-11-29 | 2019-01-25 | 成都四方伟业软件股份有限公司 | Model optimization method and apparatus |
| CN111986307A (en)* | 2019-05-24 | 2020-11-24 | 奥多比公司 | 3D object reconstruction using photometric grid representation |
| CN110414101A (en)* | 2019-07-15 | 2019-11-05 | 中国商用飞机有限责任公司北京民用飞机技术研究中心 | A simulation scene measurement method, accuracy measurement method and system |
| CN111210521A (en)* | 2020-01-06 | 2020-05-29 | 江南造船(集团)有限责任公司 | Ship giant data model lightweight method, system, terminal and medium for VR |
| CN112307553A (en)* | 2020-12-03 | 2021-02-02 | 之江实验室 | A Method of Extracting and Simplifying 3D Road Model |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022199437A1 (en)* | 2021-03-24 | 2022-09-29 | 纵深视觉科技(南京)有限责任公司 | Method and apparatus for stereoscopic display, and electronic device and storage medium |
| CN113256803A (en)* | 2021-06-23 | 2021-08-13 | 合肥量圳建筑科技有限公司 | Data compression method, device, equipment and storage medium |
| CN113963100A (en)* | 2021-10-25 | 2022-01-21 | 广东工业大学 | A 3D model rendering method and system for a digital twin simulation scene |
| CN113963100B (en)* | 2021-10-25 | 2022-04-29 | 广东工业大学 | A 3D model rendering method and system for a digital twin simulation scene |
| CN114064028A (en)* | 2021-11-04 | 2022-02-18 | 深圳航天智慧城市系统技术研究院有限公司 | Spatial analysis modeling method based on online visual editing |
| CN114461959A (en)* | 2021-12-22 | 2022-05-10 | 北京驭瓴科技有限公司 | WEB terminal online display method, device and electronic equipment of BIM data |
| CN114529623A (en)* | 2022-01-18 | 2022-05-24 | 深圳易可达科技有限公司 | Data display mode switching method, device, equipment and storage medium |
| WO2024205611A3 (en)* | 2022-05-13 | 2024-11-14 | President And Fellows Of Harvard College | Minimal memory differentiation |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022199437A1 (en) | 2022-09-29 |
| AT18289U1 (en) | 2024-08-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113012270A (en) | Stereoscopic display method and device, electronic equipment and storage medium | |
| CN102812497B (en) | Video providing device capable of providing subsequent experience video, video providing method | |
| CN111415422A (en) | Virtual object adjustment method and device, storage medium and augmented reality equipment | |
| CA2896240C (en) | System and method for role-switching in multi-reality environments | |
| CN107248194A (en) | A kind of CAE data three-dimensionals based on cloud computing show exchange method | |
| CN115191006B (en) | 3D model for displayed 2D elements | |
| CN105224288B (en) | Binocular three-dimensional method for rendering graph and related system | |
| CN103236074B (en) | A kind of 2D/3D image processing method and device | |
| CN104820497B (en) | A kind of 3D interactive display systems based on augmented reality | |
| WO2022191070A1 (en) | 3d object streaming method, device, and program | |
| WO2017113681A1 (en) | Video image processing method and apparatus based on virtual reality technology | |
| CN113099204A (en) | Remote live-action augmented reality method based on VR head-mounted display equipment | |
| WO2021204296A1 (en) | Remote display method for three-dimensional model, first terminal, electronic device and storage medium | |
| CN105898271A (en) | 360-degree panoramic video playing method, playing module and mobile terminal | |
| US20220358716A1 (en) | Method and apparatus for constructing a 3d geometry | |
| CN107005689B (en) | Digital video rendering | |
| CN105892643A (en) | Multi-interface unified display system and method based on virtual reality | |
| CN107562185B (en) | Light field display system based on head-mounted VR equipment and implementation method | |
| US11756260B1 (en) | Visualization of configurable three-dimensional environments in a virtual reality system | |
| CN112565883A (en) | Video rendering processing system and computer equipment for virtual reality scene | |
| CN206270882U (en) | A highly immersive virtual reality head-up display | |
| CN114928718A (en) | Video monitoring method and device, electronic equipment and storage medium | |
| CN114612602A (en) | Method and device for determining transparency, electronic equipment and storage medium | |
| CN115393494B (en) | Artificial intelligence-based city model rendering methods, devices, equipment and media | |
| CN204009857U (en) | A kind of for regulating and controlling the immersion what comes into a driver's copic viewing system of personnel's on-site supervision |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20210622 |