CN102306402A - Three-dimensional graph processing system of mobile visual media - Google Patents

Abstract

Translated fromChinese

本发明公开了一种移动可视媒体的三维图形处理系统，包括三维图形显示模块、新型光栅架构模块、图像逆细分模块及图形传输模块，三维图形显示模块获得并计算物体在三维坐标系下的几何位置和颜色信息，对计算出来的信息进行插值，将纹理图像映射到模型上，输出图像；新型光栅架构模块采用新型多重采样方法、高速纹理缓存方法、对移动图像进行分块着色、纹理过滤和截取，降低对外部存储器存取次数；图像细分模块采用细分小波变换技术，基于Lifting技术构造保持细分曲面规则和性质，对三维图像进行曲面造型细分；图形传输模块通过组建通信协议栈，优化支持多种标准通讯协议。本发明对移动可视媒体上的几何图形进行简化，快速显示，功耗低，传输稳定。

The invention discloses a three-dimensional graphics processing system for mobile visual media, which includes a three-dimensional graphics display module, a new grating structure module, an image inverse subdivision module and a graphics transmission module. The geometric position and color information of the image are interpolated, the texture image is mapped to the model, and the image is output; the new raster architecture module adopts a new multi-sampling method, a high-speed texture cache method, block coloring for moving images, and texture Filtering and interception reduce the number of accesses to external memory; the image subdivision module adopts subdivision wavelet transform technology, and based on the Lifting technology, the subdivision surface rules and properties are maintained, and the surface modeling and subdivision of the 3D image is carried out; the graphics transmission module communicates Protocol stack, optimized to support multiple standard communication protocols. The invention simplifies the geometric figure on the mobile visual medium, displays quickly, has low power consumption and stable transmission.

Description

Translated fromChinese

一种移动可视媒体的三维图形处理系统A 3D Graphics Processing System for Mobile Visual Media

技术领域technical field

本发明涉及移动可视媒体领域，尤其涉及一种移动可视媒体的三维图形处理系统。The invention relates to the field of mobile visual media, in particular to a three-dimensional graphics processing system for mobile visual media.

背景技术Background technique

现代人类的生活环境如此纷繁复杂，其中存在着各式各样、海量的可视媒体，不同的可视媒体承载着不同的可视信息。而移动可视媒体主要是指利用数字广播电视地面传输技术播出、以满足流动人群的视听需求为主的新型媒体。由于移动可视媒体的独特性，对图像快速显示、数据传输具有较大要求，三维图形将大大增强数字图像的真实感表现，对比于二维图形，三维图形拥有更加丰富的三维世界的信息，现有的移动可视媒体，内容匮乏，显示效果较差，显示信号不稳定，数据传输能力一般，因此，在可视媒体领域里，亟待一种移动可视媒体的三维图形处理系统，来实现图形的简化、提高显示效果，降低功耗，提高移动网络的图形图像传输质量。The living environment of modern human beings is so complicated, in which there are various and massive visual media, and different visual media carry different visual information. The mobile visual media mainly refers to the new media that utilizes digital radio and television terrestrial transmission technology to meet the audio-visual needs of mobile people. Due to the uniqueness of mobile visual media, there are great requirements for fast image display and data transmission. Three-dimensional graphics will greatly enhance the realism of digital images. Compared with two-dimensional graphics, three-dimensional graphics have richer information about the three-dimensional world. The existing mobile visual media lacks content, poor display effect, unstable display signal, and general data transmission capability. Therefore, in the field of visual media, a three-dimensional graphics processing system for mobile visual media is urgently needed to realize Simplify the graphics, improve the display effect, reduce power consumption, and improve the quality of graphics and image transmission in the mobile network.

发明内容Contents of the invention

本发明的目的是提供一种移动可视媒体的三维图形处理系统，在移动三维图形处理方面，解决三维图形的简化和传输问题，实现图形在移动可视媒体终端上快速显示，提高显示效果和降低运行功耗，提高传输能力。The purpose of the present invention is to provide a three-dimensional graphics processing system for mobile visual media. In terms of mobile three-dimensional graphics processing, it solves the problem of simplification and transmission of three-dimensional graphics, realizes fast display of graphics on mobile visual media terminals, improves display effect and Reduce operating power consumption and improve transmission capacity.

为实现上述目的，本发明提供了一种移动可视媒体的三维图形处理系统，包括三维图形显示模块、新型光栅架构模块、图像逆细分模块及图形传输模块，所述三维图形显示模块包括几何处理模块及渲染处理模块，所述几何处理模块获得并计算物体在三维坐标系下的几何位置和颜色信息，所述渲染处理模块对计算出来的信息进行插值，将纹理图像映射到模型上，在可视媒体上输出图像；所述新型光栅架构模块采用新型多重采样方法、高速纹理缓存方法、对移动图像进行分块着色、纹理过滤和截取，实现在每个时钟周期中，降低对外部存储器存取次数；所述图像细分模块采用细分小波变换技术，基于Lifting技术构造保持细分曲面规则和性质，对三维图像进行曲面造型细分；所述图形传输模块通过组建通信协议栈，优化支持HTTP、TCP/IP、SLIP、PPP、FTP、Telnet和SNMP等标准通讯协议。In order to achieve the above object, the present invention provides a three-dimensional graphics processing system for mobile visual media, including a three-dimensional graphics display module, a new grating architecture module, an image inverse subdivision module and a graphics transmission module, and the three-dimensional graphics display module includes a geometric processing module and rendering processing module, the geometric processing module obtains and calculates the geometric position and color information of the object in the three-dimensional coordinate system, the rendering processing module interpolates the calculated information, maps the texture image to the model, and Output images on visual media; the new raster architecture module adopts a new multi-sampling method, a high-speed texture caching method, performs block coloring, texture filtering and interception on moving images, and realizes that in each clock cycle, the external storage memory is reduced. The number of times is taken; the image subdivision module adopts the subdivision wavelet transform technology, and maintains the subdivision surface rules and properties based on the Lifting technology structure, and carries out surface modeling subdivision to the three-dimensional image; the graphics transmission module optimizes support by setting up a communication protocol stack Standard communication protocols such as HTTP, TCP/IP, SLIP, PPP, FTP, Telnet and SNMP.

较佳地，所述的移动可视媒体的三维图形处理系统，还包括异种网络网格传输模块，所述异种网络网格传输模块采用嵌入式网格编码方法，将网格转换成嵌入式位流，实现有线到无限网络环境下的三维几何图形传输。Preferably, the three-dimensional graphics processing system for mobile visual media further includes a heterogeneous network grid transmission module, and the heterogeneous network grid transmission module uses an embedded grid coding method to convert the grid into an embedded bit stream to realize the transmission of 3D geometric figures in wired to wireless network environment.

上述技术方案可以看出，本发明提供的移动可视媒体的三维图形处理系统，利用三维图形显示模块对图形或图像进行简化，其新型光栅化架构模块，通过采用新型多重采样方法、高速纹理缓存方法、分块着色技术纹理过滤和截取技术，结合硬件的处理能力，在每个时钟周期中，降低对外部存储器存取次数，从而降低功耗。图像逆细分模块除了生成效率高外，对于减小误差，提高图形显示质量，便于移动网络的传输与移动可视媒体的显示等方面有着重要的贡献，本发明对移动可视媒体上的几何图形进行简化，快速显示等优化，降低系统运行功耗，提高图形传输能力，增强显示效果。It can be seen from the above technical solutions that the three-dimensional graphics processing system for mobile visual media provided by the present invention uses a three-dimensional graphics display module to simplify graphics or images, and its new rasterization architecture module uses a new multi-sampling method, high-speed texture cache The method, block coloring technology, texture filtering and interception technology, combined with the processing capability of the hardware, reduces the number of accesses to the external memory in each clock cycle, thereby reducing power consumption. In addition to high generation efficiency, the image inverse subdivision module has important contributions to reducing errors, improving the quality of graphic display, facilitating the transmission of mobile networks and the display of mobile visual media. Graphics are simplified, optimized for fast display, etc., reducing system power consumption, improving graphics transmission capabilities, and enhancing display effects.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其它的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

图1是本发明实施例的移动可视媒体的三维图形处理系统的结构示意图；FIG. 1 is a schematic structural diagram of a three-dimensional graphics processing system for mobile visual media according to an embodiment of the present invention;

具体实施方式Detailed ways

下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

本发明的目的是提供一种移动可视媒体的三维图形处理系统，在移动三维图形处理方面，解决三维图形的简化和传输问题，实现图形在移动可视媒体终端上快速显示，提高显示效果和降低运行功耗，提高传输能力。下面结合说明书附图来说明本发明的具体实施方式。The purpose of the present invention is to provide a three-dimensional graphics processing system for mobile visual media. In terms of mobile three-dimensional graphics processing, it solves the problem of simplification and transmission of three-dimensional graphics, realizes fast display of graphics on mobile visual media terminals, improves display effect and Reduce operating power consumption and improve transmission capacity. The specific implementation manners of the present invention will be described below in conjunction with the accompanying drawings.

如图1所示，本发明提供了一种移动可视媒体的三维图形处理系统，包括三维图形显示模块、新型光栅架构模块、图像逆细分模块及图形传输模块，所述三维图形显示模块包括几何处理模块及渲染处理模块，所述几何处理模块获得并计算物体在三维坐标系下的几何位置和颜色信息，所述渲染处理模块对计算出来的信息进行插值，将纹理图像映射到模型上，在可视媒体上输出图像；在几何处理和渲染阶段中，均结合移动图形计算中的实际背景，根据图形、图像的表示方法，研究相应的图形真实感计算的快速算法，节省计算时间，节约能耗。与在PC机上的相应方法不同的是，移动数据终端上的显示界面大小和所用电源都受限，因此需要提供比PC更高的分辨率，来满足人们对于更高质量的移动图形显示方法的需求。所述新型光栅架构模块采用新型多重采样方法、高速纹理缓存方法、对移动图像进行分块着色、纹理过滤和截取，实现在每个时钟周期中，降低对外部存储器存取次数；所述图像细分模块采用细分小波变换技术，基于Lifting技术构造保持细分曲面规则和性质，对三维图像进行曲面造型细分；所述图形传输模块通过组建通信协议栈，优化支持HTTP、TCP/IP、SLIP、PPP、FTP、Telnet和SNMP等标准通讯协议。本发明的移动可视媒体的三维图形处理系统所处的计算机网络环境中，以中央服务器、固定仿真计算终端群为中心，移动可视媒体终端将随时动态地加入到该仿真网络中，以适应庞大的服务平台，动态变化的计算网络，复杂仿真协同工作的要求。针对GSM/GPRS、3G移动通讯协议标准，结合移动终端特性，扩展移动数据终端上的无线通讯协议，在支持GSM协议分组交换方式的编解码和多线程技术研究方面上，实现GSM/GPRS无线通讯底层软件，完成无线通话和数据传输底层数据交换与传输，优化数据信道使用效率。配合底层的无线通讯协议，研究简化和优化相关的底层通信协议，通过组建通信协议栈，优化支持HTTP、TCP/IP、SLIP、PPP、FTP、Telnet和SNMP等标准通讯协议。As shown in Figure 1, the present invention provides a three-dimensional graphics processing system for mobile visual media, including a three-dimensional graphics display module, a new grating architecture module, an image inverse subdivision module and a graphics transmission module, and the three-dimensional graphics display module includes a geometry processing module and a rendering processing module, the geometry processing module obtains and calculates the geometric position and color information of the object in the three-dimensional coordinate system, the rendering processing module interpolates the calculated information, and maps the texture image to the model, Output images on visual media; in the geometric processing and rendering stages, combined with the actual background in mobile graphics computing, according to the representation methods of graphics and images, research the corresponding fast algorithms for graphic realism calculations, saving computing time and saving energy consumption. Different from the corresponding method on the PC, the size of the display interface and the power used on the mobile data terminal are limited, so it is necessary to provide a higher resolution than that of the PC to meet people's needs for a higher-quality mobile graphics display method. need. The new raster architecture module adopts a new multi-sampling method, a high-speed texture cache method, block coloring, texture filtering and interception for moving images, so as to reduce the number of accesses to external memory in each clock cycle; the image detail The sub-module adopts the subdivision wavelet transform technology, and based on the Lifting technology, the subdivision surface rules and properties are maintained, and the surface modeling of the 3D image is subdivided; the graphics transmission module is optimized to support HTTP, TCP/IP, and SLIP by building a communication protocol stack , PPP, FTP, Telnet and SNMP and other standard communication protocols. In the computer network environment where the three-dimensional graphics processing system of the mobile visual media of the present invention is located, centering on the central server and the fixed simulation computing terminal group, the mobile visual media terminals will be dynamically added to the simulation network at any time to adapt Huge service platform, dynamically changing computing network, complex simulation collaborative work requirements. Aiming at the GSM/GPRS and 3G mobile communication protocol standards, combined with the mobile terminal characteristics, expand the wireless communication protocol on the mobile data terminal, and realize the GSM/GPRS wireless communication in terms of supporting the coding and decoding of the GSM protocol packet switching mode and multi-thread technology research The underlying software completes the underlying data exchange and transmission for wireless calls and data transmission, and optimizes the efficiency of data channel usage. Cooperate with the underlying wireless communication protocol, study the simplification and optimization of the relevant underlying communication protocol, and optimize the support of standard communication protocols such as HTTP, TCP/IP, SLIP, PPP, FTP, Telnet and SNMP by building a communication protocol stack.

较佳地，所述的移动可视媒体的三维图形处理系统，还包括异种网络网格传输模块，所述异种网络网格传输模块采用嵌入式网格编码方法，将网格转换成嵌入式位流，实现有线到无限网络环境下的三维几何图形传输。在多媒体网络传输过程中，因为有线链路的拥塞或无线链路的信道衰退会造成信道丢失，许多研究工作多集中于在现有图像/视频标准(如MPEG-4，H.263+，H.263++)增加差错还原机制与信道编码，以解决丢包或信道衰退。但基于有线到无线网络环境下的三维几何图形传输的研究工作并不多，本发明技术防范基于此提出一种嵌入式网格编码方法，将网格转换成嵌入式位流(embedded bitstream)，这为异种网络网格传输提供了端到端解决方案。Preferably, the three-dimensional graphics processing system for mobile visual media further includes a heterogeneous network grid transmission module, and the heterogeneous network grid transmission module uses an embedded grid coding method to convert the grid into an embedded bit stream to realize the transmission of 3D geometric figures in wired to wireless network environment. In the process of multimedia network transmission, because of the channel loss caused by the congestion of the wired link or the channel degradation of the wireless link, many research works focus on the existing image/video standards (such as MPEG-4, H. .263++) add error recovery mechanism and channel coding to solve packet loss or channel fading. However, there are not many research works based on the transmission of three-dimensional geometric figures under the wired to wireless network environment. The technical prevention of the present invention proposes an embedded grid coding method based on this, and converts the grid into an embedded bitstream. This provides an end-to-end solution for heterogeneous network mesh transmission.

细分方法是计算机图形学曲线曲面造型中非常有效的方法，一个粗的曲线曲面模型可以通过细分迭代得到精细的模型。本发明技术方案所提出的细分逆算法是一个快速的几何图形简化算法，该方法将任意给定的复杂模型，运用快速分解生成一系列分辨率递减的累进模型，在分解过程中保留重构原光滑模型的细节信息。这样，只要将最粗模型及一系列数值较小的细节信息记录下来，即形成模型的累进表示。该方法除了生成效率高外，对于减小误差，提高图形显示质量，便于移动网络的传输与移动终端的显示等方面有着重要的贡献。The subdivision method is a very effective method in computer graphics curve and surface modeling. A coarse curve and surface model can be subdivided and iterated to obtain a fine model. The subdivision inverse algorithm proposed by the technical solution of the present invention is a fast geometric figure simplification algorithm. This method uses fast decomposition to generate a series of progressive models with decreasing resolution, and preserves the reconstruction during the decomposition process. Details of the original smooth model. In this way, as long as the roughest model and a series of details with smaller values are recorded, a progressive representation of the model is formed. In addition to high generation efficiency, this method has important contributions to reducing errors, improving graphic display quality, and facilitating mobile network transmission and mobile terminal display.

较佳地，本发明的技术方案还包括构建网络条件下的多媒体数据局部请求访问技术，或者称为“隧道”技术，这种技术可以将图像、图形数据分解成若干子部分，根据传输的要求，进行数据的局部获取和恢复。Preferably, the technical solution of the present invention also includes constructing a multimedia data local request access technology under network conditions, or called "tunnel" technology, which can decompose image and graphic data into several sub-parts, and according to transmission requirements , for partial acquisition and recovery of data.

上述技术方案可以看出，本发明提供的移动可视媒体的三维图形处理系统，利用三维图形显示模块对图形或图像进行简化，其新型光栅化架构模块，通过采用新型多重采样方法、高速纹理缓存方法、分块着色技术纹理过滤和截取技术，结合硬件的处理能力，在每个时钟周期中，降低对外部存储器存取次数，从而降低功耗。图像逆细分模块除了生成效率高外，对于减小误差，提高图形显示质量，便于移动网络的传输与移动可视媒体的显示等方面有着重要的贡献，本发明对移动可视媒体上的几何图形进行简化，快速显示等优化，降低系统运行功耗，提高图形传输能力，增强显示效果。It can be seen from the above technical solutions that the three-dimensional graphics processing system for mobile visual media provided by the present invention uses a three-dimensional graphics display module to simplify graphics or images, and its new rasterization architecture module uses a new multi-sampling method, high-speed texture cache The method, block coloring technology, texture filtering and interception technology, combined with the processing capability of the hardware, reduces the number of accesses to the external memory in each clock cycle, thereby reducing power consumption. In addition to high generation efficiency, the image inverse subdivision module has important contributions to reducing errors, improving the quality of graphic display, facilitating the transmission of mobile networks and the display of mobile visual media. Graphics are simplified, optimized for fast display, etc., reducing system power consumption, improving graphics transmission capabilities, and enhancing display effects.

以上对本发明实施例所提供的一种移动可视媒体的三维图形处理系统，进行了详细介绍，本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想；同时，对于本领域的一般技术人员，依据本发明的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本发明的限制。The three-dimensional graphics processing system of a mobile visual media provided by the embodiment of the present invention has been introduced in detail above. In this paper, specific examples are used to illustrate the principle and implementation of the present invention. The description of the above embodiment is only used To help understand the method of the present invention and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and scope of application. In summary, this specification The content should not be construed as a limitation of the invention.

Claims (2)

1. the three-dimensional picture disposal system of mobile visible medium; It is characterized in that; Comprise three-dimensional picture display module, novel grating structure module, image contrary segmentation module and figure transport module; Said three-dimensional picture display module comprises the geometric manipulations module and plays up processing module; Said geometric manipulations module obtains and geometric position and the colouring information of computing object under three-dimensional system of coordinate; The said processing module of playing up is carried out interpolation to the information of calculating; Texture image is mapped on the model output image on visual media; Said novel grating structure module adopts the novel multiple method of sampling, texture caching method, carries out to moving image that piecemeal is painted, texture filtering and intercepting, is implemented in each clock period, reduces the external memory access number of times; Said image segmentation module adopts the segmentation wavelet transformation technique, keeps subdivision curved surface rule and character based on the Lifting technical construction, and 3-D view is carried out the surface modeling segmentation; Said figure transport module is optimized standard communications protocol such as supporting HTTP, TCP/IP, SLIP, PPP, FTP, Telnet and SNMP through setting up communication protocol stack.

2. the three-dimensional picture disposal system of mobile visible medium as claimed in claim 1; It is characterized in that; Also comprise heterogeneous network grid transport module; Said heterogeneous network grid transport module adopts embedded lattice encoding method; Convert grid to embedded bit stream, realize wired three-dimensional geometric shapes transmission of arriving under the infinite network environment.

Images