技术领域technical field
本发明涉及数据显示技术领域，具体涉及一种采用LED 3D屏幕的CAVE显示系统及方法。The invention relates to the technical field of data display, in particular to a CAVE display system and method using an LED 3D screen.
背景技术Background technique
CAVE系统可以应用于任何具有沉浸感需求的虚拟仿真应用领域。例如，虚拟设计与制造，虚拟演示，协同规划等等，应用十分广泛。现有的大部分CAVE系统中，虚拟显示空间的墙壁通常由背投影墙组成。地面部分的显示除了可以进行背投，还可以在显示空间上方安置投影仪投影到地面上。而随着技术的发展，也出现了由LCD 3D拼接屏或大尺寸LCD 3D屏代替投影显示的技术。但是仍然缺少使用LED 3D屏幕作为CAVE系统显示的方式。The CAVE system can be applied to any virtual simulation application field that requires immersion. For example, virtual design and manufacturing, virtual demonstration, collaborative planning, etc., are widely used. In most existing CAVE systems, the walls of the virtual display space are usually composed of rear projection walls. In addition to rear projection, the display of the ground part can also be projected onto the ground by placing a projector above the display space. With the development of technology, the technology of replacing projection display by LCD 3D splicing screen or large-size LCD 3D screen has also appeared. But still missing the way to use the LED 3D screen as a display for the CAVE system.
现有技术中两种常见的CAVE系统。There are two common CAVE systems in the prior art.
(一)基于背投影墙的CAVE系统(1) CAVE system based on rear projection wall
CAVE系统虚拟显示空间是由3个面以上(含3面)硬质背投影墙组成。系统利用多通道视景同步技术，在投影墙上显示整个三维场景内容。用户站在虚拟显示空间内，并佩戴用于观看影墙三维成像的3D眼镜，其中3D眼镜上附着红外标记点。在虚拟显示空间的角落上分别放置红外摄像头。由于3D眼镜上红外标记点的位置和用户的人眼位置相距不大，对比整个系统的规格，可以忽略不计，从而系统利用红外摄像头获取红外标记点的位置参数以获取用户人眼的位置参数。系统根据获得的用户人眼位置参数，调整影墙图像以匹配用户观看的当前位置(例如：离影墙近画面就会放大，离影墙远画面就会缩小)。并且结合画面校准系统，校准折角处的画面，使显示图像不会产生畸变。The virtual display space of the CAVE system is composed of more than 3 (including 3) hard rear projection walls. The system uses multi-channel visual synchronization technology to display the entire 3D scene content on the projection wall. The user stands in the virtual display space and wears 3D glasses for viewing the 3D imaging of the shadow wall, where infrared markers are attached to the 3D glasses. Infrared cameras are respectively placed on the corners of the virtual display space. Since the position of the infrared marker on the 3D glasses is not far from the position of the user's eye, it is negligible compared to the specifications of the entire system. Therefore, the system uses the infrared camera to obtain the position parameter of the infrared marker to obtain the position parameter of the user's eye. According to the user's eye position parameters obtained, the system adjusts the image of the video wall to match the current position viewed by the user (for example, if you are closer to the video wall, the picture will be enlarged, and if you are far away from the video wall, the picture will be reduced). And combined with the screen calibration system, the screen at the corner is calibrated so that the displayed image will not be distorted.
(二)基于LCD 3D拼接屏或基于大尺寸LCD屏的CAVE系统(2) CAVE system based on LCD 3D splicing screen or large-size LCD screen
该技术原理和技术(一)基本一致，但虚拟显示空间由背投影墙替换成LCD 3D拼接屏或大尺寸LCD屏构成(除地屏)，并且改变成显示相匹配的渲染通道和拼接处理器。The principle of this technology is basically the same as that of technology (1), but the virtual display space is formed by replacing the rear projection wall with an LCD 3D splicing screen or a large-size LCD screen (except the ground screen), and it is changed to display matching rendering channels and splicing processors .
然而，现有技术中的CAVE系统存在以下缺点：However, the CAVE system in the prior art has the following disadvantages:
技术(一)中由背投影墙构成虚拟显示的CAVE系统需要在环境较暗才能看清，对环境光线要求高。并且显示画面的色彩饱和度不高，观看效果不佳。投影机寿命较短。In technology (1), the virtual display CAVE system composed of a rear projection wall needs to be seen clearly in a dark environment, which requires high ambient light. Moreover, the color saturation of the display screen is not high, and the viewing effect is not good. The projector has a short lifespan.
技术(二)中基于LCD 3D拼接屏或基于大尺寸LCD屏的CAVE系统，虽然比起背投影墙不需要对环境光线有过高的要求，色彩饱和度也更高，但是长期使用，会造成单元间亮度与色彩衰减不一致，并不可恢复。此外LCD屏间还有物理拼缝，影响观看效果。大尺寸LCD屏还存在不好运输的问题。In technology (2), the CAVE system based on LCD 3D splicing screen or large-size LCD screen does not require excessive ambient light and has higher color saturation than the rear projection wall, but long-term use will cause Inconsistent brightness and color attenuation between cells is not recoverable. In addition, there are physical seams between the LCD screens, which affect the viewing effect. Large-size LCD screens also have the problem of poor transportation.
随着显示屏制造技术的提高，出现了LED 3D显示屏。LED 3D显示屏自体发光，不受环境光线限制；显示画面色彩饱和度高、显示屏间拼接无缝、使用寿命长。如果它可应用于CAVE系统中，就可以大大减少现有CAVE系统中各种终端显示的局限性。With the improvement of display manufacturing technology, LED 3D display has appeared. The LED 3D display is self-illuminating and is not limited by ambient light; the display screen has high color saturation, seamless splicing between the display screens, and a long service life. If it can be applied to the CAVE system, it can greatly reduce the limitations of various terminal displays in the existing CAVE system.
发明内容Contents of the invention
为解决上述技术问题，本发明提供了一种采用LED 3D屏幕的CAVE系统显示方法，该方法包括以下步骤：In order to solve the above technical problems, the present invention provides a CAVE system display method using an LED 3D screen, the method comprising the following steps:
1)采集3D眼镜上红外标记点的坐标位置；1) Collect the coordinate position of the infrared marker point on the 3D glasses;
2)利用所述坐标位置估算出用户双眼的位置；2) Estimate the position of the user's eyes by using the coordinate position;
3)根据所述位置计算得到相对所述3D眼镜显示的两组画面；3) Obtaining two groups of pictures displayed relative to the 3D glasses according to the position calculation;
4)在LED 3D屏幕上交替显示所述两组画面；4) alternately displaying the two groups of pictures on the LED 3D screen;
5)对所述3D眼镜进行左、右镜片开关切换，切换频率与所述两组画面交替显示的切换频率相配合，使用户体验到沉浸式立体视觉虚拟环境。5) switch the left and right lenses of the 3D glasses, and the switching frequency matches the switching frequency of the alternate display of the two groups of images, so that the user can experience an immersive stereoscopic virtual environment.
根据本发明的实施方式，优选的，所述步骤2)中将所述用户双眼的位置发送给多通道控制服务器。According to an embodiment of the present invention, preferably, in the step 2), the positions of the eyes of the user are sent to the multi-channel control server.
根据本发明的实施方式，优选的，所述步骤4)中所述多通道控制服务器根据所述用户双眼的位置生成四个LED 3D屏幕的画面控制信号，将四个LED 3D屏幕的画面控制信号分别发送给四个通道渲染服务器，以实现把校准好的两组画面连续交替地显示在所述四个LED 3D屏幕上。According to an embodiment of the present invention, preferably, the multi-channel control server in the step 4) generates picture control signals of four LED 3D screens according to the positions of the eyes of the user, and converts the picture control signals of the four LED 3D screens to Send them to the four channel rendering servers respectively, so as to continuously and alternately display the calibrated two sets of pictures on the four LED 3D screens.
根据本发明的实施方式，优选的，所述步骤5)中，所述对所述3D眼镜进行左、右镜片开关切换具体为：左眼画面出现，3D眼镜左眼镜片打开，右眼镜片关闭；右眼画面出现，3D眼镜右眼镜片打开，左眼镜片关闭。According to an embodiment of the present invention, preferably, in the step 5), the switching between the left and right lenses of the 3D glasses is specifically: the left-eye image appears, the left-eye lens of the 3D glasses is turned on, and the right-eye lens is turned off ; The right-eye image appears, the right-eye lens of the 3D glasses is turned on, and the left-eye lens is turned off.
根据本发明的实施方式，优选的，通过IR发射器接收所述多通道控制服务器发送的同步信号，并根据该画同步信号发射红外信号，所述3D眼镜根据所述红外信号控制对所述3D眼镜左、右镜片的切换频率。According to the embodiment of the present invention, preferably, the synchronization signal sent by the multi-channel control server is received by the IR transmitter, and an infrared signal is emitted according to the synchronization signal of the picture, and the 3D glasses control the 3D glasses according to the infrared signal. The switching frequency of the left and right lenses of the glasses.
根据本发明的实施方式，优选的，显示在所述LED 3D屏幕上的画面由所述CAVE系统的虚拟环境中的两个虚拟摄像机模拟人的左、右眼拍摄已有素材得到的两组画面而组成。According to an embodiment of the present invention, preferably, the pictures displayed on the LED 3D screen are two groups of pictures obtained by shooting existing materials with two virtual cameras in the virtual environment of the CAVE system simulating the left and right eyes of a person And composition.
为解决上述技术问题，本发明提供了一种采用LED 3D显示屏的CAVE显示系统，该系统包括：3D眼镜、IR发射器、多通道控制服务器、多个通道渲染服务器、多个LED 3D显示屏、网络交换机、动捕电脑和红外跟踪系统；In order to solve the above technical problems, the present invention provides a CAVE display system using LED 3D display screens, the system includes: 3D glasses, IR emitters, multi-channel control servers, multiple channel rendering servers, multiple LED 3D display screens , network switch, motion capture computer and infrared tracking system;
所述红外跟踪系统跟踪得到所述3D眼镜的坐标位置，并发送给所述网络交换机；The infrared tracking system tracks and obtains the coordinate position of the 3D glasses, and sends it to the network switch;
所述动捕电脑通过所述网络交换机获取所述坐标位置，得到用户双眼的位置参数；The motion capture computer obtains the coordinate position through the network switch, and obtains the position parameters of the user's eyes;
将所述位置参数通所述网络交换机传输给所述多通道控制服务器；transmitting the position parameter to the multi-channel control server through the network switch;
所述多通道控制服务器根据接收的位置参数，生成画面控制信号，分别发送给所述多个通道渲染服务器；The multi-channel control server generates picture control signals according to the received position parameters, and sends them to the multiple channel rendering servers respectively;
根据所述多个通道渲染服务器的控制，把校准好的两组画面图像，分别连续交替地显示在所述多个LED 3D显示屏上；According to the control of the plurality of channel rendering servers, the calibrated two groups of picture images are continuously and alternately displayed on the plurality of LED 3D display screens;
通过无线发射器接收所述多通道控制服务器发送的同步信号，并根据该画同步信号发射红外信号，所述3D眼镜根据所述红外信号控制对所述3D眼镜左、右镜片的切换频率，使用户体验到沉浸式立体视觉虚拟环境。Receive the synchronization signal sent by the multi-channel control server through the wireless transmitter, and transmit an infrared signal according to the synchronization signal, and the 3D glasses control the switching frequency of the left and right lenses of the 3D glasses according to the infrared signal, so that Users experience an immersive stereoscopic virtual environment.
根据本发明的实施方式，优选的，所述无线发射器为IR发射器。According to an embodiment of the present invention, preferably, the wireless transmitter is an IR transmitter.
根据本发明的实施方式，优选的，所述3D眼镜附有两个红外标记点，对应用户双眼，所述红外跟踪系统通过跟踪所述3D眼镜上的红外标记点获得3D眼镜的坐标位置，从而确定用户双眼的位置。According to an embodiment of the present invention, preferably, the 3D glasses are provided with two infrared marker points corresponding to the eyes of the user, and the infrared tracking system obtains the coordinate position of the 3D glasses by tracking the infrared marker points on the 3D glasses, thereby Determine the position of the user's eyes.
为解决上述技术问题，本发明提供了一种计算机存储介质，其包括计算机程序指令，当执行所述计算机程序指令时，执行上述方法之一。In order to solve the above technical problems, the present invention provides a computer storage medium, which includes computer program instructions, and when the computer program instructions are executed, one of the above methods is performed.
通过本发明的技术方案取得了以下技术效果：Obtained following technical effect by technical scheme of the present invention:
本发明区别于现有的CAVE系统，虚拟显示空间适用于光线较强的环境，可实际应用在明亮的室内环境，甚至室外环境；虚拟显示空间画面色彩饱和度高，显示屏间拼接无缝，给用户很好的观看效果；使用寿命长。The present invention is different from the existing CAVE system in that the virtual display space is suitable for environments with strong light, and can be practically applied in bright indoor environments and even outdoor environments; the virtual display space has high color saturation and seamless splicing between display screens. Give users a good viewing effect; long service life.
附图说明Description of drawings
图1是现有本发明系统构成图Fig. 1 is existing system structure diagram of the present invention
图2是本发明的控制流程图Fig. 2 is a control flowchart of the present invention
具体实施方式detailed description
<本发明的系统架构><System architecture of the present invention>
3D眼镜主要通过提高画面的快速刷新率(通常要达到120Hz)来实现3D效果，属于主动式3D技术,又叫时分法遮光技术或液晶分时技术。当3D信号输入到显示设备(诸如显示器、投影机等)后，图像便以帧序列的格式实现左右帧交替产生，通过红外发射器，蓝牙等无线方式将这些帧信号传输出去，负责接收的3D眼镜在刷新同步实现左右眼观看对应的图像，并且保持与2D视像相同的帧数，观众的两只眼睛看到快速切换的不同画面，并且在大脑中产生错觉(摄像机拍摄不出来效果)，便观看到立体影像。3D glasses mainly achieve 3D effects by increasing the fast refresh rate of the picture (usually up to 120Hz), which belongs to active 3D technology, also known as time-sharing shading technology or liquid crystal time-sharing technology. When the 3D signal is input to the display device (such as a monitor, projector, etc.), the image is generated alternately in the frame sequence format to achieve left and right frames, and these frame signals are transmitted through infrared transmitters, bluetooth and other wireless methods, responsible for receiving 3D The glasses are refreshed synchronously to realize the corresponding images viewed by the left and right eyes, and maintain the same frame number as the 2D video. The two eyes of the audience see different images that switch rapidly, and create an illusion in the brain (the camera cannot shoot the effect), You can watch stereoscopic images.
如图1，本发明的虚拟显示空间由四块LED 3D显示屏组成，LED 3D显示屏具有以下特点：自体发光、不受环境光线限制；显示画面色彩饱和度高、显示屏间拼接无缝、使用寿命长。在LED 3D显示屏的空间角落安置多个红外摄像头；摄像头的个数可以从至少3个到多个，具体根据具体需求而定，优选的，摄像头个数为八个。有若干红外标记点附着在3D眼镜上。每副3D眼镜具有左、右两个镜片，3D眼镜可根据接收的外部信号，分别实现对左、右3D眼镜镜片的打开和关闭，从而实现对左、右镜片的交替开关切换。此外还需要有四个独立的三维通道渲染服务器，多通道控制服务器，IR发射器，动捕电脑和红外跟踪系统以及网络交换机。所述多通道控制服务器用于接收用户双眼的位置信息，并根据该位置信息生成用于控制四个LED 3D显示屏的画面控制信号，并将四个画面控制信号发送给四个通道渲染服务器，以分别对所述四个LED 3D显示屏的显示进行控制。所述IR发射器放置在所述LED 3D显示屏组成的显示空间上方，与所述多通道控制服务器连接，接收所述多通道控制服务器发送的同步信号。所述IR发射器接收多通道控制服务器发送的同步信号，根据所述同步信号发射红外信号，3D眼镜根据IR发射器发送的红外信号，控制对3D眼镜左、右镜片开关切换的频率，以与在LED 3D显示屏上交替显示的画面图像频率相一致。需要说明的是，所述IR发射器仅属于一种优选的实施方式，在实际应用中可采用蓝牙、高频无线信号通讯的信号发射器与3D眼镜进行无线通讯，控制对3D眼镜左、右镜片开关切换的频率。As shown in Figure 1, the virtual display space of the present invention is composed of four LED 3D display screens. The LED 3D display screen has the following characteristics: self-illumination, not limited by ambient light; high color saturation of the display screen, seamless splicing between the display screens, long lasting. A plurality of infrared cameras are placed in the space corners of the LED 3D display screen; the number of cameras can be from at least 3 to more, depending on specific requirements, preferably, the number of cameras is eight. There are several infrared markers attached to the 3D glasses. Each pair of 3D glasses has left and right lenses, and the 3D glasses can respectively open and close the left and right 3D glasses lenses according to the external signal received, thereby realizing the alternate switching of the left and right lenses. In addition, four independent 3D channel rendering servers, multi-channel control servers, IR transmitters, motion capture computers and infrared tracking systems, and network switches are required. The multi-channel control server is used to receive the position information of the user's eyes, and generate picture control signals for controlling the four LED 3D display screens according to the position information, and send the four picture control signals to the four-channel rendering servers, to control the display of the four LED 3D display screens respectively. The IR emitter is placed above the display space formed by the LED 3D display screen, connected with the multi-channel control server, and receives the synchronization signal sent by the multi-channel control server. The IR emitter receives the synchronous signal sent by the multi-channel control server, and emits an infrared signal according to the synchronous signal, and the 3D glasses control the switching frequency of the left and right lens switches of the 3D glasses according to the infrared signal sent by the IR emitter, so as to be consistent with The frequency of the images displayed alternately on the LED 3D display is consistent. It should be noted that the IR transmitter is only a preferred implementation mode, and in practical applications, the signal transmitter of bluetooth or high-frequency wireless signal communication can be used for wireless communication with the 3D glasses to control the left and right of the 3D glasses. How often the mirror switch switches.
动捕电脑通过网络交换机获取由多个红外摄像头(优选为八个)得到3D眼镜上的红外标记点的位置参数，从而间接得到用户双眼的位置参数。在每个3D眼镜的镜框上设置两个距离固定的标记点，例如红外LED。红外摄像头获取的图像中，红外LED在绝大多数情况下是最亮的点，取合适阈值，就可以把LED位置与背景分开。获取的LED在图像中的位置，反映了用户相对于摄像头的水平角度和用户高度，而两个LED之间的距离，则反映了用户离摄像头的距离。这样，相当于获得了以摄像头为原点的圆柱坐标系内的用户坐标。结合摄像头自身位置坐标，经过简单的坐标系变换，就可以获得用户的绝对坐标。单台红外摄像头因为视角有限，无法完成360°位置捕捉的任务，可以用几台进行视场的拼接。也可以使用环带相机，则一台就可以实现360°位置捕捉的任务，原理与红外摄像头相同。利用电脑中的MotiveTracker，将用户双眼的位置参数信息通过交换机传输给四个通道渲染服务器和多通道控制服务器。所述多通道控制服务器与所述动捕电脑可整合在同一电脑中，也可以分别由不同的电脑实现其功能。The motion capture computer obtains the position parameters of the infrared marker points on the 3D glasses obtained by multiple infrared cameras (preferably eight) through the network switch, thereby indirectly obtaining the position parameters of the user's eyes. Two marking points with a fixed distance, such as infrared LEDs, are set on the frame of each 3D glasses. In the image captured by the infrared camera, the infrared LED is the brightest point in most cases. Taking an appropriate threshold can separate the position of the LED from the background. The acquired position of the LED in the image reflects the horizontal angle of the user relative to the camera and the height of the user, and the distance between two LEDs reflects the distance of the user from the camera. In this way, it is equivalent to obtaining the user coordinates in the cylindrical coordinate system with the camera as the origin. Combined with the camera's own position coordinates, the user's absolute coordinates can be obtained through a simple coordinate system transformation. A single infrared camera cannot complete the task of capturing a 360° position due to its limited viewing angle. Several cameras can be used to splice the field of view. You can also use a ring camera, and then one can achieve the task of 360° position capture, and the principle is the same as that of an infrared camera. Using the MotiveTracker in the computer, the position parameter information of the user's eyes is transmitted to the four-channel rendering server and the multi-channel control server through the switch. The multi-channel control server and the motion capture computer can be integrated in the same computer, or their functions can be realized by different computers.
显示在LED 3D屏幕上的画面图像实际上是由CAVE系统中虚拟环境中两个虚拟摄像机模拟人的左、右眼拍摄已有素材得到的两组画面而组成的。CAVE系统使用多摄像头红外定位系统通过拍摄附着在3D眼镜上的红外标记点，读取用户双眼的位置参数，以计算出系统中虚拟环境里两个摄像机的位置参数(两个虚拟摄像机模拟3D眼镜左、右镜片的位置)，从而得到用于分别显示于四个LED 3D显示屏的两组显示空间的图像。每个3D眼镜上均有两个距离固定的标记点，以供红外跟踪系统捕捉位置。CAVE系统再根据用户双眼位置的变化，分别调整显示空间的图像以匹配用户观看的当前位置(例如：离显示屏近画面就会放大，离显示屏远画面就会缩小)。并且结合画面校准系统，校准折角处的画面，使显示空间图像不会产生畸变。其中显示空间图像是由四个独立的三维渲染服务来输出显示的。CAVE系统把已校准好的两组画面，连续交替地显示在LED 3D显示屏上。同时，3D眼镜配合这个连续交替显示的画面图像进行左右镜片的切换：左眼画面出现，3D眼镜左眼镜片就打开，右眼镜片就关闭；右眼画面出现，3D眼镜右眼镜片就打开，左眼镜片就关闭。为了使左、右眼画面的切换和3D眼镜镜片的切换同步，把IR发射器放置在显示空间上方，连接多通道控制服务器，和3D眼镜，配合使用。The screen image displayed on the LED 3D screen is actually composed of two groups of screens obtained by shooting existing materials with two virtual cameras in the virtual environment of the CAVE system to simulate the left and right eyes of a person. The CAVE system uses a multi-camera infrared positioning system to read the position parameters of the user's eyes by photographing the infrared marker points attached to the 3D glasses, so as to calculate the position parameters of the two cameras in the virtual environment in the system (two virtual cameras simulate 3D glasses The positions of the left and right mirrors), so as to obtain images for displaying in two groups of display spaces on the four LED 3D display screens respectively. Each 3D glasses has two marked points with a fixed distance for the infrared tracking system to capture the position. The CAVE system then adjusts the images in the display space to match the current viewing position of the user according to the changes in the position of the user's eyes (for example, the image will zoom in if it is closer to the display screen, and the image will shrink if it is farther away from the display screen). And combined with the picture calibration system, the picture at the corner is calibrated, so that the display space image will not be distorted. The display space images are output and displayed by four independent 3D rendering services. The CAVE system continuously and alternately displays the calibrated two sets of images on the LED 3D display. At the same time, the 3D glasses switch between the left and right lenses in conjunction with the continuously alternately displayed image images: when the left eye image appears, the left eye lens of the 3D glasses is turned on, and the right eye lens is turned off; when the right eye image appears, the right eye lens of the 3D glasses is turned on, The left eyeglass is closed. In order to synchronize the switching of the left and right eye images with the switching of the 3D glasses lenses, the IR emitter is placed above the display space, connected to a multi-channel control server, and used in conjunction with the 3D glasses.
3D眼镜的每一只镜片均包含有一个液晶层，可以在加载一定电压的情况下变黑(透光率下降)。反之，在没有附加电压的情况下就和普通镜片类似。由于每一帧的3D图像均包含有左、右两幅不同角度拍摄的画面，只有当左画面对应通过左镜片(镜片上没加载固定电压)，右画面对应通过右镜片时，观众才能看到3D图像。Each lens of 3D glasses contains a liquid crystal layer, which can turn black (decrease light transmittance) when a certain voltage is applied. On the contrary, it is similar to ordinary lenses without additional voltage. Since each frame of 3D image includes left and right pictures taken from different angles, the viewer can see only when the left picture corresponds to pass through the left lens (there is no fixed voltage loaded on the lens), and the right picture corresponds to pass through the right lens. 3D images.
另外，3D眼镜应具有超高速的帧频，以匹配高速投影机的帧频，在较低频率，如几百Hz，可以通过铁电液晶实现，如果用户较多，则可以通过两块铁电液晶板，以级联的方式，实现高速的调制。这种情况下，只有前后两块液晶板处于开状态时，眼镜片才处于开的状态，而只要有一块液晶板处于关闭状态，则整个镜片处于关闭状态，通过时钟的调制，可以把两块液晶板开启与关闭的时间差设置的很小，则可以得到很快的开关速度。In addition, 3D glasses should have an ultra-high-speed frame rate to match the frame rate of high-speed projectors. At lower frequencies, such as hundreds of Hz, it can be realized through ferroelectric liquid crystals. If there are many users, it can be realized through two ferroelectric Liquid crystal panels, in a cascaded manner, realize high-speed modulation. In this case, only when the front and rear liquid crystal panels are in the open state, the spectacle lens is in the open state, and as long as one liquid crystal panel is in the closed state, the entire lens is in the closed state. If the time difference between opening and closing of the liquid crystal panel is set very small, a very fast switching speed can be obtained.
需要一个同步信号来控制左右镜片的交替和左右画面的交替保持一致。通常，使用红外线来传输这个同步信号。但由于存在着诸如易受日光灯干扰，通讯范围有限等不利因素，也发展出了利用蓝牙，高频无线信号通讯的3D快门式眼镜。在同步信号的控制下，加载在左右两只镜片上的电压交替变化，然后由大脑将两幅图像合成一体来实现3D的视觉效果。A synchronous signal is needed to control the alternation of the left and right lenses and the alternation of the left and right images to be consistent. Usually, infrared rays are used to transmit this synchronization signal. However, due to unfavorable factors such as being susceptible to fluorescent lamp interference and limited communication range, 3D shutter glasses using Bluetooth and high-frequency wireless signal communication have also been developed. Under the control of the synchronous signal, the voltage loaded on the left and right lenses changes alternately, and then the brain combines the two images into one to achieve 3D visual effects.
3D技术的原理是根据人眼对影像频率的刷新时间来实现的，所以通过提高画面的快速刷新率(一般要达到120Hz)左眼和右眼各60Hz的快速刷新才会让人不会对图像产生抖动感，并且保持与2D视像相同的帧数。The principle of 3D technology is based on the refresh time of the human eye to the image frequency, so by increasing the fast refresh rate of the picture (generally up to 120Hz), the fast refresh of 60Hz for the left eye and right eye will make people not notice the image. Produces a sense of jitter and maintains the same frame rate as 2D video.
它主要是靠液晶眼镜来实现的，它的眼镜片实质上是可以分别控制开/关的两片液晶屏，眼镜中的液晶层有黑和白两种状态，平常显示为白色即透明状态，通电之后就会变黑色。通过IR发射器，让3D眼镜和屏幕之间实现精确同步。显示屏幕上会交替进行左右眼画面的播放，在播放左画面时，左眼镜打开，右眼镜关闭，观众左眼看到需要让左眼看见的画面，右眼什么都看不到。在播放右眼画面是，右眼看右画面，左眼看不到画面，就这样让左右眼分别看到左右各自的画面，从而实现3D立体效果。这个过程交替至少达到120次/每秒，人眼才能欣赏到连贯而不闪烁的3D画面，所以主动式3D显示技术要求屏幕的刷新率至少达到120Hz。It is mainly realized by liquid crystal glasses. Its spectacle lenses are essentially two LCD screens that can be turned on/off separately. The liquid crystal layer in the glasses has two states: black and white, and is usually displayed as white or transparent. It turns black when powered on. Precise synchronization between the 3D glasses and the screen via the IR emitter. The left and right eye images will be played alternately on the display screen. When the left image is played, the left eyeglass is turned on and the right eyeglass is turned off. The left eye of the audience sees the image that the left eye needs to see, and the right eye sees nothing. When playing the right eye picture, the right eye sees the right picture, and the left eye cannot see the picture, so that the left and right eyes can see the left and right pictures respectively, thereby achieving a 3D stereoscopic effect. This process alternates at least 120 times per second, so that the human eye can enjoy a coherent and non-flickering 3D picture, so active 3D display technology requires a screen refresh rate of at least 120Hz.
<本发明的方法流程><Method flow of the present invention>
如图2，本发明公开了一种采用LED 3D屏幕的CAVE系统显示方法，该方法包括以下步骤：As shown in Figure 2, the present invention discloses a CAVE system display method using an LED 3D screen, the method comprising the following steps:
步骤S1，采集3D眼镜上红外标记点的坐标位置。Step S1, collecting coordinate positions of infrared marker points on the 3D glasses.
CAVE系统使用多摄像头红外定位系统通过拍摄附着在3D眼镜上的红外标记点，读取用户双眼的位置参数，以计算出系统中虚拟环境里两个摄像机的位置参数(两个虚拟摄像机模拟3D眼镜左、右镜片的位置)。The CAVE system uses a multi-camera infrared positioning system to read the position parameters of the user's eyes by photographing the infrared marker points attached to the 3D glasses, so as to calculate the position parameters of the two cameras in the virtual environment in the system (two virtual cameras simulate 3D glasses position of the left and right lenses).
步骤S2，利用所述坐标位置估算出用户双眼的位置。Step S2, using the coordinates to estimate the positions of the user's eyes.
动捕电脑通过网络交换机获取由多个红外摄像头(优选为八个)得到3D眼镜上的红外标记点的位置参数，从而间接得到用户双眼的位置参数。系统利用电脑中的MotiveTracker软件，数据通过交换机传输给四个通道渲染服务器和多通道控制服务器。The motion capture computer obtains the position parameters of the infrared marker points on the 3D glasses obtained by multiple infrared cameras (preferably eight) through the network switch, thereby indirectly obtaining the position parameters of the user's eyes. The system uses the MotiveTracker software in the computer, and the data is transmitted to the four-channel rendering server and the multi-channel control server through the switch.
步骤S3，根据所述位置计算得到相对所述3D眼镜显示的两组画面。Step S3, calculating and obtaining two groups of pictures displayed relative to the 3D glasses according to the position.
CAVE系统再根据用户双眼位置的变化，分别调整显示空间的图像以匹配用户观看的当前位置(例如：离显示屏近画面就会放大，离显示屏远画面就会缩小)。并且结合画面校准系统，校准折角处的画面，使显示空间图像不会产生畸变。其中显示空间图像是由四个独立的三维渲染服务来输出显示的。The CAVE system then adjusts the images in the display space to match the current viewing position of the user according to the changes in the position of the user's eyes (for example, the image will zoom in if it is closer to the display screen, and the image will shrink if it is farther away from the display screen). And combined with the picture calibration system, the picture at the corner is calibrated, so that the display space image will not be distorted. The display space images are output and displayed by four independent 3D rendering services.
步骤S4，在LED 3D屏幕上交替显示所述两组画面。Step S4, alternately displaying the two groups of pictures on the LED 3D screen.
所述多通道控制服务器根据所述3D眼镜的位置的生成四个LED 3D屏幕的画面控制信号，将四个LED 3D屏幕的画面控制信号分别发送给四个通道渲染服务器，以实现把校准好的两组画面连续交替地显示在所述四个LED 3D屏幕上。The multi-channel control server generates picture control signals of four LED 3D screens according to the position of the 3D glasses, and sends the picture control signals of the four LED 3D screens to four channel rendering servers respectively, so as to realize the calibrated Two groups of pictures are continuously and alternately displayed on the four LED 3D screens.
步骤S5，对所述3D眼镜进行左、右镜片开关切换，切换频率与所述两组画面交替显示的切换频率相配合。Step S5, switch the left lens and the right lens of the 3D glasses, and the switching frequency matches the switching frequency of the alternate display of the two groups of images.
同时，3D眼镜配合这个连续交替显示的画面图像进行左右镜片的切换：左眼画面出现，3D眼镜左眼镜片就打开，右眼镜片就关闭；右眼画面出现，3D眼镜右眼镜片就打开，左眼镜片就关闭。为了使左、右眼画面的切换和3D眼镜镜片的切换同步，还需要把IR发射器放置在显示空间上方，连接多通道控制服务器和3D眼镜，配合使用。At the same time, the 3D glasses switch between the left and right lenses in conjunction with the continuously alternately displayed image images: when the left eye image appears, the left eye lens of the 3D glasses is turned on, and the right eye lens is turned off; when the right eye image appears, the right eye lens of the 3D glasses is turned on, The left eyeglass is closed. In order to synchronize the switching of the left and right eye images with the switching of the 3D glasses lenses, it is also necessary to place the IR emitter above the display space, connect the multi-channel control server and the 3D glasses, and use it together.
当左眼画面和右眼画面各高于60Hz的快速刷新，由于人眼的视觉暂留现象，左右眼图像经由大脑重合，产生立体感。用户就会看到校准后不闪烁的3D图像。When the left-eye image and the right-eye image are refreshed faster than 60Hz, due to the persistence of vision of the human eye, the images of the left and right eyes overlap through the brain to produce a three-dimensional effect. The user will see the 3D image after calibration without flickering.
显示在所述LED 3D屏幕上的画面由所述CAVE系统的虚拟环境中的两个虚拟摄像机模拟人的左、右眼拍摄已有素材得到的两组画面而组成。The pictures displayed on the LED 3D screen are composed of two groups of pictures obtained by shooting existing materials with two virtual cameras in the virtual environment of the CAVE system simulating the left and right eyes of a person.
<本发明的具体实施例><Specific examples of the present invention>
本发明使用了点间距为P1.667的LED 3D显示屏，搭建了正面屏，左、右屏以及地屏，组成四面显示空间，视频拼接器为MVC系列。为了分别渲染LED屏上的画面，还需要四台三维通道渲染服务器，服务器采用惠普系列。此外，还有红外跟踪系统进行摄像机的空间定位，此红外跟踪系统包含八个红外摄像头，把它们分布在显示空间的角落。The present invention uses an LED 3D display screen with a dot pitch of P1.667 to build a front screen, left and right screens, and a ground screen to form a four-sided display space. The video splicer is an MVC series. In order to render the pictures on the LED screen separately, four 3D channel rendering servers are needed, and the servers use the HP series. In addition, there is an infrared tracking system for spatial positioning of the camera. This infrared tracking system includes eight infrared cameras and distributes them in the corners of the display space.
用户把红外标记点固定在3D眼镜上。3D眼镜为Active Glasses for TV。动捕电脑通过网络交换机获取由八个红外摄像头得到3D眼镜上的红外标记点的位置参数，从而间接得到用户双眼的位置参数。系统利用电脑中的软件Motive Tracker，数据通过交换机传输给四个三维通道渲染服务器和多通道控制服务器。多通道控制服务器把观众人眼的坐标信息匹配到虚拟环境中使用，得到左、右眼两组画面图像，使显示空间画面符合人眼真实视角，并且整个显示空间画面无畸变。The user fixes the infrared marker on the 3D glasses. 3D glasses are Active Glasses for TV. The motion capture computer obtains the position parameters of the infrared marker points on the 3D glasses obtained by the eight infrared cameras through the network switch, thereby indirectly obtaining the position parameters of the user's eyes. The system uses the software Motive Tracker in the computer, and the data is transmitted to four 3D channel rendering servers and multi-channel control servers through switches. The multi-channel control server matches the coordinate information of the viewer's human eyes to the virtual environment, and obtains two sets of images for the left and right eyes, so that the display space picture conforms to the real perspective of the human eye, and the entire display space picture has no distortion.
CAVE系统把已校准好的两组画面，连续交替地显示在LED 3D屏幕上。同时，3D眼镜配合这个连续交替的画面显示进行左右镜片的开关切换。为了使LED 3D屏幕上左、右眼画面的切换与3D眼镜左、右镜片的切换同步，还需要把IR发射器放置在显示空间上方，连接多通道控制服务器，和3D眼镜配合使用。The CAVE system continuously and alternately displays the calibrated two sets of pictures on the LED 3D screen. At the same time, the 3D glasses cooperate with the continuous and alternate picture display to switch the left and right lenses. In order to synchronize the switching of the left and right eye images on the LED 3D screen with the switching of the left and right lenses of the 3D glasses, it is also necessary to place the IR emitter above the display space, connect to a multi-channel control server, and use it in conjunction with the 3D glasses.
当左眼画面和右眼画面各高于60Hz的快速刷新。用户便会看到校准后不闪烁的3D图像。When the left-eye image and right-eye image are refreshed faster than 60Hz. The user will see a 3D image that is calibrated without flickering.
以上所述仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。凡在本发明的精神和原则之内，所作的任何修改、等同替换以及改进等，均应保护在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention shall be protected within the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710418098.6ACN107147899B (en) | 2017-06-06 | 2017-06-06 | CAVE display system and method adopting LED3D screen |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710418098.6ACN107147899B (en) | 2017-06-06 | 2017-06-06 | CAVE display system and method adopting LED3D screen |
| Publication Number | Publication Date |
|---|---|
| CN107147899Atrue CN107147899A (en) | 2017-09-08 |
| CN107147899B CN107147899B (en) | 2020-02-11 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710418098.6AActiveCN107147899B (en) | 2017-06-06 | 2017-06-06 | CAVE display system and method adopting LED3D screen |
| Country | Link |
|---|---|
| CN (1) | CN107147899B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108346183A (en)* | 2018-02-05 | 2018-07-31 | 北京德火新媒体技术有限公司 | A kind of method and system for AR origin reference locations |
| CN108881892A (en)* | 2018-05-23 | 2018-11-23 | 北京致臻智造科技有限公司 | Anti-dazzle method, system for Table top type virtual reality system |
| CN109151445A (en)* | 2018-09-26 | 2019-01-04 | 深圳市新致维科技有限公司 | A kind of naked eye 3D display system and its display methods and computer memory device |
| CN109769111A (en)* | 2018-11-22 | 2019-05-17 | 利亚德光电股份有限公司 | Image display method, device, system, storage medium and processor |
| CN110267028A (en)* | 2019-06-24 | 2019-09-20 | 中冶智诚(武汉)工程技术有限公司 | A kind of signal synchronous display system for five face LED-CAVE |
| CN110379240A (en)* | 2019-06-24 | 2019-10-25 | 南方电网调峰调频发电有限公司 | A kind of power station maintenance simulation training system based on virtual reality technology |
| CN110430420A (en)* | 2019-06-24 | 2019-11-08 | 南方电网调峰调频发电有限公司 | A kind of five face CAVE display system integrated approaches based on small spacing LED |
| CN110430421A (en)* | 2019-06-24 | 2019-11-08 | 南方电网调峰调频发电有限公司 | A kind of optical tracking positioning system for five face LED-CAVE |
| CN111986334A (en)* | 2020-09-07 | 2020-11-24 | 桂林旅游学院 | Hololens and CAVE combined virtual experience system and method |
| CN112040092A (en)* | 2020-09-08 | 2020-12-04 | 杭州时光坐标影视传媒股份有限公司 | Real-time virtual scene LED shooting system and method |
| CN112584118A (en)* | 2020-12-14 | 2021-03-30 | 北京易达恩能科技有限公司 | Immersive virtual reality display method and device based on LED3D screen |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102045577A (en)* | 2010-09-27 | 2011-05-04 | 昆山龙腾光电有限公司 | Observer tracking system and three-dimensional stereo display system for three-dimensional stereo display |
| CN102075776A (en)* | 2011-01-18 | 2011-05-25 | 青岛海信电器股份有限公司 | Stereo display controlling method and device |
| CN102946546A (en)* | 2012-10-10 | 2013-02-27 | 西安诺瓦电子科技有限公司 | LED display screen control system supporting shutter type 3D displaying |
| CN103686132A (en)* | 2013-11-15 | 2014-03-26 | 青岛歌尔声学科技有限公司 | Method and device for controlling 3D glasses, 3D glasses, and 3D system |
| CN104202546A (en)* | 2014-08-22 | 2014-12-10 | 湖南华凯文化创意股份有限公司 | Immersive virtual display system and display method of CAVE (Cave Automatic Virtual Environment) |
| CN105282532A (en)* | 2014-06-03 | 2016-01-27 | 天津拓视科技有限公司 | 3D display method and device |
| CN105741751A (en)* | 2014-12-11 | 2016-07-06 | 深圳市华天瑞彩科技开发有限公司 | LED three-dimensional display control system |
| CN106210706A (en)* | 2015-05-08 | 2016-12-07 | 深圳市立鼎光电技术有限公司 | LED display realizes the system that 3D shows |
| CN106454311A (en)* | 2016-09-29 | 2017-02-22 | 北京利亚德视频技术有限公司 | LED three-dimensional imaging system and method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102045577A (en)* | 2010-09-27 | 2011-05-04 | 昆山龙腾光电有限公司 | Observer tracking system and three-dimensional stereo display system for three-dimensional stereo display |
| CN102075776A (en)* | 2011-01-18 | 2011-05-25 | 青岛海信电器股份有限公司 | Stereo display controlling method and device |
| CN102946546A (en)* | 2012-10-10 | 2013-02-27 | 西安诺瓦电子科技有限公司 | LED display screen control system supporting shutter type 3D displaying |
| CN103686132A (en)* | 2013-11-15 | 2014-03-26 | 青岛歌尔声学科技有限公司 | Method and device for controlling 3D glasses, 3D glasses, and 3D system |
| CN105282532A (en)* | 2014-06-03 | 2016-01-27 | 天津拓视科技有限公司 | 3D display method and device |
| CN104202546A (en)* | 2014-08-22 | 2014-12-10 | 湖南华凯文化创意股份有限公司 | Immersive virtual display system and display method of CAVE (Cave Automatic Virtual Environment) |
| CN105741751A (en)* | 2014-12-11 | 2016-07-06 | 深圳市华天瑞彩科技开发有限公司 | LED three-dimensional display control system |
| CN106210706A (en)* | 2015-05-08 | 2016-12-07 | 深圳市立鼎光电技术有限公司 | LED display realizes the system that 3D shows |
| CN106454311A (en)* | 2016-09-29 | 2017-02-22 | 北京利亚德视频技术有限公司 | LED three-dimensional imaging system and method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108346183A (en)* | 2018-02-05 | 2018-07-31 | 北京德火新媒体技术有限公司 | A kind of method and system for AR origin reference locations |
| CN108346183B (en)* | 2018-02-05 | 2021-06-22 | 北京德火新媒体技术有限公司 | A method and system for AR reference positioning |
| CN108881892A (en)* | 2018-05-23 | 2018-11-23 | 北京致臻智造科技有限公司 | Anti-dazzle method, system for Table top type virtual reality system |
| CN109151445A (en)* | 2018-09-26 | 2019-01-04 | 深圳市新致维科技有限公司 | A kind of naked eye 3D display system and its display methods and computer memory device |
| CN109151445B (en)* | 2018-09-26 | 2020-08-04 | 深圳市新致维科技有限公司 | Naked eye 3D display system, display method thereof and computer storage device |
| CN109769111A (en)* | 2018-11-22 | 2019-05-17 | 利亚德光电股份有限公司 | Image display method, device, system, storage medium and processor |
| CN110430420A (en)* | 2019-06-24 | 2019-11-08 | 南方电网调峰调频发电有限公司 | A kind of five face CAVE display system integrated approaches based on small spacing LED |
| CN110430421A (en)* | 2019-06-24 | 2019-11-08 | 南方电网调峰调频发电有限公司 | A kind of optical tracking positioning system for five face LED-CAVE |
| CN110379240A (en)* | 2019-06-24 | 2019-10-25 | 南方电网调峰调频发电有限公司 | A kind of power station maintenance simulation training system based on virtual reality technology |
| CN110267028B (en)* | 2019-06-24 | 2021-04-30 | 中冶智诚(武汉)工程技术有限公司 | Signal synchronous display system for five-surface LED-CAVE |
| CN110267028A (en)* | 2019-06-24 | 2019-09-20 | 中冶智诚(武汉)工程技术有限公司 | A kind of signal synchronous display system for five face LED-CAVE |
| CN111986334A (en)* | 2020-09-07 | 2020-11-24 | 桂林旅游学院 | Hololens and CAVE combined virtual experience system and method |
| CN112040092A (en)* | 2020-09-08 | 2020-12-04 | 杭州时光坐标影视传媒股份有限公司 | Real-time virtual scene LED shooting system and method |
| CN112584118A (en)* | 2020-12-14 | 2021-03-30 | 北京易达恩能科技有限公司 | Immersive virtual reality display method and device based on LED3D screen |
| Publication number | Publication date |
|---|---|
| CN107147899B (en) | 2020-02-11 |
| Publication | Publication Date | Title |
|---|---|---|
| CN107147899B (en) | CAVE display system and method adopting LED3D screen | |
| US7522257B2 (en) | System and method for a 3-D phenomenoscope | |
| US20110057862A1 (en) | Image display device | |
| CN104777620B (en) | The depth of field identification Optical devices and its imaging method of virtual reality 3D scenes | |
| KR20110114671A (en) | Stereoscopic image display system | |
| CN101742347B (en) | Method for realizing three-dimensional display, display device and display system | |
| US10582184B2 (en) | Instantaneous 180-degree 3D recording and playback systems | |
| CN101631257A (en) | Method and device for realizing three-dimensional playing of two-dimensional video code stream | |
| CN102929384A (en) | Three-dimensional electronic sand board device | |
| CN107239143A (en) | A kind of CAVE using small spacing LED screen shows system and method | |
| CN108616752A (en) | Support the helmet and control method of augmented reality interaction | |
| WO2023143505A1 (en) | Image generation apparatus, display device and image generation method | |
| CN104155840A (en) | Device and method for 360-degree full-parallax three dimensional display based on high-speed projector | |
| CN203941346U (en) | A 3D display system | |
| CN101137925A (en) | 3D image capturing camera and non-stereoscopic 3D viewing apparatus without glasses | |
| CN104506841A (en) | 3D (three-dimensional) document producing and playing method and device of multi-camera terminal | |
| CN206775654U (en) | A kind of CAVE display systems using LED 3D screens | |
| CN116320364B (en) | Virtual reality shooting method and display method based on multi-layer display | |
| CN204496115U (en) | The depth of field identification optical devices of virtual reality 3D scene | |
| CN107888900A (en) | A kind of projection robot of full parallax Three-dimensional Display and the projecting method of the robot | |
| CN109714588A (en) | Multi-viewpoint stereo image positions output method, device, equipment and storage medium | |
| US20140285484A1 (en) | System of providing stereoscopic image to multiple users and method thereof | |
| CN112367516B (en) | Three-dimensional display system based on space positioning | |
| CN103984109A (en) | 3D display system | |
| CN114755839A (en) | Holographic sand table display system |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address | Address after:No. 425, 4th Floor, Building 1, No. 1, Guanghua Road, Tongzhou District, Beijing 101104 Patentee after:BEIJING DEHUO TECHNOLOGY Co.,Ltd. Address before:100091 No. 11-1-C6 Tonghu Street, Tongzhou District, Beijing Patentee before:DAHOOO NEW MEDIA TECHNOLOGY CO.,LTD. |