CN101661163A - Three-dimensional helmet display of augmented reality system - Google Patents

Abstract

Translated fromChinese

增强现实系统的立体头盔显示器，其特征是采用光学透视式结构，以使用者的鼻梁部位为中心线呈左右对称，沿光轴方向自外侧到人眼中心，依次设置图像源、方位角可以调节的偏振方位调节镜、光学成像系统和偏振组合镜，偏振组合镜将图像源的光线方向反射偏转90度后进入人眼；外界光与图像源光线成90度角，经方位角可以调节的偏振镜后，从偏振组合镜透射进入人眼；构成立体图像对的两幅图像分别传送在左右两侧的图像源中；以偏振方位调节镜和偏振组合镜构成图像源亮度调节单元，以偏振镜和偏振组合镜构成外界光亮度调节单元。本发明能使立体头盔显示器的虚拟环境和现实环境达到最佳的匹配状态，并消除双目竞争现象，用于增强现实系统。

The three-dimensional head-mounted display of the augmented reality system is characterized in that it adopts an optical see-through structure, with the bridge of the user's nose as the center line, which is left-right symmetrical, along the optical axis from the outside to the center of the human eye, and the image source is set in sequence, and the azimuth angle can be adjusted Polarization azimuth adjustment mirror, optical imaging system and polarization combination mirror, the polarization combination mirror reflects and deflects the light direction of the image source by 90 degrees and then enters the human eye; the external light and the image source light form an angle of 90 degrees, and the polarization can be adjusted by the azimuth angle After the polarization mirror, it enters the human eye through the polarization combination mirror; the two images that constitute the stereoscopic image pair are transmitted to the left and right image sources respectively; the image source brightness adjustment unit is composed of the polarization orientation adjustment mirror and the polarization combination mirror, and the polarizer The external light brightness adjustment unit is constituted by the polarizing combination mirror. The invention can make the virtual environment and the real environment of the three-dimensional head-mounted display achieve the best matching state, and eliminate the phenomenon of binocular competition, and is used in an augmented reality system.

Description

The three-dimensional helmet display of augmented reality system

Technical field

The present invention relates to three-dimensional helmet display,, realize the best optical perspective formula three-dimensional helmet display that merges of actual situation environment more precisely by regulating image source and brightness of outside light.

Background technology

Helmet Mounted Display (Head-Mounted Display, HMD) be mounted in a kind of display on user's helmet, its activity ken can widely reach 360 degree, and has characteristics such as big picture, portable and high telepresenc, is widely used in fields such as military affairs, simulated training, amusement, medical treatment and engineering.

(Augmented Reality AR) requires virtual environment and actual environment are combined together the augmented reality technology, makes the user can obtain the information of virtual environment and actual environment simultaneously, needs the luminance brightness of virtual environment and actual environment can obtain optimum matching.Perspective helmet display device can be watched virtual environment information, can watch external environment again, utilize principle of parallax in the binocular structure, can realize stereo display, have simple in structure, easy to use and advantage such as stereoeffect is obvious as the man-machine interface of augmented reality system.

The perspective formula three-dimensional helmet display mainly contains two kinds of video perspective formula and optical perspective formulas, after video perspective formula three-dimensional helmet display utilizes camera that external environment is filmed, be shown to the user with the virtual environment image co-registration more together, time-delay when this can cause the user to watch external environment produces sense of discomfort and sense of fatigue.Optical perspective formula three-dimensional helmet display is shown to the user after utilizing combined lens that the information of virtual environment and actual environment is synthesized, and the user to external environment, does not have time-delay by the combined lens direct viewing, and is more comfortable, is suitable for working long hours.Therefore in strengthening display system, adopt optical perspective formula three-dimensional helmet display.But there is following technical matters in the optical perspective formula three-dimensional helmet display in the prior art:

1, when being under the extraneous high light situation, the brightness of image and the contrast of Helmet Mounted Display are low, and image is covered by external environment, to such an extent as to human eye can only be seen external environment under high light, does not see the display message of Helmet Mounted Display;

2, when being under the extraneous half-light situation, the brightness of image of Helmet Mounted Display is too high, and external environment is blocked by image source information, to such an extent as to human eye be can't see external information.

3, in binocular is overlapped, because the image difference of binocular vision causes the binocular competition, can cause the image division under the serious situation, produce visual fatigue, increase the weight of user's work load.

Chinese patent 200710108422.0 discloses the head mounted display of a kind of adjustable collar border light intensity, two polaroids are stacked together, one of them polaroid is fixing, by regulating the azimuth adjustment ambient light brightness of another polaroid, this patent can't be regulated the brightness of virtual environment, therefore under extraneous half-light situation, the user can not see external environment clearly.

Summary of the invention

The present invention is for avoiding above-mentioned existing in prior technology weak point, a kind of three-dimensional helmet display that is used for augmented reality system is provided, utilize optical means effectively to regulate the brightness of image source and external environment, the contrast problem of solution actual situation scene under extraneous high light and two kinds of situations of half-light combines actual situation together environmentally advantageously; By making the virtual image that binocular becomes overlapping fully on the locus, increase the field angle in stereo display zone, and eliminate the binocular warfare.

Technical solution problem of the present invention adopts following technical scheme:

The design feature of the three-dimensional helmet display of augmented reality system of the present invention is to adopt optical perspective formula structure, bridge of the nose position with the user is that center line is left-right symmetric, along optical axis direction from the outside to the human eye center, set gradually the polarization orientation that image source, position angle can regulate and regulate mirror, optical imaging system and polarization combination mirror, described polarization combination mirror enters human eye after the radiation direction reflection of image source is turn 90 degrees partially; Ambient light becomes an angle of 90 degrees with image source light, behind the polariscope that can regulate through the position angle, enters human eye from the transmission of polarization combination mirror;

Input signal provides display message through driving circuit for image source; Constituting two right width of cloth images of stereo-picture is transmitted in respectively in the image source of the left and right sides; Regulate mirror and polarization combination mirror pie graph image source brightness adjusting unit with described polarization orientation, constitute the ambient light brightness adjusting unit with described polariscope and polarization combination mirror.

The design feature of the three-dimensional helmet display of described augmented reality system also is:

Described image source is the color LCD screen, and it is the adjustable half-wave plate of fast axis direction that mirror is regulated in described polarization orientation, and described polarization combination mirror adopts polarization spectroscope.

Described image source or be the color OLED screen, it is the adjustable polariscope in polarization orientation that mirror is regulated in described polarization orientation, described polarization combination mirror adopts polarization spectroscope.

The design feature of another form of the three-dimensional helmet display of augmented reality system of the present invention is: adopt optical perspective formula structure, bridge of the nose position with the user is that center line is left-right symmetric, set gradually the polarization orientation that image source, position angle can regulate along optical axis direction from the outside to the human eye center and regulate mirror, optical imaging system and unpolarized combined lens, described unpolarized combined lens enters human eye after the radiation direction reflection of image source is turn 90 degrees partially; Ambient light becomes an angle of 90 degrees with image source light, passes through outer polariscope and interior polariscope successively, enters human eye from unpolarized combined lens transmission; Polariscope and outer polariscopic polarization position angle all can be regulated in described;

Input signal provides display message through driving circuit for image source, constitutes two right width of cloth images of stereo-picture and is transmitted in respectively in the image source of the left and right sides; Regulate mirror and image source pie graph image source brightness adjusting unit with described polarization orientation, constitute the ambient light brightness adjusting unit with polariscope in described and outer polariscope.

The design feature of the three-dimensional helmet display of another form augmented reality system described in the present invention is that also described image source adopts the color LCD screen, it is the adjustable polariscope in polarization orientation that mirror is regulated in described polarization orientation, and described unpolarized combined lens adopts unpolarized spectroscope.

The design feature of the three-dimensional helmet display of augmented reality system of the present invention also is:

By finely tuning described polarization combination mirror and unpolarized combined lens direction with respect to image source light, make the left and right sides stereo-picture that is transmitted in respectively in the image source of the left and right sides right, in the locus of the virtual image that right and left eyes becomes for overlapping or overlapping fully.

The present invention utilizes the polarisation of light characteristic that the image source and the brightness of outside light of three-dimensional helmet display are regulated, and compared with the prior art, beneficial effect of the present invention is embodied in:

1, when image source be under the situation of color LCD screen, the present invention adopts half-wave plate as polarization orientation regulating element, cooperate polarization spectroscope or common spectroscope, the image source brightness that three-dimensional helmet shows is regulated, adopt polariscope to cooperate polarization spectroscope or common spectroscope, luminance brightness is regulated to external world, makes virtual environment and external environment can reach best syncretizing effect.

2, when image source be under the situation of color OLED screen, utilize polariscope to cooperate polarization spectroscope, the image source brightness that three-dimensional helmet shows is regulated, adopt polariscope to cooperate polarization spectroscope, luminance brightness is regulated to external world, makes virtual environment and external environment can reach best syncretizing effect.

3, by the virtual image that binocular becomes is overlapped fully, increase the field angle in stereo display zone on the locus, and eliminated the binocular warfare.

Description of drawings

Fig. 1 is first kind of version synoptic diagram of three-dimensional helmet display of the present invention.

Fig. 2 is second kind of version synoptic diagram of three-dimensional helmet display of the present invention.

Fig. 3 a is the image source brightness regulation schematic diagram of first kind of version of the present invention.

Fig. 3 b is the ambient light brightness regulation schematic diagram of first kind of version of the present invention.

Fig. 4 a is the image source brightness regulation schematic diagram of second kind of version of the present invention.

Fig. 4 b is second kind of version ambient light of the present invention brightness regulation schematic diagram.

Fig. 5 is the software flow of used stereo-picture among the present invention to realizing.

Number in the figure: polariscope, 52 outer polariscopes in mirror, 3 optical imaging systems, 4 polarization combination mirrors, 5 polariscopes, 6 driving circuits, 7 input signals, 8 human eyes, the 41 unpolarized combined lens, 51 are regulated in 1 image source, 2 polarization orientation.

Below by embodiment, the invention will be further described in conjunction with the accompanying drawings.

Embodiment

Embodiment 1:

Referring to Fig. 1, in the present embodiment, left and right sides stereo-picture is to sending intodriving circuit 6 withinput signal 7, and it is right that drivingcircuit 6 drivesimage source 1 display image.The light thatimage source 1 is sent, behind polarizationorientation adjusting mirror 2 andoptical imaging system 3, the polarization combination mirror 4 that constitutes via polarization spectroscope enters human eye 8 again, ambient light enters human eye 8 through polariscope 5 and polarization combination mirror 4, by observer's vision physiological effect acquisition stereo display picture.

Whenimage source 1 is the color LCD screen, the polarization orientation is regulatedmirror 2 and is made of half-wave plate.Regulate the position angle ofmirror 2 by regulating the polarization orientation, can regulate the brightness ofimage source 1, its principle is shown in Fig. 3 a.Among Fig. 3 a, 2. 1. line be two orthogonal polarization orientation of polarization combination mirror 4 with line, to see through fully after thepolarization direction light 1. identical with line incides polarization combination mirror 4, will be reflected fully after thepolarization direction light 2. identical with line incides polarization combination mirror 4.

ColorLCD image source 1 send for linearly polarized light, its polarization direction as Fig. 3 acenter line 3. shown in, with the line of polarization combination mirror 4 1. the angular separation be θ₁, 4. line regulates the quick shaft direction ofmirror 2 for the polarization orientation, withline 3. the angular separation be θ₂, then the polarization direction direction that to beline light 3. regulatemirror 2 through the polarization orientation be line 5. shown in, withline 3. the angular separation be 2 θ₂If the luminous flux of image source outgoing is φ₁, do not consider the absorption loss in the optical transmission process, then reach the image source light flux φ ' of human eye 8₁For:

${\mathrm{\φ}}_1^{\′}={\mathrm{\φ}}_1{\sin }^2({\mathrm{\θ}}_1+2{\mathrm{\θ}}_2)---\left(1\right)$

By regulating the position angle of polariscope 5, the brightness of surround lighting is regulated to external world, and its principle is referring to Fig. 3 b.Among Fig. 3 b, 6. line is the polarization direction of polariscope 5, with the line of combined lens 4 1. the angular separation be θ₃, the luminous flux of establishing ambient light arrival polariscope 5 planes of incidence is φ₂, then reach the ambient light flux φ ' of human eye 8₂For:

${\mathrm{\&phi;}}_2^{\&prime;}=\frac{{\mathrm{\&phi;}}_2}{2}{\mathrm{<figure-callout\; label="cos"\; filenames="A2009101450900008H2.png,A2009101450900009H2.png"\; state="\{\{state\}\}">cos</figure-callout>}}^2{\mathrm{\&theta;}}_3---\left(2\right)$

Know according to formula (1) and (2), regulate the azimuth angle theta that mirror 2 and polariscope 5 are regulated in the polarization orientation₁And θ₃, can regulate the luminous flux that image source and external environment enter human eye 8 respectively, because human eye 8 receiving areas and solid angle are constant, then can regulate the brightness of virtual environment and actual environment in the human eye 8 respectively.The luminous flux range of adjustment of image source is 0～φ₁, the luminous flux range of adjustment of ambient light is

Whenimage source 1 was shielded for color OLED, the polarization orientation was regulatedmirror 2 and is made of polariscope, and this moment, image source was all identical with Fig. 3 b with ambient light brightness regulation principle.

Embodiment 2:

Referring to Fig. 2, in the present embodiment, left and right sides stereo-picture is to being to send intodriving circuit 6 frominput signal 7 equally, and it is right that drivingcircuit 6 drivesimage source 1 display image.The light thatimage source 1 is sent, behind polarizationorientation adjusting mirror 2 andoptical imaging system 3, the unpolarized combinedlens 41 that constitutes via unpolarized spectroscope enters human eye 8 again, ambient light enters human eye 8 throughinterior polariscope 51,outer polariscope 52 and unpolarized combinedlens 41, by observer's vision physiological effect acquisition stereo display picture.

Image source 1 is the color LCD screen, and its emergent ray is a linearly polarized light, and it is polariscope thatmirror 2 is regulated in the polarization orientation.Regulate the position angle ofmirror 2 by regulating the polarization orientation, can regulate the brightness ofimage source 1, its principle is referring to Fig. 4 a.Among Fig. 4 a, 8. 7. line be respectively the linearly polarized light direction ofimage source 1 and polarizationorientation adjusting mirror 2 with line, and its position angle is respectively θ₄And θ₅If the luminous flux of image source outgoing is φ₃, do not consider the absorption loss in the optical transmission process, then reach the image source light flux φ ' of human eye 8₃For:

${\mathrm{\&phi;}}_3^{\&prime;}=\frac{{\mathrm{\&phi;}}_3}{2}{\cos }^2({\mathrm{\&theta;}}_4-{\mathrm{\&theta;}}_5)---\left(3\right)$

By the position angle angle of polariscope in regulating 51 andouter polariscope 52, the brightness of surround lighting is regulated to external world, and its principle is referring to Fig. 4 b.θ₆And θ₇Polariscope 51 andouter polariscope 52 position angles in being respectively, the luminous flux of establishingouter polariscope 52 planes of incidence of ambient light arrival is φ₄, then reach the image source light flux φ ' of human eye 8₄For:

${\mathrm{\&phi;}}_4^{\&prime;}=\frac{{\mathrm{\&phi;}}_4}{2}{\cos }^2({\mathrm{\&theta;}}_6-{\mathrm{\&theta;}}_7)---\left(4\right)$

Can realize adjusting to image source and external environment luminance brightness according to formula (3) and (4), the luminous flux range of adjustment of image source is

The luminous flux range of adjustment of ambient light is

The right and left eyes stereo-picture ininput picture source 1 is to obtaining according to parallax theory.Utilize Microsoft Visual C++, set up binocular solid video camera shooting model, three-dimensional model is taken according to the interpupillary distance and the viewing distance of human eye.Obtain stereo-picture

Right software flow as shown in Figure 5, human eye watch image to after produce stereoscopic picture plane through the vision physiological process.

Claims (6)

1, a kind of three-dimensional helmet display of augmented reality system, it is characterized in that adopting optical perspective formula structure, bridge of the nose position with the user is that center line is left-right symmetric, along optical axis direction from the outside to the human eye center, set gradually the polarization orientation that image source (1), position angle can regulate and regulate mirror (2), optical imaging system (3) and polarization combination mirror (4), described polarization combination mirror (4) reflects the radiation direction of image source (1) and enters human eye (8) after turning 90 degrees partially; Ambient light becomes an angle of 90 degrees with image source (1) light, behind the polariscope (5) that can regulate through the position angle, enters human eye (8) from polarization combination mirror (4) transmission; Input signal (7) provides display message through driving circuit (6) for image source (1); Constituting two right width of cloth images of stereo-picture is transmitted in respectively in the image source (1) of the left and right sides; Regulate mirror (2) and polarization combination mirror (4) pie graph image source (1) brightness adjusting unit with described polarization orientation, constitute the ambient light brightness adjusting unit with described polariscope (5) and polarization combination mirror (4).

2, a kind of three-dimensional helmet display of augmented reality system, it is characterized in that adopting optical perspective formula structure, bridge of the nose position with the user is that center line is left-right symmetric, set gradually the polarization orientation that image source (1), position angle can regulate along optical axis direction from the outside to the human eye center and regulate mirror (2), optical imaging system (3) and unpolarized combined lens (41), described unpolarized combined lens (41) reflects the radiation direction of image source (1) and enters human eye (8) after turning 90 degrees partially; Ambient light becomes an angle of 90 degrees with image source (1) light, passes through outer polariscope (52) and interior polariscope (51) successively, enters human eye (8) from unpolarized combined lens (41) transmission; The polarization position angle of polariscope (51) and outer polariscope (52) all can be regulated in described;

Input signal (7) provides display message through driving circuit (6) for image source (1), constitutes two right width of cloth images of stereo-picture and is transmitted in respectively in the image source (1) of the left and right sides; Regulate mirror (2) and image source (1) pie graph image source brightness adjusting unit with described polarization orientation, constitute the ambient light brightness adjusting unit with polariscope (51) in described and outer polariscope (52).

3, the three-dimensional helmet display of augmented reality system according to claim 1, it is characterized in that described image source (1) is the color LCD screen, it is the adjustable half-wave plate of fast axis direction that mirror (2) is regulated in described polarization orientation, and described polarization combination mirror (4) adopts polarization spectroscope.

4, the three-dimensional helmet display of augmented reality system according to claim 1, it is characterized in that described image source (1) is the color OLED screen, it is the adjustable polariscope in polarization orientation that mirror (2) is regulated in described polarization orientation, and described polarization combination mirror (4) adopts polarization spectroscope.

5, the three-dimensional helmet display of augmented reality system according to claim 2, it is characterized in that described image source (1) adopts the color LCD screen, it is the adjustable polariscope in polarization orientation that mirror (2) is regulated in described polarization orientation, and described unpolarized combined lens (41) adopts unpolarized spectroscope.

6, the three-dimensional helmet display of augmented reality system according to claim 1 and 2, it is characterized in that by finely tuning described polarization combination mirror (4) and unpolarized combined lens (41) direction with respect to image source (1) light, make the left and right sides stereo-picture that is transmitted in respectively in the left and right sides image source (1) right, in the locus of the virtual image that right and left eyes becomes for overlapping or overlapping fully.

Images