Invention content
In view of this, the present invention proposes a kind of light field display unit based on small array image source, for realizing lightLearn transmissive display.During observation, modulation of the light through micro structure array sent out by small array image source canRestore the spatial distribution when light that object point is sent out under nature situation enters human eye, simulation human eye is when observing true environmentNature meets the observation habit of human eye, existing suitable for enhancing when virtual reality fusion is effectively relieved the problem of influx-focusing disordersThe requirement applied in fact.
A kind of light field display unit according to the present invention includes the small array image source formed in substrate and is configured atMicro structure array device near it, the small array image source will be for that will include the light of image information to micro structure arrayDevice direction is emitted, and the micro structure array device is for receiving the light sent out from small array image source and being carried out to itModulation；It is characterized in that, the small array image source and micro structure array device are aligned in a predefined manner, so that small arrayThe center at the center and the corresponding microstructure unit of the micro structure array device of each micro display territory element in image sourceLine meet at the emergent pupil center of the display unit.
Specifically, the small array image source is formed in substrate, the nontransparent region with pixel covering is as micro-Display area unit, each unit arrange in a predefined manner, between there are gaps；The micro structure array device includes transparent JieThe substrate of material, and multiple microstructure units corresponding with the micro display territory element thereon, each microstructure unitBetween there are gap for penetrate external environment light.
It for the substrate of the small array image source, can be formed for transparent dielectric material, so that gap location is without pixelPenetrate external environment light to keep transparent；Or opaque medium material is formed, for blocking from extraneous environmentLight makes its not micro structure array device described in directive.
The light that each valid pixel on its corresponding micro display territory element is sent out is passed through folding by microstructure unitIt penetrates or filters modulation and form it into parallel or approximately parallel spatial beam, each pixel only corresponds to the spatial light in a directionBeam, the spatial beam that all pixels are formed form spatial light field and are distributed between micro structure array device and emergent pupil.
As a kind of microstructure unit, can be selected from following any or combinations thereof：Lens, holography with focal power are thoroughlyMirror, aperture.
There is the transparent substrates of micro structure array device opposite first surface and second surface, microstructure unit to be distributed inThe first surface of transparent material substrate.
Preferably, in the marginal portion of microstructure unit or to can correspond to the part at micro-structure just edge include opaqueAnnular diaphragm, to shield stray light.
The invention further relates to a kind of nearly eye display devices based on above-mentioned light field display unit, further comprise image renderingModule, for being formed as described image information after being pre-processed with display image, by way of wired or wireless transmissionIt is input to small array image source, forms the complete picture of suitable human eye viewing in exit pupil position after micro structure array device modulationFace.
The pre-treatment step specifically rendered to described image may include：
According to the predetermined way alignment spanning subgraph as the step of, the quantity of the subgraph and described and micro displayThe quantity of territory element and microstructure unit is identical.Wherein, the generation of each subgraph meets camera model.
Light field display unit according to the present invention and nearly eye display device, due to each micro display territory element and micro-structure listThe relative position of member determines, therefore the spatial beam that the light that sends out of each pixel is formed after micro structure array is modulated is with controllableForm arranges, these space light pencils carry the color and strength information of be originated from pixel, can be used in description spaceThe position and direction of light are distributed, and restore spatial light field；The friendship of the reverse extending line of spatial beam containing identical image informationPoint is picture point formed by system, transparency gap allow external environment light to limit again in the range of across and into emergent pupil areaDomain can be realized simultaneously the display of perspective formula.
Specific implementation mode
Below in conjunction with attached drawing and specific embodiment is enumerated, the present invention is described in further detail.Art technologyPersonnel it is to be appreciated that specific name, the term etc. that are used in following each descriptions do not constitute the restriction to technical solution of the present invention, andAnd in the following description, for ease of description, identical component will use identical reference numeral.
In the following embodiments, statement " first " and " second " etc. can modify a variety of constituent element of the present invention, stillCorresponding constituent element is not limited.For example, statement does not limit sequence or importance of corresponding constituent element etc..Statement can be usedIn a constituent element is distinguished with another constituent element.For example, first user device and second user device are allUser apparatus, and represent different user apparatus.For example, the first constituent element can be named as the second constituent element without de-From spirit and scope of the present disclosure.In the same manner, the first constituent element is named as the second constituent element.
Light field display unit according to the present invention based on small array image source, may be implemented into nearly eye as indicated with 2Display device, shown in Fig. 2, nearly eye display device by glasses form it is wearable in a manner of realize, the device include be worn on headWear part, such as the Mirror frame structure including temple 12 and image rendering module 13, although in Fig. 2 in such a way that cable is externalImage rendering module is shown, but those skilled in the art understand that, image rendering module can also be placed in Mirror frame structure, orPerson connect in such a way that other can realize signal connection with display portion.Equally, the part worn can not also be confined to mirrorThe structure of posture, any light field display unit for making the present invention by wearable mode to be placed in the structure of user at the moment equalIt can be considered that the present invention's wears part.
As shown in Figure 2, light field display unit 1 of the invention is assemblied in the structure of glasses form the shape under biocular caseAs a pair, each light field display unit includes using transparent medium as the small array image source devices of substrate and with transparent mediumFor the micro structure array device of substrate.Due to the use of transparent substrates, light field display unit of the invention can put forward ambient lightFor high transmittance, the virtual reality fusion to be conveniently used in augmented reality is shown.Specifically, as shown in figure 3, in small arrayIn image source 2, it is micro display territory element 201, each micro display area to have the region of offer hundred Pixel-level of image display coveringDomain unit 201 includes that a certain number of pixels show point, and arrangement form is small-sized according to certain rules for multiple micro display territory elements 201Array of figure image source 2 constitutes region cover without pixel between each unit there are gap 202, remains transparent medium substrate, permissionLight directly passes through；In micro structure array device 3, microstructure unit 301 and the corresponding arrangement in corresponding micro display region, without micro- knotThe region 302 of structure unit covering, which remains transparent medium, allows light directly to pass through.Small array image source 2 and micro structure arrayDevice 3 is aligned in a predefined manner so that the thang-kng of the center pixel and each microstructure unit of each micro display territory element 201The line of aperture center intersects at emergent pupil center.Shown image information is by image rendering wherein in small array image source 2Module 13 generates, and small array image source 2 is located in the imaging region of micro structure array device 3, the image light in each region viaCorresponding micro-structure 301 enters the human eye 6 being located at emergent pupil 5.
Fig. 4 shows the Facad structure of small array image source 2, and each micro display territory element 201 thereon is by a set patternRule arrangement, typical arrangement mode includes but not limited to rectangular arranged or hexagonal array, i.e. multiple micro display territory elements 201The array image display area that overall structure is rectangle or hexagon is distributed on 2 light-emitting surface of image source, between each unitGap 202 is transparent medium substrate；The row of microstructure unit 301 and micro display territory element 201 on micro structure array device 3Row rule is corresponding, is 302 region of gap between each unit, equally remains transparent medium substrate.Image source 2 further includes drivingThe hardware circuit parts such as line, data line, data link, data processor (not shown), in general, in the substrate or substrateIt is interior.
Micro display territory element 201 shown in Fig. 4 is in periodic arrangement in transparent medium substrate.Arrangement described in figureMode is rectangular arrangement pattern, but not limited to this, or hexagonal array or chequered order, to improve light field space pointThe uniformity of cloth.Small array image source 2 is preferred, and the side that OLED/LED luminous points are covered in transparent medium substrate can be usedFormula makes, and wherein the material of transparent medium substrate may be but not limited to resin material or glass material.OLED/LED luminous pointsThe part of covering is opaque region, as micro display territory element 201.
The small array image source 2 of the present invention may be implemented by customizing the miniature screens of OLED.In general, being made using ito glassFor base material, anode and cathode 203 is in the distribution of grouping raster pattern and orthogonal arrangement.Between each group of anode and cathode 203There are larger gap, luminescent layer is not deposited, light is allowed to pass through, and the inside of every group of cathode or anode 203 then close-packed arrays, it hands overWrong position is then the position of pixel, and the set that every group of cathode or anode 203 interlock is the position of micro display territory element 201It sets, under the prior art, resolution ratio is smaller (such as 50 × 50), but higher pixel density (PPI) is conducive to obtain more refinementGreasy display effect, but then there is higher manufacture difficulty to small array image source.Each pixel contains complete OLEDStructure, it can be monochromatic light or colourama to have spontaneous light ability, the light sent out, be in externally opaque.To keep perspective formulaDisplay capabilities and reconstruction light field ability, each 201 support size of micro display territory element should not exceed 1mm (with the square length of sideIt calculates).Small array image source 2 can also use similar mode to be realized as luminescence unit with micro LED, and cathodeArrangement mode with anode 203 can be other arrangement modes other than orthogonal arrangement, such as hexagonal array or checkerboard arrangement.The display of pixel is driven by the circuit 204 around array, and data source is image rendering module 13, by wired connection or wirelesslyThe mode of connection is transmitted.Circuit 204 is partially due to be not involved in display, therefore can be in opaque, but visual in order to expandRange can take technique appropriate to keep its presentation transparent.
Fig. 5 shows the structural schematic diagram in 3 imaging function region of micro structure array device corresponding with Fig. 4, is omitted in figureThe structure unrelated with imaging function.The substrate of device 3 is also transparent dielectric material, including but not limited to resin material or glassThe shape of material, substrate can be parallel flat or the shape with diopter, and the arrangement rule of microstructure unit 301 is shown with micro-Show that territory element 201 is corresponding.For being formed as micro-structure using the device with focal power, such as lenticule or hololensWhen unit 301, the light-emitting area of micro display territory element 201 should be at the front focal plane of corresponding microstructure unit 301 or precedingNear focal plane, the light that each pixel is sent out forms collimated light beam or less parallel light beam after microstructure unit is modulated.ForImaging definition is improved, the bore for the light beam that the light that each pixel is sent out is formed by microstructure unit should be less than 1mm, i.e., excellentChoosing, so that micro display territory element 201 is emitted light to microstructure unit 301 in a directional manner.
Fig. 6 shows the method for determination of 5 range of emergent pupil.5 range of emergent pupil by solve external environmental light 7 only by small-sizedThe range in 202 region of gap of array of figure image source 2 and 302 region of gap of micro structure array device 3, the weight of all such rangesFolded part defines the position (eyebox) that pupil can move, using bore maximum as the position where emergent pupil 5.From geometryOn see, take the line of the lower edge of corresponding with its microstructure unit of the lower edge of each micro display territory element 201 301, instituteThere is the intersection point of these lines to define the top edge of emergent pupil 5；Take top edge and the microstructure unit of micro display territory element 201The line of 301 top edge, the intersection point of all these lines determine the lower edge of emergent pupil 5.Within this range, human eye 6 is seenThe external environmental light 7 observed can only be between 202 region of gap and micro structure array device 3 through small array image source 2The part in 302 region of gap.For nearly eye display device, emergent pupil 5 is apart from close to its 3 outermost table of micro structure array deviceDistance (eye relief) the about 20mm in face.
Although display device shown in Fig. 2 is binocular display devices, right and left eyes correspond to a light field display unit 1 respectively.But those skilled in the art understand that, which can also realize in the form of monocular is shown, and can also cancel substrateTransparent characteristic and shield true environment light and shown (virtual reality) to be readily applicable to the immersion of non-penetrating type.Equally, light field display unit 1 according to the present invention is not the display for being only available for nearly eye, is readily applicable to big display sizeWindow-glass, windshield, showcase and other mobile devices etc. at this time want the pixel density (PPI) of array image source 2Asking will reduce, and the bore of corresponding lenticule can increase, and the emergent pupil 5 determined is apart from close to its micro structure array device 3The distance (eye relief) of outermost surfaces can be adjusted to that infinity.Although only including the micro display region list of single pixelMember 201 can also realize display in the case of large scale low PPI, but for embodying the effect that light field is shown, singleIt is right that at least 2 × 2 pixel quantity is kept in micro display territory element 201.
Fig. 7 shows the display mode of the virtual information provided from rendering module.It is each on micro display territory element 201The light that pixel is sent out is after the modulation of corresponding microstructure unit 301, with collimated light beam or the formal distribution of less parallel light beamBetween micro structure array 3 and emergent pupil 5, the position at the position of each pixel and corresponding micro-structure center determines the light beamPosition and direction, therefore each virtual image point can be defined with different location in light field 8 and the light beam in direction.For by imageThe light beam corresponding to pixel that same point in information renders, the reverse extending line of their chief ray is in image space phaseIt meets at a bit, i.e., the formed virtual image.According to the difference of these light angles, which can generate the virtual image point at closer distance901 or compared with distant location virtual image point 902.
Image rendering module is according to the distribution of spatial light field, i.e. pair of the pixel of small array image source and space light pencilIt should be related to (i.e. a camera model), the light pencil and three-dimensional virtual object table are assigned to each pixel of small array image sourceThe gray value in each channel, each to generate in gray value (when being shown for monochrome)/each color channel (such as RGB) of face point of intersectionThe subgraph that micro display territory element is shown, the parameters such as field angle, boresight direction and viewpoint position involved in camera model byThe size of micro display territory element 201, the spacing distance of small array image source 2 and micro structure array device 3 and center connectThe distribution of line 4 determines.For example, in common OpenGL, each pair of micro display territory element-microstructure unit combination can be considered asOne view frustums assigns a projection matrix；The viewpoint of these view frustums is located at the geometric center of microstructure unit, the optical axisOn the geometric center line of micro display territory element and microstructure unit, and intersect at emergent pupil center.View frustums are with micro displayTerritory element is nearly cutting plane, and yonder clipping plane can be situated in any position at a distance.
Meanwhile image rendering module can also carry out intensity again to the subgraph of each micro display territory element 201Modulation.For all pixels point in each micro display territory element 201, further away from center pixel position, then existOn retina when refocusing, it is easier with close on the light that micro display territory element 201 is sent out and overlap, therefore can be according to pictureDistance of the vegetarian refreshments apart from each 201 center pixel of micro display territory element weakens the brightness of pixel, to reduce lightBrightness caused by overlapping is significantly raised, improves picture uniformity.
In the present invention, the intensity of ambient light 7 and the intensity of image information light are conflict amount.When image source brightness is certainWhen, the two be in shifting relationship, intensity by gap area 302 3 during micro-structure on area duty ratio determine,It can be adjusted by changing the duty ratio.In order to reach better display effect, it is preferred that make in small array image source 2It is fixed that the area of region A defined in outermost micro display territory element 201 is more than outermost micro-structure on micro structure array device 3The area (i.e. area A is more than area B) of the outer edge area B of justice, B is compared at interval 202 as shown in Figures 4 and 5, also, in a-quadrantInterval 302 in region is big.
Since the distance of the light source distance human eye 6 of ambient light 7 is very big for the size of micro structure array device 3,It is incident to be considered as less parallel light, therefore, suction of each transparent medium itself to light in light field display unit 1 can be ignoredIt receives, ambient light 7 is typically considered to parastate incidence, and transmitance is approximately equal to 3 intermediate gap region 302 of micro structure array deviceArea duty ratio.And the intensity for the image information that image rendering module provides is in addition to that can pass through each microstructure unit of change301 clear aperture is adjusted, and can also be adjusted by changing the pixel intensity of small array image source 201.To ensureShow quality, when under nearly eye dispaly state, 1mm is not to be exceeded in 301 maximum scale of each microstructure unit.Due to human eye6 pupil diameter generally between 2~8mm, therefore no matter when, can receive and be sent out from small array image source 2 simultaneouslyAnd through micro structure array device 3 modulate light and from external environment and across light field display unit 1 light.
Due to the presence of various structures and registration problems, light field display unit 1 may bring stray light, Fig. 8 to show to beingIt unites the analysis of stray light that may be present.If keeping obtaining the display effect of not stray light completely under the premise of without diaphragmFruit then requires microstructure unit to have larger bore so that the light that micro display territory element 201 is sent out is entering emergent pupil 5It can all be modulated before by microstructure unit 301.But under general manufacturing process and display effect limitation, especially forFor microstructure unit 301 with focal power, bore is usually less than the ideal dimensions, therefore in light by micro display regionWhen unit 201 sends out simultaneously directive micro structure array device 3, some light may be from the gap area other than microstructure unit 301302 enter 5 range of emergent pupil, just form stray light 10 and are received by human eye 6.The characteristics of stray light 10 is further away from 5 center of emergent pupilPosition it is stronger.In this regard, preferred processing mode is to adjust the parameter that each structure is related in light field display unit 1, such as cut down5 size of emergent pupil, or adjust rear cut-off distance (eye relief) etc., to weaken the stray light 10 for actually entering human eye 6.When stray light 10The illumination of maximum in 5 range of emergent pupil account for the ratio of the average illumination of normal light field in a certain threshold value (such as 50%) hereinafter,And illumination of the stray light 10 at 5 center of emergent pupil account for the ratio of the average illumination of normal light field a certain threshold value (such as 10%) belowWhen, it is believed that stray light 10 is distributed in the receptible range of human eye institute.It will be appreciated by those skilled in the art that, it reduces5 range of emergent pupil make that there is higher transmitance to external environmental light 7, but the wearer's difficulty for also leading to adapt to different interpupillary distances increasesInterpupillary adjustment mechanism can be added by, which adding, realizes the position of emergent pupil 5 and being registrated for user's human eye 6.
For this purpose, present invention further proposes a kind of modes for the stray light that disappears as shown in Figure 9：In micro structure array 3Increase lighttight ring plated film around 302 upper edge microstructure unit 301 of gap area or by way of installing mechanical structure additionalShape diaphragm 303 makes original stray light 10 be absorbed or reflected before being emitted by micro structure array device 3, to not enter5 region of emergent pupil.Plated film can be reflectance coating or absorbing film.It adds annular diaphragm 303 to be conducive to expand the size of emergent pupil 5, moreAdditional interpupillary adjustment mechanism be may not need in the case of number to match the interpupillary distance of wearer, improve wearing and observation comfort level.ThisWhen, should not include the region that is covered of diaphragm for the interval 302 in B area, i.e., on micro structure array 3 between be divided into figureAs the light transmission part of no modulating action, it is preferred that 30% of B area or more is accounted for, to ensure the transmission to ambient image.And the areas AEach lightproof part in domain shows the micro display territory element 201 of subgraph, than area defined in diaphragm outmost turnsIt is small.
When light field display unit 1 according to the present invention can be implemented as spectacle as shown in Figure 2 nearly eye display device, eyeThe circuit and other signal processors, sensor of driving small array image source can be further fitted with inside the frame 12 of mirrorDeng light field display unit 1 corresponds to right and left eyes 6 respectively, and the contradictory binocular real tri-dimension vision of no influx-focusing may be implemented.
Alternatively, the invention also includes a kind of perspective formula displaying scheme based on array of orifices, such as Figure 10It is shown.Wherein microstructure unit 301 by no focal power keyhole formation so that the light sent out by micro display territory element 201Subtended angle is limited in smaller range after aperture, and to embody directionality, distribution forms light field.Further, eachOne annular diaphragm 303 is set around aperture, and the light to being directly entered emergent pupil without small holes shields, and is disappeared with realization miscellaneousAstigmatism.
Although the substrate of micro structure array device 3 is shown in the above-mentioned technical proposal of the present invention in a manner of tablet,Without being limited thereto, the substrate of micro structure array device 3 can be formed to have the form of focal power, as shown in figure 11, at this point, thisVision correction when the light field display unit of invention is supported to wearer's environment of observation light.Specifically, both sides have different sides typeAnd substrate of the eyeglass 11 with focal power as micro structure array device 3.Microstructure unit 1101 is in eyeglass 11 towards smallThe surface of type array of figure image source, annular diaphragm 1103 is on another surface of eyeglass 11.When observation, the light of extraneous true environmentCan by the transparent substrates portions incident to eyeglass 11 of small array image source, while being passed through by gap area 1102 byTo the refraction of 11 focal power of eyeglass, to realize the vision correction for external environment light.And micro display territory element 201 is sent outThe light gone out passes through eyeglass 11 after the modulation of micro-structure 1101, while also by the refraction of eyeglass 11, to realize for virtualThe vision correction of information.
Figure 12 shows a kind of AR application modes based on light field display unit of the present invention, since the light field of the present invention is shownUnit can realize that human eye influx is consistent with focus state, therefore can be by (the image of corresponding each pixel of virtual information 16Information) it renders in any position, i.e., the virtual image light that human eye receives, which seems, to be sent out by any specified positionHuman eye is eventually entered into, in the application mode, human eye can be moved in the position 601,602 in true environment, use the present inventionThe nearly eye display device of light field display unit always can then render virtual information according to the position of human eye of the feedbacks such as sensorOn the position consistent with real-world object 15 so that no matter human eye on hand 601 still 602 is seen a long way off within 0.5 meterWhen examining virtual information, comfortable state can be kept for a long time, and it is consistent clear to ensure that virtual information and true environment haveClear degree.
Light field display unit according to the present invention, when augmented reality mode is shown, micro display territory element is in substrateSurface, itself is opaque, and the external environment light in micro display territory element region is incident on by micro- aobvious from outer surfaces of substratesShow blocking for device and can not be incident on micro structure array, to external environment light can and be merely able to be directed through it is transparentThe gap of medium substrate is incident on micro structure array, is avoided stray light and common is closed by the way of the transflection spectro-filmAt the loss of true environment light when virtual image and true environment light.Within the scope of emergent pupil, only include through small array figureThe external environment light in the gap of image source and by the modulated virtual image of microstructure unit, and virtual image appears to be simulationIts true position that occurs occurs and injects human eye, keeps virtual reality fusion truer.
Although the preferred embodiment has been described in detail, it should be understood that the present invention can be with many differentForm is realized and should not be construed as limited by each embodiment set forth herein.Those skilled in the art is contemplated that these realitiesApply the modification and adjustment of example, the scope of the present invention proposed without departing from such as appended claims.