US20010043163A1 - Method of and apparatus for viewing an image - Google Patents

Abstract

Light from an image displayed on a display screen10is transmitted to an observer's eye11by way of a dynamic optical element12(such as a spatial light modulator or an electrically switchable holographic composite) which acts as a lens. The characteristics of the dynamic optical element12can be altered so that it acts sequentially to direct light of different colors to the observer's eye.

In one optional embodiment emitters17on the display screen10emit infra-red radiation which is projected by the dynamic lens12as a broad wash onto the eye11.Infra-red radiation reflected back from the eye11is focussed by the dynamic lens12onto detectors18also provided on the display screen10.The detectors18are thus able to sense the direction of eye gaze, and the dynamic lens12is controlled in dependence on this to create an area of high resolution in an area of interest centered on the direction of gaze, which is moved to follow the eye gaze as its direction alters. Other than in the area of interest, the dynamic lens12has a relatively low resolution.

Description

FIELD OF THE INVENTION
• This invention relates to a method of and apparatus for viewing an image.[0001]
BACKGROUND OF THE INVENTION
• In head-mounted optical displays (such as are used in the recreation industry for viewing virtual reality images), it has been the practice to project an image to be viewed into the observer's eyes using conventional refractive and reflective optical elements, i.e. lenses and mirrors. However, in head-mounted displays where weight and size are major considerations it is normally possible to provide only a very small field of view by this means, which is a disadvantage when it is desired to provide the observer with the sensation of being totally immersed in a virtual world. In an attempt to overcome this problem, it has been proposed to use so-called “pancake windows”. i.e. multi-layer devices which use polarisation and reflection techniques to simulate the effect of lenses and mirrors. However, such devices suffer from the problem that they have low transmissivity.[0002]
• Particularly with the factors of size and weight in mind, wide field optics designs have turned to diffractive optical solutions. It is known that diffractive techniques can be used to simulate the effect of a lens, by reducing the profile to a kinoform (FIGS. 1 and 2) or by the use of fixed surface or volume holograms. However diffractive optics have always suffered from extreme chromatic aberration when used in full colour imaging systems. Correction methods which have included multiplexing holograms recorded with different wavelengths in a single emulsion have been suggested. Such schemes still exhibit residual crosstalk between the colour channels which makes them inappropriate for high quality imaging systems.[0003]
• Additionally, wide fields of view lead to problems in other forms of aberration correction, as well as difficulties in supporting the data bandwidth required to support high resolution across the entire field of view.[0004]
SUMMARY OF THE INVENTION
• It is an object of the present invention to provide a method of and apparatus for viewing images which improve on the techniques described above.[0005]
• According to a first aspect of the present invention, there is provided a method of viewing an image, the method comprising transmitting an image into an eye of an observer by means of a dynamic optical device, the dynamic optical device being operative to create a modulation in respect of at least one of phase and amplitude in light transmitted or reflected thereby, said modulation being variable from one point or spatial region in the optical device to another, and wherein the modulation at any point or spatial region can be varied by the application of a stimulus, and altering the characteristics of the dynamic optical device so that the dynamic optical device acts sequentially to direct light of different colours to the observer's eye.[0006]
• The expression “transmitting an image” is intended to include the formation of a virtual aerial image at some point, or the projection of a real image onto the surface of the observer's retina.[0007]
• According to a second aspect of the present invention, there is provided apparatus for viewing an image, comprising a dynamic optical device, the dynamic optical device being operative to create a modulation in respect of at least one of phase and amplitude in light transmitted or reflected thereby, said modulation being variable from one point or spatial region in the optical device to another, and control means operative to apply a stimulus to the dynamic optical device, whereby the modulation at any point or spatial region can be varied, the control means being operative to alter periodically the characteristics of the dynamic optical device so that the device acts sequentially to direct light of different colours to the observer's eye.[0008]
• The dynamic optical device can comprise a succession of layers which are configured to act upon the primary wavelengths, respectively, or the different colour channels may all be embodied in the one layer of the dynamic optical device.[0009]
• Moreover, the optical power (focal length), size, position and/or shape of the exit pupil and other optical parameters can also be controlled.[0010]
• The above-described method and apparatus allow the provision not only of a relatively wide field of view, but also a large exit pupil, a movable exit pupil of variable shape, and high resolution.[0011]
• Conveniently, the dynamic optical device comprises a spatial light modulator containing an array of switchable elements in which the optical state of each element can be altered to create a change in phase and/or amplitude in the light incident thereon. Alternatively, the dynamic optical device can comprise an array of switchable prerecorded holographic elements, wherein more complex phase functions can be encoded within the holograms. In this case, the dynamic optical device can also comprise non-switchable holographic elements.[0012]
• Advantageously, the dynamic optical device comprises an electrically switchable holographic composite.[0013]
• Desirably, the dynamic optical device is used in a range in which the phase and/or amplitude modulation varies substantially linearly with applied stimulus.[0014]
• The dynamic optical device is preferably used in a range in which it does not substantially affect the amplitude and/or wavelength characteristics of the light transmitted or reflected thereby.[0015]
• The dynamic optical device can be in the form of a screen adapted for mounting close to the observer's eye. The screen can be of generally curved section in at least one plane. Alternatively, for ease of manufacture, the screen may be planar. Conveniently, the apparatus also comprises means for engaging the screen with the observer's head in a position such that the curve thereof is generally centred on the eye point.[0016]
• In one arrangement, the dynamic optical device acts upon light transmitted therethrough, and the image generator is located on a side of the dynamic optical device remote from the intended position of the observer's eye. In an alternative arrangement, the dynamic optical device acts upon light reflected thereby, and the image generator is at least partially light-transmitting and is located between the dynamic optical device and the intended position of the observer's eye.[0017]
• The apparatus may include image generation means configured off-axis from the general direction of the observer's eye in use. In that case, the image generation means can be non-light transmitting.[0018]
• In one arrangement, the dynamic optical device comprises a plurality of discrete optical elements in close juxtaposition to each other, each of which acts as an individual lens or mirror. Conveniently, some of the discrete optical elements act to direct to the observer's eye light of one Colour, while others of the discrete optical elements act to direct to the observer's eye light of other colours.[0019]
• In one preferred embodiment of the invention, the apparatus may comprise left and right image generation means, left and right dynamic optical devices and left and right side portions within which said left and right image generation means are housed, said left and right image generation means being operative to project towards said left and right dynamic optical devices respectively, thereby displaying a binocular image. The apparatus can also be arranged to provide for the full range of accommodation and convergence required to simulate human vision, because the parameters governing the factors can be altered dynamically.[0020]
• Advantageously, the dynamic optical device functions to correct aberrations and/or distortions in the image produced by the image generator. The dynamic optical device can also function to create a desired position, size and/or shape for the exit pupil.[0021]
• The method may further comprise the steps of controlling the characteristics of the dynamic optical device to create an area of relatively high resolution in the direction of gaze of the observer's eye, the dynamic optical device providing a lesser degree of resolution of the image elsewhere, and sensing the direction of gaze of the observer's eye and altering the characteristics of the dynamic optical device in accordance therewith, so that the area of relatively high resolution is repositioned to include said direction of gaze as the latter is altered.[0022]
• The apparatus may further comprise sensing means operative to sense the direction of gaze of the observer's eye, and the control means being operative on the dynamic optical device to create an area of relatively high resolution in said direction of gaze, the dynamic optical device providing a lesser degree of resolution of the image elsewhere, the control means being responsive to the sensing means and being operative to alter the characteristics of the dynamic optical device to move said area of relatively high resolution to follow said direction of gaze as the latter is altered.[0023]
• Moreover, in accordance with a third aspect of the invention, there is provided apparatus for viewing an image, comprising a dynamic optical device, the dynamic optical device being operative to create a modulation in respect of at least one of phase and amplitude in light transmitted or reflectual thereby by means of which the observer's eye views an image in use. sensing means operative to sense the direction of gaze of the observer's eye, and control means which acts on the dynamic optical device to create an area of relatively high resolution in said direction of gaze, the dynamic optical device providing a lesser degree of resolution of the image elsewhere, the control means being responsive to the sensing means and being operative to alter the characteristics of the dynamic optical device to move said area of relatively high resolution to follow said direction of gaze as the latter is altered.[0024]
• It will be appreciated that the features identified above as being preferred features of the second aspect of the invention may also be incorporated into the apparatus of the third aspect of the invention.[0025]
• Preferably, the sensing means utilises radiation which is scattered from the observer's eye and which is detected by detector means, and the dynamic optical device may also function to project said radiation onto the eye and/or to project to the detector means the radiation reflected by the eye.[0026]
• Conveniently, the sensing means includes a plurality of sensors adapted to sense the attitude of the observer's eye, the sensors being positioned in or on the dynamic optical device and/or the image generator.[0027]
• Preferably, the sensing means comprises emitter means operative to emit radiation for projection onto the observer's eye and detector means operative to detect radiation reflected back from the eye.[0028]
• Desirably, the sensing means utilises infra-red radiation. In this case the dynamic optical device can be reconfigured to handle visible light on the one hand and infra-red radiation on the other.[0029]
• The apparatus can further comprise at least one optical element provided in tandem with the dynamic optical device, which acts upon infra-red light but not upon visible light.[0030]
• The detector means can be provided on a light-transmitting screen disposed between the image generator and the dynamic optical device.[0031]
• Conveniently, a reflector is disposed between the image generator and the light-transmitting screen, and is operative to reflect the infra-red radiation whilst allowing transmission of visible light, such that the infra-red radiation after reflection by the observer's eye passes through the dynamic optical device and the light-transmitting screen, and is reflected by said reflector back towards the screen.[0032]
• In cases where the sensing means operates on infra-red principles, it is necessary to focus onto the detectors the returned infra-red radiation after reflection from the observer's eye. Although it is possible to employ for this purpose the same optical elements as are used to focus the image light onto the observer's eye, the disparity in wavelength between visible light and infra-red radiation means that this cannot always be achieved effectively. According to a development of the invention, the sensing function is performed not by infra-red radiation but rather by means of visible light. The light can be rendered undetectable by the observer by using it in short bursts. Alternatively, where the emitter means is provided at pixel level in the field of view, the wavelength of the light can be matched to the colour of the surrounding elements in the image. As a further alternative, the light can be in a specific narrow band of wavelengths. This technique also has applicability to viewing apparatus other than that including dynamic optical devices, and has a general application to any apparatus where eye tracking is required.[0033]
• Preferably, the emitter means and/or the detector means are provided on a light-transmitting screen disposed between the image generator and the dynamic optical device.[0034]
• Desirably, the image generator is in the form of a display screen, and the emitter means and/or the detector means are provided in or on the display screen.[0035]
• Conveniently, the emitter means are provided in or on the display screen, a beamsplitter device is disposed between the display screen and the dynamic optical device and is operative to deflect radiation reflected by the observer's eye laterally of the main optical path through the apparatus, and the detector means are displaced laterally from the main optical path.[0036]
• Where the image generator produces a pixellated image, the emitter means and/or detector means can be provided at pixel level within the field of view.[0037]
• Advantageously, the image generator and the dynamic optical device are incorporated into a thin monolithic structure, which can also include a micro-optical device operative to perform initial bean shaping. The monolithic structure can also include an optical shutter switchable between generally light-transmitting and generally light-obstructing states.[0038]
• The apparatus can further comprise means to permit the viewing of ambient light from the surroundings, either separately from or in conjunction with the image produced by the image generator. In this case, the image generator can include discrete light-emitting elements (such as lasers or LEDs) which are located on a generally light-transmitting screen through which the ambient light can be viewed.[0039]
• Preferably, the light-emitting elements of said device are located at the periphery of said screen, and the screen acts as a light guide member and includes reflective elements to deflect the light from the light-emitting elements towards the dynamic optical element.[0040]
• Desirably, the image generator is in the form of a display panel, and the panel is mounted so as to be movable between a first position in which it confronts the dynamic optical device and a second position in which it is disposed away from the dynamic optical device.[0041]
• In an alternative arrangement, the image generator is in the form of a display screen and displays an input image, and the apparatus further comprises detector means operative to sense the ambient light, a processor responsive to signals received from the detector means to display on the display screen an image of the surroundings, and means enabling the display screen to display selectively and/or in combination the input image and the image of the surroundings.[0042]
• In one particular arrangement, the image generator comprises an array of light-emitting elements each of which is supplied with signals representing a respective portion of the image to be viewed, wherein the signals supplied to each light-emitting element are time-modulated with information relating to the details in the respective portion of the image, and the area of relatively high resolution is produced by means of the dynamic optical device switching the direction of the light from the light-emitting elements in the region of the direction of gaze of the observer's eye.[0043]
• The apparatus can further comprise tracking means operative to track the head positions of a plurality of observers, and a plurality of sensing means each of which is operative to detect the direction of eye gaze of a respective one of the observers, with the dynamic optical device being operative to create a plurality of exit pupils for viewing of the image by the observers, respectively.[0044]
• The image produced by the image generator can be pre-distorted to lessen the burden on the dynamic optical device. In this case, the distinction between the image display and the dynamic optical device is less well defined, and the functions of the image generator and the dynamic optical device can be combined into a single device, such as a dynamic hologram. More particularly, a spatial light modulator can be used to produce a dynamic diffraction pattern which is illuminated by one or more reference beams.[0045]
• Preferably, said image for viewing by the observer is displayed on a display screen, which can be of generally curved section in at least one plane. The apparatus can further comprise means for engaging the display screen with the observer's head in a position such that the curve thereof is generally centred on the eye point.[0046]
• The apparatus can form part of a head-mounted device.[0047]
• In a preferred arrangement as described above, the dynamic optical device functions not only to focus image light onto the observer's eye, but also to project radiation from the emitters onto the eye, and/or to project the radiation reflected by the eye onto the detectors. According to a fourth aspect of the present invention, this general technique can be applied to viewing apparatus in which conventional optics rather than a dynamic optical device are employed.[0048]
• Thus, according to the said fourth aspect of the invention, viewing apparatus comprises an image generator operative to generate an image for viewing by an observer's eye, an optical system for transmitting said image to the observer's eye position, sensing means operative to sense the direction of gaze of the observer's eye, and control means responsive to the sensing means and operative to act on the image generator and/or the optical system to modify said image transmitted to the eye in accordance with the direction of gaze of the eye, the sensing means including emitter means operative to emit radiation for projection onto the observer's eye, and detector means operative to detect said radiation after reflection by said eye, the optical system also functioning to transmit said radiation from the emitter means onto said eye and/or to transmit said radiation reflected from said eye to the detector means.[0049]
• Preferably, said radiation comprises infra-red radiation.[0050]
• In a particular arrangement, the optical system includes at least one optical element which acts upon both visible light and infra-red radiation, and at least one second optical element which acts upon infra-red radiation but not upon visible light. In this way, the optical system can have a different focal length for visible light than that for infra-red radiation.[0051]
• In one embodiment, the detector means (and preferably also the emitter means) are provided on a light-transmitting screen disposed between the image generator and the optical system. Desirably, a reflector (such as a holographic/diffractive reflector or a conventional dichroic reflector) is disposed between the image generator and the light-transmitting screen, and is operative to reflect the infra-red radiation whilst allowing transmission of visible light, such that the infra-red radiation after reflection by the observer's eye passes through the optical system and the light-transmitting screen, and is reflected by said reflector back towards the screen.[0052]
• In the case where the image generator is in the form of a display screen, the emitter means and/or the detector means can be provided in or on the display screen. Alternatively, the emitter means can be provided in or on the display screen, a beamsplitter device can be disposed between the display screen and the optical system so as to deflect infra-red radiation reflected by the observer's eye and passing through the optical system laterally of the main optical path through the apparatus, and the detector means can be displaced laterally from said main optical path.[0053]
• Advantageously, the image generator generates a pixellated image, and the emitter means and/or the detector means are provided at pixel level.[0054]
• In a preferred arrangement as described above, the sensing means comprises emitters and detectors provided at pixel level within the field of view. According to a fourth aspect of the present invention, this general technique can be applied to viewing apparatus in which conventional optics rather than a dynamic optical device are employed.[0055]
• Thus, according to the said fourth aspect of the invention, viewing apparatus comprises an image generator operative to generate an image for viewing by an observer's eye, an optical system for transmitting said image to the observer's eye position, sensing means operative to sense the direction of gaze of the observer's eye, and control means responsive to the sensing means and operative to act on the image generator and/or the optical system to modify said image transmitted to the eye in accordance with the direction of gaze of the eye, the sensing means including emitter means operative to emit radiation for projection onto the observer's eye, and detector means operative to detect said radiation after reflection by said eye, the emitter means and/or the detector means being provided at pixel level within the field of view of the image.[0056]
• Particularly in the case where the image generator is in the form of a display screen, the emitter means and/or the detector means can be provided at pixel level in or on the display screen. Alternatively, the emitter means and/or the detector means can be provided at pixel level on a light-transmitting screen disposed between the image generator and the optical system.[0057]
• Preferably, said radiation comprises infra-red radiation.[0058]
• In a particular arrangement, the optical system includes at least one optical element which acts upon both visible light and infra-red radiation, and at least one second optical element which acts upon infra-red radiation but not upon visible light. In this way, the optical system can have a different focal length for visible light than that for infra-red radiation.[0059]
BRIEF DESCRIPTION OF THE DRAWINGS
• The invention will now be further described, by way of example only, with reference to the remaining Figures of the accompanying drawings, in which:[0060]
• FIG. 1 is a schematic view of a kinoform lens of known type;[0061]
• FIG. 2 is a graphical arrangement of a kinoform lens, demonstrating how the lens can be implemented in practice;[0062]
• FIG. 3 is a general arrangement drawing illustrating a viewing apparatus and method according to the present invention;[0063]
• FIG. 4 is a schematic view of a first embodiment of viewing apparatus according to the present invention:[0064]
• FIG. 4A is a detail of part of the apparatus shown in FIG. 4;[0065]
• FIGS. 4B to[0066]7 are graphs illustrating various characteristics of the apparatus of FIG. 4;
• FIG. 8 is a schematic view of a modification to the first embodiment of the viewing apparatus;[0067]
• FIG. 8A is a detail of part of the apparatus shown in FIG. 8;[0068]
• FIG. 9 is a schematic view of a second embodiment of viewing apparatus according to the present invention;[0069]
• FIG. 10 is a schematic view of a modification to the second embodiment of the viewing apparatus;[0070]
• FIG. 11 illustrates a third embodiment of viewing apparatus according to the invention, which uses an electrically switchable holographic composite (ESHC);[0071]
• FIGS. 11A and 11B illustrate the operation of the ESHC;[0072]
• FIGS. 12 and 13 illustrate the use of an alternative form of image generator in the apparatus;[0073]
• FIGS. 14 and 15 show arrangements enabling the viewing of the surroundings in addition to a displayed image;[0074]
• FIGS.[0075]16 to18 are schematic views of further embodiments of viewing apparatus according to the invention, showing in particular an eye tracker;
• FIG. 19 is a diagram illustrating the general principle of a dynamic optical device as embodied in the viewing apparatus;[0076]
• FIG. 20 is a diagram illustrating the use of a dynamic hologram;[0077]
• FIGS. 21 and 21A illustrate the use of planar display screens and dynamic optical devices;[0078]
• FIG. 22 is an exploded perspective view of apparatus for viewing an image, employing an ESHC as the dynamic optical device;[0079]
• FIG. 23 is a schematic section through the apparatus shown in FIG. 22;[0080]
• FIG. 24 is a schematic sectional view of an arrangement wherein the apparatus is of generally curved configuration;[0081]
• FIG. 25 is a schematic sectional view of another embodiment of the apparatus;[0082]
• FIG. 26 is a schematic sectional view of part of an image generator;[0083]
• FIGS. 27A, 27B and[0084]27C are schematic views of different optical arrangements for the apparatus;
• FIG. 28 is a schematic view of apparatus for use by multiple observers;[0085]
• FIGS. 29 and 30 are schematic plan views of apparatuses for use in displaying stereoscopic images;[0086]
• FIGS.[0087]31 to35 show a further embodiment of viewing apparatus according to the present invention, and
• FIGS. 36.[0088]36A and36B show a modification of the embodiment depicted in FIGS.31 to35.
• FIG. 37 is a perspective schematic diagram of a further specific embodiment of apparatus in accordance with the invention;[0089]
• FIG. 38 is a plan view of the apparatus illustrated in FIG. 37;[0090]
• FIG. 39 is a plan view of a yet further specific embodiment of apparatus in accordance with the invention; and[0091]
• FIG. 40 is a view of the dynamic optical device of the apparatus illustrated in FIG. 39. in use, in the direction indicated by arrows X in FIG. 39;[0092]
DESCRIPTION OF THE PREFERRED EMBODIMENTS OF THE INVENTION
• Referring to FIG. 3, there is shown a general arrangement of viewing apparatus which comprises a[0093]display screen10 on which is displayed an image to be viewed by aneye11 of an observer. Interposed between thedisplay screen10 and theeye11 is a dynamic optical element (in this case, a lens) in the form of ascreen12. The dynamic lens comprises a spatial light modulator (such as a liquid crystal device) to which a stimulus is applied by a control device13 to create an area of relatively high resolution in the direction of gaze of theeye11, the remaining area of the modulator providing a lesser degree of resolution. Sensing means14 is operative to sense the attitude of theeye11, and the control device13 is responsive to signals received from the sensing means14 and alters the characteristics of the modulator so that the area of relatively high resolution is moved so as to follow the direction of gaze of the observer'seye11 as this is altered.
• The apparatus and its characteristics will now be described in more detail. Although the described apparatus is intended for use in a head-mounted device for viewing virtual reality images, it will be appreciated that the apparatus has many other uses and applications as well.[0094]
• In the ensuing description,. reference will be made to the apparatus as being applied to one of the observer's eyes. However, when used for virtual reality applications, two such apparatuses will in fact be provided, one for each eye. In this case, the respective display screens can (if desired) be used to display stereoscopic images to provide a 3-D effect to the observer.[0095]
• FIGS. 4 and 4A show a first actual embodiment of the viewing apparatus, wherein similar components are designated by the same reference numerals as used in FIG. 3. However, the control device[0096]13 and the sensing means14 are omitted for the sake of clarity. In this embodiment, thedisplay screen10 and thescreen12 are each of curved configuration and are centred generally on the rotation axis of the observer'seye11.
• The spatial light modulator comprising the[0097]screen12 can operate on phase and/or amplitude modulation principles. However, phase modulation is preferred because amplitude modulation devices tend to have relatively low light efficiency. The modulator has a phase modulation depth of not less than 2 and its phase shift varies linearly with applied voltage.
• The aperture and focal length of the dynamic lens formed by the spatial light modulator, are dictated by the resolution of the modulator. The form of the lens is modified in real time, allowing the focal length to be changed so that conflicts between accommodation and convergence can be resolved. In addition, focus correction for different users can be carried out electronically rather than mechanically.[0098]
• The dynamic lens is intended to provide an area of interest (AOI) field of view, the AOI being a high resolution region of the field of view that corresponds to the instantaneous direction of gaze of the observer's eye. By reducing the size of the AOI, certain benefits arise such as minimising the amount of imagery that needs to be computed for display on the[0099]screen10 at any instant, improving the image quality by allowing the dynamic lens to operate at low field angles, and increasing the effective image brightness and resolution of the display. FIG. 4B shows in graphic form the variation of resolution across the AOI.
• Normally, the optics required to achieve human visual fields of view involve very complex optical designs consisting of many separate lens elements. The concept employed in the present invention achieves economy of design by using an adaptive lens in which its transform is recomputed for each resolution cell of the field of view. Furthermore, since the dynamic lens is used with a device (eye tracker) which senses the attitude of the observer's eye, only a modest AOI is required. Accordingly, the form of the lens is simplified, although separate lens forms are required for each increment in the field of view to ensure that collimation is preserved over the entire field of view.[0100]
• The diffractive principles employed by the spatial light modulator are ideally suited to correcting for monochromatic aspheric and high order spherical aberrations, distortion, tilt and decentring effects. However, since diffractive structures suffer from chromatic aberration, it is necessary to compute separate forms for each wavelength, and in particular to re-compute the diffraction pattern for each of the primary wavelengths used in the display. For example, in one arrangement the dynamic optical device is configured to produce an array of discrete micro-lenses in close juxtaposition to each other, with some of the micro-lenses acting to direct to the observer's eye red light, whilst other micro-lenses act to direct green and blue light to the observer's eye, respectively. In a second arrangement, the characteristics of the dynamic optical device are altered periodically so that, at least in the area of high resolution, it acts to direct to the observer's eye red, green and blue light in temporal sequence. In a third arrangement, the dynamic optical device comprises several layers which are designed to act on red, green and blue wavelengths, respectively. The resolution of the apparatus is dependent upon several factors, especially the dimensions of the dynamic lens, the resolution of the spatial light modulator, the number of phase levels in the spatial light modulator, focal length and pixel size of the[0101]display screen10. In order to achieve a satisfactory resolution, the dynamic lens is operated not as a single lens, but rather as an array of micro-lenses as depicted schematically at12a in FIG. 4.
• Diffracting structures are subject to similar geometric aberrations and distortions to those found in conventional lenses. By using an eye tracker in conjunction with an area of high resolution in the dynamic lens, the effects of distortion are minimal, particularly since low relative apertures are used. Generally, diffractive optics are more difficult to correct at high optical powers. From basic aberration theory, the field angle achievable with the dynamic lens is limited to a few degrees before off-axis aberrations such as coma start to become significant and it becomes necessary to re-compute the diffraction pattern.[0102]
• In general, the correction of geometric distortions and matching of the AOI with lower resolution background imagery can be carried out electronically. Particularly in the case where the dynamic lens is implemented in a curved configuration (as depicted in FIG. 4), the effects of geometric distortion will be minimal.[0103]
• The main factors affecting transmission through the dynamic lens are the diffraction efficiency, effective light collection aperture of the optics, and transmission characteristics of the medium employed for the dynamic lens. Because of the geometry of the dynamic lens, the effect of occlusions and vignetting will be minimal. The most significant factor tends to be the collection aperture. In order to maximise the transmission of the display to the dynamic lens, it is possible to include an array of condensing lenses. FIG. 4A shows a detail of the[0104]display screen10 depicted in FIG. 4,. wherein anarray15 of micro-lenses is disposed in front of thedisplay screen10 to perform initial beam-shaping on the light emitted from the screen, before this is transmitted to the dynamic lens. Alternatively, this beam-shaping function can be performed by means of diffractive or holographic components.
• Because the operation of the dynamic lens is governed by the attitude of the observer's eye, the majority of the processing of the image displayed on the[0105]screen10 at any one time will be concerned with the image region contained in the exit pupil. To take full advantage of the eye's visual acuity characteristics, the eye tracker is arranged to operate at bandwidths of at least 1000 Hz in order to determine the tracking mode of the eye (for example smooth pursuit or saccade).
• The picture content in the exit pupil of the dynamic lens at any given time will depend upon the AOI field of view, and the field angle and resolution of the dynamic lens. FIG. 5 shows in graphic form a calculation of the number of resolution cells in the exit pupil that will need to be up-dated per frame as a function of the AOI for different values of the dynamic lens field angle. For the purpose of these calculations, it has been assumed (for illustrative purposes) that the dynamic lens consists of 20×20 micro-lenses each of 0.5 mm size, with each micro-lens having a resolution of 48×48. It has also been assumed that the dynamic lens has a field of view of 7°, and that the AOI is 10°. This results in a total of about one million cells in the exit pupil, equivalent to a 1000×1000 array. Taking into account the dynamic lens field angle, each of these cells will need to be up-dated approximately 2 times per frame, i.e. 2 million cell up-dates per frame are required. By extrapolating from the size of the exit pupil to the maximum array size necessary to provide the same resolution over an entire field of view of, say, 135°×180°, it can be determined that a dynamic lens comprising of the order of 113×113 micro-lenses will be required (equivalent to a 5400×5400 cell spatial light modulator).[0106]
• The specification of the input image display (i.e. the image as displayed on the screen[0107]10) will be determined by the required display resolution. For example, by aiming to match the 1 minute of arc resolution of the human visual system, the display will need to provide a matrix of 8100×8100 pixels to achieve the desired performance over a field of view of 135°×180°. The number to be up-dated in any given frame will be considerably smaller. FIG. 6 shows in graphic form the number of active display elements required in the exit pupils, assuming a variable resolution profile of the form shown in FIG. 7.
• Significant economy in the computation of the input imagery can be achieved by exploiting the rapid fall-off of human visual acuity with angle. Since only 130,000 pixels can be observed by the eye at any time, and noting that the eye is not very good at distinguishing intermittent events at moderate rates (typically 30 per second), it can be concluded that the apparatus of the present invention presents a processing requirement which is not significantly bigger than that of a 625 line television.[0108]
• The exit pupil of the dynamic lens is not subject to the same physical constraints as that of a conventional lens system, since it is defined electronically. According to the normal definition of the term, it could be said that the exit pupil covers the whole of the 135°×180° field of view. However, because of the eye tracking function employed in the present invention, it is more appropriate to consider the exit pupil as being the region of the spatial light modulator array contained within the eye-tracked area of interest. The remainder of the field of view is filled with imagery whose resolution progressively decreases as the periphery is approached.[0109]
• FIG. 8 illustrates a particular manner of implementing the eye tracking function, with similar components being accorded the same reference numerals as employed in FIG. 4. In this embodiment, the eye tracking function is achieved by means of an array of[0110]emitters17 anddetectors18 provided on ascreen19 disposed immediately in front of thedisplay screen10. Radiation (such as infra-red radiation) is emitted by theemitters17 and is directed by thedynamic lens12 as a broad wash across the observer'seye11, as depicted byarrows20. The radiation reflected by theeye11 is then focussed by thedynamic lens12 onto thedetectors18, as depicted byarrows21. Thus, thedynamic lens12 not only functions to transmit to the observer's eye the image as displayed on thescreen10, but also forms an important part of the eye-tracker. The spatial frequencies of theemitters17 anddetectors18 do not have to be very high, but are sufficient to resolve the eye of the pupil or some other ocular parameter.
• FIG. 9 shows an alternative embodiment in which the dynamic optical element takes the form of a[0111]mirror22 rather than a lens. In this arrangement, thedisplay screen10 is interposed between thedynamic mirror22 and the observer's eye, and is formed by a generally light-transmittingscreen23 on which are provided a series of visible light emitters24 (such as LEDs, lasers or phosphors) in red-green-blue triads. The triads are spaced apart from one another, to permit theeye11 to view the displayed image after reflection by thedynamic mirror22 and subsequent passage through thescreen23. Each triad is fronted by amicro-lens array25 which performs initial beam shaping.
• The[0112]dynamic mirror22 is based on the same diffractive optical principles as the dynamic lens. The use of reflection techniques can offer some advantages over a transmissive mode of operation because the drive circuitry for the spatial light modulator can be implemented in a more efficient way, for example on a silicon backplane. As in the case of the dynamic lens, the limited resolution of currently available spatial light modulators will dictate that themirror22 is made up of an array of miniature dynamic mirrors, each comprising a separate diffracting array. By arranging for thedisplay screen10 to have a suitably high pixel resolution, the displayed area of interest image can be built up by generating a different field of view element for each pixel, in a similar way to a dynamic lens. Alternatively, the image can be generated by modulating theemitters24 and synchronously modifying the diffracting patterns contained in themirror22 in such a way that the required image is produced by switching the direction of the emitted light in the field of view. This has the advantage of requiring fewer elements in the partially transmittingpanel23 and hence allowing a higher transmission. An equivalent approach can also be used in the case where the dynamic optical element is a lens.
• FIG. 10 illustrates the application of the eye tracker to apparatus of the type shown in FIG. 9. More particularly,[0113]emitters26 of radiation (such as infra-red light) are provided on thelight transmitting screen23 and emit radiation towards thedynamic mirror22. Themirror22 then reflects that radiation as a broad wash through thescreen23 and onto the observer'seye11, as depicted byarrows27. Radiation reflected by theeye11 passes back through thescreen23 and ontodetectors28 provided on themirror22. Other configurations are, however, possible. For example, both theemitters26 anddetectors28 could be mounted on thepanel23, with the dynamic mirror performing the functions of receiver and transmitter optics.
• In the above-described embodiments, reference has been made to the spatial light modulator comprising a liquid crystal device. However, other types of spatial light modulator can also be used, such as surface acoustic wave devices and micro-mirror arrays.[0114]
• In a further embodiment (shown in FIG. 11), the dynamic[0115]optical device12 takes yet another form, namely that of an electrically switchable holographic composite (ESHC). Such a composite (generally referenced200) comprises a number oflayers201, each of which contains a plurality of pre-recordedholographic elements202 which function as diffraction gratings (or as any other chosen type of optical element). Theelements202 can be selectively switched into and out of operation by means of respective electrodes (not shown), and sequences of theseelements202 can be used to create multiple diffraction effects. ESHCs have the advantages of high resolution, high diffraction efficiency, fast switching time and the capability of implementation in non-planar geometries.
• If a liquid crystal display, surface acoustic element or micromirror device is used, the dynamic optical device will operate on the basis of discrete switchable elements or pixels. Although such a device can be programmed at pixel level, this is achieved at the expense of limited resolution. As a result, it is difficult to achieve very high diffraction efficiencies. In contrast, ESHCs have sub-micron resolution, which represents a substantially higher pixel density than that of the above-described types of spatial light modulators. Typically, the resolution of conventional spatial light modulators are of the order of 512[0116]², representing about one million bits of encoded data: the diffraction efficiencies tend to be well below 50%. In contrast, ESHCs offer a resolution equivalent to 10¹³bits, and diffraction efficiencies close to 100% are therefore a practical proposition.
• An ESHC may be defined as a holographic or diffractive photo polymeric film that has been combined with a liquid crystal. The liquid crystal is preferably suffused into the pores of the film, but can alternatively be deposited as a layer on the film. The hologram may be recorded in the liquid crystal either prior to or after the combination with the photo polymeric film. Recordal of the hologram can be performed by optical means, or by the use of highly accurate laser writing devices or optical replication techniques. The resultant composite typically comprises an array of separate holograms that are addressed by means of an array of transparent electrodes manufactured for example from indium tin oxide, which usually have a transmission of greater than 80%.[0117]
• The thickness of the composite is typically 10 microns or less. Application of electric fields normal to the plane of the composite causes the optical characteristics of the liquid crystals to be changed such that the diffraction efficiency is modulated. For example, in one implementation the liquid crystal is initially aligned perpendicularly to the fringe pattern and, as the electric field is increased, the alignment swings into the direction with the effective refractive index changing accordingly. The diffraction efficiency can be either switched or tuned continuously. Typically, the range of diffraction efficiencies covers the approximate range of 100% to 0.1%. There is therefore a very large range of diffraction efficiency between the “fully on” and “fully off” states of the ESHC, which makes the ESHC a very efficient switching device.[0118]
• The speed of response is high due to the encapsulation of the liquid crystals in the micropore structure of the polymeric film. In fact, it is possible to achieve hologram switching times in the region of 1 to 10 microseconds using nematic liquid crystals. Ultimately, very high resolutions can be achieved, with equivalent array dimensions of up to 10[0119]⁵and sub-micron spot sizes. It is even possible to approach the theoretical ideal of a continuous kinoform.
• Although the holographic diffraction patterns must be pre-recorded and cannot be altered, a limited degree of programmability is possible. For example, it is possible to programme diffraction efficiency and relative phase in arrays of holographic elements arranged in stacks and/or adjacent to each other. A multi-layer ESHC of this type is essentially a programmable volume hologram. Taking multiple diffraction into account, a wavefront passing through the device could be switched into 2[0120]^Noutput wavefronts, where the integer N represents the product of the number of layers and the number of elements in each layer. As an illustration of the capability of such a device, in the case of a three-level system with each plane having a resolution of 8×8 elements, the number of possible output wavefronts is 2¹⁹⁷(or 10⁵⁷). Hence, the number of diffractive functions that can be implemented is practically unlimited. In practice, some of the layers in a stack would be provided with electrodes, whilst others would operate in a passive state.
• Each wavefront can be made to correspond to a particular gaze direction. Manifestly, not all of the wavefronts would be generated at the same time because of the need for certain rays to use the same holograms along portions of their paths. However, by making the hologram array sizes suitably large and taking advantage of the characteristic short switching time, the requisite number of wavefronts can be generated at typical video rates of 50 Hz.[0121]
• For example, to provide one minute of arc display resolution over an instantaneous eye track area of interest of[0122]size 10°×10°, a total of 600×600 separate wavefronts would need to be generated in {fraction (1/50)} second, which is equivalent to 18×10⁶separate wavefronts in 20 milliseconds. Assuming that the input resolution of the portion of the hologram array stack that corresponds to the field of view is 30×30, and the entire holographic array can be switched in 1 microsecond, then the time required to generate the full set of wavefronts is equal to:
• 1×(18×10⁶)/(30×30)=20 milliseconds.
• To provide the same resolution and switching time over the maximum human monocular field of view of 150°×135°, a holographic array would be required with size equivalent to:[0123]
• [(150/10)×30]×[(135/10)×30]=450×390.
• By using a construction of the above-described type, it is also possible to arrange for all of the holographic elements in a layer to be switched simultaneously, with the selection of specific holograms in the layers being performed by appropriate switching of the individual light-emitting elements. Such “optical addressing” eliminates the wiring problems posed by having several high resolution hologram matrices. Furthermore, by recording multiple Bragg patterns in a given hologram, the number of possible deviation patterns for a light beam passing through that hologram can be increased, thereby enabling the number of layers in the ESHC to be reduced. The number of Bragg patterns that can be multiplexed depends on the refractive index modulation that is available, typically up to around 20 multiplexed patterns are possible. This reduces the effects of scatter and stray light, whilst stray light can be further minimised by the use of anti-reflection coatings applied to selected layers.[0124]
• Because holograms are highly dispersive, the effects of chromatic aberration can be minimised by arranging for separate “channels” in the ESHC for the primary wavelengths, so that each channel can be optimised for the particular wavelength concerned. The term “channel” is intended to indicate a sequence of holographic elements through which the beam propagates. Also, chromatic aberration caused by the finite bandwidth of the light emitted by LEDs, can be reduced by employing suitable band pass filters[0125]
• An ESHC is typically a thick or volume hologram which is based on Bragg diffraction, giving a theoretical diffraction efficiency of 100%. In principle, it is also possible to configure the ESHC as thin holograms (Raman-Nath regime), which can also give 100% efficiency in certain circumstances.[0126]
• FIG. 11A depicts an ESHC in which the[0127]holographic elements202 insuccessive layers201 become progressively more staggered towards the periphery. This enables light rays (such as indicated at L) to be deviated at the periphery of the ESHC through larger angles than would otherwise be possible.
• FIG. 11B is a schematic illustration of the way in which a light beam L[0128]¹can be deflected through differing angles by reflection at the Bragg surfaces B of the holographic elements insuccessive layers201 of the ESHC. For example, L¹denotes the path followed by a light beam which is deflected by a Bragg surface in the first of thelayers201 only, whilst L¹denotes the path followed by the same beam when the relevant holographic element in the next layer is activated so that the beam is deflected by a Bragg surface in that element also.
• In a further development, the dynamic optical device can operates a mirror, for example by combining an ESHC device with conventional silicon backplane technology, such as is used in active matrix liquid crystal displays.[0129]
• As a further alternative, the dynamic optical device can take the form of a multi-layer liquid crystal divided into a number of individual cells, each of which is switchable between a limited number of states, which creates essentially the same effect as an ESHC.[0130]
• In the above-described embodiments, the image for viewing by the observer is generated by a display screen, in particular an LCD screen, although an electro luminescent screen or any other flat-panel screen (eg LED array) could be used instead. However, it is also possible to use other types of image generator. FIG. 12 shows one particular example, in which the input image data is generated by modulating an array of light emitting elements[0131]250 (such as lasers or LEDs) at high frequency and using anESHC251 as described above to “switch” the laser beams between different orientations, such as indicated forlaser beam252. The lasers in the array can be configured as triads of red, blue and green. A micro-optic beam-forming system such asmicro lenses253 can be associated with the lasers.
• FIG. 13 shows another example of the viewing apparatus, in which the image generator takes the form of a[0132]light guide panel260 having a series oflasers261 disposed around its periphery. Fabricated within thepanel260 are a series ofprisms262 each of which has an inclinedsemi-reflecting surface263 confronting one of thelasers261. Thesesurfaces263 receive light from thelasers261 and partially reflect this in a direction normal to thepanel260. Microlenses264 are provided on a surface of thepanel260 which confronts the user, to focus and/or shape the respective laser beams.
• As an alternative to lasers, LEDs of suitably narrow wavelength bands could be used. The lasers and/or LEDs can be fabricated from wide-band semiconductors such as GaN.[0133]
• The image information is encoded by temporal modulation of the laser beams, and therefore the resolution of the laser array does not need to be large. This means that, by providing the laser array on a generally transparent panel, the observer can have the facility of viewing the surroundings. Furthermore, as shown in FIG. 12, it is possible to provide an external shutter[0134]270 (such as by means of an additional layer of liquid crystal) whereby the observer can switch the surroundings into and out of view. In this manner, the observer can use the shutter to shut out external light whilst using the ESHC in diffractive mode to view a virtual display, or alternatively the shutter can be used to transmit light from the surroundings whilst switching the ESHC to non-diffractive mode. As a further alternative, the virtual imagery and ambient view can be superimposed in the manner of a head-up display. Under these circumstances, in order to avoid conflict with using the same processing elements in the ESHC for both virtual and ambient image scanning, the shutter liquid crystal can be provided as an array such that it is possible to switch off those pixels corresponding to field of view directions at which virtual imagery is to be displayed. Alternatively, other techniques can be employed, such as those based on polarisation, wavelength division, etc.
• There are other ways in which a provision for viewing the surroundings can be included in the apparatus. For example, in the case where the image generator comprises an LCD or electro luminescent panel, gaps can be left in the display layer. Also, in the case where an LCD is used, a transparent back-lighting arrangement can be used. A further alternative is depicted in FIG. 14, wherein the display panel (referenced[0135]280) is pivotally mounted on aheadset281 of which the apparatus forms part. Thepanel280 can be pivoted between a first position (shown in broken lines) in which it confronts the dynamic lens (referenced282), and a second position (shown in solid lines) in which it is disposed away from thelens282 to allow ambient light to pass therethrough.
• Another arrangement is shown in FIG. 15, wherein the display panel (referenced[0136]290) does not allow ambient light to pass therethrough, and in which adetector array291 is disposed on the external side of thepanel290 so that the detectors therein face the surroundings through apanel292 of lenses. The lenses in thepanel292 form images of the surroundings on the detectors in thearray291, and signals received from the detectors are processed by aprocessor293 for display on thedisplay panel290. In this way, the user can switch the display on thepanel292 between internal imagery and the surroundings, and view either of these by way of the dynamic lens (referenced293).
• In the above-described embodiments, the sensing means comprises emitters and detectors. The emitters emit radiation (such as infra-red radiation) which is projected as a broad wash onto the observer's eye, and the radiation scattered back from the eye is projected onto the detectors. On the one hand, the dynamic optical device functions not only to focus image light onto the observer's eye, but also to project the radiation from the emitters onto the eye and/or to project the radiation reflected by the eye to the detectors. On the other hand, the emitters and/or the detectors are provided at pixel level within the field of view of the observed image.[0137]
• These general arrangements can be applied to viewing apparatuses other than those incorporating dynamic optical devices.[0138]
• One such system is illustrated in FIGS. 16 and 16A, in which one or more infra-red emitters (referenced[0139]300) are provided on a light-transmittingscreen301 positioned forwardly of thedisplay screen10.Image light302 from thedisplay screen10 is directed to the observer'seye11 by means of a lens system303 (depicted schematically) which collimates the image light over a field of view of typically 40°. Infra-red radiation304 from the emitter(s)300 is projected as a broad wash onto the surface of theeye11 by thelens system303 and is scattered thereby. The returned infra-red radiation304¹is propagated back through thelens system303, and is projected onto anelement305 positioned immediately in front of thedisplay screen10 which acts as a reflector to infra-red wavelengths but not to visible light. Theelement305 can for example be a holographic or diffractive mirror, or a conventional dichroic mirror. After reflection by theelement305, the infra-red radiation is projected onto thescreen301 as a focussed image of the pupil of theeye11, and is incident upon one ormore detectors306 provided at pixel level in or on thescreen301. The arrangement of theemitters300 anddetectors306 is such as to cause minimal obstruction to the passage of the image light through thescreen301.
• FIG. 16A shows a cross-section of the[0140]screen301, on which the focussed pupil image is indicated by broken lines at307. If (as shown) thedetectors306 are arranged in an array in the shape of a cross, then the dimensions of theinstantaneous image307 can be measured in two orthogonal directions, although other arrangements are also possible.
• An alternative system is shown in FIG. 17, wherein a small number of infra-red emitters[0141]400 (only one shown) are provided at pixel level in or on thedisplay screen10 itself. As in the embodiment of FIG. 16, image light401 from thedisplay screen10 is directed to the observer'seye11 by alens system402. In this embodiment, however, aninclined beamsplitter403 is interposed between thedisplay screen10 and thelens system402.
• Infra-[0142]red radiation404 from theemitters400 passes through thebeamsplitter403 and is projected by thelens system402 as a broad wash onto the observer'seye11 to be scattered thereby. The returned infra-red radiation404¹passes through thelens system402 and is then reflected by thebeamsplitter403 so that it is deflected laterally (either sideways or up or down) towards arelay lens system405, which projects the returned infra-red radiation onto an array ofdetectors406 to form a focussed infra-red image of the pupil on the detector array. Both therelay lens system405 and thedetector array406 are thus displaced laterally from the main optical path through the viewing apparatus. In the illustrated embodiment, thebeamsplitter403 takes the form of a coated light-transmitting plate, but a prism can be used instead.
• A further alternative arrangement is shown in FIG. 18, wherein one or more infra-[0143]red emitters500 are again incorporated at pixel level in or on thedisplay screen10. As before, image light501 from thedisplay screen10 is focussed by alens system502 onto the observer'seye11, with thelens system502 collimating the visible light over a field of view of typically 40°. However, in this embodiment there is positioned between thedisplay screen10 and thelens system502 one or more diffractive orholographic elements503 which are optimised for infra-red wavelengths and which have minimal effect on the visible light from thedisplay screen10. Thus, the focal length of the combined optical system comprising the element(s)503 and thelens system502 for visible light is different from that for infra-red radiation. The combined effect of the element(s)503 and thelens system502 is to produce a broad wash of infra-red radiation across the surface of the observer'seye11. Infra-red light scattered off the surface of the eye is then projected by the combined effect of thelens system502 and the element(s)503 onto the surface of thedisplay screen10 to form a focussed infra-red image of the pupil, which is detected by detectors505 (only one shown) also provided at pixel level in or on thedisplay screen10.
• In the embodiments of FIGS.[0144]16 to18, thelens systems303,402 and502 are based on conventional refractive optical elements. However, the principles described can be applied to arrangements wherein a dynamic optical device is used instead.
• Also in the embodiments of FIGS.[0145]16 to18, thelens systems303,402 and502 perform the dual function of focussing the image light onto the observer's eye and of focussing the returned infrared radiation onto the detectors. The lens system must therefore cope with a wide variation of different wavelengths, and a lens system which has optimised performance with respect to visible light may not perform exactly the desired function with respect to infra-red radiation. In practice, the disparity is sufficiently small that it does not create a problem, particularly if near infra-red radiation is used. However, it is nevertheless sometimes desirable to incorporate some form of compensation for the infra-red radiation, such as the incorporation of the element(s)503 in the embodiment of FIG. 18.
• In an alternative arrangement, instead of employing infra-red radiation for eye tracking, it is possible to use light in the visible spectrum. This visible light could be rendered undetectable to the observer by using the light in very short bursts, or by allocating specific elements in the array for tracking (which could be colour-adjusted to match the surrounding image elements), or by using specific narrow bands of wavelengths.[0146]
• The efficiency of the eye tracker will be limited by the latency of the processing system used to detect the variation in the ocular feature (such as the pupil edge, the dark pupil, etc) that is being used. In order to increase this efficiency, it is possible to use parallel processing techniques which can be implemented using hybrid electronic-optical technology, or even entirely optical processing methods. By harnessing the full speed advantage of optical computing, it is possible to perform eye tracking such that the image generator only needs to compute the data contained within the central 1° to 2° of the eye's field of view.[0147]
• An optical computer for use with the present apparatus comprises components such as switches, data stores and communication links. The processing involves the interaction of the dynamic lens with the emitters and detectors. Many different optical processing architectures are possible, the most appropriate types being those based on adaptive networks in which the processing functions are replicated at each node. It is even possible to combine the image generator, optical computing structure and the dynamic lens into a single monolithic structure.[0148]
• As explained above, a dynamic lens is a device based on diffraction principles whose optical form can be changed electronically. For example, this can take the form of a lens based on a binary profile, or a close approximation to the ideal kinoform, written onto a spatial light modulator or similar device. Although the primary use of the dynamic lens is to vary the focal length, it can also serve other functions such as to correct geometric distortions and aberrations. For example, chromatic aberrations can be reduced by re-calculating the diffraction pattern profiles (and hence the focal length) of the lens for each primary wavelength in sequence. Alternatively, three associated dynamic lenses could be used, each optimised for a different primary wavelength. These lenses can be augmented by bandpass filters operating at the primary wavelengths. In addition, the dynamic lens (in association with an input image array) can be used to vary the position, size and/or shape of the exit pupil in real time.[0149]
• As a result of this, it is possible to achieve several advantageous effects. Firstly, a wide field of view (FOV) can be created, which helps realism. This stems primarily from the ability to move the exit pupil. The ability to implement imaging functions within a relatively thin architecture also helps to eliminate many of the geometrical optical obstacles to achieving high FOV displays. In contrast, in conventional optics a large exit pupil is achieved either by using mechanical means to move a small exit pupil (which is generally not practical given the problems of inertia, etc), or by using large numbers of optical elements to correct aberrations, etc, with consequent complexity and expense.[0150]
• Secondly, the apparatus can be made light in weight so that it is comfortable and safe for a user to wear. This also means that the apparatus has low inertia, so the user has minimal difficulty in moving his or her head while wearing the apparatus. The reduction in weight results in part from the intrinsic lightness of the materials used to fabricate the spatial light modulator, as compared with those employed for conventional optics.[0151]
• Thirdly, the functions of image transmission and eye tracking are combined into a single integral unit. This also assists in making the apparatus relatively low in weight. Furthermore, it also provides for easy area of interest detection and detail enrichment, which enables an effective high resolution to be achieved.[0152]
• Fourthly, by suitably designing the software for driving operation of the dynamic lens, it is possible to prevent disassociation between accommodation and convergence, so that the apparatus does not place a visual strain on the user and provides a more realistic display. This is to be contrasted with conventional optics which, even if the relevant range information is available, are not capable of displaying objects at the correct depth without incorporating moving parts in the optical system or using other methods of changing the focal characteristics of the lenses.[0153]
• A further advantageous property of the dynamic lens is its ability to reconfigure itself to allow different wavelength bands (e.g. visible and infra-red) to propagate through it. Multiple wavelengths can be transmitted simultaneously, either by allocating different portions of the dynamic lens to different wavelengths, or by reconfiguring the lens sequentially for those wavelengths. Moreover, the direction of propagation of those different wavelengths does not have to be the same. This makes the dynamic lens particularly useful in on the one hand transmitting image light for viewing by the observer, and on the other hand transmitting the infrared light used in the eye tracker system.[0154]
• Although the above description makes particular reference to dynamic lenses, it will be appreciated that the principles expounded are equally applicable to dynamic mirrors.[0155]
• FIG. 19 illustrates the basic concept of a dynamic lens operating on diffraction principles. The[0156]display screen10 embodies a number of infra-red emitters600 at pixel level, and a series ofdiffraction patterns601 are generated in a spatiallight modulator602 which serve the function of lenses, to focus image light603 from thedisplay screen10 onto the observer's eye and to project the infra-red light604 from theemitters600 as a broad wash onto the surface of theeye11.
• In order to reduce the burden on the dynamic lens and facilitate the diffraction calculations that are required in order to re-configure the spatial light modulator each time the display is updated, it is possible to transform or distort the image as actually displayed on the[0157]display screen10. Under these circumstances, the distinction between the input image display and the dynamic optical device becomes less well defined.
• FIG. 20 illustrates a further development of the invention, in which the functions of image generation and dynamic imaging are combined within a dynamic[0158]holographic element700. The required output image is then produced by reconstruction using only a series of reference beams produced by an array of discretelight sources701. In the illustrated arrangement, thelight sources701 are mounted on ascreen702 disposed behind the dynamicholographic element700, on which are also provided infra-red emitters703 anddetectors704 for the eye tracking function.
• The[0159]screen702 thus performs no imaging function, i.e. it has no pictorial content, its purpose being merely to provide a set of reference beams. The resolution of the array ofreference beam sources701 can in fact be quite low, although the economy of design that results is achieved at the expense of the additional computational power required to re-calculate the hologram for each image update, since both the lens function and the image need to be recomputed.
• The dynamic[0160]holographic element700 can be implemented using a high resolution spatial light modulator such as that based on liquid crystals, micro-mechanical mirror arrays or opto-acoustic devices. It is possible for the dynamic hologram to operate either in transmission or in reflection. As is the case where a separate dynamic optical device and image generator are used, the use of reflective techniques can offer certain advantages, such as in allowing circuitry to be implemented in a more efficient way, and in enhancing the brightness of the display.
• It is also possible to incorporate into the dynamic hologram lenses which project infra-red light from the[0161]emitters703 onto the observer's eye, these lenses being encoded within portions of the hologram.
• In a further modification (not shown), a texturised screen is provided around the periphery of the image displayed on the display screen. For reasons that are not yet fully understood, it has been found that the use of such a texturised screen can induce an illusion of depth in the displayed image, and this effect can be used to enhance the reality of the image as perceived by the user. The screen can be provided as a separate component which surrounds or partially overlies the periphery of the display screen. Alternatively, a peripheral region of the display screen itself can be reserved to display an image replicating the texturised effect. Moreover, under these circumstances it is possible to alter the display in that peripheral region to vary the texturised effect in real time, to[0162]
• allow for changes in the image proper as displayed on the screen and adjust the “pseudo-depth” effect in accordance with those changes.[0163]
• In the above embodiments, the display screen and dynamic lens are described as being curved. However, as depicted in FIGS. 21 and 21A, it is possible to construct the[0164]display screen10 from a series ofplanar panels900, and similarly to construct thedynamic lens12 from a series ofpanels901, eachpanel900 and901 being angled relative to its neighbour(s) so that the display screen and dynamic lens each approximate to a curve. FIG. 21A shows the configuration of thescreen10 andlens12 in three dimensions.
• Referring now to FIGS. 22 and 23, there is shown apparatus for viewing an image which is generally similar to that depicted in FIG. 12. The apparatus comprises an[0165]image generator1010 in the form of an array of LED triads0101 provided on a generally light-transmitting screen1012. TheLED triads1011 form a low resolution matrix of, say, 100×100 or 200×200 elements. Light from theLED triads1011 is subjected to beam shaping by amicrolens array1013, and then passes through aliquid crystal shutter1014 towards anESHC1015. Themicrolens array1013 has as its main effect the collimation of the light emitted by theLED triads1011, and can be of holographic design.
• The LEDs in the[0166]triads1011 are driven by signals defining an image to be viewed by an observer. On the one hand, these signals are such that the array of LEDs produces a relatively coarse version of the final image. On the other hand, the signals supplied to each LED triad are time-modulated with information referring to image detail, and theESHC1015 functions to scan the light from that triad in a manner which causes the image detail to be perceived by the observer.
• The apparatus also comprises an eye tracker device which senses the direction of gaze of the observer's eye. Suitable forms of eye tracker are described above and are not shown in any detail herein. Suffice it to say that radiation from a plurality of emitters is projected onto the observer's eye in a broad wash, and radiation reflected back from the eye is projected onto detectors, such as[0167]detector elements16 mounted in or on thescreen1012. The same optics as employed for image transmission are also used for the purpose of projecting the radiation onto the eye and/or projecting the reflected radiation onto thedetector elements1016.
• As indicated above, the eye tracker senses the direction of gaze of the observer's eye The operation of the[0168]ESHC1015 is then controlled in accordance therewith, so that the ESHC functions to “expand” the resolution of the initially coarse image only in the direction in which the eye is looking. In all other areas of the image, the resolution is maintained at the initial coarse level. As the direction of gaze alters, the operation of the ESHC is changed as appropriate to “expand” the resolution in the new direction of gaze instead.
• The[0169]liquid crystal shutter1014 is switchable between two states, in the first of which the shutter is generally light-obstructing but containswindows1017 for transmission of the light from therespective LED triads1011. Within these windows, the liquid crystal material can control the phase of the light beams, for example to create fine-tuning of the collimation of those beams. In its second state, theshutter1014 is generally light-transmitting and allows viewing of the ambient surroundings through thescreen1012, either separately from or in conjunction with viewing of the image from the LEDs.
• The[0170]ESHC1015 can include passive holograms (i.e. not electrically switched) that are written onto the substrates, to allow for greater flexibility in optimising the optical performance of the apparatus.
• Instead of LEDs, the[0171]image generator1010 can employ lasers.
• As can be seen to advantage in FIG. 23, this form of construction enables a very compact monolithic arrangement to be achieved, comprising a succession of layers as follows:[0172]
• the[0173]screen1012 containing the LED/laser array
• the[0174]microlens array1013 embodied within a spacer
• the[0175]liquid crystal shutter1014
• the[0176]ESHC1015 comprising successive layers ofholographic material1018 plus electrodes, andspacers1019 between these layers.
• The[0177]first spacer1019 in the ESHC (i.e. that directly adjacent to the liquid crystal shutter1014) allows for development of the light beams from the LED triads after passing through themicrolens array1013 and before passing through the ESHC proper.
• It is anticipated that the overall thickness of the apparatus can be made no greater than about 7.5 mm, enabling the apparatus to be incorporated into something akin to a pair of spectacles[0178]
• FIG. 24 shows a modified arrangement wherein the apparatus is of generally curved configuration, the curve being centred generally on a[0179]nominal eye point1020. Typically, the radius curvature of the apparatus is about 25 mm.
• FIG. 25 shows an alternative arrangement, which operates on reflective principles. In this embodiment, the[0180]image generator1040 comprises alight guide1041 disposed on a side of the apparatus adjacent to the observer's eye. Thelight guide1041 is depicted in detail (in curved configuration) in FIG. 26, and has a series of LEDs orlasers1042 disposed around its periphery. Lens elements1043 (only one shown) are formed on the periphery of thelight guide1041, and each serves to collimate the light from a respective one of the LEDs/lasers1042 to form a beam which is projected along theguide1041 through the body thereof. Disposed at intervals within theguide1041 are prismatic surfaces1044 (which can be coated with suitably reflective materials), which serve to deflect the light beams laterally out of thelight guide1041.
• Disposed behind the light guide[0181]1041 (as viewed by the observer) are, in order, afirst ESHC1045, a light-transmittingspacer1046, asecond ESHC1047, a further light-transmittingspacer1048, and a reflector1049 (which is preferably partially reflecting). Light emerging from thelight guide1041 is acted on in succession by theESHCs1045 and1047, is reflected by thereflector1049, passes back through theESHCs1047 and1045 and finally through thelight guide1041 to the observer'seye1050. Because the light undertakes two passes through each of theESHCs1045 and1047, this gives more opportunity for control of the beam propagation.
• In practice, the apparatus shown in FIG. 25 can also include a microlens array and a liquid crystal shutter such as those described above with reference to FIGS. 22 and 23 but these have been omitted for convenience of illustration.[0182]
• FIGS. 27A to[0183]27C show in schematic form alternative configurations for the apparatus. In FIG. 27A, the image generator comprises an array of LEDs orlasers1050 provided in or on alight transmitting screen1051. As with the arrangement depicted in FIG. 25, thescreen1051 is disposed on a side of the apparatus adjacent to the observer'seye1052. Light from the LEDs/lasers1050 is initially projected away from theeye1052 through anESHC1053, and is then reflected by areflector1054 back through theESHC1053. The light then passes through thescreen1051 and passes to the observer's eye. Again, this arrangement has the advantage that the light passes through theESHC1053 twice, giving increased opportunity for the control of the light beam shaping.
• FIG. 27B shows in schematic terms an arrangement similar to that already described with reference to FIGS. 22 and 23, but wherein the image generator comprises a[0184]light guide1055 of the general type shown in FIG. 26. FIG. 27C shows a similar arrangement, but wherein the light guide is replaced by a light-transmitting screen1056 having an array of LEDs orlasers1057 therein or thereon.
• As with FIG. 25, the microlens array and the liquid crystal shutter have been omitted from the drawings for ease of illustration, but will in practice be provided between the image generator and the ESHC in each case.[0185]
• All of these arrangements are capable of being implemented as a monolithic, very thin panel (typically less than 10 mm in thickness). In practice, the overall thickness of the panel will be dictated by the required thickness of the substrates and spacers.[0186]
• The use of a light guide such as described with reference to FIGS. 25, 26 and[0187]27B can offer a greater degree of transparency to the image generator for viewing of the ambient surroundings.
• As depicted in FIG. 28, the apparatus can also be adapted for use by multiple observers, by arranging for the dynamic optical device (referenced[0188]1070) to create more than one exit pupil, one for each of the intended observers.Reference numeral1071 denotes an image generator comprising an array of LEDs/lasers1072 on ascreen1073, which screen also incorporatesemitters1074 anddetectors1075 of the eye tracking system. Signals received from thedetectors1075 are processed by aprocessor1076 and a multiple-target tracking system1077 which detects the positions of the heads of the various observers. The characteristics of the dynamicoptical device1070 are then altered in accordance with the detected head positions and directions of gaze, to create suitable exit pupils for viewing by the observers of the image transmitted by theimage generator1071.
• The apparatus can also be adapted for the viewing of stereoscopic images. For example, as shown in FIG. 29, a pair of apparatuses as described can be mounted side by side in a[0189]headset1100. Each apparatus comprises generally an image generator1101 (such as a display screen), a dynamicoptical device1102 and aneye tracker1103. Stereoscopically paired images are produced by theimage generators1101, and are viewed by the observer'seyes1104 respectively by means of the respective dynamicoptical devices1102. Eacheye tracker1103 senses the direction of gaze of therespective eye1104, and the respective dynamicoptical device1102 maintains an area of high resolution in that direction of gaze, and alters this as the direction of gaze changes.
• In an alternative arrangement (shown in FIG. 30), a single dynamic[0190]optical device1102¹is used in common to both apparatuses, and acts to create two areas of high resolution corresponding to the directions of gaze of the observer'seyes1104, respectively. Under these circumstances, it may be possible to employ asingle eye tracker1103 which detects the direction of gaze of oneeye1104. One area of high resolution is created using signals obtained directly from the eye tracker, while the other area of high resolution is created in accordance with signals received from theeye tracker1103 and information in the image input signal.
• FIG. 31 shows a further embodiment of the invention in which the display screen (referenced[0191]1201) is of a different form. In, for example, the embodiment of FIG. 12 the display screen comprises a monolithic LED array on a substrate. The size of this array is equivalent to a 768×768 matrix on a 60 mm substrate and, whilst this is not a particularly large matrix in purely numerical terms, the need to cluster the LEDs in a small area can pose difficulties due to the high density of wiring required. Also, the presence of this wiring on the substrate will have the effect of reducing the intensity of the light passing therethrough when the apparatus is used in a mode to view the surroundings.
• The arrangement depicted in FIG. 31 is intended to solve this particular difficulty by employing[0192]photon generation modules1202 which are disposed around the periphery of atransparent plate1203. Eachmodule1202 is built up from a number of separate, lower resolution arrays of LEDs, as will be described later. Theplate1203 is moulded from plastics material and includes light guides1204 and miniature lenses (not shown in FIG. 31) which are used to relay demagnified images of the LED arrays to each of a number ofnodes1205 situated directly in front of the microlens array (referenced1206).Reference numeral1207 designates the ESHC, whilereference numerals1208 indicate typical output light beams produced by the apparatus.
• FIG. 32 shows a front view of the[0193]display screen1201, wherein the positioning oflight guides1204 and nodes1205 (six in all) can be seen to advantage.Reference numeral1209 designates an opaque region in which thephoton generation modules1202 are located.
• Mounting the[0194]photon generation modules1202 around the periphery of theplate1203 also solves the problem of decreasing geometric blur due to the finite size of the LED elements, since the ratio of pixel size to LED/microlens array distance must be kept small. Furthermore, theplate1203 does not now have to be made of a suitable LED substrate material, and can simply be made of optical-grade plastics.
• FIG. 33 shows the construction and operation of one LED array of a[0195]photon generation module1202 in detail. More particularly, the LED array is disposed parallel to theplate1203, and light emitted therefrom is subjected to initial beam shaping by anoptical element1210 such as a holographic diffuser The light is then reflected through 90° inwardly of theplate1203 by areflector element1211, and passes in sequence through arelay lens1213, a focussing element1214 (for example an LCD element) and acondenser lens1215. The light then passes along therespective light guide1204 to therespective node1205, where it is deflected by areflector element1216 towards themicrolens array1206. On leaving theplate1203, the light is spread by abeam diverging element1217 provided on the surface of theplate1203 confronting themicrolens array1206.
• As indicated above, each of the[0196]photon generation modules1202 is formed of a cluster of LED arrays. A typical example is shown in FIG. 34, wherein the module comprises four arrays1221 each containing a 50×50 matrix of LEDs measuring 4 mm×4 mm. Because each of the arrays1221 subtends a slightly different angle to the associated optics, the beams generated by the four arrays emerge at slightly different angles from therespective node1205. This can be used to achieve a small amount of variation in the direction of the output beam for each channel of light passage through the assembly of themicrolens array1206 and theESHC1207.
• FIG. 35 is a schematic view of apparatus embodying the above-described design of display panel, illustrating the typical passage therethrough of an[0197]output beam1218. Thedisplay panel1201 is mounted on one side of a transparentlight guide panel1219, thepanel1219 having the array ofmicrolenses1206 mounted on its other side. AnLCD shutter1220 is disposed between themicrolens array1206 and theESHC1207. In this embodiment, themicrolens array1206 comprises a 36×36 array of independently switchable holographic microlenses, and theESHC1207 comprises a stack of substrates each containing a 36×36 array of simultaneously addressable holograms.
• FIGS. 36 and 36A show an alternative arrangement wherein a single photon generation module (referenced[0198]1301) is employed in common betweendisplay screens1302 for viewing by the observer's two eyes, respectively. Themodule1301 operates on essentially the same principles as that described in the embodiment of FIGS.31 to34, and is disposed intermediate the twodisplay screens1302. Eachdisplay screen1302 includes light guides1303 andnodes1304 as before, thenodes1304 in this instance being formed bycurved mirrors1305.
• FIG. 36B shows schematically a manner in which the photon generation module can be implemented in this arrangement. More particularly light from an[0199]LED array1401 contained in the module is subjected to beam shaping by alens1402 and then passes through aliquid crystal array1403. The beam then passes to a fixedgrid1404 which operates on diffraction principles to produce a plurality ofoutput beams1405 at defined angles, and the above-mentioned light guides are configured to match those angles.
• Referring now to FIGS. 37 and 38 a[0200]viewing apparatus1500 includes animage generator1501 arranged to emit light intoprojection optics1502. Theprojection optics1502 are arranged to project light from the image generator towards a dynamicoptical element1503, arranged at an acute angle with a principal axis of theprojection optics1502. The dynamicoptical element1503 is generally reflective, and is controlled by acontroller1504.
• The dynamic[0201]optical element1503 causes an image to be formed such that anobserver1505 viewing the image experiences a wide field of view. For clarity, tracking apparatus is not shown on the embodiment so illustrated, but it will be appreciated that eye tracking apparatus can be arranged therein.
• The off axis orientation of the arrangement is best illustrated in FIG. 38. As shown in that drawing, the dynamic optical element comprises Red, Green and Blue[0202]holographic layers1503R,1503G,1503B. By enabling these layers sequentially, theelement1503 can present a full colour image to a user.
• When a layer is disabled, it is transparent. It will be understood from the above description that that arrangement is necessary because of the monochromatic nature of holographic elements. The high angle of incidence of light on to the dynamic[0203]optical element1503 from theimage generator1501 andprojection optics1502 is clearly illustrated. It will be appreciated that the Red, Green and Blue channels of the element can be interspaced in one layer as an alternative.
• Located behind the dynamic[0204]optical element1503 is anambient light shutter1509. Theambient light shutter1509 is operative, on receiving a stimulus from thecontroller1504 to permit or to obstruct the passage of ambient light through the dynamic optical element. The gives the user the facility to mix the display from theimage generator1501 with the real-life view beyond theviewing apparatus1500.
• FIG. 39 illustrates an alternative arrangement which utilises a transmissive dynamic[0205]optical element1503′. All other components are assigned the same reference numbers as in FIGS. 37 and 38. Evidently, theobserver1505 now views the image from the opposite side of the dynamic optical element than theimage generator1501 andprojection optics1502.
• FIG. 40 illustrates how the dynamic[0206]optical device1503 can comprise a letterbox shutter layer. The letterbox shutter layer is omitted from FIGS. 38 and 39 for clarity. The dynamicoptical device1503 defines an array ofmicrolenses1506. The shutter layer is electronically controlled, such that for a given electronic signal a rectangular area orletterbox1507 of the shutter layer becomes transparent, the remainder of the shutter layer remaining opaque. Theletterbox1507 is registered with a row ofmicrolenses1506. It may be registered with part of a row, or other combination of microlenses, if desired. In that way, by sequentially renderingspecific areas1507 of the shutter layer transparent, specific rows of themicrolenses1506 are exposed to light1508 from theprojection optics1502. This reduces the possibility of accidental beam spillage over onto adjacent microlenses from those for which the beam is intended. In that way the quality of the viewed image is improved.
• By virtue of the inherent angular selectivity of Bragg (volume) holograms, stray light which is predominantly parallel to the general plane of the shutter alignment, and which does not satisfy the Bragg condition will be undeflected. In this plane, the undeflected light will pass out of the field of view of the observer due to the off-axis arrangement, and thus the quality of the final viewed image can be improved.[0207]
• The viewing apparata described above have many and varied applications, although they are designed primarily for use as head-mounted pieces of equipment. In a particular example, the equipment includes two such apparata, one for each eye of the user. In the entertainment field, the equipment can be used for example to display video images derived from commercially-available television broadcasts or from video recordings. In this case, the equipment can also include means for projecting the associated soundtrack (e.g. in stereo) into the user's ears.[0208]
• Also, by displaying stereoscopically paired images on the two apparatuses, the equipment can be used to view 3-D television. In addition, by arranging for the projected images substantially to fill the whole of the field of view of each eye, there can be provided a low-cost system for viewing wide field films.[0209]
• In the communications sector, the apparatus can be used as an autocue for persons delivering speeches or reading scripts, and can be used to display simultaneous translations to listeners in other languages. The apparatus can also be used as a wireless pager for communicating to the user.[0210]
• In another area, the apparatus can be used as a night-vision aid or as an interactive magnifying device such as binoculars. Also, the apparatus can be employed in an interactive manner to display a map of the area in which the user is located to facilitate navigation and route-finding.[0211]
• Further examples demonstrating the wide applicability of the apparatus include its use in computing, in training, and in providing information to an engineer e.g. for interactive maintenance of machinery. In the medical sector, the apparatus can be used as electronic glasses and to provide disability aids. The apparatus can further be utilised to provide head-up displays, for example for use by aircraft pilots and by air traffic controllers.[0212]

Claims (131)

1. A method of viewing an image, the method comprising transmitting an image into an eye of an observer by means of a dynamic optical device, the dynamic optical device being operative to create a modulation in respect of at least one of phase and amplitude in light transmitted or reflected thereby, said modulation being variable from one point or spatial region in the optical device to another, and wherein the modulation at any point or spatial region can be varied by the application of a stimulus, and altering the characterstics of the dynamic optical device so that the dynamic optical device acts sequentially to direct light of different colours to the observer's eye.

2. A method of viewing an image, the method comprising transmitting an image into an eye of an observer by means of a dynamic optical device, the dynamic optical device being operative to create a modulation in respect of at least one of phase and amplitude in light transmitted or reflected thereby, said modulation being variable from one point or spatial region in the optical device to another, and wherein the modulation at any point or spatial region can be varied by the application of a stimulus, and further comprising the steps of controlling the characteristics of the dynamic optical device to create an area of relatively high resolution in the direction of gaze of the observer's eye, the dynamic optical device providing a lesser degree of resolution of the image elsewhere, and sensing the direction of gaze of the observer's eye and altering the characteristics of the dynamic optical device in accordance therewith, so that the area of relatively high resolution is repositioned to include said direction of gaze as the latter is altered.

3. Apparatus for viewing an image, comprising image generation means, a dynamic optical device, the dynamic optical device being operative to create a modulation in respect of at least one of phase and amplitude in light transmitted or reflected thereby, said modulation being variable from one point or spatial region in the optical device to another, and control means operative to apply a stimulus to the dynamic optical device, whereby the modulation at any point or spatial region can be varied, the control means being operative to alter periodically the characteristics of the dynamic optical device so that the device acts sequentially to direct light of different colours to the observer's eye.

4. Apparatus as claimed in

claim 3

wherein the dynamic optical device is generally reflective.

5. Apparatus as claimed in

claim 3

wherein the dynamic optical device is generally transmissive.

6. Apparatus as claimed in

claim 3

wherein the image generation means is configured off-axis from the general direction of view of the observer's eye in use.

7. Apparatus as claimed in

claim 6

wherein the apparatus is embodied in a headset with a side portion arranged to be placed in the temple region of an observer's head, the image generation means being housed within the side portion.

8. Apparatus as claimed in

claim 3

wherein the apparatus includes left and right image generation means, left and right dynamic optical devices and left and right side portions within which said left and right image generation means are housed, said left and right image generation means being operative to project towards said left and right dynamic optical devices respectively, thereby displaying a binocular image.

9. Apparatus as claimed in

claim 3

, wherein the dynamic optical device comprises a spatial light modulator containing an array of switchable elements in which the optical state of each element can be altered to create a change in phase and/or amplitude in the light incident thereon.

10. Apparatus as claimed in

claim 3

, wherein the dynamic optical device comprises an array of switchable pre-recorded holographic elements.

11. Apparatus as claimed in

claim 10

, wherein the dynamic optical device also comprises non-switchable holographic elements.

12. Apparatus as claimed in

claim 10

, wherein the dynamic optical device comprises an electrically switchable holographic composite.

13. Apparatus as claimed in

claim 3

, wherein the dynamic optical device is used in a range in which the phase and/or amplitude modulation varies substantially linearly with applied stimulus.

14. Apparatus as claimed in

claim 3

, wherein the dynamic optical device is used in a range in which it does not substantially affect the amplitude and/or the wavelength characteristics of the light transmitted or reflected thereby.

15. Apparatus as claimed in

claim 3

, wherein the dynamic optical device is in the form of a screen adapted for mounting close to the observer's eye.

16. Apparatus as claimed in

claim 15

, wherein the screen is of generally curved section in at least one plane.

17. Apparatus claimed in

claim 16

, further comprising means for engaging the screen with the observer's head in a position such that the curve thereof is generally centred on the eye point.

18. Apparatus as claimed in

claim 3

, wherein the dynamic optical device acts upon light transmitted therethrough, and the image generator is located on a side of the dynamic optical device remote from the intended position of the observer's eye.

19. Apparatus as claimed in

claim 3

, wherein the dynamic optical device acts upon light reflected thereby, and the image generator is at least partially light-transmitting and is located between the dynamic optical device and the intended position of the observer's eye.

20. Apparatus as claimed in

claim 3

, wherein the control means acts on the dynamic optical device comprises an array of discrete optical elements in close juxtaposition to each other, each of which acts as an individual lens or mirror.

21. Apparatus as claimed in

claim 20

wherein the discrete optical elements are capable of being controlled independently.

22. Apparatus as claimed in

claim 20

, wherein some of the discrete optical elements act to direct to the observer's eye light of one colour, while others of the discrete optical elements act to direct to the observer's eye light of other colours.

23. Apparatus as claimed in

claim 3

, wherein the dynamic optical device functions to correct aberrations and/or distortions in the image produced by the image generator.

24. Apparatus as claimed in

claim 3

, wherein the dynamic optical device factions to create a desired position, size and/or shape for the exit pupil.

25. Apparatus as claimed in

claim 3

, and further including sensing means operative to sense the direction of gaze of the observer's eye, the control means being operative on the dynamic optical device to create an area of relatively high resolution in said direction of gaze, the dynamic optical device providing a lesser degree of resolution of the image elsewhere, the control means being responsive to the sensing means and being operative to alter the characteristics of the dynamic optical device to reposition said area of relatively high resolution to include said direction of gaze as the latter is altered.

26. Apparatus as claimed in

claim 25

, wherein the sensing means utilises radiation which is scattered from the observer's eye and which is detected by detector means, and the dynamic optical device also functions to project said radiation onto the eye and/or to project to the detector means the radiation reflected by the eye.

27. Apparatus as claimed in

claim 26

, further comprising sensing means operative to track the head positions of a plurality of observers, a plurality of sensing means each of which is operative to detect the direction of eye gaze of a respective one of the observers, and the dynamic optical device is operative to create a plurality of exit pupils for viewing of the image by the observers, respectively.

28. Apparatus as claimed in

claim 25

, wherein the sensing means includes a plurality of sensors adapted to sense the attitude of the observer's eye, the sensors being positioned in or on the dynamic optical device and/or the image generator.

29. Apparatus as claimed in

claim 25

, wherein the sensing means comprises emitter means operative to emit radiation for projection onto the observer's eye and detector means operative to detect radiation reflected back from the eye.

30. Apparatus as claimed in

claim 29

. wherein the emitter means and/or the detector means are provided on a light-transmitting screen disposed between the image generator and the dynamic optical device.

31. Apparatus as claimed in

claim 30

, wherein the image generator is in the form of a display screen, and the emitter means and/or the detector means are provided in or on the display screen.

32. Apparatus as claimed in

claim 31

, wherein the emitter means are provided in or on the display screen, a beamsplitter device is disposed between the display screen and the dynamic optical device and is operative to deflect radiation reflected by the observer's eye laterally of the main optical path through the apparatus, and the detector means are displaced laterally from the main optical path.

33. Apparatus as claimed in

claim 29

, wherein the image generator produces a pixilated image, and the emitter means and/or detector means are provided at pixel level within the field of view.

34. Apparatus as claimed in

claim 25

, wherein the sensing means utilises infra-red radiation.

35. Apparatus as claimed in

claim 34

, further comprising at least one optical element provided in tandem with the dynamic optical device, which acts upon infra-red light but not upon visible light.

36. Apparatus as claimed in

claim 34

, wherein the detector means are provided on a light-transmitting screen disposed between the image generator and the dynamic optical device.

37. Apparatus as claimed in

claim 36

, wherein a reflector is disposed between the image generator and the light-transmitting screen, and is operative to reflect the infra-red radiation whilst allowing transmission of visible light, such that the infra-red radiation after reflection by the observer's eye passes through the dynamic optical device and the light-transmitting screen, and is reflected by said reflector back towards the screen.

38. Apparatus as claimed in

claim 25

, wherein the sensing means utilises visible light.

39. Apparatus as claimed in

claim 38

, wherein the visible light is utilised in short bursts.

40. Apparatus as claimed in

claim 38

, wherein the sensing means include emitter means operative to emit light for projection onto the observer's eye, the image generator produces a pixilated image, the emitter means is provided at pixel level within the field of view, and the wavelength of light emitted by the emitter is matched to that of the surrounding pixels in the generated image.

41. Apparatus as claimed in

claim 38

, wherein the visible light is utilised in a specific narrow band of wavelengths.

42. Apparatus as claimed in

claim 3

, wherein the image generator and the dynamic optical device are incorporated into a thin monolithic structure.

43. Apparatus as claimed in

claim 39

, wherein the monolithic structure also includes a micro-optical device operative to perform initial beam shaping.

44. Apparatus as claimed in

claim 3

wherein the dynamic optical device includes an optical shutter operable to selectively expose a portion of the dynamic optical device to light from the image generation means.

45. Apparatus as claimed in

claim 44

wherein the optical shutter is capable of defining a generally light transmitting area of the dynamic optical device in response to a stimulus applied by the control means, the control means further being operable to control the optical shutter to expose all areas of the dynamic optical device sequentially.

46. Apparatus as claimed in

claim 3

, further comprising means to permit the viewing of ambient light from the surroundings, either separately from or in conjunction with the image produced by the image generator.

47. Apparatus as claimed in

claim 46

. wherein the image generator includes discrete light-emitting elements (such as lasers or LEDs) which are located on a generally light-transmitting screen through which the ambient light can be viewed.

48. Apparatus as claimed in

claim 46

, wherein the light-emitting elements are located at the periphery of said screen, and the screen acts as a light guide member and includes reflective elements to deflect the light from the light-emitting elements towards the dynamic optical element.

49. Apparatus as claimed in

claim 46

, wherein the image generator is in the form of a display panel, and the panel is mounted so as to be movable between a first position in which it confronts the dynamic optical device and a second position in which it is disposed away from the dynamic optical device.

50. Apparatus as claimed in

claim 46

, wherein the image generator is in the form of a display screen and displays an input image, and further comprising detection means operative to sense the ambient light, a processor responsive to signals received from the detector means to display on the display screen an image of the surroundings, and means enabling the display screen to display selectively and/or in combination the input image and the image of the surroundings.

51. Apparatus as claimed in

claim 3

, wherein the image generator comprises an array of light-emitting elements each of which is supplied with signals representing a respective portion of the image to be viewed, the signals supplied to each light-emitting element being time-modulated with information relating to the details in the respective portion of the image.

52. Apparatus as claimed in

claim 3

, wherein the image produced by the image generator is pre-distorted.

53. Apparatus as claimed in

claim 3

, wherein the functions of the image generator and the dynamic optical device are combined into a single device.

54. Apparatus as claimed in

claim 53

, wherein said single device comprises a dynamic hologram.

55. Apparatus as claimed in

claim 53

, wherein said single device includes a spatial light modulator operative to produce a dynamic diffraction pattern which is illuminated by at least one reference beam.

56. Apparatus as claimed in

claim 3

, wherein said image for viewing by the observer is displayed on a display screen.

57. Apparatus as claimed in

claim 56

, wherein the display screen is of generally curved section in at least one plane.

58. Apparatus as claimed in

claim 57

, further comprising means for engaging the display screen with the observer's head in a position such that the curve thereof is generally centred on the eye point.

59. Apparatus as claimed in

claim 58

, which forms part of a head-mounted device.

60. Apparatus for viewing an image, comprising a dynamic optical device, the dynamic optical device being operative to create a modulation in respect of at least one of phase and amplitude in light transmitted or rejected thereby by means of which the observer's eye views an image in use, sensing means operative to sense the direction of gaze of the observer's eye, and control means which acts on the dynamic optical device to create an area of relatively high resolution in said direction of gaze, the dynamic optical device providing a lesser degree of resolution of the image elsewhere, the control means being responsive to the sensing means and being operative to alter the characteristics of the dynamic optical device to move said area of relatively high resolution to follow said direction of gaze as the latter is altered.

61. Apparatus as claimed in

claim 60

wherein the control means is operative to alter periodically the characteristics of the dynamic optical device so that, at least in said area of relatively high resolution, the dynamic optical device acts sequentially to direct light of different colours to the observer's eye.

62. Apparatus as claimed in

claim 60

, wherein the sensing means utilises radiation which is scattered from the observer's eye and which is detected by detector means, and the dynamic optical device also functions to project said radiation onto the eye and/or to project to the detector means the radiation reflected by the eye.

63. Apparatus as claimed in

claim 62

, further comprising sensing means operative to track the head positions of a plurality of observers, a plurality of sensing means each of which is operative to detect the direction of eye gaze of a respective one of the observers, and the dynamic optical device is operative to create a plurality of exit pupils for viewing of the image by the observers, respectively.

64. Apparatus as claimed in

claim 60

, wherein the sensing means includes a plurality of sensors adapted to sense the attitude of the observer's eye, the sensors being positioned in or on the dynamic optical device and/or the image generator.

65. Apparatus as claimed in

claim 60

, wherein the sensing means comprises emitter means operative to emit radiation for projection onto the observer's eye and detector means operative to detect radiation reflected back from the eye.

66. Apparatus as claimed in

claim 65

, wherein the emitter means and/or the detector means are provided on a light-transmitting screen disposed between the image generator and the dynamic optical device.

67. Apparatus as claimed in

claim 66

, wherein the image generator is in the form of a display screen, and the emitter means and/or the detector means are provided in or on the display screen.

68. Apparatus as claimed in

claim 67

, wherein the emitter means are provided in or on the display screen, a beamsplitter device is disposed between the display screen and the dynamic optical device and is operative to deflect radiation reflected by the observer's eye laterally of the main optical path through the apparatus, and the detector means are displaced laterally from the main optical path.

69. Apparatus as claimed in

claim 65

, wherein the image generator produces a pixilated image, and the emitter means and/or detector means are provided at pixel level within the field of view.

70. Apparatus as claimed in

claim 60

, wherein the sensing means utilises infra-red radiation.

71. Apparatus as claimed in

claim 70

, further comprising at least one optical element provided in tandem with the dynamic optical device, which acts upon infra-red light but not upon visible light.

72. Apparatus as claimed in

claim 70

, wherein the detector means are provided on a light-transmitting screen disposed between the image generator and the dynamic optical device.

73. Apparatus as claimed in

claim 72

, wherein a reflector is disposed between the image generator and the light-transmitting screen, and is operative to reflect the infra-red radiation whilst allowing transmission of visible light, such that the infra-red radiation after reflection by the observer's eye passes through the dynamic optical device and the light-transmitting screen, and is reflected by said reflector back towards the screen.

74. Apparatus as claimed in

claim 60

, wherein the sensing means utilises visible light.

75. Apparatus as claimed in

claim 74

, wherein the visible light is utilised in short bursts.

76. Apparatus as claimed in

claim 74

, wherein the sensing means include emitter means operative to emit light for projection onto the observer's eye, the image generator produces a pixellated image, the emitter means is provided at pixel level within the field of view, and the wavelength of light emitted by the emitter is matched to that of the surrounding pixels in the generated image.

77. Apparatus as claimed in

claim 74

, wherein the visible light is utilised in a specific narrow band of wavelengths.

78. Apparatus as claimed in

claim 60

wherein the dynamic optical device is generally reflective.

79. Apparatus as claimed in

claim 60

wherein the dynamic optical device is generally transmissive.

80. Apparatus as claimed in

claim 60

wherein the image generation means is configured off-axis from the general direction of view of the observer's eye in use.

81. Apparatus as claimed in

claim 80

wherein the apparatus is embodied in a headset with a side portion arranged to be placed in the temple region of an observer's head, the image generation means being housed within the side portion.

82. Apparatus as claimed in

claim 60

wherein the apparatus includes left and right image generation means, left and right dynamic optical devices and left and right side portions within which said left and right image generation means are housed, said left and right image generation means being operative to project towards said left and right dynamic optical devices respectively, thereby displaying a binocular image.

83. Apparatus as claimed in

claim 60

, wherein the dynamic optical device comprises a spatial light modulator containing an array of switchable elements in which the optical state of each element can be altered to create a change in phase and/or amplitude in the light incident thereon.

84. Apparatus as claimed in

claim 60

, wherein the dynamic optical device comprises an array of switchable pre-recorded holographic elements.

85. Apparatus as claimed in

claim 84

, wherein the dynamic optical device also comprises non-switchable holographic elements.

86. Apparatus as claimed in

claim 84

, wherein the dynamic optical device comprises an electrically switchable holographic composite.

87. Apparatus as claimed in

claim 60

, wherein the dynamic optical device is used in a range in which the phase and/or amplitude modulation varies substantially linearly with applied stimulus.

88. Apparatus as claimed in

claim 60

, wherein the dynamic optical device is used in a range in which it does not substantially affect the amplitude and/or the wavelength characteristics of the light transmitted or reflected thereby.

89. Apparatus as claimed in

claim 60

, wherein the dynamic optical device is in the form of a screen adapted for mounting close to the observer's eye.

90. Apparatus as claimed in

claim 89

, wherein the screen is of generally curved section in at least one plane.

91. Apparatus claimed in

claim 90

, further comprising means for engaging the screen with the observer's head in a position such that the curve thereof is generally centred on the eye point.

92. Apparatus as claimed in

claim 60

, wherein the dynamic optical device acts upon light transmitted therethrough, and the image generator is located on a side of the dynamic optical device remote from the intended position of the observer's eye.

93. Apparatus as claimed in

claim 60

, wherein the dynamic optical device acts upon light reflected thereby, and the image generator is at least partially light-transmitting and is located between the dynamic optical device and the intended position of the observer's eye.

94. Apparatus as claimed in

claim 60

, wherein the control means acts on the dynamic optical device comprises an array of discrete optical elements in close juxtaposition to each other, each of which acts as an individual lens or mirror.

95. Apparatus as claimed in

claim 94

wherein the discrete optical elements are capable of being controlled independently.

96. Apparatus as claimed in

claim 94

, wherein some of the discrete optical elements act to direct to the observer's eye light of one colour, while others of the discrete optical elements act to direct to the observer's eye light of other colours.

97. Apparatus as claimed in

claim 60

, wherein the dynamic optical device functions to correct aberrations and/or distortions in the image produced by the image generator.

98. Apparatus as claimed in

claim 60

, wherein the dynamic optical device functions to create a desired position, size and/or shape for the exit pupil.

99. Apparatus as claimed in

claim 60

, wherein the image generator and the dynamic optical device are incorporated into a thin monolithic structure.

100. Apparatus as claimed in

claim 60

, wherein the monolithic structure also includes a micro-optical device operative to perform initial beam shaping.

101. Apparatus as claimed in

claim 3

. wherein the dynamic optical device includes an optical shutter operable to selectively expose a portion of the dynamic optical device to light from the image generation means.

102. Apparatus as claimed in

claim 101

wherein the optical shutter is capable of defining a generally light transmitting area of the dynamic optical device in response to a stimulus applied by the control means, the control means further being operable to control the optical shutter to expose all areas of the dynamic optical device sequentially.

103. Apparatus as claimed in

claim 60

, further comprising means to permit the viewing of ambient light from the surroundings, either separately from or in conjunction with the image produced by the image generator.

104. Apparatus as claimed in

claim 103

, wherein the image generator includes discrete light-emitting elements (such as lasers or LEDs) which are located on a generally light-transmitting screen through which the ambient light can be viewed.

105. Apparatus as claimed in

claim 103

, wherein the light-emitting elements are located at the periphery of said screen, and the screen acts as a light guide member and includes reflective elements to deflect the light from the light-emitting elements towards the dynamic optical element.

106. Apparatus as claimed in

claim 103

, wherein the image generator is in the form of a display panel, and the panel is mounted so as to be movable between a first position in which it confronts the dynamic optical device and a second position in which it is disposed away from the dynamic optical device.

107. Apparatus as claimed in

claim 103

, wherein the image generator is in the form of a display screen and displays an input image, and further comprising detection means operative to sense the ambient light, a processor responsive to signals received from the detector means to display on the display screen an image of the surroundings, and means enabling the display screen to display selectively and/or in combination the input image and the image of the surroundings.

108. Apparatus as claimed in

claim 60

wherein the image generator comprises an array of light-emitting elements each of which is supplied with signals representing a respective portion of the image to be viewed, the signals supplied to each light-emitting element being time-modulated with information relating to the details in the respective portion of the image.

109. Apparatus as claimed in

claim 108

wherein the area of relatively high resolution is produced by means of the dynamic optical device switching the direction of the light from the light-emitting elements in the region of the direction of gaze of the observer's eye.

110. Apparatus as claimed in

claim 60

, wherein the image produced by the image generator is pre-distorted.

111. Apparatus as claimed in

claim 60

, wherein the functions of the image generator and the dynamic optical device are combined into a single device.

112. Apparatus as claimed in

claim 111

, wherein said single device comprises a dynamic hologram.

113. Apparatus as claimed in

claim 111

, wherein said single device includes a spatial light modulator operative to produce a dynamic diffraction pattern which is illuminated by at least one reference beam.

114. Apparatus as claimed in

claim 60

, wherein said image for viewing by the observer is displayed on a display screen.

115. Apparatus as claimed in

claim 114

. wherein the display screen is of generally curved section in at least one plane.

116. Apparatus as claimed in

claim 115

further comprising means for engaging the display screen with the observer's head in a position such that the curve thereof is generally centred on the eye point.

117. Apparatus as claimed in

claim 116

, which forms part of a head-mounted device.

118. Apparatus for viewing an image, comprising an image generator operative to generate an image for viewing by an observer's eye, an optical system for transmitting said image to the observer's eye position, sensing means operative to sense the direction of gaze of the observer's eye, and control means responsive to the sensing means and operative to act on the image generator and/or the optical system to modify said image transmitted to the eye in accordance with the direction of gaze of the eye, the sensing means including emitter means operative to emit radiation for projection onto the observer's eye, and detector means operative to detect said radiation after reflection by said eye, the optical system also functioning to transmit said radiation from the emitter means onto said eye and/or to transmit said radiation reflected from said eye to the detector means.

119. Apparatus as claimed in

claim 118

, wherein said radiation comprises infra-red radiation.

120. Apparatus as claimed in

claim 118

, wherein the optical system includes at least one optical element which acts upon both visible light and infra-red radiation, and at least one second optical element which acts upon infra-red radiation but not upon visible light.

121. Apparatus as claimed in

claim 118

, wherein the detector means (and preferably also the emitter means) are provided on a light-transmitting screen disposed between the image generator and the optical system.

122. Apparatus as claimed in

claim 121

, wherein a reflector is disposed between the image generator and the light-transmitting screen, and is operative to reflect the infra-red radiation whilst allowing transmission of visible light, such that the infra-red radiation after reflection by the observer's eye passes through the optical system and the light-transmitting screen, and is reflected by said reflector back towards the screen.

123. Apparatus as claimed in

claim 122

wherein the reflector is one of a holographic/diffractive reflector and a conventional dichroic reflector.

124. Apparatus as claimed in

claim 118

, wherein the image generator is in the form of a display screen, and the emitter means and/or the detector means are provided in or on the display screen.

125. Apparatus as claimed in

claim 124

, wherein the emitter means are provided in or on the display screen, a beamsplitter device is disposed between the display screen and the optical system and is operative to deflect infra-red radiation reflected by the observer's eye and passing through the optical system laterally of the main optical path through the apparatus, and the detector means are displaced laterally from said main optical path.

126. Apparatus as claimed in

claim 118

, wherein the image generator generates a pixilated image, and the emitter means and/or the detector means are provided at pixel level.

127. Apparatus for viewing an image, comprising an image generator operative to generate an image for viewing by an observer's eye, an optical system for transmitting said image to the observer's eye position, sensing means operative to sense the direction of gaze of the observer's eye, and control means responsive to the sensing means and operative to act on the image generator and/or the optical system to modify said image transmitted to the eye in accordance with the direction of gaze of the eye, the tracking means including emitter means operative to emit radiation for projection onto the observer's eye, and detector means operative to detect said radiation after reflection by said eye, the emitter means and/or the detector means being provided at pixel level within the field of view of the image.

128. Apparatus as claimed in

claim 127

, wherein the image generator is in the form of a display screen, and the emitter means and/or the detector means are provided at pixel level in or on the display screen.

129. Apparatus as claimed in

claim 127

, wherein the emitter means and/or the detector means are provided at pixel level on a light-transmitting screen disposed between the image generator and the optical system.

130. Apparatus as claimed in

claim 127

. wherein said radiation comprises infra-red radiation.

131. Apparatus as claimed in

claim 127

, wherein the optical system includes at least one optical element which acts upon both visible light and infra-red radiation, and at least one second optical element which acts upon infra-red radiation but not upon visible light.

Images