US20020034020A1 - Panoramic imaging arrangement - Google Patents

Abstract

According to one aspect the invention, a panoramic imaging arrangement is provided which includes at least a first lens block including a convex reflective surface and a transparent component. The convex reflective surface has a substantially vertically extending axis of revolution and is capable of receiving light from a 360° surrounding panoramic scene, and reflecting the light for further manipulation. The transparent component covers the convex reflective surface. The convex reflective surface is thereby protected from environmental conditions which may otherwise result in damage to the convex reflective surface.

Description

• This patent application is a divisional of U.S. patent application Ser. No. 09/137,660 filed Aug. 20, 1998 now U.S. Pat. No. ______ that is a is a continuation-in-part of U.S. patent application Ser. No. 08/872,525 filed Jun. 11, 1997 (pending) which claims priority from U.S. Provisional Patent Application Serial No. 60/020,292 filed Jun. 24, 1996.[0001]
BACKGROUND OF THE INVENTION
• 1). Field of the Invention[0002]
• This invention relates to a panoramic imaging arrangement of the kind capable of capturing, focusing, correcting aberrations and otherwise manipulating light received from a 360° surrounding panoramic scene, and to a method of capturing a 360° surrounding panoramic scene.[0003]
• 2). Discussion of Related Art[0004]
• Panoramic imaging arrangements have become popular in recent years for purposes of viewing 360° surrounding panoramic scenes. Older generations of panoramic imaging arrangements generally consisted of revolving periscope-like constructions having relatively complex mechanisms for revolving them. More recently, stationary panoramic imaging arrangements have been developed. A stationary panoramic imaging arrangement generally has one or more lenses, each having a vertically extending axis of revolution, which are used to refract or reflect light received from a 360° surrounding panoramic scene. The lenses alter the direction of the light, whereafter the light passes through a series of lenses which are located vertically one above the other and which further manipulate the light by, for example, focusing the light or altering the intensity of the light.[0005]
• The task of receiving light in a sideways direction and altering the direction of the light so that the light then proceeds in a vertical direction is a difficult one. Altering the direction of light to such a degree, especially when coming from a 360° surrounding scene, oftentimes leads to aberrations in the resulting light. These aberrations may include astigmatism of the light, defects in color of the light, a loss of image plane flatness, and other defects, some of which are discussed in more detail herein below.[0006]
• Relatively complex lenses and lens arrangements have been developed in order to overcome these aberrations. Some of these lenses have surfaces which are aspherical (see for example U.S. Pat. No. 5,473,474 issued to Powell). Aspherical lenses are difficult to manufacture and therefore less practical to manufacture than for example spherical lenses.[0007]
• One reason why aberrations in light occur is due to the use of refractive lenses instead of reflective lenses. The use of refractive lenses results in aberrations in color of the resulting light, whereas the use of reflective, or mirror lenses does not result in, or cause minimal aberrations in color of the light reflected from them. One reason for the lack of the use of reflective lenses, on the other hand, is that reflective lenses, when exposed to the environment, degrade through time, resulting in loss of image.[0008]
• These and other aberrations in light are more prominent when light is received from a panoramic view at a relatively large lateral included angle, particularly if the included angle, in a vertical plane, is larger than 90° and especially if the included angle extends from an angle below the horizon to an angle above the horizon, i.e. covering substantially more than a hemisphere.[0009]
SUMMARY OF THE INVENTION
• According to one aspect of the invention, a panoramic imaging arrangement is provided comprising at least a first lens block including a convex reflective surface and a transparent lens. The convex reflective surface has a substantially vertical axis of revolution and is capable of receiving light from a 360° surrounding panoramic scene, and reflecting the light for further manipulation. The transparent lens has a convex outer surface and covers the convex reflective surface. The convex reflective surface is thereby protected from environmental conditions which may otherwise result in damage to the convex reflective surface. An additional advantage is that a convex cover introduces fewer aberrations and internal reflections.[0010]
• The convex reflective surface may, for ease of fabrication, be substantially spherical.[0011]
• The transparent component may, for ease of fabrication, have a spherical outer surface thorough which light from the panoramic scene passes before reaching the convex reflective surface.[0012]
• The panoramic imaging arrangement may include a second lens block secured to the first lens block. Light, reflected by the convex reflective surface, may pass through the transparent component, whereafter the light may pass through the second lens block. The second lens block provides a way for the first lens block to be held without obscuring its field of view.[0013]
• The convex reflective surface is preferably capable of receiving light for an unbroken included angle of at least 60° in a vertical plane, from the panoramic scene, and reflecting the light so as to pass through the second lens block.[0014]
• The included angle preferably extends from an angle below the horizon to an angle above the horizon. The panoramic imaging arrangement is therefore capable of capturing more than just a hemispherical scene. The angle below the horizon is preferably at least 30° below the horizon and the angle above the horizon is preferably at least 30° above the horizon.[0015]
• A transparent optical cement may be located between the first and second lens blocks and secure the first and second lens blocks to one another.[0016]
• According to another aspect of the invention, a panoramic imaging arrangement is provided which includes at least a first lens block including a convex reflective surface and a transparent component. The convex reflective surface has a substantially vertical axis of revolution. The convex reflective surface is capable of receiving light from a 360° surrounding panoramic scene for an unbroken included angle, in a vertical plane extending from an angle below the horizon to an angle above the horizon. The convex reflective surface is capable of reflecting the light for further manipulation. The transparent component covers the reflective surface.[0017]
• According to a further aspect of the invention, a panoramic imaging arrangement is provided comprising at least one lens having a substantially vertical axis of revolution and a convex spherical reflective surface capable of receiving light from a 360° surrounding panoramic scene and reflecting the light received from the panoramic scene. Reflective surfaces cause less aberrations in color, convex reflective lenses require less power, and spherical lenses are easier to manufacture.[0018]
• Apparatus is preferably provided which is positioned to receive light reflected by the convex spherical reflective surface and is capable of correcting at least one aberration of the light.[0019]
• The apparatus preferably manipulates the light so as to correct astigmatism, so as to do color correction, to focus the light, to adjust f-theta closer to a desired level, or so as to create a flat image plane when the light is focused.[0020]
• The convex spherical reflective surface is preferably capable of receiving light for an unbroken included angle of at least 60°, in a vertical plane, whereafter the light from the entire included angle is received by the manipulation apparatus.[0021]
• The included angle preferably extends from an angle below the horizon to an angle above the horizon.[0022]
• According to a further aspect of the invention, a panoramic imaging arrangement is provided comprising at least one lens, and light manipulation apparatus. The lens has a substantially vertical axis of revolution. The lens is also capable of receiving light from a 360° panoramic scene surrounding the lens for an unbroken included angle of at least 60°, in a vertical plane, extending from an angle below the horizon to an angle above the horizon. The lens is further capable of altering the direction of the light received from the panoramic scene. The light manipulation apparatus is positioned and capable of receiving light from the lens for the entire included angle. One advantage of such a lens is that a relatively large included angle, extending from below to above the horizon, can be viewed.[0023]
• The lens preferably has a spherical surface altering the direction of the light.[0024]
• The lens may have a reflective surface which reflects the light. The reflective surface may be convex and is preferably spherical.[0025]
• According to yet a further aspect of the invention, apparatus is provided for capturing a panoramic scene. The apparatus comprises a vertical support structure, lower and upper lens blocks, and a convex reflective surface. The lower lens block is secured to an upper end of the support structure. The upper lens block is secured to the lower lens block in a position above the lower lens block and has a convex outer surface having a substantially vertical axis of revolution. The convex reflective surface is located on the upper lens block. Light from a 360° surrounding panoramic scene is capable of passing through the convex outer surface of the upper lens block into the upper lens block, the light is then reflected off the convex reflective surface, and the light then passes through the upper lens block and then through the lower lens block. In such an apparatus there is little obscuring of the panoramic view by the support structure.[0026]
• The apparatus for capturing the panoramic scene preferably includes a system of lenses positioned below the lower lens block to receive light after passing through the lower lens block.[0027]
• According to yet a further aspect of the invention, a method is provided of mounting a panoramic lens arrangement including a first lens block which includes a convex reflective surface having a substantially vertical axis of revolution, and a transparent component covering the reflective surface, and a second lens block located on the first lens block. The method includes the step of securing the second lens block to a support structure in a position so that light from a 360° surrounding panoramic scene passes through the transparent component, whereafter the light is reflected by the convex reflective surface, whereafter the light passes through the second block.[0028]
• According to yet a further aspect of the invention, a method of capturing a panoramic scene is provided. Light, received from a 360° panoramic scene surrounding a convex spherical reflective surface, is reflected from the convex spherical reflective surface. The light reflected from the convex spherical reflective surface may then be corrected for at least one characteristic of the light, the characteristic being selected from the group consisting of: astigmatism; color; f-theta and image flatness.[0029]
• The convex spherical reflective surface preferably receives light for an unbroken included angle of at least 60°, in a vertical plane, whereafter the light from the entire included angle is corrected.[0030]
• The included angle preferably extends from an angle below the horizon to an angle above the horizon.[0031]
• According to yet a further aspect of the invention another method of capturing a panoramic scene is provided. Light is received from a 360° surrounding panoramic scene for an unbroken included angle of at least 60° extending from an angle below the horizon to an angle above the horizon. The direction of the light received from the panoramic scene is then altered. After the direction of the light is altered, at least one characteristic of the light is corrected, the characteristic being selected from the group consisting of: astigmatism; color; f-theta; and image flatness.[0032]
BRIEF DESCRIPTION OF THE DRAWINGS
• The invention is further described by way of example with reference to the accompanying drawings wherein:[0033]
• FIG. 1 is a side view illustrating apparatus, according to an embodiment of the invention, for viewing in a panoramic scene; and[0034]
• FIG. 2 is an enlarged view of first and second lens blocks forming part of the apparatus of FIG. 1.[0035]
DESCRIPTION OF PREFERRED EMBODIMENT
• FIG. 1 of the accompanying drawings illustrates[0036]apparatus10, according to an embodiment of the invention, for capturing a panoramic scene. Theapparatus10 includes a vertically extendingsupport structure12, and apanoramic imaging arrangement14 which is secured to anupper end16 of thesupport structure12.
• The[0037]support structure12 may be any device having anupper end16 which is high enough for purposes of providing a viewpoint of a panoramic scene. Thesupport structure12 may, for example, be a vertically extending post, a tripod stand, or may form part of building structure.
• The[0038]panoramic imaging arrangement14 includes a first,upper lens block18, a second,lower lens block20, andapparatus22, positioned below thesecond lens block20, for manipulating light so as to correct certain aberrations of the light and to focus the light (hereinafter generally referred to as the “light manipulation apparatus22”).
• FIG. 2 is an enlarged view of the first and second lens blocks[0039]18 and20.
• The[0040]first lens block18 includes a transparent component orrefractive lens24 which has a substantially spherical convex outer andlower surface26, and a substantially spherical concave inner andupper surface28. Center points of the convexouter surface26 and the concaveinner surface28 of thetransparent lens24 substantially coincide with one another.
• The concave[0041]inner surface28 is covered with a thin layer ofreflective material30. After thereflective material30 is deposited, a substantially spherical convex reflective surface32 (sometimes generally referred to herein as a “convex reflective lens”) is provided against thetransparent lens24. Thetransparent lens24 so covers the convexreflective surface32, thereby providing a shield protecting the convexreflective surface32 against environmental conditions which may otherwise cause damage to the convexreflective surface32.
• The convex[0042]outer surface26 of thetransparent lens24 and the convexreflective surface32 have a common, substantially vertical axis ofrevolution34. Thesecond lens block20 is made out of cylindrical transparent material. Anupper end36 of thesecond lens block20 has a substantially spherical concave surface which conforms with the convexouter surface26 of thetransparent lens24.
• The[0043]transparent lens24 and thesecond lens block20 are secured to one another be means of a transparent optical cement (not shown) which is located between theupper end36 of thesecond lens block20 and the convexouter surface26 of thetransparent lens24. Transparent optical cements of the above kind are known in the art.
• Referring again to FIG. 1, the[0044]light manipulation apparatus22 includes a system oflenses38,image capturing apparatus40, anddigital image corrector42.
• The system of[0045]lenses38 includes a first set oflenses44, a second set oflenses46, and a third set oflenses48. The lenses work together to correct aberrations of light. Generally speaking the first set oflenses44 is designed and configured to reduce astigmatism, the second set oflenses46 for doing color correction, and thethird set lenses48 for creating an image of suitable scale and for fine-tuning certain other system aberration as will further be discussed herein. One skilled in the art of optics will appreciate that the respective sets oflenses44,46, and48 are of conventional kind although their collective effect may be unique in completing the present embodiment. Further details of such lenses may be found in a handbook on modern optics such as in “Modern Optical Engineering” by Warren J. Smith (McGraw Hill, Inc.; 1990).
• The[0046]panoramic imaging arrangement14 is secured to theupper end16 of thesupport structure12 by mounting thesecond lens block20 directly to theupper end16 of thesupport structure12. No metal or other components are therefore secured to thefirst lens block18.
• In use, light is received laterally from a 360° panoramic scene surrounding the first lens block[0047]18 (see FIG. 2). Light from the panoramic scene enters the convexouter surface26 of thetransparent lens24 of thefirst lens block18 for an unbroken and continuous includedangle52 located in a vertical plane. The included angle is about 105° covering more than a hemisphere and extends from anangle54 which is about 55° below the horizon to anangle56 which about 40° above the horizon. (The includedangle52 is therefore at least 60° and preferably at least 90°, and theangles54 and56 below and above the horizon are each therefore at least 30° below and above the horizon.)
• It should be noted that the lens blocks[0048]18 and20 are mounted to thesupport structure12 so that light from the panoramic scene is capable of passing over theupper end16 of thesupport structure12, i.e., without the support structure obscuring light from the panoramic scene.
• Light from the panoramic scene is refracted slightly upwardly when entering the[0049]transparent lens24. The light then travels through thetransparent lens24 and is reflected downwardly from the convexreflective surface32. The light then passes downwardly through thetransparent lens24 and exits thetransparent lens24 downwardly through the convexouter surface26.
• The light then passes through the transparent optical cement located between the first and second lens blocks[0050]18 and20, whereafter the light enters thesecond lens block20 through theupper end36 thereof. Thesecond lens block20 has a diameter which is sufficiently wide so that light from the entire includedangle52, after being reflected by the convexreflective surface32, enters thesecond lens block20 thorough itsupper end36. The light then travels through thesecond lens block20 and exits the second lens block through alower end60 thereof. Although not shown in particular detail in the figures, the cylindrical outer surface of thesecond lens block20 is typically covered to prevent light from entering into thesecond lens block20 in a sideways direction. This may be accomplished with theupper end16 of the support structure shown in FIG. 2.
• Should an attempt be made to focus the light after leaving the[0051]second lens block20, certain aberrations would be noticed. These aberrations include astigmatism, abnormality in color, lack of image plane flatness, and a value of f-theta which is less than 1. The value f-theta is indicative of how much compression of view occurs in a vertical direction of an image view, resulting in more vertical compression in one area of the image view than in another area of the image view. Values of f-theta are expressed as fractions of 1 so that a value of f-theta approaching 1 would be indicative of more uniform compression, and a value of f-theta which is a smaller fraction of1 would be indicative of more non-uniform compression.
• A number of factors, alone and in combination, contribute to these aberrations, including the relatively large width of the included[0052]angle52, the relatively large inclination of theangle54 below the horizon, the relatively high inclination of theangle56 above the horizon, and the particular choice of lenses, including the choice of a substantially spherical convexouter surface26 of thetransparent lens24, and the substantially spherical convexreflective surface32. These aberrations occur even though areflective surface32 is used which causes less aberrations in color than a refractive surface would and even though thetransparent lens24 has a convexouter surface26 which assists greatly in reducing aberrations.
• The light manipulation apparatus[0053]22 (see FIG. 1), however, functions to correct or at least to reduce these aberrations.
• In particular, the first set of[0054]lenses44 is positioned so that light from thesecond lens block20 passes through the first set oflenses44. The first set oflenses44 then generally corrects or at least reduces astigmatism of the light to an acceptable level.
• The second set of[0055]lenses46 is positioned to receive the light, after passing through the first set oflenses44, and generally functions so as to do color correction of the light.
• The third set of[0056]lenses48 is positioned to receive light, after passing through the second set oflenses46, and generally functions to reduce the effect of compression so that the value f-theta is adjusted closer to 1, typically to a value above 0.5. The third set oflenses48 also functions to flatten the image plane and focus the image on theimage capturing apparatus40.
• The[0057]image capturing apparatus40 may, for example, be a digital detection array capable of capturing the image projected by thepanoramic imaging arrangement14. Certain aberrations may still exist, even after the light passes through the system oflenses38. For example, the value of f-theta, although adjusted to be closer to 1, may still be somewhat below 1.
• The[0058]digital image corrector42 is coupled to the image capturing apparatus so as to receive the image captured by theimage capturing apparatus40. Thedigital image corrector42 is capable of adjusting the image so as to correct for certain, still existing aberrations. For example, thedigital image corrector42 may adjust f-theta so as to be closer or substantially equal to 1. One skilled in the art would appreciate that thedigital image corrector42 typically has a processor and memory with an executable program which corrects the aberrations in the light referred to.
• As mentioned previously, one unique feature is that a substantially spherical convex[0059]reflective surface32 is used which is protected from environmental conditions which may otherwise result in damage to thereflective surface32. Reflective lenses generally have the advantage that they reflect light with little or no aberrations in color of the reflected light and convex reflective lenses have the added advantage that they require less power than, for example, concave reflective lenses.
• It should also be evident from the aforegoing description that another advantage is that the[0060]panoramic imaging arrangement14 can be mounted to thesupport structure12 in a manner wherein thesupport structure12 does not obscure light from a panoramic view from reaching thefirst lens block18.
• A further advantage of the invention is that lenses having substantially spherical surfaces are used. Spherical surfaces are easier to manufacture than paraboloidal, hyperboloidal, ellipsoidal or other aspheric surfaces and are therefore less expensive to manufacture.[0061]
• Yet a further advantage is that a relatively large included[0062]angle52 can be received which extends from a relativelylarge angle54 below the horizon to a relativelylarge angle56 above the horizon.
• Although spherical surfaces are used, at least one of which having a reflective surface, and regardless of the choice of[0063]angles52,54, and56, a final image is created which is corrected for astigmatism and color, which is flattened, and in which the value of f-theta is controlled.
• While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative and not restrictive of the current invention, and that this invention is not restricted to the specific constructions and arrangements shown and described, since modifications may occur to those ordinarily skilled in the art.[0064]

Claims (24)

What is claimed is:

1. A panoramic imaging arrangement comprising:

at least one lens having a substantially vertical axis of revolution, the lens having a convex spherical reflective surface capable of receiving light from a substantially 360° surrounding panoramic scene and reflecting the light received from the panoramic scene.

2. The panoramic imaging arrangement ofclaim 1 further comprising apparatus positioned to receive light reflected by the convex spherical reflective surface and capable of correcting at least one aberration of the light.

3. The panoramic imaging arrangement ofclaim 2 wherein the apparatus corrects astigmatism of the light.

4. The panoramic imaging arrangement ofclaim 2 wherein the apparatus does color correction of the light.

5. The panoramic imaging arrangement ofclaim 2 wherein the apparatus focuses the light.

6. The panoramic imaging arrangement ofclaim 5 wherein, after focusing the light, an image is created wherein f-theta is less than 1.

7. The panoramic imaging arrangement ofclaim 6 wherein f-theta is more than 0.5.

8. The panoramic imaging arrangement ofclaim 6 that includes a digital image connector capable of reading the image and adjusting f-theta closer to 1.

9. The panoramic imaging arrangement ofclaim 2 wherein the apparatus creates a flattened image plane when the light is focused.

10. The panoramic imaging arrangement ofclaim 2 wherein the convex spherical reflective surface is capable of receiving light for an unbroken included angle of at least 80°, in a vertical plane, whereafter the light from the entire included angle is received by the manipulation apparatus.

11. The panoramic imaging arrangement ofclaim 10 wherein the included angle extends from an angle below the horizon to an angle above the horizon.

12. The panoramic imaging arrangement ofclaim 1 further comprising a transparent component covering the convex reflective surface, the transparent component having a spherical outer surface through which the light from the panoramic scene passes before reaching the reflective surface.

13. A panoramic imaging arrangement comprising:

at least one lens having a substantially vertical axis of revolution, the lens being capable of receiving light from substantially a 360° panoramic scene surrounding the lens for an unbroken included angle of at least 60°, in a vertical plane, extending from an angle below the horizon to an angle above the horizon, and altering the direction of the light received from the panoramic scene; and

a light manipulation apparatus positioned and capable of receiving light from the lens for the entire included angle.

14. The panoramic imaging arrangement ofclaim 13 wherein the lens has a spherical surface altering the direction of the light.

15. The panoramic imaging arrangement ofclaim 14 wherein the lens has a reflective surface which reflects the light.

16. The panoramic imaging arrangement ofclaim 15 wherein the reflective surface is convex.

17. The panoramic imaging arrangement ofclaim 16 wherein the reflective surface is spherical.

18. Apparatus for capturing a panoramic scene, the apparatus comprising:

a vertically extending support structure;

a lower lens block secured to an upper end of the support structure;

an upper lens block secured to the lower lens block in a position above the lower lens block, the upper lens block having convex, outer surface having a vertically extending axis of revolution;

a convex reflective surface on the upper lens block wherein light from a substantially 360° surrounding panoramic scene passes through the convex outer surface of the upper lens block into the upper lens block, the light is then reflected off the convex reflective surface, and the light then passes through the upper lens block and then through the lower lens block.

19. The apparatus ofclaim 18 that includes a system of lenses, positioned below the lower lens block to receive the light after passing through the lower lens block.

20. A method of mounting a panoramic lens arrangement which includes a first lens block including a convex reflective surface having a vertically extending axis of revolution, a transparent component covering the reflective surface, and a second lens block located on the first lens block, the method comprising:

securing the second lens block to a support structure in a position so that light from a substantially 360° surrounding panoramic scene passes through the transparent component, whereafter the light is reflected by the convex reflective surface, whereafter the light passes through the second lens block.

21. A method of capturing a panoramic scene, comprising:

reflecting light, received from a 360° surrounding panoramic scene from a convex spherical reflective surface; and

correcting at least one characteristic of the light reflected from the convex spherical reflective surface, the characteristic being selected of the group consisting of: astigmatism; color; f-theta; and image plane flatness.

22. The method ofclaim 21 wherein the convex spherical reflective surface receives light for an unbroken included angle of at least 60°, in a vertical plane, whereafter the light from the entire included angle is corrected.

23. The method ofclaim 22 wherein the included angle extends from an angle below the horizon to an angle above the horizon.

24. A method of capturing a panoramic scene, comprising:

receiving light from a 360 surrounding panoramic scene for an unbroken included angle of at least 60°, in a vertical plane, extending from an angle below the horizon to an angle above the horizon;

altering the direction of the light received from the panoramic scene; and

correcting at least one characteristic the light after altering its direction, the characteristic being selected from the group consisting of: astigmatism; color; f-theta; and image plane flatness.

Images