Disclosure of Invention
An optical zoom imaging apparatus comprising: the zoom lens comprises a first light beam deflection element, a zoom lens, a beam splitter, a visible light imaging module and an infrared imaging module; the first light beam deflection element receives light beams from a target scene and reflects the light beams to the zoom lens; the zoom lens comprises one or more lenses, is arranged on the optical path of the first light beam deflection element and can move along the direction of the optical path so as to adjust the zoom multiple; the beam splitter receives the light beam from the zoom lens and then divides the light beam into a transmission light beam and a reflection light beam; the visible light imaging module is used for collecting the transmitted light beams to perform visible light imaging, and the infrared imaging module is used for collecting the reflected light beams to perform infrared imaging; or the infrared imaging module is used for collecting the transmitted light beams to perform infrared imaging, and the visible light imaging module is used for collecting the reflected light beams to perform visible light imaging.
In one embodiment, the infrared imaging module further comprises a second beam deflecting element for receiving the reflected beam and reflecting the reflected beam to the visible light imaging module or the infrared imaging module.
In one embodiment, the first beam deflecting element and the second beam deflecting element comprise at least one of a mirror or a micro-electro-mechanical system.
In one embodiment, the infrared imaging module further comprises a first relay lens and a second relay lens, wherein the first relay lens is arranged between the beam splitter and the infrared imaging module, and the second relay lens is arranged between the beam splitter and the visible light imaging module.
In one embodiment, the infrared imaging module further comprises a third relay mirror and a fourth relay mirror, wherein the third relay mirror is arranged between the beam splitter and the infrared imaging module, and the fourth relay mirror is arranged between the second beam deflection element and the visible light imaging module; or the third relay mirror is arranged between the beam splitter and the visible light imaging module, and the fourth relay mirror is arranged between the second beam deflection element and the infrared imaging module.
In one embodiment, the beam splitter comprises a first prism and a second prism connected to the first prism; the contact surface of the first prism and the second prism is plated with a first antireflection film so as to transmit infrared beams to the infrared imaging module, and the contact surface of the second prism and the first prism is plated with a first high-reflection film so as to reflect visible light beams to the visible light imaging module; or a second antireflection film is plated on the contact surface of the first prism and the second prism so as to transmit the visible light beam to the visible light imaging module, and a second high-reflection film is plated on the contact surface of the second prism and the first prism so as to reflect the infrared light beam to the infrared imaging module.
In one embodiment, the first antireflection film has a transmission spectrum range of 800nm to 1300nm and a spectral transmittance of more than 85%, and the first high-reflection film has a reflection spectrum range of 400nm to 700nm and a reflectivity of more than 85%; the second antireflection film has a transmission spectrum range of 400-700 nm and a spectral transmittance of more than 85%, and the second high-reflection film has a reflection spectrum range of 800-1300 nm and a reflectivity of more than 85%.
In one embodiment, the visible light imaging module comprises a visible light filter and a visible light image sensor, wherein the visible light filter is attached to the light incident side of the visible light image sensor; the infrared imaging module comprises an infrared filter and an infrared image sensor, wherein the infrared filter is attached to the light incident side of the infrared image sensor.
A depth camera, comprising: the projector is used for projecting an infrared structured light image; the optical zoom imaging device is used for collecting a visible light image and the infrared structural light image; and the processor is respectively connected with the projector and the imaging module.
In one embodiment, the processor is further configured to calculate a depth image from the structured light image, and fuse the depth image with the color image to obtain a color depth image.
The utility model has the advantages that: the optical zooming imaging device can change the shooting distance and the imaging size of the device through the arrangement of the zoom lens, and in addition, the zoom lens can lie down because the direction of an incident beam is changed through the reflector, so that the volume of the device is greatly reduced; in addition, the beam splitter is adopted to divide incident beams into beams with different directions and respectively enter the visible light imaging module and the infrared light imaging module, so that visible light imaging and infrared light imaging can be simultaneously realized, and the field angles of the collected visible light image and the infrared image are the same.
Detailed Description
The present invention will now be described in detail by way of specific embodiments with reference to the accompanying drawings so as to better understand the present invention, but the following embodiments do not limit the scope of the present invention. In addition, it should be noted that the drawings provided in the following embodiments are only for illustrating the basic concept of the present invention, and the drawings only show the components related to the present invention rather than being drawn according to the number, shape and size of the components in actual implementation, and the shape, number and proportion of the components in actual implementation may be changed arbitrarily, and the layout of the components may be more complicated.
It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element. The connection may be for fixation or for circuit connection.
It is to be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in the orientation or positional relationship indicated in the drawings for convenience in describing the embodiments of the present invention and to simplify the description, and are not intended to indicate or imply that the referenced device or element must have a particular orientation, be constructed and operated in a particular orientation, and are not to be construed as limiting the invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present invention, "a plurality" means two or more unless specifically limited otherwise.
Referring to fig. 1, an opticalzoom imaging device 10 according to an embodiment of the present invention will be described. The opticalzoom imaging apparatus 10 includes: the firstbeam deflection element 110, thezoom lens 120, thebeam splitter 130, the visiblelight imaging module 140, and theinfrared imaging module 150. The firstbeam deflecting element 110 receives the beam from the target scene and reflects it to thezoom lens 120. Thezoom lens 120 includes one ormore lenses 121 and is disposed on an optical path of the firstbeam deflecting element 110, and thelenses 121 are movable in an optical path direction to adjust a zoom magnification. Thebeam splitter 130 receives the light beam from thezoom lens 120 and splits it into a transmitted light beam a and a reflected light beam b. The visiblelight imaging module 140 is used for collecting the transmission light beam a to perform visible light imaging, and theinfrared imaging module 150 is used for collecting the reflection light beam b to perform infrared imaging. The positions of the visiblelight imaging module 140 and theinfrared imaging module 150 may be interchanged, which is not limited herein. In this way, the opticalzoom imaging device 10 can simultaneously realize visible light imaging and infrared imaging, and the photographing distance and the imaging size can be changed by adjusting the zoom factor of thezoom lens 120.
Referring to fig. 1, the first lightbeam deflecting device 110 deflects the incident light beam L and reflects the deflected incident light beam L to thezoom lens 120, and compared with the case that the incident light beam L directly enters thezoom lens 120, at this time, thelens 121 in thezoom lens 120 can be laid down, so that the overall volume of theapparatus 10 is greatly reduced. In one embodiment, thebeam deflection element 110 includes at least one of a mirror or a Micro Electro Mechanical System (MEMS), and may be other types of devices as long as the propagation path of the incident beam L can be changed, which is not limited herein.
In one embodiment, thezoom lens 120 includes a plurality oflenses 121, and the focal length of the lenses can be changed by changing the relative positions of thelenses 121 in thezoom lens 120, i.e. for the purpose of optical zooming. The different multiples of optical zoom mean the different maximum focal lengths. For example, an imaging device with a minimum focal length of 35mm, a focal length of 350mm after 10 times zooming. Thezoom lens 120 may realize a zoom multiple of 5 times or 10 times, and is set according to practical situations, which is not limited herein. In one embodiment, thelens 121 may be driven for relative movement by a voice coil motor or other driver. The surface type of eachlens 121 may be any one of an aspherical surface, a spherical surface, a fresnel surface, and a binary optical surface. Thelens 121 can be made of glass material to solve the problem that thelens 121 generates temperature drift when the environmental temperature changes; or thelens 121 is made of plastic material to make it less expensive and easy to obtain.
Continuing to refer to fig. 1, in one embodiment,beam splitter 130 may be made of a very thin glass plate, and when inserted at an angle into light beam L exitingzoom lens 120, may divert a portion of the light beam into different directions, i.e., split light beam L into a transmitted light beam a and a reflected light beam b. In one embodiment, thebeam splitter 130 may be a half mirror.
In one embodiment, the visiblelight imaging module 140 includes avisible light filter 141 and a visiblelight image sensor 142, and thevisible light filter 141 is attached to the light incident side of the visiblelight image sensor 142. Theinfrared imaging module 150 includes aninfrared filter 151 and aninfrared image sensor 152, and theinfrared filter 151 is attached to the light incident side of theinfrared image sensor 152. The transmitted beam a passes through thevisible light filter 141 to the visiblelight image sensor 142 to realize visible light imaging. The reflected light beam b passes through aninfrared filter 151 to reach aninfrared image sensor 152 to realize infrared imaging. The positions of the visiblelight imaging module 140 and theinfrared imaging module 150 may be interchanged, which is not limited herein. In one embodiment, thevisible light filter 141 may be an RGB filter, and the visiblelight image sensor 142 may be an RGB image sensor.
In the above embodiment, thebeam splitter 130 only simply splits the incident light beam L into the transmitted light beam a and the reflected light beam b, it can be understood that when the transmitted light beam a passes through thevisible light filter 141, the infrared light component in the transmitted light beam a will be filtered out, i.e. only a part of the transmitted light beam a is effectively collected by the visiblelight image sensor 142; alternatively, when the transmitted beam a passes through theinfrared filter 151, the visible light component in the transmitted beam a will be filtered out, i.e., only a portion of the transmitted beam a is effectively collected by theinfrared image sensor 152. The same applies to the reflected beam b. Thus, a significant portion of the light beam is wasted for the visiblelight imaging module 140 and theinfrared imaging module 150, which may cause poor imaging quality.
In view of the above, the present application also provides abeam splitter 130, wherein thebeam splitter 130 is configured to reflect infrared light and transmit visible light; or be configured to reflect visible light and transmit infrared light. Therefore, more light beams can be effectively collected by the visiblelight imaging module 140 and theinfrared imaging module 150, so as to enhance the imaging quality.
Referring to fig. 2, in one embodiment, thebeam splitter 130 includes two right-angled triangular prisms with the same optical axis direction and similar structural dimensions: afirst prism 131, and asecond prism 132 glued together with the first prism. Thecontact surface 1311 of thefirst prism 131 and thesecond prism 132 is coated with a first antireflection film, the transmission spectrum range covers 800nm to 1300nm, and the spectral transmittance is greater than 85% so as to transmit the infrared beam to theinfrared imaging module 150. Thecontact surface 1321 of thesecond prism 132 and thefirst prism 131 is plated with a first high-reflection film, the reflection spectrum range covers 400 nm-700 nm, and the reflectivity is greater than 85%, so that the visible light beam is reflected to the visiblelight imaging module 140. It is understood that thebeam splitter 130 is only used as an example to better understand the present embodiment, and in other embodiments, thebeam splitter 130 may be composed of other structures.
In one embodiment, thecontact surface 1311 of thefirst prism 131 and thesecond prism 132 is coated with a second antireflection film, the transmission spectrum range covers 400nm to 700nm, and the spectral transmittance is greater than 85% so as to transmit the visible light beam to the visiblelight imaging module 140. Thecontact surface 1321 of thesecond prism 132 and thefirst prism 131 is plated with a second high-reflection film, the reflection spectrum range covers 800 nm-1300 nm, and the reflectivity is greater than 85%, so that the infrared beam is reflected to theinfrared imaging module 150. It is understood that the filters in the visiblelight imaging module 140 and the infrared imaging module can be omitted.
In one embodiment, thebeam splitter 130 may also be another beam splitter or dichroic mirror.
It can be understood that the incident light beams L pass through thebeam splitter 130 to make the light beams in different directions enter the visiblelight imaging module 140 and theinfrared imaging module 150, respectively, so that the imaging field angles of the visiblelight imaging module 140 and theinfrared imaging module 150 are the same, that is, the field angles of the visible light image and the infrared image collected by thedevice 10 are the same, and when the visible light image and the infrared image are fused and applied subsequently, the step of registration is not required.
Referring to fig. 3, in an embodiment, the opticalzoom imaging apparatus 10 further includes a secondbeam deflecting element 111, and the secondbeam deflecting element 111 is configured to receive the reflected beam b and reflect the reflected beam b to the visiblelight imaging module 140. In one embodiment, the secondbeam deflecting element 111 can also reflect the reflected beam b to theinfrared imaging module 150 again. The positions of the visiblelight imaging module 140 and theinfrared imaging module 150 can be exchanged.
Referring to fig. 4, in one embodiment, the opticalzoom imaging apparatus 10 further includes a first relay lens 161 and a second relay lens 162. The first relay lens 161 is disposed between thebeam splitter 130 and theinfrared imaging module 150, and is used for imaging the transmitted light beam a to theinfrared imaging module 150. The second relay mirror 162 is disposed between thebeam splitter 130 and the visiblelight imaging module 140, and is used for imaging the reflected light beam b to the visiblelight imaging module 140. It is understood that the positions of the visiblelight imaging module 140 and theinfrared imaging module 150 can be interchanged.
Referring to fig. 5, in one embodiment, the opticalzoom imaging apparatus 10 further includes athird relay lens 163 and afourth relay lens 164. Thethird relay mirror 163 is disposed between thebeam splitter 130 and theinfrared imaging module 150, and is configured to image the transmitted light beam a to theinfrared imaging module 150. Thefourth relay mirror 164 is disposed between the secondbeam deflecting element 111 and the visiblelight imaging module 140, and is used for imaging the reflected beam b to the visiblelight imaging module 140. The positions of the visiblelight imaging module 140 and theinfrared imaging module 150 can be exchanged.
It should be understood that when the zoom factor of thezoom lens 120 is adjusted, the image plane of thezoom lens 120 may become closer than before, and in this case, the image plane may fall within the range of thebeam splitter 130, thereby affecting the image quality. Therefore, a relay lens is added in front of the visiblelight imaging module 140 and theinfrared module 150 respectively, and the relay lens can delay an imaging surface to the plane of the image sensor of the imaging module through secondary imaging so as to solve the problem of poor imaging quality.
The optical zooming imaging device can change the shooting distance and the imaging size of the device through the arrangement of the zoom lens, and in addition, the zoom lens can lie down because the direction of an incident beam is changed through the reflector, so that the volume of the device is greatly reduced; in addition, the beam splitter is adopted to divide incident beams into beams with different directions and respectively enter the visible light imaging module and the infrared light imaging module, so that visible light imaging and infrared light imaging can be simultaneously realized, and the field angles of the collected visible light image and the infrared image are the same.
Referring to fig. 6, the present invention further provides adepth camera 60, including: a projector 100 for projecting an infrared structured light image; an optical zoom imaging device 200 for collecting a visible light image and the infrared structured light image; and a processor 300 respectively connected with the projector 100 and the optical zoom imaging device 200. The optical zoom imaging apparatus 200 may be replaced with the opticalzoom imaging apparatus 10 described above. The projector 100, the optical zoom imaging device 200, are mounted on the same plane and on the same base line, and each element corresponds to one window. Therefore, the acquisition of structural light emission, visible light images and infrared images is realized through the two windows.
The projector 100 includes: a light source (not shown) for emitting a light beam; a diffractive optical element (not shown) for receiving the light beam and projecting a structured light image. The light source comprises a single light source or an array of a plurality of light sources, wherein the light sources comprise at least one of laser diodes, edge-emitting laser diodes, and vertical cavity surface-emitting lasers. In one embodiment, the structured light image projected by the light source is an infrared speckle image, and the infrared speckle image has the characteristics of high irrelevance and uniform distribution.
It can be understood that the infrared structured light image and the visible light image collected by the optical zoom imaging device 200 may be further transmitted to the processor 300, and the processor 300 may calculate a depth image according to the received infrared structured light image, and fuse the depth image with the visible light image to obtain a color depth image, so as to perform operations such as face detection, face recognition, security payment, and the like according to the visible light depth image. It can be understood that, because the infrared structured light image and the color image are acquired under the same view field angle, the step of registering the depth image and the visible light image can be omitted, so that the accuracy of image fusion is improved, and the algorithm requirement on the depth camera is reduced.
The foregoing is a more detailed description of the present invention, taken in conjunction with the specific preferred embodiments thereof, and it is not intended that the invention be limited to the specific embodiments shown and described. To the technical field of the utility model belongs to the prerequisite of not deviating from the utility model discloses, can also make a plurality of equal substitution or obvious variants, performance or usage are the same moreover, all should regard as belonging to the utility model's scope of protection.