技术领域technical field
本公开涉及虚拟现实技术领域，具体而言，涉及一种具有瞳孔追踪功能的影像投影装置及其瞳孔位置追踪装置。The present disclosure relates to the technical field of virtual reality, in particular, to an image projection device with pupil tracking function and a pupil position tracking device thereof.
背景技术Background technique
将虚拟现实及/或扩增虚拟现实应用于使用者的头戴式或穿戴式影像投影系统的技术是目前的大势所趋。当用户使用头戴式或穿戴式影像投影系统(通常是眼镜)时，虚拟现实影像或视频会通过投影装置投射至用户的眼睛以呈像。同时，为了达到较佳的虚拟现实体验感受，会在投影系统中另增设追踪装置以追踪用户的头部与眼睛的位置以及移动。It is a general trend to apply virtual reality and/or augmented virtual reality to a user's head-mounted or wearable image projection system. When a user uses a head-mounted or wearable image projection system (usually glasses), a virtual reality image or video will be projected to the user's eyes through the projection device to present an image. At the same time, in order to achieve a better virtual reality experience, a tracking device will be added to the projection system to track the position and movement of the user's head and eyes.
现有技术中的虚拟现实装置中，是通过检测目前眼睛位置并预测头部和眼睛的下一个位置来分析并结合影像至下一个位置的用户聚焦区域，以实现凝视追踪的效果。然而，使用者各眼所感知的实像(于视网膜的成像)实际上是聚焦在离眼睛固定距离(焦距)的实像或虚像平面。一般来说，人脑的视神经会自主地根据所感知的实像而欲调整眼睛对焦在所感知的组件/对象上，但是在虚拟现实装置中，眼睛的焦距调整会跟已经固定距离的实像的焦距距离抵触。如此一来，会使大脑无法成功协调视觉感知系统以及本体感觉，容易产生疲劳以及头晕。In the virtual reality device in the prior art, by detecting the current eye position and predicting the next position of the head and eyes to analyze and combine the image to the user's focus area at the next position, so as to achieve the effect of gaze tracking. However, the real image (imaged on the retina) perceived by each eye of the user is actually focused on a real or virtual image plane at a fixed distance (focal distance) from the eye. Generally speaking, the optic nerve of the human brain will automatically adjust the focus of the eyes on the perceived component/object according to the perceived real image, but in a virtual reality device, the focus adjustment of the eyes will be in accordance with the focal length of the fixed-distance real image Distance conflicts. In this way, the brain will not be able to successfully coordinate the visual perception system and proprioception, and it will easily cause fatigue and dizziness.
故，现有技术虚拟现实装置中的凝视追踪系统与虚拟图像投射仍具有改善空间。Therefore, there is still room for improvement in the gaze tracking system and virtual image projection in the prior art virtual reality device.
发明内容Contents of the invention
本发明所要解决的技术问题在于，针对现有技术的不足提供一种可具有瞳孔追踪功能的影像投影装置以及可实时反馈瞳孔位置信息的瞳孔位置追踪装置。The technical problem to be solved by the present invention is to provide an image projection device capable of pupil tracking function and a pupil position tracking device capable of feeding back pupil position information in real time in view of the deficiencies of the prior art.
为了解决上述的技术问题，本发明所采用的其中一技术方案是，提供一种具有瞳孔追踪功能的影像投影装置，其包括：一光源模块、一微镜模块、一光学模块、一感测模块以及一控制模块，所述控制模块电性连接于所述微镜模块与所述感测模块，且所述光源模块、所述微镜模块、所述光学模块以及所述感测模块沿着一预定光学路径布置。其中，所述光源模块所提供的一第一点光源通过所述微镜模块的反射以形成一第一面光源，所述第一面光源通过所述光学模块的反射以形成一投向一眼球表面的检测光源，且所述眼球表面具有一瞳孔表面以及一围绕所述瞳孔表面的非瞳孔表面。其中，所述检测光源通过所述瞳孔表面的反射以形成投向所述感测模块的一第一反射光源，且所述感测模块依据所述第一反射光源以传送一瞳孔位置信号至所述控制模块。其中，所述控制模块依据所述瞳孔位置信号以调整所述微镜模块，所述光源模块所提供的一第二点光源通过调整后的所述微镜模块的反射以形成一第二面光源，且所述第二面光源通过所述光学模块的反射以形成一准确地投向所述瞳孔表面的影像光源。In order to solve the above technical problems, one of the technical solutions adopted by the present invention is to provide an image projection device with pupil tracking function, which includes: a light source module, a micromirror module, an optical module, and a sensing module and a control module, the control module is electrically connected to the micromirror module and the sensing module, and the light source module, the micromirror module, the optical module and the sensing module are along a Predetermined optical path arrangement. Wherein, a first point light source provided by the light source module is reflected by the micromirror module to form a first surface light source, and the first surface light source is reflected by the optical module to form a projection on the surface of the eyeball. and the eyeball surface has a pupil surface and a non-pupil surface surrounding the pupil surface. Wherein, the detection light source is reflected by the pupil surface to form a first reflected light source directed to the sensing module, and the sensing module transmits a pupil position signal to the sensing module according to the first reflected light source control module. Wherein, the control module adjusts the micromirror module according to the pupil position signal, and a second point light source provided by the light source module is reflected by the adjusted micromirror module to form a second surface light source , and the second surface light source is reflected by the optical module to form an image light source projected accurately on the pupil surface.
更进一步地，所述第一点光源为一非可见光光束，且所述第二点光源为一影像光束。Furthermore, the first point light source is an invisible light beam, and the second point light source is an image light beam.
更进一步地，投向所述眼球表面的所述检测光源的面积大于或者等于所述眼球表面的面积。Furthermore, the area of the detection light source cast on the surface of the eyeball is greater than or equal to the area of the surface of the eyeball.
更进一步地，所述微镜模块包括多个微镜片，且所述控制模块通过所述瞳孔位置信号，以调整每一个所述微镜片的一反射角度。Furthermore, the micromirror module includes a plurality of microlenses, and the control module adjusts a reflection angle of each of the microlenses through the pupil position signal.
更进一步地，所述检测光源通过所述非瞳孔表面的反射以形成投向所述感测模块的一第二反射光源，且所述瞳孔表面的透光性大于所述非瞳孔表面的透光性，以使得所述第一反射光源的强度小于所述第二反射光源的强度。Furthermore, the detection light source is reflected by the non-pupil surface to form a second reflected light source projected toward the sensing module, and the light transmittance of the pupil surface is greater than that of the non-pupil surface , so that the intensity of the first reflected light source is smaller than the intensity of the second reflected light source.
为了解决上述的技术问题，本发明所采用的另外一技术方案是，提供一种瞳孔位置追踪装置，其包括：一光源模块、一微镜模块、一光学模块、一感测模块以及一控制模块，所述控制模块电性连接于所述微镜模块与所述感测模块，且所述光源模块、所述微镜模块、所述光学模块以及所述感测模块沿着一预定光学路径布置。其中，所述光源模块所提供的一点光源通过所述微镜模块的反射以形成一面光源，所述面光源通过所述光学模块的反射以形成一投向一眼球表面的检测光源，且所述眼球表面具有一瞳孔表面以及一围绕所述瞳孔表面的非瞳孔表面。其中，所述检测光源通过所述瞳孔表面的反射以形成投向所述感测模块的一第一反射光源，且所述感测模块依据所述第一反射光源以传送一瞳孔位置信号至所述控制模块。In order to solve the above technical problems, another technical solution adopted by the present invention is to provide a pupil position tracking device, which includes: a light source module, a micromirror module, an optical module, a sensing module and a control module , the control module is electrically connected to the micromirror module and the sensing module, and the light source module, the micromirror module, the optical module and the sensing module are arranged along a predetermined optical path . Wherein, the point light source provided by the light source module is reflected by the micromirror module to form a surface light source, and the surface light source is reflected by the optical module to form a detection light source projected on the surface of the eyeball, and the eyeball The surface has a pupil surface and a non-pupil surface surrounding the pupil surface. Wherein, the detection light source is reflected by the pupil surface to form a first reflected light source directed to the sensing module, and the sensing module transmits a pupil position signal to the sensing module according to the first reflected light source control module.
更进一步地，所述点光源为一非可见光光束。Furthermore, the point light source is a non-visible light beam.
更进一步地，投向所述眼球表面的所述检测光源的面积大于或者等于所述眼球表面的面积。Furthermore, the area of the detection light source cast on the surface of the eyeball is greater than or equal to the area of the surface of the eyeball.
更进一步地，所述微镜模块包括多个微镜片，且所述控制模块通过所述瞳孔位置信号，以调整每一个所述微镜片的一反射角度。Furthermore, the micromirror module includes a plurality of microlenses, and the control module adjusts a reflection angle of each of the microlenses through the pupil position signal.
更进一步地，所述检测光源通过所述非瞳孔表面的反射以形成投向所述感测模块的一第二反射光源，且所述瞳孔表面的透光性大于所述非瞳孔表面的透光性，以使得所述第一反射光源的强度小于所述第二反射光源的强度。Furthermore, the detection light source is reflected by the non-pupil surface to form a second reflected light source projected toward the sensing module, and the light transmittance of the pupil surface is greater than that of the non-pupil surface , so that the intensity of the first reflected light source is smaller than the intensity of the second reflected light source.
本发明的有益效果在于，本发明技术方案所提供的具有瞳孔追踪功能的影像投影装置及其瞳孔位置追踪装置，其能通过“所述光源模块所提供的第一点光源通过所述微镜模块的反射以形成第一面光源，所述第一面光源通过所述光学模块的反射以形成投向一眼球表面的检测光源”以及“所述检测光源通过所述瞳孔表面的反射以形成投向所述感测模块的第一反射光源”的技术特征，以使感测模块依据第一反射光源传送瞳孔位置信号至控制模块，并使控制模块依据瞳孔位置信号以调整微镜模块，使得第二点光源形成准确地投向所述瞳孔表面的一影像光源。The beneficial effect of the present invention is that the image projection device with pupil tracking function and the pupil position tracking device provided by the technical solution of the present invention can pass through the micromirror module through "the first point light source provided by the light source module reflection to form a first surface light source, the first surface light source is reflected by the optical module to form a detection light source projected on the surface of the eyeball" and "the detection light source is reflected by the pupil surface to form a detection light source projected on the The technical characteristics of the "first reflected light source" of the sensing module, so that the sensing module transmits the pupil position signal to the control module according to the first reflected light source, and the control module adjusts the micromirror module according to the pupil position signal, so that the second point light source An image light source projected accurately on the pupil surface is formed.
为使能更进一步了解本发明的特征及技术内容，请参阅以下有关本发明的详细说明与附图，然而所提供的附图仅用于提供参考与说明，并非用来对本发明加以限制。In order to further understand the features and technical contents of the present invention, please refer to the following detailed description and drawings related to the present invention. However, the provided drawings are only for reference and description, and are not intended to limit the present invention.
附图说明Description of drawings
图1为本发明实施例的具有瞳孔追踪功能的影像投影装置沿预定光学路径布置的示意图。FIG. 1 is a schematic diagram of an image projection device with a pupil tracking function arranged along a predetermined optical path according to an embodiment of the present invention.
图2为本发明实施例的具有瞳孔追踪功能的影像投影装置的其中一影像投影光学路径示意图。FIG. 2 is a schematic diagram of an image projection optical path of an image projection device with pupil tracking function according to an embodiment of the present invention.
图3为本发明实施例的具有瞳孔追踪功能的影像投影装置的瞳孔位置追踪光学路径的示意图。3 is a schematic diagram of a pupil position tracking optical path of an image projection device with a pupil tracking function according to an embodiment of the present invention.
图4为本发明实施例的具有瞳孔追踪功能的影像投影装置的另外一影像投影光学路径示意图。4 is a schematic diagram of another image projection optical path of the image projection device with pupil tracking function according to the embodiment of the present invention.
具体实施方式Detailed ways
以下是通过特定的具体实施例来说明本发明所公开有关“具有瞳孔追踪功能的影像投影装置及其瞳孔位置追踪装置”的实施方式，本领域技术人员可由本说明书所公开的内容了解本发明的优点与效果。本发明可通过其他不同的具体实施例加以施行或应用，本说明书中的各项细节也可基于不同观点与应用，在不悖离本发明的构思下进行各种修饰与变更。另外，本发明的附图仅为简单示意说明，并非依实际尺寸的描绘，事先声明。以下的实施方式将进一步详细说明本发明的相关技术内容，但所公开的内容并非用以限制本发明的保护范围。The following is a description of the implementation of the "image projection device with pupil tracking function and its pupil position tracking device" disclosed in the present invention through specific specific examples. Those skilled in the art can understand the contents of the present invention from the content disclosed in this specification. Advantages and effects. The present invention can be implemented or applied through other different specific embodiments, and various modifications and changes can be made to the details in this specification based on different viewpoints and applications without departing from the concept of the present invention. In addition, the drawings of the present invention are only for simple illustration, and are not drawn according to the actual size, which is stated in advance. The following embodiments will further describe the relevant technical content of the present invention in detail, but the disclosed content is not intended to limit the protection scope of the present invention.
请参阅图1，其为本发明实施例的具有瞳孔追踪功能的影像投影装置的布置示意图。本发明提供一种具有瞳孔追踪功能的影像投影装置D，其包括一光源模块1、一微镜模块2、一光学模块3、一感测模块5以及一控制模块6。控制模块6电性连接于微镜模块2与感测模块5。同时，光源模块1、微镜模块2、光学模块3以及感测模块5沿着一预定光学路径L布置。Please refer to FIG. 1 , which is a schematic layout diagram of an image projection device with pupil tracking function according to an embodiment of the present invention. The present invention provides an image projection device D with pupil tracking function, which includes a light source module 1 , a micromirror module 2 , an optical module 3 , a sensing module 5 and a control module 6 . The control module 6 is electrically connected to the micromirror module 2 and the sensing module 5 . Meanwhile, the light source module 1 , the micromirror module 2 , the optical module 3 and the sensing module 5 are arranged along a predetermined optical path L.
本发明的预定光学路径L是通过光入射及反射的原理来行进的可预测路径，因此预定光学路径的布置可依照基本光学原理进行配置。The predetermined optical path L of the present invention is a predictable path traveling through the principle of light incident and reflection, so the arrangement of the predetermined optical path can be configured according to the basic optical principle.
再者，如图1所示，本发明的具有瞳孔追踪功能的影像投影装置D，其光源模块1可提供至少一点光源。至少一点光源可通过微镜模块2的反射以形成至少一面光源。至少一面光源再通过光学模块3的反射以形成检测光源以及/或是影像光源。Moreover, as shown in FIG. 1 , the light source module 1 of the image projection device D with pupil tracking function of the present invention can provide at least one point of light source. At least one point of the light source can be reflected by the micromirror module 2 to form at least one side of the light source. At least one side of the light source is reflected by the optical module 3 to form a detection light source and/or an image light source.
举例来说，在本发明的实施例中，具有瞳孔追踪功能的影像投影装置D的光源模块1可同时提供第一点光源以及第二点光源，且第一点光源与第二点光源的光波波长不同。此外，第一点光源是用以形成检测光源；第二点光源是用以形成影像光源。进一步，第一点光源可以是非可见光光束；而第二点光源是可形成影像的影像光束。For example, in the embodiment of the present invention, the light source module 1 of the image projection device D with pupil tracking function can provide the first point light source and the second point light source at the same time, and the light waves of the first point light source and the second point light source The wavelengths are different. In addition, the first point light source is used to form a detection light source; the second point light source is used to form an image light source. Further, the first point light source may be an invisible light beam; and the second point light source is an image light beam capable of forming an image.
其中，光源模块1可具有两个光源投射单元，其分别提供光波波长不同的第一点光源与第二点光源。例如，光源模块1可包括可见光投射单元以及非可见光投射单元，其分别提供非可见光光束的第一点光源以及影像光束的第二点光源。Wherein, the light source module 1 may have two light source projection units, which respectively provide a first point light source and a second point light source with different light wavelengths. For example, the light source module 1 may include a visible light projection unit and an invisible light projection unit, which respectively provide a first point light source of the invisible light beam and a second point light source of the image light beam.
承上所述，在本发明实施例中，光源模块1所提供的第一点光源可通过微镜模块2的反射以形成第一面光源，第一面光源可通过光学模块3的反射以形成检测光源。检测光源是投向眼球表面，而眼球表面具有瞳孔表面以及围绕瞳孔表面的非瞳孔表面。因为光源会经瞳孔进入眼球中，所以通过瞳孔表面反射的反射光源的强度会小于通过非瞳孔表面反射的光源的强度。As mentioned above, in the embodiment of the present invention, the first point light source provided by the light source module 1 can be reflected by the micromirror module 2 to form the first surface light source, and the first surface light source can be formed by the reflection of the optical module 3 Detect light source. The detection light source is projected onto the surface of the eyeball, and the surface of the eyeball has a pupil surface and a non-pupil surface surrounding the pupil surface. Because the light source enters the eye through the pupil, the intensity of the reflected light source reflected by the pupillary surface will be less than the intensity of the light source reflected by the non-pupil surface.
接着，在本发明的具有瞳孔追踪功能的影像投影装置中，还包括仅特定波长的光源所检测的感测模块5。在本发明中，感测模块5仅接受非可见光波长的光，因此感测模块5感测第一面光源形成的检测光源，而不受到第二面光源反射形成的影像光源的影响。其中，检测光源通过瞳孔表面的反射以形成投向感测模块5的第一反射光源，检测光源通过非瞳孔表面的反射以形成投向感测模块5的第二反射光源。第一反射光源的强度小于第二反射光源的强度，如此一来，感测模块5可依据第一反射光源以传送瞳孔位置信号至控制模块6。Next, in the image projection device with pupil tracking function of the present invention, it further includes a sensing module 5 that detects only light sources with specific wavelengths. In the present invention, the sensing module 5 only accepts light with non-visible wavelengths, so the sensing module 5 senses the detection light source formed by the first surface light source, and is not affected by the image light source formed by the reflection of the second surface light source. Wherein, the detection light source is reflected by the pupil surface to form a first reflected light source projected toward the sensing module 5 , and the detected light source is reflected by a non-pupil surface to form a second reflected light source projected toward the sensing module 5 . The intensity of the first reflected light source is smaller than the intensity of the second reflected light source. In this way, the sensing module 5 can transmit the pupil position signal to the control module 6 according to the first reflected light source.
再者，控制模块6依据瞳孔位置信号以调整微镜模块2，同时，光源模块1所提供的第二点光源通过调整后的微镜模块2的反射以形成第二面光源，且第二面光源亦通过光学模块3的反射以形成准确地投向瞳孔表面的影像光源。Furthermore, the control module 6 adjusts the micromirror module 2 according to the pupil position signal. At the same time, the second point light source provided by the light source module 1 is reflected by the adjusted micromirror module 2 to form a second surface light source, and the second surface The light source is also reflected by the optical module 3 to form an image light source that is accurately projected on the pupil surface.
以下将根据实际操作的实施方式按序详细说明本发明具有瞳孔追踪功能的影像投影装置D的各组件的操作以实现瞳孔追踪的功能。The operation of each component of the image projection device D with pupil tracking function of the present invention will be described in detail in order according to the actual implementation of the implementation, so as to realize the pupil tracking function.
请参阅图1以及图2，图具有瞳孔追踪功能的影像投影装置D的其中一影像投影光学路径示意图。如图2所示，本发明实施例提供一种具有瞳孔追踪功能的影像投影装置D，其包括光源模块1、微镜模块2、光学模块3、感测模块5以及控制模块6。控制模块6电性连接于微镜模块2以及感测模块5。此外，如前所述，光源模块1、微镜模块2、光学模块3以及感测模块5是沿着一预定光学路径L布置。在影像投影的模式(图2)下，光源模块1根据一预定光学路径提供第二点光源L2。光源模块1可通过可见光投射单元提供第二点光源L2。Please refer to FIG. 1 and FIG. 2 , which are schematic diagrams of one of the image projection optical paths of the image projection device D with pupil tracking function. As shown in FIG. 2 , an embodiment of the present invention provides an image projection device D with pupil tracking function, which includes a light source module 1 , a micromirror module 2 , an optical module 3 , a sensing module 5 and a control module 6 . The control module 6 is electrically connected to the micromirror module 2 and the sensing module 5 . In addition, as mentioned above, the light source module 1 , the micromirror module 2 , the optical module 3 and the sensing module 5 are arranged along a predetermined optical path L. As shown in FIG. In the image projection mode ( FIG. 2 ), the light source module 1 provides a second point light source L2 according to a predetermined optical path. The light source module 1 can provide a second point light source L2 through a visible light projection unit.
首先，光源模块1提供第二点光源L2至微镜模块2，经微镜模块2反射后形成第二面光源L21。第二面光源L21通过光学模块3的反射以形成影像光源L22。Firstly, the light source module 1 provides the second point light source L2 to the micromirror module 2 , and the second surface light source L21 is formed after being reflected by the micromirror module 2 . The second surface light source L21 is reflected by the optical module 3 to form an image light source L22.
详细说明的是，第二点光源L2是可传送影像的可见光光束。换句话说，第二点光源L2是可形成影像的影像光束。在本发明实施例中，第二点光源L2可为RGB激光发光模块，其包括一个红色激光光源、一蓝色激光光源以及一绿色激光光源(在此以RGB表示)。光源模块1将RGB激光光源在短时间内瞬时投射在微镜模块2的每个微镜单元(可为微镜片)上。接着，RGB激光光源经微镜模块2反射后形成一帧第二面光源L21，投射至光学模块3。第二面光源L21再经光学模块3的反射以形成影像光源L22。In detail, the second point light source L2 is a visible light beam capable of transmitting images. In other words, the second point light source L2 is an image beam capable of forming an image. In the embodiment of the present invention, the second point light source L2 can be an RGB laser light emitting module, which includes a red laser light source, a blue laser light source and a green laser light source (represented by RGB here). The light source module 1 projects the RGB laser light source instantaneously on each micromirror unit (which may be a microlens) of the micromirror module 2 within a short time. Next, the RGB laser light source is reflected by the micromirror module 2 to form a frame of second surface light source L21 , which is projected to the optical module 3 . The second surface light source L21 is reflected by the optical module 3 to form an image light source L22.
值得一提的是，除了前述单一RGB激光光源之外，本发明的第二点光源L2也可以是RGGB激光光源。也就是说，第二点光源L2可以是一个红色激光光源、两个绿色激光光源以及一个蓝色激光光源。同理可证，第二点光源L2还可以是RRGGB激光光源，其具有两个红色激光光源、两个绿色激光光源以及一个蓝色激光光源。It is worth mentioning that, in addition to the aforementioned single RGB laser light source, the second point light source L2 of the present invention may also be an RGGB laser light source. That is to say, the second point light source L2 may be one red laser light source, two green laser light sources and one blue laser light source. Similarly, it can be proved that the second point light source L2 can also be an RRGGB laser light source, which has two red laser light sources, two green laser light sources and one blue laser light source.
需注意的是，光学模块3可以为，举例来说但不限于：凹面反射镜、平面反射镜、凸透镜。在本发明实施例，光学模块3为凹面反射镜，但本发明不限于此。此外，光学模块3可为固定式或可调式。在本发明实施例中，光学模块3为固定式。It should be noted that the optical module 3 can be, for example but not limited to: a concave mirror, a plane mirror, and a convex lens. In the embodiment of the present invention, the optical module 3 is a concave mirror, but the present invention is not limited thereto. In addition, the optical module 3 can be fixed or adjustable. In the embodiment of the present invention, the optical module 3 is fixed.
承上所述，如图2所示，影像光源L22经光学模块3反射并准确地投向使用者的眼球表面4的瞳孔表面41。根据本实施例，经微镜模块2反射的第二面光源L21经过是凹面反射镜的光学模块3反射之后，形成影像光源L22，该影像光源L22通过瞳孔表面41之后，聚焦在使用者的眼球，最终以在视网膜成像。是故，从光源模块1发射出的第二点光源L2最终可形成在使用者眼球中成像的影像光源L22。Based on the above, as shown in FIG. 2 , the image light source L22 is reflected by the optical module 3 and accurately projects to the pupil surface 41 of the user's eyeball surface 4 . According to this embodiment, after the second surface light source L21 reflected by the micromirror module 2 is reflected by the optical module 3 which is a concave mirror, an image light source L22 is formed. After the image light source L22 passes through the pupil surface 41, it is focused on the user's eyeball , eventually to image in the retina. Therefore, the second point light source L2 emitted from the light source module 1 can eventually form an image light source L22 imaged in the user's eyeball.
接着，请参阅图1及图3，其为具有瞳孔追踪功能的影像投影装置D的瞳孔位置追踪光学路径的示意图。如同图3所示，本发明实施例的具有瞳孔追踪功能的影像投影装置D包括沿着预定光学路径L布置的光源模块1、微镜模块2、光学模块3、感测模块5以及控制模块6。根据图3显示，光源模块1根据预定光学路径提供第一点光源L1，此时具有瞳孔追踪功能的影像投影装置D具有瞳孔位置追踪光学路径的模式。Next, please refer to FIG. 1 and FIG. 3 , which are schematic diagrams of the pupil position tracking optical path of the image projection device D with the pupil tracking function. As shown in FIG. 3 , the image projection device D with pupil tracking function according to the embodiment of the present invention includes a light source module 1 , a micromirror module 2 , an optical module 3 , a sensing module 5 and a control module 6 arranged along a predetermined optical path L . According to FIG. 3 , the light source module 1 provides the first point light source L1 according to a predetermined optical path, and at this time, the image projection device D with pupil tracking function has a pupil position tracking optical path mode.
与前述影像投影模式相似，首先，光源模块1通过其非可见光投射单元提供第一点光源L1至微镜模块2，经微镜模块2反射后形成第一面光源L11，第一面光源L11经光学模块3的反射形成投向瞳孔表面的检测光源L12。Similar to the aforementioned image projection mode, first, the light source module 1 provides the first point light source L1 to the micromirror module 2 through its invisible light projection unit, and the first surface light source L11 is formed after being reflected by the micromirror module 2, and the first surface light source L11 is passed through The reflection of the optical module 3 forms a detection light source L12 directed towards the pupil surface.
详细对其进行说明，第一点光源L1是非可见光光束。举例来说，本发明实施例的第一点光源L1可以是光波长为760nm至1000nm之间的红外光。To describe it in detail, the first point light source L1 is an invisible light beam. For example, the first point light source L1 in the embodiment of the present invention may be infrared light with a light wavelength between 760 nm and 1000 nm.
承上所述，第一点光源L1可以以单一光束射出，亦可以多个个光束以形成一发射范围射出。在本发明实施例中，第一点光源L1是以单一光束射出。光源模块1提供红外光在短时间内瞬时投射在微镜模块2的每个微镜单元(可为微镜片)上。接着，红外光经微镜模块2反射后形成一帧第一面光源L11，投射至光学模块3。第一面光源L11再经光学模块3的反射以形成具有一投射范围的检测光源L12。Based on the above, the first point light source L1 can emit a single light beam, or emit a plurality of light beams to form an emission range. In the embodiment of the present invention, the first point light source L1 emits with a single light beam. The light source module 1 provides infrared light to be projected instantaneously on each micromirror unit (which may be a microlens) of the micromirror module 2 in a short time. Next, the infrared light is reflected by the micromirror module 2 to form a frame of first surface light source L11 , which is projected to the optical module 3 . The first surface light source L11 is reflected by the optical module 3 to form a detection light source L12 with a projection range.
再次说明，在本实施例，光学模块3为固定式凹面反射镜，但本发明不限于此。Again, in this embodiment, the optical module 3 is a fixed concave mirror, but the present invention is not limited thereto.
承上所述，如图3所示，第一面光源L11经光学模块3反射并投向使用者的眼球表面4。值得一提的是，根据本发明实施例，眼球表面4具有瞳孔表面41以及围绕瞳孔表面41的非瞳孔表面42。投向眼球表面4的检测光源L12的涵盖面积包括瞳孔表面41以及非瞳孔表面42的范围。具体来说，投向眼球表面4的检测光源L12的面积可为大于或等于眼球表面4的面积。在本发明实施例中，检测光源L12的面积是等于眼球表面4的面积。As mentioned above, as shown in FIG. 3 , the first surface light source L11 is reflected by the optical module 3 and projected toward the eyeball surface 4 of the user. It is worth mentioning that, according to the embodiment of the present invention, the eyeball surface 4 has a pupil surface 41 and a non-pupil surface 42 surrounding the pupil surface 41 . The covered area of the detection light source L12 projected onto the eyeball surface 4 includes the range of the pupil surface 41 and the non-pupil surface 42 . Specifically, the area of the detection light source L12 projected onto the eyeball surface 4 may be greater than or equal to the area of the eyeball surface 4 . In the embodiment of the present invention, the area of the detection light source L12 is equal to the area of the eyeball surface 4 .
承上所述，检测光源L12通过瞳孔表面41的反射形成第一反射光源R1；检测光源L12通过非瞳孔表面42的反射形成第二反射光源R2。第一反射光源R1可被感测模块5检测，感测模块5可依据第一反射光源R1传送瞳孔位置信号到控制模块6。由于瞳孔表面41的透光性大于非瞳孔表面42的透光性。投向瞳孔表面41的检测光源L12会有部分穿过瞳孔进入眼球，因此第一反射光源R1的强度会比全反射的第二反射光源R2的强度较小。如此，感测模块5可借此判断瞳孔的位置，并得到一瞳孔位置信号，并将该瞳孔位置信号传送至控制模块6。As mentioned above, the detection light source L12 is reflected by the pupil surface 41 to form the first reflected light source R1; the detection light source L12 is reflected by the non-pupil surface 42 to form the second reflected light source R2. The first reflected light source R1 can be detected by the sensing module 5 , and the sensing module 5 can transmit a pupil position signal to the control module 6 according to the first reflected light source R1 . Since the light transmittance of the pupil surface 41 is greater than that of the non-pupil surface 42 . The detection light source L12 directed towards the pupil surface 41 will partially pass through the pupil and enter the eyeball, so the intensity of the first reflected light source R1 will be smaller than the intensity of the fully reflected second reflected light source R2. In this way, the sensing module 5 can judge the position of the pupil, obtain a pupil position signal, and send the pupil position signal to the control module 6 .
从图3可看出，眼球转动使得瞳孔位置从垂直正中间偏移至右侧，瞳孔表面41仍在检测光源L12的面积之内。因此，检测光源L12内的部分红外光光束会通过偏移后的瞳孔表面41反射较小强度的第一反射光源R1，而其余从非瞳孔表面42反射的第二反射光源R2的强度不变。进而感测模块5通过反射至感测模块的第一反射光源R1以及第二反射光源R2的强弱，便可判断出瞳孔位置。如此，当使用者的眼球转动时，感测模块5均可实时追踪该用户的眼球瞳孔位置，并实时输出瞳孔的瞳孔位置信号。It can be seen from FIG. 3 that the eyeball rotation causes the pupil position to shift from the vertical middle to the right, and the pupil surface 41 is still within the area of the detection light source L12. Therefore, part of the infrared light beam in the detection light source L12 will reflect the first reflected light source R1 with a lower intensity through the shifted pupil surface 41 , while the rest of the second reflected light source R2 reflected from the non-pupil surface 42 has the same intensity. Furthermore, the sensing module 5 can determine the position of the pupil through the intensity of the first reflected light source R1 and the second reflected light source R2 reflected to the sensing module. In this way, when the user's eyeball rotates, the sensing module 5 can track the position of the pupil of the user's eyeball in real time, and output the pupil position signal of the pupil in real time.
接着请参阅图4，其为具有瞳孔追踪功能的影像投影装置D的另外一影像投影光学路径示意图。详言之，承前所述，感测模块5输出瞳孔的瞳孔位置信号至控制模块6，控制模块6根据该瞳孔位置信号调整微镜模块2。根据图4，控制模块6依据瞳孔位置信号调整微镜模块2，使得光源模块1所提供的第二点光源L2在经过调整后的微镜模块2的反射形成调整后的第二面光源L21，且调整后的第二面光源L21通过光学模块3的反射形成调整后影像光源L22。调整后的影像光源L22准确地投向(偏移后的)瞳孔表面，以重新在使用者的眼球中成像。具体而言，微镜模块2可包括多个微镜片，而控制模块6可通过瞳孔位置信号来调整每一个微镜片的反射角度。如此一来可改变预定光学路径，使得第二点光源L2按序通过微镜模块2以及光学模块3的反射所形成的影像光源L22可准确实时地投向瞳孔表面。Next, please refer to FIG. 4 , which is a schematic diagram of another image projection optical path of the image projection device D with pupil tracking function. In detail, as mentioned above, the sensing module 5 outputs the pupil position signal of the pupil to the control module 6 , and the control module 6 adjusts the micromirror module 2 according to the pupil position signal. According to FIG. 4 , the control module 6 adjusts the micromirror module 2 according to the pupil position signal, so that the second point light source L2 provided by the light source module 1 is reflected by the adjusted micromirror module 2 to form an adjusted second surface light source L21, And the adjusted second surface light source L21 is reflected by the optical module 3 to form an adjusted image light source L22. The adjusted image light source L22 is accurately projected toward the (shifted) pupil surface to re-image in the user's eyeball. Specifically, the micromirror module 2 may include a plurality of microlenses, and the control module 6 may adjust the reflection angle of each microlens through the pupil position signal. In this way, the predetermined optical path can be changed, so that the image light source L22 formed by the reflection of the second point light source L2 through the micromirror module 2 and the optical module 3 in sequence can be projected onto the pupil surface accurately and in real time.
需注意的是，前述检测光源L12通过眼球表面反射不同强度的第一反射光源R1与第二反射光源R2以使感测模块5判断瞳孔位置的作动，与控制模块6调整微镜模块2以使影像光源L22准确地投向瞳孔表面的作动，是几乎同时发生。如此，具有瞳孔追踪功能的影像投影装置D同时提供第一点光源L1与第二点光源L2，第一点光源L1形成检测光源L12并通过眼球表面4反射出不同强度的反射光源，感测模块5通过反射光源判断瞳孔位置并传送瞳孔位置信号给控制模块6。同时，控制模块6实时地调整微镜模块2以改变第二点光源L2的光学路径以准确地在用户的眼球中成像。如此一来，本发明最终可实现具有瞳孔追踪功能的影像投影装置。It should be noted that the aforementioned detection light source L12 reflects the first reflected light source R1 and the second reflected light source R2 of different intensities through the surface of the eyeball so that the sensing module 5 can determine the position of the pupil, and the control module 6 adjusts the micromirror module 2 to The action of accurately projecting the image light source L22 onto the pupil surface occurs almost simultaneously. In this way, the image projection device D with pupil tracking function provides the first point light source L1 and the second point light source L2 at the same time, the first point light source L1 forms the detection light source L12 and reflects different intensities of reflected light sources through the eyeball surface 4, and the sensing module 5 Judging the pupil position by reflecting the light source and sending the pupil position signal to the control module 6 . At the same time, the control module 6 adjusts the micromirror module 2 in real time to change the optical path of the second point light source L2 to accurately form an image in the user's eyeball. In this way, the present invention can finally realize an image projection device with pupil tracking function.
实施例的有益效果Beneficial effects of the embodiment
本发明的有益效果在于，本发明技术方案所提供的具有瞳孔追踪功能的影像投影装置及其瞳孔位置追踪装置，其能通过“光源模块1所提供的第一点光源L1通过微镜模块2的反射以形成第一面光源L11，第一面光源L11通过光学模块3的反射以形成投向眼球表面4的检测光源L12”以及“检测光源L12通过瞳孔表面41的反射以形成投向感测模块5的第一反射光源R1”的技术特征，以使感测模块5依据第一反射光源R1传送瞳孔位置信号至控制模块6，并使控制模块6依据瞳孔位置信号以调整微镜模块2，使得第二点光源L2形成准确地投向瞳孔表面41的影像光源L22。The beneficial effect of the present invention is that the image projection device with pupil tracking function and the pupil position tracking device provided by the technical solution of the present invention can pass the first point light source L1 provided by the light source module 1 through the micromirror module 2. Reflect to form the first surface light source L11, the first surface light source L11 is reflected by the optical module 3 to form the detection light source L12 directed to the eyeball surface 4" and "the detection light source L12 is reflected by the pupil surface 41 to form a detection light source L12 projected to the sensing module 5 The technical characteristics of the first reflective light source R1 ", so that the sensing module 5 transmits the pupil position signal to the control module 6 according to the first reflective light source R1, and the control module 6 adjusts the micromirror module 2 according to the pupil position signal, so that the second The point light source L2 forms an image light source L22 projected precisely on the pupil surface 41 .
以上所公开的内容仅为本发明的优选可行实施例，并非因此局限本发明的权利要求书的保护范围，所以凡是运用本发明说明书及附图内容所做的等效技术变化，均包含于本发明的权利要求书的保护范围内。The content disclosed above is only a preferred feasible embodiment of the present invention, and does not therefore limit the protection scope of the claims of the present invention. Therefore, all equivalent technical changes made by using the description of the present invention and the contents of the accompanying drawings are included in this document. within the protection scope of the claims of the invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710206164.3ACN108663806A (en) | 2017-03-31 | 2017-03-31 | Image projection device with pupil tracking function and pupil position tracking device thereof |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710206164.3ACN108663806A (en) | 2017-03-31 | 2017-03-31 | Image projection device with pupil tracking function and pupil position tracking device thereof |
| Publication Number | Publication Date |
|---|---|
| CN108663806Atrue CN108663806A (en) | 2018-10-16 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710206164.3APendingCN108663806A (en) | 2017-03-31 | 2017-03-31 | Image projection device with pupil tracking function and pupil position tracking device thereof |
| Country | Link |
|---|---|
| CN (1) | CN108663806A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815939A (en)* | 2019-03-01 | 2019-05-28 | 北京当红齐天国际文化发展集团有限公司 | Projection display system and method based on human eye tracking |
| CN113093378A (en)* | 2020-01-08 | 2021-07-09 | 宏碁股份有限公司 | Eyeball tracking device and head-mounted display equipment |
| CN114815237A (en)* | 2021-01-28 | 2022-07-29 | Oppo广东移动通信有限公司 | Laser display module and head-mounted display equipment |
| CN118280151A (en)* | 2024-01-29 | 2024-07-02 | 比亚迪股份有限公司 | Man-machine interaction method, electronic device, vehicle and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050185138A1 (en)* | 2004-02-19 | 2005-08-25 | Visx, Incorporated | Methods and systems for differentiating left and right eye images |
| KR20060123353A (en)* | 2003-12-18 | 2006-12-01 | 애질런트 테크놀로지스, 인크. | Imaging System and Wavelength Dependent Detection Method |
| CN102955255A (en)* | 2011-09-26 | 2013-03-06 | 微软公司 | Integrated eye tracking and display system |
| CN103530618A (en)* | 2013-10-23 | 2014-01-22 | 哈尔滨工业大学深圳研究生院 | Non-contact sight tracking method based on corneal reflex |
| CN104254800A (en)* | 2012-02-06 | 2014-12-31 | 巴特尔纪念研究院 | Image generation system and image generation method |
| CN105138119A (en)* | 2015-08-04 | 2015-12-09 | 湖南七迪视觉科技有限公司 | Stereo vision system with automatic focusing controlled based on human biometrics |
| CN105408801A (en)* | 2013-06-25 | 2016-03-16 | 微软技术许可有限责任公司 | Eye-tracking system for head-mounted display |
| CN105847540A (en)* | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Method and mobile phone for controlling picture movement of VR (Virtual Reality) glasses based on eyeball tracking and VR glasses |
| CN105847538A (en)* | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking |
| CN105929963A (en)* | 2016-05-11 | 2016-09-07 | 北京蚁视科技有限公司 | Method for tracing eyeball position and detection device |
| CN106062665A (en)* | 2013-09-11 | 2016-10-26 | 深圳市汇顶科技股份有限公司 | User interface based on optical sensing and tracking of user's eye movement and position |
| CN106132284A (en)* | 2013-11-09 | 2016-11-16 | 深圳市汇顶科技股份有限公司 | optical eye tracking |
| CN106164743A (en)* | 2014-03-03 | 2016-11-23 | 埃韦视觉有限公司 | eye projection system |
| CN106164748A (en)* | 2014-02-27 | 2016-11-23 | 西铁城控股株式会社 | Projection arrangement |
| CN106200901A (en)* | 2016-06-24 | 2016-12-07 | 联想(北京)有限公司 | The bearing calibration of a kind of wear-type ocular pursuit device and wear-type ocular pursuit device |
| CN106236372A (en)* | 2016-08-17 | 2016-12-21 | 浙江大学 | A kind of method and apparatus of digitized corneal cross-linking regulation corneal curvature radius |
| CN106249412A (en)* | 2015-06-15 | 2016-12-21 | 三星电子株式会社 | Head mounted display device |
| CN206696529U (en)* | 2017-03-31 | 2017-12-01 | 及至微机电股份有限公司 | Image projection device with pupil tracking function and pupil position tracking device thereof |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060123353A (en)* | 2003-12-18 | 2006-12-01 | 애질런트 테크놀로지스, 인크. | Imaging System and Wavelength Dependent Detection Method |
| US20050185138A1 (en)* | 2004-02-19 | 2005-08-25 | Visx, Incorporated | Methods and systems for differentiating left and right eye images |
| CN102955255A (en)* | 2011-09-26 | 2013-03-06 | 微软公司 | Integrated eye tracking and display system |
| CN104254800A (en)* | 2012-02-06 | 2014-12-31 | 巴特尔纪念研究院 | Image generation system and image generation method |
| CN105408801A (en)* | 2013-06-25 | 2016-03-16 | 微软技术许可有限责任公司 | Eye-tracking system for head-mounted display |
| CN106062665A (en)* | 2013-09-11 | 2016-10-26 | 深圳市汇顶科技股份有限公司 | User interface based on optical sensing and tracking of user's eye movement and position |
| CN103530618A (en)* | 2013-10-23 | 2014-01-22 | 哈尔滨工业大学深圳研究生院 | Non-contact sight tracking method based on corneal reflex |
| CN106132284A (en)* | 2013-11-09 | 2016-11-16 | 深圳市汇顶科技股份有限公司 | optical eye tracking |
| CN106164748A (en)* | 2014-02-27 | 2016-11-23 | 西铁城控股株式会社 | Projection arrangement |
| CN106164743A (en)* | 2014-03-03 | 2016-11-23 | 埃韦视觉有限公司 | eye projection system |
| CN106249412A (en)* | 2015-06-15 | 2016-12-21 | 三星电子株式会社 | Head mounted display device |
| CN105138119A (en)* | 2015-08-04 | 2015-12-09 | 湖南七迪视觉科技有限公司 | Stereo vision system with automatic focusing controlled based on human biometrics |
| CN105847538A (en)* | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Mobile phone and method for controlling operations of VR (Virtual Reality) glasses based on eyeball tracking |
| CN105847540A (en)* | 2016-03-16 | 2016-08-10 | 惠州Tcl移动通信有限公司 | Method and mobile phone for controlling picture movement of VR (Virtual Reality) glasses based on eyeball tracking and VR glasses |
| CN105929963A (en)* | 2016-05-11 | 2016-09-07 | 北京蚁视科技有限公司 | Method for tracing eyeball position and detection device |
| CN106200901A (en)* | 2016-06-24 | 2016-12-07 | 联想(北京)有限公司 | The bearing calibration of a kind of wear-type ocular pursuit device and wear-type ocular pursuit device |
| CN106236372A (en)* | 2016-08-17 | 2016-12-21 | 浙江大学 | A kind of method and apparatus of digitized corneal cross-linking regulation corneal curvature radius |
| CN206696529U (en)* | 2017-03-31 | 2017-12-01 | 及至微机电股份有限公司 | Image projection device with pupil tracking function and pupil position tracking device thereof |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815939A (en)* | 2019-03-01 | 2019-05-28 | 北京当红齐天国际文化发展集团有限公司 | Projection display system and method based on human eye tracking |
| CN113093378A (en)* | 2020-01-08 | 2021-07-09 | 宏碁股份有限公司 | Eyeball tracking device and head-mounted display equipment |
| CN114815237A (en)* | 2021-01-28 | 2022-07-29 | Oppo广东移动通信有限公司 | Laser display module and head-mounted display equipment |
| WO2022160962A1 (en)* | 2021-01-28 | 2022-08-04 | Oppo广东移动通信有限公司 | Laser display module and head-mounted display apparatus |
| CN114815237B (en)* | 2021-01-28 | 2023-11-28 | Oppo广东移动通信有限公司 | Laser display modules and head-mounted display devices |
| CN118280151A (en)* | 2024-01-29 | 2024-07-02 | 比亚迪股份有限公司 | Man-machine interaction method, electronic device, vehicle and storage medium |
| Publication | Publication Date | Title |
|---|---|---|
| CN110446965B (en) | Method and system for tracking eye movement in conjunction with a light scanning projector | |
| CN104254800B (en) | Image generation system and image generation method | |
| CN206696529U (en) | Image projection device with pupil tracking function and pupil position tracking device thereof | |
| US9916005B2 (en) | Gaze tracking with projector | |
| TWI569040B (en) | Autofocus head mounted display device | |
| TW201831953A (en) | Eye tracker based on retinal imaging via light-guide optical element | |
| JP7302592B2 (en) | Information detection device, video projection device, information detection method, and video projection method | |
| US9662014B2 (en) | Methods and apparatus for visual cues for eye alignment | |
| TW201712371A (en) | Projection device for data eyeglasses, data eyeglasses, and process to operate a projection device for data eyeglasses enabling a user to have projected image on their data eyeglasses | |
| KR102255781B1 (en) | Compatct type optical device for augmented reality | |
| US12001030B1 (en) | Shadow-matched Fresnel lens doublet for reduced optical artifacts | |
| US10452911B2 (en) | Gaze-tracking system using curved photo-sensitive chip | |
| JP7163230B2 (en) | Line-of-sight detection device, line-of-sight detection method, and display device | |
| US11892634B2 (en) | Multi-plane projection with laser beam scanning in augmented reality displays | |
| CN108663806A (en) | Image projection device with pupil tracking function and pupil position tracking device thereof | |
| CN109725416B (en) | Eyeball tracking optical system, head-mounted equipment and imaging method | |
| CN112384883A (en) | Wearable device and control method thereof | |
| WO2020124627A1 (en) | Near-eye display system and glasses-type virtual display | |
| KR20220046494A (en) | Eye tracking method and eye tracking sensor | |
| CN114815237B (en) | Laser display modules and head-mounted display devices | |
| US20170261750A1 (en) | Co-Aligned Retinal Imaging And Display System | |
| CN216485801U (en) | Optical imaging system, image display device and augmented reality display device | |
| TWM547127U (en) | Image projection device with pupil-tracking function and pupil position-tracking device thereof | |
| JP7356181B2 (en) | Augmented reality optical device capable of providing close-range augmented reality images | |
| US20180267601A1 (en) | Light Projection for Guiding a User within a Physical User Area During Virtual Reality Operations |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | Application publication date:20181016 |