眼动追踪技术用于VR一体机，可以通过注视点渲染降低VR一体机的功耗，从而提高设备待机时间，通过人眼和神经生物学原理，发现人眼只在注视点区域以高分辨率渲染真实世界的影像，其余部分只是模糊的轮廓、纹理与颜色，因此借助眼动追踪技术，VR设备能够根据这一原理只在注视点区域以高分辨率渲染虚拟世界的影像，在大幅提升注视点区域渲染效果的同时，还降低了设备的功耗，提升了VR一体机的待机时长，眼动追踪还提供了全新的交互方式，支撑自动瞳距调节，以及身份识别等功能，但现有的眼动追踪技术存在着以下缺点：1、困扰现代VR/AR头显的一个重大挑战是视觉辐辏调节冲突，视觉辐辏调节冲突容易造成用户产生眼睛疲劳，恶心，头晕等问题；2、菲涅尔VR光学方案的空间比较大，眼动追踪的光学设计空间大，通过半反半透光学镜片实现视觉呈现和眼镜图像的获取，但随着PANCAKE光学方案的应用，光路设计的空间被极度压缩，原先的眼动追踪光学方案无法实现。Eye tracking technology is used in VR all-in-one machines. It can reduce the power consumption of VR all-in-one machines through gaze point rendering, thereby increasing the standby time of the device. Through the principles of human eyes and neurobiology, it is found that the human eye only renders the image of the real world with high resolution in the gaze point area, and the rest is just blurred outlines, textures and colors. Therefore, with the help of eye tracking technology, VR devices can only render the image of the virtual world with high resolution in the gaze point area according to this principle. While greatly improving the rendering effect of the gaze point area, it also reduces the power consumption of the device and increases the standby time of the VR all-in-one machine. Eye tracking also provides a new way of interaction, supports automatic pupil distance adjustment, and identity recognition and other functions, but the existing eye tracking technology has the following shortcomings: 1. A major challenge that plagues modern VR/AR head displays is visual convergence and accommodation conflict, which can easily cause users to have problems such as eye fatigue, nausea, and dizziness; 2. The space of Fresnel VR optical solutions is relatively large, and the optical design space of eye tracking is large. Visual presentation and eye image acquisition are achieved through semi-reflective and semi-transparent optical lenses, but with the application of PANCAKE optical solutions, the space of optical path design is extremely compressed, and the original eye tracking optical solution cannot be realized.

发明内容Summary of the invention

本发明的目的在于提供一种屏下眼动追踪系统，以解决上述背景技术中提出的问题。The purpose of the present invention is to provide an under-screen eye tracking system to solve the problems raised in the above-mentioned background technology.

为实现上述目的，本发明提供如下技术方案：一种屏下眼动追踪系统，包括红外摄像头、显示屏、第一透镜、第二透镜、红外LED和人眼，所述红外摄像头与人眼之间设置有显示屏、第一透镜和第二透镜，且第二透镜的上下两端均设置有红外LED。To achieve the above-mentioned objectives, the present invention provides the following technical solutions: an under-screen eye tracking system, comprising an infrared camera, a display screen, a first lens, a second lens, an infrared LED and a human eye, wherein the display screen, the first lens and the second lens are arranged between the infrared camera and the human eye, and infrared LEDs are arranged at both upper and lower ends of the second lens.

优选的，所述显示屏位于第一透镜的右侧，第一透镜位于第二透镜的右侧。Preferably, the display screen is located on the right side of the first lens, and the first lens is located on the right side of the second lens.

优选的，所述第一透镜的像侧面镀有半透半反膜，第一透镜的物侧面贴有四分之一波片，第二透镜的像侧面贴有偏振反射膜。Preferably, the image side surface of the first lens is coated with a semi-transparent and semi-reflective film, the object side surface of the first lens is attached with a quarter-wave plate, and the image side surface of the second lens is attached with a polarized reflective film.

优选的，所述第二透镜像侧面的曲率半径为999.996mm，厚度为4.004mm，孔径为24mm，折射率为1.54，第二透镜物侧面的曲率半径为-183.89mm，厚度为4.373mm，孔径为24mm，第一透镜像侧面的曲率半径为无限大，厚度为8.504mm，孔径为24mm，折射率为1.52，第一透镜物侧面的曲率半径为-70.934mm，厚度为2.599mm，孔径为24mm。Preferably, the radius of curvature of the image side of the second lens is 999.996 mm, the thickness is 4.004 mm, the aperture is 24 mm, and the refractive index is 1.54; the radius of curvature of the object side of the second lens is -183.89 mm, the thickness is 4.373 mm, the aperture is 24 mm, the radius of curvature of the image side of the first lens is infinite, the thickness is 8.504 mm, the aperture is 24 mm, and the refractive index is 1.52; the radius of curvature of the object side of the first lens is -70.934 mm, the thickness is 2.599 mm, and the aperture is 24 mm.

优选的，所述第一透镜像侧面的K为1，A4为1.804E-06，A6为-4.309E-09，第一透镜物侧面的K为-5.314，A4为0，A6为0，第二透镜像侧面的K为1.001，A4为7.965E-07，A6为3.656E-11。Preferably, the K of the image side surface of the first lens is 1, A4 is 1.804E-06, and A6 is -4.309E-09, the K of the object side surface of the first lens is -5.314, A4 is 0, and A6 is 0, and the K of the image side surface of the second lens is 1.001, A4 is 7.965E-07, and A6 is 3.656E-11.

与现有技术相比，本发明的有益效果如下：Compared with the prior art, the present invention has the following beneficial effects:

本发明通过屏下的红外摄像头，将眼动追踪的光路设计和空间需求压缩到很小的空间内，在空间有限的情况下实现眼动的图像获取，应用到pancake VR一体机中，并通过屏幕背光时序，避开屏幕干扰，获取更清晰的眼睛图像。The present invention uses an infrared camera under the screen to compress the optical path design and space requirements of eye tracking into a very small space, realize eye movement image acquisition under limited space conditions, and apply it to the pancake VR all-in-one machine. Through the screen backlight timing, the screen interference is avoided to obtain clearer eye images.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1为本发明显示屏处于状态1时的示意图；FIG1 is a schematic diagram of a display screen of the present invention when it is in state 1;

图2为本发明显示屏处于状态2时的示意图；FIG2 is a schematic diagram of the display screen of the present invention when it is in state 2;

图3为本发明实施例二示意图；FIG3 is a schematic diagram of a second embodiment of the present invention;

图4为本发明90Hz刷新率下的屏幕和眼动摄像头时序示意图；FIG4 is a schematic diagram of the timing of the screen and the eye-tracking camera at a refresh rate of 90 Hz according to the present invention;

图5为本发明72Hz刷新率下的屏幕和眼动摄像头时序示意图。FIG5 is a schematic diagram of the timing of the screen and the eye-tracking camera at a refresh rate of 72 Hz according to the present invention.

图中：红外摄像头1、显示屏2、第一透镜3、第二透镜4、红外LED 5、人眼6。In the figure: infrared camera 1, display screen 2, first lens 3, second lens 4, infrared LED 5, human eye 6.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

实施例一：Embodiment 1:

一种屏下眼动追踪系统，包括红外摄像头1、显示屏2、第一透镜3、第二透镜4、红外LED 5和人眼6，红外摄像头1与人眼6之间设置有显示屏2、第一透镜3和第二透镜4，且第二透镜4的上下两端均设置有红外LED 5，显示屏2位于第一透镜3的右侧，第一透镜3位于第二透镜4的右侧，第一透镜3的像侧面镀有半透半反膜，第一透镜3的物侧面贴有四分之一波片，第二透镜4的像侧面贴有偏振反射膜，第二透镜4像侧面的曲率半径为999.996mm，厚度为4.004mm，孔径为24mm，折射率为1.54，第二透镜4物侧面的曲率半径为-183.89mm，厚度为4.373mm，孔径为24mm，第一透镜3像侧面的曲率半径为无限大，厚度为8.504mm，孔径为24mm，折射率为1.52，第一透镜3物侧面的曲率半径为-70.934mm，厚度为2.599mm，孔径为24mm，第一透镜3像侧面的K为1，A4为1.804E-06，A6为-4.309E-09，第一透镜3物侧面的K为-5.314，A4为0，A6为0，第二透镜4像侧面的K为1.001，A4为7.965E-07，A6为3.656E-11。A screen eye tracking system includes an infrared camera 1, a display screen 2, a first lens 3, a second lens 4, an infrared LED 5 and a human eye 6. The display screen 2, the first lens 3 and the second lens 4 are arranged between the infrared camera 1 and the human eye 6, and the upper and lower ends of the second lens 4 are both provided with infrared LEDs 5. The display screen 2 is located on the right side of the first lens 3, and the first lens 3 is located on the right side of the second lens 4. The image side of the first lens 3 is coated with a semi-transparent and semi-reflective film, the object side of the first lens 3 is attached with a quarter-wave plate, and the image side of the second lens 4 is attached with a polarized reflection film. The curvature radius of the image side of the second lens 4 is 999.996 mm, the thickness is 4.004 mm, the aperture is 24 mm, and the refractive index is 1.54. The curvature radius of the object side of the second lens 4 is -183.89 mm, the thickness is 4.373 mm, the aperture is 24 mm, and the curvature radius of the image side of the first lens 3 ... second lens 4 is -183.89 mm, the thickness is 4.373 mm, the aperture is 24 mm, and the curvature radius of the image side of the first lens 3 is -183.89 mm, the thickness is 4.37 The rate radius is infinite, the thickness is 8.504mm, the aperture is 24mm, the refractive index is 1.52, the curvature radius of the object side of the first lens 3 is -70.934mm, the thickness is 2.599mm, the aperture is 24mm, the K of the image side of the first lens 3 is 1, A4 is 1.804E-06, A6 is -4.309E-09, the K of the object side of the first lens 3 is -5.314, A4 is 0, A6 is 0, the K of the image side of the second lens 4 is 1.001, A4 is 7.965E-07, A6 is 3.656E-11.

如附图1所示，显示屏2处于状态1时，红外LED 5和红外摄像头1启动。红外LED 5发出的红外光被人眼6反射，再经过第二透镜4和第一透镜3的折射，光线从第一透镜3的像侧面射出，被红外摄像头1捕捉成像。As shown in FIG. 1 , when the display screen 2 is in state 1, the infrared LED 5 and the infrared camera 1 are activated. The infrared light emitted by the infrared LED 5 is reflected by the human eye 6, and then refracted by the second lens 4 and the first lens 3. The light is emitted from the image side of the first lens 3 and captured by the infrared camera 1 to form an image.

如附图2所示，显示屏2处于状态2时，显示屏2发出的圆偏振光经过第一透镜3、四分之一波片后转换成线偏振光，再经过偏振反射膜后回到第一透镜3，通过半透半反膜折回到第二透镜4，从第二透镜4射入人眼6，形成虚像。As shown in FIG. 2 , when the display screen 2 is in state 2, the circularly polarized light emitted by the display screen 2 is converted into linearly polarized light after passing through the first lens 3 and the quarter-wave plate, and then returns to the first lens 3 after passing through the polarizing reflective film, and is folded back to the second lens 4 through the semi-transparent and semi-reflective film, and is emitted from the second lens 4 into the human eye 6 to form a virtual image.

实施例二：Embodiment 2:

光学系统沿光线传输方向依次包括：显示屏、部分反射镜、第一透镜、第二透镜、四分之一波片、偏振反射器和第三透镜。The optical system includes, in sequence along the light transmission direction: a display screen, a partial reflector, a first lens, a second lens, a quarter wave plate, a polarization reflector and a third lens.

其中，第三透镜物侧面为平面面型，第三透镜物侧面与偏振反射器贴合，第二透镜像侧面为平面面型，第二透镜像侧面与四分之一波片贴合。The object side surface of the third lens is a plane surface, and the object side surface of the third lens is bonded to the polarizing reflector. The image side surface of the second lens is a plane surface, and the image side surface of the second lens is bonded to the quarter wave plate.

A、显示屏处于状态1时，红外LED和红外摄像头启动，红外LED发出的红外光被人眼反射，再经过第三透镜和第三透镜，第二透镜和第一透镜的折射，光线从第一透镜的像侧面射出，被红外摄像头捕捉成像；A. When the display screen is in state 1, the infrared LED and the infrared camera are activated, the infrared light emitted by the infrared LED is reflected by the human eye, and then refracted by the third lens and the third lens, the second lens and the first lens, and the light is emitted from the image side of the first lens and captured by the infrared camera;

B、显示屏处于状态2时，显示屏发出的圆偏振光经过第一透镜、第二透镜、四分之一波片后转换成线偏振光，再经过偏振反射膜后回到四分之一波片转换为圆偏振光，再通过第二透镜和第一透镜，通过半透半反膜折回到第二透镜，从第三透镜第三透镜射入人眼，形成虚像。B. When the display screen is in state 2, the circularly polarized light emitted by the display screen is converted into linearly polarized light after passing through the first lens, the second lens, and the quarter-wave plate, and then returns to the quarter-wave plate after passing through the polarizing reflective film to be converted into circularly polarized light, and then passes through the second lens and the first lens, and is reflected back to the second lens through the semi-transparent and semi-reflective film, and is emitted into the human eye from the third lens to form a virtual image.

为了获取清晰的眼动追踪图像，VR一体机采用fastlcd显示屏，并采用屏下摄像头方案获取眼动图像，当屏幕背光熄灭时，摄像头再曝光抓取眼睛图像(如附图4所示)，T1为上一帧背光关闭的时刻，延迟100us的T2时刻打开红外灯，将眼睛照亮，并在同一时刻屏下摄像头开始曝光，红外灯点亮时间和摄像曝光时间均为1ms，在T3时刻关闭红外灯和结束曝光。In order to obtain clear eye tracking images, the VR all-in-one machine uses a fast LCD display and an under-screen camera solution to obtain eye movement images. When the screen backlight is off, the camera exposes and captures the eye image again (as shown in Figure 4). T1 is the moment when the backlight of the previous frame is turned off. The infrared light is turned on at T2, which is delayed by 100us, to illuminate the eyes, and the under-screen camera starts to expose at the same time. The infrared light lighting time and the camera exposure time are both 1ms. The infrared light is turned off and the exposure ends at T3.

尽管已经示出和描述了本发明的实施例，对于本领域的普通技术人员而言，可以理解在不脱离本发明的原理和精神的情况下可以对这些实施例进行多种变化、修改、替换和变型，本发明的范围由所附权利要求及其等同物限定。Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. The utility model provides an eye moves tracking system under screen, includes infrared camera (1), display screen (2), first lens (3), second lens (4), infrared LED (5) and human eye (6), its characterized in that: a display screen (2), a first lens (3) and a second lens (4) are arranged between the infrared camera (1) and the human eye (6), infrared LEDs (5) are arranged at the upper end and the lower end of the second lens (4), the display screen (2) is positioned on the right side of the first lens (3), the first lens (3) is positioned on the right side of the second lens (4), a semi-transparent semi-reflective film is plated on the image side surface of the first lens (3), a quarter wave plate is attached to the object side surface of the first lens (3), a polarized reflective film is attached to the image side surface of the second lens (4), the curvature radius of the image side surface of the second lens (4) is 999.996mm, the thickness is 4.004mm, the aperture is 24mm, the refractive index is 1.54, the radius of curvature of the object side of the second lens (4) is-183.89 mm, the thickness is 4.373mm, the aperture is 24mm, the radius of curvature of the image side of the first lens (3) is infinite, the thickness is 8.504mm, the aperture is 24mm, the refractive index is 1.52, the radius of curvature of the object side of the first lens (3) is-70.934 mm, the thickness is 2.599mm, the aperture is 24mm, K of the image side of the first lens (3) is 1, A4 is 1.804E-06, A6 is-4.309E-09, K of the object side of the first lens (3) is-5.314, A4 is 0, A6 is 0, K of the image side of the second lens (4) is 1.001, A4 is 7.965E-07, and A6 is 3.656E-11.