







本发明涉及视网膜检测技术领域,具体地,涉及一种视网膜检测系统,尤其是一种基于虚拟现实技术的视网膜检测系统,能够提供多种人机交互式的多种基于虚拟现实技术的视野范围检测。The present invention relates to the technical field of retina detection, in particular to a retina detection system, in particular a retina detection system based on virtual reality technology, which can provide multiple human-machine interactive and multiple virtual reality technology-based field of view detections .
视网膜健康状态与人的视觉健康情况直接相关,许多视觉疾病表现为视网膜的损坏或功能衰退。包括但不限于:黄斑变性、青光眼、视网膜脱落、色盲与色弱,严重影响职业与生活功能。视网膜损坏或功能衰退的病因及发病机制多种多样,多数都存在病情逐渐恶化,初期不易察觉,视网膜病变发病机制多样,多数无法找到成因,这些疾病的基本特点是初期不易察觉,一旦发现已经病情严重无法逆转或控制。The health of the retina is directly related to the health of people's vision. Many visual diseases are manifested as damage or functional decline of the retina. Including but not limited to: macular degeneration, glaucoma, retinal detachment, color blindness and color weakness, which seriously affect occupation and life functions. The etiology and pathogenesis of retinal damage or functional decline are diverse. Most of them have gradual deterioration and are not easy to detect at the initial stage. The pathogenesis of retinopathy is diverse, and most of them cannot find the cause. The basic feature of these diseases is that they are not easy to detect at the initial stage. Seriously irreversible or controllable.
视网膜相关疾病的诊断和治疗遵循越早越好的原则,及时而有效的早期诊断和定期复诊有助于改善病情,提高生活质量。但是,现有的视网膜健康状态检测手段是陈旧的机械式眼底扫描,过程繁琐,精度不佳,要求被测者保持眼球不动,并依赖于经验丰富的医师的个人技术,需要投入大量的人力、物力和财力,这对拥有视网膜健康问题的家庭和社会医疗资源都是极大的挑战。因此,目前亟需提供成本低、效率高、可客观量化的视野测量辅助手段。为了减少对医师的依赖,提倡采用更客观的量化指标来辅助检测视网膜健康状态,更加及时准确的发现视网膜病变。The diagnosis and treatment of retinal-related diseases follow the principle that the sooner the better, and timely and effective early diagnosis and regular follow-up diagnosis can help improve the condition and improve the quality of life. However, the existing retinal health detection method is an old mechanical fundus scanning, which is cumbersome and poor in accuracy. It requires the subject to keep the eyeballs still, and relies on the personal skills of experienced physicians, requiring a lot of manpower. , Material and financial resources, this is a great challenge for families with retinal health problems and social medical resources. Therefore, there is an urgent need to provide low-cost, high-efficiency, and objectively quantifiable auxiliary methods for visual field measurement. In order to reduce dependence on physicians, it is advocated to use more objective quantitative indicators to assist in the detection of retinal health, and to detect retinopathy in a more timely and accurate manner.
相当比例的视网膜健康状态测试者,比如低龄儿童和老年人,很难听从指令持续专注的注视固定平面显示器或球面视网膜检测仪,并针对变化快速反应,这将导致其注视点分布可能超过视觉刺激材料的限定范围,传感器采集到的数据失效。所以,通过普通的固定平面和球面视觉刺激材料采集到的视网膜健康状态信息无法排除显示设备之外的人为和环境干扰。A considerable proportion of retinal health testers, such as young children and the elderly, find it difficult to follow instructions and continue to focus on fixed flat-panel displays or spherical retinal detectors, and respond quickly to changes, which may cause their fixation points to exceed visual stimuli. In the limited range of materials, the data collected by the sensor is invalid. Therefore, the retinal health status information collected through ordinary fixed plane and spherical visual stimulus materials cannot exclude human and environmental interference outside the display device.
同时,普通的平面眼动追踪传感器需要校准使用者的视线焦点,范围较大的头部运动会影响校准结果和实际测试过程中的注视点位置的匹配准确率,两种指标相互影响,会降低采集到的注视点数据的质量。At the same time, ordinary planar eye tracking sensors need to calibrate the user’s gaze focus. A large range of head movement will affect the matching accuracy of the calibration result and the gaze position during the actual test. The two indicators affect each other and reduce the collection. The quality of the gaze point data reached.
目前没有发现同本发明类似技术的说明或报道,也尚未收集到国内外类似的资料。At present, no description or report of similar technology to the present invention has been found, and similar data at home and abroad have not been collected.
发明内容Summary of the invention
针对现有技术中存在的上述不足,本发明的目的是提供一种基于虚拟现实技术的视网膜检测系统。In view of the above-mentioned shortcomings in the prior art, the purpose of the present invention is to provide a retina detection system based on virtual reality technology.
本发明是通过以下技术方案实现的。The present invention is achieved through the following technical solutions.
一种基于虚拟现实技术的视网膜检测系统,包括:显示子系统、头动追踪子系统、眼动追踪子系统、控制器子系统以及头戴式显示器支架,所述显示子系统、头动追踪子系统和眼动追踪子系统内置于所述头戴式显示器支架中;其中:A retinal detection system based on virtual reality technology includes: a display subsystem, a head movement tracking subsystem, an eye tracking subsystem, a controller subsystem, and a head-mounted display bracket. The display subsystem, the head movement tracking sub-system The system and the eye tracking subsystem are built in the head-mounted display bracket; wherein:
所述显示子系统,用于向被测者显示无视野边界的立体影像,包括:The display subsystem is used to display a three-dimensional image without boundary of the field of view to the subject, including:
-显示器模块,所述显示器模块用于向被测者显示具有景深的立体影像;-A display module, which is used to display a stereoscopic image with depth of field to the subject;
-透镜模块,所述透镜模块位于被测者的眼睛和所述显示器模块之间,用于将所述显示器模块投射出的光线放大映射到被测者的眼中,使所述显示器模块显示的立体影像占据被测者的全部视野;-A lens module, the lens module is located between the eyes of the subject and the display module, and is used to magnify and map the light projected by the display module to the eyes of the subject, so that the display module can display three-dimensional The image occupies the entire field of view of the subject;
所述控制器子系统,用于控制得到被测者的视野边界以及测试光点信息;The controller subsystem is used to control and obtain the visual field boundary of the subject and the test light spot information;
所述头动跟踪子系统,用于检测头部运动信息,消除头部运动对视觉检测的影响;The head movement tracking subsystem is used to detect head movement information and eliminate the influence of head movement on visual detection;
所述眼动追踪子系统,用于检测被测者的注视点信息。The eye tracking subsystem is used to detect the gaze point information of the subject.
优选地,所述显示器模块采用内嵌式双屏显示器,所述内嵌式双屏显示器的两块屏幕模拟人眼对现实景物的观察角度,以人的每只眼睛的视野范围建立球面坐标,球面顶点是人眼的视野中心;所述显示器模块包括初步测量模式和精确测量模式,其中:Preferably, the display module adopts a built-in dual-screen display, the two screens of the built-in dual-screen display simulate the viewing angle of the human eye to the real scene, and the spherical coordinates are established based on the field of view of each human eye, The apex of the spherical surface is the center of the human eye's field of view; the display module includes a preliminary measurement mode and an accurate measurement mode, among which:
所述初步测量模式为:极轴通过顶点形成0°子午线,在视野范围内从0°子午线开始逆时针每N°间隔增加一条经过球面顶点的子午线,多条子午线将视野划分为多个区域,显示器模块在黑暗背景下,从0°子午线开始逆时针依次沿各条子午线的球面顶点向视野边缘移动并向被测者双眼投射光点,当被测者发现光点消失时 启动控制器子系统的客户端,记录该视野区域方向上的视野边界;所述控制器子系统的服务端还用于控制内嵌式双屏显示器增加M°间隔的子午线不同光亮及颜色光点扫描,得到被测者的测试光点信息,进而初步勾勒出被测试者视觉不敏感的区域;其中M°小于N°。The preliminary measurement mode is: the polar axis passes through the apex to form a 0° meridian, and a meridian passing through the apex of the sphere is added counterclockwise from the 0° meridian in the field of view every N° interval, and multiple meridians divide the field of view into multiple regions, On a dark background, the display module moves counterclockwise from the 0° meridian to the edge of the field of view along the sphere vertices of each meridian, and projects light spots to the eyes of the subject. When the subject finds the light spots disappear, the controller subsystem is activated. The client side of the field of view records the boundary of the field of view in the direction of the field of view; the server side of the controller subsystem is also used to control the embedded dual-screen display to increase the meridian different brightness and color spot scanning at the interval of M° to obtain the measured The test light spot information of the subject, and then preliminarily outlines the visually insensitive area of the subject; where M° is less than N°.
所述精确测量模式为:以视野中心为原点,建立水平和垂直坐标线,所述水平和垂直坐标线将视野范围分为四个象限区域;其中每个象限区域内平均分布若干个能够随机点亮的光点,被测者根据视野范围内是否观测到点亮的光点而对应做出选择,进而精确测量出被测试者的视觉不敏感区。The precise measurement mode is: taking the center of the field of view as the origin to establish horizontal and vertical coordinate lines, the horizontal and vertical coordinate lines divide the field of view into four quadrant areas; wherein a number of random points are evenly distributed in each quadrant area For the bright light spot, the subject makes a corresponding choice according to whether the light spot is observed in the field of view, and then accurately measures the visual insensitive area of the subject.
优选地,所述精确测量模式在初步测量模式的基础之上执行。Preferably, the precise measurement mode is executed on the basis of the preliminary measurement mode.
优选地,所述N°采用30°,相应地,所述视野将划分为12个区域;所述M°采用5°。Preferably, the N° adopts 30°, and accordingly, the field of view will be divided into 12 regions; the M° adopts 5°.
优选地,所述光点亮度及颜色可调节。Preferably, the brightness and color of the light spots are adjustable.
在完成动态视网膜测试后,根据动态视野范围测量的结果勾勒出被测者视野中对光敏感较弱的区域。After the dynamic retina test is completed, the areas of the subject’s visual field that are less sensitive to light are outlined based on the results of the dynamic visual field range measurement.
在勾勒出被测者视野范围弱的区域后,系统将使用静态视场测试将视觉敏感度较弱区域重点测量,视场中敏感较强区域将会被进行粗略测量,如图8所示。静态视场测量使用呈矩阵排列的光斑逐个闪烁,矩阵分为四个象限,每个象限区域内预先分布多个光点,光点数量和设定位置不影响本专利权利要求。被测者对光斑的闪烁作出反应。如此测试产生结果更加具体,但测试时间长且测试过程使人不适,选择敏感度弱的区域重点测量将缩短测试时间,但保持测试精度。After delineating the areas where the subject’s field of view is weak, the system will use the static field of view test to focus on the areas with weaker visual sensitivity, and the more sensitive areas in the field of view will be roughly measured, as shown in Figure 8. The static field of view measurement uses light spots arranged in a matrix to blink one by one. The matrix is divided into four quadrants. A plurality of light spots are pre-distributed in each quadrant area. The number of light spots and setting positions do not affect the claims of this patent. The subject responds to the flickering of the light spot. Such a test produces more specific results, but the test time is long and the test process is uncomfortable. Choosing an area with weak sensitivity to focus on measurement will shorten the test time, but maintain the test accuracy.
优选地,所述透镜模块包括两片透镜,分别与内嵌式双屏显示器的两块屏幕相对应,其中每一片透镜均设有圆形棱镜阵列。Preferably, the lens module includes two lenses, respectively corresponding to the two screens of the in-cell dual-screen display, and each lens is provided with a circular prism array.
优选地,所述头动跟踪子系统包括:Preferably, the head movement tracking subsystem includes:
加速计模块,所述加速计模块用于重力监测,从而判断所述头戴式显示器支架是否正立,同时检测被测者头部在各轴上的加速度;An accelerometer module, the accelerometer module is used for gravity monitoring, so as to determine whether the head-mounted display bracket is upright, and at the same time detect the acceleration of the subject's head on each axis;
陀螺仪模块,所述陀螺仪模块用于跟踪被测者头部的旋转角速度及角度变化。The gyroscope module is used to track the rotation angular velocity and angle change of the subject's head.
优选地,所述视网膜检测系统,还包括分析评价子系统;Preferably, the retina detection system further includes an analysis and evaluation subsystem;
所述分析评价子系统,包括:The analysis and evaluation subsystem includes:
-头部运动补偿模块,根据头部运动信息,得到被测者头部运动模式;-The head motion compensation module, based on the head motion information, obtains the head motion mode of the subject;
-视觉注意点跟踪模块,所述视觉注意点追踪模块根据注视点信息,通过补偿 眼部运动持续追踪视网膜特定区域,提取其视觉注意模式;-A visual attention point tracking module, the visual attention point tracking module continuously tracks a specific area of the retina by compensating for eye movement according to the point of gaze information, and extracts its visual attention mode;
-视网膜检测评价模块,所述视网膜检测评价模块,通过头部运动模式和视觉注意模式,准确定位视网膜的检测位置,-Retina detection and evaluation module, the retina detection and evaluation module accurately locates the detection position of the retina through head movement patterns and visual attention patterns,
吗基于对被测者的视野边界的测量,评估视力受损的可能视野区域,同时根据测试光点信息,得到被测者在不同视野区域的感光敏感度和颜色敏感度,测量受测试者的视网膜可视区域和不可视区域的范围,输出被测者的视网膜健康状态检测结果。Based on the measurement of the visual field boundary of the subject, the possible visual field area with impaired vision is evaluated. At the same time, the light sensitivity and color sensitivity of the subject in different visual field areas are obtained according to the test light spot information, and the subject’s visual sensitivity is measured. The range of the visible and invisible areas of the retina output the test result of the health status of the retina of the subject.
优选地,所述注视点信息包括:被测者在立体影像上的注视位置信息、注视顺序信息和注视时长信息。Preferably, the gaze point information includes: gaze position information, gaze sequence information, and gaze duration information of the subject on the stereoscopic image.
优选地,所述头部运动信息包括:被测者的头动速度信息、位移信息和旋转方向信息。Preferably, the head movement information includes: head movement speed information, displacement information and rotation direction information of the subject.
优选地,所述测试光点信息包括:被测者在球坐标空间中看到的光点的位置、光点的亮度以及光点的颜色。Preferably, the test light spot information includes: the position of the light spot, the brightness of the light spot, and the color of the light spot seen by the subject in the spherical coordinate space.
本发明提供的基于虚拟现实技术的视网膜检测系统,是一种基于虚拟现实技术,采用动态子午线光点与静态矩阵光点相结合的方法,提供多种视野检测模式的系统,可用于测试无视野边界的立体影像。该系统中:显示器模块用于向被测者显示具有景深的立体影像(光点);透镜模块位于被测者的眼睛和显示器模块之间,用于将显示器模块投射出的光点放大映射到被测者的眼中,使显示器模块显示的立体影像占据被测者的全部视野;控制器子系统,用于控制得到被测者的视野边界以及测试光点信息;头动跟踪子系统,用于检测头部运动信息,消除头部运动对视觉检测的影响;眼动追踪子系统,用于检测被测者的注视点信息。本发明能够客观准确的跟踪并评估被测者的视网膜各个区域的健康状态检测结果,能够量化特征,准确高效。The retinal detection system based on virtual reality technology provided by the present invention is a system based on virtual reality technology that combines dynamic meridian light spots and static matrix light spots to provide multiple visual field detection modes, which can be used to test no visual field Three-dimensional image of the boundary. In this system: the display module is used to display a three-dimensional image (light spot) with depth of field to the subject; the lens module is located between the subject’s eyes and the display module, and is used to magnify and map the light spot projected by the display module to In the eyes of the subject, the stereoscopic image displayed by the display module occupies the entire field of view of the subject; the controller subsystem is used to control the boundary of the subject’s field of view and the test light point information; the head movement tracking subsystem is used to Detect head movement information to eliminate the influence of head movement on visual detection; eye tracking subsystem is used to detect the gaze point information of the subject. The invention can objectively and accurately track and evaluate the health status detection result of each area of the retina of the subject, can quantify features, and is accurate and efficient.
与现有技术相比,本发明具有如下有益效果:Compared with the prior art, the present invention has the following beneficial effects:
1、本发明提出的一种基于虚拟现实技术的视网膜检测系统,采用头戴式显示器支架,其中的显示子系统的显示模块生成的立体影像,测试过程比传统视场检测方式舒适且价格适中,有利于减轻不适感对测试准确性的影响,提高了视网膜健康状态检查的配合度;另一方面也使得虚拟现实环境中的视觉刺激材料的比平面刺激材料更立体、更具有景深,能模拟人所接触到的实际场景视觉范围,有助于提升采集数据有效性。1. A retinal detection system based on virtual reality technology proposed by the present invention adopts a head-mounted display bracket, in which the three-dimensional image generated by the display module of the display subsystem, the test process is more comfortable and affordable than the traditional field of view detection method. It is helpful to reduce the impact of discomfort on the test accuracy and improve the coordination of the retinal health check; on the other hand, it also makes the visual stimulus material in the virtual reality environment more three-dimensional and more depth of field than the plane stimulus material, and can simulate people The visual range of the actual scene that is touched helps to improve the effectiveness of the collected data.
2、本发明提出的一种基于虚拟现实技术的视网膜检测系统,由于眼动追踪子系统内嵌于头戴式显示器支架内部,眼动追踪子系统与被测者眼睛无相对位移,因此该眼动追踪子系统可以实现头部运动同步跟随,不会由于头部大幅动作而对被测者双眼失焦。2. The present invention proposes a retinal detection system based on virtual reality technology. Since the eye tracking subsystem is embedded in the head-mounted display bracket, there is no relative displacement between the eye tracking subsystem and the subject’s eyes. The dynamic tracking subsystem can realize the synchronous follow-up of the head movement, and will not lose focus on the subject's eyes due to the large movement of the head.
3、本发明提出的一种基于虚拟现实技术的视网膜检测系统,头动跟踪子系统内嵌于头戴式显示器支架中,能够无相对位移的跟随头动,提高了头动检测的准确性。3. In a retinal detection system based on virtual reality technology proposed by the present invention, the head movement tracking subsystem is embedded in the head-mounted display bracket, which can follow the head movement without relative displacement, thereby improving the accuracy of head movement detection.
4、本发明提出的一种基于虚拟现实技术的视网膜检测系统,根据视觉的注意点信息和头部运动信息两项指标,客观准确的跟踪并评估被测者的视网膜各个区域的健康状态检测结果,能够量化特征,准确高效。4. A retinal detection system based on virtual reality technology proposed by the present invention can objectively and accurately track and evaluate the health status detection results of each region of the subject’s retina according to two indicators of visual attention point information and head movement information , Can quantify features, accurately and efficiently.
5.本发明结合动态和静态的视场测量方式,使测量时间缩短但保持静态测量的精度。5. The invention combines dynamic and static field-of-view measurement methods to shorten the measurement time but maintain the accuracy of static measurement.
通过阅读参照以下附图对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:By reading the detailed description of the non-limiting embodiments with reference to the following drawings, other features, purposes and advantages of the present invention will become more apparent:
图1为本发明一实施例中基于虚拟现实技术的视网膜检测系统的结构框图;FIG. 1 is a structural block diagram of a retina detection system based on virtual reality technology in an embodiment of the present invention;
图2为本发明一实施例中头动跟踪子系统的结构框图;Fig. 2 is a structural block diagram of a head movement tracking subsystem in an embodiment of the present invention;
图3为本发明一实施例中分析评价子系统的结构框图;Figure 3 is a structural block diagram of an analysis and evaluation subsystem in an embodiment of the present invention;
图4为本发明一实施例中头戴式显示器的结构示意图;4 is a schematic diagram of the structure of a head-mounted display in an embodiment of the present invention;
图5为本发明一实施例中子午线动态方法测试的单眼视野范围影像图;FIG. 5 is an image diagram of a monocular field of view tested by a meridian dynamic method according to an embodiment of the present invention;
图6为本发明一实施例中矩阵静态方法测试的单眼视野范围影像图;FIG. 6 is an image diagram of a monocular field of view tested by a matrix static method in an embodiment of the present invention;
图7为本发明一实施例中子午线动态方法初筛勾勒的单眼视野范围影像图;FIG. 7 is an image diagram of the monocular field of view outlined by the initial screening of the meridian dynamic method according to an embodiment of the present invention; FIG.
图8为本发明一实施例中子午线动态初筛结合矩阵静态法描绘的精确单眼视野范围影像图;FIG. 8 is an image diagram of an accurate monocular field of view drawn by the dynamic preliminary screening of the meridian combined with the static matrix method in an embodiment of the present invention;
图中:In the picture:
1为显示子系统,11为透镜模块,12为显示器模块;1 is the display subsystem, 11 is the lens module, and 12 is the display module;
2为眼动追踪子系统;2 is the eye tracking subsystem;
3为头动跟踪子系统,31为加速计模块,32为陀螺仪模块;3 is the head movement tracking subsystem, 31 is the accelerometer module, and 32 is the gyroscope module;
4为分析评价子系统,41为头动跟踪模块,42为眼动跟踪模块,43为视网膜检测评价模块;4 is the analysis and evaluation subsystem, 41 is the head tracking module, 42 is the eye tracking module, and 43 is the retina detection and evaluation module;
5为头戴式显示器支架;5 is a head-mounted display stand;
61为视觉区域原点62为子午线,63为动态观光点,64为动态光点沿子午线运动的起始点,65为光点的运动方向,66为光点进入被测试者的视觉敏感区的边界点,也是光点在该子午线的运动终点;61 is the origin of the visual area 62 is the meridian, 63 is the dynamic sightseeing spot, 64 is the starting point of the dynamic light spot moving along the meridian, 65 is the movement direction of the light spot, and 66 is the boundary point where the light spot enters the subject's visual sensitive area , Is also the end point of the light point at the meridian;
71为视觉区域中心点即原点,72为划分视觉区域的X轴,73为划分视觉区域的Y轴,75为静态测试光点;71 is the center point or origin of the visual area, 72 is the X-axis that divides the visual area, 73 is the Y-axis that divides the visual area, and 75 is the static test spot;
81、82、83、84为光点进入被测者视觉区域的边界点,85为利用这些边界点所勾勒的被测者的视觉不敏感区域;81, 82, 83, 84 are the boundary points where the light point enters the subject's visual area, and 85 is the visually insensitive area of the subject outlined by these boundary points;
91为静态光点,92为动态子午线勾勒的视觉不敏感区域;91 is a static light spot, and 92 is a visually insensitive area outlined by a dynamic meridian;
10为控制子模块。10 is the control sub-module.
下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明,但不以任何形式限制本发明。应当指出的是,对本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进。这些都属于本发明的保护范围。The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be pointed out that for those of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.
本发明实施例提出了一种基于虚拟现实技术的视网膜检测系统,参照图1、图4和图5所示,包括:显示子系统1、眼动追踪子系统2、头动跟踪子系统3和头戴式显示器支架5,显示子系统1、眼动追踪子系统2和头动跟踪子系统均内置于头戴式显示器支架5中,显示子系统1,用于向被测者显示无视野边界的立体影像,其包括:显示器模块12,显示器模块12为具有足够像素密度和刷新速率的内嵌式双屏显示器,用于向被测者显示具有景深的立体影像;透镜模块11,透镜模块11位于被测者的眼睛和显示器模块12间,用于将显示器模块12投射出的光线放大映射到被测者的眼中,使显示器模块12显示的立体影像占据被测者的全部视野;眼动追踪子系统2,用于检测被测者的注视点信息;头动跟踪子系统3,用于检测头部运动信息,消除头部运动对视觉检测的影响。以每个眼的视野范围建立球面坐标,球面顶点61是人眼的视野中心,水平右向的子午线通过顶点,是0°子午线62,显示器模块12在在视野范围内从0°子午线62开始逆时针每N°(可以为30°)一条子午线经过顶点,将视野划分为多个区域(相应地形成12个区域),分别向被测者双眼投射黑暗背景下沿各个子午线依次从边缘向视野中心移动 的光点63,当被测者发现光点63消失时按下控制器子系统的客户端,记录该视野方向上的视野边界,光点63亮度及颜色可控。在动态测量后勾勒出视觉不敏感区域,利用静态测量将不敏感区域重点测量,视觉相对敏感区域将被粗略测量。测量结果将会根据眼动和头动跟踪数据而校准结果,最终测试结果类似静态视场测量结果。所述控制器子系统的服务端还用于控制内嵌式双屏显示器增加M°间隔的子午线不同光亮及颜色光点扫描,得到被测者的测试光点信息;其中M°小于N°。进一步地,M°可以采用5°。The embodiment of the present invention proposes a retina detection system based on virtual reality technology, as shown in FIG. 1, FIG. 4, and FIG. 5, including: a display subsystem 1, an
在完成动态视网膜测试后,根据动态视野范围测量的结果勾勒出被测者视野中对光敏感较弱的区域,如图7所示。After the dynamic retina test is completed, the areas of the subject’s field of view that are less sensitive to light are outlined according to the results of the dynamic field of view range measurement, as shown in Figure 7.
在勾勒出被测者视野范围弱的区域后,系统将使用静态视场测试将视觉敏感度较弱区域重点测量,视场中敏感较强区域将会被进行粗略测量,如图8所示。静态视场测量使用呈矩阵排列的光斑逐个闪烁,如图6所示,矩阵分为四个象限,每个象限区域内预先分布多个光点,光点数量和设定位置不影响本专利权利要求。被测者对光斑的闪烁作出反应。如此测试产生结果更加具体,但测试时间长且测试过程使人不适,选择敏感度弱的区域重点测量将缩短测试时间,但保持测试精度。After delineating the areas where the subject’s field of view is weak, the system will use the static field of view test to focus on the areas with weaker visual sensitivity, and the more sensitive areas in the field of view will be roughly measured, as shown in Figure 8. The static field of view measurement uses the light spots arranged in a matrix to flicker one by one, as shown in Figure 6, the matrix is divided into four quadrants, and multiple light spots are pre-distributed in each quadrant area. The number of light spots and setting positions do not affect the patent rights Claim. The subject responds to the flickering of the light spot. Such a test produces more specific results, but the test time is long and the test process is uncomfortable. Choosing an area with weak sensitivity to focus on measurement will shorten the test time, but maintain the test accuracy.
具体地,本发明的头戴式显示器支架5内置了显示子系统1、眼动追踪子系统2和头部跟踪子系统3,显示子系统1中的显示器模块12的像素密度需大于400ppi,刷新速率至少有60Hz,显示器模块12内嵌在头戴式显示器支架5的前端,其自带的双屏显示器正对被测者双眼。在传统静态视场测量过程中,被测者的头部需要在固定位置上停留10到20分钟,且测试中被测者需要迅速对一闪而过的光斑做出反应。在此测试环境下被测者很容易产生不适,会降低测试准确率,因为视场测试结果依赖被测者的反应,若被测者无法准确做出反应,测试结果准确率会降低。如果使用本发明使用的虚拟现实显示,被测者可以在测试过程中移动头部,降低测试时的不适感。本发明的测试方法也在一定程度上降低被测者的不适感,动态测量被相比静态测量舒适,但测量精度不高,本发明结合静态测量和动态测量。首先静态测量画出视野中有问题的区域,再用静态测量重点测量视力缺陷区域。减少需要静态测量的部分,并保持测试准确性。Specifically, the head-mounted display stand 5 of the present invention has a built-in display subsystem 1, an
而透镜模块11可将显示器模块12发出的光线放大后投射至人眼上,进而 可以消除显示器模块12的双屏显示器在人眼中的边框,使得被测者更能沉浸在显示子系统1营造的环境中,其对不同影像作出的反馈行为更加真实,增加了视网膜健康状态判断结果的准确性;The
眼动追踪子系统2,为一种能够跟踪测量眼球位置及眼球运动信息的一种设备,内嵌于头戴式显示器支架5中。在本实施例中,眼动追踪子系统2可以通过近红外生成瞳孔所见的图像,再通过相机捕捉生成的图像。眼动追踪子系统2也可以通过辨认眼球的特征,如瞳孔外形、异色边缘虹膜、虹膜边界、近距指向光源的角膜反射来实现眼动跟踪。本发明实施例中的眼动追踪子系统2,由于内嵌在头戴式显示器支架5中,其始终和被测者头部同步运动,解决了现有的眼动追踪装置位置固定,一旦被测者头部大幅度运动,则眼动追踪装置在被测者眼部的焦点会失焦的问题。The
进一步地,在上述实施例的基础上,显示器模块12的两块屏幕,模拟人眼对现实景物的观察角度,分别向被测者双眼投射同景不同角度的影像。Further, on the basis of the above-mentioned embodiment, the two screens of the
进一步地,在上述实施例的基础上,参照图4所示,透镜模块11在头戴式显示器支架5中左右各设有一片,每片透镜模块11均设有圆形棱镜阵列。Further, on the basis of the above-mentioned embodiment, as shown in FIG. 4, the
具体的,圆形棱镜阵列能够使透镜模块11具有与大块曲面透镜相同的效果,是来自显示器模块12的光线散射在人眼中,使双屏显示器呈现的视觉刺激材料占据被测者整个视野。圆形棱镜阵列的位置可以根据用户的实际情况(如近视、远视、眼距的宽窄等)做微调。Specifically, the circular prism array can enable the
进一步地,在上述实施例的基础上,参照图1、图4所示,基于虚拟现实技术的视网膜检测系统还包括:头动跟踪子系统3,头动跟踪子系统3亦内置于头戴式显示器支架5中,用于检测被测者的头部动作信息;分析评价子系统4,分析评价子系统4用于从眼动追踪子系统2与头动跟踪子系统3收集注视点信息与头部动作信息,并根据收集到的注视点信息与头部动作信息得到被测者的视觉注意模式与头部运动模式,从而判断视网膜健康状态的检测结果。Further, on the basis of the above-mentioned embodiment, referring to Figures 1 and 4, the retinal detection system based on virtual reality technology further includes: a
进一步地,在上述实施例的基础上,如图2所示,头动跟踪子系统3包括:加速计模块31,加速计模块31用于重力监测,从而判断头戴式显示器支架5是否正立;加速计模块31,还用于检测被测者头部在各轴上的加速度;陀螺仪模块32,陀螺仪模块32用于跟踪被测者头部的旋转角速度及角度变化。Further, on the basis of the foregoing embodiment, as shown in FIG. 2, the head
具体的,在本实施例中,加速计模块31利用传感装置的惯性力测量其在x、 y、z三轴上的加速方向和速度大小。在其他实施例中,x、y二轴加速度测量传感器也可以使用,其中x轴加速度为0g,y轴加速度为1g。Specifically, in this embodiment, the
陀螺仪模块32,跟踪头戴式显示器支架5沿着x、y、z三轴的旋转角速度或角度变化,来为分析评价子系统4提供更精确的物体旋转信息。该模块可以通过测量三维坐标系内陀螺转子的垂直轴与设备之间的夹角计算角速度,通过夹角和角速度来判别被测者头部在三维空间的运动状态。The
进一步地,在上述实施例的基础上,如图3所示,分析评价子系统4包括:视觉注意点跟踪模块42,视觉注意点跟踪模块42根据注视点信息,基于视觉注意模式得出被测者的视觉注意模式;头部运动补偿模块41,头部运动补偿模块41根据头部动作信息,基于头部跟踪算法得出被测者的头部运动模式;视网膜检测评价模块43,视网膜检测评价模块43根据被测者的视觉注意点和头部运动补偿。在动态子午线测试中基于显示器模块对12个方向上的受测试者视野边界的测量,评估可能视力受损的区域,增加5°间隔的更细致子午线不同颜色光点63扫描,从而精确测量受测试者的视网膜可视区域和不可视区域的范围,包括可视区域的感光敏感度和对不同颜色的敏感度,输出被测者的视网膜健康状态检测结果;在静态光点测试中,整个视野区域被X轴72,Y轴73分为四个象限74,显示模块将逐个随机显示呈矩阵排列的光斑75,被测试者对于光斑做出看到或者无法看到的反应,系统会根据测试者的反应绘制测试者的视野图;在动态与静态结合的测试中,动态测试画出的视野盲区的初略图,图7。系统会显示静态光斑用于精确测量视觉盲区,光斑随机逐个闪烁,但系统会在动态勾勒图中的不敏感区域分配更多的光点,视觉健康区域也会分配若干亮点,但不会重点测量如图8。测试中眼动和头动检测也会起到作用,保证测试准确。在静态测试后,系统会结合头动和眼动跟踪产生最终结果,结果将图将与传统机械静态测量类似。Further, on the basis of the foregoing embodiment, as shown in FIG. 3, the analysis and
具体地,头部运动补偿模块41,基于头部跟踪算法,利用头部运动随时间变化的速度、位置和方向信息,得出被测者头部运动模式。在本实施例中,该模块的输入信息来源于加速计模块31和陀螺仪模块32测量得到的头戴式显示器在多轴上的加速度方向、加速度大小以及沿着x、y、z三轴的旋转角速度及角度变化。头动运动补偿模块的信号输入还可以来源于布置于基于虚拟现实中视觉注意模式和头部运动模式的视网膜检测系统所处环境的红外检测组件测量得到的头戴式显示器的位移和旋转角度。Specifically, the head
视觉注意点跟踪模块42,利用眼动追踪子系统2得到的被测者注视点和扫视过程的位置和时间分布,基于视觉注意模式得到被测者的关注点和不关注区域信息,提取其视觉注意模式。The visual attention
视网膜检测评价模块43,利用头部运动补偿41和视觉注意点跟踪42得到的视觉注意模式和头部运动模式在同一时间线上的特征和对应关系,将这些特征和关系通过视网膜健康状态检测评价算法与视网膜缺损个体和标准发育个体特征进行比较,来评价被测者视网膜健康状态,并输出显示视网膜健康状态检测结果。该模块可以但不限于运行在个人计算机或服务器上。检测结果可以但不限于个人计算机的显示屏或额外的LED显示屏等多种显示装置。The retinal detection and
进一步地,在上述实施例的基础上,头部动作信息包括:被测者的头动速度信息、位移信息和旋转方向信息。Further, on the basis of the foregoing embodiment, the head movement information includes: head movement speed information, displacement information, and rotation direction information of the subject.
本发明上述实施例提供的一种基于虚拟现实技术的视网膜检测系统,检测视网膜各处的生理健康状态,包括成像范围、感光度、色觉等指标,由显示子系统,头动/眼动追踪子系统,分析评价子系统和控制器子系统组成,其中显示子系统和头动/眼动追踪子系统内置于头戴式显示器中,分析评价子系统在头戴式显示器所连接的电脑中运行,控制器子系统的客户端由受测试者手动控制,通过蓝牙与电脑无线连接。显示子系统包括:显示器模块,显示器模块为具有足够像素密度和刷新速率的内嵌式双屏显示器,用于向被测者两眼显示具有景深的立体影像;透镜模块,透镜模块位于被测者眼睛和显示器模块间,用于将显示器模块投射出的光线放大映射到被测者眼中,使显示器模块显示的立体影像占据被测者的全部视野。头动跟踪子系统:用于检测头部运动,消除头部运动对视觉检测的影响。眼动追踪子系统:用于检测眼球运动与被测者的注视点信息。本发明通过消除视野边框和增强景深,增大了的视网膜检测范围和精度,且眼动追踪子系统始终与头部同步运动,确保在眼睛运动时精确定位视网膜的检测位置。分析评价子系统:用于集成和处理各传感器信息和控制器输入信息,输出受测试者的视网膜生理健康状态。控制子系统:受测试者根据视觉效果选择性输入,用于反映受测试者的视网膜不同位置的生理状态。The above embodiment of the present invention provides a retina detection system based on virtual reality technology, which detects the physiological health status of various parts of the retina, including imaging range, sensitivity, color vision and other indicators. The display subsystem, head movement/eye movement tracking sub-system The system consists of analysis and evaluation subsystems and controller subsystems. The display subsystem and head movement/eye tracking subsystem are built in the head-mounted display, and the analysis and evaluation subsystem runs on the computer connected to the head-mounted display. The client of the controller subsystem is manually controlled by the tester, and is wirelessly connected to the computer via Bluetooth. The display subsystem includes: a display module, which is an embedded dual-screen display with sufficient pixel density and refresh rate, used to display stereo images with depth of field to the subject’s eyes; lens module, the lens module is located on the subject Between the eye and the display module, it is used to magnify and map the light projected by the display module to the eyes of the subject, so that the three-dimensional image displayed by the display module occupies the entire field of view of the subject. Head movement tracking subsystem: used to detect head movement and eliminate the influence of head movement on visual inspection. Eye tracking subsystem: used to detect eye movement and gaze point information of the subject. The invention increases the detection range and accuracy of the retina by eliminating the visual field frame and enhancing the depth of field, and the eye tracking subsystem always moves in synchronization with the head, ensuring precise positioning of the detection position of the retina when the eyes are moving. Analysis and evaluation subsystem: used to integrate and process various sensor information and controller input information, and output the physiological health status of the subject's retina. Control subsystem: the subject selects input according to the visual effect, which is used to reflect the physiological state of the subject's retina at different positions.
以上对本发明的具体实施例进行了描述。需要理解的是,本发明并不局限于上述特定实施方式,本领域技术人员可以在权利要求的范围内做出各种变形或修改,这并不影响本发明的实质内容。The specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various deformations or modifications within the scope of the claims, which does not affect the essence of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910840530.X | 2019-09-06 | ||
| CN201910840530.XACN110537895A (en) | 2019-09-06 | 2019-09-06 | Retina detecting system based on virtual reality technology |
| Publication Number | Publication Date |
|---|---|
| WO2021042504A1true WO2021042504A1 (en) | 2021-03-11 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/116196CeasedWO2021042504A1 (en) | 2019-09-06 | 2019-11-07 | Virtual reality technology-based retina detection system |
| Country | Link |
|---|---|
| CN (1) | CN110537895A (en) |
| WO (1) | WO2021042504A1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110812146B (en)* | 2019-11-20 | 2022-02-22 | 精准视光(北京)医疗技术有限公司 | Multi-region visual function adjusting method and device and virtual reality head-mounted display equipment |
| CN111134693B (en)* | 2019-12-09 | 2021-08-31 | 上海交通大学 | Auxiliary detection method, system and terminal for children with autism based on virtual reality technology |
| CN112754421B (en)* | 2021-01-19 | 2024-09-24 | 上海佰翊医疗科技有限公司 | A device for measuring protrusion of eyeballs |
| CA3205671A1 (en) | 2021-02-22 | 2022-08-25 | Niccolo Maschio | Tracking of retinal traction through digital image correlation |
| CN113647900A (en)* | 2021-06-28 | 2021-11-16 | 中山大学中山眼科中心 | Self-service visual field detection method based on personal terminal |
| CN115644791A (en)* | 2022-11-10 | 2023-01-31 | 吉林大学 | Double-vision detection system based on virtual reality technology and use method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3914090B2 (en)* | 2002-05-07 | 2007-05-16 | 株式会社ニューオプト | Eye movement analysis system and eye imaging device |
| CN106037626A (en)* | 2016-07-12 | 2016-10-26 | 吴越 | Head-mounted visual field inspector |
| CN107169309A (en)* | 2017-07-26 | 2017-09-15 | 北京为凡医疗信息技术有限公司 | Visual field detection method, system and detection means based on wear-type detection device |
| US20180008141A1 (en)* | 2014-07-08 | 2018-01-11 | Krueger Wesley W O | Systems and methods for using virtual reality, augmented reality, and/or a synthetic 3-dimensional information for the measurement of human ocular performance |
| CN108209857A (en)* | 2013-09-03 | 2018-06-29 | 托比股份公司 | Portable eyes tracing equipment |
| WO2018163166A2 (en)* | 2017-03-05 | 2018-09-13 | Virtuoptica Ltd. | Eye examination method and apparatus therefor |
| CN109645955A (en)* | 2019-01-31 | 2019-04-19 | 北京大学第三医院(北京大学第三临床医学院) | Multifunctional visual function detection device and method based on VR and eye tracking |
| CN109758107A (en)* | 2019-02-14 | 2019-05-17 | 郑州诚优成电子科技有限公司 | A VR visual function inspection device |
| CN109846456A (en)* | 2019-03-06 | 2019-06-07 | 西安爱特眼动信息科技有限公司 | A visual field inspection device based on a head-mounted display device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102265310A (en)* | 2008-10-28 | 2011-11-30 | 俄勒冈健康科学大学 | Method and device for visual field monitoring |
| CN109310315B (en)* | 2016-06-09 | 2022-02-22 | Qd激光公司 | Visual field visual acuity test system, visual field visual acuity test device, visual field visual acuity test method, storage medium, and server device |
| CN208319187U (en)* | 2017-09-06 | 2019-01-04 | 福州东南眼科医院(金山新院)有限公司 | A kind of ophthalmic computer visual field meter |
| CN109717828A (en)* | 2018-10-24 | 2019-05-07 | 中国医学科学院生物医学工程研究所 | A kind of perimetry devices and detection method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3914090B2 (en)* | 2002-05-07 | 2007-05-16 | 株式会社ニューオプト | Eye movement analysis system and eye imaging device |
| CN108209857A (en)* | 2013-09-03 | 2018-06-29 | 托比股份公司 | Portable eyes tracing equipment |
| US20180008141A1 (en)* | 2014-07-08 | 2018-01-11 | Krueger Wesley W O | Systems and methods for using virtual reality, augmented reality, and/or a synthetic 3-dimensional information for the measurement of human ocular performance |
| CN106037626A (en)* | 2016-07-12 | 2016-10-26 | 吴越 | Head-mounted visual field inspector |
| WO2018163166A2 (en)* | 2017-03-05 | 2018-09-13 | Virtuoptica Ltd. | Eye examination method and apparatus therefor |
| CN107169309A (en)* | 2017-07-26 | 2017-09-15 | 北京为凡医疗信息技术有限公司 | Visual field detection method, system and detection means based on wear-type detection device |
| CN109645955A (en)* | 2019-01-31 | 2019-04-19 | 北京大学第三医院(北京大学第三临床医学院) | Multifunctional visual function detection device and method based on VR and eye tracking |
| CN109758107A (en)* | 2019-02-14 | 2019-05-17 | 郑州诚优成电子科技有限公司 | A VR visual function inspection device |
| CN109846456A (en)* | 2019-03-06 | 2019-06-07 | 西安爱特眼动信息科技有限公司 | A visual field inspection device based on a head-mounted display device |
| Publication number | Publication date |
|---|---|
| CN110537895A (en) | 2019-12-06 |
| Publication | Publication Date | Title |
|---|---|---|
| WO2021042504A1 (en) | Virtual reality technology-based retina detection system | |
| US10610093B2 (en) | Method and system for automatic eyesight diagnosis | |
| CN113208884B (en) | Visual detection and visual training equipment | |
| US6659611B2 (en) | System and method for eye gaze tracking using corneal image mapping | |
| EP2467053B1 (en) | Apparatus and method for automatically determining a strabismus angle | |
| JP2010526623A (en) | Visual field inspection system, visual field inspection method, computer program, computer product, and processor | |
| CN106821301B (en) | A kind of computer based eye movement distance and movements binocular consistency error measuring means and method | |
| CN110881981A (en) | Alzheimer's disease auxiliary detection system based on virtual reality technology | |
| CN113080836A (en) | Non-center gazing visual detection and visual training equipment | |
| CN115590462A (en) | Vision detection method and device based on camera | |
| Nagamatsu et al. | Calibration-free gaze tracking using a binocular 3D eye model | |
| CN111528786A (en) | System and method for detecting head position of strabismus compensation | |
| CN111134693B (en) | Auxiliary detection method, system and terminal for children with autism based on virtual reality technology | |
| JP6747172B2 (en) | Diagnosis support device, diagnosis support method, and computer program | |
| Lin | An eye behavior measuring device for VR system | |
| CN106725280A (en) | A kind of slant visibility measurement apparatus | |
| CN108742510B (en) | Oblique vision and horizontal torsion angle detector suitable for children with low age | |
| JP6496917B2 (en) | Gaze measurement apparatus and gaze measurement method | |
| MP et al. | Method for increasing the accuracy of tracking the center of attention of the gaze | |
| NL2036527B1 (en) | Method and system for measuring of visual functions and/or behavior and/or neurological functions | |
| JP7548637B2 (en) | Systems and methods for quantifying ocular dominance | |
| Shin et al. | A novel computerized visual acuity test for children | |
| CN116413049A (en) | A driver's head movement simulation device | |
| CN113080844A (en) | Visual detection and visual training device for optimizing retina area | |
| UA139464U (en) | METHOD OF DIAGNOSIS OF THE STATE OF THE OCULOMOTOR SYSTEM OF THE EYE |
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | Ref document number:19944213 Country of ref document:EP Kind code of ref document:A1 | |
| NENP | Non-entry into the national phase | Ref country code:DE | |
| 122 | Ep: pct application non-entry in european phase | Ref document number:19944213 Country of ref document:EP Kind code of ref document:A1 | |
| 122 | Ep: pct application non-entry in european phase | Ref document number:19944213 Country of ref document:EP Kind code of ref document:A1 |