Movatterモバイル変換


[0]ホーム

URL:


WO2021042504A1 - Virtual reality technology-based retina detection system - Google Patents

Virtual reality technology-based retina detection system
Download PDF

Info

Publication number
WO2021042504A1
WO2021042504A1PCT/CN2019/116196CN2019116196WWO2021042504A1WO 2021042504 A1WO2021042504 A1WO 2021042504A1CN 2019116196 WCN2019116196 WCN 2019116196WWO 2021042504 A1WO2021042504 A1WO 2021042504A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
field
head
module
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/116196
Other languages
French (fr)
Chinese (zh)
Inventor
杨容
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IndividualfiledCriticalIndividual
Publication of WO2021042504A1publicationCriticalpatent/WO2021042504A1/en
Anticipated expirationlegal-statusCritical
Ceasedlegal-statusCriticalCurrent

Links

Images

Classifications

Definitions

Landscapes

Abstract

A virtual reality technology-based retina detection system, comprising: a display module (12), which is used for displaying a three-dimensional image (a light spot) having depth of field to a detected person; a lens module (11), which is located between the eyes of the detected person and the display module (12) and is used for amplifying the light spot projected by the display module (12) and mapping same into the eyes of the detected person such that the three-dimensional image displayed by the display module (12) occupies the entire visual field of the detected person; a controller subsystem (10), which is used for controlling the acquisition of the visual field boundary of the detected person and test light spot information; a head movement tracking subsystem (3), which is used for detecting head movement information and eliminating the influence of head movement on visual detection; and an eye movement tracking subsystem (2), which is used for detecting focal point information of the detected person. Thus, a health state detection result of each region of the retina of the detected person may be objectively and accurately tracked and evaluated, characteristics may be quantified, and the system is accurate and efficient.

Description

Translated fromChinese
一种基于虚拟现实技术的视网膜检测系统A retina detection system based on virtual reality technology技术领域Technical field

本发明涉及视网膜检测技术领域,具体地,涉及一种视网膜检测系统,尤其是一种基于虚拟现实技术的视网膜检测系统,能够提供多种人机交互式的多种基于虚拟现实技术的视野范围检测。The present invention relates to the technical field of retina detection, in particular to a retina detection system, in particular a retina detection system based on virtual reality technology, which can provide multiple human-machine interactive and multiple virtual reality technology-based field of view detections .

背景技术Background technique

视网膜健康状态与人的视觉健康情况直接相关,许多视觉疾病表现为视网膜的损坏或功能衰退。包括但不限于:黄斑变性、青光眼、视网膜脱落、色盲与色弱,严重影响职业与生活功能。视网膜损坏或功能衰退的病因及发病机制多种多样,多数都存在病情逐渐恶化,初期不易察觉,视网膜病变发病机制多样,多数无法找到成因,这些疾病的基本特点是初期不易察觉,一旦发现已经病情严重无法逆转或控制。The health of the retina is directly related to the health of people's vision. Many visual diseases are manifested as damage or functional decline of the retina. Including but not limited to: macular degeneration, glaucoma, retinal detachment, color blindness and color weakness, which seriously affect occupation and life functions. The etiology and pathogenesis of retinal damage or functional decline are diverse. Most of them have gradual deterioration and are not easy to detect at the initial stage. The pathogenesis of retinopathy is diverse, and most of them cannot find the cause. The basic feature of these diseases is that they are not easy to detect at the initial stage. Seriously irreversible or controllable.

视网膜相关疾病的诊断和治疗遵循越早越好的原则,及时而有效的早期诊断和定期复诊有助于改善病情,提高生活质量。但是,现有的视网膜健康状态检测手段是陈旧的机械式眼底扫描,过程繁琐,精度不佳,要求被测者保持眼球不动,并依赖于经验丰富的医师的个人技术,需要投入大量的人力、物力和财力,这对拥有视网膜健康问题的家庭和社会医疗资源都是极大的挑战。因此,目前亟需提供成本低、效率高、可客观量化的视野测量辅助手段。为了减少对医师的依赖,提倡采用更客观的量化指标来辅助检测视网膜健康状态,更加及时准确的发现视网膜病变。The diagnosis and treatment of retinal-related diseases follow the principle that the sooner the better, and timely and effective early diagnosis and regular follow-up diagnosis can help improve the condition and improve the quality of life. However, the existing retinal health detection method is an old mechanical fundus scanning, which is cumbersome and poor in accuracy. It requires the subject to keep the eyeballs still, and relies on the personal skills of experienced physicians, requiring a lot of manpower. , Material and financial resources, this is a great challenge for families with retinal health problems and social medical resources. Therefore, there is an urgent need to provide low-cost, high-efficiency, and objectively quantifiable auxiliary methods for visual field measurement. In order to reduce dependence on physicians, it is advocated to use more objective quantitative indicators to assist in the detection of retinal health, and to detect retinopathy in a more timely and accurate manner.

相当比例的视网膜健康状态测试者,比如低龄儿童和老年人,很难听从指令持续专注的注视固定平面显示器或球面视网膜检测仪,并针对变化快速反应,这将导致其注视点分布可能超过视觉刺激材料的限定范围,传感器采集到的数据失效。所以,通过普通的固定平面和球面视觉刺激材料采集到的视网膜健康状态信息无法排除显示设备之外的人为和环境干扰。A considerable proportion of retinal health testers, such as young children and the elderly, find it difficult to follow instructions and continue to focus on fixed flat-panel displays or spherical retinal detectors, and respond quickly to changes, which may cause their fixation points to exceed visual stimuli. In the limited range of materials, the data collected by the sensor is invalid. Therefore, the retinal health status information collected through ordinary fixed plane and spherical visual stimulus materials cannot exclude human and environmental interference outside the display device.

同时,普通的平面眼动追踪传感器需要校准使用者的视线焦点,范围较大的头部运动会影响校准结果和实际测试过程中的注视点位置的匹配准确率,两种指标相互影响,会降低采集到的注视点数据的质量。At the same time, ordinary planar eye tracking sensors need to calibrate the user’s gaze focus. A large range of head movement will affect the matching accuracy of the calibration result and the gaze position during the actual test. The two indicators affect each other and reduce the collection. The quality of the gaze point data reached.

目前没有发现同本发明类似技术的说明或报道,也尚未收集到国内外类似的资料。At present, no description or report of similar technology to the present invention has been found, and similar data at home and abroad have not been collected.

发明内容Summary of the invention

针对现有技术中存在的上述不足,本发明的目的是提供一种基于虚拟现实技术的视网膜检测系统。In view of the above-mentioned shortcomings in the prior art, the purpose of the present invention is to provide a retina detection system based on virtual reality technology.

本发明是通过以下技术方案实现的。The present invention is achieved through the following technical solutions.

一种基于虚拟现实技术的视网膜检测系统,包括:显示子系统、头动追踪子系统、眼动追踪子系统、控制器子系统以及头戴式显示器支架,所述显示子系统、头动追踪子系统和眼动追踪子系统内置于所述头戴式显示器支架中;其中:A retinal detection system based on virtual reality technology includes: a display subsystem, a head movement tracking subsystem, an eye tracking subsystem, a controller subsystem, and a head-mounted display bracket. The display subsystem, the head movement tracking sub-system The system and the eye tracking subsystem are built in the head-mounted display bracket; wherein:

所述显示子系统,用于向被测者显示无视野边界的立体影像,包括:The display subsystem is used to display a three-dimensional image without boundary of the field of view to the subject, including:

-显示器模块,所述显示器模块用于向被测者显示具有景深的立体影像;-A display module, which is used to display a stereoscopic image with depth of field to the subject;

-透镜模块,所述透镜模块位于被测者的眼睛和所述显示器模块之间,用于将所述显示器模块投射出的光线放大映射到被测者的眼中,使所述显示器模块显示的立体影像占据被测者的全部视野;-A lens module, the lens module is located between the eyes of the subject and the display module, and is used to magnify and map the light projected by the display module to the eyes of the subject, so that the display module can display three-dimensional The image occupies the entire field of view of the subject;

所述控制器子系统,用于控制得到被测者的视野边界以及测试光点信息;The controller subsystem is used to control and obtain the visual field boundary of the subject and the test light spot information;

所述头动跟踪子系统,用于检测头部运动信息,消除头部运动对视觉检测的影响;The head movement tracking subsystem is used to detect head movement information and eliminate the influence of head movement on visual detection;

所述眼动追踪子系统,用于检测被测者的注视点信息。The eye tracking subsystem is used to detect the gaze point information of the subject.

优选地,所述显示器模块采用内嵌式双屏显示器,所述内嵌式双屏显示器的两块屏幕模拟人眼对现实景物的观察角度,以人的每只眼睛的视野范围建立球面坐标,球面顶点是人眼的视野中心;所述显示器模块包括初步测量模式和精确测量模式,其中:Preferably, the display module adopts a built-in dual-screen display, the two screens of the built-in dual-screen display simulate the viewing angle of the human eye to the real scene, and the spherical coordinates are established based on the field of view of each human eye, The apex of the spherical surface is the center of the human eye's field of view; the display module includes a preliminary measurement mode and an accurate measurement mode, among which:

所述初步测量模式为:极轴通过顶点形成0°子午线,在视野范围内从0°子午线开始逆时针每N°间隔增加一条经过球面顶点的子午线,多条子午线将视野划分为多个区域,显示器模块在黑暗背景下,从0°子午线开始逆时针依次沿各条子午线的球面顶点向视野边缘移动并向被测者双眼投射光点,当被测者发现光点消失时 启动控制器子系统的客户端,记录该视野区域方向上的视野边界;所述控制器子系统的服务端还用于控制内嵌式双屏显示器增加M°间隔的子午线不同光亮及颜色光点扫描,得到被测者的测试光点信息,进而初步勾勒出被测试者视觉不敏感的区域;其中M°小于N°。The preliminary measurement mode is: the polar axis passes through the apex to form a 0° meridian, and a meridian passing through the apex of the sphere is added counterclockwise from the 0° meridian in the field of view every N° interval, and multiple meridians divide the field of view into multiple regions, On a dark background, the display module moves counterclockwise from the 0° meridian to the edge of the field of view along the sphere vertices of each meridian, and projects light spots to the eyes of the subject. When the subject finds the light spots disappear, the controller subsystem is activated. The client side of the field of view records the boundary of the field of view in the direction of the field of view; the server side of the controller subsystem is also used to control the embedded dual-screen display to increase the meridian different brightness and color spot scanning at the interval of M° to obtain the measured The test light spot information of the subject, and then preliminarily outlines the visually insensitive area of the subject; where M° is less than N°.

所述精确测量模式为:以视野中心为原点,建立水平和垂直坐标线,所述水平和垂直坐标线将视野范围分为四个象限区域;其中每个象限区域内平均分布若干个能够随机点亮的光点,被测者根据视野范围内是否观测到点亮的光点而对应做出选择,进而精确测量出被测试者的视觉不敏感区。The precise measurement mode is: taking the center of the field of view as the origin to establish horizontal and vertical coordinate lines, the horizontal and vertical coordinate lines divide the field of view into four quadrant areas; wherein a number of random points are evenly distributed in each quadrant area For the bright light spot, the subject makes a corresponding choice according to whether the light spot is observed in the field of view, and then accurately measures the visual insensitive area of the subject.

优选地,所述精确测量模式在初步测量模式的基础之上执行。Preferably, the precise measurement mode is executed on the basis of the preliminary measurement mode.

优选地,所述N°采用30°,相应地,所述视野将划分为12个区域;所述M°采用5°。Preferably, the N° adopts 30°, and accordingly, the field of view will be divided into 12 regions; the M° adopts 5°.

优选地,所述光点亮度及颜色可调节。Preferably, the brightness and color of the light spots are adjustable.

在完成动态视网膜测试后,根据动态视野范围测量的结果勾勒出被测者视野中对光敏感较弱的区域。After the dynamic retina test is completed, the areas of the subject’s visual field that are less sensitive to light are outlined based on the results of the dynamic visual field range measurement.

在勾勒出被测者视野范围弱的区域后,系统将使用静态视场测试将视觉敏感度较弱区域重点测量,视场中敏感较强区域将会被进行粗略测量,如图8所示。静态视场测量使用呈矩阵排列的光斑逐个闪烁,矩阵分为四个象限,每个象限区域内预先分布多个光点,光点数量和设定位置不影响本专利权利要求。被测者对光斑的闪烁作出反应。如此测试产生结果更加具体,但测试时间长且测试过程使人不适,选择敏感度弱的区域重点测量将缩短测试时间,但保持测试精度。After delineating the areas where the subject’s field of view is weak, the system will use the static field of view test to focus on the areas with weaker visual sensitivity, and the more sensitive areas in the field of view will be roughly measured, as shown in Figure 8. The static field of view measurement uses light spots arranged in a matrix to blink one by one. The matrix is divided into four quadrants. A plurality of light spots are pre-distributed in each quadrant area. The number of light spots and setting positions do not affect the claims of this patent. The subject responds to the flickering of the light spot. Such a test produces more specific results, but the test time is long and the test process is uncomfortable. Choosing an area with weak sensitivity to focus on measurement will shorten the test time, but maintain the test accuracy.

优选地,所述透镜模块包括两片透镜,分别与内嵌式双屏显示器的两块屏幕相对应,其中每一片透镜均设有圆形棱镜阵列。Preferably, the lens module includes two lenses, respectively corresponding to the two screens of the in-cell dual-screen display, and each lens is provided with a circular prism array.

优选地,所述头动跟踪子系统包括:Preferably, the head movement tracking subsystem includes:

加速计模块,所述加速计模块用于重力监测,从而判断所述头戴式显示器支架是否正立,同时检测被测者头部在各轴上的加速度;An accelerometer module, the accelerometer module is used for gravity monitoring, so as to determine whether the head-mounted display bracket is upright, and at the same time detect the acceleration of the subject's head on each axis;

陀螺仪模块,所述陀螺仪模块用于跟踪被测者头部的旋转角速度及角度变化。The gyroscope module is used to track the rotation angular velocity and angle change of the subject's head.

优选地,所述视网膜检测系统,还包括分析评价子系统;Preferably, the retina detection system further includes an analysis and evaluation subsystem;

所述分析评价子系统,包括:The analysis and evaluation subsystem includes:

-头部运动补偿模块,根据头部运动信息,得到被测者头部运动模式;-The head motion compensation module, based on the head motion information, obtains the head motion mode of the subject;

-视觉注意点跟踪模块,所述视觉注意点追踪模块根据注视点信息,通过补偿 眼部运动持续追踪视网膜特定区域,提取其视觉注意模式;-A visual attention point tracking module, the visual attention point tracking module continuously tracks a specific area of the retina by compensating for eye movement according to the point of gaze information, and extracts its visual attention mode;

-视网膜检测评价模块,所述视网膜检测评价模块,通过头部运动模式和视觉注意模式,准确定位视网膜的检测位置,-Retina detection and evaluation module, the retina detection and evaluation module accurately locates the detection position of the retina through head movement patterns and visual attention patterns,

吗基于对被测者的视野边界的测量,评估视力受损的可能视野区域,同时根据测试光点信息,得到被测者在不同视野区域的感光敏感度和颜色敏感度,测量受测试者的视网膜可视区域和不可视区域的范围,输出被测者的视网膜健康状态检测结果。Based on the measurement of the visual field boundary of the subject, the possible visual field area with impaired vision is evaluated. At the same time, the light sensitivity and color sensitivity of the subject in different visual field areas are obtained according to the test light spot information, and the subject’s visual sensitivity is measured. The range of the visible and invisible areas of the retina output the test result of the health status of the retina of the subject.

优选地,所述注视点信息包括:被测者在立体影像上的注视位置信息、注视顺序信息和注视时长信息。Preferably, the gaze point information includes: gaze position information, gaze sequence information, and gaze duration information of the subject on the stereoscopic image.

优选地,所述头部运动信息包括:被测者的头动速度信息、位移信息和旋转方向信息。Preferably, the head movement information includes: head movement speed information, displacement information and rotation direction information of the subject.

优选地,所述测试光点信息包括:被测者在球坐标空间中看到的光点的位置、光点的亮度以及光点的颜色。Preferably, the test light spot information includes: the position of the light spot, the brightness of the light spot, and the color of the light spot seen by the subject in the spherical coordinate space.

本发明提供的基于虚拟现实技术的视网膜检测系统,是一种基于虚拟现实技术,采用动态子午线光点与静态矩阵光点相结合的方法,提供多种视野检测模式的系统,可用于测试无视野边界的立体影像。该系统中:显示器模块用于向被测者显示具有景深的立体影像(光点);透镜模块位于被测者的眼睛和显示器模块之间,用于将显示器模块投射出的光点放大映射到被测者的眼中,使显示器模块显示的立体影像占据被测者的全部视野;控制器子系统,用于控制得到被测者的视野边界以及测试光点信息;头动跟踪子系统,用于检测头部运动信息,消除头部运动对视觉检测的影响;眼动追踪子系统,用于检测被测者的注视点信息。本发明能够客观准确的跟踪并评估被测者的视网膜各个区域的健康状态检测结果,能够量化特征,准确高效。The retinal detection system based on virtual reality technology provided by the present invention is a system based on virtual reality technology that combines dynamic meridian light spots and static matrix light spots to provide multiple visual field detection modes, which can be used to test no visual field Three-dimensional image of the boundary. In this system: the display module is used to display a three-dimensional image (light spot) with depth of field to the subject; the lens module is located between the subject’s eyes and the display module, and is used to magnify and map the light spot projected by the display module to In the eyes of the subject, the stereoscopic image displayed by the display module occupies the entire field of view of the subject; the controller subsystem is used to control the boundary of the subject’s field of view and the test light point information; the head movement tracking subsystem is used to Detect head movement information to eliminate the influence of head movement on visual detection; eye tracking subsystem is used to detect the gaze point information of the subject. The invention can objectively and accurately track and evaluate the health status detection result of each area of the retina of the subject, can quantify features, and is accurate and efficient.

与现有技术相比,本发明具有如下有益效果:Compared with the prior art, the present invention has the following beneficial effects:

1、本发明提出的一种基于虚拟现实技术的视网膜检测系统,采用头戴式显示器支架,其中的显示子系统的显示模块生成的立体影像,测试过程比传统视场检测方式舒适且价格适中,有利于减轻不适感对测试准确性的影响,提高了视网膜健康状态检查的配合度;另一方面也使得虚拟现实环境中的视觉刺激材料的比平面刺激材料更立体、更具有景深,能模拟人所接触到的实际场景视觉范围,有助于提升采集数据有效性。1. A retinal detection system based on virtual reality technology proposed by the present invention adopts a head-mounted display bracket, in which the three-dimensional image generated by the display module of the display subsystem, the test process is more comfortable and affordable than the traditional field of view detection method. It is helpful to reduce the impact of discomfort on the test accuracy and improve the coordination of the retinal health check; on the other hand, it also makes the visual stimulus material in the virtual reality environment more three-dimensional and more depth of field than the plane stimulus material, and can simulate people The visual range of the actual scene that is touched helps to improve the effectiveness of the collected data.

2、本发明提出的一种基于虚拟现实技术的视网膜检测系统,由于眼动追踪子系统内嵌于头戴式显示器支架内部,眼动追踪子系统与被测者眼睛无相对位移,因此该眼动追踪子系统可以实现头部运动同步跟随,不会由于头部大幅动作而对被测者双眼失焦。2. The present invention proposes a retinal detection system based on virtual reality technology. Since the eye tracking subsystem is embedded in the head-mounted display bracket, there is no relative displacement between the eye tracking subsystem and the subject’s eyes. The dynamic tracking subsystem can realize the synchronous follow-up of the head movement, and will not lose focus on the subject's eyes due to the large movement of the head.

3、本发明提出的一种基于虚拟现实技术的视网膜检测系统,头动跟踪子系统内嵌于头戴式显示器支架中,能够无相对位移的跟随头动,提高了头动检测的准确性。3. In a retinal detection system based on virtual reality technology proposed by the present invention, the head movement tracking subsystem is embedded in the head-mounted display bracket, which can follow the head movement without relative displacement, thereby improving the accuracy of head movement detection.

4、本发明提出的一种基于虚拟现实技术的视网膜检测系统,根据视觉的注意点信息和头部运动信息两项指标,客观准确的跟踪并评估被测者的视网膜各个区域的健康状态检测结果,能够量化特征,准确高效。4. A retinal detection system based on virtual reality technology proposed by the present invention can objectively and accurately track and evaluate the health status detection results of each region of the subject’s retina according to two indicators of visual attention point information and head movement information , Can quantify features, accurately and efficiently.

5.本发明结合动态和静态的视场测量方式,使测量时间缩短但保持静态测量的精度。5. The invention combines dynamic and static field-of-view measurement methods to shorten the measurement time but maintain the accuracy of static measurement.

附图说明Description of the drawings

通过阅读参照以下附图对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:By reading the detailed description of the non-limiting embodiments with reference to the following drawings, other features, purposes and advantages of the present invention will become more apparent:

图1为本发明一实施例中基于虚拟现实技术的视网膜检测系统的结构框图;FIG. 1 is a structural block diagram of a retina detection system based on virtual reality technology in an embodiment of the present invention;

图2为本发明一实施例中头动跟踪子系统的结构框图;Fig. 2 is a structural block diagram of a head movement tracking subsystem in an embodiment of the present invention;

图3为本发明一实施例中分析评价子系统的结构框图;Figure 3 is a structural block diagram of an analysis and evaluation subsystem in an embodiment of the present invention;

图4为本发明一实施例中头戴式显示器的结构示意图;4 is a schematic diagram of the structure of a head-mounted display in an embodiment of the present invention;

图5为本发明一实施例中子午线动态方法测试的单眼视野范围影像图;FIG. 5 is an image diagram of a monocular field of view tested by a meridian dynamic method according to an embodiment of the present invention;

图6为本发明一实施例中矩阵静态方法测试的单眼视野范围影像图;FIG. 6 is an image diagram of a monocular field of view tested by a matrix static method in an embodiment of the present invention;

图7为本发明一实施例中子午线动态方法初筛勾勒的单眼视野范围影像图;FIG. 7 is an image diagram of the monocular field of view outlined by the initial screening of the meridian dynamic method according to an embodiment of the present invention; FIG.

图8为本发明一实施例中子午线动态初筛结合矩阵静态法描绘的精确单眼视野范围影像图;FIG. 8 is an image diagram of an accurate monocular field of view drawn by the dynamic preliminary screening of the meridian combined with the static matrix method in an embodiment of the present invention;

图中:In the picture:

1为显示子系统,11为透镜模块,12为显示器模块;1 is the display subsystem, 11 is the lens module, and 12 is the display module;

2为眼动追踪子系统;2 is the eye tracking subsystem;

3为头动跟踪子系统,31为加速计模块,32为陀螺仪模块;3 is the head movement tracking subsystem, 31 is the accelerometer module, and 32 is the gyroscope module;

4为分析评价子系统,41为头动跟踪模块,42为眼动跟踪模块,43为视网膜检测评价模块;4 is the analysis and evaluation subsystem, 41 is the head tracking module, 42 is the eye tracking module, and 43 is the retina detection and evaluation module;

5为头戴式显示器支架;5 is a head-mounted display stand;

61为视觉区域原点62为子午线,63为动态观光点,64为动态光点沿子午线运动的起始点,65为光点的运动方向,66为光点进入被测试者的视觉敏感区的边界点,也是光点在该子午线的运动终点;61 is the origin of the visual area 62 is the meridian, 63 is the dynamic sightseeing spot, 64 is the starting point of the dynamic light spot moving along the meridian, 65 is the movement direction of the light spot, and 66 is the boundary point where the light spot enters the subject's visual sensitive area , Is also the end point of the light point at the meridian;

71为视觉区域中心点即原点,72为划分视觉区域的X轴,73为划分视觉区域的Y轴,75为静态测试光点;71 is the center point or origin of the visual area, 72 is the X-axis that divides the visual area, 73 is the Y-axis that divides the visual area, and 75 is the static test spot;

81、82、83、84为光点进入被测者视觉区域的边界点,85为利用这些边界点所勾勒的被测者的视觉不敏感区域;81, 82, 83, 84 are the boundary points where the light point enters the subject's visual area, and 85 is the visually insensitive area of the subject outlined by these boundary points;

91为静态光点,92为动态子午线勾勒的视觉不敏感区域;91 is a static light spot, and 92 is a visually insensitive area outlined by a dynamic meridian;

10为控制子模块。10 is the control sub-module.

具体实施方式detailed description

下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明,但不以任何形式限制本发明。应当指出的是,对本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进。这些都属于本发明的保护范围。The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be pointed out that for those of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

本发明实施例提出了一种基于虚拟现实技术的视网膜检测系统,参照图1、图4和图5所示,包括:显示子系统1、眼动追踪子系统2、头动跟踪子系统3和头戴式显示器支架5,显示子系统1、眼动追踪子系统2和头动跟踪子系统均内置于头戴式显示器支架5中,显示子系统1,用于向被测者显示无视野边界的立体影像,其包括:显示器模块12,显示器模块12为具有足够像素密度和刷新速率的内嵌式双屏显示器,用于向被测者显示具有景深的立体影像;透镜模块11,透镜模块11位于被测者的眼睛和显示器模块12间,用于将显示器模块12投射出的光线放大映射到被测者的眼中,使显示器模块12显示的立体影像占据被测者的全部视野;眼动追踪子系统2,用于检测被测者的注视点信息;头动跟踪子系统3,用于检测头部运动信息,消除头部运动对视觉检测的影响。以每个眼的视野范围建立球面坐标,球面顶点61是人眼的视野中心,水平右向的子午线通过顶点,是0°子午线62,显示器模块12在在视野范围内从0°子午线62开始逆时针每N°(可以为30°)一条子午线经过顶点,将视野划分为多个区域(相应地形成12个区域),分别向被测者双眼投射黑暗背景下沿各个子午线依次从边缘向视野中心移动 的光点63,当被测者发现光点63消失时按下控制器子系统的客户端,记录该视野方向上的视野边界,光点63亮度及颜色可控。在动态测量后勾勒出视觉不敏感区域,利用静态测量将不敏感区域重点测量,视觉相对敏感区域将被粗略测量。测量结果将会根据眼动和头动跟踪数据而校准结果,最终测试结果类似静态视场测量结果。所述控制器子系统的服务端还用于控制内嵌式双屏显示器增加M°间隔的子午线不同光亮及颜色光点扫描,得到被测者的测试光点信息;其中M°小于N°。进一步地,M°可以采用5°。The embodiment of the present invention proposes a retina detection system based on virtual reality technology, as shown in FIG. 1, FIG. 4, and FIG. 5, including: a display subsystem 1, aneye tracking subsystem 2, ahead tracking subsystem 3, and The head-mounted display bracket 5, the display subsystem 1, theeye tracking subsystem 2 and the head-movement tracking subsystem are all built in the head-mounted display bracket 5. The display subsystem 1 is used to show the subject without the boundary of the field of view The three-dimensional image includes: adisplay module 12, which is an embedded dual-screen display with sufficient pixel density and refresh rate, used to display a three-dimensional image with depth of field to the subject;lens module 11,lens module 11 Located between the subject’s eyes and thedisplay module 12, it is used to magnify and map the light projected by thedisplay module 12 to the subject’s eyes, so that the three-dimensional image displayed by thedisplay module 12 occupies the subject’s entire field of view;eye tracking Subsystem 2 is used to detect the gaze point information of the subject; headmovement tracking subsystem 3 is used to detect head movement information and eliminate the influence of head movement on vision detection. The spherical coordinates are established based on the field of view of each eye. The apex 61 of the spherical surface is the center of the human eye. The horizontal right meridian passes through the apex, which is the 0° meridian 62. Thedisplay module 12 starts from the 0° meridian 62 in the field of view. When the hour hand passes through the apex every N°(may be 30°), the field of view is divided into multiple areas (12 areas are formed accordingly), and the dark background is projected to the subject’s eyes along each meridian from the edge to the center of the field of view. The moving light spot 63, when the subject finds that the light spot 63 disappears, presses the client of the controller subsystem to record the field of view boundary in the field of view direction, and the brightness and color of the light spot 63 are controllable. After the dynamic measurement, outline the visually insensitive area, use the static measurement to focus on the insensitive area, and the visually sensitive area will be roughly measured. The measurement result will be calibrated based on the eye movement and head movement tracking data. The final test result is similar to the static field of view measurement result. The server end of the controller subsystem is also used to control the built-in dual-screen display to increase the meridian different brightness and color spot scanning of M° interval to obtain the test spot information of the subject; where M° is less than N°. Further, M° can be 5°.

在完成动态视网膜测试后,根据动态视野范围测量的结果勾勒出被测者视野中对光敏感较弱的区域,如图7所示。After the dynamic retina test is completed, the areas of the subject’s field of view that are less sensitive to light are outlined according to the results of the dynamic field of view range measurement, as shown in Figure 7.

在勾勒出被测者视野范围弱的区域后,系统将使用静态视场测试将视觉敏感度较弱区域重点测量,视场中敏感较强区域将会被进行粗略测量,如图8所示。静态视场测量使用呈矩阵排列的光斑逐个闪烁,如图6所示,矩阵分为四个象限,每个象限区域内预先分布多个光点,光点数量和设定位置不影响本专利权利要求。被测者对光斑的闪烁作出反应。如此测试产生结果更加具体,但测试时间长且测试过程使人不适,选择敏感度弱的区域重点测量将缩短测试时间,但保持测试精度。After delineating the areas where the subject’s field of view is weak, the system will use the static field of view test to focus on the areas with weaker visual sensitivity, and the more sensitive areas in the field of view will be roughly measured, as shown in Figure 8. The static field of view measurement uses the light spots arranged in a matrix to flicker one by one, as shown in Figure 6, the matrix is divided into four quadrants, and multiple light spots are pre-distributed in each quadrant area. The number of light spots and setting positions do not affect the patent rights Claim. The subject responds to the flickering of the light spot. Such a test produces more specific results, but the test time is long and the test process is uncomfortable. Choosing an area with weak sensitivity to focus on measurement will shorten the test time, but maintain the test accuracy.

具体地,本发明的头戴式显示器支架5内置了显示子系统1、眼动追踪子系统2和头部跟踪子系统3,显示子系统1中的显示器模块12的像素密度需大于400ppi,刷新速率至少有60Hz,显示器模块12内嵌在头戴式显示器支架5的前端,其自带的双屏显示器正对被测者双眼。在传统静态视场测量过程中,被测者的头部需要在固定位置上停留10到20分钟,且测试中被测者需要迅速对一闪而过的光斑做出反应。在此测试环境下被测者很容易产生不适,会降低测试准确率,因为视场测试结果依赖被测者的反应,若被测者无法准确做出反应,测试结果准确率会降低。如果使用本发明使用的虚拟现实显示,被测者可以在测试过程中移动头部,降低测试时的不适感。本发明的测试方法也在一定程度上降低被测者的不适感,动态测量被相比静态测量舒适,但测量精度不高,本发明结合静态测量和动态测量。首先静态测量画出视野中有问题的区域,再用静态测量重点测量视力缺陷区域。减少需要静态测量的部分,并保持测试准确性。Specifically, the head-mounted display stand 5 of the present invention has a built-in display subsystem 1, aneye tracking subsystem 2 and ahead tracking subsystem 3. The pixel density of thedisplay module 12 in the display subsystem 1 needs to be greater than 400ppi, refresh The rate is at least 60 Hz, thedisplay module 12 is embedded in the front end of the head-mounted display bracket 5, and its built-in dual-screen display faces the eyes of the subject. In the traditional static field of view measurement process, the head of the subject needs to stay in a fixed position for 10 to 20 minutes, and the subject needs to react quickly to a flash of light spot during the test. In this test environment, the testee is prone to discomfort, which will reduce the test accuracy rate, because the field of view test result depends on the testee's response. If the testee cannot respond accurately, the test result accuracy rate will be reduced. If the virtual reality display used in the present invention is used, the subject can move his head during the test, which reduces the discomfort during the test. The test method of the present invention also reduces the discomfort of the testee to a certain extent. Dynamic measurement is more comfortable than static measurement, but the measurement accuracy is not high. The present invention combines static measurement and dynamic measurement. First, static measurement draws out the problematic area in the field of view, and then uses static measurement to focus on the area of vision defects. Reduce the part that needs to be statically measured and maintain test accuracy.

而透镜模块11可将显示器模块12发出的光线放大后投射至人眼上,进而 可以消除显示器模块12的双屏显示器在人眼中的边框,使得被测者更能沉浸在显示子系统1营造的环境中,其对不同影像作出的反馈行为更加真实,增加了视网膜健康状态判断结果的准确性;Thelens module 11 can magnify the light emitted by thedisplay module 12 and project it on the human eye, thereby eliminating the frame of the dual-screen display of thedisplay module 12 in the human eye, so that the subject can be more immersed in the display subsystem 1 In the environment, its feedback behavior to different images is more realistic, which increases the accuracy of the judgment results of the retinal health status;

眼动追踪子系统2,为一种能够跟踪测量眼球位置及眼球运动信息的一种设备,内嵌于头戴式显示器支架5中。在本实施例中,眼动追踪子系统2可以通过近红外生成瞳孔所见的图像,再通过相机捕捉生成的图像。眼动追踪子系统2也可以通过辨认眼球的特征,如瞳孔外形、异色边缘虹膜、虹膜边界、近距指向光源的角膜反射来实现眼动跟踪。本发明实施例中的眼动追踪子系统2,由于内嵌在头戴式显示器支架5中,其始终和被测者头部同步运动,解决了现有的眼动追踪装置位置固定,一旦被测者头部大幅度运动,则眼动追踪装置在被测者眼部的焦点会失焦的问题。Theeye tracking subsystem 2 is a device capable of tracking and measuring eyeball position and eye movement information, and is embedded in the head-mounted display bracket 5. In this embodiment, theeye tracking subsystem 2 can generate an image seen by the pupil through near infrared, and then capture the generated image through a camera. Theeye tracking subsystem 2 can also realize eye tracking by recognizing the characteristics of the eyeball, such as pupil shape, heterochromatic edge iris, iris boundary, and corneal reflection of a close-pointing light source. Since theeye tracking subsystem 2 in the embodiment of the present invention is embedded in the head-mounted display bracket 5, it always moves in synchronization with the subject’s head, which solves the problem that the position of the existing eye tracking device is fixed. If the subject’s head moves significantly, the eye tracking device will lose focus on the subject’s eyes.

进一步地,在上述实施例的基础上,显示器模块12的两块屏幕,模拟人眼对现实景物的观察角度,分别向被测者双眼投射同景不同角度的影像。Further, on the basis of the above-mentioned embodiment, the two screens of thedisplay module 12 simulate the viewing angle of the human eye to the real scene, and respectively project images of the same scene and different angles to the eyes of the subject.

进一步地,在上述实施例的基础上,参照图4所示,透镜模块11在头戴式显示器支架5中左右各设有一片,每片透镜模块11均设有圆形棱镜阵列。Further, on the basis of the above-mentioned embodiment, as shown in FIG. 4, thelens module 11 is provided with a piece oflens module 11 on the left and right sides of the head mounted display bracket 5, and eachlens module 11 is provided with a circular prism array.

具体的,圆形棱镜阵列能够使透镜模块11具有与大块曲面透镜相同的效果,是来自显示器模块12的光线散射在人眼中,使双屏显示器呈现的视觉刺激材料占据被测者整个视野。圆形棱镜阵列的位置可以根据用户的实际情况(如近视、远视、眼距的宽窄等)做微调。Specifically, the circular prism array can enable thelens module 11 to have the same effect as a large curved lens. The light from thedisplay module 12 is scattered in the human eye, so that the visual stimulus material presented by the dual-screen display occupies the entire field of view of the subject. The position of the circular prism array can be fine-tuned according to the actual situation of the user (such as myopia, hyperopia, eye distance, etc.).

进一步地,在上述实施例的基础上,参照图1、图4所示,基于虚拟现实技术的视网膜检测系统还包括:头动跟踪子系统3,头动跟踪子系统3亦内置于头戴式显示器支架5中,用于检测被测者的头部动作信息;分析评价子系统4,分析评价子系统4用于从眼动追踪子系统2与头动跟踪子系统3收集注视点信息与头部动作信息,并根据收集到的注视点信息与头部动作信息得到被测者的视觉注意模式与头部运动模式,从而判断视网膜健康状态的检测结果。Further, on the basis of the above-mentioned embodiment, referring to Figures 1 and 4, the retinal detection system based on virtual reality technology further includes: ahead tracking subsystem 3, which is also built in the head-mounted The display bracket 5 is used to detect the head movement information of the subject; the analysis andevaluation subsystem 4, the analysis andevaluation subsystem 4 are used to collect the gaze point information and head movement from theeye tracking subsystem 2 and thehead tracking subsystem 3 According to the collected gaze point information and head movement information, the subject’s visual attention pattern and head movement pattern can be obtained to determine the detection result of the retinal health status.

进一步地,在上述实施例的基础上,如图2所示,头动跟踪子系统3包括:加速计模块31,加速计模块31用于重力监测,从而判断头戴式显示器支架5是否正立;加速计模块31,还用于检测被测者头部在各轴上的加速度;陀螺仪模块32,陀螺仪模块32用于跟踪被测者头部的旋转角速度及角度变化。Further, on the basis of the foregoing embodiment, as shown in FIG. 2, the headmovement tracking subsystem 3 includes: anaccelerometer module 31, which is used for gravity monitoring, so as to determine whether the head-mounted display stand 5 is upright Theaccelerometer module 31 is also used to detect the acceleration of the subject's head on each axis; thegyroscope module 32 is used to track the rotational angular velocity and angle changes of the subject's head.

具体的,在本实施例中,加速计模块31利用传感装置的惯性力测量其在x、 y、z三轴上的加速方向和速度大小。在其他实施例中,x、y二轴加速度测量传感器也可以使用,其中x轴加速度为0g,y轴加速度为1g。Specifically, in this embodiment, theaccelerometer module 31 uses the inertial force of the sensing device to measure its acceleration direction and speed on the x, y, and z axes. In other embodiments, the x-axis and y-axis acceleration measurement sensors can also be used, where the x-axis acceleration is 0g and the y-axis acceleration is 1g.

陀螺仪模块32,跟踪头戴式显示器支架5沿着x、y、z三轴的旋转角速度或角度变化,来为分析评价子系统4提供更精确的物体旋转信息。该模块可以通过测量三维坐标系内陀螺转子的垂直轴与设备之间的夹角计算角速度,通过夹角和角速度来判别被测者头部在三维空间的运动状态。Thegyroscope module 32 tracks the rotation angular velocity or angle change of the head mounted display support 5 along the x, y, and z three axes to provide more accurate object rotation information for the analysis andevaluation subsystem 4. The module can calculate the angular velocity by measuring the angle between the vertical axis of the gyro rotor and the device in the three-dimensional coordinate system, and judge the movement state of the subject’s head in three-dimensional space through the angle and angular velocity.

进一步地,在上述实施例的基础上,如图3所示,分析评价子系统4包括:视觉注意点跟踪模块42,视觉注意点跟踪模块42根据注视点信息,基于视觉注意模式得出被测者的视觉注意模式;头部运动补偿模块41,头部运动补偿模块41根据头部动作信息,基于头部跟踪算法得出被测者的头部运动模式;视网膜检测评价模块43,视网膜检测评价模块43根据被测者的视觉注意点和头部运动补偿。在动态子午线测试中基于显示器模块对12个方向上的受测试者视野边界的测量,评估可能视力受损的区域,增加5°间隔的更细致子午线不同颜色光点63扫描,从而精确测量受测试者的视网膜可视区域和不可视区域的范围,包括可视区域的感光敏感度和对不同颜色的敏感度,输出被测者的视网膜健康状态检测结果;在静态光点测试中,整个视野区域被X轴72,Y轴73分为四个象限74,显示模块将逐个随机显示呈矩阵排列的光斑75,被测试者对于光斑做出看到或者无法看到的反应,系统会根据测试者的反应绘制测试者的视野图;在动态与静态结合的测试中,动态测试画出的视野盲区的初略图,图7。系统会显示静态光斑用于精确测量视觉盲区,光斑随机逐个闪烁,但系统会在动态勾勒图中的不敏感区域分配更多的光点,视觉健康区域也会分配若干亮点,但不会重点测量如图8。测试中眼动和头动检测也会起到作用,保证测试准确。在静态测试后,系统会结合头动和眼动跟踪产生最终结果,结果将图将与传统机械静态测量类似。Further, on the basis of the foregoing embodiment, as shown in FIG. 3, the analysis andevaluation subsystem 4 includes: a visual attentionpoint tracking module 42. The visual attentionpoint tracking module 42 obtains the measured point based on the gaze point information and the visual attention mode. The person’s visual attention mode; the headmotion compensation module 41, the headmotion compensation module 41 obtains the subject’s head motion mode based on the head tracking algorithm according to the head motion information; the retinadetection evaluation module 43, the retina detection evaluation Themodule 43 compensates according to the subject's visual attention point and head movement. In the dynamic meridian test, based on the measurement of the subject’s visual field boundary in 12 directions by the display module, the area that may be visually impaired is evaluated, and the more detailed meridian light spots of different colors at 5° intervals are added to scan 63, so as to accurately measure the test subject The range of the visible and invisible areas of the subject’s retina, including the sensitivity of the visible area and the sensitivity to different colors, and output the test results of the subject’s retinal health; in the static light spot test, the entire field of view The X-axis 72 and Y-axis 73 are divided into four quadrants 74. The display module will randomly display the light spots 75 arranged in a matrix one by one. Draw the tester’s visual field in response to the test; in the dynamic and static combined test, the initial sketch of the blind area of the visual field drawn by the dynamic test is shown in Figure 7. The system will display static light spots for precise measurement of blind areas. The light spots will flash randomly one by one, but the system will allocate more light spots in the insensitive area in the dynamic outline map, and the visual health area will also allocate several bright spots, but will not focus on the measurement. As shown in Figure 8. Eye movement and head movement detection will also play a role in the test to ensure the accuracy of the test. After the static test, the system will combine head movement and eye tracking to produce the final result, and the result will be similar to the traditional mechanical static measurement.

具体地,头部运动补偿模块41,基于头部跟踪算法,利用头部运动随时间变化的速度、位置和方向信息,得出被测者头部运动模式。在本实施例中,该模块的输入信息来源于加速计模块31和陀螺仪模块32测量得到的头戴式显示器在多轴上的加速度方向、加速度大小以及沿着x、y、z三轴的旋转角速度及角度变化。头动运动补偿模块的信号输入还可以来源于布置于基于虚拟现实中视觉注意模式和头部运动模式的视网膜检测系统所处环境的红外检测组件测量得到的头戴式显示器的位移和旋转角度。Specifically, the headmotion compensation module 41, based on a head tracking algorithm, uses the speed, position, and direction information of the head motion over time to obtain the head motion pattern of the subject. In this embodiment, the input information of the module comes from the acceleration direction and magnitude of the head-mounted display on the multi-axis measured by theaccelerometer module 31 and thegyroscope module 32, and the acceleration along the x, y, and z three axes. Rotation angular velocity and angle change. The signal input of the head movement compensation module can also be derived from the displacement and rotation angle of the head-mounted display measured by the infrared detection component arranged in the environment of the retina detection system based on the visual attention mode and the head movement mode in virtual reality.

视觉注意点跟踪模块42,利用眼动追踪子系统2得到的被测者注视点和扫视过程的位置和时间分布,基于视觉注意模式得到被测者的关注点和不关注区域信息,提取其视觉注意模式。The visual attentionpoint tracking module 42 uses theeye tracking subsystem 2 to obtain the location and time distribution of the subject’s gaze point and saccade process, and obtains the subject’s attention point and non-focus area information based on the visual attention mode, and extracts its vision Pay attention to the pattern.

视网膜检测评价模块43,利用头部运动补偿41和视觉注意点跟踪42得到的视觉注意模式和头部运动模式在同一时间线上的特征和对应关系,将这些特征和关系通过视网膜健康状态检测评价算法与视网膜缺损个体和标准发育个体特征进行比较,来评价被测者视网膜健康状态,并输出显示视网膜健康状态检测结果。该模块可以但不限于运行在个人计算机或服务器上。检测结果可以但不限于个人计算机的显示屏或额外的LED显示屏等多种显示装置。The retinal detection andevaluation module 43 uses the characteristics and corresponding relations of the visual attention pattern and the head movement pattern on the same timeline obtained byhead motion compensation 41 and visual attention point tracking 42, and evaluates these characteristics and relationships through retinal health status detection and evaluation The algorithm compares the characteristics of individuals with retinal defects and standard developmental individuals to evaluate the health status of the subject’s retina, and outputs the results of the detection of the health status of the retina. The module can, but is not limited to, run on a personal computer or server. The detection result can be, but not limited to, various display devices such as the display screen of a personal computer or an additional LED display screen.

进一步地,在上述实施例的基础上,头部动作信息包括:被测者的头动速度信息、位移信息和旋转方向信息。Further, on the basis of the foregoing embodiment, the head movement information includes: head movement speed information, displacement information, and rotation direction information of the subject.

本发明上述实施例提供的一种基于虚拟现实技术的视网膜检测系统,检测视网膜各处的生理健康状态,包括成像范围、感光度、色觉等指标,由显示子系统,头动/眼动追踪子系统,分析评价子系统和控制器子系统组成,其中显示子系统和头动/眼动追踪子系统内置于头戴式显示器中,分析评价子系统在头戴式显示器所连接的电脑中运行,控制器子系统的客户端由受测试者手动控制,通过蓝牙与电脑无线连接。显示子系统包括:显示器模块,显示器模块为具有足够像素密度和刷新速率的内嵌式双屏显示器,用于向被测者两眼显示具有景深的立体影像;透镜模块,透镜模块位于被测者眼睛和显示器模块间,用于将显示器模块投射出的光线放大映射到被测者眼中,使显示器模块显示的立体影像占据被测者的全部视野。头动跟踪子系统:用于检测头部运动,消除头部运动对视觉检测的影响。眼动追踪子系统:用于检测眼球运动与被测者的注视点信息。本发明通过消除视野边框和增强景深,增大了的视网膜检测范围和精度,且眼动追踪子系统始终与头部同步运动,确保在眼睛运动时精确定位视网膜的检测位置。分析评价子系统:用于集成和处理各传感器信息和控制器输入信息,输出受测试者的视网膜生理健康状态。控制子系统:受测试者根据视觉效果选择性输入,用于反映受测试者的视网膜不同位置的生理状态。The above embodiment of the present invention provides a retina detection system based on virtual reality technology, which detects the physiological health status of various parts of the retina, including imaging range, sensitivity, color vision and other indicators. The display subsystem, head movement/eye movement tracking sub-system The system consists of analysis and evaluation subsystems and controller subsystems. The display subsystem and head movement/eye tracking subsystem are built in the head-mounted display, and the analysis and evaluation subsystem runs on the computer connected to the head-mounted display. The client of the controller subsystem is manually controlled by the tester, and is wirelessly connected to the computer via Bluetooth. The display subsystem includes: a display module, which is an embedded dual-screen display with sufficient pixel density and refresh rate, used to display stereo images with depth of field to the subject’s eyes; lens module, the lens module is located on the subject Between the eye and the display module, it is used to magnify and map the light projected by the display module to the eyes of the subject, so that the three-dimensional image displayed by the display module occupies the entire field of view of the subject. Head movement tracking subsystem: used to detect head movement and eliminate the influence of head movement on visual inspection. Eye tracking subsystem: used to detect eye movement and gaze point information of the subject. The invention increases the detection range and accuracy of the retina by eliminating the visual field frame and enhancing the depth of field, and the eye tracking subsystem always moves in synchronization with the head, ensuring precise positioning of the detection position of the retina when the eyes are moving. Analysis and evaluation subsystem: used to integrate and process various sensor information and controller input information, and output the physiological health status of the subject's retina. Control subsystem: the subject selects input according to the visual effect, which is used to reflect the physiological state of the subject's retina at different positions.

以上对本发明的具体实施例进行了描述。需要理解的是,本发明并不局限于上述特定实施方式,本领域技术人员可以在权利要求的范围内做出各种变形或修改,这并不影响本发明的实质内容。The specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various deformations or modifications within the scope of the claims, which does not affect the essence of the present invention.

Claims (12)

Translated fromChinese
一种基于虚拟现实技术的视网膜检测系统,其特征在于,包括:显示子系统、头动追踪子系统、眼动追踪子系统、控制器子系统以及头戴式显示器支架,所述显示子系统、头动追踪子系统和眼动追踪子系统内置于所述头戴式显示器支架中;其中:A retinal detection system based on virtual reality technology, which is characterized by comprising: a display subsystem, a head tracking subsystem, an eye tracking subsystem, a controller subsystem, and a head-mounted display bracket. The display subsystem, The head tracking subsystem and the eye tracking subsystem are built in the head-mounted display bracket; wherein:所述显示子系统,用于向被测者显示无视野边界的立体影像,包括:The display subsystem is used to display a three-dimensional image without boundary of the field of view to the subject, including:-显示器模块,所述显示器模块用于向被测者显示具有景深的立体影像;-A display module, which is used to display a stereoscopic image with depth of field to the subject;-透镜模块,所述透镜模块位于被测者的眼睛和所述显示器模块之间,用于将所述显示器模块投射出的光线放大映射到被测者的眼中,使所述显示器模块显示的立体影像占据被测者的全部视野;-A lens module, the lens module is located between the eyes of the subject and the display module, and is used to magnify and map the light projected by the display module to the eyes of the subject, so that the display module can display three-dimensional The image occupies the entire field of view of the subject;所述控制器子系统,用于控制得到被测者的视野边界以及测试光点信息;The controller subsystem is used to control and obtain the visual field boundary of the subject and the test light spot information;所述头动跟踪子系统,用于检测头部运动信息,消除头部运动对视觉检测的影响;The head movement tracking subsystem is used to detect head movement information and eliminate the influence of head movement on visual detection;所述眼动追踪子系统,用于检测被测者的注视点信息。The eye tracking subsystem is used to detect the gaze point information of the subject.根据权利要求1所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述显示器模块采用内嵌式双屏显示器,所述内嵌式双屏显示器的两块屏幕模拟人眼对现实景物的观察角度,以人的每只眼睛的视野范围建立球面坐标,球面顶点是人眼的视野中心。The retina detection system based on virtual reality technology according to claim 1, wherein the display module adopts an embedded dual-screen display, and the two screens of the embedded dual-screen display simulate the human eye's interaction with the real scene. The observation angle of, the spherical coordinates are established by the field of view of each human eye, and the apex of the spherical surface is the center of the human eye’s field of view.根据权利要求2所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述显示器模块包括初步测量模式;The retina detection system based on virtual reality technology according to claim 2, wherein the display module includes a preliminary measurement mode;所述初步测量模式为:极轴通过顶点形成0°子午线,在视野范围内从0°子午线开始逆时针每N°间隔增加一条经过球面顶点的子午线,多条子午线将视野划分为多个区域,显示器模块在黑暗背景下,从0°子午线开始逆时针依次沿各条子午线的球面顶点向视野边缘移动并向被测者双眼投射光点,当被测者发现光点消失时启动控制器子系统的客户端,记录该视野区域方向上的视野边界;所述控制器子系统的服务端还用于控制内嵌式双屏显示器增加M°间隔的子午线不同光亮及颜色光点扫描,得到被测者的测试光点信息,进而初步勾勒出被测试者视觉不敏感的区域;其中M°小于N°。The preliminary measurement mode is: the polar axis passes through the apex to form a 0° meridian, and a meridian passing through the apex of the sphere is added counterclockwise from the 0° meridian in the field of view every N° interval, and multiple meridians divide the field of view into multiple regions, On a dark background, the display module moves counterclockwise from the 0° meridian to the edge of the field of view along the sphere vertices of each meridian, and projects light spots to the eyes of the subject. When the subject finds the light spots disappear, the controller subsystem is activated. The client side of the field of view records the boundary of the field of view in the direction of the field of view; the server side of the controller subsystem is also used to control the embedded dual-screen display to increase the meridian different brightness and color spot scanning at the interval of M° to obtain the measured The test light spot information of the subject, and then preliminarily outlines the visually insensitive area of the subject; where M° is less than N°.根据权利要求3所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述显示器模块还包括精确测量模式;The retina detection system based on virtual reality technology according to claim 3, wherein the display module further comprises an accurate measurement mode;所述精确测量模式为:以视野中心为原点,建立水平和垂直坐标线,所述水平和垂直坐标线将视野范围分为四个象限区域;其中每个象限区域内平均分布若干个能够随机点亮的光点,被测者根据视野范围内是否观测到点亮的光点而对应做出选择,进而精确测量出被测试者的视觉不敏感区;The precise measurement mode is: taking the center of the field of view as the origin to establish horizontal and vertical coordinate lines, the horizontal and vertical coordinate lines divide the field of view into four quadrant areas; wherein a number of random points are evenly distributed in each quadrant area Bright light spot, the subject makes a corresponding choice according to whether the light spot is observed in the field of view, and then accurately measures the visual insensitive area of the subject;所述精确测量模式在初步测量模式的基础之上执行。The precise measurement mode is executed on the basis of the preliminary measurement mode.根据权利要求4所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述N°采用30°,相应地,所述视野将划分为12个区域;所述M°采用5°。The retina detection system based on virtual reality technology according to claim 4, wherein the N° adopts 30°, and accordingly, the field of view is divided into 12 regions; the M° adopts 5°.根据权利要求4所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述光点亮度及颜色可调节。The retina detection system based on virtual reality technology according to claim 4, wherein the brightness and color of the light spot are adjustable.根据权利要求1所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述透镜模块包括两片透镜,分别与内嵌式双屏显示器的两块屏幕相对应,其中每一片透镜均设有圆形棱镜阵列。The retina detection system based on virtual reality technology according to claim 1, wherein the lens module includes two lenses, respectively corresponding to the two screens of the embedded dual-screen display, wherein each lens is provided with There is a circular prism array.根据权利要求1所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述头动跟踪子系统包括:The retina detection system based on virtual reality technology according to claim 1, wherein the head movement tracking subsystem comprises:加速计模块,所述加速计模块用于重力监测,从而判断所述头戴式显示器支架是否正立,同时检测被测者头部在各轴上的加速度;An accelerometer module, the accelerometer module is used for gravity monitoring, so as to determine whether the head-mounted display bracket is upright, and at the same time detect the acceleration of the subject's head on each axis;陀螺仪模块,所述陀螺仪模块用于跟踪被测者头部的旋转角速度及角度变化。The gyroscope module is used to track the rotation angular velocity and angle change of the subject's head.根据权利要求1-8中任一项所述的基于虚拟现实技术的视网膜检测系统,其特征在于,还包括分析评价子系统;The retina detection system based on virtual reality technology according to any one of claims 1-8, further comprising an analysis and evaluation subsystem;所述分析评价子系统,包括:The analysis and evaluation subsystem includes:-头部运动补偿模块,根据头部运动信息,得到被测者头部运动模式;-The head motion compensation module, based on the head motion information, obtains the head motion mode of the subject;-视觉注意点跟踪模块,所述视觉注意点追踪模块根据注视点信息,通过补偿眼部运动持续追踪视网膜特定区域,提取其视觉注意模式;-A visual attention point tracking module, the visual attention point tracking module continuously tracks a specific area of the retina by compensating eye movement according to the point of gaze information, and extracts its visual attention mode;-视网膜检测评价模块,所述视网膜检测评价模块,通过头部运动模式和视觉注意模式,准确定位视网膜的检测位置,-Retina detection and evaluation module, the retina detection and evaluation module accurately locates the detection position of the retina through head movement patterns and visual attention patterns,基于对被测者的视野边界的测量,评估视力受损的可能视野区域,同时根据测试光点信息,得到被测者在不同视野区域的感光敏感度和颜色敏感度,测量受测试者的视网膜可视区域和不可视区域的范围,输出被测者的视网膜健康状态检测结果。Based on the measurement of the subject’s visual field boundary, assess the possible visual field area with impaired vision, and at the same time obtain the subject’s sensitivity and color sensitivity in different visual fields based on the test light spot information, and measure the subject’s retina The range of the visible area and the invisible area output the test result of the retinal health status of the testee.根据权利要求1-8中任一项所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述注视点信息包括:被测者在立体影像上的注视位置信息、注视顺序信息和注视时长信息。The retina detection system based on virtual reality technology according to any one of claims 1-8, wherein the gaze point information comprises: gaze position information, gaze sequence information, and gaze information of the subject on the stereoscopic image. Duration information.根据权利要求1-8中任一项所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述头部运动信息包括:被测者的头动速度信息、位移信息和旋转方向信息。The retina detection system based on virtual reality technology according to any one of claims 1-8, wherein the head movement information comprises: head movement speed information, displacement information and rotation direction information of the subject.根据权利要求1-8中任一项所述的基于虚拟现实技术的视网膜检测系统,其特征在于,所述测试光点信息包括:被测者在球坐标空间中看到的光点的位置、光点的亮度以及光点的颜色。The retina detection system based on virtual reality technology according to any one of claims 1-8, wherein the test light point information includes: the position of the light point seen by the subject in the spherical coordinate space, The brightness of the light spot and the color of the light spot.
PCT/CN2019/1161962019-09-062019-11-07Virtual reality technology-based retina detection systemCeasedWO2021042504A1 (en)

Applications Claiming Priority (2)

Application NumberPriority DateFiling DateTitle
CN201910840530.X2019-09-06
CN201910840530.XACN110537895A (en)2019-09-062019-09-06Retina detecting system based on virtual reality technology

Publications (1)

Publication NumberPublication Date
WO2021042504A1true WO2021042504A1 (en)2021-03-11

Family

ID=68712630

Family Applications (1)

Application NumberTitlePriority DateFiling Date
PCT/CN2019/116196CeasedWO2021042504A1 (en)2019-09-062019-11-07Virtual reality technology-based retina detection system

Country Status (2)

CountryLink
CN (1)CN110537895A (en)
WO (1)WO2021042504A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN110812146B (en)*2019-11-202022-02-22精准视光(北京)医疗技术有限公司Multi-region visual function adjusting method and device and virtual reality head-mounted display equipment
CN111134693B (en)*2019-12-092021-08-31上海交通大学 Auxiliary detection method, system and terminal for children with autism based on virtual reality technology
CN112754421B (en)*2021-01-192024-09-24上海佰翊医疗科技有限公司 A device for measuring protrusion of eyeballs
CA3205671A1 (en)2021-02-222022-08-25Niccolo MaschioTracking of retinal traction through digital image correlation
CN113647900A (en)*2021-06-282021-11-16中山大学中山眼科中心Self-service visual field detection method based on personal terminal
CN115644791A (en)*2022-11-102023-01-31吉林大学Double-vision detection system based on virtual reality technology and use method

Citations (9)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP3914090B2 (en)*2002-05-072007-05-16株式会社ニューオプト Eye movement analysis system and eye imaging device
CN106037626A (en)*2016-07-122016-10-26吴越Head-mounted visual field inspector
CN107169309A (en)*2017-07-262017-09-15北京为凡医疗信息技术有限公司Visual field detection method, system and detection means based on wear-type detection device
US20180008141A1 (en)*2014-07-082018-01-11Krueger Wesley W OSystems and methods for using virtual reality, augmented reality, and/or a synthetic 3-dimensional information for the measurement of human ocular performance
CN108209857A (en)*2013-09-032018-06-29托比股份公司Portable eyes tracing equipment
WO2018163166A2 (en)*2017-03-052018-09-13Virtuoptica Ltd.Eye examination method and apparatus therefor
CN109645955A (en)*2019-01-312019-04-19北京大学第三医院(北京大学第三临床医学院) Multifunctional visual function detection device and method based on VR and eye tracking
CN109758107A (en)*2019-02-142019-05-17郑州诚优成电子科技有限公司 A VR visual function inspection device
CN109846456A (en)*2019-03-062019-06-07西安爱特眼动信息科技有限公司 A visual field inspection device based on a head-mounted display device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN102265310A (en)*2008-10-282011-11-30俄勒冈健康科学大学 Method and device for visual field monitoring
CN109310315B (en)*2016-06-092022-02-22Qd激光公司Visual field visual acuity test system, visual field visual acuity test device, visual field visual acuity test method, storage medium, and server device
CN208319187U (en)*2017-09-062019-01-04福州东南眼科医院(金山新院)有限公司A kind of ophthalmic computer visual field meter
CN109717828A (en)*2018-10-242019-05-07中国医学科学院生物医学工程研究所A kind of perimetry devices and detection method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP3914090B2 (en)*2002-05-072007-05-16株式会社ニューオプト Eye movement analysis system and eye imaging device
CN108209857A (en)*2013-09-032018-06-29托比股份公司Portable eyes tracing equipment
US20180008141A1 (en)*2014-07-082018-01-11Krueger Wesley W OSystems and methods for using virtual reality, augmented reality, and/or a synthetic 3-dimensional information for the measurement of human ocular performance
CN106037626A (en)*2016-07-122016-10-26吴越Head-mounted visual field inspector
WO2018163166A2 (en)*2017-03-052018-09-13Virtuoptica Ltd.Eye examination method and apparatus therefor
CN107169309A (en)*2017-07-262017-09-15北京为凡医疗信息技术有限公司Visual field detection method, system and detection means based on wear-type detection device
CN109645955A (en)*2019-01-312019-04-19北京大学第三医院(北京大学第三临床医学院) Multifunctional visual function detection device and method based on VR and eye tracking
CN109758107A (en)*2019-02-142019-05-17郑州诚优成电子科技有限公司 A VR visual function inspection device
CN109846456A (en)*2019-03-062019-06-07西安爱特眼动信息科技有限公司 A visual field inspection device based on a head-mounted display device

Also Published As

Publication numberPublication date
CN110537895A (en)2019-12-06

Similar Documents

PublicationPublication DateTitle
WO2021042504A1 (en)Virtual reality technology-based retina detection system
US10610093B2 (en)Method and system for automatic eyesight diagnosis
CN113208884B (en)Visual detection and visual training equipment
US6659611B2 (en)System and method for eye gaze tracking using corneal image mapping
EP2467053B1 (en)Apparatus and method for automatically determining a strabismus angle
JP2010526623A (en) Visual field inspection system, visual field inspection method, computer program, computer product, and processor
CN106821301B (en)A kind of computer based eye movement distance and movements binocular consistency error measuring means and method
CN110881981A (en)Alzheimer's disease auxiliary detection system based on virtual reality technology
CN113080836A (en)Non-center gazing visual detection and visual training equipment
CN115590462A (en)Vision detection method and device based on camera
Nagamatsu et al.Calibration-free gaze tracking using a binocular 3D eye model
CN111528786A (en)System and method for detecting head position of strabismus compensation
CN111134693B (en) Auxiliary detection method, system and terminal for children with autism based on virtual reality technology
JP6747172B2 (en) Diagnosis support device, diagnosis support method, and computer program
LinAn eye behavior measuring device for VR system
CN106725280A (en)A kind of slant visibility measurement apparatus
CN108742510B (en)Oblique vision and horizontal torsion angle detector suitable for children with low age
JP6496917B2 (en) Gaze measurement apparatus and gaze measurement method
MP et al.Method for increasing the accuracy of tracking the center of attention of the gaze
NL2036527B1 (en)Method and system for measuring of visual functions and/or behavior and/or neurological functions
JP7548637B2 (en) Systems and methods for quantifying ocular dominance
Shin et al.A novel computerized visual acuity test for children
CN116413049A (en) A driver's head movement simulation device
CN113080844A (en)Visual detection and visual training device for optimizing retina area
UA139464U (en) METHOD OF DIAGNOSIS OF THE STATE OF THE OCULOMOTOR SYSTEM OF THE EYE

Legal Events

DateCodeTitleDescription
121Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number:19944213

Country of ref document:EP

Kind code of ref document:A1

NENPNon-entry into the national phase

Ref country code:DE

122Ep: pct application non-entry in european phase

Ref document number:19944213

Country of ref document:EP

Kind code of ref document:A1

122Ep: pct application non-entry in european phase

Ref document number:19944213

Country of ref document:EP

Kind code of ref document:A1


[8]ページ先頭

©2009-2025 Movatter.jp