CN113413265A - Visual aid method and system for visual dysfunction person and intelligent AR glasses - Google Patents

Abstract

The invention discloses a visual auxiliary method for a person with visual dysfunction, which comprises the following steps: s1, providing AR glasses based on planar waveguide imaging; s2, detecting eye function parameters of the wearer including central visual acuity, contrast sensitivity, fusion function and stereoscopic vision by utilizing AR glasses imaging; s3, the camera system tracks the observation target of the wearer, and the camera system shoots after accurate positioning to obtain a target image; s4, subjecting the acquired digital image information to optical amplification and background digital amplification, performing feature enhancement according to the functional parameters of the eyes of the wearer, and outputting imaging light; and S5, imaging the imaging light rays in the retina of the wearer after passing through the planar waveguide. Correspondingly, the invention also discloses a vision auxiliary system for the visual dysfunction person and intelligent AR glasses. The invention can help the people with visual dysfunction to recover normal life, work and study, can carry out necessary scientific rehabilitation training, and helps the patients to develop and effectively use the residual vision.

Description

Visual aid method and system for visual dysfunction person and intelligent AR glasses

Technical Field

The invention relates to the technical field of electronic vision assistance, in particular to a visual assistance method and system for a person with visual dysfunction and intelligent AR glasses.

Background

At present, binocular vision dysfunction is more and more common in clinic, the main causes of the binocular vision dysfunction comprise amblyopia, congenital or acquired cataract, uncorrectable ametropia, diabetic retinopathy and the like, and the binocular vision dysfunction is usually manifested as visual disturbance, abnormal color vision, night blindness, visual field defect, visual deformation, flashing vision, asthenopia, abnormal stereoscopic vision, abnormal contrast sensitivity and the like, and the normal life of people with visual dysfunction is seriously influenced.

The traditional typoscope, such as an optical typoscope, has the defects of single function, poor visual image quality, inconvenience in carrying and the like, so that the requirements of normal life of most patients with visual dysfunction cannot be met. The closed VR equipment only supports binocular parallax and mobile parallax, so that eye convergence regulation conflict and visual and body feeling conflict of a user can be caused, and general discomfort symptoms such as visual fatigue, virtual reality motion sickness and the like can be caused easily.

Disclosure of Invention

The invention provides a visual auxiliary method and system for a person with visual dysfunction and intelligent AR glasses, and aims to solve the problem that the person with visual dysfunction uses a traditional typoscope and a closed VR device in normal life.

In order to solve the technical problems, the technical scheme of the invention is as follows:

a method of assisting a visual function of a visually impaired person, comprising:

s1, providing AR glasses based on planar waveguide imaging;

s2, detecting eye function parameters of the wearer including central visual acuity, contrast sensitivity, fusion function and stereoscopic vision by utilizing AR glasses imaging;

s3, the camera system tracks the observation target of the wearer, and the camera system shoots after accurate positioning to obtain a target image;

s4, subjecting the acquired digital image information to optical amplification and background digital amplification, performing feature enhancement according to the functional parameters of the eyes of the wearer, and outputting imaging light;

and S5, imaging the imaging light rays in the retina of the wearer after passing through the planar waveguide.

Preferably, the AR glasses in step S1 include an imaging system and an input device; the camera system is used for inputting surrounding environment information; the input equipment comprises keys, a touch pad and Bluetooth control equipment, is operated by a user and feeds back signals to the circuit control system.

Preferably, step S2 includes: projecting the Snellen diagram to a theoretical eye distance, feeding back observation information through the input device, and detecting the central visual acuity of the eyes of the wearer; switching different spatial frequencies and different contrast change grating images, feeding observation information back through the input equipment, and detecting the contrast sensitivity of the eyes of the wearer; different images are respectively projected to the visual fields of the two eyes, observation information is fed back through the input equipment, and the fusion function of the eyes of the wearer is detected; and integrating the Titmus stereoscopy inspection chart into the AR image, and feeding back observation information through the input device to detect the stereoscopic vision of the eyes of the wearer.

Preferably, the camera system in step S3 includes a camera and a related circuit; the camera is mounted on the mirror bracket between the two planar waveguides.

Preferably, in step S3, the camera moves along with the head of the wearer to automatically focus the scene in front of the eyes of the wearer.

Preferably, the feature enhancement in step S4 includes increasing brightness, increasing contrast, increasing saturation, improving sharpening effect, and changing image display mode.

Preferably, step S2 includes: and performing binocular vision division training, binocular fusion and hand-eye coordination training by utilizing AR glasses imaging.

A visual aid system for a visually impaired person for carrying out the method of any preceding claim.

Smart AR glasses for implementing the method of any of the preceding claims.

Compared with the prior art, the invention has the beneficial effects that:

the characteristics of the AR glasses based on the planar waveguide imaging are utilized to help the people with visual dysfunction to recover normal study, life and work, and necessary scientific rehabilitation training can be carried out to help the patients to develop and effectively use residual vision; the system and the intelligent AR glasses designed by the invention are lighter and more concealed, the appearance of the system is similar to that of common glasses, no redundant belt is provided, pressure can not be applied to the bridge of the nose and the head, no additional attention can be brought to others, and the wearing comfort level is improved.

Drawings

FIG. 1 is a flow chart of a visual aid method for a person with visual dysfunction according to the present invention;

fig. 2 is a flow chart of the present invention for detecting eye function parameters.

Detailed Description

The following further describes embodiments of the present invention with reference to the drawings. Here, the description of the embodiments is provided to help understanding of the invention, but the invention is not limited thereto. In addition, the technical features involved in the respective embodiments of the invention described below may be combined with each other as long as they do not conflict with each other.

Example one

As shown in fig. 1, a visual assistance method for a person with visual dysfunction includes:

s1, providing AR glasses based on planar waveguide imaging;

AR glasses based on planar waveguide formation of image mainly comprises microdisplay and waveguide display module assembly, and the appearance is similar with ordinary glasses, for traditional typoscope and closed VR equipment, it is lighter more, more has disguise, does not have unnecessary band, can not cause pressure for bridge of the nose, head, can not attract attention, has improved the comfort level of wearing.

The AR glasses comprise a camera system and an input device; the camera system is used for inputting surrounding environment information; the input device comprises a key, a touch pad and a Bluetooth control device, is operated by a user and feeds back signals to the circuit control system.

S2, detecting eye function parameters of the wearer including central visual acuity, contrast sensitivity, fusion function and stereoscopic vision by utilizing AR glasses imaging;

as shown in fig. 2, projecting the Snellen diagram to the theoretical eye distance, feeding back the observation information through the input device, and detecting the central visual acuity of the wearer's eyes; switching different spatial frequencies and different contrast change grating images, feeding observation information back through input equipment, and detecting the contrast sensitivity of the eyes of the wearer; different images are respectively projected to the visual fields of the two eyes, observation information is fed back through input equipment, and the fusion function of the eyes of the wearer is detected; image information such as a clinically common Titmus stereoscopy chart, TNO stereoscopy, a random point stereoscopy and the like is fused in the AR eye image, observation information is fed back through input equipment, and the stereoscopic vision of the eyes of a wearer is detected.

Besides supporting normal work, life and learning of the person with visual dysfunction, the rehabilitation training can be carried out by utilizing the AR glasses, for example, binocular vision separating training, binocular fusion and hand-eye coordination training can be carried out by utilizing the imaging of the AR glasses.

The binocular fusion function design scheme is as follows: the principle of a synoptophore is used as a blue book, the visual fields of two eyes are separated by utilizing external equipment, two pictures are projected to the retina of a patient respectively, and whether the patient has fusion dysfunction or not is checked. In addition, the AR glasses can be externally provided with a camera for recording the eye position change of the patient.

The design scheme of binocular vision-separated training is as follows: one hour of tetris was played with goggles each day, one eye only seeing the falling dice and the other eye only seeing the stacked dice, with a training period of two weeks.

The hand-eye coordination training design scheme is as follows: the practice jigsaw is selected according to the condition of children, for example, the practice jigsaw is selected from simple shape jigsaw (circle, triangle, square, rectangle, trapezoid, heart shape, pentagon and hexagon) → 6-8 animals, alternate tool jigsaw → 26 English letters jigsaw → clock jigsaw → digital jigsaw printed by feet and hands → combined jigsaw goose → combined snail jigsaw → combined jigsaw map, no matter which jigsaw, the strengthening process is carried out by starting from a single jigsaw, and different shapes are changed during the strengthening process, such as putting, putting upside down and hanging to lead a patient to find, and the ability of the patient is improved differently according to different forms.

S3, the camera system tracks the observation target of the wearer, and the camera system shoots after accurate positioning to obtain a target image;

the camera system comprises a camera and a related circuit; the camera is mounted on the frame between the two planar waveguides. The camera moves along with the head of the wearer, passively observes the tracking target and automatically focuses the tracking target of the wearer. Because the AR glasses based on the planar waveguide have a large field angle, the scene in the eye movement range can be seen from the AR glasses image, and the wearer can see a clear image seen by normal people without frequently moving the head. The camera system can add an OIS (optical anti-shake) function and acquire stable and clear digital images.

S4, according to the requirement, the acquired digital image information can be subjected to optical amplification and background digital amplification, and then imaging light rays are output after feature enhancement is carried out according to the functional parameters of the eyes of the wearer;

feature enhancement includes increasing brightness, increasing contrast, increasing saturation, improving sharpening effects, and altering image display modes. The image display mode includes a pure black-and-white mode, a contour mode, a monochrome mode, and the like.

And S5, imaging the imaging light rays in the retina of the wearer after passing through the planar waveguide.

The AR glasses are used for augmented reality, the wearer can watch or not watch the AR glasses image, and the AR glasses image does not influence the normal observation of the scene in front of the eyes of the wearer.

Example two

A visual aid system for a visually impaired person for carrying out the method of embodiment one.

All technical schemes of various devices or equipment manufactured by using the visual assistance method for the visual dysfunction persons in combination with software belong to the protection scope of the patent of the invention.

EXAMPLE III

Intelligent AR glasses for implementing the method of embodiment one.

Compared with the visual assistance system for the visually impaired, the intelligent AR glasses of the present embodiment are the best choice to implement the method of the first embodiment.

In one embodiment, the planar waveguide is coated with a color-changing film, and the color-changing film can change color according to the change of the external ultraviolet intensity, so that the effects of shielding external strong light and protecting eyes are achieved.

The embodiments of the invention have been described in detail with reference to the accompanying drawings, but the invention is not limited to the described embodiments. It will be apparent to those skilled in the art that various changes, modifications, substitutions and alterations can be made in these embodiments without departing from the spirit and scope of the invention.

Claims (9)

1. A method of assisting a visual function of a person with visual dysfunction, comprising:

s1, providing AR glasses based on planar waveguide imaging;

s2, detecting eye function parameters of the wearer including central visual acuity, contrast sensitivity, fusion function and stereoscopic vision by utilizing AR glasses imaging;

s3, the camera system tracks the observation target of the wearer, and the camera system shoots after accurate positioning to obtain a target image;

s4, subjecting the acquired digital image information to optical amplification and background digital amplification, performing feature enhancement according to the functional parameters of the eyes of the wearer, and outputting imaging light;

and S5, imaging the imaging light rays in the retina of the wearer after passing through the planar waveguide.

2. A visual aid method according to claim 1, wherein said AR glasses comprise a camera system and an input device in step S1; the camera system is used for inputting surrounding environment information; the input equipment comprises keys, a touch pad and Bluetooth control equipment, is operated by a user and feeds back signals to the circuit control system.

3. A visual aid method according to claim 2, wherein step S2 includes: projecting the Snellen diagram to a theoretical eye distance, feeding back observation information through the input device, and detecting the central visual acuity of the eyes of the wearer; switching different spatial frequencies and different contrast change grating images, feeding observation information back through the input equipment, and detecting the contrast sensitivity of the eyes of the wearer; different images are respectively projected to the visual fields of the two eyes, observation information is fed back through the input equipment, and the fusion function of the eyes of the wearer is detected; and integrating the Titmus stereoscopy inspection chart into the AR image, and feeding back observation information through the input device to detect the stereoscopic vision of the eyes of the wearer.

4. A visual aid method according to claim 3, wherein said camera system in step S3 includes a camera and associated circuitry; the camera is mounted on the mirror bracket between the two planar waveguides.

5. A visual aid method according to claim 4 wherein in step S3 said camera moves with the head of the wearer to automatically focus the scene in front of the eyes of the wearer.

6. A visual aid method according to claim 5, wherein said feature enhancement in step S4 includes increasing brightness, increasing contrast, increasing saturation, improving sharpening effect and changing image display mode.

7. A visual aid method according to claim 6, wherein step S2 includes: and performing binocular vision division training, binocular fusion and hand-eye coordination training by utilizing AR glasses imaging.

8. A visual aid system for a visually impaired person for carrying out the method of any preceding claim.

9. Smart AR glasses for implementing the method of any one of claims 1 to 7.

Images