Summary of the invention
The present invention is poor so as to cause therapeutic effect for the normal life for overcoming existing amblyopia treatment equipment to influence patientThe problem of, a kind of amblyopia treatment system based on AR technology is provided.
To achieve the goals above, the present invention provides a kind of amblyopia treatment system based on AR technology, which includes obtainingModulus block, laminating module and rendering module.Obtain the object in module acquisition augmented reality AR scene.Laminating module willPreset amblyopia treatment image superposition is into the object of AR scene.Rendering module renders amblyopia treatment according to the result that amblyopia detectsImage, the pattern for making two width in amblyopia treatment image have identical visual are presented with different rendering parameters.
In one embodiment of the invention, rendering parameter include the form and aspect of pattern, saturation degree, contrast, brightness, colorfulness withAnd gray scale.
In one embodiment of the invention, the amblyopia treatment system based on AR technology further includes amblyopia detection module, amblyopia inspectionSurveying module includes display module, detection module and authentication module.Display module is shown in response to the operation of triggering amblyopia detectionPreset amblyopia detection image.Detection module detection is directed to the judgement information of amblyopia detection image.Authentication module confirmation judgement letterBreath result whether consistent and according to confirmation with the information in preset amblyopia detection image obtains the testing result of amblyopia.
In one embodiment of the invention, amblyopia detection image includes eyesight detection image, Contrast Detection image, eyes suppressionAny two or more combination in processing procedure degree detection image or autokinesis detection image.
In one embodiment of the invention, Contrast Detection image is gabor filter profile, and gabor filter profile goes out at randomIt disappears after now a period of time, detection module detects the gabor filter profile of input within the period that gabor filter profile occursDirection.
In one embodiment of the invention, if the information of the judgement information and preset amblyopia detection image that continuously input three timesAmblyopia detection image that is consistent then showing promotes a detection level；If misjudgment is primary, the amblyopia detection image shownA detection level is reduced, detection level is lower, and characterization amblyopia is more serious, until ten detections terminate, display module statistics is lastThe detection levels of six detections are simultaneously shown after being averaged.
In one embodiment of the invention, eyes inhibition level detection image be simultaneously displaying on eyes screen by twoThe interference sine wave of opposite in phase is formed by two raster graphics with out of phase, brightness and contrast, judges to believeBreath is the pixel line being input on two screens, then when the pixel line of input is overlapped with the median vertical line in two raster graphicsThink that eyes are normal, if there is deviation, the pixel distance of deviation is that the brightness and contrast of eyes inhibits threshold value.
In one embodiment of the invention, the brightness and contrast of raster graphic corresponding to detected eyes is adjustable, justThe brightness and contrast of raster graphic corresponding to normal eyes locks 100%；Alternatively, raster graphic corresponding to eyes is brightDegree and contrast are adjustable.
In one embodiment of the invention, autokinesis detection image is to be presented on two screens corresponding to eyesMultiple movement beads, the bead in data side screen corresponding to detected eyes move according to a certain direction, the other sideBead random motion in noise side screen corresponding to eyes judges information for the direction of motion of bead in data side screen.
In one embodiment of the invention, the bead quantity phase under original state in data side screen and noise side screen is setDeng, authentication module confirmation input judges whether information is consistent with the direction of motion of bead in data side screen, if continuous threeSecondary confirmation is correct then in data side screen by a certain amount of quantity for reducing movement bead, and increases in the screen of noise side identicalThe bead of amount；If there is primary misjudgment, by a certain amount of quantity for increasing movement bead in data side screen, and making an uproarReduce same amount of bead in the screen of sound side, detects six times and obtain the variation of bead in data side screen in last five detectionsThe average value of amount and the ratio of the variable quantity of bead in the screen of noise side forms autokinesis testing result.
In conclusion amblyopia treatment system combination AR technology provided by the invention treats amblyopia, AR is a kind of increasingStrong reality technology, in amblyopia treatment, AR video module obtains environment locating for patient in real time, forms the object in AR scene,Amblyopia treatment image superposition is carried out amblyopia treatment to the object in AR scene by laminating module.This therapeutic modality patient only needs to wearThe variation of locating environment can be observed in real time while treatment by wearing AR glasses, not only will not influence the daily life of patientAnd relative to traditional covering method, high-tech AR glasses are more beautiful, and patient is also easier to receive treatment.Further, originallyThe amblyopia treatment system that invention provides carries out amblyopia treatment (traditional covering method is simple eye treatment) with principle is controlled using eyes, doubleEye solves the treatment of traditional covering method and the asthenopia of generation and controls with the eyesight that can balance eyes during treatment is controlledTreat excessive problem.
In addition, the amblyopia treatment system based on AR technology, by setting amblyopia detection module, display module carries out a variety of pre-If amblyopia detection image displaying, the judgement information of detection module detection input, authentication module by contrast judgement information andThe information of amblyopia standard pattern come obtain amblyopia detection result.Entire detection process will not be influenced by artificial subjectivity, patientAmblyopia detection can be carried out whenever and wherever possible without being detected to special testing agency, and this detection only needs patient onePeople can be completed, very easy to use.
For above and other objects of the present invention, feature and advantage can be clearer and more comprehensible, preferred embodiment is cited below particularly,And cooperate attached drawing, it is described in detail below.
Specific embodiment
It include as shown in Figure 1 obtaining module 1, superposition mould for the amblyopia treatment system provided in this embodiment based on AR technologyBlock 2 and rendering module 3.Obtain the object in the acquisition augmented reality AR scene of module 1.Laminating module 2 will be preset weakDepending on treatment image superposition into the object of AR scene.Rendering module 3 renders amblyopia treatment image according to the result that amblyopia detects, and makesThere is two width in amblyopia treatment image the pattern of identical visual to be presented with different rendering parameters.
Amblyopia treatment system provided in this embodiment is on the basis of AR technology using eyes with technology of controlling.Specifically,AR technology is a kind of augmented reality, and virtual information can be shown in true environment.Using in the present embodiment then are as follows:Amblyopia treatment image is shown in true environment.Patient need to only wear AR eyes in amblyopia treatment can observe its institute simultaneouslyThe environment and amblyopia treatment figure at place, will not impact its daily life, can at any time with carry out amblyopia treatment.Further, traditional amblyopia treatment device is using occlusion therapy method, and amblyopia patient needs to cover always in this therapeutic deviceEyes then cover normal eye for children whose monocular amblyopia, using amblyopia eye to improve eyesight；And then to replace for eyes amblyopiaCover eyes.Either eyes amblyopia or children whose monocular amblyopia, carrying out treatment patient using covering method can only use at any one timeOne eye eyeball, mono-vision object lacks sense of depth, and the high-incidence group of amblyopia is children, its shortage experience of life of children, mono-visionObject is easy to live to it and impact.
Therefore, for this problem, the amblyopia treatment system provided in this embodiment based on AR technology is controlled using eyes are samePrinciple.Amblyopia reason from brain visual cortex for visual signal error handle and non-ocular device Geological Problems itself.Therefore the same time is needed to give the same visual of eyes but different display effects, to stimulate and change cerebral cortex for viewThe false perception of feel after stimulating for a long time, can reverse and think to generate new nerve connection, achieve the effect that healing.It is wearingTwo eyes for wearing patient after AR glasses can see affairs, very easy to use；Further, AR glasses have certain sectionSkill sense, shape is also relatively beautiful, and patient is easier to receive, to greatly improve the career in medicine for the treatment of.The display effect isRealized by changing the rendering parameter of pattern, affiliated rendering parameter include the form and aspect of pattern, saturation degree, contrast, brightness,Colorfulness and gray scale.
The application method of amblyopia treatment system provided in this embodiment based on AR technology are as follows:
Firstly, obtaining the object in module acquisition augmented reality AR scene, i.e. ambient image locating for acquisition patient.In this present embodiment, obtaining module 1 is ccd image sensor.However, the present invention is not limited in any way this.In other implementationsIn example, obtaining module 1 can be cmos image sensor or other image acquisition devices.
After obtaining the object in AR scene, laminating module 2 will be in the AR scene of amblyopia treatment image superposition to acquisitionOn object, realizes virtual information and show the combination of information.
Finally, rendering module 3 renders amblyopia treatment figure according to amblyopia testing result, by changing amblyopia imageIn pattern of two width with identical visual rendering parameter come so that the two have different display effects.The rendering ginsengNumber includes the parameters such as form and aspect, saturation degree, contrast, brightness, colorfulness and the gray scale of pattern.Specifically, being examined according to amblyopiaIt surveys the image rendering that result carries out to refer to: when two eye visions are widely different, increasing the brightness ratio and comparison of two patternsRatio is spent, or is shown using widely different two different form and aspect.The continuous stimulation of eyes different display effects changesCerebral cortex is become for the false perception of vision, and for a long time after stimulation, can reverse and has thought to generate new nerve connectionTo cure amblyopia.
The present embodiment simply shows a kind of application method of the amblyopia treatment system based on AR technology.In other embodimentsIn, the amblyopia treatment system based on AR technology can use following sequence when in use: rendering module 3 is detected according to amblyopia firstAs a result amblyopia treatment image is rendered accordingly, obtains the object in the acquisition augmented reality AR scene of module 1 later,Last laminating module 2 is by the amblyopia treatment image superposition after rendering to the object in augmented reality AR scene to controlIt treats.
In this present embodiment, the amblyopia treatment system based on AR technology further includes amblyopia detection module 4, amblyopia detection moduleIt again include display module 41, detection module 42 and authentication module 43.The operation that display module 41 is detected in response to triggering amblyopia,Show preset amblyopia detection image.The detection of detection module 42 is directed to the judgement information of amblyopia detection image.Authentication module 43 is trueRecognize the detection for judging that information result whether consistent and according to confirmation with the information in preset amblyopia detection image obtains amblyopiaAs a result.
Existing amblyopia detection is detected only with international standard visual chart, and patient needs to specific mechanism (such asHospital) it is detected, the method for detection is single and detection accuracy is low.Amblyopia detection module provided in this embodiment is using multiple pre-If amblyopia detection image carry out amblyopia detection, greatly improve the detection accuracy of amblyopia, it is often more important that the testing result of amblyopiaBe by system by calculate and verifying after obtain, be subjective judgement there is no anyone, thus amblyopia patient can independently intoThe detection of row amblyopia, it is more convenient to use without being detected to specific mechanism.
In this present embodiment, the detection of amblyopia includes four aspects, is eyesight detection, Contrast Detection, eyes suppression respectivelyDegree detecting processed and autokinesis detection.Corresponding, amblyopia detection image includes eyesight detection image, Contrast DetectionImage, eyes inhibition level detection image and autokinesis detection image.However, the present invention is not limited in any way this.InIn other embodiments, amblyopia detection module may include the combination in above-mentioned four kinds of detection images more than any the two.In this implementationIn example, amblyopia detection module successively carries out eyesight detection, Contrast Detection, the detection of eyes inhibition level and autokinesis inspectionIt surveys.Likewise, the present invention is not limited in any way this.In other embodiments, above-mentioned four detection ordering can be adjusted.
It is detected compared to traditional amblyopia carried out only with international standard visual chart, amblyopia detection module provided by the inventionProvide multiple detection projects, can eyesight that is more accurate, accurately detecting patient it is horizontal, be especially adapted for use in children's this kindAbility to express is not group fine and that amblyopia rate is high.Further, in this present embodiment, display module 41 is set using VRThe standby displaying for carrying out preset amblyopia detection image, VR equipment generate the ring of amblyopia detection using virtual display technologyBorder is not limited by any place and equipment, more convenient to use.However, the present invention is not limited in any way this.In otherIn embodiment, display module 41 can be traditional display.
When carrying out eyesight detection, eyesight detection image includes multiple " E " words with different openings direction, such as comprising" E " word of the opening of upper and lower, left and right four direction.For with better detection accuracy, in this present embodiment, setting eyesight is examinedAltimetric image appears randomly in VR scene to disappear after a period of time.Preferably, the time that setting eyesight detection image occurs is 0.5Second.However, the present invention is not limited in any way this.Within the period that eyesight detection image occurs, patient passes through external inputJudge information.As inputted observed by patient the opening direction of " E " word by the handle with direction key or passing through handThe variation of gesture is inputted.Detection module 42 detects opening for " E " word of input within the period that eyesight detection image occursMouthful direction, the opening of " E " word of 43 confirmation input of authentication module towards the opening with " E " word in eyesight detection image whether oneIt causes.When the judgement information (the opening direction of " E " word) continuously inputted three times is consistent with the information in eyesight detection image, showAmblyopia detection image promote a detection level, as being " E " word is changed to that eyesight is 1.0 corresponding to 0.8 " E " by eyesightWord.If there is primary misjudgment, the amblyopia detection image of displaying is reduced into a detection level, as being 0.8 institute by eyesightCorresponding " E " word is changed to " E " word that eyesight is 0.6, and detection level is lower, and characterization amblyopia is more serious.Mould is verified in detection ten timesThe eyesight grade that block 43 takes last six detections corresponding is the result of eyesight detection and is shown the testing result.Pass throughWireless data transfer module, testing result can be both shown on the intelligent terminal of patient, while can also be in long-range intelligenceIt is shown in terminal, long-range displaying facilitates doctor to the real-time monitoring of patient's vision state.
Degree of comparing detects after the completion of eyesight detection, and display module 41 is by Contrast Detection image superposition in VR sceneIn object in.In this present embodiment, Contrast Detection image is gabor filter profile.However, the present invention this is not made it is anyIt limits.Identical with eyesight detection, gabor filter profile appears randomly in the object of VR scene to disappear after a period of time.?In the period that gabor filter profile occurs, patient carries out judging the defeated of information by handle with direction key or gestureEnter.Detection module 42 detects the direction of the gabor filter profile of input within the period that gabor filter profile occurs.
Fig. 2 a show the gabor filter profile that contrast is 18% in the amblyopia treatment system based on AR technology.Fig. 2 bIt show the gabor filter profile that contrast is 58% in the amblyopia treatment system based on AR technology.Fig. 2 c is shown based on ARThe gabor filter profile that contrast is 100% in the amblyopia treatment system of technology.When the judgement information that patient continuously inputs three timesConsistent with the direction of the gabor filter profile currently shown, gabor filter profile promotes a detection level, i.e. reduction gaborThe brightness and contrast of filter profile is such as switched to Fig. 2 a from Fig. 2 b.When the judgement information that once inputs and current occurs in patientWhen the direction of the gabor filter profile of display is inconsistent, gabor filter profile reduces a detection level, such as switches from Fig. 2 bTo gabor filter profile shown in Fig. 2 c.Detection level is lower, and the brightness and contrast of gabor filter profile is more obvious, patientMore it is easily observed that the direction of gabor filter profile, corresponding amblyopia are also more serious.It is continuous to detect ten times and take last six inspectionsThe average value of the detection level of survey is spent the result of detection as a comparison and is shown.Last six works are chosen in ten detectionsFor valid data, it is contemplated that patient needs certain adaptation time when detecting, and four times initial detections are used for the mould of patientQuasi-, latter six times detections can accurately reflect that the current eyesight of patient's eye is horizontal.
The present embodiment simply shows the grade of three contrasts of gabor filter profile.However, the present invention does not make thisAny restriction.In other embodiments, to detect amblyopia more accurately, settable multiple contrast change intervals are smallGabor filter profile.
The detection of eyes inhibition level is carried out after the completion of Contrast Detection, eyesight detection, contrast in the detection of amblyopiaDetection and autokinesis detection are simple eye test, which eye patient can determine by external input device when detectingEyeball is as tested eye, and in addition one eye is then defaulted as normal eyes.And the detection of eyes inhibition level is the detection of eyes double screen.As shown in Figure 3a and Figure 3b shows, eyes inhibition level detection image is the interference by two opposite in phase being shown on eyes screenSine wave is formed by two raster graphics with out of phase, brightness and contrast.The phase of sine wave in raster graphicPosition range is 180 degree, and the period is two periods.It is when detecting that detected eyes is enabled accurately to observe raster graphic,The brightness and contrast of raster graphic corresponding to settable detected eyes is adjustable (specifically, can be defeated by handle etc.Enter the change that equipment carries out parameter), and the brightness and contrast of raster graphic corresponding to normal eye locking 100%.However,The present invention is not limited in any way this.In other embodiments, the brightness and comparison of raster graphic corresponding to settable eyesIt spends adjustable.
When eyes are with two screens of view, brain visual centre will generate fusion visual experience.If eyes are normal, patientThe median vertical line of two raster graphics can be found easily, and tester is moved by input equipment (induction of such as handle or gesture) at this timeDynamic pixel line, is overlapped it with the median vertical line of two raster graphics.If wherein one eye eyeball is abnormal, side there will necessarily beCerebral cortex has exception for brightness and contrast's perception, then the median vertical line of two discovered at this time raster graphic does not exist certainlyCorrect position, distance is then the inhibition level fault of eyes between the pixel line inputted at this time and the median vertical line of two raster graphicsValue.
After obtaining the detection of eyes inhibition level, in this present embodiment, amblyopia detection module also carries out autokinesis inspectionIt surveys.Autokinesis detection image is the multiple movement beads being presented on two screens corresponding to eyes, detected eyeBead in data side screen corresponding to eyeball moves according to a certain direction, in noise side screen corresponding to the eyes of the other sideBead random motion, judge information for the direction of motion of bead in data side screen.Specifically, original state eyes institute is right50 beads are respectively distributed in the screen answered, the bead in data side screen moves according to a certain direction, and has in same frame5% random small club disappears simultaneously, and random site occurs again, occurs again in the other end again when moving to boundary.And noise sideBead then random motion in screen.Patient passes through the direction of motion of the bead in the screen of input equipment input signal side, when evenThe continuous judgement information inputted three times is consistent with the direction of motion of bead in data side screen, reduces signal according to a certain percentageBead quantity in the screen of side, and increase the bead quantity of equivalent in the screen of noise side.When appearance once judges information and letterWhen the direction of motion of bead in number side screen is inconsistent, then increase the bead quantity in data side screen according to a certain percentage,And reduce the bead quantity of equivalent in the screen of noise side.Preferably, the variation ratio that bead is arranged is 20%.However, this hairIt is bright that this is not limited in any way.Detection six times simultaneously obtains in last five detections the quantity of bead and noise side in data side screenThe average value of the ratio of bead quantity in screen forms autokinesis testing result.
It is when detecting the direction of motion that can preferably observe bead, raster graphic corresponding to settable data side screenBrightness and contrast it is adjustable (specifically, change that the input equipments such as handle carry out parameter can be passed through), and noise side screenBrightness and contrast locking 100%.However, the present invention is not limited in any way this.In other embodiments, settable signalThe brightness and contrast of side screen and noise side screen is adjustable.
Amblyopia is examined after completing eyesight detection, Contrast Detection, the detection of eyes inhibition level and autokinesis and detectingSurvey module will test data send rendering module, patient intelligent terminal (on such as mobile phone or on IPAD) or cured mainly positioned at long-rangeOn the computer of doctor, attending physician can be in the eyesight situation of change for remotely checking patient, thus so timely that provide treatment advice.Wash with watercoloursThe result that contaminating module can then detect according to amblyopia carries out the rendering of amblyopia treatment image.
In conclusion the amblyopia treatment system combination AR technology provided by the invention based on AR technology controls amblyopiaIt treats, AR is a kind of augmented reality, and in amblyopia treatment, AR video module obtains environment locating for patient in real time, forms ARAmblyopia treatment image superposition is carried out amblyopia treatment to the object in AR scene by the object in scene, laminating module.This treatmentMode patient need to only wear AR glasses can observe in real time the variation of locating environment while treatment, not only will not influenceThe daily life of patient and relative to traditional covering method, high-tech AR glasses are more beautiful, and patient is also easier to receive to controlIt treats.Further, amblyopia treatment system provided by the invention carries out amblyopia treatment (traditional covering method with principle is controlled using eyesIt is simple eye treatment), eyes solve the treatment of traditional covering method and generation with the eyesight that can balance eyes during treatment is controlledAsthenopia and the excessive problem for the treatment of.
In addition, the amblyopia treatment system based on AR technology, by setting amblyopia detection module, display module carries out a variety of pre-If amblyopia detection image displaying, the judgement information of detection module detection input, authentication module by contrast judgement information andThe information of amblyopia standard pattern come obtain amblyopia detection result.Entire detection process will not be influenced by artificial subjectivity, patientAmblyopia detection can be carried out whenever and wherever possible without being detected to special testing agency, and this detection only needs patient onePeople can be completed, very easy to use.
Although the present invention is disclosed above by preferred embodiment, however, it is not intended to limit the invention, this any known skillSkill person can make some changes and embellishment without departing from the spirit and scope of the present invention, therefore protection scope of the present invention is worked asSubject to claims range claimed.