技术领域technical field
本发明属于可使眼科病人用别种感觉代替直接视觉的仪器或方法技术领域，具体的为一种视觉辅助眼镜及其图像识别方法。The invention belongs to the technical field of instruments or methods that enable ophthalmology patients to replace direct vision with other senses, in particular to a kind of visual aid glasses and an image recognition method thereof.
背景技术Background technique
系视觉障碍指由于先天或后天原因，导致视觉器官(眼球视觉神经、大脑视觉中心)的构造或机能发生部分或全部障碍，经治疗仍对外界事物无法(或甚难)作视觉辨识。依据相关规定，视觉未达0.3，或视野在20°以内者即为视觉障碍。根据障碍程度不同，视觉障碍可以分为两类:两眼视力测定值在0.03以上未达0.3或其视野在20°以内为弱视；两眼视力测定值未达0.03为全盲。弱视人群通常可以利用视觉进行日常生活，但是在视物方面有一定障碍，一般需要借助光学辅助设备或特殊放大设备来观察事物。但是弱视本身也有极大不同：既有缺乏立体感的，对光线敏感的，无法辨识色彩的，也有视野过于狭窄的。Visual impairment refers to congenital or acquired reasons that cause partial or complete impairment of the structure or function of the visual organs (eyeball optic nerve, brain visual center), and it is still impossible (or very difficult) to visually recognize external things after treatment. According to the relevant regulations, those whose vision does not reach 0.3, or whose field of vision is within 20°, are considered to be visually impaired. According to the different degrees of impairment, visual impairment can be divided into two categories: amblyopia if the measured value of visual acuity in both eyes is above 0.03 but less than 0.3 or its visual field is within 20°; total blindness is defined as the measured value of visual acuity in both eyes is less than 0.03. People with amblyopia can usually use their vision to carry out daily life, but they have certain obstacles in seeing things, and generally need to use optical aids or special magnifying devices to observe things. But amblyopia itself is very different: there are those who lack stereoscopic vision, those who are sensitive to light, those who cannot distinguish colors, and those whose field of vision is too narrow.
视觉性辅具是指可以通过视觉途径帮助视障者提高视觉能力的设备或装置，又分为光学、非光学、电子助视器三类。光学助视器比较常见，有手持、立式放大镜，眼镜式、单筒、双筒望远镜等。光学助视器具有容易使用、携带方便、价格低等特点，也是低视力患者使用的主要助视器具；但它也存在一些使用上的局限性，如放大倍数低，阅读范围小，长期使用会引起姿势不良，会受到光源的影响等。非光学助视器，指通过改善周围的环境来提高视觉效果。如：放大的印刷品以改变阅读物的大小，高强度的照射器以增加对比度，高对比度的物件以利于局部物品的区分等。电子助视器是一种电子视讯装置，能将阅读的文件、图片、观察的物品等通过摄影镜头，将影像传送到屏幕上供使用者浏览。Visual aids refer to equipment or devices that can help visually impaired people improve their visual abilities through visual means, and are divided into three categories: optical, non-optical, and electronic vision aids. Optical vision aids are relatively common, including handheld and standing magnifying glasses, glasses, monoculars, and binoculars. Optical vision aids are easy to use, easy to carry, and low in price. They are also the main vision aids used by low-vision patients; but they also have some limitations in use, such as low magnification, small reading range, and long-term use. Causes poor posture, will be affected by the light source, etc. Non-optical vision aids refer to improving visual effects by improving the surrounding environment. Such as: enlarged printed matter to change the size of the reading material, high-intensity illuminators to increase contrast, high-contrast objects to facilitate the distinction of local items, etc. The electronic vision aid is an electronic video device, which can transmit the read documents, pictures, observed objects, etc. through the camera lens to the screen for users to browse.
综上可知，现有的电子助视器一般采用放大影像的方式来使视觉障碍者看清外界事物，虽然在一定程度上能够满足使用要求，但是这样的电子助视器一方面存在结构复杂(需要内置或外置显示屏)的缺点，另一方面，对于一些视觉障碍者而言，放大的影像仍不足以使其看清外界事物。To sum up, it can be seen that the existing electronic vision aids generally use enlarged images to enable the visually impaired to see external things clearly. Although they can meet the requirements of use to a certain extent, on the one hand, such electronic vision aids have complex structures ( On the other hand, for some visually impaired people, the magnified image is still not enough to make them see the outside world clearly.
发明内容Contents of the invention
有鉴于此，本发明的目的在于提供一种视觉辅助眼镜及其图像识别方法，能够实时采集佩戴者手指所指位置处的现实场景，并通过图像处理将现实场景内的信息通过语音等方式反馈给佩戴者，达到辅助视觉的目的。In view of this, the object of the present invention is to provide a kind of visual aid glasses and its image recognition method, which can collect the real scene at the position pointed by the wearer's finger in real time, and feed back the information in the real scene through voice and other ways through image processing For the wearer, to achieve the purpose of assisting vision.
为达到上述目的，本发明提供如下技术方案：To achieve the above object, the present invention provides the following technical solutions:
本发明首先提出了一种视觉辅助眼镜，包括眼镜架，所述眼镜架上安装设有用于对佩戴者所指位置进行拍照的摄像头、用于对所述摄像头拍摄的图像进行图像处理的图像处理器和用于将图像处理结果反馈给佩戴者的人机交互设备；所述摄像头和人机交互设备均与所述图像处理器电连接，且所述人机交互设备包括佩戴在佩戴者耳部的耳机或骨传导耳机。The present invention firstly proposes a kind of visual aid glasses, including a spectacle frame, a camera for taking pictures of the position pointed by the wearer is installed on the spectacle frame, and an image processing device for image processing the image captured by the camera. and a human-computer interaction device for feeding back image processing results to the wearer; both the camera and the human-computer interaction device are electrically connected to the image processor, and the human-computer interaction device includes a headphones or bone conduction headphones.
进一步，所述人机交互设备还包括设置在所述眼镜架上的微振动器。Further, the human-computer interaction device further includes a micro-vibrator arranged on the spectacle frame.
本发明还提出了一种如上所述视觉辅助眼镜的图像识别方法，包括佩戴者手指识别方法和佩戴者手指所指区域图像识别方法；The present invention also proposes an image recognition method for the aforementioned visual aid glasses, including a wearer's finger recognition method and a wearer's finger-pointing area image recognition method;
所述佩戴者手指识别方法包括如下步骤：The wearer's finger recognition method comprises the steps of:
1)佩戴者的其中一根手指伸出并指向需要识别的区域位置处，所述摄像头对佩戴者手部及其所指区域进行摄像，并将拍摄的图像传输至所述图像处理器；1) One of the wearer's fingers stretches out and points to the position of the area to be identified, the camera takes pictures of the wearer's hand and the area it points to, and transmits the captured image to the image processor;
2)所述图像处理器识别出佩戴者整个手部的手势图像轮廓；2) The image processor recognizes the gesture image outline of the wearer's entire hand;
3)在所述手势图像轮廓上取若干点并垂直做射线，每一个点上的射线为两条，且位于所述手势图像轮廓内的一条射线与所述手势图像轮廓相交形成一段线段；采集线段的长度数据，且当线段的长度增长或缩短的速率大于设定的阀值时，所述图像处理器则将该手势图像轮廓区域认定为佩戴者手指所在位置区域；3) Take several points on the outline of the gesture image and make rays vertically, the rays on each point are two, and a ray located in the outline of the gesture image intersects with the outline of the gesture image to form a line segment; The length data of the line segment, and when the length of the line segment increases or decreases at a rate greater than a set threshold, the image processor identifies the gesture image contour area as the area where the wearer's finger is located;
4)按照预设要求放大或缩小所述佩戴者手指所在位置区域，并将其与预存在所述图像处理器内的佩戴者手指图像轮廓模型进行对比；4) Enlarging or reducing the area where the wearer's finger is located according to preset requirements, and comparing it with the image contour model of the wearer's finger pre-stored in the image processor;
5)若对比识别成功，则对比失败次数清零，并找出所述手势图像轮廓中的指尖所在位置，并将对比成功的信息通过人机交互设备反馈给佩戴者；若对比失败，则对比失败次数加1，若对比失败次数小于设定次数，则重复步骤3)和步骤4)，若对比失败次数等于设定次数，将对比失败的信息通过人机交互设备反馈给佩戴者，并根据佩戴者指令结束图像识别或重复步骤1)至步骤4)；5) If the comparison and recognition is successful, the number of comparison failures is cleared, and the position of the fingertip in the outline of the gesture image is found, and the information of the comparison success is fed back to the wearer through the human-computer interaction device; if the comparison fails, then Add 1 to the number of comparison failures. If the number of comparison failures is less than the set number of times, repeat steps 3) and 4). End image recognition or repeat steps 1) to 4) according to the wearer's instruction;
所述佩戴者手指所指区域图像识别方法识别所述手指指尖所指位置区域的图像信息，并将该图像信息通过所述人机交互设备反馈至佩戴者。The method for recognizing the image of the region pointed by the wearer's finger recognizes the image information of the region pointed by the fingertip, and feeds the image information back to the wearer through the human-computer interaction device.
进一步，所述步骤2)中，采用基于深度的识别算法或基于灰度的识别算法识别出佩戴者整个手部的手势图像轮廓。Further, in the step 2), a depth-based recognition algorithm or a grayscale-based recognition algorithm is used to recognize the gesture image outline of the wearer's entire hand.
本发明的有益效果在于：The beneficial effects of the present invention are:
本发明的视觉辅助眼镜，通过摄像头对佩戴者手部及周边区域进行摄像，而后通过佩戴者手指识别方法识别佩戴者伸出手指的指尖位置，利用现有的图像识别技术对指尖所指区域的图像进行处理分析，并将分析处理后的结果通过耳机或骨传导耳机反馈给佩戴者，使佩戴者能够正确识别器指尖所指物品，避免了如现有的电子助视器仍采用图像反馈而导致使用者看不清的缺陷，即本发明的视觉辅助眼镜能够实时采集佩戴者手指所指位置处的现实场景，并通过图像处理将现实场景内的信息通过语音等方式反馈给佩戴者，达到辅助视觉的目的，适用于视力衰弱，减退；色盲，色弱，远近视，老花等视力受损者而非全盲者。The visual aid glasses of the present invention use a camera to take pictures of the wearer's hands and surrounding areas, and then use the wearer's finger recognition method to identify the position of the fingertip of the wearer's extended finger, and use the existing image recognition technology to identify where the fingertip is pointing. The image of the area is processed and analyzed, and the results of the analysis and processing are fed back to the wearer through earphones or bone conduction earphones, so that the wearer can correctly identify the object pointed by the fingertip, avoiding the use of electronic vision aids such as existing The defect that the user cannot see clearly due to image feedback, that is, the visual aid glasses of the present invention can collect the real scene at the position pointed by the wearer's finger in real time, and feed back the information in the real scene to the wearer through voice and other means through image processing. For those who achieve the purpose of assisting vision, it is suitable for people with weak or diminished vision; color blindness, color weakness, farsightedness, presbyopia and other visually impaired people rather than blind people.
附图说明Description of drawings
为了使本发明的目的、技术方案和有益效果更加清楚，本发明提供如下附图进行说明：In order to make the purpose, technical scheme and beneficial effect of the present invention clearer, the present invention provides the following drawings for illustration:
图1为本发明视觉辅助眼镜实施例的结构示意图；Fig. 1 is a schematic structural view of an embodiment of visual aid glasses of the present invention;
图2为手势图像轮廓的结构示意图；Fig. 2 is a structural schematic diagram of a gesture image profile;
图3为在手势图像轮廓上取点并做射线的结构示意图(仅标注了位于手势图像轮廓内的射线)；Fig. 3 is a structural schematic diagram of taking points and making rays on the outline of the gesture image (only marking the rays located in the outline of the gesture image);
图4为射线与手势图像轮廓相交形成线段时的结构示意图；Fig. 4 is a schematic diagram of the structure when the ray intersects with the outline of the gesture image to form a line segment;
图5为手指所在区域的线段长度变化的结构示意图；Fig. 5 is a structural schematic diagram of the change in the length of the line segment in the area where the finger is located;
图6为将佩戴者手指所在位置区域与预存的佩戴者手指图像轮廓模型进行对比的原理图；Fig. 6 is a schematic diagram of comparing the position area of the wearer's finger with the pre-stored wearer's finger image contour model;
图7为采用本实施例的视觉辅助眼镜识别红绿灯或站牌信息时的使用状态参考图；FIG. 7 is a reference diagram of the use state when the visual aid glasses of this embodiment are used to identify traffic lights or stop sign information;
图8为采用本实施例的视觉辅助眼镜识别汽车时的使用状态参考图；FIG. 8 is a reference diagram of the use state when the visual aid glasses of this embodiment are used to identify a car;
图9为采用本实施例的视觉辅助眼镜识别书本或报纸上的文字时的使用状态参考图；FIG. 9 is a reference diagram of the use state when using the visual aid glasses of this embodiment to recognize characters on books or newspapers;
具体实施方式detailed description
下面结合附图和具体实施例对本发明作进一步说明，以使本领域的技术人员可以更好的理解本发明并能予以实施，但所举实施例不作为对本发明的限定。The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments, so that those skilled in the art can better understand the present invention and implement it, but the examples given are not intended to limit the present invention.
如图1所示，为本发明视觉辅助眼镜实施例的结构示意图。本实施例的视觉辅助眼镜，包括眼镜架1，眼镜架1上安装设有用于对佩戴者所指位置进行拍照的摄像头2、用于对摄像头2拍摄的图像进行图像处理的图像处理器3和用于将图像处理结果反馈给佩戴者的人机交互设备4。摄像头2和人机交互设备4均与图像处理器3电连接，且人机交互设备4包括佩戴在佩戴者耳部的耳机或骨传导耳机，当佩戴者听力正常时，则采用耳机即可满足使用要求；若佩戴者有听力障碍时，则需佩戴骨传导耳机。As shown in FIG. 1 , it is a schematic structural diagram of an embodiment of the vision aid glasses of the present invention. The visual aid glasses of this embodiment comprise a spectacle frame 1, on which a camera 2 for taking pictures of the position pointed by the wearer, an image processor 3 for image processing the images captured by the camera 2, and A human-computer interaction device 4 for feeding back image processing results to the wearer. Both the camera 2 and the human-computer interaction device 4 are electrically connected to the image processor 3, and the human-computer interaction device 4 includes earphones or bone conduction earphones worn on the ears of the wearer. Requirements for use; if the wearer has hearing impairment, he needs to wear bone conduction earphones.
进一步，人机交互设备4还包括设置在眼镜架上的微振动器，可通过微振动器的不同震动模式来将手指识别成功或失败的信息反馈给佩戴者。Further, the human-computer interaction device 4 also includes a micro-vibrator arranged on the spectacle frame, which can feed back information about the success or failure of finger recognition to the wearer through different vibration modes of the micro-vibrator.
下面对采用本实施例的视觉辅助眼镜进行图像识别的方法进行详细说明。The method for image recognition using the visual aid glasses of this embodiment will be described in detail below.
本实施例视觉辅助眼镜的图像识别方法，包括佩戴者手指识别方法和佩戴者手指所指区域图像识别方法；The image recognition method of the visual aid glasses in this embodiment includes a wearer's finger recognition method and an image recognition method of the area pointed by the wearer's finger;
其中，佩戴者手指识别方法包括如下步骤：Wherein, the wearer's finger identification method includes the following steps:
1)佩戴者的其中一根手指伸出并指向需要识别的区域位置处，摄像头2对佩戴者手部及其所指区域进行摄像，并将拍摄的图像传输至图像处理器3；1) One of the fingers of the wearer stretches out and points to the position of the area to be identified, the camera 2 takes pictures of the wearer's hand and the area it points to, and transmits the captured image to the image processor 3;
2)图像处理器3识别出佩戴者整个手部的手势图像轮廓，如图2所示，现有的可识别佩戴者整个手部的手势图像轮廓的方法有多种，如可采用基于深度的识别算法或基于灰度的识别算法识别出佩戴者整个手部的手势图像轮廓，本实施例采用基于深度的识别算法识别出佩戴者整个手部的手势图像轮廓；2) The image processor 3 recognizes the gesture image contour of the wearer's entire hand, as shown in Figure 2, there are many existing methods for recognizing the gesture image contour of the wearer's entire hand, such as depth-based The recognition algorithm or the grayscale-based recognition algorithm recognizes the gesture image contour of the wearer's entire hand. In this embodiment, the depth-based recognition algorithm is used to recognize the gesture image contour of the wearer's entire hand;
3)在手势图像轮廓上取若干点并垂直做射线，每一个点上的射线为两条，且位于手势图像轮廓内的一条射线与手势图像轮廓相交形成一段线段，如图3和图4所示；采集线段的长度数据，且当线段的长度增长或缩短的速率大于设定的阀值时，图像处理器则将该手势图像轮廓区域认定为佩戴者手指所在位置区域，如图5所示；3) Take several points on the contour of the gesture image and make vertical rays. There are two rays on each point, and a ray located in the contour of the gesture image intersects with the contour of the gesture image to form a line segment, as shown in Figure 3 and Figure 4 display; collect the length data of the line segment, and when the length of the line segment grows or shrinks faster than the set threshold value, the image processor identifies the contour area of the gesture image as the area where the wearer's finger is located, as shown in Figure 5 ;
4)按照预设要求放大或缩小佩戴者手指所在位置区域，并将其与预存在图像处理器内的佩戴者手指图像轮廓模型进行对比，如图6所示；4) Enlarge or reduce the area where the wearer's finger is located according to the preset requirements, and compare it with the image contour model of the wearer's finger pre-stored in the image processor, as shown in Figure 6;
5)若对比识别成功，则对比失败次数清零，并找出手势图像轮廓中的指尖所在位置，并将对比成功的信息通过人机交互设备4反馈给佩戴者；若对比失败，则对比失败次数加1，若对比失败次数小于设定次数，则重复步骤3)和步骤4)，若对比失败次数等于设定次数，将对比失败的信息通过人机交互设备反馈给佩戴者，并根据佩戴者指令结束图像识别或重复步骤1)至步骤4)；5) If the comparison recognition is successful, the number of comparison failures is cleared, and the position of the fingertip in the outline of the gesture image is found, and the information of the comparison success is fed back to the wearer through the human-computer interaction device 4; if the comparison fails, the comparison Add 1 to the number of failed comparisons. If the number of comparison failures is less than the set number, repeat steps 3) and 4). The wearer instructs to end image recognition or repeat steps 1) to 4);
本实施例的设定次数取值为5，在使用过程中，在其他未伸出的手指处可能会存在凸起，在该凸起处，线段的长度变化速率会大于设定的阀值，此时图像处理器3会将手势图像轮廓在该凸起的位置区域与预存在图像处理器内的佩戴者手指图像轮廓模型进行对比，对比则会失败；通过限定失败次数为5次，一方面可避免进入循环对比的死循环，另一方面可充分考虑到5根手指均可进行充分对比，进而实现对手势图像轮廓的全方位对比，当然，该设定次数还可设定为6次及6次以上，其原理相当，不再累述。The set number of times in this embodiment is set to 5. During use, there may be protrusions at other unstretched fingers. At this protrusion, the rate of change of the length of the line segment will be greater than the set threshold. At this moment, the image processor 3 will compare the gesture image contour with the wearer's finger image contour model pre-stored in the image processor in the raised position area, and the comparison will fail; by limiting the number of failures to 5 times, on the one hand It can avoid entering into an endless loop of cyclic comparison. On the other hand, it can be fully considered that all 5 fingers can be fully compared, so as to realize an all-round comparison of gesture image outlines. Of course, the setting times can also be set to 6 times or less. More than 6 times, the principle is the same, so I won't repeat it here.
佩戴者手指所指区域图像识别方法识别手指指尖所指位置区域的图像信息，并将该图像信息通过人机交互设备4反馈至佩戴者，其中佩戴者手指所指区域图像识别方法可采用现有的多种图像识别方法实现，这些识别方法均能够正确识别手指所指物品的信息，不再累述。The image recognition method of the area pointed by the finger of the wearer recognizes the image information of the area pointed by the fingertip, and feeds back the image information to the wearer through the human-computer interaction device 4, wherein the image recognition method of the area pointed by the wearer's finger can adopt the current Some image recognition methods are implemented, and these recognition methods can correctly recognize the information of the object pointed by the finger, so it will not be repeated here.
本实施例的视觉辅助眼镜，通过摄像头对佩戴者手部及周边区域进行摄像，而后通过佩戴者手指识别方法识别佩戴者伸出手指的指尖位置，利用现有的图像识别技术对指尖所指区域的图像进行处理分析，并将分析处理后的结果通过耳机或骨传导耳机反馈给佩戴者，使佩戴者能够正确识别器指尖所指物品，避免了如现有的电子助视器仍采用图像反馈而导致使用者看不清的缺陷，即本实施例的视觉辅助眼镜能够实时采集佩戴者手指所指位置处的现实场景，并通过图像处理将现实场景内的信息通过语音等方式反馈给佩戴者，达到辅助视觉的目的，适用于视力衰弱，减退；色盲，色弱，远近视，老花等视力受损者而非全盲者。The visual aid glasses of this embodiment use the camera to take pictures of the wearer's hand and the surrounding area, and then use the wearer's finger recognition method to recognize the position of the fingertip of the wearer's extended finger, and use the existing image recognition technology to identify the position of the fingertip. The images of the fingertips are processed and analyzed, and the results of the analysis and processing are fed back to the wearer through earphones or bone conduction earphones, so that the wearer can correctly identify the object pointed by the fingertip, avoiding the still The defect that the user cannot see clearly due to the use of image feedback, that is, the visual aid glasses of this embodiment can collect the real scene at the position pointed by the wearer's finger in real time, and feed back the information in the real scene through voice and other means through image processing For the wearer, to achieve the purpose of assisting vision, it is suitable for people with weakened or reduced vision; color blindness, color weakness, far-sightedness, presbyopia and other vision-impaired people instead of blind people.
以上所述实施例仅是为充分说明本发明而所举的较佳的实施例，本发明的保护范围不限于此。本技术领域的技术人员在本发明基础上所作的等同替代或变换，均在本发明的保护范围之内。本发明的保护范围以权利要求书为准。The above-mentioned embodiments are only preferred embodiments for fully illustrating the present invention, and the protection scope of the present invention is not limited thereto. Equivalent substitutions or transformations made by those skilled in the art on the basis of the present invention are all within the protection scope of the present invention. The protection scope of the present invention shall be determined by the claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610312871.6ACN106249866B (en) | 2016-05-12 | 2016-05-12 | Vision auxiliary eyeglasses and its image-recognizing method |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610312871.6ACN106249866B (en) | 2016-05-12 | 2016-05-12 | Vision auxiliary eyeglasses and its image-recognizing method |
| Publication Number | Publication Date |
|---|---|
| CN106249866Atrue CN106249866A (en) | 2016-12-21 |
| CN106249866B CN106249866B (en) | 2018-11-13 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610312871.6AActiveCN106249866B (en) | 2016-05-12 | 2016-05-12 | Vision auxiliary eyeglasses and its image-recognizing method |
| Country | Link |
|---|---|
| CN (1) | CN106249866B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107007437A (en)* | 2017-03-31 | 2017-08-04 | 北京邮电大学 | Interactive blind person's householder method and equipment |
| CN109542231A (en)* | 2018-11-29 | 2019-03-29 | 达闼科技（北京）有限公司 | A kind of method, apparatus of feedback information, electronic equipment and storage medium |
| CN109559536A (en)* | 2018-12-10 | 2019-04-02 | 百度在线网络技术（北京）有限公司 | Traffic lights, traffic light recognition method, device, equipment and storage medium |
| CN114302129A (en)* | 2021-12-27 | 2022-04-08 | 杭州瑞杰珑科技有限公司 | Eyesight assisting method and system based on AR |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE202008003455U1 (en)* | 2008-03-11 | 2008-07-03 | Chen, Lu, Dr. | Portable device as a guide for the blind |
| US20120249797A1 (en)* | 2010-02-28 | 2012-10-04 | Osterhout Group, Inc. | Head-worn adaptive display |
| CN103720576A (en)* | 2013-11-27 | 2014-04-16 | 山东科技大学 | Navigation glasses for the blind |
| CN104143084A (en)* | 2014-07-17 | 2014-11-12 | 武汉理工大学 | Assistive reading glasses for visually impaired people |
| KR20150012173A (en)* | 2013-07-24 | 2015-02-03 | 김도영 | reading glasses for the blind |
| CN104473717A (en)* | 2014-12-04 | 2015-04-01 | 上海交通大学 | Wearable guide apparatus for totally blind people |
| CN104983511A (en)* | 2015-05-18 | 2015-10-21 | 上海交通大学 | Voice-helping intelligent glasses system aiming at totally-blind visual handicapped |
| TW201603791A (en)* | 2014-07-31 | 2016-02-01 | Richplay Information Co Ltd | Blind-guide mobile device positioning system and operation method thereof |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE202008003455U1 (en)* | 2008-03-11 | 2008-07-03 | Chen, Lu, Dr. | Portable device as a guide for the blind |
| US20120249797A1 (en)* | 2010-02-28 | 2012-10-04 | Osterhout Group, Inc. | Head-worn adaptive display |
| KR20150012173A (en)* | 2013-07-24 | 2015-02-03 | 김도영 | reading glasses for the blind |
| CN103720576A (en)* | 2013-11-27 | 2014-04-16 | 山东科技大学 | Navigation glasses for the blind |
| CN104143084A (en)* | 2014-07-17 | 2014-11-12 | 武汉理工大学 | Assistive reading glasses for visually impaired people |
| TW201603791A (en)* | 2014-07-31 | 2016-02-01 | Richplay Information Co Ltd | Blind-guide mobile device positioning system and operation method thereof |
| CN104473717A (en)* | 2014-12-04 | 2015-04-01 | 上海交通大学 | Wearable guide apparatus for totally blind people |
| CN104983511A (en)* | 2015-05-18 | 2015-10-21 | 上海交通大学 | Voice-helping intelligent glasses system aiming at totally-blind visual handicapped |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107007437A (en)* | 2017-03-31 | 2017-08-04 | 北京邮电大学 | Interactive blind person's householder method and equipment |
| CN109542231A (en)* | 2018-11-29 | 2019-03-29 | 达闼科技（北京）有限公司 | A kind of method, apparatus of feedback information, electronic equipment and storage medium |
| CN109542231B (en)* | 2018-11-29 | 2022-04-08 | 达闼科技（北京）有限公司 | Method and device for feeding back information, electronic equipment and storage medium |
| CN109559536A (en)* | 2018-12-10 | 2019-04-02 | 百度在线网络技术（北京）有限公司 | Traffic lights, traffic light recognition method, device, equipment and storage medium |
| CN114302129A (en)* | 2021-12-27 | 2022-04-08 | 杭州瑞杰珑科技有限公司 | Eyesight assisting method and system based on AR |
| Publication number | Publication date |
|---|---|
| CN106249866B (en) | 2018-11-13 |
| Publication | Publication Date | Title |
|---|---|---|
| US9101459B2 (en) | Apparatus and method for hierarchical object identification using a camera on glasses | |
| CN104306102B (en) | For the wear-type vision-aided system of dysopia patient | |
| CN112601509B (en) | Hybrid perspective augmented reality system and method for low vision users | |
| CN106249866B (en) | Vision auxiliary eyeglasses and its image-recognizing method | |
| CN102610184B (en) | Method and device for adjusting display state | |
| CN205318022U (en) | Wearable intelligent vision enhancement equipment | |
| DE112015002673T5 (en) | Display for information management | |
| CN104036270B (en) | A kind of instant automatic translation device and method | |
| CN107307981A (en) | Visual training method based on eye movement | |
| CN106618479B (en) | Pupil tracking system and method thereof | |
| CN107818569B (en) | A kind of visual impairment monitoring alarm method | |
| CN102043942A (en) | Visual direction judging method, image processing method and device, and display device | |
| CN110286759A (en) | The adaptive amplification display method of terminal, system and terminal based on eye tracking | |
| CN110349383A (en) | A kind of intelligent eyeshield device and method | |
| WO2016086438A1 (en) | Head-mounted multimedia terminal auxiliary viewing system for visually impaired person | |
| CN104637263A (en) | Device and method for preventing myopia and correcting sitting posture | |
| Rupanagudi et al. | Novel methodology for blink recognition using video oculography for communicating | |
| CN109800618A (en) | A kind of device and method thereof for detecting whether to wear U.S. pupil | |
| US20140272815A1 (en) | Apparatus and method for performing actions based on captured image data | |
| CN111209804A (en) | Visual impairment auxiliary enhancement system | |
| Ilango | Integrating Low Vision Service in Clinical Practice |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | Address after:325006 Zhejiang, Ouhai, South East Road, No. 38, Wenzhou National University Science Park Incubator Applicant after:Wenzhou Vocational & Technical College Address before:325035 Zhejiang province Chashan Wenzhou Higher Education Park of Wenzhou Vocational and Technical College Applicant before:Wenzhou Vocational & Technical College | |
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | Effective date of registration:20200107 Address after:325204 International Automobile & Motorcycle Industrial Park, Wenzhou, Zhejiang, Ruian Patentee after:Zhejiang Shenghuabo Electrical Applicance Co., Ltd. Address before:325006 Zhejiang, Ouhai, South East Road, No. 38, Wenzhou National University Science Park Incubator Patentee before:Wenzhou Vocational & Technical College | |
| TR01 | Transfer of patent right |