Background
The blind person reader is a device which can enable the blind person to read any text; the existing blind person readers are mainly of two types, one type is that after the device takes a picture, the Internet cloud processing technology is used for recognizing characters and converting the characters into a voice mode, so that the blind person can listen to the voice mode; the other is to transmit the literal information to the braille display machine, the device forms a dot matrix by punching holes on a flat surface, and the blind can read by touching.
However, for the two types of blind person readers, the information processing efficiency is low, the mechanical structure is too complex, and the blind person readers are not suitable for being worn on the person; in addition, the device can only display and read characters, the content of information presented at a time is small, and complicated pictures or lines and other information with large information content cannot be converted.
Disclosure of Invention
In view of the above, the embodiment of the invention provides a blind reader and a method using the blind reader, and mainly aims to solve the problems that the traditional blind reader is low in information processing efficiency, too complex in mechanical structure and not suitable for being worn on person; and the device can only display and read characters, the single-time presentation of information smelting is small, and complicated pictures or lines and other information with large information content cannot be converted.
In order to achieve the purpose, the invention mainly provides the following technical scheme:
in one aspect, an embodiment of the present invention provides a reader for blind people, including:
the display device is provided with a touch panel;
the touch sensing equipment is worn at a first position of a human body and is used for contacting the touch panel, protruding or vibrating image-text information of a corresponding contact area and stimulating the first position;
the touch sensing device is in contact with the touch panel, and corresponding bulges or vibrations are generated at the contact position of the touch sensing device and the first position corresponding to the shape of the image-text information of the touch area, so as to express the image-text information of the touch area.
The purpose and the technical problem to be solved can be further realized by adopting the following technical measures;
optionally, in the reader for the blind, the touch panel is provided with sensing pixels, and the sensing pixels are correspondingly matched with display pixels on the display device and used for expressing image-text information on the display device;
the touch sensing equipment is provided with sensing pixels, and the sensing pixels are matched with the sensing pixels to correspondingly generate bulges or vibration.
Optionally, in the reader for the blind, the display device includes a first microelectronic device and a second microelectronic device, and the first microelectronic device, the second microelectronic device, and the touch panel are electrically connected in pairs;
the first microelectronic device is configured to identify a touch area of the tactile sensing apparatus and to communicate positional information to the second microelectronic device;
the second microelectronic device is a programmable device and is used for identifying and responding to the image-text information of the touch area;
the first microelectronic device identifies a touch area of the touch sensor and transmits position information to the second microelectronic device, the second microelectronic device identifies image-text information of the touch area and transmits the image-text information to a sensing pixel of the touch sensor, and the sensing pixel generates corresponding projection or vibration to represent the image-text information of the touch position.
Optionally, in the blind reader, the second microelectronic device controls the brightness display of the display device; the touch panel is touched by the touch sensing equipment, and the second microelectronic device controls the lighting and brightness of the touch area or the whole display equipment.
Optionally, in the reader for blind people, the touch panel is disposed on a liquid crystal panel of the display device or embedded in a display pixel of the display device.
Optionally, in the reader for blind persons, the sensing pixels are a plurality of sensors, and the plurality of sensors are composed of a plurality of piezoelectric materials or a micro vibration mechanism and used for generating a protrusion or vibrating to stimulate the first position.
Optionally, in the reader for blind people, the first position is a finger, a fingertip, a finger pad or a palm.
On the other hand, the embodiment of the invention also provides a method for utilizing the blind reader, which comprises the following steps:
the blind person wears the touch sensing equipment to a first position of the human body;
the blind person moves the touch sensing equipment to make the touch sensing equipment contact with a touch panel of display equipment, and the display equipment responds;
the shape of the image-text information of the contact area corresponding to the touch sensing equipment is raised or vibrated and is transmitted to the first position of the human body.
Optionally, the blind person moves the touch sensing device to make the touch sensing device contact with a touch panel of a display device, and the display device responds;
wherein a first microelectronic device of the display device transfers positional information of the contact region to a second microelectronic device, which controls the contact region or the entire display device to light up and recognize graphical and textual information of the contact region.
Optionally, the shape of the image-text information of the contact area corresponding to the tactile sensing device is raised or vibrated and transmitted to the first position of the human body;
the second microelectronic device of the display device recognizes the image-text information of the contact area and transmits the image-text information to the touch sensing device, sensing pixels on the touch sensing device protrude or vibrate corresponding to the shape of the image-text information, the blind generates touch, and the image-text information and the strength of the image-text information expressed by the display device in the contact area are received.
By the technical scheme, the blind reader and the method for utilizing the blind reader at least have the following advantages: the display equipment is matched with the touch sensing equipment to finish the auxiliary reading for the blind, large-scale equipment such as a camera or bump printing and the like is not needed, the mechanical structure is greatly simplified, the information processing efficiency is improved, and the portable touch screen is convenient to carry; meanwhile, the shape of the touch sensing equipment is transmitted to the first position of the human body in a convex or vibration stimulation mode according to the image-text information on the display equipment, so that the blind can really feel the touch screen, a vivid picture is formed in the brain, the touch screen is not limited to braille and voice broadcasting for reading, and the amount of information presented at a single time is large.
Detailed Description
To further explain the technical means and effects of the present invention adopted to achieve the predetermined purpose, the following detailed description will be made on the embodiments, structures, features and effects of the reader for blind persons and the method using the reader for blind persons according to the present invention with reference to the accompanying drawings and preferred embodiments. In the following description, different "one embodiment" or "an embodiment" refers to not necessarily the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
In order to solve the technical problems, the embodiment of the invention has the following general idea:
example 1
Referring to fig. 1, a reader for blind persons according to an embodiment of the present invention includes a display device 1 and atactile sensing device 2; atouch panel 11 is arranged on the display device 1; thetouch sensing equipment 2 is worn at a first position of a human body and is used for contacting with thetouch panel 11 and generating protrusion or vibration corresponding to image-text information of a contact area to stimulate the first position;
thetouch sensing device 2 is in contact with thetouch panel 11, and the shape of thetouch sensing device 2 corresponding to the graphic and text information of the touch area generates a corresponding bulge or vibration at the contact position of thetouch sensing device 2 and the first position, so as to express the graphic and text information of the touch area
Particularly, the reader is not suitable for being worn by a user in order to solve the problems that the traditional reader for the blind has low information processing efficiency and too complex mechanical structure; the embodiment of the invention provides a reader for blind people, which comprises a display device 1 and atouch sensing device 2, and solves the problems that the reader can only display and read characters, has small information amount in single presentation, and cannot convert complex pictures or lines containing large information amount; the display device 1 is a TFT flat panel display device, namely a thin film transistor liquid crystal display device, has a network connection function, and can update information in real time; the display device 1 adopts a TFT LCD or OLED display technology and adopts color or gray scale display, and the display device 1 is different from the traditional TFT display device in that the resolution of the display device 1 adopted by the invention is lower, namely, the display device 1 has fewer pixels displayed in unit area; meanwhile, the aperture opening ratio of the display device 1 is low, namely, the effective light transmittance of the display device 1 can be very low, and the characteristics are specially designed for the blind; thetouch sensing equipment 2 is conversion equipment worn at a first position of a human body, converts the shape or outline of image-text information on the display equipment 1 into a bulge or vibration, stimulates the first position, and further enables a blind person to feel composition in the brain and sea; thetouch sensing device 2 is in contact with thetouch panel 11 on the display device 1, and when the area in contact with thetouch sensor 2 has the text information, thetouch sensing device 2 will protrude correspondingly at the first position of the human body, and if the text information is only text information, thetouch sensing device 2 will protrude along the shape of thetouch sensing device 2 touching the text information; if the graphic information includes a three-dimensional shape such as a peak, thetactile sensing device 2 may protrude along a shape profile of the peak touched by thetactile sensing device 2, and vibrate at the peak or a valley; on the contrary, if there is no image-text information in the area where thetouch sensing device 2 and thetouch panel 11 are in contact with each other, thetouch sensing device 2 does not respond.
According to the list, in the technical scheme adopted by the invention, the display device 1 is matched with thetouch sensing device 2 to finish the auxiliary reading for the blind person, large-scale devices such as a camera or bump printing and the like are not needed, the mechanical structure is greatly simplified, and the device is convenient to carry; meanwhile, the shape of thetouch sensing device 2 is transmitted to the first position of the human body in a protruding or vibration stimulation mode according to the image-text information on the display device 1, so that the blind can feel truly, and meanwhile, a vivid picture is formed in the mind and does not need to be limited to braille and voice broadcast reading.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, with the specific understanding that: both a and B may be included, a may exist alone, or B may exist alone, and any of the three cases can be provided.
Further, referring to fig. 1, in a specific implementation, an embodiment of the present invention provides a reader for blind people, where in the specific implementation, aninduction pixel 111 is disposed on thetouch panel 11, and theinduction pixel 111 is correspondingly matched with adisplay pixel 112 on the display device 1, and is used for expressing image-text information on the display device 1; thetouch sensing device 2 is provided with asensing pixel 211, and thesensing pixel 211 is matched with thesensing pixel 111 to generate a bulge or vibration correspondingly.
Specifically, in order to realize that the corresponding image-text information is raised or vibrated after thetouch sensing device 2 is contacted with thetouch panel 11, in the technical scheme adopted by the invention, aninduction pixel 111 is arranged on thetouch panel 11, theinduction pixel 111 is correspondingly matched with adisplay pixel 112 on the display device 1, and the image-text information to be expressed by the display device 1 is expressed on theinduction pixel 111, wherein theinduction pixel 111 is a unit for storing, inducing and transferring electric charges on thetouch panel 11; thedisplay pixel 112 refers to a unit having a light-emitting display function on the display device 1; thesensing pixel 211 is a unit which is in contact with a first position of a human body on thetouch sensing device 2 to enable the blind person to feel touch; referring to fig. 3, 4 and 5, the corresponding matching means that thesensing pixel 111 and thedisplay pixel 112 physically correspond to each other, but the pixel density is different in a unit area, so that asmany display pixels 211 as possible can be displayed in a unit area when a limited number of thesensing pixels 211 are in contact with thesensing pixel 111; when the sensing pixel 211 (the touch sensing device 2) is in contact with the sensing pixel 111 (the touch panel 11), the sensing pixel 111 (the touch panel 11) transmits the graphic information expressed by the corresponding display pixel 112 (the display device 1) to the sensing pixel 211 (the touch sensing device 2), so that when the sensing pixel 211 (the touch sensing device 2) touches a certain position of thetouch panel 11 with the graphic information, the sensing pixel 211 (the touch sensing device 2) generates corresponding protrusion or vibration.
Further, referring to fig. 2, in a specific implementation of the reader for blind people according to an embodiment of the present invention, the display device 1 includes a firstmicroelectronic device 12 and a secondmicroelectronic device 13, and the firstmicroelectronic device 12, the secondmicroelectronic device 13, and thetouch panel 11 are electrically connected to each other in pairs;
the firstmicroelectronic device 12 is used to identify the touch area of thetactile sensing apparatus 2 and to communicate position information to the secondmicroelectronic device 13;
the secondmicroelectronic device 13 is a programmable device, and the secondmicroelectronic device 13 is used for identifying and responding to the graphic and text information of the touch area;
wherein the firstmicroelectronic device 12 identifies a touch area of thetactile sensor 2 and transmits position information to the secondmicroelectronic device 13, the secondmicroelectronic device 13 identifies graphic information of the touch area and transmits the graphic information to thesensing pixel 211 of thetactile sensor 2, and thesensing pixel 211 generates corresponding graphic information representing the touch position by a bump or vibration.
Specifically, in order to achieve accurate response to image-text information, avoid using a camera or a braille printing large-scale device, and improve information processing efficiency, in the technical scheme adopted by the present invention, a firstmicroelectronic device 12 and a secondmicroelectronic device 13 are arranged in the display device 1, wherein the firstmicroelectronic device 12 is a microelectronic device (IC1) or an integrated circuit in the field, and is electrically connected to thetouch panel 11, and is configured to identify a position where capacitance change occurs when the sensing pixel 211 (the tactile sensing device 2) and the sensing pixel 111 (the touch panel 11) are in contact; the secondmicroelectronic device 13 is a programmable microelectronic device (IC2), which is a conventional programmable microelectronic device in the art or is called a programmable integrated circuit, the secondmicroelectronic device 13 is electrically connected to the secondmicroelectronic device 12 and thetouch panel 11 at the same time, receives the position information of the contact area of the firstmicroelectronic device 12, identifies the graphic information (DATE) of the position, and transmits the graphic information (DATE) to the tactile sensing device 2 (sensing pixel 211) through the touch panel 11 (sensing pixel 111), so that the graphic information expressed by the display device 1 (display pixel 112) corresponding to the tactile sensing device 2 (sensing pixel 211) is correspondingly raised or vibrated; referring to fig. 6, the process of transmitting the graphic information to thesensing pixel 211 by the secondmicroelectronic device 13 is a scanning process, and information expressed by thedisplay pixel 112 scanned by the second microelectronic device is transmitted to thesensing pixel 211 according to a certain timing sequence, where the scanning timing sequence may be column-by-column scanning, row-by-row scanning, dot scanning, or other scanning modes; FIG. 6 is a column-by-column scan, which is illustrated by S1-S4-S7 …, and so on; after each sensingpixel 211 is scanned by the secondmicroelectronic device 13, the information of the scanneddisplay pixel 112 is maintained for a period of time until thenext display pixel 112 is scanned in the next time, and the plurality ofsensing pixels 211 sequentially respond to the information of thedisplay pixels 112 to form the whole sensing matrix, i.e., the response of thetactile sensing device 2.
Further, referring to fig. 2, in a specific implementation of the reader for blind persons according to the embodiment of the present invention, the secondmicroelectronic device 13 controls the brightness display of the display device 1; wherein, thetouch sensing device 2 touches thetouch panel 11, and the secondmicroelectronic device 13 controls the touch area or the whole display device 1 to light up and brightness.
Specifically, in order to reduce the power consumption of the display device 1 and enable normal people to help the blind person read, in the technical scheme adopted by the present invention, the secondmicroelectronic device 13 is endowed with a function of controlling the luminance display of the display device 1 during the programming process, when thetactile sensing device 2 touches the touch panel 1, the firstmicroelectronic device 12 transmits the position information of the contact area to the secondmicroelectronic device 13, and then the secondmicroelectronic device 13 controls thedisplay pixels 112 of the contact area of the display device 1 to light up, or when normal visible people are needed to help the blind person read together, the display mode of the display device 1 can be adjusted, that is, the secondmicroelectronic device 13 controls the display device 1 to light up normally; further, the secondmicroelectronic device 13 can process and control the brightness and darkness of the graphic information displayed on the display device 1 and transmit the graphic information to thetactile sensing device 2, for example, when the brightness and darkness of the graphic information are different, the secondmicroelectronic device 13 can control the strength or degree of the protrusion or vibration of thetactile sensing device 2 to be different.
Further, in a specific implementation of the reader for blind people provided in the embodiment of the present invention, thetouch panel 11 is disposed on a liquid crystal panel of the display device 1 or embedded in thedisplay pixels 112 of the display device 1.
Specifically, In order to realize diversification and simplification of the display device 1, In the technical scheme adopted by the present invention, the manner In which thetouch panel 11 is disposed On the display panel 1 is defined as an On Cell or an In Cell, where the In Cell is to embed thetouch panel 11 into thedisplay pixels 112 of the display device 1, and the On Cell is to embed thetouch panel 11 between the color filter substrate and the polarizing plate of the display device 1; compared with the In Cell technology, the On Cell has the advantages that the difficulty is reduced, the manufacturing difficulty is reduced, and the manufacturing cost is reduced.
Further, referring to fig. 3, 4 and 5, in a specific implementation of the reader for blind persons according to an embodiment of the present invention, thesensing pixel 211 is a plurality of sensors, and the plurality of sensors are composed of a plurality of piezoelectric materials or micro-vibration mechanisms, and are configured to generate a protrusion or vibration to stimulate the first position.
Specifically, in order to simplify the mechanical structure, in the technical scheme adopted by the present invention, thesensing pixels 211 on thetactile sensing device 2 are set as sensors, eachsensing pixel 211 is an independent sensor, so that thesensing pixel 211 itself is used as the output end of thetactile sensing device 2, and the sensor is set to be composed of a piezoelectric material or a micro vibration mechanism, wherein the piezoelectric material utilizes the piezoelectric effect to generate the protrusion effect on thesensing pixel 211; the micro-vibration mechanism is turned on by an electrical signal to generate a vibration effect on thesensing pixel 211.
Further, in a specific implementation of the reader for blind people according to an embodiment of the present invention, the first position is a finger, a fingertip, a finger pad, or a palm.
Specifically, in order to improve the touch feeling of the blind, in the technical scheme adopted by the invention, thetouch sensing equipment 2 is worn at a first position of a human body, wherein when the first position is a finger or a fingertip, thetouch sensing equipment 2 is a finger stall and is used for stimulating the finger belly of the blind; when the first position is a palm, thetouch sensing equipment 2 is a glove and is used for stimulating the palm of the blind; meanwhile, thetactile sensing device 2 may be configured in the form of a dedicated slider or the like, for example, thetactile sensing device 2 is configured in the form of a stamp, and thesensing pixel 211 is in contact with a human hand on the surface of the stamp and performs a protrusion or vibration stimulation; in addition, the response form of thetactile sensing device 2 is not limited to protrusion or vibration, and may also include a cold-heat sensing response, for example, a heating resistance wire is disposed in thesensing pixel 211, and the response principle refers to the above embodiments, and is not described herein again.
Example 2
Referring to fig. 7, an embodiment of the present invention provides a method for using the blind reader, which includes the following steps:
s1, the blind person wears thetouch sensing device 2 to a first position of the human body;
s2, the blind moves thetouch sensing device 2 to make the touch sensing device contact with thetouch panel 11 of the display device 1, and the display device 1 responds;
and S3, the shape of the image-text information of the corresponding contact area of thetouch sensing device 2 is raised or vibrated and transmitted to the first position of the human body.
Specifically, in order to enable the blind to enrich the reading content, in the technical scheme adopted by the invention, the touch sensing equipment 2 is a conversion equipment worn at a first position of a human body, converts the shape or outline of image-text information on the display equipment 1 into a bulge or vibration, stimulates the first position, and further enables the blind to feel composition in the brain and sea; the touch sensing device 2 is in contact with the touch panel 11 on the display device 1, and when the area in contact with the touch sensor 2 has the text information, the touch sensing device 2 will protrude correspondingly at the first position of the human body, and if the text information is only text information, the touch sensing device 2 will protrude along the shape of the touch sensing device 2 touching the text information; if the graphic information includes a three-dimensional shape such as a peak, the tactile sensing device 2 may protrude along a shape profile of the peak touched by the tactile sensing device 2, and vibrate at the peak or a valley; on the contrary, if there is no image-text information in the area where the touch sensing device 2 and the touch panel 11 are in contact with each other, the touch sensing device 2 does not respond.
Further, in the method using the blind reader according to the embodiment of the present invention, in S2, the blind moves thetactile sensing device 2 to make it contact with thetouch panel 11 of the display device 1, and the display device 1 responds;
further comprising S21, the firstmicroelectronic device 12 of the display device 1 transferring the position information of the contact area to the secondmicroelectronic device 13; s22 and S23, the secondmicroelectronic device 13 controls the contact area or the whole display device 1 to light up and recognize the teletext information of the contact area.
Specifically, in order to flexibly apply a blind person reader and achieve the effect that a visual person assists a blind person to read, in the technical scheme adopted by the present invention, the secondmicroelectronic device 13 is endowed with a function of controlling the luminance display of the display device 1 in the programming process, when thetactile sensing device 2 touches the touch panel 1, the firstmicroelectronic device 12 transmits the position information of a contact area to the secondmicroelectronic device 13, and then the secondmicroelectronic device 13 controls thedisplay pixels 112 of the contact area of the display device 1 to light up, or when a normal visual person is needed to help to read with the blind person, the display mode of the display device 1 can be adjusted, that is, the secondmicroelectronic device 13 controls the display device 1 to light up; further, the secondmicroelectronic device 13 can process and control the brightness and darkness of the graphic information displayed on the display device 1 and transmit the graphic information to thetactile sensing device 2, for example, when the brightness and darkness of the graphic information are different, the secondmicroelectronic device 13 can control the strength or degree of the protrusion or vibration of thetactile sensing device 2 to be different.
Further, in the method using the blind reader according to the embodiment of the present invention, S3, the shape of the image-text information of the contact area corresponding to thetactile sensing device 2 is raised or vibrated and transmitted to the first position of the human body;
the secondmicroelectronic device 13 of the display device 1 recognizes the graphic information of the contact area and transmits the graphic information to thetactile sensing device 2, the sensingpixels 211 on thetactile sensing device 2 generate a protrusion or vibration corresponding to the shape of the graphic information, and the blind generates a tactile sensation and receives the graphic information and the intensity expressed by the display device 1 in the contact area.
Specifically, in order to improve the touch feeling of the blind and enable the blind to experience a real touch feeling, in the technical scheme adopted by the invention, thetouch sensing equipment 2 is in contact with thetouch panel 11 on the display equipment 1, and under the condition that the contact area of thetouch sensing equipment 2 has image-text information, the contact position of thetouch sensing equipment 2 and the first position of the human body generates a corresponding bulge, and meanwhile, if the image-text information is only text information, thetouch sensing equipment 2 generates a bulge along the shape of thetouch sensing equipment 2 touching the text information; if the graphic information includes a three-dimensional shape such as a peak, thetactile sensing device 2 may protrude along a shape profile of the peak touched by thetactile sensing device 2, and vibrate at the peak or a valley; on the contrary, if there is no image-text information in the area where thetouch sensing device 2 and thetouch panel 11 are in contact with each other, thetouch sensing device 2 does not respond.