The content of the invention
It is contemplated that at least solving one of above-mentioned technical problem.
Therefore, it is an object of the present invention to propose a kind of sight identifying device, the device can accurately identify the mesh of userLight region-of-interest and it is specifically directed towards, and time and the moving direction of sight concern can be counted.
It is another object of the present invention to propose a kind of sight recognition methods.
To achieve these goals, the embodiment of first aspect present invention discloses a kind of sight identifying device, including：ImageAcquisition module, the face-image for gathering user；Infrared light supply, the infrared light supply is arranged in target area；It is infraredAcquisition module, the infrared collecting module is arranged in the target area and closes on the infrared light supply, is come from for receivingThe infrared external reflection light of eyes of user；And processing module, the processing module respectively with described image acquisition module and described redOuter acquisition module is connected, and the eye locations of user are determined for the face-image according to the user and the infrared external reflection light,And judge whether user pays close attention to the target area according to the intensity of the infrared external reflection light.
In addition, sight identifying device according to the above embodiment of the present invention can also have technical characteristic additional as follows：
In some instances, the processing module is used for when the intensity of the infrared external reflection light is more than or equal to predetermined threshold value,Judge that the user pays close attention to the target area, and when the intensity of the infrared external reflection light is less than the predetermined threshold value, sentenceThe fixed user does not pay close attention to the target area.
In some instances, the infrared light supply is multiple, and multiple infrared light supplies run on one plane.
In some instances, the processing module is additionally operable to it is determined that after the eye locations of the user, obtaining the eye of userPortion's image, and partial enlargement is carried out to the eyes image, the infrared reflecting pattern to user eyeball surface is identified, withJudge user's sight being specifically directed towards in the target area.
In some instances, the processing module is additionally operable to continuously recognize the infrared reflecting pattern on the user eyeball surface, withIdentify the moving direction of user's sight.
In some instances, the processing module is additionally operable to record the duration that the user pays close attention to the target area.
In some instances, described image acquisition module is visible image capturing head.
In some instances, the infrared collecting device is infrared camera.
Sight identifying device according to embodiments of the present invention, the eye of user is determined according to the face-image of user and infrared external reflection lightPortion position, and when the intensity of infrared external reflection light is more than or equal to predetermined threshold value, judge user's concern target area, Yi JiWhen the intensity of infrared external reflection light is less than predetermined threshold value, judge that user does not pay close attention to target area.Therefore, the device can accurately be knownThe sight region-of-interest of other user and it is specifically directed towards, and time and the moving direction of sight concern can be counted.
The embodiment of second aspect of the present invention discloses a kind of sight recognition methods, comprises the following steps：Gather the face of userImage；Infrared light supply is provided in target area, and receives in the target area infrared external reflection light from eyes of user；And the face-image and the infrared external reflection light according to the user determine the eye locations of user, and according to described infrared anti-The intensity for penetrating light judges whether user pays close attention to the target area.
In addition, sight recognition methods according to the above embodiment of the present invention can also have technical characteristic additional as follows：
In some instances, the intensity according to the infrared external reflection light judges whether user pays close attention to the target area, toolBody includes：If the intensity of the infrared external reflection light is more than or equal to predetermined threshold value, judge that the user pays close attention to the targetRegion；If the intensity of the infrared external reflection light is less than the predetermined threshold value, judge that the user does not pay close attention to the target areaDomain.
Sight recognition methods according to embodiments of the present invention, the eye of user is determined according to the face-image of user and infrared external reflection lightPortion position, and when the intensity of infrared external reflection light is more than or equal to predetermined threshold value, judge user's concern target area, Yi JiWhen the intensity of infrared external reflection light is less than predetermined threshold value, judge that user does not pay close attention to target area.Therefore, this method can accurately be knownThe sight region-of-interest of other user and it is specifically directed towards, and time and the moving direction of sight concern can be counted.
The additional aspect and advantage of the present invention will be set forth in part in the description, and partly will become bright from the following descriptionIt is aobvious, or recognized by the practice of the present invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein identical from beginning to endOr similar label represents same or similar element or the element with same or like function.Retouched below with reference to accompanying drawingThe embodiment stated is exemplary, is only used for explaining the present invention, and is not considered as limiting the invention.
In the description of the invention, it is to be understood that term " " center ", " longitudinal direction ", " transverse direction ", " on ", " under ", " preceding ",The orientation or position relationship of the instruction such as " rear ", "left", "right", " vertical ", " level ", " top ", " bottom ", " interior ", " outer " areBased on orientation shown in the drawings or position relationship, it is for only for ease of the description present invention and simplifies description, rather than indicate or darkSpecific orientation must be had, with specific azimuth configuration and operation by showing the device or element of meaning, therefore it is not intended that rightThe limitation of the present invention.In addition, term " first ", " second " are only used for describing purpose, and it is not intended that indicating or implying phaseTo importance.
In the description of the invention, it is necessary to explanation, unless otherwise clearly defined and limited, term " installation ", " connected "," connection " should be interpreted broadly, for example, it may be being fixedly connected or being detachably connected, or be integrally connected；CanTo be mechanical connection or electrical connection；Can be joined directly together, can also be indirectly connected to by intermediary, can be withIt is the connection of two element internals.For the ordinary skill in the art, it can understand that above-mentioned term exists with concrete conditionConcrete meaning in the present invention.
Sight identifying device and method according to embodiments of the present invention is described below in conjunction with accompanying drawing.
Fig. 1 is the structured flowchart of sight identifying device according to an embodiment of the invention.As shown in figure 1, according to the present inventionThe sight identifying device 100 of embodiment, including：Image capture module 110, infrared light supply 120, infrared collecting module 130With processing module 140.
Specifically, image capture module 110 is used for the face-image for gathering user.In specific example, image capture module110 be, for example, visible image capturing head, by shooting visible images, for face recognition to obtain the face-image of user.
Infrared light supply 120 is arranged in target area, outwards to launch the infrared light of some strength.
Infrared collecting module 130 is arranged in target area and closes on infrared light supply, for receiving from the infrared of eyes of userReflected light.Specifically, when eyes of user receives infrared light, according to infrared light human body eye high reflection principle,Eyes can reflect infrared light, that is, send infrared external reflection light, further, and infrared collecting module 130 receives infrared external reflection light,And infrared external reflection light is identified.
In specific example, infrared collecting device 130 is, for example, infrared camera, and it is used for assisted face identification, and to peopleBody eye infrared external reflection light is identified.
Processing module 140 is connected with image capture module 110 and infrared collecting module 130 respectively, for the face according to userPortion's image and infrared external reflection light determine the eye locations of user, and judge whether user pays close attention to mesh according to the intensity of infrared external reflection lightMark region.Specifically, processing module 140 is used to, when the intensity of infrared external reflection light is more than or equal to predetermined threshold value, judge to useTarget area is paid close attention at family, and when the intensity of infrared external reflection light is less than predetermined threshold value, judges that user does not pay close attention to target area.
The cardinal principle of the sight identifying device 100 of the embodiment of the present invention is summarized as：By infrared collecting module 130 and infrared lightSource 120 is arranged in target area, and the mounting distance of the two is nearer, when the eyeball of identified user faces target areaWhen within certain limit, user eyeground and iris are very strong to infrared reflection degree, are preset when the intensity of infrared external reflection light exceedesDuring threshold value, judge that user pays close attention to and (watched attentively) target area, and when the intensity of infrared external reflection light is less than predetermined threshold value,Judge that user does not pay close attention to and (watched attentively) target area.
Further, in one embodiment of the invention, the number of infrared light supply 120 for example can be multiple, Duo GehongOuter light source 120 runs on one plane.Based on this, processing module 140 is additionally operable to it is determined that the eye position of identified userAfter putting, the eyes image of user is obtained, and partial enlargement is carried out to the eyes image of user, to the red of user eyeball surfaceExternal reflectance optical mode is identified, to judge user's sight being specifically directed towards in target area.
In addition, in one embodiment of the invention, processing module 140 is additionally operable to the infrared of continuous identification user eyeball surfaceLight reflection mode, to identify the moving direction of user's sight.
Further, in one embodiment of the invention, processing module 140 is additionally operable to record user's concern target areaDuration, so as to judge the degree of concern of user.
To sum up, sight identifying device according to embodiments of the present invention, determines to use according to the face-image of user and infrared external reflection lightThe eye locations at family, and when the intensity of infrared external reflection light is more than or equal to predetermined threshold value, judge user's concern target area,And when the intensity of infrared external reflection light is less than predetermined threshold value, judge that user does not pay close attention to target area.Therefore, the device canAccurately identify the sight region-of-interest of user and be specifically directed towards, and time and the moving direction of sight concern can be counted.
Further embodiment of the present invention also proposed a kind of sight recognition methods.
Fig. 2 is the flow chart of sight recognition methods according to an embodiment of the invention.As shown in Fig. 2 this method include withLower step：
Step S1：Gather the face-image of user.In specific example, for example, visible ray figure is shot by visible image capturing headPicture, for face recognition to obtain the face-image of user.
Step S2：Infrared light supply is provided in target area, and receives in target area the infrared external reflection from eyes of userLight.Specifically, infrared light supply outwards launches the infrared light of some strength, when eyes of user receives infrared light, according toInfrared light is in the high reflection principle of human body eye, and eyes can reflect infrared light, that is, send infrared external reflection light, further, exampleInfrared external reflection light is such as received by infrared camera, and infrared external reflection light is identified.
Step S3：The eye locations of user are determined according to the face-image of user and infrared external reflection light, and according to infrared external reflection lightIntensity judge whether user pays close attention to target area.Specifically, if the intensity of infrared external reflection light is more than or equal to default thresholdValue, then judge user's concern target area；If the intensity of infrared external reflection light is less than predetermined threshold value, judge that user does not pay close attention toTarget area.
The cardinal principle of the sight recognition methods of the embodiment of the present invention is summarized as：For example, it will be seen that light video camera head and infrared light supplyIt is arranged in target area, and the mounting distance of the two is nearer, when the eyeball of identified user faces the certain model in target areaWhen within enclosing, user eyeground and iris are very strong to infrared reflection degree, when the intensity of infrared external reflection light exceedes predetermined threshold value,Judge that user pays close attention to and (watched attentively) target area, and when the intensity of infrared external reflection light is less than predetermined threshold value, judge userDo not pay close attention to (watching attentively) target area.
Further, in one embodiment of the invention, the individual position of infrared light supply for example can be multiple, multiple infrared lightsSource distribution is in a plane.Based on this, this method also includes：It is determined that after the eye locations of identified user, obtainingThe eyes image of user, and partial enlargement is carried out to the eyes image of user, to the infrared external reflection optical mode on user eyeball surfaceIt is identified, to judge user's sight being specifically directed towards in target area.
In addition, in one embodiment of the invention, this method also includes：The infrared reflecting on continuous identification user eyeball surfacePattern, to identify the moving direction of user's sight.
Further, in one embodiment of the invention, this method also includes：The duration that user pays close attention to target area is recorded,So as to judge the degree of concern of user.
To sum up, sight recognition methods according to embodiments of the present invention, determines to use according to the face-image of user and infrared external reflection lightThe eye locations at family, and when the intensity of infrared external reflection light is more than or equal to predetermined threshold value, judge user's concern target area,And when the intensity of infrared external reflection light is less than predetermined threshold value, judge that user does not pay close attention to target area.Therefore, this method canAccurately identify the sight region-of-interest of user and be specifically directed towards, and time and the moving direction of sight concern can be counted.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specific example ",Or the description of " some examples " etc. means to combine specific features, structure, material or the feature bag that the embodiment or example are describedIt is contained at least one embodiment of the present invention or example.In this manual, to the schematic representation of above-mentioned term not necessarilyRefer to identical embodiment or example.Moreover, specific features, structure, material or the feature of description can be anyCombined in an appropriate manner in one or more embodiments or example.
Although an embodiment of the present invention has been shown and described, it will be understood by those skilled in the art that：Do not departing fromIn the case of the principle and objective of the present invention a variety of change, modification, replacement and modification, this hair can be carried out to these embodimentsBright scope is by claim and its equivalent limits.