Movatterモバイル変換


[0]ホーム

URL:


CN103514437A - Three-dimensional hand gesture recognition device and three-dimensional hand gesture recognition method - Google Patents

Three-dimensional hand gesture recognition device and three-dimensional hand gesture recognition method
Download PDF

Info

Publication number
CN103514437A
CN103514437ACN201210565201.7ACN201210565201ACN103514437ACN 103514437 ACN103514437 ACN 103514437ACN 201210565201 ACN201210565201 ACN 201210565201ACN 103514437 ACN103514437 ACN 103514437A
Authority
CN
China
Prior art keywords
gesture recognition
image
gesture
images
gestures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210565201.7A
Other languages
Chinese (zh)
Other versions
CN103514437B (en
Inventor
施建华
邵诗强
陈永洒
邓益群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL Corp
Original Assignee
TCL Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TCL CorpfiledCriticalTCL Corp
Priority to CN201210565201.7ApriorityCriticalpatent/CN103514437B/en
Publication of CN103514437ApublicationCriticalpatent/CN103514437A/en
Application grantedgrantedCritical
Publication of CN103514437BpublicationCriticalpatent/CN103514437B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Landscapes

Abstract

The invention provides a three-dimensional hand gesture recognition device and a three-dimensional hand gesture recognition method. The three-dimensional hand gesture recognition device comprises two infrared cameras, an image collecting unit, an infrared light emitting diode, an infrared light emitting diode driving unit, an arithmetic unit and a hand gesture recognition unit; the two infrared cameras are arranged upwards and are electrically connected with the image collecting unit, the infrared light emitting diode driving unit drives the infrared light emitting diode to emit light, and the arithmetic unit is electrically connected with the image collecting unit, the infrared light emitting diode driving unit and the hand gesture recognition unit. The infrared light emitting diode emits light to provide back light, the image collecting unit collects hand gesture image data through the infrared cameras and sends the data to the arithmetic unit, binaryzation, edge extraction, two-dimensional finger location and three-dimensional position location processing are conducted on the data, and then the data are sent to the hand gesture recognition unit to achieve hand gesture recognition. According to the three-dimensional hand gesture recognition device and the three-dimensional hand gesture recognition method, infrared lighting and the infrared cameras are adopted, interference of visible light is avoided, the upward cameras shoot images so that interference of a background can be avoided, and reliability of hand gesture recognition is further improved.

Description

A kind of three-dimension gesture recognition device and three-dimension gesture recognition methods
Technical field
The present invention relates to Gesture Recognition, relate in particular to the recognition methods of a kind of three-dimension gesture recognition device three-dimension gesture.
Background technology
At present, gesture interaction technology has been widely used in field of human-computer interaction, prior art gesture interaction technology mainly comprises two-dimentional gesture identification and the identification of the camera three-dimension gesture based on infrared structure light based on single camera, and the latter is as the product kinect of Microsoft.In two-dimentional gesture identification operation based on single camera, there is no depth information, can only the simple two-dimentional gesture information of identification; It is higher that three-dimension gesture identification based on infrared structure light realizes cost, and performance accuracy has certain defect.
Therefore, prior art need to improve and development.
Summary of the invention
In view of above-mentioned the deficiencies in the prior art part, the present invention is for solving prior art defect and deficiency, a kind of three-dimension gesture identification equipment and gesture identification method based on common infrared camera proposed, can eliminate the interference of environment, improve the reliability of gesture identification, computation process is simple, realizes cost low.
The technical scheme that technical solution problem of the present invention adopts is as follows:
A recognition device, for gesture is identified, comprises two infrared cameras, image acquisition units, infrarede emitting diode, infrarede emitting diode driver element, arithmetic element and gesture identification unit; The camera lens of described two infrared cameras arranges upward, described image acquisition units is electrically connected to two infrared cameras, described infrarede emitting diode driver element is electrically connected to drive infrarede emitting diode luminous with infrarede emitting diode, described arithmetic element is electrically connected to image acquisition units, infrarede emitting diode driver element, gesture identification unit; Described arithmetic element is controlled the luminous images of gestures for two infrared camera picked-ups of infrarede emitting diode bias light is provided, described image acquisition units gathers images of gestures data by two infrared cameras, and images of gestures data are sent to arithmetic element process, arithmetic element sends to gesture identification unit to realize three-dimension gesture identification after obtaining images of gestures data.
Horizontal range between described two infrared cameras is 6cm.
The visual angle angle of described two infrared cameras is 60 °.
Described infrared diode is at least one.
The present invention also provides a kind of three-dimension gesture recognition methods, based on above-mentioned three-dimension gesture recognition device, realizes, and it is characterized in that, comprises the steps:
Left and right two infrared cameras are horizontally disposed with, and cam lens upward;
Described image acquisition units is obtained respectively two first gesture image, the second images of gestures in the angular field of view of infrared camera top by left and right two infrared cameras and is sent to arithmetic element;
Arithmetic element is carried out respectively image binaryzation processing by first gesture image, the second images of gestures;
Arithmetic element is carried out respectively Boundary extracting algorithm by the first gesture image after binary conversion treatment, the second images of gestures and is obtained the edge image of first gesture image, the edge image of the second images of gestures;
Arithmetic element realizes finger two-dimensional coordinate location according to the edge image of the edge image of first gesture image, the second images of gestures;
Arithmetic element becomes three-dimensional localization coordinate by the two-dimensional localization coordinate conversion of the two-dimensional localization coordinate of the edge image of first gesture image and the edge image of the second images of gestures, mates identification with the gesture model information being pre-stored within gesture identification unit.
As further improved plan, gesture operation scope is the common factor at the visual angle of two infrared cameras.
Described Binarization methods adopts common Threshold segmentation to realize.
Described Boundary extracting algorithm first adopts the erosion algorithm of 7 * 7 templates to remove spuious point, then uses 7 * 7 templates extensive palinspastic map that expands, then adopts former figure that the former figure recovering deducts this recovery image after 3 * 3 erosion algorithms to obtain edge image.
Described two dimension finger location adopts the edge contour image of whole hand in first and second images of gestures of search, angle in scanning hand contour curve, determine angle be acute angle and direction vertically upward be pad of finger, each finger tip position of orienting finger.
The described two-dimensional localization coordinate conversion by the two-dimensional localization coordinate of the edge image of first gesture image and the edge image of the second images of gestures becomes three-dimensional localization coordinate to realize by binocular vision algorithm.
Compared with prior art, the present invention has adopted two infrared cameras to obtain images of gestures to have solved two-dimentional gesture identification and do not have depth information to cause gesture identification inaccurate; Infrarede emitting diode illumination has solved the problem that visible ray disturbs, and the camera lens of infrared camera arranges upward, can reduce the interference of absorbing the image background arriving, unlike the images of gestures of prior art picked-up, tend to be subject to the interference of human body background, can realize by simple calculating the identification of complicated gesture, improve the accuracy rate of identification.
Accompanying drawing explanation
Fig. 1 is the theory structure block diagram of three-dimension gesture recognition device of the present invention.
Fig. 2 is the perspective structure schematic diagram of three-dimension gesture recognition device specific embodiment of the present invention (two infrared cameras and infrarede emitting diode are only shown).
Fig. 3 is the visual angle structural representation of the infraluminescence camera of three-dimension gesture recognition device specific embodiment of the present invention.
Fig. 4 is the workflow diagram of three-dimension gesture recognition methods of the present invention.
Fig. 5 is the finger location structure schematic diagram of indication two dimension finger coordinate setting in Fig. 4.
Embodiment
For making object of the present invention, technical scheme and advantage clearer, clear and definite, referring to accompanying drawing, developing simultaneously, the present invention is described in more detail for embodiment.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
As shown in Figure 1, three-dimension gesture recognition device of the present invention comprises twoinfrared cameras 21,22, image acquisition units 20,infrarede emitting diode 41, infrarede emitting diode driver element 40,arithmetic element 30 andgesture identification unit 50.
Image acquisition units 20 shown in Fig. 1 is electrically connected to twoinfrared cameras 21,22, described infrarede emitting diode driver element 40 is electrically connected to drive infrarede emitting diode luminous withinfrarede emitting diode 41, and describedarithmetic element 30 is electrically connected to image acquisition units 20, infrarede emitting diode driver element 40,gesture identification unit 50; Described image acquisition units 20 gathers images of gestures data by twoinfrared cameras 21,22, and images of gestures data are sent toarithmetic element 30 process,arithmetic element 30 sends data to gestureidentification unit 50 and carries out pattern match and realize three-dimension gesture identification after obtaining images of gestures data and carrying out three-dimensional coordinate location.When two infrared cameras carry out image capture, described arithmetic element can, according to surround lighting, be controlled the luminous images of gestures for two infrared camera picked-ups of infraredeemitting diode 41 by infrarede emitting diode driver element 40 bias light is provided.
Particularly, the product of three-dimension gesture recognition device of the present invention is set to a box body, as shown in Figure 2, the building block of said apparatus is positioned in thisbox body 10, Fig. 2 only illustrates the setting position of two cameras and infrarede emitting diode, and remaining part, when forming specific product, can be that whole installation is on PCB, do not limit, only in order to the gesture identification principle of this device to be described herein.Twoinfrared cameras 21,22 are horizontally set in three-dimensiongesture recognition device 10, and its camera lens arranges upward.Fig. 3 shows the structure that two infrared cameras arrange, distance in two infrared camera horizontal directions is 6cm, the reasonable placement scope that meets general binocular vision, in figure, crossingregion 23, two infrared camera visual angles is object run region, be operand---the residing operating area of hand, in the scope in this object run region, can realize the identification of this device to gesture, according to the distance in two infrared cameras, 21,22 horizontal directions, the crossing angle in two infrared camera visual angles is 60 °.During work, the top that hand is placed on tobox body 10 operates, and can avoid like this camera to obtain the background interference of image, improves counting yield.
Shown in Fig. 4, be the processing flow chart of three-dimension gesture recognition methods embodiment of the present invention, it is based on binocular vision technology that the gesture in this three-dimension gesture recognition methods is extracted, and its method step is as follows:
S100, left and right two infrared cameras are horizontally disposed with, and cam lens upward;
S200, described image acquisition units is obtained respectively two first gesture image, the second images of gestures in the angular field of view of infrared camera top by left and right two infrared cameras and is sent to arithmetic element; First, second images of gestures described here refers to the images of gestures that left or right camera absorbs, and owing to being that two infrared cameras absorb respectively, distinguishes with first, second herein.Described two infrared cameras top angular field of view is that 60 ° of angular range are intersected at two infrared camera visual angles, and this scope is the object run region in Fig. 3, and during operation, hand is worked in this object run region.
S300, arithmetic element is carried out respectively image binaryzation processing by first gesture image, the second images of gestures; Described Binarization methods adopts common Threshold Segmentation Algorithm to realize.
S400, arithmetic element is carried out respectively Boundary extracting algorithm by the first gesture image after binary conversion treatment, the second images of gestures and is obtained the edge image of first gesture image, the edge image of the second images of gestures; Described Boundary extracting algorithm first adopts the erosion algorithm of 7 * 7 templates to remove spuious point, then uses 7 * 7 templates extensive palinspastic map that expands, then adopts extensive palinspastic map to deduct the figure of this extensive palinspastic map after 3 * 3 erosion algorithms to obtain edge image.
S500, arithmetic element realizes the coordinate setting of two dimension finger according to the edge image of the edge image of first gesture image, the second images of gestures; Described two dimension finger location adopts the edge contour image of whole hand in first and second images of gestures of search, angle in scanning hand contour curve, determine angle be acute angle and direction vertically upward be pad of finger, each finger tip position of orienting finger.Fig. 5 shows the profile diagram of the edge image of the first or second images of gestures, as shown in Figure 5, arithmetic element is by the edge contour image of the whole hand of search, scan the angle in hand contour curve, as A, B, the formed angle α of C point in figure, can orient the finger tip position of finger, to obtain two dimension finger coordinate.
S600, arithmetic element converts the two-dimensional localization coordinate associative operation of the two-dimensional localization coordinate of first gesture image and the second images of gestures to three-dimensional localization coordinate, mates identification with the gesture model information that is pre-stored within gesture identification unit.Particularly, described two-dimensional localization coordinate is according to the edge image of the first or second images of gestures, to obtain the profile coordinate of hand, become three-dimensional localization coordinate to realize by binocular vision method the two-dimensional localization coordinate conversion of the two-dimensional localization coordinate of first gesture image and the second images of gestures, binocular vision algorithm is prior art, does not repeat herein.
Adopt apparatus of the present invention and method can solve the interference of visible ray to image, hand operates the interference that also can effectively reduce background above device, gesture identifying device unlike prior art, human body can have interference to the image of picked-up before camera, make computation process also will consider the interference of human body, solve the complexity that binocular vision is calculated, improved the reliability of gesture identification.
Should be understood that; the foregoing is only preferred embodiment of the present invention; be not sufficient to limit technical scheme of the present invention; for those of ordinary skills; within the spirit and principles in the present invention; can be increased and decreased according to the above description, replaced, converted or be improved, and all these increases and decreases, replace, conversion or improve after technical scheme, all should belong to the protection domain of claims of the present invention.

Claims (10)

1. a three-dimension gesture recognition device, for gesture is identified, is characterized in that, comprises two infrared cameras, image acquisition units, infrarede emitting diode, infrarede emitting diode driver element, arithmetic element and gesture identification unit; The camera lens of described two infrared cameras arranges upward, described image acquisition units is electrically connected to two infrared cameras, described infrarede emitting diode driver element is electrically connected to drive infrarede emitting diode luminous with infrarede emitting diode, described arithmetic element is electrically connected to image acquisition units, infrarede emitting diode driver element, gesture identification unit; Described arithmetic element is controlled the luminous images of gestures for two infrared camera picked-ups of infrarede emitting diode bias light is provided, described image acquisition units gathers images of gestures data by two infrared cameras, and images of gestures data are sent to arithmetic element process, arithmetic element sends to gesture identification unit to realize three-dimension gesture identification after obtaining images of gestures data.
CN201210565201.7A2012-12-242012-12-24A kind of three-dimension gesture identifying device and three-dimensional gesture recognition methodActiveCN103514437B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201210565201.7ACN103514437B (en)2012-12-242012-12-24A kind of three-dimension gesture identifying device and three-dimensional gesture recognition method

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201210565201.7ACN103514437B (en)2012-12-242012-12-24A kind of three-dimension gesture identifying device and three-dimensional gesture recognition method

Publications (2)

Publication NumberPublication Date
CN103514437Atrue CN103514437A (en)2014-01-15
CN103514437B CN103514437B (en)2017-04-05

Family

ID=49897134

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201210565201.7AActiveCN103514437B (en)2012-12-242012-12-24A kind of three-dimension gesture identifying device and three-dimensional gesture recognition method

Country Status (1)

CountryLink
CN (1)CN103514437B (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104484679A (en)*2014-09-172015-04-01北京邮电大学Non-standard gun shooting bullet trace image automatic identification method
CN105892637A (en)*2015-11-252016-08-24乐视致新电子科技(天津)有限公司Gesture identification method and virtual reality display output device
CN106211470A (en)*2016-08-242016-12-07横店集团得邦照明股份有限公司A kind of LED dimming control system controlled based on 3D gesture and its implementation
CN106443651A (en)*2016-09-302017-02-22乐视控股(北京)有限公司Virtual reality device, and spatial positioning system and method
CN106491071A (en)*2015-09-062017-03-15中兴通讯股份有限公司A kind of method for giving a test of one's eyesight and terminal
CN106547359A (en)*2016-11-302017-03-29珠海迈科智能科技股份有限公司High voltage power supply with gesture identification function and its recognition methodss
CN107896274A (en)*2017-10-272018-04-10广东欧珀移动通信有限公司 Infrared Emitter Control Method, Terminal, and Computer-Readable Storage Medium
CN108073274A (en)*2016-11-102018-05-25财团法人金属工业研究发展中心Gesture operation method and system based on depth value
CN108363482A (en)*2018-01-112018-08-03江苏四点灵机器人有限公司A method of the three-dimension gesture based on binocular structure light controls smart television
CN114390760A (en)*2022-01-202022-04-22北方工业大学 Lighting control method and system
CN115599220A (en)*2022-11-042023-01-13北京圣威特科技有限公司(Cn) Method, device, MR equipment and storage medium for motion recognition of MR equipment
CN116363795A (en)*2023-03-222023-06-30湖南云数信息科技有限公司 Vending cabinet, management method and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101510121A (en)*2009-03-122009-08-19重庆大学Interface roaming operation method and apparatus based on gesture identification
CN101847057A (en)*2010-06-012010-09-29郭小卫Method for touchpad to acquire input information
US20110175802A1 (en)*2009-12-102011-07-21Tatung CompanyMethod and system for operating electric apparatus
CN102156859A (en)*2011-04-212011-08-17刘津甦Sensing method for gesture and spatial location of hand
CN102184008A (en)*2011-05-032011-09-14北京天盛世纪科技发展有限公司Interactive projection system and method
CN102750046A (en)*2012-05-302012-10-24浙江大学Quick three-dimensional display interacting device and method based on dual-structure light infrared identification
CN102799271A (en)*2012-07-022012-11-28Tcl集团股份有限公司Method and system for identifying interactive commands based on human hand gestures

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101510121A (en)*2009-03-122009-08-19重庆大学Interface roaming operation method and apparatus based on gesture identification
US20110175802A1 (en)*2009-12-102011-07-21Tatung CompanyMethod and system for operating electric apparatus
CN101847057A (en)*2010-06-012010-09-29郭小卫Method for touchpad to acquire input information
CN102156859A (en)*2011-04-212011-08-17刘津甦Sensing method for gesture and spatial location of hand
CN102184008A (en)*2011-05-032011-09-14北京天盛世纪科技发展有限公司Interactive projection system and method
CN102750046A (en)*2012-05-302012-10-24浙江大学Quick three-dimensional display interacting device and method based on dual-structure light infrared identification
CN102799271A (en)*2012-07-022012-11-28Tcl集团股份有限公司Method and system for identifying interactive commands based on human hand gestures

Cited By (15)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104484679B (en)*2014-09-172017-12-22北京邮电大学Non- standard rifle shooting warhead mark image automatic identifying method
CN104484679A (en)*2014-09-172015-04-01北京邮电大学Non-standard gun shooting bullet trace image automatic identification method
CN106491071A (en)*2015-09-062017-03-15中兴通讯股份有限公司A kind of method for giving a test of one's eyesight and terminal
CN105892637A (en)*2015-11-252016-08-24乐视致新电子科技(天津)有限公司Gesture identification method and virtual reality display output device
CN106211470A (en)*2016-08-242016-12-07横店集团得邦照明股份有限公司A kind of LED dimming control system controlled based on 3D gesture and its implementation
CN106443651A (en)*2016-09-302017-02-22乐视控股(北京)有限公司Virtual reality device, and spatial positioning system and method
CN108073274A (en)*2016-11-102018-05-25财团法人金属工业研究发展中心Gesture operation method and system based on depth value
CN108073274B (en)*2016-11-102021-04-06财团法人金属工业研究发展中心 Gesture operation method and system based on depth value
CN106547359A (en)*2016-11-302017-03-29珠海迈科智能科技股份有限公司High voltage power supply with gesture identification function and its recognition methodss
CN107896274A (en)*2017-10-272018-04-10广东欧珀移动通信有限公司 Infrared Emitter Control Method, Terminal, and Computer-Readable Storage Medium
CN108363482A (en)*2018-01-112018-08-03江苏四点灵机器人有限公司A method of the three-dimension gesture based on binocular structure light controls smart television
CN114390760A (en)*2022-01-202022-04-22北方工业大学 Lighting control method and system
CN114390760B (en)*2022-01-202023-11-21北方工业大学Light control method and system
CN115599220A (en)*2022-11-042023-01-13北京圣威特科技有限公司(Cn) Method, device, MR equipment and storage medium for motion recognition of MR equipment
CN116363795A (en)*2023-03-222023-06-30湖南云数信息科技有限公司 Vending cabinet, management method and storage medium

Also Published As

Publication numberPublication date
CN103514437B (en)2017-04-05

Similar Documents

PublicationPublication DateTitle
CN103514437A (en)Three-dimensional hand gesture recognition device and three-dimensional hand gesture recognition method
CN109934848B (en) A method for precise positioning of moving objects based on deep learning
CN104463146B (en)Posture identification method and device based on near-infrared TOF camera depth information
CN103941866B (en)Three-dimensional gesture recognizing method based on Kinect depth image
CN102799318B (en)A kind of man-machine interaction method based on binocular stereo vision and system
CN103226387B (en)Video fingertip localization method based on Kinect
US9047507B2 (en)Upper-body skeleton extraction from depth maps
CN101776952B (en)Novel interactive projection system
CN100487724C (en)Rapid target identification and positioning system and method
CN112667078B (en) Method, system and computer-readable medium for fast mouse control in multi-screen scene based on line-of-sight estimation
CN101477631B (en) Method, device and human-computer interaction system for extracting target from image
CN104978012B (en)One kind points to exchange method, apparatus and system
KR102012254B1 (en)Method for tracking user's gaze position using mobile terminal and apparatus thereof
CN104574365B (en)Obstacle detector and method
CN103984928A (en)Finger gesture recognition method based on field depth image
CN107688779A (en)A kind of robot gesture interaction method and apparatus based on RGBD camera depth images
JP2012068690A (en)Finger gesture detection device
CN103150020A (en)Three-dimensional finger control operation method and system
CN103472907B (en)Method and system for determining operation area
CN103500010A (en)Method for locating fingertips of person through video
CN106484108A (en)Chinese characters recognition method based on double vision point gesture identification
US20130127704A1 (en)Spatial touch apparatus using single infrared camera
CN201699871U (en)interactive projection device
CN204808201U (en)Gesture recognition control system based on vision
CN105205786A (en)Image depth recovery method and electronic device

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp