Summary of the invention
For overcoming Problems existing in correlation technique, disclosure embodiment provides screen unlock method and device, carries out unlocking screen for facilitating user.
According to the first aspect of disclosure embodiment, a kind of screen unlock method is provided, comprises:
When receiving unlock command, in screen, show the pattern for unlocking;
Obtain the face-image of user, determine the moving direction of the blinkpunkt of user's eyeball according to the face-image of user;
According to the moving direction of the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in described pattern;
When the track formed when the position that the blinkpunkt of user's eyeball moves in described pattern is identical with desired guiding trajectory, screen is unlocked.
In one embodiment, the described face-image according to user determines the moving direction of the blinkpunkt of user's eyeball, can comprise:
The eyes image of user is detected from the face-image of user;
Eyes image is resolved, determines the moving direction of the blinkpunkt of user's eyeball according to analysis result.
In one embodiment, described eyes image to be resolved, can comprise:
Utilize radial symmetry algorithm RST to resolve described eyes image, obtain the part that the eye benevolence center of eyeball and eye benevolence are hidden by eyelid;
Utilize moving shape model algorithm ASM to resolve described eyes image, obtain inner eye corner position and the tail of the eye position of eyes.
In one embodiment, described analysis result comprises: the part that eye benevolence center, inner eye corner position, tail of the eye position and eye benevolence are hidden by eyelid; The described moving direction determining the blinkpunkt of user's eyeball according to analysis result, can comprise:
Determine eye socket center according to inner eye corner position and tail of the eye position, according to the position deviation of relative eye socket center, eye benevolence center, that determines the blinkpunkt of eyeball moves horizontally direction;
Determined the vertical moving direction of the blinkpunkt of user's eyeball by the part that eyelid hides according to eye benevolence.
In one embodiment, the described face-image according to user determines the moving direction of the blinkpunkt of user's eyeball, can comprise:
When there is position skew when between the face-image of adjacent two frames, according to the position skew between the face-image of adjacent two frames, determine the facial moving direction of user;
The moving direction of the face of user is corresponded to the moving direction of the blinkpunkt of user's eyeball.
According to the second aspect of disclosure embodiment, a kind of screen unlocking device is provided, comprises:
Display module, for when receiving unlock command, shows the pattern for unlocking in screen;
First determination module, for obtaining the face-image of user, determines the moving direction of the blinkpunkt of user's eyeball according to the face-image of user;
Second determination module, for the moving direction of the blinkpunkt according to user's eyeball, determines the position that the blinkpunkt of user's eyeball moves in described pattern;
Unlocked state, when the track for being formed when the position that the blinkpunkt of user's eyeball moves in described pattern is identical with desired guiding trajectory, unlocks screen.
In one embodiment, described first determination module, can comprise:
Detection sub-module, for detecting the eyes image of user from the face-image of user;
Analyzing sub-module, for resolving eyes image, determines the moving direction of the blinkpunkt of user's eyeball according to analysis result.
In one embodiment, described analyzing sub-module, can comprise:
First resolution unit, for utilizing radial symmetry algorithm RST to resolve described eyes image, obtains the part that the eye benevolence center of eyeball and eye benevolence are hidden by eyelid;
Second resolution unit, for utilizing moving shape model algorithm ASM to resolve described eyes image, obtains inner eye corner position and the tail of the eye position of eyes.
In one embodiment, described analysis result comprises: the part that eye benevolence center, inner eye corner position, tail of the eye position and eye benevolence are hidden by eyelid; Described analyzing sub-module, can comprise:
First determining unit, for determining eye socket center according to inner eye corner position and tail of the eye position, according to the position deviation of relative eye socket center, eye benevolence center, that determines the blinkpunkt of eyeball moves horizontally direction;
Second determining unit, for being determined the vertical moving direction of the blinkpunkt of user's eyeball by the part that eyelid hides according to eye benevolence.
In one embodiment, described first determination module, can comprise:
Determining submodule, during for having position skew when between the face-image of adjacent two frames, according to the position skew between the face-image of adjacent two frames, determining the facial moving direction of user;
Corresponding submodule, the moving direction for the face by user corresponds to the moving direction of the blinkpunkt of user's eyeball.
According to the third aspect of disclosure embodiment, a kind of screen unlocking device is provided, comprises:
Processor;
For the storer of storage of processor executable instruction;
Wherein, described processor is configured to:
When receiving unlock command, in screen, show the pattern for unlocking;
Obtain the face-image of user, determine the moving direction of the blinkpunkt of user's eyeball according to the face-image of user;
According to the moving direction of the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in described pattern;
When the track formed when the position that the blinkpunkt of user's eyeball moves in described pattern is identical with desired guiding trajectory, screen is unlocked.
The technical scheme that embodiment of the present disclosure provides can comprise following beneficial effect: in the disclosure, technical scheme determines the moving direction of the blinkpunkt of user's eyeball according to the face-image of user, according to the moving direction of the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in pattern, when the track formed when the position that the blinkpunkt of user's eyeball moves in pattern is identical with desired guiding trajectory, screen is unlocked; So, user can not be needed to use finger touch screen just can carry out unlocking screen, facilitate user to carry out unlocking screen.
Should be understood that, it is only exemplary and explanatory that above general description and details hereinafter describe, and can not limit the disclosure.
Embodiment
Here will be described exemplary embodiment in detail, its sample table shows in the accompanying drawings.When description below relates to accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawing represents same or analogous key element.Embodiment described in following exemplary embodiment does not represent all embodiments consistent with the disclosure.On the contrary, they only with as in appended claims describe in detail, the example of apparatus and method that aspects more of the present disclosure are consistent.
Fig. 1 is the process flow diagram of a kind of screen unlock method according to an exemplary embodiment.As shown in Figure 1, this screen unlock method is used for terminal device, as in mobile phone, panel computer, comprises the following steps S101-S104:
In step S101, when receiving unlock command, in screen, show the pattern for unlocking.
For example, when receiving the speech unlocking instruction of user, show in screen for unlock 3 × 3 nine grids.
In step s 102, obtain the face-image of user, determine the moving direction of the blinkpunkt of user's eyeball according to the face-image of user.
For example, adopt mobile phone or additional camera to catch user images, utilize iterative algorithm adaboost to use the training set comprising facial image to carry out Face datection, use target tracking algorism meanshift to follow the tracks of, obtain the face-image of user.
In one embodiment, the above-mentioned face-image according to user determines that the moving direction of the blinkpunkt of user's eyeball can comprise the steps A1-A2:
In steps A 1, from the face-image of user, detect the eyes image of user.
For example, iterative algorithm adaboost is utilized to use the training set comprising eye image to carry out human eye detection.
In steps A 2, eyes image is resolved, determine the moving direction of the blinkpunkt of user's eyeball according to analysis result.
Above-mentionedly parsing is carried out to eyes image can comprise the steps A21-A22:
In steps A 21, utilize radial symmetry algorithm RST to resolve eyes image, obtain the part that the eye benevolence center of eyeball and eye benevolence are hidden by eyelid.
Radial symmetry algorithm RST utilizes the gradient direction of the every bit of pixel to carry out the projection ballot in the center of circle.The maximum position of ballot is defined as the eye benevolence center of user, according to the pixel of voting to eye benevolence center, determine the radius of a benevolence, draw a benevolence region, according in eye benevolence region not to the pixel voted in eye benevolence center, draw the part that a benevolence is hidden by eyelid.
In steps A 22, utilize moving shape model algorithm ASM to resolve eyes image, obtain inner eye corner position and the tail of the eye position of eyes.
In one embodiment, analysis result comprises: the part that eye benevolence center, inner eye corner position, tail of the eye position and eye benevolence are hidden by eyelid; The above-mentioned moving direction determining the blinkpunkt of user's eyeball according to analysis result, can comprise the steps A23-A24:
In steps A 23, determine eye socket center according to inner eye corner position and tail of the eye position, according to the position deviation of relative eye socket center, eye benevolence center, that determines the blinkpunkt of eyeball moves horizontally direction.
For example, such as, when eye benevolence center is in the position that eye socket center is to the left, determine that the blinkpunkt of eyeball is moved to the left in the horizontal direction; When eye benevolence center is in the position that eye socket center is to the right, determine that the blinkpunkt of eyeball moves right in the horizontal direction.
In steps A 24, determined the vertical moving direction of the blinkpunkt of user's eyeball by the part that eyelid hides according to eye benevolence.
Such as, when the top of eye benevolence is hidden by upper eyelid, determine that the blinkpunkt of eyeball moves up; When the bottom of eye benevolence is hidden by lower eyelid, determine that the blinkpunkt of eyeball moves down.
In one embodiment, the above-mentioned face-image according to user determines that the moving direction of the blinkpunkt of user's eyeball can comprise the steps B1-B2:
In step bl is determined., when there is position skew when between the face-image of adjacent two frames, according to the position skew between the face-image of adjacent two frames, determine the facial moving direction of user.
In step B2, the moving direction of the face of user is corresponded to the moving direction of the blinkpunkt of user's eyeball.
For example, according to the position skew between the face-image of adjacent two frames, can determine the facial moving direction of user, such as, up and down, left and right, upper left, lower-left, which direction is moved in upper right and direction, eight, bottom right.The moving direction of the face of the user determined is corresponded to the moving direction of the blinkpunkt of user's eyeball.
In step s 103, according to the moving direction of the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in pattern.
For example, before moving according to blinkpunkt, the position of blinkpunkt in pattern of eyeball, and the moving direction of blinkpunkt, determine the position that blinkpunkt moves in pattern.Such as, blinkpunkt, before movement, is positioned at the position at nine grids center, determines that the blinkpunkt of eyeball moves up in step s 102, determines that the blinkpunkt of user's eyeball moves to lattice of the centre of the most lastrow of nine grids.
In step S104, when the track formed when the position that the blinkpunkt of user's eyeball moves in pattern is identical with desired guiding trajectory, screen is unlocked.
The technical scheme that embodiment of the present disclosure provides can comprise following beneficial effect: in the disclosure, technical scheme determines the moving direction of the blinkpunkt of user's eyeball according to the face-image of user, according to the moving direction of the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in pattern, when the track formed when the position that the blinkpunkt of user's eyeball moves in pattern is identical with desired guiding trajectory, screen is unlocked; So, user can not be needed to use finger touch screen just can carry out unlocking screen, facilitate user to carry out unlocking screen.
Embodiment one
Fig. 2 is the process flow diagram of a kind of screen unlock method according to an exemplary embodiment one.Embodiment one is applied in following scene, uses nine grids to unlock in mobile phone, receives phonetic order and starts unblock.As shown in Figure 2, comprise the following steps:
In step s 201, when receiving the speech unlocking instruction of user, show in screen for unlock 3 × 3 nine grids.
In step S202, adopt camera to catch user images, utilize iterative algorithm to use the training set comprising facial image to carry out Face datection, use target tracking algorism to follow the tracks of, obtain the face-image of user.
In step S203, utilize iterative algorithm to use the training set comprising eye image to carry out human eye detection, from the face-image of user, detect the eyes image of user.
In step S204, utilize radial symmetry algorithm RST to resolve eyes image, obtain the part that the eye benevolence center of eyeball and eye benevolence are hidden by eyelid.
In step S205, utilize moving shape model algorithm ASM to resolve eyes image, obtain inner eye corner position and the tail of the eye position of eyes.
In step S206, determine eye socket center according to inner eye corner position and tail of the eye position, according to the position deviation of relative eye socket center, eye benevolence center, that determines the blinkpunkt of eyeball moves horizontally direction.
In step S207, determined the vertical moving direction of the blinkpunkt of user's eyeball by the part that eyelid hides according to eye benevolence.
In step S208, move horizontally direction and vertical moving direction according to the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in nine grids.
In step S209, when the track formed when the position that the blinkpunkt of user's eyeball moves in nine grids is identical with desired guiding trajectory, screen is unlocked.
In embodiment of the present disclosure, do not need user to use finger touch screen just can carry out unlocking screen, user can be facilitated to carry out unlocking screen.
Fig. 3 is the block diagram of a kind of screen unlocking device according to an exemplary embodiment.As shown in Figure 3, this screen unlock method is used for terminal device, as in mobile phone, panel computer, comprising:
Display module 31 is configured to when receiving unlock command, shows the pattern for unlocking in screen;
First determination module 32 is configured to the face-image obtaining user, determines the moving direction of the blinkpunkt of user's eyeball according to the face-image of user;
Second determination module 33 is configured to the moving direction of the blinkpunkt according to user's eyeball, determines the position that the blinkpunkt of user's eyeball moves in pattern;
When the track that unlocked state 34 is configured to be formed when the position that the blinkpunkt of user's eyeball moves in pattern is identical with desired guiding trajectory, screen is unlocked.
In one embodiment, as shown in Figure 4, the first determination module 32, can comprise:
Detection sub-module 41 is configured to the eyes image detecting user from the face-image of user;
Analyzing sub-module 42 is configured to resolve eyes image, determines the moving direction of the blinkpunkt of user's eyeball according to analysis result.
In one embodiment, as shown in Figure 5, analyzing sub-module 42, can comprise:
First resolution unit 51 is configured to utilize radial symmetry algorithm RST to resolve eyes image, obtains the part that the eye benevolence center of eyeball and eye benevolence are hidden by eyelid;
Second resolution unit 52 is configured to utilize moving shape model algorithm ASM to resolve eyes image, obtains inner eye corner position and the tail of the eye position of eyes.
In one embodiment, as shown in Figure 5, analysis result comprises: the part that eye benevolence center, inner eye corner position, tail of the eye position and eye benevolence are hidden by eyelid; Analyzing sub-module 42, can comprise:
First determining unit 53 is configured to determine eye socket center according to inner eye corner position and tail of the eye position, and according to the position deviation of relative eye socket center, eye benevolence center, that determines the blinkpunkt of eyeball moves horizontally direction;
Second determining unit 54 is configured to the vertical moving direction of the blinkpunkt being determined user's eyeball according to eye benevolence by the part that eyelid hides.
In one embodiment, as shown in Figure 6, the first determination module 32, comprising:
When determining that submodule 61 is configured to have position skew when between the face-image of adjacent two frames, according to the position skew between the face-image of adjacent two frames, determine the facial moving direction of user;
Corresponding submodule 62 is configured to the moving direction of the blinkpunkt moving direction of the face of user being corresponded to user's eyeball.
About the device in above-described embodiment, wherein the concrete mode of modules executable operations has been described in detail in about the embodiment of the method, will not elaborate explanation herein.
The technical scheme that embodiment of the present disclosure provides can comprise following beneficial effect: in the disclosure, technical scheme determines the moving direction of the blinkpunkt of user's eyeball according to the face-image of user, according to the moving direction of the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in pattern, when the track formed when the position that the blinkpunkt of user's eyeball moves in pattern is identical with desired guiding trajectory, screen is unlocked; So, user can not be needed to use finger touch screen just can carry out unlocking screen, facilitate user to carry out unlocking screen.
Fig. 7 is a kind of block diagram for screen unlocking device 1200 according to an exemplary embodiment, and this device is applicable to terminal device.Such as, device 1200 can be mobile phone, computing machine, digital broadcast terminal, messaging devices, game console, tablet device, Medical Devices, body-building equipment, personal digital assistant etc.
With reference to Fig. 7, device 1200 can comprise following one or more assembly: processing components 1202, storer 1204, power supply module 1206, multimedia groupware 1208, audio-frequency assembly 1210, the interface 1212 of I/O (I/O), sensor module 1214, and communications component 1216.
The integrated operation of the usual control device 1200 of processing components 1202, such as with display, call, data communication, camera operation and record operate the operation be associated.Treatment element 1202 can comprise one or more processor 1220 to perform instruction, to complete all or part of step of above-mentioned method.In addition, processing components 1202 can comprise one or more module, and what be convenient between processing components 1202 and other assemblies is mutual.Such as, processing element 1202 can comprise multi-media module, mutual with what facilitate between multimedia groupware 1208 and processing components 1202.
Storer 1204 is configured to store various types of data to be supported in the operation of equipment 1200.The example of these data comprises for any application program of operation on device 1200 or the instruction of method, contact data, telephone book data, message, picture, video etc.Storer 1204 can be realized by the volatibility of any type or non-volatile memory device or their combination, as static RAM (SRAM), Electrically Erasable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory EPROM (EPROM), programmable read only memory (PROM), ROM (read-only memory) (ROM), magnetic store, flash memory, disk or CD.
The various assemblies that electric power assembly 1206 is device 1200 provide electric power.Electric power assembly 1206 can comprise power-supply management system, one or more power supply, and other and the assembly generating, manage and distribute electric power for device 1200 and be associated.
Multimedia groupware 1208 is included in the screen providing an output interface between described device 1200 and user.In certain embodiments, screen can comprise liquid crystal display (LCD) and touch panel (TP).If screen comprises touch panel, screen may be implemented as touch-screen, to receive the input signal from user.Touch panel comprises one or more touch sensor with the gesture on sensing touch, slip and touch panel.Described touch sensor can the border of not only sensing touch or sliding action, but also detects the duration relevant to described touch or slide and pressure.In certain embodiments, multimedia groupware 1208 comprises a front-facing camera and/or post-positioned pick-up head.When equipment 1200 is in operator scheme, during as screening-mode or video mode, front-facing camera and/or post-positioned pick-up head can receive outside multi-medium data.Each front-facing camera and post-positioned pick-up head can be fixing optical lens systems or have focal length and optical zoom ability.
Audio-frequency assembly 1210 is configured to export and/or input audio signal.Such as, audio-frequency assembly 1210 comprises a microphone (MIC), and when device 1200 is in operator scheme, during as call model, logging mode and speech recognition mode, microphone is configured to receive external audio signal.The sound signal received can be stored in storer 1204 further or be sent via communications component 1216.In certain embodiments, audio-frequency assembly 1210 also comprises a loudspeaker, for output audio signal.
I/O interface 1212 is for providing interface between processing components 1202 and peripheral interface module, and above-mentioned peripheral interface module can be keyboard, some striking wheel, button etc.These buttons can include but not limited to: home button, volume button, start button and locking press button.
Sensor module 1214 comprises one or more sensor, for providing the state estimation of various aspects for device 1200.Such as, sensor module 1214 can detect the opening/closing state of equipment 1200, the relative positioning of assembly, such as described assembly is display and the keypad of device 1200, the position of all right pick-up unit 1200 of sensor module 1214 or device 1200 assemblies changes, the presence or absence that user contacts with device 1200, the temperature variation of device 1200 orientation or acceleration/deceleration and device 1200.Sensor module 1214 can comprise proximity transducer, be configured to without any physical contact time detect near the existence of object.Sensor module 1214 can also comprise optical sensor, as CMOS or ccd image sensor, for using in imaging applications.In certain embodiments, this sensor module 1214 can also comprise acceleration transducer, gyro sensor, Magnetic Sensor, pressure transducer or temperature sensor.
Communications component 1216 is configured to the communication being convenient to wired or wireless mode between device 1200 and other equipment.Device 1200 can access the wireless network based on communication standard, as WiFi, 2G or 3G, or their combination.In one exemplary embodiment, communication component 1216 receives from the broadcast singal of external broadcasting management system or broadcast related information via broadcast channel.In one exemplary embodiment, described communication component 1216 also comprises near-field communication (NFC) module, to promote junction service.Such as, can based on radio-frequency (RF) identification (RFID) technology in NFC module, Infrared Data Association (IrDA) technology, ultra broadband (UWB) technology, bluetooth (BT) technology and other technologies realize.
In the exemplary embodiment, device 1200 can be realized, for performing said method by one or more application specific integrated circuit (ASIC), digital signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD) (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components.
In the exemplary embodiment, additionally provide a kind of non-transitory computer-readable recording medium comprising instruction, such as, comprise the storer 1204 of instruction, above-mentioned instruction can perform said method by the processor 820 of device 1200.Such as, described non-transitory computer-readable recording medium can be ROM, random access memory (RAM), CD-ROM, tape, floppy disk and optical data storage devices etc.
A kind of screen unlocking device, comprising:
Processor;
For the storer of storage of processor executable instruction;
Wherein, processor is configured to:
When receiving unlock command, in screen, show the pattern for unlocking;
Obtain the face-image of user, determine the moving direction of the blinkpunkt of user's eyeball according to the face-image of user;
According to the moving direction of the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in described pattern;
When the track formed when the position that the blinkpunkt of user's eyeball moves in described pattern is identical with desired guiding trajectory, screen is unlocked.
This processor is configured to: the eyes image detecting user from the face-image of user; Eyes image is resolved, determines the moving direction of the blinkpunkt of user's eyeball according to analysis result.
This processor is configured to: utilize radial symmetry algorithm RST to resolve described eyes image, obtains the part that the eye benevolence center of eyeball and eye benevolence are hidden by eyelid; Utilize moving shape model algorithm ASM to resolve described eyes image, obtain inner eye corner position and the tail of the eye position of eyes.
This processor is configured to: determine eye socket center according to inner eye corner position and tail of the eye position, and according to the position deviation of relative eye socket center, eye benevolence center, that determines the blinkpunkt of eyeball moves horizontally direction; Determined the vertical moving direction of the blinkpunkt of user's eyeball by the part that eyelid hides according to eye benevolence.
This processor is configured to: when having position skew when between the face-image of adjacent two frames, according to the position skew between the face-image of adjacent two frames, determines the facial moving direction of user; The moving direction of the face of user is corresponded to the moving direction of the blinkpunkt of user's eyeball.
A kind of non-transitory computer-readable recording medium, when the instruction in described storage medium is performed by the processor of mobile terminal, make mobile terminal can perform a kind of screen unlock method, described method comprises:
When receiving unlock command, in screen, show the pattern for unlocking;
Obtain the face-image of user, determine the moving direction of the blinkpunkt of user's eyeball according to the face-image of user;
According to the moving direction of the blinkpunkt of user's eyeball, determine the position that the blinkpunkt of user's eyeball moves in described pattern;
When the track formed when the position that the blinkpunkt of user's eyeball moves in described pattern is identical with desired guiding trajectory, screen is unlocked.
The described face-image according to user determines the moving direction of the blinkpunkt of user's eyeball, can comprise: the eyes image detecting user from the face-image of user; Eyes image is resolved, determines the moving direction of the blinkpunkt of user's eyeball according to analysis result.
Described eyes image to be resolved, can comprise: utilize radial symmetry algorithm RST to resolve described eyes image, obtain the part that the eye benevolence center of eyeball and eye benevolence are hidden by eyelid; Utilize moving shape model algorithm ASM to resolve described eyes image, obtain inner eye corner position and the tail of the eye position of eyes.
The described moving direction determining the blinkpunkt of user's eyeball according to analysis result, can comprise: determine eye socket center according to inner eye corner position and tail of the eye position, according to the position deviation of relative eye socket center, eye benevolence center, that determines the blinkpunkt of eyeball moves horizontally direction; Determined the vertical moving direction of the blinkpunkt of user's eyeball by the part that eyelid hides according to eye benevolence.
The described face-image according to user determines the moving direction of the blinkpunkt of user's eyeball, can comprise: when having position skew when between the face-image of adjacent two frames, according to the position skew between the face-image of adjacent two frames, determines the facial moving direction of user; The moving direction of the face of user is corresponded to the moving direction of the blinkpunkt of user's eyeball.
Those skilled in the art, at consideration instructions and after putting into practice disclosed herein disclosing, will easily expect other embodiment of the present disclosure.The application is intended to contain any modification of the present disclosure, purposes or adaptations, and these modification, purposes or adaptations are followed general principle of the present disclosure and comprised the undocumented common practise in the art of the disclosure or conventional techniques means.Instructions and embodiment are only regarded as exemplary, and true scope of the present disclosure and spirit are pointed out by claim below.
Should be understood that, the disclosure is not limited to precision architecture described above and illustrated in the accompanying drawings, and can carry out various amendment and change not departing from its scope.The scope of the present disclosure is only limited by appended claim.