技术领域technical field
本发明涉及生物特征识别技术领域，尤其涉及一种基于人脸识别的解锁方法、装置以及移动终端。The present invention relates to the technical field of biological feature recognition, and in particular to an unlocking method, device and mobile terminal based on face recognition.
背景技术Background technique
在使用互联网产品时，对使用者进行身份验证是目前较为常见的一种保护用户信息安全的方式，现有的用户身份认证方法主要分为三种：一种是基于密码口令等信息的认证方式；第二种是基于特殊标志的认证，如钥匙、身份证等；第三种则是用户生物特征的认证，用户的生物特征主要可以包括指纹、声音、面孔、掌纹、虹膜、DNA等。相对于这三种安全认证方式，生物特征认证技术具有很多优点，例如生物特征随身携带，不会遗忘，不会丢失，并且与用户唯一绑定，因而具有较高的安全性。When using Internet products, user identity verification is a relatively common way to protect user information security. The existing user identity authentication methods are mainly divided into three types: one is based on passwords and other information authentication methods The second is authentication based on special signs, such as keys, ID cards, etc.; the third is the authentication of user biometrics, which mainly include fingerprints, voices, faces, palm prints, iris, DNA, etc. Compared with these three security authentication methods, biometric authentication technology has many advantages. For example, biometrics can be carried with you, will not be forgotten, will not be lost, and are uniquely bound to the user, so it has higher security.
目前，随着人脸识别技术的越来越成熟，市面上的大量手机都增加了人脸识别的手机解锁方式。这种通过人脸识别的解锁方式，不仅操作简单(用户只需将人脸对着手机屏幕即可)，且解锁速度快，一经上市便受到用户的广泛好评。At present, as face recognition technology becomes more and more mature, a large number of mobile phones on the market have added a face recognition mobile phone unlocking method. This unlocking method through face recognition is not only easy to operate (users only need to face the screen of the mobile phone), but also has a fast unlocking speed. It has been widely praised by users once it is launched.
然而由于现有人脸识别解锁的操作方式的影响，当用户只需要点亮手机屏幕看一下手机的时间或者日期的时候，此时按照现有的人脸识别解锁的操作流程，手机同样也会对用户的人脸图像进行采集，并通过对采集到的人脸图像进行人脸识别，从而自动进行解锁。很明显，在这种情况下的解锁并非用户本意，属于误解锁，从而极大地影响了用户正常的使用体验。However, due to the influence of the existing face recognition unlocking operation method, when the user only needs to light up the mobile phone screen to see the time or date of the mobile phone, at this time, according to the existing face recognition unlocking operation process, the mobile phone will also be unlocked. The user's face image is collected, and the face recognition is performed on the collected face image, thereby automatically unlocking. Obviously, the unlocking in this case is not the user's intention, and it is a mistaken unlocking, which greatly affects the normal user experience of the user.
发明内容Contents of the invention
本发明实施例提供一种基于人脸识别的解锁方法、装置以及移动终端，用以解决采用现有的人脸识别解锁方法导致误解锁，而影响用户正常使用体验的问题。Embodiments of the present invention provide an unlocking method, device, and mobile terminal based on face recognition to solve the problem that using the existing face recognition unlocking method leads to false unlocking and affects the user's normal use experience.
为了解决上述技术问题，本发明是这样实现的：In order to solve the problems of the technologies described above, the present invention is achieved in that:
第一方面，提供了一种基于人脸识别的解锁方法，该方法包括：In the first aspect, an unlocking method based on face recognition is provided, the method comprising:
响应于针对屏幕的触摸操作，启动图像采集模块；In response to the touch operation on the screen, start the image acquisition module;
若图像采集模块采集到人脸图像，且所述人脸图像的眼睛的视线目标为屏幕的显示区域时，点亮所述屏幕；If the image acquisition module acquires a face image, and the sight target of the eyes of the face image is the display area of the screen, light up the screen;
根据指定物理按键当前的按压情况，确定是否执行人脸识别解锁指令。According to the current pressing situation of the specified physical button, determine whether to execute the face recognition unlock command.
第二方面，提供了一种基于人脸识别的解锁装置，该装置包括：In a second aspect, an unlocking device based on face recognition is provided, the device comprising:
采集模块控制单元，用于响应于针对屏幕的触摸操作，启动图像采集模块；An acquisition module control unit, configured to start the image acquisition module in response to a touch operation on the screen;
显示单元，用于若图像采集模块采集到人脸图像，且所述人脸图像的眼睛的视线目标为屏幕的显示区域，点亮所述屏幕；A display unit, configured to light up the screen if the image acquisition module acquires a face image, and the sight target of the eyes of the face image is the display area of the screen;
解锁单元，用于根据指定物理按键当前的按压情况，确定是否解除人脸识别锁定。The unlocking unit is used to determine whether to release the face recognition lock according to the current pressing situation of the specified physical button.
第三方面，提供了一种终端设备，该终端设备包括处理器、存储器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如第一方面所述的方法的步骤。In a third aspect, a terminal device is provided. The terminal device includes a processor, a memory, and a computer program stored in the memory and operable on the processor. When the computer program is executed by the processor The steps of the method described in the first aspect are realized.
第四方面，提供了一种计算机可读存储介质，其特征在于，所述计算机可读存储介质上存储计算机程序，所述计算机程序被处理器执行时实现如第一方面所述的方法的步骤。In a fourth aspect, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method according to the first aspect are implemented .
在本发明实施例中，用户在使用终端设备时，用户通过触摸终端屏幕，可以触发终端启动前置摄像头进行图像采集，进而终端设备可以根据摄像头所采集到的图像，来判断采集到的图像是否为人脸图像，且该人脸图像的眼睛的实现目标是否为终端屏幕的显示区域，当图像采集模块采集到人脸图像，且所述人脸图像的眼睛的视线目标为屏幕的显示区域时，则终端可以点亮所述屏幕，在这种情况下，由于终端仅仅是点亮屏幕，而不会触发人脸识别解锁操作，从而避免了当用户仅仅想查看时间时的误解锁。而当用户需要进行人脸识别解锁时，用户通过进一步按压终端的特定物理按键，即可触发终端进行人脸识别解锁。由于采用本申请实施例所提供的基于人脸识别的解锁方法，在用户触发图像采集请求后，终端设备不会马上进行人脸识别，而会根据采集到的图像以及用户对终端设备上指定物理按键的按压情况，来确定当前是否需要进行人脸识别解锁，从而避免了在用户不想解锁终端设备时，终端设备误解锁的问题。In the embodiment of the present invention, when the user is using the terminal device, the user can trigger the terminal to start the front camera for image collection by touching the terminal screen, and then the terminal device can judge whether the collected image is based on the image collected by the camera. is a face image, and whether the target of the eyes of the face image is the display area of the terminal screen, when the image acquisition module captures the face image, and the sight target of the eyes of the face image is the display area of the screen, Then the terminal can light up the screen. In this case, since the terminal only lights up the screen, the face recognition unlocking operation is not triggered, thereby avoiding an accidental unlocking when the user only wants to check the time. When the user needs to unlock with face recognition, the user can trigger the terminal to unlock with face recognition by further pressing a specific physical button on the terminal. Due to the use of the face recognition-based unlocking method provided by the embodiment of the present application, after the user triggers an image collection request, the terminal device will not immediately perform face recognition, but will use the collected image and the user's specified physical location on the terminal device. Press the button to determine whether face recognition unlocking is currently required, thereby avoiding the problem of accidentally unlocking the terminal device when the user does not want to unlock the terminal device.
附图说明Description of drawings
此处所说明的附图用来提供对本发明的进一步理解，构成本发明的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：The accompanying drawings described here are used to provide a further understanding of the present invention, and constitute a part of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention, and do not constitute improper limitations to the present invention. In the attached picture:
图1是本发明的一个实施例所提供的基于人脸识别的解锁方法的具体实现流程示意图；Fig. 1 is a schematic diagram of the specific implementation flow of the face recognition-based unlocking method provided by one embodiment of the present invention;
图2是本发明的一个实施例所提供的一种人眼注视效果示意图；Fig. 2 is a schematic diagram of a human eye gaze effect provided by an embodiment of the present invention;
图3是本发明的一个实施例所提供的一种人眼注视视线示意图；Fig. 3 is a schematic diagram of a human gaze provided by an embodiment of the present invention;
图4为本发明的一个实施例所提供的一种三维坐标系示意图；Fig. 4 is a schematic diagram of a three-dimensional coordinate system provided by an embodiment of the present invention;
图5为本发明的一个实施例所提供的一种人眼视线在该三维坐标系上交点的示意图；Fig. 5 is a schematic diagram of an intersection point of the human eye's line of sight on the three-dimensional coordinate system provided by an embodiment of the present invention;
图6为本发明的一个实施例所提供的另外一种基于人脸识别的解锁方法的具体实现流程示意图；FIG. 6 is a schematic diagram of a specific implementation flow of another face recognition-based unlocking method provided by an embodiment of the present invention;
图7为本发明的一个实施例所提供的基于人脸识别的解锁装置的具体结构示意图；Fig. 7 is a specific structural schematic diagram of an unlocking device based on face recognition provided by an embodiment of the present invention;
图8为本发明的一个实施例所提供的终端设备的结构示意图。Fig. 8 is a schematic structural diagram of a terminal device provided by an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
以下结合附图，详细说明本申请各实施例提供的技术方案。The technical solutions provided by various embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.
本申请实施例提供的图像处理方法的执行主体，可以但不限于为手机、平板电脑、个人电脑(Personal Computer，PC)以及任何可以运行图像处理美颜应用(Appliacation，APP)的终端设备中的至少一种。此外，该方法的执行主体，也可以是用于实现人脸识别解锁的APP本身。The execution subject of the image processing method provided by the embodiment of the present application may be, but not limited to, a mobile phone, a tablet computer, a personal computer (Personal Computer, PC) and any terminal device that can run an image processing beauty application (Appliacation, APP). at least one. In addition, the subject of execution of the method may also be the APP itself for unlocking by face recognition.
为了便于描述，下文以该方法的执行主体为移动终端设备手机为例对该方法的实施方式进行介绍。可以理解，该方法的执行主体为手机只是一种示例性的说明，并不应理解为对该方法的限定。For the convenience of description, the implementation of the method will be introduced below by taking the mobile terminal device mobile phone as an example to execute the method. It can be understood that the implementation subject of the method is the mobile phone is only an exemplary description, and should not be understood as a limitation of the method.
本申请实施例提供了一种基于人脸识别的解锁方法，用以解决采用现有的人脸识别解锁方法可能导致误解锁，而影响用户正常使用体验的问题，该方法的具体实现流程示意图如图1所示，主要包括下述步骤：The embodiment of the present application provides an unlocking method based on face recognition to solve the problem that using the existing face recognition unlocking method may lead to false unlocking and affect the user's normal use experience. The specific implementation flow diagram of the method is as follows As shown in Figure 1, it mainly includes the following steps:
步骤101：响应于针对屏幕的触摸操作，启动图像采集模块；Step 101: Start the image acquisition module in response to a touch operation on the screen;
其中，所述图像采集模块可以是指手机上摄像头，比如手机的前置摄像头，或者也可以是指手机的其他图像采集装置。Wherein, the image acquisition module may refer to a camera on the mobile phone, such as a front camera of the mobile phone, or may refer to other image acquisition devices of the mobile phone.
需要说明的是，用户对屏幕的触摸操作可以包括但不仅限于下述操作中的至少一种：It should be noted that the user's touch operation on the screen may include but not limited to at least one of the following operations:
操作1：长按操作；Operation 1: long press operation;
比如，用户可以通过长按手机屏幕，以触发手机启动图像采集模块。For example, the user can trigger the mobile phone to start the image acquisition module by long pressing the screen of the mobile phone.
这里还需要说明的是，为了避免用户无意中点击屏幕而导致的误操作，在本申请实施例中，当用户将控制区启动图像采集模块的操作设置为长按操作时，手机还需要检测针对屏幕的触摸操作是否超过预设的时长，比如该预设时长为2s，则当用户长按手机屏幕超过2s后，手机才会启动图像采集模块。What needs to be explained here is that in order to avoid misoperations caused by the user accidentally clicking the screen, in the embodiment of this application, when the user sets the operation of starting the image acquisition module in the control area as a long press operation, the mobile phone also needs to detect the Whether the touch operation on the screen exceeds the preset duration. For example, if the preset duration is 2s, the mobile phone will start the image acquisition module only after the user presses and holds the screen of the mobile phone for more than 2s.
操作2：滑动手势操作；Operation 2: slide gesture operation;
比如，用户可以按照预先设置的滑动轨迹，在手机屏幕上输入特定的滑动手势操作，以触发手机启动图像采集模块。For example, the user can input a specific sliding gesture operation on the screen of the mobile phone according to the preset sliding trajectory to trigger the mobile phone to start the image acquisition module.
操作3：点击操作；Operation 3: click operation;
比如，用户可以通过双击手机屏幕的方式，以触发手机启动图像采集模块。For example, the user can trigger the mobile phone to start the image acquisition module by double-clicking the screen of the mobile phone.
用户可以根据自己的需要，自行设置可以采用何种方式启动手机的图像采集模块，或者当用户没有自行设置触发方式时，终端设备可以随机选择一种触发方式作为默认触发方式。The user can set the way to start the image acquisition module of the mobile phone according to his own needs, or when the user does not set the trigger mode by himself, the terminal device can randomly select a trigger mode as the default trigger mode.
在本申请实施例中，用户想要启动手机的图像采集模块也需要通过上述几种操作方式，而上述几种操作方式一般不容易被用户在无意识的状况下误触发，因而采用这种方式也可以在一定程度上避免用户的误操作。In this embodiment of the application, the user also needs to use the above-mentioned several operation methods to start the image acquisition module of the mobile phone, and the above-mentioned several operation methods are generally not easy to be accidentally triggered by the user unconsciously, so this method is also necessary. To a certain extent, user misoperation can be avoided.
当手机检测到用户通过上述方式对手机屏幕的触摸操作后，手机会启动前置摄像头，并通过该前置摄像头进行图像采集。When the mobile phone detects that the user touches the screen of the mobile phone through the above method, the mobile phone will start the front camera and collect images through the front camera.
步骤102：判断通过执行步骤101采集到的图像是否为人脸图像，且所述人脸图像的眼睛的视线目标是否为屏幕的显示区域；若判断结果为是，则执行步骤103；若判断结果为否，则继续通过图像采集模块进行图像采集；Step 102: Judging whether the image collected by executing step 101 is a face image, and whether the sight target of the eyes of the face image is the display area of the screen; if the judgment result is yes, then perform step 103; if the judgment result is If not, then continue to carry out image acquisition through the image acquisition module;
这里需要说明的是，一般地当用户需要解锁使用手机时，用户往往会手持手机并将手机置于自己面前，则在这种情况下，当用户通过上述操作触发图像采集请求后，手机响应于该请求启动前置摄像头后，通过该前置摄像头一般都可以采集到用户的面部图像；而当用户是由于误操作而触发手机启动该前置摄像头时，此时由于用户不需要使用手机，因而手机一般不会置于用户面前，这种情况下手机通过该前置摄像头也无法采集到用户的面部图像。What needs to be explained here is that generally when the user needs to unlock the mobile phone, the user often holds the mobile phone and places the mobile phone in front of himself. In this case, when the user triggers the image acquisition request through the above operations, the mobile phone responds to After the request starts the front camera, the user's facial image can generally be collected through the front camera; and when the user triggers the mobile phone to start the front camera due to misoperation, since the user does not need to use the mobile phone at this time, the The mobile phone is generally not placed in front of the user. In this case, the mobile phone cannot collect the user's facial image through the front camera.
基于上述原因，在本申请实施例中，手机可以将采集到的第一图像上是否具有人脸图像作为判断当前用户是否需要使用手机的依据之一。除此之外，基于同样的原因，因而用户视线是否注视着手机屏幕，也可以作为判断当前用户是否需要使用手机的依据之一。Based on the above reasons, in the embodiment of the present application, the mobile phone may use whether the collected first image has a human face image as one of the bases for judging whether the current user needs to use the mobile phone. In addition, based on the same reason, whether the user is looking at the screen of the mobile phone can also be used as one of the basis for judging whether the current user needs to use the mobile phone.
则在本申请实施例中，具体可以采用以下方法判断采集到的图像是否为人脸图像，且所述人脸图像的眼睛的视线目标是否为屏幕的显示区域：对采集到的图像进行人脸检测，判断所述图像是否为人脸图像；当判断所述图像为人脸图像时，判断图像中人眼是否注视所述屏幕的显示区域；当判断所述第一图像中人眼注视所述屏幕的显示区域时，则可以确定用户当前需要使用手机，进而点亮手机屏幕。Then in the embodiment of the present application, the following method can be used to judge whether the collected image is a human face image, and whether the sight target of the eyes of the human face image is the display area of the screen: perform face detection on the collected image , judging whether the image is a human face image; when judging that the image is a human face image, judging whether the human eye in the image is watching the display area of the screen; when judging that the human eye is watching the display of the screen in the first image When the area is selected, it can be determined that the user currently needs to use the mobile phone, and then light up the mobile phone screen.
在通过执行步骤101手机通过图像采集模块采集到图像后，手机首先会对该图像进行人脸识别，以判断该图像上是否存在人脸图像。具体地，手机可以采用人脸识别技术对第一图像进行人脸检测以确定该第一图像上是否存在人脸图像。人脸检测是人脸识别技术的第一步，基于人的脸部特征，可以确定输入的图像上是否有人脸图像。After the mobile phone acquires an image through the image acquisition module by executing step 101, the mobile phone first performs face recognition on the image to determine whether there is a human face image on the image. Specifically, the mobile phone may use face recognition technology to perform face detection on the first image to determine whether there is a face image on the first image. Face detection is the first step of face recognition technology. Based on the facial features of a person, it can be determined whether there is a face image on the input image.
具体地，可以采用以下五种方式进行人脸检测：Specifically, face detection can be performed in the following five ways:
方式1：参考模板法：Method 1: Reference template method:
采用该方法，首先会设计一个或数个标准人脸的模板，然后计算测试采集的样品与标准模板之间的匹配程度，并通过阈值来判断是否存在人脸；Using this method, one or several standard face templates will be designed first, then the degree of matching between the samples collected by the test and the standard template will be calculated, and the threshold will be used to determine whether there is a face;
方式2：人脸规则法：Method 2: face rule method:
由于人脸具有一定的结构分布特征，所谓人脸规则的方法即提取这些特征生成相应的规则以判断测试样品是否包含人脸；Since human faces have certain structural distribution features, the so-called face rule method is to extract these features to generate corresponding rules to judge whether the test sample contains human faces;
方式3：样品学习法：Method 3: Sample learning method:
这种方法即采用模式识别中人工神经网络的方法，即通过对面像样品集和非面像样品集的学习产生分类器；This method uses the method of artificial neural network in pattern recognition, that is, a classifier is generated by learning the face sample set and the non-face sample set;
方式4：肤色模型法：Method 4: Skin color model method:
这种方法是依据面貌肤色在色彩空间中分布相对集中的规律来进行检测。This method is based on the relatively concentrated distribution of facial skin color in the color space for detection.
方式5：特征子脸法：Method 5: Feature subface method:
这种方法是将所有面像集合视为一个面像子空间，并基于检测样品与其在子空间的投影之间的距离判断是否存在面像。This method regards all face sets as a face subspace, and judges whether there is a face based on the distance between the detection sample and its projection in the subspace.
在本申请实施例中，可以采用上述五种方式来对待处理图像进行人脸识别，除此以外，还可以采用其他方式对第一图像进行人脸识别，本申请实施例对人脸识别具体采用的方法不做限定，只要能识别出通过图像采集模块采集到的图像中存在人脸图像即可。In the embodiment of the present application, the above five methods can be used to perform face recognition on the image to be processed. In addition, other methods can also be used to perform face recognition on the first image. The embodiment of the present application specifically uses The method is not limited, as long as it can be identified that there is a face image in the image collected by the image collection module.
当手机采用上述方法确定通过执行步骤101采集到的图像中存在人脸图像后，可以进一步地对该人脸图像上人眼的视线进行确定，以确定该人眼视线是否落在手机屏幕上。则在本申请实施例中，手机判断图像中人眼是否注视屏幕显示区域的具体方法可以包括：确定该图像中人眼的视线；根据所述人眼视线是否落在所述屏幕的显示区域，确定所述第一图像中人眼是否注视所述屏幕的显示区域。After the mobile phone determines that there is a face image in the image collected by executing step 101 through the above method, it can further determine the line of sight of the human eye on the face image to determine whether the line of sight of the human eye falls on the screen of the mobile phone. Then, in the embodiment of the present application, the specific method for the mobile phone to determine whether the human eye in the image is watching the display area of the screen may include: determining the line of sight of the human eye in the image; according to whether the line of sight of the human eye falls on the display area of the screen, Determining whether human eyes in the first image focus on the display area of the screen.
为了可以判断用户视线是否落在手机屏幕上，在本申请实施例中，手机首先需要确定在图像中人脸图像上人眼的视线。一般地，我们可以通瞳孔在眼球中的位置来确定用户当前的注视方向，如图2所示，图2中人眼瞳孔位于眼球的正中心，因而可以确定该人眼视线的方向为正前方。而如图3所示，图3中人眼瞳孔的中心并没有为与眼球中心，此时瞳孔中心与眼球中心之间呈一定角度，则在这种情况下，可以将人眼眼球中心与瞳孔中心之间的连线，作为该人眼的视线，则图3中该人眼的视线方向如图3中虚线方向所示。In order to determine whether the user's line of sight falls on the screen of the mobile phone, in the embodiment of the present application, the mobile phone first needs to determine the line of sight of the human eye on the face image in the image. Generally, we can determine the user's current gaze direction through the position of the pupil in the eyeball. As shown in Figure 2, the pupil of the human eye in Figure 2 is located in the very center of the eyeball, so it can be determined that the direction of the human eye's line of sight is straight ahead . As shown in Figure 3, the center of the human eye pupil in Figure 3 is not the same as the center of the eyeball. At this time, there is a certain angle between the center of the pupil and the center of the eyeball. In this case, the center of the human eyeball and the center of the pupil can be The connecting line between the centers is the line of sight of the human eye, and the line of sight of the human eye in FIG. 3 is shown in the direction of the dotted line in FIG. 3 .
基于上述思路，在本申请实施例中，可以通过在人脸图像中的人眼眼球中心点位置坐标与人眼瞳孔位置坐标来确定该人眼的视线方向，具体可以包括：确定在所述人脸图像中人眼中心点位置坐标；确定在所述人脸图像中人眼瞳孔位置坐标；根据所述人眼中心点位置坐标以及所述人眼瞳孔位置坐标，确定所述人脸图像中人眼的视线。Based on the above idea, in the embodiment of the present application, the line-of-sight direction of the human eye can be determined through the position coordinates of the center point of the human eyeball and the position coordinates of the pupil of the human eye in the face image. The position coordinates of the human eye center point in the face image; determine the human eye pupil position coordinates in the human face image; determine the human eye pupil position coordinates in the human face image according to the human eye center point position coordinates and the human eye pupil position coordinates eye sight.
需要说明的是，在本申请实施例中可以以手机屏幕坐标系X轴、Y轴以及与屏幕垂直的一条轴线构成一个三维坐标系。例如，可以将该三维坐标系的原点与手机屏幕的坐标原点设置在同一位置，而该三维坐标系的X轴为与手机屏幕垂直且经过手机屏幕坐标系原点的轴线，该三维坐标系的Y轴为该手机屏幕的X轴，该三维坐标系的Z轴为该手机屏幕的Y轴，则该三维坐标系如图4所述。It should be noted that, in the embodiment of the present application, a three-dimensional coordinate system can be formed by the mobile phone screen coordinate system X-axis, Y-axis and an axis perpendicular to the screen. For example, the origin of the three-dimensional coordinate system and the coordinate origin of the mobile phone screen can be set at the same position, and the X-axis of the three-dimensional coordinate system is an axis perpendicular to the mobile phone screen and passing through the origin of the mobile phone screen coordinate system, and the Y axis of the three-dimensional coordinate system is axis is the X-axis of the mobile phone screen, and the Z-axis of the three-dimensional coordinate system is the Y-axis of the mobile phone screen, then the three-dimensional coordinate system is as shown in Figure 4.
在按照上述方法完成三维坐标系的构建后，手机可以分别确定在人脸图像中人眼图像的眼球中心点在该三维坐标系中的位置坐标以及瞳孔中心点在该三维坐标系中的位置坐标，根据眼球中心点的位置坐标以及瞳孔中心点的位置首先可以确定该人眼的视线方向，进而根据人脸图像与手机屏幕之间的距离，以及人眼的视线方向，确定该视线与手机屏幕之间是否有交点，则当该人眼的视线方向与该手机屏幕上存在交点时，则可以确定该人眼视线正在注视该手机屏幕的显示区域。例如如图5所示，在图5所示的这种情况下，可以确定该人眼视线当前落在该手机屏幕的显示区域内。After completing the construction of the three-dimensional coordinate system according to the above method, the mobile phone can respectively determine the position coordinates of the eyeball center point of the human eye image in the three-dimensional coordinate system and the position coordinates of the pupil center point in the three-dimensional coordinate system in the face image , according to the position coordinates of the eyeball center point and the position of the pupil center point, the line of sight direction of the human eye can be determined first, and then according to the distance between the face image and the mobile phone screen, and the line of sight direction of the human eye, the line of sight and the mobile phone screen can be determined If there is an intersection between them, then when there is an intersection between the line of sight of the human eye and the screen of the mobile phone, it can be determined that the line of sight of the human eye is watching the display area of the mobile phone screen. For example, as shown in FIG. 5 , in the situation shown in FIG. 5 , it may be determined that the line of sight of the human eye currently falls within the display area of the screen of the mobile phone.
步骤103：手机点亮屏幕；Step 103: the mobile phone lights up the screen;
当通过执行步骤102判断通过图像采集模块采集到人脸图像，且所述人脸图像的眼睛的视线目标为屏幕的显示区域时，则表明此时用户可能需要使用手机，比如查看手机时间等，则此时手机可以点亮手机屏幕，以便用户查看时间，或者进行其他操作。When it is judged by executing step 102 that the face image is collected by the image acquisition module, and the sight target of the eyes of the face image is the display area of the screen, it indicates that the user may need to use the mobile phone at this time, such as checking the time of the mobile phone, etc. At this time, the mobile phone can light up the screen of the mobile phone so that the user can check the time or perform other operations.
步骤104：判断用户是否按压指定物理按键，若判断结果为是，则执行步骤106；若判断结果为否，则执行步骤105；Step 104: Judging whether the user presses the specified physical button, if the judgment result is yes, then execute step 106; if the judgment result is no, then execute step 105;
其中，所述物理按键比如可以是指手机上的“home键”、电源键以及音量键等。Wherein, the physical keys may refer to, for example, a "home key", a power key, and a volume key on a mobile phone.
步骤105：利用图像采集模块继续进行图像采集，并对采集到的图像进行人脸检测，若在所述图像采集模块采集到的图像上未检测到人脸图像，熄灭所述屏幕。Step 105: Use the image acquisition module to continue image acquisition, and perform face detection on the acquired image, if no face image is detected on the image acquired by the image acquisition module, turn off the screen.
采用上述方法，当用户不使用手机后，手机会自动熄灭屏幕，而不需要用户进行相关的操作，同时还可以避免由于手机屏幕常亮而导致的误操作以及电量消耗的问题。With the above method, when the user does not use the mobile phone, the mobile phone will automatically turn off the screen without requiring the user to perform relevant operations, and at the same time, it can also avoid misoperation and power consumption problems caused by the mobile phone screen being always on.
且在手机熄灭屏幕后，手机会进一步检测对屏幕的触摸操作是否结束，并在当监测到对所述屏幕的触摸操作结束时，关闭图像采集模块。And after the mobile phone turns off the screen, the mobile phone will further detect whether the touch operation to the screen ends, and when it is detected that the touch operation to the screen ends, the image acquisition module will be turned off.
步骤106：启动人脸识别功能，进行人脸识别解锁；Step 106: start the face recognition function, and perform face recognition unlocking;
需要说明的是，手机可以直接使用通过执行步骤101采集到的人脸图像进行人脸识别解锁；或者手机还可以通过图像采集模块重新采集一张人脸图像，并根据该张人脸图像进行人脸识别，进而在对该人脸图像的识别通过后，进行人脸识别解锁。It should be noted that the mobile phone can directly use the face image collected by executing step 101 to perform face recognition unlocking; Face recognition, and then after the recognition of the face image is passed, face recognition unlocking is performed.
则在实际使用中，用户具体使用操作流程图如图6所示，具体包括下述步骤：In actual use, the specific operation flow chart of the user is shown in Figure 6, which specifically includes the following steps:
步骤601：用户长按屏幕；Step 601: The user presses and holds the screen;
步骤602：手机判断用户长按操作是否超过2s，若判断结果为是，则执行步骤603；若判断结果为否，执行步骤611；Step 602: The mobile phone judges whether the user's long press operation exceeds 2s, if the judgment result is yes, then execute step 603; if the judgment result is no, execute step 611;
步骤603：手机响应于通过长按操作触发的图像采集指令，启动前置摄像头，进行图像采集；Step 603: the mobile phone responds to the image acquisition instruction triggered by the long press operation, starts the front camera, and performs image acquisition;
步骤604：判断采集到的图像上是否采集到人脸图像，若判断结果为是，则执行步骤605；若判断结果为否，则执行步骤603；Step 604: Judging whether a human face image is collected on the collected image, if the judgment result is yes, then execute step 605; if the judgment result is no, then execute step 603;
步骤605：判断人脸图像上的人眼是否注视着屏幕；若判断结果为否，则执行步骤606；若判断结果为是，则执行步骤612；Step 605: Judging whether the human eyes on the face image are watching the screen; if the judgment result is no, then execute step 606; if the judgment result is yes, then execute step 612;
步骤606：手机亮屏；Step 606: turn on the screen of the mobile phone;
步骤607：判断用户是否点击电源键，若判断结果为否，则执行步骤608；若判断结果为是，则执行步骤612；Step 607: Judging whether the user clicks the power button, if the judgment result is no, then execute step 608; if the judgment result is yes, then execute step 612;
步骤608：手机在亮屏状态下持续使用前置摄像头进行人脸检测，若未检测到人脸，则执行步骤609；若监测到人脸，则继续亮屏；Step 608: The mobile phone continues to use the front camera for face detection when the screen is on. If no face is detected, perform step 609; if a face is detected, continue to turn on the screen;
步骤609：手机熄灭屏幕；Step 609: turn off the screen of the mobile phone;
步骤610：手机检测用户手指是否结束按压屏幕，若用户手指不在按压屏幕，则执行步骤611；若用户手机继续按压屏幕，则执行步骤602；Step 610: The mobile phone detects whether the user's finger has finished pressing the screen, if the user's finger is not pressing the screen, then perform step 611; if the user's mobile phone continues to press the screen, then perform step 602;
步骤611：手机关闭摄像头，并结束操作；Step 611: the mobile phone turns off the camera, and ends the operation;
步骤612：手机进行人脸识别解锁操作。Step 612: The mobile phone is unlocked by face recognition.
在本发明实施例中，用户在使用终端设备时，用户通过触摸终端屏幕，可以触发终端启动前置摄像头进行图像采集，进而终端设备可以根据摄像头所采集到的图像，来判断采集到的图像是否为人脸图像，且该人脸图像的眼睛的实现目标是否为终端屏幕的显示区域，当图像采集模块采集到人脸图像，且所述人脸图像的眼睛的视线目标为屏幕的显示区域时，则终端可以点亮所述屏幕，在这种情况下，由于终端仅仅是点亮屏幕，而不会触发人脸识别解锁操作，从而避免了当用户仅仅想查看时间时的误解锁。而当用户需要进行人脸识别解锁时，用户通过进一步按压终端的特定物理按键，即可触发终端进行人脸识别解锁。由于采用本申请实施例所提供的基于人脸识别的解锁方法，在用户触发图像采集请求后，终端设备不会马上进行人脸识别，而会根据采集到的图像以及用户对终端设备上指定物理按键的按压情况，来确定当前是否需要进行人脸识别解锁，从而避免了在用户不想解锁终端设备时，终端设备误解锁的问题。In the embodiment of the present invention, when the user is using the terminal device, the user can trigger the terminal to start the front camera for image collection by touching the terminal screen, and then the terminal device can judge whether the collected image is based on the image collected by the camera. is a face image, and whether the target of the eyes of the face image is the display area of the terminal screen, when the image acquisition module captures the face image, and the sight target of the eyes of the face image is the display area of the screen, Then the terminal can light up the screen. In this case, since the terminal only lights up the screen, the face recognition unlocking operation is not triggered, thereby avoiding an accidental unlocking when the user only wants to check the time. When the user needs to unlock with face recognition, the user can trigger the terminal to unlock with face recognition by further pressing a specific physical button on the terminal. Due to the use of the face recognition-based unlocking method provided by the embodiment of the present application, after the user triggers an image collection request, the terminal device will not immediately perform face recognition, but will use the collected image and the user's specified physical location on the terminal device. Press the button to determine whether face recognition unlocking is currently required, thereby avoiding the problem of accidentally unlocking the terminal device when the user does not want to unlock the terminal device.
本申请实施例还提供了一种基于人脸识别的解锁装置，用以解决采用现有的人脸识别解锁方法可能导致误解锁，而影响用户正常使用体验的问题。该装置的具体结构示意图如图7所示，主要包括：采集模块控制单元71、显示单元72、解锁单元73。The embodiment of the present application also provides an unlocking device based on face recognition, which is used to solve the problem that using the existing face recognition unlocking method may lead to false unlocking and affect the user's normal use experience. The specific structural diagram of the device is shown in FIG. 7 , which mainly includes: an acquisition module control unit 71 , a display unit 72 , and an unlocking unit 73 .
其中，采集模块控制单元71，用于响应于针对屏幕的触摸操作时，启动图像采集模块；Wherein, the acquisition module control unit 71 is configured to start the image acquisition module in response to a touch operation on the screen;
显示单元72，用于若图像采集模块采集到人脸图像，且所述人脸图像的眼睛的视线目标为屏幕的显示区域，点亮所述屏幕；The display unit 72 is configured to light up the screen if the face image is collected by the image acquisition module, and the sight target of the eyes of the face image is the display area of the screen;
解锁单元73，用于根据指定物理按键当前的按压情况，确定是否执行人脸识别解锁指令。The unlocking unit 73 is configured to determine whether to execute the face recognition unlocking instruction according to the current pressing situation of the specified physical key.
在一种实施方式中，所述采集模块控制单元，还用于：判断所述针对屏幕的触摸操作是否超过预设时长；若判断结果为是，启动所述图像采集模块。In one embodiment, the acquisition module control unit is further configured to: judge whether the touch operation on the screen exceeds a preset duration; if the judgment result is yes, start the image acquisition module.
在一种实施方式中，所述装置还包括压检测单元，用于：检测针对所述指定物理按键的按压情况；若所述按压检测单元检测到针对指定物理按键的按压操作，所述解锁单元，用于执行人脸识别解锁指令；若所述按压检测单元未检测到针对指定物理按键的按压操作，所述显示单元，用于保持屏幕点亮状态。In one embodiment, the device further includes a pressure detection unit, configured to: detect the pressing of the designated physical key; if the pressing detection unit detects the pressing operation of the designated physical key, the unlocking unit , for executing a face recognition unlocking instruction; if the press detection unit does not detect a press operation on a designated physical key, the display unit is used to keep the screen on.
在一种实施方式中，当按压检测单元未检测到针对指定物理按键的按压操作，显示单元保持屏幕点亮状态后，所述显示单元72还用于：若所述图像采集模块未采集到人脸图像，熄灭所述屏幕。In one embodiment, when the press detection unit does not detect the press operation for the specified physical button, and the display unit keeps the screen on, the display unit 72 is also used to: if the image acquisition module does not capture a person face image, turn off the screen.
在一种实施方式中，采集模块控制单元71，还用于：若检测到对所述屏幕的触摸操作结束，关闭所述图像采集模块。In one embodiment, the acquisition module control unit 71 is further configured to: if it is detected that the touch operation on the screen ends, turn off the image acquisition module.
在本发明实施例中，用户在使用终端设备时，用户通过触摸终端屏幕，可以触发终端启动前置摄像头进行图像采集，进而终端设备可以根据摄像头所采集到的图像，来判断采集到的图像是否为人脸图像，且该人脸图像的眼睛的实现目标是否为终端屏幕的显示区域，当图像采集模块采集到人脸图像，且所述人脸图像的眼睛的视线目标为屏幕的显示区域时，则终端可以点亮所述屏幕，在这种情况下，由于终端仅仅是点亮屏幕，而不会触发人脸识别解锁操作，从而避免了当用户仅仅想查看时间时的误解锁。而当用户需要进行人脸识别解锁时，用户通过进一步按压终端的特定物理按键，即可触发终端进行人脸识别解锁。由于采用本申请实施例所提供的基于人脸识别的解锁方法，在用户触发图像采集请求后，终端设备不会马上进行人脸识别，而会根据采集到的图像以及用户对终端设备上指定物理按键的按压情况，来确定当前是否需要进行人脸识别解锁，从而避免了在用户不想解锁终端设备时，终端设备误解锁的问题。In the embodiment of the present invention, when the user is using the terminal device, the user can trigger the terminal to start the front camera for image collection by touching the terminal screen, and then the terminal device can judge whether the collected image is based on the image collected by the camera. is a face image, and whether the target of the eyes of the face image is the display area of the terminal screen, when the image acquisition module captures the face image, and the sight target of the eyes of the face image is the display area of the screen, Then the terminal can light up the screen. In this case, since the terminal only lights up the screen, the face recognition unlocking operation is not triggered, thereby avoiding an accidental unlocking when the user only wants to check the time. When the user needs to unlock with face recognition, the user can trigger the terminal to unlock with face recognition by further pressing a specific physical button on the terminal. Due to the use of the face recognition-based unlocking method provided by the embodiment of the present application, after the user triggers an image collection request, the terminal device will not immediately perform face recognition, but will use the collected image and the user's specified physical location on the terminal device. Press the button to determine whether face recognition unlocking is currently required, thereby avoiding the problem of accidentally unlocking the terminal device when the user does not want to unlock the terminal device.
图8为实现本发明各个实施例的一种移动终端的硬件结构示意图。FIG. 8 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention.
在图8中，该终端设备800包括但不限于：射频单元801、网络模块802、音频输出单元803、输入单元804、传感器805、显示单元806、用户输入单元807、接口单元808、存储器809、处理器810、以及电源811等部件。本领域技术人员可以理解，图8中示出的终端设备结构并不构成对终端设备的限定，终端设备可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。在本发明实施例中，终端设备包括但不限于手机、平板电脑、笔记本电脑、掌上电脑、车载终端、可穿戴设备、以及计步器等。In FIG. 8, the terminal device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, A processor 810, a power supply 811 and other components. Those skilled in the art can understand that the terminal device structure shown in FIG. 8 does not constitute a limitation on the terminal device, and the terminal device may include more or less components than shown in the figure, or combine some components, or different components layout. In the embodiment of the present invention, the terminal devices include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, vehicle-mounted terminals, wearable devices, and pedometers.
处理器810，当检测到对屏幕的触摸操作时，启动图像采集模块；当图像采集模块采集到人脸图像，且所述人脸图像的眼睛的视线目标为屏幕的显示区域时，点亮所述屏幕；根据指定物理按键当前的按压情况，确定是否解除人脸识别锁定。The processor 810, when detecting a touch operation on the screen, starts the image acquisition module; when the image acquisition module acquires a face image, and the sight target of the eyes of the face image is the display area of the screen, lights up the The above screen; according to the current pressing situation of the specified physical button, determine whether to release the face recognition lock.
在本发明实施例中，用户在使用终端设备时，用户通过指定操作可以触发图像采集请求，进而终端设备可以启动前置摄像头进行图像采集，进而终端设备可以根据摄像头所采集到的第一图像，来判断用户当前是否满足人脸识别解锁条件，当终端设备在采集到的第一图像上识别出人脸图像，且识别出该人脸图像的视线注视在终端设备的屏幕上时，在这种情况下一般可以确定用户此时期望解锁并使用终端设备，则可以据此设置人脸识别解锁条件，并在条件满足时，进一步地采集第二图像，并通过对该第二图像进行人脸识别，以实现解锁操作；而当采集到的第一图像上未识别出人脸图像，或者识别出的人脸图像的人眼视线并未注视终端设备的屏幕时，则可以确定在当前情况下用户可能不需要解锁使用终端设备，而该图像采集请求可能是由用户误操作而触发的，因而在这种情况下，当终端设备判断当前不满足人脸识别解锁条件时，终端设备可以点亮屏幕，以便用户可以查看时间、天气等信息。由于采用本申请实施例所提供的基于人脸识别的解锁方法，在用户触发图像采集请求后，终端设备不会马上进行人脸识别，而会根据采集到的图像判断当前是否满足人脸识别解锁条件，从而避免了在用户不想解锁终端设备时，由于用户的误操作而导致终端设备误解锁的问题。In the embodiment of the present invention, when the user is using the terminal device, the user can trigger an image collection request through a specified operation, and then the terminal device can start the front camera for image collection, and then the terminal device can, according to the first image collected by the camera, To determine whether the user currently meets the face recognition unlocking condition, when the terminal device recognizes the face image on the first image collected, and the line of sight that recognizes the face image is fixed on the screen of the terminal device, in this In general, it can be determined that the user wants to unlock and use the terminal device at this time, and then the face recognition unlocking condition can be set accordingly, and when the condition is met, a second image is further collected, and face recognition is performed on the second image , to realize the unlocking operation; and when no face image is recognized on the collected first image, or the human eye line of the recognized face image does not look at the screen of the terminal device, it can be determined that the user in the current situation It may not be necessary to unlock and use the terminal device, and the image collection request may be triggered by a user misoperation, so in this case, when the terminal device judges that the face recognition unlocking condition is not met, the terminal device can light up the screen , so that the user can view information such as time, weather, etc. Due to the face recognition-based unlocking method provided by the embodiment of the present application, after the user triggers the image collection request, the terminal device will not immediately perform face recognition, but will judge whether the current face recognition unlocking is satisfied according to the collected image. Conditions, thereby avoiding the problem that the terminal device is unlocked by mistake due to the user's misoperation when the user does not want to unlock the terminal device.
应理解的是，本发明实施例中，射频单元801可用于收发信息或通话过程中，信号的接收和发送，具体的，将来自基站的下行数据接收后，给处理器810处理；另外，将上行的数据发送给基站。通常，射频单元801包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外，射频单元801还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in the embodiment of the present invention, the radio frequency unit 801 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, after receiving the downlink data from the base station, the processor 810 processes it; Uplink data is sent to the base station. Generally, the radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 801 can also communicate with the network and other devices through a wireless communication system.
终端设备通过网络模块802为用户提供了无线的宽带互联网访问，如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The terminal device provides users with wireless broadband Internet access through the network module 802, such as helping users send and receive emails, browse web pages, and access streaming media.
音频输出单元803可以将射频单元801或网络模块802接收的或者在存储器809中存储的音频数据转换成音频信号并且输出为声音。而且，音频输出单元803还可以提供与终端设备800执行的特定功能相关的音频输出(例如，呼叫信号接收声音、消息接收声音等等)。音频输出单元803包括扬声器、蜂鸣器以及受话器等。The audio output unit 803 may convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output as sound. Also, the audio output unit 803 may also provide audio output related to a specific function performed by the terminal device 800 (for example, call signal reception sound, message reception sound, etc.). The audio output unit 803 includes a speaker, a buzzer, a receiver, and the like.
输入单元804用于接收音频或视频信号。输入单元804可以包括图形处理器(Graphics Processing Unit，GPU)8041和麦克风8042，图形处理器8041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元806上。经图形处理器8041处理后的图像帧可以存储在存储器809(或其它存储介质)中或者经由射频单元801或网络模块802进行发送。麦克风8042可以接收声音，并且能够将这样的声音处理为音频数据。处理后的音频数据可以在电话通话模式的情况下转换为可经由射频单元801发送到移动通信基站的格式输出。The input unit 804 is used for receiving audio or video signals. The input unit 804 may include a graphics processing unit (Graphics Processing Unit, GPU) 8041 and a microphone 8042, and the graphics processing unit 8041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The data is processed. The processed image frames may be displayed on the display unit 806 . The image frames processed by the graphics processor 8041 may be stored in the memory 809 (or other storage media) or sent via the radio frequency unit 801 or the network module 802 . The microphone 8042 can receive sound, and can process such sound into audio data. The processed audio data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 801 for output in the case of a phone call mode.
终端设备800还包括至少一种传感器805，比如光传感器、运动传感器以及其他传感器。具体地，光传感器包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板8061的亮度，接近传感器可在终端设备800移动到耳边时，关闭显示面板8061和/或背光。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别终端设备姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；传感器805还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等，在此不再赘述。The terminal device 800 also includes at least one sensor 805, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 8061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 8061 and the / or backlighting. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the posture of terminal equipment (such as horizontal and vertical screen switching, related games) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 805 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.
显示单元806用于显示由用户输入的信息或提供给用户的信息。显示单元806可包括显示面板8061，可以采用液晶显示器(Liquid Crystal Display，LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板8061。The display unit 806 is used to display information input by the user or information provided to the user. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
用户输入单元807可用于接收输入的数字或字符信息，以及产生与终端设备的用户设置以及功能控制有关的键信号输入。具体地，用户输入单元807包括触控面板8071以及其他输入设备8072。触控面板8071，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板8071上或在触控面板8071附近的操作)。触控面板8071可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器810，接收处理器810发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板8071。除了触控面板8071，用户输入单元807还可以包括其他输入设备8072。具体地，其他输入设备8072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。The user input unit 807 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the terminal device. Specifically, the user input unit 807 includes a touch panel 8071 and other input devices 8072 . The touch panel 8071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 8071 or near the touch panel 8071). operate). The touch panel 8071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 810, receive the command sent by the processor 810 and execute it. In addition, the touch panel 8071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 8071 , the user input unit 807 may also include other input devices 8072 . Specifically, other input devices 8072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.
进一步的，触控面板8071可覆盖在显示面板8061上，当触控面板8071检测到在其上或附近的触摸操作后，传送给处理器810以确定触摸事件的类型，随后处理器810根据触摸事件的类型在显示面板8061上提供相应的视觉输出。虽然在图8中，触控面板8071与显示面板8061是作为两个独立的部件来实现终端设备的输入和输出功能，但是在某些实施例中，可以将触控面板8071与显示面板8061集成而实现终端设备的输入和输出功能，具体此处不做限定。Furthermore, the touch panel 8071 can be covered on the display panel 8061, and when the touch panel 8071 detects a touch operation on or near it, it will be sent to the processor 810 to determine the type of the touch event, and then the processor 810 will The type of event provides a corresponding visual output on the display panel 8061. Although in FIG. 8, the touch panel 8071 and the display panel 8061 are used as two independent components to realize the input and output functions of the terminal device, in some embodiments, the touch panel 8071 and the display panel 8061 can be integrated. The implementation of the input and output functions of the terminal device is not specifically limited here.
接口单元808为外部装置与终端设备800连接的接口。例如，外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元808可以用于接收来自外部装置的输入(例如，数据信息、电力等等)并且将接收到的输入传输到终端设备800内的一个或多个元件或者可以用于在终端设备800和外部装置之间传输数据。The interface unit 808 is an interface for connecting an external device to the terminal device 800 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 808 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.
存储器809可用于存储软件程序以及各种数据。存储器809可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器809可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 809 can be used to store software programs as well as various data. The memory 809 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 809 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
处理器810是终端设备的控制中心，利用各种接口和线路连接整个终端设备的各个部分，通过运行或执行存储在存储器809内的软件程序和/或模块，以及调用存储在存储器809内的数据，执行终端设备的各种功能和处理数据，从而对终端设备进行整体监控。处理器810可包括一个或多个处理单元；优选的，处理器810可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器810中。The processor 810 is the control center of the terminal equipment, and uses various interfaces and lines to connect various parts of the entire terminal equipment, by running or executing software programs and/or modules stored in the memory 809, and calling data stored in the memory 809 , execute various functions of the terminal equipment and process data, so as to monitor the terminal equipment as a whole. The processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 810 .
终端设备800还可以包括给各个部件供电的电源811(比如电池)，优选的，电源811可以通过电源管理系统与处理器810逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The terminal device 800 can also include a power supply 811 (such as a battery) for supplying power to various components. Preferably, the power supply 811 can be logically connected to the processor 810 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.
另外，终端设备800包括一些未示出的功能模块，在此不再赘述。In addition, the terminal device 800 includes some functional modules not shown, which will not be repeated here.
优选的，本发明实施例还提供一种终端设备，包括处理器810，存储器809，存储在存储器809上并可在所述处理器810上运行的计算机程序，该计算机程序被处理器810执行时实现上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。Preferably, the embodiment of the present invention also provides a terminal device, including a processor 810, a memory 809, and a computer program stored in the memory 809 and operable on the processor 810. When the computer program is executed by the processor 810 Each process of the above embodiment of the image processing method can achieve the same technical effect, so in order to avoid repetition, details are not repeated here.
本发明实施例还提供一种计算机可读存储介质，计算机可读存储介质上存储有计算机程序，该计算机程序被处理器执行时实现上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。其中，所述的计算机可读存储介质，如只读存储器(Read-Only Memory，简称ROM)、随机存取存储器(Random Access Memory，简称RAM)、磁碟或者光盘等。The embodiment of the present invention also provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above-mentioned image processing method embodiment is realized, and the same technology can be achieved. Effect, in order to avoid repetition, will not repeat them here. Wherein, the computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk or an optical disk, and the like.
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in various embodiments of the present invention.
上面结合附图对本发明的实施例进行了描述，但是本发明并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本发明的启示下，在不脱离本发明宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本发明的保护之内。Embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementations, and the above-mentioned specific implementations are only illustrative, rather than restrictive. Those of ordinary skill in the art will Under the enlightenment of the present invention, many forms can also be made without departing from the gist of the present invention and the protection scope of the claims, all of which belong to the protection of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810205827.4ACN108549802A (en) | 2018-03-13 | 2018-03-13 | An unlocking method, device and mobile terminal based on face recognition |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810205827.4ACN108549802A (en) | 2018-03-13 | 2018-03-13 | An unlocking method, device and mobile terminal based on face recognition |
| Publication Number | Publication Date |
|---|---|
| CN108549802Atrue CN108549802A (en) | 2018-09-18 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810205827.4APendingCN108549802A (en) | 2018-03-13 | 2018-03-13 | An unlocking method, device and mobile terminal based on face recognition |
| Country | Link |
|---|---|
| CN (1) | CN108549802A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109194834A (en)* | 2018-09-27 | 2019-01-11 | 上海与德科技有限公司 | mobile phone power-saving method, device, equipment and storage medium |
| CN109325336A (en)* | 2018-10-19 | 2019-02-12 | 北京小米移动软件有限公司 | Unlocking method, device and computer-readable storage medium |
| CN110045834A (en)* | 2019-05-21 | 2019-07-23 | 广东工业大学 | Detection method, device, system, equipment and storage medium for sight locking |
| CN111327952A (en)* | 2018-12-14 | 2020-06-23 | 中国移动通信集团山东有限公司 | Video switching processing method and device |
| WO2020181523A1 (en)* | 2019-03-13 | 2020-09-17 | 华为技术有限公司 | Method and apparatus for waking up screen |
| CN112631432A (en)* | 2021-01-05 | 2021-04-09 | Oppo广东移动通信有限公司 | Screen control method, wearable device and storage medium |
| CN113360222A (en)* | 2020-03-06 | 2021-09-07 | 华为技术有限公司 | Application information display method and related equipment |
| CN113687899A (en)* | 2021-08-25 | 2021-11-23 | 读书郎教育科技有限公司 | A method and device for solving the conflict between viewing notifications and face unlocking |
| WO2023065849A1 (en)* | 2021-10-19 | 2023-04-27 | Oppo广东移动通信有限公司 | Screen brightness adjustment method and apparatus for electronic device, and electronic device |
| CN116222136A (en)* | 2022-12-20 | 2023-06-06 | 珠海格力电器股份有限公司 | Control method, module, electronic device and readable medium of display screen of refrigerator |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102981726A (en)* | 2012-11-29 | 2013-03-20 | 广东欧珀移动通信有限公司 | Method and system for preventing accidental unlocking of mobile terminal |
| CN106371515A (en)* | 2016-09-05 | 2017-02-01 | 乐视控股（北京）有限公司 | Method and device for controlling screen states |
| CN106708271A (en)* | 2016-12-30 | 2017-05-24 | 珠海市魅族科技有限公司 | Terminal screen control method and device |
| CN107563168A (en)* | 2017-09-05 | 2018-01-09 | 广东欧珀移动通信有限公司 | Unlocking method and device for mobile terminal and mobile terminal |
| CN107590375A (en)* | 2017-09-12 | 2018-01-16 | 广东欧珀移动通信有限公司 | Unlocking method and related product |
| CN107835286A (en)* | 2017-10-27 | 2018-03-23 | 维沃移动通信有限公司 | It is a kind of to prevent from misreading the method locked and mobile terminal |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102981726A (en)* | 2012-11-29 | 2013-03-20 | 广东欧珀移动通信有限公司 | Method and system for preventing accidental unlocking of mobile terminal |
| CN106371515A (en)* | 2016-09-05 | 2017-02-01 | 乐视控股（北京）有限公司 | Method and device for controlling screen states |
| CN106708271A (en)* | 2016-12-30 | 2017-05-24 | 珠海市魅族科技有限公司 | Terminal screen control method and device |
| CN107563168A (en)* | 2017-09-05 | 2018-01-09 | 广东欧珀移动通信有限公司 | Unlocking method and device for mobile terminal and mobile terminal |
| CN107590375A (en)* | 2017-09-12 | 2018-01-16 | 广东欧珀移动通信有限公司 | Unlocking method and related product |
| CN107835286A (en)* | 2017-10-27 | 2018-03-23 | 维沃移动通信有限公司 | It is a kind of to prevent from misreading the method locked and mobile terminal |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109194834A (en)* | 2018-09-27 | 2019-01-11 | 上海与德科技有限公司 | mobile phone power-saving method, device, equipment and storage medium |
| CN109325336A (en)* | 2018-10-19 | 2019-02-12 | 北京小米移动软件有限公司 | Unlocking method, device and computer-readable storage medium |
| CN109325336B (en)* | 2018-10-19 | 2024-04-19 | 北京小米移动软件有限公司 | Unlocking method, unlocking device and computer readable storage medium |
| US10735578B2 (en) | 2018-10-19 | 2020-08-04 | Beijing Xiaomi Mobile Software Co., Ltd. | Method for unlocking a mobile terminal, devices using the same, and computer-readable storage media encoding the same |
| CN111327952A (en)* | 2018-12-14 | 2020-06-23 | 中国移动通信集团山东有限公司 | Video switching processing method and device |
| CN111936990A (en)* | 2019-03-13 | 2020-11-13 | 华为技术有限公司 | Method and device for waking up the screen |
| WO2020181523A1 (en)* | 2019-03-13 | 2020-09-17 | 华为技术有限公司 | Method and apparatus for waking up screen |
| EP3910507B1 (en)* | 2019-03-13 | 2025-05-07 | Huawei Technologies Co., Ltd. | Method and apparatus for waking up screen |
| CN110045834A (en)* | 2019-05-21 | 2019-07-23 | 广东工业大学 | Detection method, device, system, equipment and storage medium for sight locking |
| CN113360222A (en)* | 2020-03-06 | 2021-09-07 | 华为技术有限公司 | Application information display method and related equipment |
| CN112631432A (en)* | 2021-01-05 | 2021-04-09 | Oppo广东移动通信有限公司 | Screen control method, wearable device and storage medium |
| CN113687899A (en)* | 2021-08-25 | 2021-11-23 | 读书郎教育科技有限公司 | A method and device for solving the conflict between viewing notifications and face unlocking |
| WO2023065849A1 (en)* | 2021-10-19 | 2023-04-27 | Oppo广东移动通信有限公司 | Screen brightness adjustment method and apparatus for electronic device, and electronic device |
| CN116222136A (en)* | 2022-12-20 | 2023-06-06 | 珠海格力电器股份有限公司 | Control method, module, electronic device and readable medium of display screen of refrigerator |
| CN116222136B (en)* | 2022-12-20 | 2025-05-09 | 珠海格力电器股份有限公司 | Control method, module, electronic device and readable medium for refrigerator display screen |
| Publication | Publication Date | Title |
|---|---|---|
| CN108549802A (en) | An unlocking method, device and mobile terminal based on face recognition | |
| CN107742072B (en) | Face recognition method and mobile terminal | |
| CN108229420B (en) | Face recognition method and mobile terminal | |
| CN108038360B (en) | A kind of operation mode switching method and mobile terminal | |
| CN109190356B (en) | Screen unlocking method and terminal | |
| CN107870674B (en) | A program starting method and mobile terminal | |
| CN108206892B (en) | Method and device for protecting privacy of contact person, mobile terminal and storage medium | |
| CN107835286B (en) | Method and mobile terminal for preventing false unlocking | |
| CN108650408B (en) | Screen unlocking method and mobile terminal | |
| CN107862194A (en) | A kind of method, device and mobile terminal of safety verification | |
| CN107545166A (en) | Biometric discrimination method and Related product | |
| CN107609363B (en) | An unlocking method and mobile terminal | |
| CN108010170A (en) | A control method and device for facial recognition unlocking function | |
| CN108416203A (en) | A kind of unlocking screen method and mobile terminal | |
| CN108174012A (en) | A permission control method and mobile terminal | |
| CN108898000A (en) | A kind of method and terminal solving lock screen | |
| CN108446665A (en) | A kind of face identification method and mobile terminal | |
| CN108769410B (en) | Information sending method and mobile terminal | |
| CN107809515B (en) | A display control method and mobile terminal | |
| CN107895108B (en) | An operation management method and mobile terminal | |
| CN108345780A (en) | A kind of solution lock control method and mobile terminal | |
| CN108363914A (en) | Fingerprint unlocking control method and device | |
| CN107944242B (en) | Biometric function disabling method and mobile terminal | |
| CN111078002A (en) | Suspended gesture recognition method and terminal equipment | |
| CN110472520B (en) | A kind of identification method and mobile terminal |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20180918 | |
| RJ01 | Rejection of invention patent application after publication |