技术领域technical field
本发明涉及移动终端技术领域，具体涉及人脸活体检测方法及相关产品。The invention relates to the technical field of mobile terminals, in particular to a human face living body detection method and related products.
背景技术Background technique
随着社会的进步和科学的发展，信息交互越来越频繁，为保证信息的安全，需对用户身份进行验证，因此，常常会用到生物识别，例如：指纹识别、人脸识别、虹膜识别、静脉识别、掌纹识别等生物识别技术。With the progress of society and the development of science, information interaction is becoming more and more frequent. In order to ensure the security of information, user identity needs to be verified. Therefore, biometrics are often used, such as: fingerprint recognition, face recognition, iris recognition , vein recognition, palmprint recognition and other biometric technologies.
目前，人脸识别技术应用广泛并且将会继续被推广使用，越来越多的移动终端配备有人脸识别装置，如可通过前置摄像头拍摄人脸图像，人脸识别技术具有准确率高、方便快捷等特点，At present, face recognition technology is widely used and will continue to be popularized and used. More and more mobile terminals are equipped with face recognition devices. For example, face images can be taken through front cameras. Face recognition technology has high accuracy and convenience quick features,
发明内容Contents of the invention
本发明实施例提供了人脸活体检测方法及相关产品，可以提高移动终端生物识别的安全性、可靠性和准确性。。Embodiments of the present invention provide a face detection method and related products, which can improve the security, reliability and accuracy of mobile terminal biometric identification. .
第一方面，本发明实施例提供一种移动终端，包括生物信息采集装置、处理器，上述生物信息采集装置连接上述处理器，其中，In the first aspect, an embodiment of the present invention provides a mobile terminal, including a biological information collection device and a processor, and the biological information collection device is connected to the processor, wherein,
上述处理器，用于在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，通过上述生物信息采集装置连续采集当前拍摄范围内的多帧的参考图像；The above-mentioned processor is configured to continuously collect multiple frames of reference images within the current shooting range through the above-mentioned biological information collection device when it is detected that the current shooting range contains a preset image whose integrity is greater than a preset threshold;
上述处理器，还用于预处理上述多帧的参考图像；The above-mentioned processor is also used for preprocessing the reference images of the above-mentioned multi-frames;
上述处理器，还用于获取上述预处理后的每帧参考图像的特征点集合；The above-mentioned processor is also used to obtain the set of feature points of each frame of the reference image after the above-mentioned preprocessing;
上述处理器，还用于根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。The above-mentioned processor is further configured to determine whether the user within the above-mentioned shooting range is a real user according to the above-mentioned acquired feature point set.
第二方面，本发明实施例提供一种人脸活体检测方法，包括：In a second aspect, an embodiment of the present invention provides a face detection method, including:
在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像；When it is detected that the current shooting range contains a preset image whose integrity is greater than the preset threshold, continuously collect multiple frames of reference images in the current shooting range;
预处理上述多帧的参考图像；Preprocessing the reference images of the above multiple frames;
获取上述预处理后的每帧参考图像的特征点集合；Obtain the set of feature points of each frame of the reference image after the above preprocessing;
根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。It is determined whether the user within the shooting range is a real user according to the acquired feature point set.
第三方面，本发明实施例提供一种移动终端，包括处理单元和采集单元，In a third aspect, an embodiment of the present invention provides a mobile terminal, including a processing unit and a collection unit,
上述处理单元，用于在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，通过上述采集单元连续采集当前拍摄范围内的多帧的参考图像；The above-mentioned processing unit is configured to continuously collect multiple frames of reference images within the current shooting range through the above-mentioned acquisition unit when it is detected that the current shooting range contains a preset image whose integrity is greater than a preset threshold;
上述处理单元，还用于预处理上述多帧的参考图像；The above-mentioned processing unit is also used for pre-processing the reference images of the above-mentioned multiple frames;
上述处理单元，还用于获取上述预处理后的每帧参考图像的特征点集合；The above-mentioned processing unit is also used to obtain the set of feature points of each frame of the reference image after the above-mentioned preprocessing;
上述处理单元，还用于根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。The processing unit is further configured to determine whether the user within the shooting range is a real user according to the acquired feature point set.
第四方面，本发明实施例提供一种移动终端，包括处理器、存储器、通信接口以及一个或多个程序，其中，上述一个或多个程序被存储在上述存储器中，并且被配置由上述处理器执行，上述程序包括用于执行本发明实施例第一方面任一方法中的步骤的指令。In a fourth aspect, an embodiment of the present invention provides a mobile terminal, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and are configured to be processed by the above The above program includes instructions for executing the steps in any method of the first aspect of the embodiments of the present invention.
第五方面，本发明实施例提供了一种计算机可读存储介质，其中，上述计算机可读存储介质存储用于电子数据交换的计算机程序，其中，上述计算机程序使得计算机执行如本发明实施例第一方面任一方法中所描述的部分或全部步骤，上述计算机包括移动终端。In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the above-mentioned computer-readable storage medium stores a computer program for electronic data exchange, wherein the above-mentioned computer program enables the computer to execute the computer program as described in the first embodiment of the present invention. In one aspect, for some or all of the steps described in any method, the above-mentioned computer includes a mobile terminal.
第六方面，本发明实施例提供了一种计算机程序产品，其中，上述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质，上述计算机程序可操作来使计算机执行如本发明实施例第一方面任一方法中所描述的部分或全部步骤。该计算机程序产品可以为一个软件安装包，上述计算机包括移动终端。In a sixth aspect, an embodiment of the present invention provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable the computer to execute the computer program as implemented in the present invention. For example, some or all of the steps described in any method of the first aspect. The computer program product may be a software installation package, and the above-mentioned computer includes a mobile terminal.
可以看出，本发明实施例中，移动终端首先在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像，其次，预处理上述多帧的参考图像，然后，获取上述预处理后的每帧参考图像的特征点集合，最后，根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。可见，移动终端在进行生物识别之前，先根据用户的脸部表情变化，识别当前人脸是否为人脸活体，有效地避免了假照片等情况，有利于提高生物识别的安全性、可靠性和准确性。It can be seen that in the embodiment of the present invention, when the mobile terminal first detects that the current shooting range contains a preset image whose integrity is greater than the preset threshold, it continuously collects multiple frames of reference images in the current shooting range, and secondly, pre-processes For the above multiple frames of reference images, then obtain the feature point set of each frame of the preprocessed reference image, and finally, determine whether the user within the shooting range is a real user according to the above acquired feature point set. It can be seen that before performing biometric identification, the mobile terminal first identifies whether the current face is a live human face according to the change of the user's facial expression, effectively avoiding false photos and other situations, and is conducive to improving the security, reliability and accuracy of biometric identification. sex.
附图说明Description of drawings
下面将对本发明实施例所涉及到的附图作简单地介绍。The accompanying drawings involved in the embodiments of the present invention will be briefly introduced below.
图1是本发明实施例提供的一种移动终端的结构示意图；FIG. 1 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention;
图2A是本发明实施例提供的一种人脸活体检测方法的流程示意图；FIG. 2A is a schematic flow diagram of a face detection method provided by an embodiment of the present invention;
图2B是本发明实施例提供的一种参考图像的示例图；FIG. 2B is an example diagram of a reference image provided by an embodiment of the present invention;
图2C是本发明实施例提供的一种参考图像的示例图；FIG. 2C is an example diagram of a reference image provided by an embodiment of the present invention;
图3发明实施例公开的一种移动终端的结构示意图；Fig. 3 is a schematic structural diagram of a mobile terminal disclosed by an embodiment of the invention;
图4是本发明实施例公开的一种移动终端的功能单元组成框图。Fig. 4 is a block diagram of functional units of a mobile terminal disclosed in an embodiment of the present invention.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本发明方案，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别不同对象，而不是用于描述特定顺序。此外，术语“包括”和“具有”以及它们任何变形，意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元，而是可选地还包括没有列出的步骤或单元，或可选地还包括对于这些过程、方法、产品或设备固有的其他步骤或单元。The terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally further includes For other steps or units inherent in these processes, methods, products or devices.
在本文中提及“实施例”意味着，结合实施例描述的特定特征、结构或特性可以包含在本发明的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例，也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是，本文所描述的实施例可以与其它实施例相结合。Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present invention. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.
本发明实施例所涉及到的移动终端可以包括各种具有无线通信功能的手持设备、车载设备、可穿戴设备、计算设备或连接到无线调制解调器的其他处理设备，以及各种形式的用户设备(User Equipment，UE)，移动台(Mobile Station，MS)，终端设备(terminaldevice)等等。为方便描述，上面提到的设备统称为移动终端。The mobile terminals involved in the embodiments of the present invention may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems, as well as various forms of user equipment (User Equipment, UE), mobile station (Mobile Station, MS), terminal device (terminal device) and so on. For convenience of description, the devices mentioned above are collectively referred to as mobile terminals.
本发明实施例所描述的移动终端设置有生物信息采集装置，该生物信息采集装置具体包括指纹信息采集装置、虹膜信息采集装置和面部信息采集装置，其中，指纹信息采集装置可以是指纹传感器模组、虹膜信息采集装置可以包括红外光源和虹膜摄像头，面部信息采集装置可以是通用摄像头模组，如前置摄像头。下面结合附图对本发明实施例进行介绍。The mobile terminal described in the embodiment of the present invention is provided with a biological information collection device, and the biological information collection device specifically includes a fingerprint information collection device, an iris information collection device, and a facial information collection device, wherein the fingerprint information collection device may be a fingerprint sensor module 1. The iris information collection device may include an infrared light source and an iris camera, and the facial information collection device may be a general camera module, such as a front camera. Embodiments of the present invention will be described below in conjunction with the accompanying drawings.
请参阅图1，图1是本发明实施例提供了一种移动终端100的结构示意图，上述移动终端100包括：壳体、触控显示屏、主板、电池和副板，主板上设置有红外光源21、虹膜摄像头22、前置摄像头23、处理器110、存储器120和SIM卡槽等，副板上设置有振子、一体音腔、VOOC闪充接口和指纹模组24，上述红外光源21和虹膜摄像头22组成该移动终端100的虹膜信息采集装置，上述前置摄像头23组成该移动终端100的面部信息采集装置，上述指纹传感器模组24组成该移动终端100的指纹信息采集装置，上述虹膜信息采集装置、面部信息采集装置和指纹信息采集装置统称为该移动终端100的生物信息采集装置，其中，Please refer to FIG. 1. FIG. 1 is a schematic structural diagram of a mobile terminal 100 provided by an embodiment of the present invention. The above-mentioned mobile terminal 100 includes: a housing, a touch display screen, a main board, a battery and a sub-board, and an infrared light source is arranged on the main board. 21. Iris camera 22, front camera 23, processor 110, memory 120, SIM card slot, etc., the sub-board is provided with a vibrator, integrated sound cavity, VOOC flash charging interface and fingerprint module 24, the above-mentioned infrared light source 21 and iris The camera 22 forms the iris information collection device of the mobile terminal 100, the above-mentioned front camera 23 forms the facial information collection device of the mobile terminal 100, the fingerprint sensor module 24 forms the fingerprint information collection device of the mobile terminal 100, and the iris information collection device, facial information collection device and fingerprint information collection device are collectively referred to as the biological information collection device of the mobile terminal 100, wherein,
上述生物信息采集装置，用于在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像。The above biological information collection device is configured to continuously collect multiple frames of reference images within the current shooting range when it is detected that the current shooting range contains a preset image whose integrity is greater than a preset threshold.
其中，生物信息采集装置为虹膜信息采集装置时，红外光源21用于发射红外光线照射用户的虹膜形成反射光线，虹膜摄像头22用于采集反射光线形成虹膜图像，处理器110获取该虹膜图像后，针对该虹膜图像执行虹膜图像质量评估、虹膜区域定位(包含粗定位和精定位)、虹膜预处理、虹膜特征点提取、虹膜模板生成等处理过程，生成的虹膜模板即上述生物信息。Wherein, when the biological information collection device is an iris information collection device, the infrared light source 21 is used to emit infrared light to irradiate the user's iris to form reflected light, and the iris camera 22 is used to collect the reflected light to form an iris image, and after the processor 110 acquires the iris image, For the iris image, perform iris image quality assessment, iris area positioning (including rough positioning and fine positioning), iris preprocessing, iris feature point extraction, iris template generation and other processing processes, and the generated iris template is the above-mentioned biological information.
采集生物信息的具体实现方式可以是生物信息采集装置采集用户的生物图像。A specific implementation manner of collecting biological information may be that a biological information collection device collects a user's biological image.
上述处理器110，用于预处理上述多帧的参考图像。The processor 110 is configured to preprocess the reference images of the multiple frames.
上述处理器110，还用于获取上述预处理后的每帧参考图像的特征点集合。The above-mentioned processor 110 is further configured to obtain the set of feature points of each frame of the reference image after the above-mentioned preprocessing.
上述处理器110，还用于根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户The above-mentioned processor 110 is further configured to determine whether the user within the above-mentioned shooting range is a real user according to the above-mentioned acquired feature point set
可以看出，本发明实施例中，移动终端首先在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像，其次，预处理上述多帧的参考图像，然后，获取上述预处理后的每帧参考图像的特征点集合，最后，根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。可见，移动终端在进行生物识别之前，先根据用户的脸部表情变化，识别当前人脸是否为人脸活体，有效地避免了假照片等情况，有利于提高生物识别的安全性、可靠性和准确性。It can be seen that in the embodiment of the present invention, when the mobile terminal first detects that the current shooting range contains a preset image whose integrity is greater than the preset threshold, it continuously collects multiple frames of reference images in the current shooting range, and secondly, pre-processes For the above multiple frames of reference images, then obtain the feature point set of each frame of the preprocessed reference image, and finally, determine whether the user within the shooting range is a real user according to the above acquired feature point set. It can be seen that before performing biometric identification, the mobile terminal first identifies whether the current face is a live human face according to the change of the user's facial expression, effectively avoiding false photos and other situations, and is conducive to improving the security, reliability and accuracy of biometric identification. sex.
在一个可能的示例中，在上述预处理上述多帧的参考图像方面，上述处理器110具体用于：检测上述多帧的参考图像中每帧参考图像中的人脸面积大小是否等于预设面积大小；以及用于在检测到上述人脸面积大小不等于预设面积大小时，对上述参考图像进行缩放，使得上述每帧参考图像中的人脸面积大小等于预设面积大小。In a possible example, in terms of preprocessing the above-mentioned multi-frame reference images, the above-mentioned processor 110 is specifically configured to: detect whether the size of the face area in each frame of the above-mentioned multi-frame reference images is equal to a preset area size; and when it is detected that the size of the face area is not equal to the preset area size, the reference image is scaled so that the size of the face area in each frame of the reference image is equal to the preset area size.
在一个可能的示例中，在上述根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户方面，上述处理器110具体用于：获取上述特征点集合中的任意两个特征点；以及用于确定上述任意两个特征点之间的第一相对参考值；以及用于在上述第一相对参考值大于第一预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, in terms of determining whether the user within the shooting range is a real user based on the acquired feature point set, the processor 110 is specifically configured to: acquire any two feature points in the feature point set; and for determining a first relative reference value between any two feature points; and for determining that the user within the photographing range is a real user when the first relative reference value is greater than a first preset threshold.
在一个可能的示例中，在上述根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户方面，上述处理器110具体用于：获取上述多帧的参考图像中任意两帧参考图像的特征点集合；以及用于确定上述任意两帧参考图像的特征点集合中对应的特征点之间的第二相对参考值；以及用于在上述第二相对参考值大于第二预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, in terms of determining whether the user within the shooting range is a real user based on the above-mentioned obtained feature point set, the above-mentioned processor 110 is specifically configured to: obtain any two frames of reference images in the above-mentioned multiple frames of reference images and used to determine the second relative reference value between the corresponding feature points in the feature point sets of any two frames of reference images; and used when the above-mentioned second relative reference value is greater than the second preset threshold , to determine that the users within the shooting range are real users.
在本可能的示例中，在上述第二相对参考值大于第二预设阈值时，确定上述拍摄范围内的用户为真实用户方面，上述处理器110具体用于：确定上述第二相对参考值大于第二预设阈值的特征点组数；以及用于在上述特征点组数大于第三预设阈值时，确定上述拍摄范围内的用户为真实用户。In this possible example, when the second relative reference value is greater than a second preset threshold, in terms of determining that the user within the shooting range is a real user, the processor 110 is specifically configured to: determine that the second relative reference value is greater than The number of feature point groups of the second preset threshold; and used to determine that the users within the shooting range are real users when the number of feature point groups is greater than the third preset threshold.
请参阅图2A，图2A是本发明实施例提供了一种人脸活体检测方法的流程示意图，应用于移动终端，如图所示，本人脸活体检测方法包括：Please refer to FIG. 2A. FIG. 2A is a schematic flow diagram of a face detection method provided by an embodiment of the present invention, which is applied to a mobile terminal. As shown in the figure, the face detection method includes:
S201，移动终端在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像。S201. When the mobile terminal detects that the current shooting range contains a preset image whose completeness is greater than a preset threshold, continuously collect multiple frames of reference images in the current shooting range.
其中，预设图像可为人脸图像或虹膜图像。Wherein, the preset image may be a face image or an iris image.
其中，预设图像中人脸图像或虹膜图像的完整度应大于预设阈值。例如，人脸图像中的人脸的完整度需大于百分之九十，如此，可避免用不同表情的人脸照片伪装成人脸活体识别，因为在替换照片的过程中，会有拍摄到的人脸完整度低甚至拍摄不到人脸的情况，进而，可有效避免假照片识别的情况。Wherein, the integrity of the face image or iris image in the preset image should be greater than a preset threshold. For example, the integrity of the face in the face image needs to be greater than 90%. In this way, it is possible to avoid using face photos with different expressions to pretend to be human face biometric recognition, because in the process of replacing photos, there will be captured When the integrity of the face is low or even the face cannot be photographed, it can effectively avoid the situation of false photo recognition.
其中，人脸图像和虹膜图像对应的预设阈值可不相同。Wherein, the preset thresholds corresponding to the face image and the iris image may be different.
其中，移动终端在检测到拍摄范围内的预设图像中包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像，该多帧的参考图像为人脸图像。Wherein, when the mobile terminal detects that the preset images within the shooting range contain preset images whose integrity is greater than the preset threshold, the mobile terminal continuously collects multiple frames of reference images within the current shooting range, and the reference images of the multiple frames are face images .
S202，上述移动终端预处理上述多帧的参考图像。S202. The mobile terminal preprocesses the reference images of the multiple frames.
其中，对多帧的参考图像进行预处理，可将该多帧图像进行亮度、对比度以及平滑度的处理，以方便特征点的提取和减少特征点之间的误差。Wherein, the multi-frame reference image is preprocessed, and the multi-frame image can be processed for brightness, contrast and smoothness, so as to facilitate the extraction of feature points and reduce errors between feature points.
其中，在采集到多帧的参考图像后，由于这多帧的参考图像是连续采集的，可根据该多帧的参考图像判断人脸的表情是否发生变换，从而确定是否为人脸活体。Wherein, after collecting multiple frames of reference images, since the multiple frames of reference images are continuously collected, it can be judged whether the expression of the human face has changed according to the multiple frames of reference images, so as to determine whether it is a living human face.
S203，上述移动终端获取上述预处理后的每帧参考图像的特征点集合。S203. The above mobile terminal obtains the feature point set of each frame of the reference image after the above preprocessing.
其中，获取预处理后的每帧参考图像的特征点集合，特征点可以是眼睛、鼻子、嘴巴、眉毛等。Wherein, a set of feature points of each frame of the reference image after preprocessing is obtained, and the feature points may be eyes, nose, mouth, eyebrows, and the like.
其中，特征点的选取可由用户进行设置，或者，移动终端根据用户的使用习惯，进行智能学习，得到特征点集合。例如，在用户使用移动终端的过程中，检测到用户习惯性的会动嘴或者动眼睛或者动眉毛，可将这些元素作为特征点。The selection of the feature points can be set by the user, or the mobile terminal can perform intelligent learning according to the usage habits of the user to obtain the set of feature points. For example, in the process of the user using the mobile terminal, it is detected that the user habitually moves the mouth, eyes, or eyebrows, and these elements may be used as feature points.
S204，上述移动终端根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。S204. The mobile terminal determines whether the user within the photographing range is a real user according to the acquired feature point set.
其中，由于采集到的是时间连续的多帧的参考图像，假设拍摄到的用户的表情发生变化时，每帧参考图像中的特征点集合也会发生变化，因此可根据获取的到的特征点集合，可进一步确定用户的表情是否发生变化，从而，确定是否为人脸活体检测。Among them, since the time-continuous multi-frame reference images are collected, it is assumed that when the captured user’s expression changes, the set of feature points in each frame of the reference image will also change, so it can be obtained according to the acquired feature points The collection can further determine whether the user's expression changes, thereby determining whether it is human face liveness detection.
可以看出，本发明实施例中，移动终端首先在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像，其次，预处理上述多帧的参考图像，然后，获取上述预处理后的每帧参考图像的特征点集合，最后，根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。可见，移动终端在进行生物识别之前，先根据用户的脸部表情变化，识别当前人脸是否为人脸活体，有效地避免了假照片等情况，有利于提高生物识别的安全性、可靠性和准确性。It can be seen that in the embodiment of the present invention, when the mobile terminal first detects that the current shooting range contains a preset image whose integrity is greater than the preset threshold, it continuously collects multiple frames of reference images in the current shooting range, and secondly, pre-processes For the above multiple frames of reference images, then obtain the feature point set of each frame of the preprocessed reference image, and finally, determine whether the user within the shooting range is a real user according to the above acquired feature point set. It can be seen that before performing biometric identification, the mobile terminal first identifies whether the current face is a live human face according to the change of the user's facial expression, effectively avoiding false photos and other situations, and is conducive to improving the security, reliability and accuracy of biometric identification. sex.
在一个可能的示例中，上述预处理上述多帧的参考图像，包括：检测上述多帧的参考图像中每帧参考图像中的人脸面积大小是否等于预设面积大小；在检测到上述人脸面积大小不等于预设面积大小时，对上述参考图像进行缩放，使得上述每帧参考图像中的人脸面积大小等于预设面积大小。In a possible example, the above-mentioned preprocessing of the multiple frames of reference images includes: detecting whether the size of the face in each frame of the reference images of the above-mentioned multiple frames of reference images is equal to a preset area size; When the area size is not equal to the preset area size, the above-mentioned reference image is scaled so that the size of the human face in each frame of the reference image is equal to the preset area size.
其中，对多帧的参考图像进行预处理，检测每帧参考图像中的人脸面积大小是否等于预设的面积大小，在人脸面积大小不等于预设的面积大小时，对该参考图像进行缩放，使得该参考图像中的人脸面积大小的等于预设的面积大小，进而，使得多帧的参考图像中每帧参考图像中的人脸面积大小都相同，等于预设的面积大小Wherein, the reference image of multiple frames is preprocessed, and whether the face area size in each frame of reference image is equal to the preset area size is detected, and when the face area size is not equal to the preset area size, the reference image is processed. Scaling, so that the size of the face area in the reference image is equal to the preset area size, and then, making the face area size in each frame of the reference image in multiple frames of reference images the same, equal to the preset area size
其中，预设面积大小应满足可从该预设面积大小的人脸图像中提取到清晰的特征点集合。Wherein, the preset size of the area should meet the requirement that a clear set of feature points can be extracted from the face image of the preset size of the area.
可见，本示例中，由于用户在进行人脸识别时，和移动终端之间的距离可能发生了变化，进而，使得得到的多帧的参考图像中人脸面积的大小不相同。对每帧参考图像中的人脸面积大小进行检测，从而，对参考图像中的人脸面积大小进行归一化处理，使得每帧参考图像中的人脸面积大小相同，有利于在对多帧的参考图像进行特征点提取的时候，使得相应的特征点图像面积大小相同，从而，减少特征点的误差。It can be seen that in this example, since the distance between the user and the mobile terminal may change when performing face recognition, the sizes of the face areas in the obtained reference images of multiple frames are different. Detect the size of the face area in each frame of the reference image, thereby normalizing the size of the face area in the reference image, so that the size of the face area in each frame of the reference image is the same, which is conducive to multi-frame When extracting feature points from the reference image, the corresponding feature point images have the same area size, thereby reducing the error of feature points.
在一个可能的示例中，上述根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户，包括：获取上述特征点集合中的任意两个特征点；确定上述任意两个特征点之间的第一相对参考值；在上述第一相对参考值大于第一预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, the above-mentioned determining whether the user within the shooting range is a real user according to the above-mentioned acquired feature point set includes: acquiring any two feature points in the above-mentioned feature point set; a first relative reference value; when the first relative reference value is greater than a first preset threshold, it is determined that the users within the photographing range are real users.
其中，在任一参考图像的特征点集合中，任意选取两个特征点，比较这两个特征点之间的第一相对参考值，第一相对参考值可以是两个特征点之间的相对距离、相对角度、相对方向、相对坐标位移等，此处不做限定。Wherein, in the feature point set of any reference image, two feature points are randomly selected, and the first relative reference value between the two feature points is compared, the first relative reference value can be the relative distance between the two feature points , relative angle, relative direction, relative coordinate displacement, etc., are not limited here.
例如，第一相对参考值为相对距离，选取的两个特征点为嘴角和鼻尖，用户在微笑时和不微笑时，嘴角和鼻尖之间的距离应不相同。比如，可能用户在微笑时，嘴角和鼻尖之间的距离会大于不微笑时嘴角和鼻尖之间的距离，根据微笑程度的不同，嘴角和鼻尖之间的距离也会发生一定程度的变化，但是变化的范围应该在合理的变换范围在之内，如超出这个变化范围，则不认为是正常的人脸微笑表情。For example, the first relative reference value is a relative distance, and the two selected feature points are the corners of the mouth and the tip of the nose. The distance between the corners of the mouth and the tip of the nose should be different when the user is smiling and not smiling. For example, when the user is smiling, the distance between the corner of the mouth and the tip of the nose may be greater than the distance between the corner of the mouth and the tip of the nose when the user is not smiling. The change range should be within a reasonable change range, and if it exceeds this change range, it will not be considered as a normal human face smiling expression.
又例如，第一相对参考值为相对坐标，以鼻尖为坐标原点，用户没有做任何表情时，嘴角的相对坐标为(X1，Y1)，在用户有做表情时，嘴角的相对坐标为(X2，Y2)，第一相对参考值为坐标(X2，Y2)和坐标(X1，Y1)之间的位移。其中，在第一相对参考值大于第一预设阈值时，即(X2，Y2)和坐标(X1，Y1)之间的位移大于第一预设阈值时，说明用户发生了一定程度的微笑，是有意的在微笑，可确定当前用户为真实用户。For another example, the first relative reference value is relative coordinates, with the tip of the nose as the coordinate origin, when the user does not make any facial expressions, the relative coordinates of the corners of the mouth are (X1, Y1), and when the user makes facial expressions, the relative coordinates of the corners of the mouth are (X2 , Y2), the first relative reference value is the displacement between coordinates (X2, Y2) and coordinates (X1, Y1). Wherein, when the first relative reference value is greater than the first preset threshold, that is, when the displacement between (X2, Y2) and the coordinates (X1, Y1) is greater than the first preset threshold, it means that the user has smiled to a certain extent, It is intentional to smile, which can determine that the current user is a real user.
可见，在本示例中，根据特征点集合中任意两个特征点之间的第一相对参考值，确定拍摄范围内的用户是否为真实用户，可准确识别用户是否发生了表情变化，从而确定是否为人脸活体，有利于提高生物识别的准确性和可靠性。It can be seen that in this example, according to the first relative reference value between any two feature points in the feature point set, it is determined whether the user within the shooting range is a real user, and it is possible to accurately identify whether the user’s expression has changed, so as to determine whether It is a live face, which is conducive to improving the accuracy and reliability of biometric identification.
在一个可能的示例中，上述根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户，包括：获取上述多帧的参考图像中任意两帧参考图像的特征点集合；确定上述任意两帧参考图像的特征点集合中对应的特征点之间的第二相对参考值；在上述第二相对参考值大于第二预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, the above-mentioned determining whether the user within the shooting range is a real user according to the above-mentioned acquired feature point set includes: acquiring the feature point set of any two frames of reference images in the above-mentioned multiple frames of reference images; determining the above-mentioned any A second relative reference value between corresponding feature points in the feature point sets of two frames of reference images; when the second relative reference value is greater than a second preset threshold, it is determined that the user within the shooting range is a real user.
其中，在连续采集多帧的人脸参考图像时，若用户的人脸表情发生了变化，则在多帧的参考图像中，每帧参考图像中的特征点集合中的同一个或多个特征点也是不相同的，会有一定程度上的变化。Among them, when multiple frames of face reference images are collected continuously, if the user's facial expression changes, in the multiple frames of reference images, the same or more features in the feature point set in each frame of reference image The points are also different, and there will be changes to a certain extent.
其中，在任意两帧参考图像的特征点集合中，选取对应的一个或多个特征点，比较特征点之间的第二相对参考值。第二相对参考值可以是一个或多个对应特征点在两帧参考图像中发生的距离变化、位移变化、角度变化等。Among the feature point sets of any two frames of reference images, one or more corresponding feature points are selected, and a second relative reference value between the feature points is compared. The second relative reference value may be a distance change, displacement change, angle change, etc. of one or more corresponding feature points in two frames of reference images.
例如，选取特征点中的两个嘴角进行比较，在用户表情发生变化，如微笑时，参考图像1中两嘴角之间的距离和参考图像2中两嘴角之间的距离可能不相同，因为参考图像1和参考图像2为在不同的时刻采集到的两幅参考图像，用户在表情发生变化的过程中，两嘴角之间的距离自然也会发生变化。如图2B和图2C所示，为多帧参考图像中的任意两帧参考图像，图2B为参考图像1，参考图像1中嘴角1和嘴角2之间的距离为d1，图2C为参考图像2，参考图像2中嘴角1和嘴角2之间的距离为d2，第二参考值为d1和d2差值的绝对值。可以看出，参考图像1和参考图像2中嘴角之间的距离d1和d2不相同。For example, if two corners of the mouth in the feature points are selected for comparison, when the user’s expression changes, such as smiling, the distance between the corners of the mouth in reference image 1 and the distance between the corners of the mouth in reference image 2 may be different, because the reference Image 1 and reference image 2 are two reference images collected at different times. When the user's expression changes, the distance between the two mouth corners will naturally change. As shown in Figure 2B and Figure 2C, it is any two frames of reference images in the multi-frame reference image, Figure 2B is the reference image 1, the distance between the mouth corner 1 and the mouth corner 2 in the reference image 1 is d1, and Figure 2C is the reference image 2. The distance between mouth corner 1 and mouth corner 2 in reference image 2 is d2, and the second reference value is the absolute value of the difference between d1 and d2. It can be seen that the distances d1 and d2 between the corners of the mouth in reference image 1 and reference image 2 are not the same.
其中，根据两帧参考图像中的对应特征点之间的第二相对参考值，如参考图1和参考图像2中的两嘴角之间的距离d1和d2，可确定第二相对参考值，在第二相对参考值大于第二预设阈值时，表明参考图像1和参考图像2中用户的表情发生了变化，可确定当前拍摄范围内的用户人脸为人脸活体。Wherein, according to the second relative reference value between the corresponding feature points in the two frames of reference images, such as the distances d1 and d2 between the two corners of the mouth in reference to Figure 1 and reference image 2, the second relative reference value can be determined, in When the second relative reference value is greater than the second preset threshold, it indicates that the expression of the user in the reference image 1 and reference image 2 has changed, and it can be determined that the user's face within the current shooting range is a live face.
可见，本示例中，由于多帧的参考图像为连续采集的人脸图像，并且参考图像1和参考图像2为多帧的参考图像中的任意两张参考图像，因此，跟根据人脸的表情变化及变化程度确定为人脸活体。It can be seen that, in this example, since the reference images of multiple frames are continuously collected face images, and reference image 1 and reference image 2 are any two reference images in the reference images of multiple frames, according to the facial expression The change and the degree of change are determined as a live face.
在本可能的示例中，上述在上述第二相对参考值大于第二预设阈值时，确定上述拍摄范围内的用户为真实用户，包括：确定上述第二相对参考值大于第二预设阈值的特征点组数；在上述特征点组数大于第三预设阈值时，确定上述拍摄范围内的用户为真实用户。In this possible example, when the second relative reference value is greater than the second preset threshold, determining that the user within the shooting range is a real user includes: determining that the second relative reference value is greater than the second preset threshold The number of feature point groups; when the number of feature point groups is greater than a third preset threshold, it is determined that the users within the shooting range are real users.
其中，特征点集合中包含用户的多个特征点，用户的表情变化可包含多个特征点的变化，例如，检测到的第一个特征点为嘴角，在确定嘴角发生变换后，进而，可检测用户的眼睛是否发生变换，由于用户在微笑时眼睛也会发生变化，可对任意两帧参考图像的多组特征点进行比较，确定特征点之间的第二相对参考值大于第二预设阈值的组数。Wherein, the feature point set includes multiple feature points of the user, and the user's facial expression changes may include changes in multiple feature points. For example, the first feature point detected is the corner of the mouth. After it is determined that the corner of the mouth has changed, further, Detect whether the user's eyes change. Since the user's eyes will also change when they smile, multiple sets of feature points of any two frames of reference images can be compared to determine that the second relative reference value between the feature points is greater than the second preset The number of groups for the threshold.
其中，在特征点组数大于第三预设阈值时，可确定拍摄范围内的用户为真实用户。例如，第三预设阈值为2，若检测到仅仅是人脸的嘴角发生了变化，则不能判断当前人脸或人脸活体，若检测到人脸的嘴角和眼睛这两组特征点都发生了一定程度的变化，则可确定为人脸活体。Wherein, when the number of feature point groups is greater than the third preset threshold, it may be determined that the users within the shooting range are real users. For example, the third preset threshold is 2. If only the corners of the mouth of the face are detected to be changed, the current face or the living body of the face cannot be judged. If there is a certain degree of change, it can be determined as a living human face.
可见，本示例中，在第二相对参考值大于第二预设阈值的特征点组数大于第三预设阈值时，才可确定拍摄范围内的用户为真实用户。如此，使用用户在进行生物识别之前，先要做出一定程度的表情变换，并且在表情变化的过程中，不能只是简单的表情变化，发生变化的特征点数目需大于第三预设阈值，有利于提高人脸活体检测的准确性和可靠性。It can be seen that, in this example, only when the number of feature point groups whose second relative reference value is greater than the second preset threshold is greater than the third preset threshold, can it be determined that the user within the shooting range is a real user. In this way, the user must make a certain degree of expression change before performing biometric identification, and in the process of expression change, it cannot be just a simple expression change. The number of changed feature points must be greater than the third preset threshold. It is beneficial to improve the accuracy and reliability of face detection.
与上述图2A所示的实施例一致的，请参阅图3，图3是本发明实施例提供的一种移动终端的结构示意图，如图所示，该移动终端包括处理器、存储器、通信接口以及一个或多个程序，其中，上述一个或多个程序被存储在上述存储器中，并且被配置由上述处理器执行，上述程序包括用于执行以下步骤的指令；Consistent with the embodiment shown in FIG. 2A above, please refer to FIG. 3. FIG. 3 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention. As shown in the figure, the mobile terminal includes a processor, a memory, and a communication interface and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the programs include instructions for performing the following steps;
在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像；When it is detected that the current shooting range contains a preset image whose integrity is greater than the preset threshold, continuously collect multiple frames of reference images in the current shooting range;
预处理上述多帧的参考图像；Preprocessing the reference images of the above multiple frames;
获取上述预处理后的每帧参考图像的特征点集合；Obtain the set of feature points of each frame of the reference image after the above preprocessing;
根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。It is determined whether the user within the shooting range is a real user according to the acquired feature point set.
可以看出，本发明实施例中，移动终端首先在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，连续采集当前拍摄范围内的多帧的参考图像，其次，预处理上述多帧的参考图像，然后，获取上述预处理后的每帧参考图像的特征点集合，最后，根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。可见，移动终端在进行生物识别之前，先根据用户的脸部表情变化，识别当前人脸是否为人脸活体，有效地避免了假照片等情况，有利于提高生物识别的安全性、可靠性和准确性。It can be seen that in the embodiment of the present invention, when the mobile terminal first detects that the current shooting range contains a preset image whose integrity is greater than the preset threshold, it continuously collects multiple frames of reference images in the current shooting range, and secondly, pre-processes For the above multiple frames of reference images, then obtain the feature point set of each frame of the preprocessed reference image, and finally, determine whether the user within the shooting range is a real user according to the above acquired feature point set. It can be seen that before performing biometric identification, the mobile terminal first identifies whether the current face is a live human face according to the change of the user's facial expression, effectively avoiding false photos and other situations, and is conducive to improving the security, reliability and accuracy of biometric identification. sex.
在一个可能的示例中，在上述预处理上述多帧的参考图像方面，上述程序中的指令具体用于执行以下步骤：检测上述多帧的参考图像中每帧参考图像中的人脸面积大小是否等于预设面积大小；在检测到上述人脸面积大小不等于预设面积大小时，对上述参考图像进行缩放，使得上述每帧参考图像中的人脸面积大小等于预设面积大小。In a possible example, in terms of preprocessing the above-mentioned multi-frame reference images, the instructions in the above-mentioned program are specifically used to perform the following steps: detecting whether the size of the human face in each frame of the above-mentioned multi-frame reference images is Equal to the preset area size; when it is detected that the above-mentioned face area size is not equal to the preset area size, the above-mentioned reference image is scaled so that the face area size in each frame of the above-mentioned reference image is equal to the preset area size.
在一个可能的示例中，在上述根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户方面，上述程序中的指令具体用于执行以下步骤：获取上述特征点集合中的任意两个特征点；确定上述任意两个特征点之间的第一相对参考值；在上述第一相对参考值大于第一预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, in terms of determining whether the user within the shooting range is a real user according to the above-mentioned acquired feature point set, the instructions in the above-mentioned program are specifically used to perform the following steps: acquire any two of the above-mentioned feature point set feature points; determining a first relative reference value between any two feature points; when the first relative reference value is greater than a first preset threshold, it is determined that the user within the shooting range is a real user.
在一个可能的示例中，在上述根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户方面，上述程序中的指令具体用于执行以下步骤：获取上述多帧的参考图像中任意两帧参考图像的特征点集合；确定上述任意两帧参考图像的特征点集合中对应的特征点之间的第二相对参考值；在上述第二相对参考值大于第二预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, in terms of determining whether the user within the shooting range is a real user based on the acquired feature point set, the instructions in the above program are specifically used to perform the following steps: acquire any The feature point sets of two frames of reference images; determine the second relative reference value between the corresponding feature points in the feature point sets of any two frames of reference images; when the above-mentioned second relative reference value is greater than the second preset threshold, determine The users within the shooting range mentioned above are real users.
在一个可能的示例中，在上述在上述第二相对参考值大于第二预设阈值时，确定上述拍摄范围内的用户为真实用户方面，上述程序中的指令具体用于执行以下步骤：确定上述第二相对参考值大于第二预设阈值的特征点组数；In a possible example, when the second relative reference value is greater than the second preset threshold, determining that the user within the shooting range is a real user, the instructions in the program are specifically used to perform the following steps: determine the the number of feature point groups whose second relative reference value is greater than the second preset threshold;
在上述特征点组数大于第三预设阈值时，确定上述拍摄范围内的用户为真实用户。When the number of feature point groups is greater than a third preset threshold, it is determined that the users within the shooting range are real users.
上述主要从方法侧执行过程的角度对本发明实施例的方案进行了介绍。可以理解的是，移动终端为了实现上述功能，其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，本发明能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。The foregoing mainly introduces the solutions of the embodiments of the present invention from the perspective of executing the process on the method side. It can be understood that, in order to realize the above functions, the mobile terminal includes hardware structures and/or software modules corresponding to each function. Those skilled in the art should easily realize that the present invention can be realized in the form of hardware or a combination of hardware and computer software in combination with the units and algorithm steps of each example described in the embodiments disclosed herein. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.
本发明实施例可以根据上述方法示例对移动终端进行功能单元的划分，例如，可以对应各个功能划分各个功能单元，也可以将两个或两个以上的功能集成在一个处理单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。需要说明的是，本发明实施例中对单元的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。In the embodiment of the present invention, the functional units of the mobile terminal may be divided according to the above method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of the units in the embodiment of the present invention is schematic, and is only a logical function division, and there may be another division manner in actual implementation.
在采用集成的单元的情况下，图4示出了上述实施例中所涉及的移动终端的一种可能的功能单元组成框图。移动终端400包括：处理单元402和采集单元403。处理单元402用于对移动终端的动作进行控制管理，例如，处理单元402用于支持移动终端执行图2A中的步骤S201-S203和/或用于本文所描述的技术的其它过程。采集单元403用于支持移动终端与其他设备的通信。移动终端还可以包括存储单元401，用于存储移动终端的程序代码和数据。In the case of using integrated units, FIG. 4 shows a possible functional unit composition block diagram of the mobile terminal involved in the above-mentioned embodiments. The mobile terminal 400 includes: a processing unit 402 and a collection unit 403 . The processing unit 402 is used to control and manage the actions of the mobile terminal, for example, the processing unit 402 is used to support the mobile terminal to execute steps S201-S203 in FIG. 2A and/or other processes for the technologies described herein. The collection unit 403 is used to support communication between the mobile terminal and other devices. The mobile terminal may also include a storage unit 401 for storing program codes and data of the mobile terminal.
其中，上述处理单元402，用于在检测到当前拍摄范围内包含完整度大于预设阈值的预设图像时，通过上述采集单元403连续采集当前拍摄范围内的多帧的参考图像；以及用于预处理上述多帧的参考图像；以及用于获取上述预处理后的每帧参考图像的特征点集合；以及用于根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户。Wherein, the above-mentioned processing unit 402 is configured to continuously collect reference images of multiple frames within the current shooting range through the above-mentioned acquisition unit 403 when detecting that the current shooting range contains a preset image whose integrity is greater than a preset threshold; and for Preprocessing the reference images of the above multiple frames; and obtaining the feature point set of each frame of the preprocessed reference image; and determining whether the user within the shooting range is a real user based on the above acquired feature point set.
在一个可能的示例中，在上述预处理上述多帧的参考图像方面，上述处理单元402具体用于：检测上述多帧的参考图像中每帧参考图像中的人脸面积大小是否等于预设面积大小；以及用于在检测到上述人脸面积大小不等于预设面积大小时，对上述参考图像进行缩放，使得上述每帧参考图像中的人脸面积大小等于预设面积大小。In a possible example, in terms of the aforementioned preprocessing of the aforementioned multiple frames of reference images, the aforementioned processing unit 402 is specifically configured to: detect whether the size of the face area in each frame of the aforementioned multiple frames of reference images is equal to a preset area size; and when it is detected that the size of the face area is not equal to the preset area size, the reference image is scaled so that the size of the face area in each frame of the reference image is equal to the preset area size.
在一个可能的示例中，在上述根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户方面，上述处理单元402具体用于：获取上述特征点集合中的任意两个特征点；以及用于确定上述任意两个特征点之间的第一相对参考值；以及用于在上述第一相对参考值大于第一预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, in terms of determining whether the user within the shooting range is a real user based on the acquired feature point set, the processing unit 402 is specifically configured to: acquire any two feature points in the feature point set; and for determining a first relative reference value between any two feature points; and for determining that the user within the photographing range is a real user when the first relative reference value is greater than a first preset threshold.
在一个可能的示例中，在上述根据上述获取的特征点集合确定上述拍摄范围内的用户是否为真实用户方面，上述处理单元402具体用于：获取上述多帧的参考图像中任意两帧参考图像的特征点集合；以及用于确定上述任意两帧参考图像的特征点集合中对应的特征点之间的第二相对参考值；以及用于在上述第二相对参考值大于第二预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, in terms of determining whether the user within the shooting range is a real user according to the above-mentioned obtained feature point set, the above-mentioned processing unit 402 is specifically configured to: obtain any two frames of reference images in the above-mentioned multiple frames of reference images and used to determine the second relative reference value between the corresponding feature points in the feature point sets of any two frames of reference images; and used when the above-mentioned second relative reference value is greater than the second preset threshold , to determine that the users within the shooting range are real users.
在一个可能的示例中，在上述在上述第二相对参考值大于第二预设阈值时，确定上述拍摄范围内的用户为真实用户方面，上述处理单元402具体用于：确定上述第二相对参考值大于第二预设阈值的特征点组数；以及用于在上述特征点组数大于第三预设阈值时，确定上述拍摄范围内的用户为真实用户。In a possible example, in terms of determining that the user within the shooting range is a real user when the second relative reference value is greater than the second preset threshold, the processing unit 402 is specifically configured to: determine the second relative reference value The number of feature point groups whose value is greater than the second preset threshold; and used to determine that the user within the shooting range is a real user when the number of feature point groups is greater than a third preset threshold.
其中，处理单元402可以是处理器或控制器，采集单元403可以是生物信息采集装置，如虹膜信息采集装置、面部信息采集装置、指纹信息采集装置等，存储单元401可以是存储器。Wherein, the processing unit 402 may be a processor or a controller, the collection unit 403 may be a biological information collection device, such as an iris information collection device, a facial information collection device, a fingerprint information collection device, etc., and the storage unit 401 may be a memory.
本发明实施例还提供一种计算机存储介质，其中，该计算机存储介质存储用于电子数据交换的计算机程序，该计算机程序使得计算机执行如上述方法实施例中记载的任一方法的部分或全部步骤，上述计算机包括移动终端。An embodiment of the present invention also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables the computer to execute some or all of the steps of any method described in the above method embodiments , the above computer includes a mobile terminal.
本发明实施例还提供一种计算机程序产品，上述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质，上述计算机程序可操作来使计算机执行如上述方法实施例中记载的任一方法的部分或全部步骤。该计算机程序产品可以为一个软件安装包，上述计算机包括移动终端。An embodiment of the present invention also provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program is operable to make the computer perform any one of the methods described in the above method embodiments Some or all steps of the method. The computer program product may be a software installation package, and the above-mentioned computer includes a mobile terminal.
需要说明的是，对于前述的各方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本发明并不受所描述的动作顺序的限制，因为依据本发明，某些步骤可以采用其他顺序或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作和模块并不一定是本发明所必须的。It should be noted that for the foregoing method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence. Because of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.
在上述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其他实施例的相关描述。In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.
在本申请所提供的几个实施例中，应该理解到，所揭露的装置，可通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如上述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components can be combined or integrated. to another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical or other forms.
上述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
上述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储器中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储器中，包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本发明各个实施例上述方法的全部或部分步骤。而前述的存储器包括：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。If the above-mentioned integrated units are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable memory. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory. Several instructions are included to make a computer device (which may be a personal computer, server or network device, etc.) execute all or part of the steps of the above-mentioned methods in various embodiments of the present invention. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读存储器中，存储器可以包括：闪存盘、只读存储器(英文：Read-Only Memory，简称：ROM)、随机存取器(英文：Random Access Memory，简称：RAM)、磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory (English: Read-Only Memory, abbreviated: ROM), random access device (English: Random Access Memory, abbreviated: RAM), magnetic disk or optical disk, etc.
以上对本发明实施例进行了详细介绍，本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想；同时，对于本领域的一般技术人员，依据本发明的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本发明的限制。The embodiments of the present invention have been described in detail above, and specific examples have been used in this paper to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only used to help understand the method and core idea of the present invention; at the same time, for Those skilled in the art will have changes in the specific implementation and scope of application according to the idea of the present invention. In summary, the contents of this specification should not be construed as limiting the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710560789.XACN107437067A (en) | 2017-07-11 | 2017-07-11 | Face liveness detection method and related products |
| PCT/CN2018/088896WO2019011073A1 (en) | 2017-07-11 | 2018-05-29 | Human face live detection method and related product |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710560789.XACN107437067A (en) | 2017-07-11 | 2017-07-11 | Face liveness detection method and related products |
| Publication Number | Publication Date |
|---|---|
| CN107437067Atrue CN107437067A (en) | 2017-12-05 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710560789.XAPendingCN107437067A (en) | 2017-07-11 | 2017-07-11 | Face liveness detection method and related products |
| Country | Link |
|---|---|
| CN (1) | CN107437067A (en) |
| WO (1) | WO2019011073A1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109086691A (en)* | 2018-07-16 | 2018-12-25 | 阿里巴巴集团控股有限公司 | A kind of three-dimensional face biopsy method, face's certification recognition methods and device |
| WO2019011073A1 (en)* | 2017-07-11 | 2019-01-17 | Oppo广东移动通信有限公司 | Human face live detection method and related product |
| CN109614910A (en)* | 2018-12-04 | 2019-04-12 | 青岛小鸟看看科技有限公司 | A face recognition method and device |
| CN109871755A (en)* | 2019-01-09 | 2019-06-11 | 中国平安人寿保险股份有限公司 | An authentication method based on face recognition |
| CN110199296A (en)* | 2019-04-25 | 2019-09-03 | 深圳市汇顶科技股份有限公司 | Face identification method, processing chip and electronic equipment |
| WO2020007191A1 (en)* | 2018-07-06 | 2020-01-09 | 北京三快在线科技有限公司 | Method and apparatus for living body recognition and detection, and medium and electronic device |
| CN111432279A (en)* | 2019-01-10 | 2020-07-17 | 青岛海尔多媒体有限公司 | A method and device for smart TV control and smart TV |
| CN115798059A (en)* | 2022-12-20 | 2023-03-14 | 平安银行股份有限公司 | Living body detection method and device, computer equipment and storage medium |
| CN116168428A (en)* | 2021-11-24 | 2023-05-26 | 北京中关村科金技术有限公司 | Human face image living body detection method, device, computer equipment and storage medium |
| CN119234260A (en)* | 2023-03-14 | 2024-12-31 | 丰富M1有限公司 | Counterfeit detection system and counterfeit detection program |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111860057A (en)* | 2019-04-29 | 2020-10-30 | 北京眼神智能科技有限公司 | Face image blurring and living body detection method, device, storage medium and device |
| CN111179234B (en)* | 2019-12-20 | 2023-08-25 | 珠海格力智能装备有限公司 | Method and device for determining hole site information of compressor |
| CN113128288B (en)* | 2019-12-31 | 2024-06-11 | 深圳云天励飞技术有限公司 | Monitoring method and related product |
| CN116208842B (en)* | 2021-11-30 | 2024-11-29 | 顺丰科技有限公司 | Video processing method, apparatus, device and computer readable storage medium |
| CN115174138B (en)* | 2022-05-25 | 2024-06-07 | 北京旷视科技有限公司 | Camera attack detection method, system, device, storage medium and program product |
| CN117746470B (en)* | 2022-12-16 | 2024-11-19 | 行吟信息科技(武汉)有限公司 | Face area identification method and device, electronic equipment and storage medium |
| CN118474522B (en)* | 2023-11-07 | 2024-12-31 | 荣耀终端有限公司 | Photographing method, terminal equipment, chip and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102654903A (en)* | 2011-03-04 | 2012-09-05 | 井维兰 | Face comparison method |
| CN104361326A (en)* | 2014-11-18 | 2015-02-18 | 新开普电子股份有限公司 | Method for distinguishing living human face |
| CN104751110A (en)* | 2013-12-31 | 2015-07-01 | 汉王科技股份有限公司 | Bio-assay detection method and device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107437067A (en)* | 2017-07-11 | 2017-12-05 | 广东欧珀移动通信有限公司 | Face liveness detection method and related products |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102654903A (en)* | 2011-03-04 | 2012-09-05 | 井维兰 | Face comparison method |
| CN104751110A (en)* | 2013-12-31 | 2015-07-01 | 汉王科技股份有限公司 | Bio-assay detection method and device |
| CN104361326A (en)* | 2014-11-18 | 2015-02-18 | 新开普电子股份有限公司 | Method for distinguishing living human face |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019011073A1 (en)* | 2017-07-11 | 2019-01-17 | Oppo广东移动通信有限公司 | Human face live detection method and related product |
| WO2020007191A1 (en)* | 2018-07-06 | 2020-01-09 | 北京三快在线科技有限公司 | Method and apparatus for living body recognition and detection, and medium and electronic device |
| CN109086691A (en)* | 2018-07-16 | 2018-12-25 | 阿里巴巴集团控股有限公司 | A kind of three-dimensional face biopsy method, face's certification recognition methods and device |
| CN109614910A (en)* | 2018-12-04 | 2019-04-12 | 青岛小鸟看看科技有限公司 | A face recognition method and device |
| CN109871755A (en)* | 2019-01-09 | 2019-06-11 | 中国平安人寿保险股份有限公司 | An authentication method based on face recognition |
| CN111432279A (en)* | 2019-01-10 | 2020-07-17 | 青岛海尔多媒体有限公司 | A method and device for smart TV control and smart TV |
| CN110199296A (en)* | 2019-04-25 | 2019-09-03 | 深圳市汇顶科技股份有限公司 | Face identification method, processing chip and electronic equipment |
| CN116168428A (en)* | 2021-11-24 | 2023-05-26 | 北京中关村科金技术有限公司 | Human face image living body detection method, device, computer equipment and storage medium |
| CN115798059A (en)* | 2022-12-20 | 2023-03-14 | 平安银行股份有限公司 | Living body detection method and device, computer equipment and storage medium |
| CN119234260A (en)* | 2023-03-14 | 2024-12-31 | 丰富M1有限公司 | Counterfeit detection system and counterfeit detection program |
| Publication number | Publication date |
|---|---|
| WO2019011073A1 (en) | 2019-01-17 |
| Publication | Publication Date | Title |
|---|---|---|
| CN107437067A (en) | Face liveness detection method and related products | |
| CN107886032B (en) | Terminal device, smart phone, authentication method and system based on face recognition | |
| US10423848B2 (en) | Method, system, and computer-readable recording medium for long-distance person identification | |
| CN107273875A (en) | Face living body detection method and related product | |
| CN107480601B (en) | Detection method and related product | |
| CN105205462A (en) | Shooting promoting method and device | |
| CN107292283A (en) | Mix face identification method | |
| WO2019011072A1 (en) | Iris live detection method and related product | |
| CN108304708A (en) | Mobile terminal, face unlocking method and related product | |
| CN107657161A (en) | Mobile payment method and related products based on face recognition | |
| CN107527046A (en) | Solve lock control method and Related product | |
| CN107622246A (en) | Face recognition method and related products | |
| CN107622243A (en) | Unlock control method and related products | |
| CN107491672A (en) | Unlocking processing method and Related product | |
| CN110287918A (en) | living body identification method and related product | |
| CN107451453A (en) | Solve lock control method and Related product | |
| CN107527019B (en) | Unlocking control method and related product | |
| CN107277265A (en) | Unlock control method and related products | |
| CN108021905A (en) | Image processing method, device, terminal equipment and storage medium | |
| CN107506697B (en) | Anti-counterfeiting processing method and related product | |
| CN107451543A (en) | Event processing method and related products | |
| CN113591526A (en) | Face living body detection method, device, equipment and computer readable storage medium | |
| CN109684993B (en) | Face recognition method, system and equipment based on nostril information | |
| CN107977636B (en) | Face detection method and device, terminal and storage medium | |
| CN107563338A (en) | Face detection method and related products |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20171205 | |
| RJ01 | Rejection of invention patent application after publication |