CN110602390A - Image processing method and electronic equipment - Google Patents

Abstract

Translated fromChinese

本发明实施例公开了一种图像处理方法及电子设备，涉及通信技术领域，可以解决电子设备拍摄过程的效率较低的问题。该方法包括：识别目标图像中第一人脸图像的第一特征点信息；根据第一特征点信息，确定第一人脸图像中的目标特征点的移动参数，该移动参数包括目标移动方向和目标移动距离；基于移动参数，在目标图像中移动目标特征点，并生成目标显示图像；显示目标显示图像。本发明实施例应用于电子设备根据人脸图像的特征点的信息，调整人脸图像的过程中。

The embodiment of the invention discloses an image processing method and electronic equipment, relates to the field of communication technology, and can solve the problem of low efficiency in the shooting process of the electronic equipment. The method includes: identifying the first feature point information of the first human face image in the target image; determining the movement parameters of the target feature points in the first human face image according to the first feature point information, the movement parameters including the target moving direction and The moving distance of the target; based on the moving parameter, moving the target feature point in the target image, and generating the target display image; displaying the target display image. The embodiments of the present invention are applied in the process of adjusting the face image by the electronic device according to the information of the feature points of the face image.

Description

Translated fromChinese

一种图像处理方法及电子设备Image processing method and electronic device

技术领域technical field

本发明实施例涉及通信技术领域，尤其涉及一种图像处理方法及电子设备。Embodiments of the present invention relate to the field of communication technologies, and in particular, to an image processing method and electronic equipment.

背景技术Background technique

目前，电子设备(例如手机)的摄像头设置在手机的显示屏的某一侧位置(例如显示屏的左上方位置或右上方位置)，用户在使用手机进行拍摄(例如自拍)时，拍摄的效果可能不佳。At present, the camera of an electronic device (such as a mobile phone) is set on a certain side of the display screen of the mobile phone (such as the upper left position or the upper right position of the display screen). Possibly bad.

通常，在手机拍摄的人脸图像不佳时，用户需要重新调整手机的拍摄角度，再次进行拍摄，直至得到比较满意的图像，因此用户通过电子设备进行拍摄过程的操作比较繁琐，从而导致电子设备拍摄过程的效率较低。Usually, when the face image captured by the mobile phone is not good, the user needs to readjust the shooting angle of the mobile phone and shoot again until a satisfactory image is obtained. The efficiency of the shooting process is low.

发明内容Contents of the invention

本发明实施例提供一种图像处理方法及电子设备，可以解决电子设备拍摄过程的效率较低的问题。Embodiments of the present invention provide an image processing method and an electronic device, which can solve the problem of low efficiency in the shooting process of the electronic device.

为了解决上述技术问题，本发明实施例采用如下技术方案：In order to solve the above technical problems, the embodiment of the present invention adopts the following technical solutions:

本发明实施例的第一方面，提供一种图像处理方法，应用于电子设备，该图像处理方法包括：识别目标图像中第一人脸图像的第一特征点信息；根据第一特征点信息，确定第一人脸图像中的目标特征点的移动参数，移动参数包括目标移动方向和目标移动距离；基于移动参数，在目标图像中移动目标特征点，并生成目标显示图像；显示目标显示图像。According to the first aspect of the embodiments of the present invention, an image processing method is provided, which is applied to an electronic device. The image processing method includes: identifying the first feature point information of the first human face image in the target image; according to the first feature point information, Determine the movement parameters of the target feature points in the first face image, the movement parameters include the target movement direction and the target movement distance; based on the movement parameters, move the target feature points in the target image, and generate a target display image; display the target display image.

本发明实施例的第二方面，提供一种电子设备，该电子设备包括：识别模块、确定模块、移动模块、生成模块和显示模块。其中，识别模块，用于识别目标图像中第一人脸图像的第一特征点信息。确定模块，用于根据识别模块识别的第一特征点信息，确定第一人脸图像中的目标特征点的移动参数，该移动参数包括目标移动方向和目标移动距离。移动模块，用于基于确定模块确定的移动参数，在目标图像中移动目标特征点。生成模块，用于生成目标显示图像。显示模块，用于显示生成模块生成的目标显示图像。According to a second aspect of the embodiments of the present invention, an electronic device is provided, and the electronic device includes: an identification module, a determination module, a movement module, a generation module and a display module. Wherein, the identification module is used to identify the first feature point information of the first human face image in the target image. The determination module is configured to determine the movement parameters of the target feature points in the first face image according to the first feature point information identified by the recognition module, where the movement parameters include the target moving direction and the target moving distance. The moving module is used for moving the target feature point in the target image based on the moving parameter determined by the determining module. The generating module is used for generating target display images. The display module is used to display the target display image generated by the generation module.

本发明实施例的第三方面，提供一种电子设备，该电子设备包括处理器、存储器及存储在存储器上并可在处理器上运行的计算机程序，该计算机程序被处理器执行时实现如第一方面所述的图像处理方法的步骤。The third aspect of the embodiments of the present invention provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and operable on the processor. When the computer program is executed by the processor, the following In one aspect, the steps of the image processing method.

本发明实施例的第四方面，提供一种计算机可读存储介质，该计算机可读存储介质上存储计算机程序，该计算机程序被处理器执行时实现如第一方面所述的图像处理方法的步骤。A fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the image processing method as described in the first aspect are implemented .

在本发明实施例中，电子设备可以获取第一特征点信息(该第一特征信点息包括第一人脸图像的特征点的信息)，并根据该第一特征点信息，确定第一人脸图像中的目标特征点的移动参数，从而以基于该移动参数，移动第一人脸图像的特征点。由于电子设备可以直接基于根据第一特征点信息确定的移动参数，移动第一人脸图像的特征点，以调整第一人脸图像，从而得到比较对称的人脸图像，而无需用户多次调整电子设备的拍摄角度以进行多次拍摄，如此可以在提升电子设备的拍摄效果的同时，简化用户拍摄过程的操作且节省耗时，从而可以提高电子设备拍摄过程的效率。In the embodiment of the present invention, the electronic device may obtain the first feature point information (the first feature information point information includes the feature point information of the first face image), and determine the first person according to the first feature point information The movement parameters of the target feature points in the face image, so as to move the feature points of the first human face image based on the movement parameters. Since the electronic device can directly move the feature points of the first face image based on the movement parameters determined according to the first feature point information to adjust the first face image, thereby obtaining a more symmetrical face image without the need for multiple adjustments by the user The shooting angle of the electronic device can be used for multiple shooting, so that while improving the shooting effect of the electronic device, the operation of the user's shooting process can be simplified and time-consuming can be saved, thereby improving the efficiency of the shooting process of the electronic device.

附图说明Description of drawings

图1为本发明实施例提供的一种安卓操作系统的架构示意图；Fig. 1 is a schematic diagram of the architecture of an Android operating system provided by an embodiment of the present invention;

图2为本发明实施例提供的一种图像处理方法的示意图之一；FIG. 2 is one of the schematic diagrams of an image processing method provided by an embodiment of the present invention;

图3为本发明实施例提供的一种手机的界面的实例示意图之一；Fig. 3 is one of the example schematic diagrams of the interface of a mobile phone provided by the embodiment of the present invention;

图4为本发明实施例提供的一种图像处理方法的示意图之二；FIG. 4 is the second schematic diagram of an image processing method provided by an embodiment of the present invention;

图5为本发明实施例提供的一种图像处理方法的特征点分布示意图之一；FIG. 5 is one of the schematic diagrams of feature point distribution of an image processing method provided by an embodiment of the present invention;

图6为本发明实施例提供的一种图像处理方法的示意图之三；FIG. 6 is the third schematic diagram of an image processing method provided by an embodiment of the present invention;

图7为本发明实施例提供的一种图像处理方法的特征点分布示意图之二；Fig. 7 is the second schematic diagram of feature point distribution of an image processing method provided by an embodiment of the present invention;

图8为本发明实施例提供的一种图像处理方法的特征点分布示意图之三；Fig. 8 is the third schematic diagram of feature point distribution of an image processing method provided by an embodiment of the present invention;

图9为本发明实施例提供的一种图像处理方法的示意图之四；FIG. 9 is a fourth schematic diagram of an image processing method provided by an embodiment of the present invention;

图10为本发明实施例供的一种图像处理方法的特征点处理示意图之一；10 is one of the schematic diagrams of feature point processing of an image processing method provided by an embodiment of the present invention;

图11为本发明实施例供的一种图像处理方法的特征点处理示意图之二；Fig. 11 is the second schematic diagram of feature point processing of an image processing method provided by an embodiment of the present invention;

图12为本发明实施例提供的一种手机的界面的实例示意图之二；FIG. 12 is the second schematic diagram of an example of an interface of a mobile phone provided by an embodiment of the present invention;

图13为本发明实施例提供的一种电子设备的结构示意图之一；FIG. 13 is one of the structural schematic diagrams of an electronic device provided by an embodiment of the present invention;

图14为本发明实施例提供的一种电子设备的结构示意图之二；FIG. 14 is the second structural schematic diagram of an electronic device provided by an embodiment of the present invention;

图15为本发明实施例提供的一种电子设备的结构示意图之三；FIG. 15 is the third structural schematic diagram of an electronic device provided by an embodiment of the present invention;

图16为本发明实施例提供的一种电子设备的结构示意图之四；FIG. 16 is a fourth schematic structural diagram of an electronic device provided by an embodiment of the present invention;

图17为本发明实施例提供的一种电子设备的结构示意图之五；Fig. 17 is the fifth structural schematic diagram of an electronic device provided by an embodiment of the present invention;

图18为本发明实施例提供的一种电子设备的结构示意图之六；FIG. 18 is a sixth schematic structural diagram of an electronic device provided by an embodiment of the present invention;

图19为本发明实施例提供的一种电子设备的硬件示意图。FIG. 19 is a schematic diagram of hardware of an electronic device provided by an embodiment of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

本发明实施例的说明书和权利要求书中的术语“第一”和“第二”等是用于区别不同的对象，而不是用于描述对象的特定顺序。例如，第一特征点信息和第二特征点信息等是用于区别不同的特征点信息，而不是用于描述特征点信息的特定顺序。The terms "first" and "second" in the description and claims of the embodiments of the present invention are used to distinguish different objects, rather than to describe a specific sequence of objects. For example, the first feature point information and the second feature point information are used to distinguish different feature point information, rather than describing a specific sequence of feature point information.

在本发明实施例的描述中，除非另有说明，“多个”的含义是指两个或两个以上。例如，多个元件是指两个元件或两个以上元件。In the description of the embodiments of the present invention, unless otherwise specified, "plurality" means two or more. For example, a plurality of elements means two or more elements.

本文中术语“和/或”，是一种描述关联对象的关联关系，表示可以存在三种关系，例如，显示面板和/或背光，可以表示：单独存在显示面板，同时存在显示面板和背光，单独存在背光这三种情况。本文中符号“/”表示关联对象是或者的关系，例如输入/输出表示输入或者输出。The term "and/or" in this article is an association relationship describing associated objects, which means that there may be three relationships, for example, the display panel and/or backlight may indicate: a display panel exists alone, a display panel and a backlight exist at the same time, There are three cases of backlight alone. Herein, the symbol "/" indicates that the associated object is an OR relationship, for example, input/output indicates input or output.

在本发明实施例中，“示例性的”或者“例如”等词用于表示作例子、例证或说明。本发明实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言，使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。In the embodiments of the present invention, words such as "exemplary" or "for example" are used as examples, illustrations or illustrations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present invention shall not be construed as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.

本发明实施例提供一种图像处理方法，应用于电子设备，电子设备可以获取第一特征点信息(该第一特征信点息包括第一人脸图像的特征点的信息)，并根据该第一特征点信息，确定第一人脸图像中的目标特征点的移动参数，从而以基于该移动参数，移动第一人脸图像的特征点。由于电子设备可以直接基于根据第一特征点信息确定的移动参数，移动第一人脸图像的特征点，以调整第一人脸图像，从而得到比较对称的人脸图像，而无需用户多次调整电子设备的拍摄角度以进行多次拍摄，如此可以在提升电子设备的拍摄效果的同时，简化用户拍摄过程的操作且节省耗时，从而可以提高电子设备拍摄过程的效率。An embodiment of the present invention provides an image processing method, which is applied to an electronic device. The electronic device can acquire first feature point information (the first feature information point information includes feature point information of a first human face image), and according to the first feature point information, The feature point information determines the movement parameter of the target feature point in the first human face image, so as to move the feature point of the first human face image based on the movement parameter. Since the electronic device can directly move the feature points of the first face image based on the movement parameters determined according to the first feature point information to adjust the first face image, thereby obtaining a more symmetrical face image without the need for multiple adjustments by the user The shooting angle of the electronic device can be used for multiple shooting, so that while improving the shooting effect of the electronic device, the operation of the user's shooting process can be simplified and time-consuming can be saved, thereby improving the efficiency of the shooting process of the electronic device.

本发明实施例提供的图像处理方法及电子设备，可以应用于电子设备处理人脸图像的过程。具体的，可以应用于电子设备根据人脸图像的特征点的信息，调整该人脸图像的过程。The image processing method and electronic device provided by the embodiments of the present invention can be applied to the process of processing human face images by the electronic device. Specifically, it can be applied to a process in which an electronic device adjusts the face image according to information of feature points of the face image.

本发明实施例中的电子设备可以为具有操作系统的电子设备。该操作系统可以为安卓(Android)操作系统，可以为ios操作系统，还可以为其他可能的操作系统，本发明实施例不作具体限定。The electronic device in this embodiment of the present invention may be an electronic device with an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present invention.

下面以安卓操作系统为例，介绍一下本发明实施例提供的图像处理方法所应用的软件环境。The following uses the Android operating system as an example to introduce the software environment applied to the image processing method provided by the embodiment of the present invention.

如图1所示，为本发明实施例提供的一种可能的安卓操作系统的架构示意图。在图1中，安卓操作系统的架构包括4层，分别为：应用程序层、应用程序框架层、系统运行库层和内核层(具体可以为Linux内核层)。As shown in FIG. 1 , it is a schematic structural diagram of a possible Android operating system provided by an embodiment of the present invention. In FIG. 1 , the architecture of the Android operating system includes four layers, namely: an application layer, an application framework layer, a system runtime layer and a kernel layer (specifically, the Linux kernel layer).

其中，应用程序层包括安卓操作系统中的各个应用程序(包括系统应用程序和第三方应用程序)。Wherein, the application program layer includes various application programs (including system application programs and third-party application programs) in the Android operating system.

应用程序框架层是应用程序的框架，开发人员可以在遵守应用程序的框架的开发原则的情况下，基于应用程序框架层开发一些应用程序。The application program framework layer is the application program framework, and developers can develop some applications based on the application program framework layer while complying with the development principles of the application program framework layer.

系统运行库层包括库(也称为系统库)和安卓操作系统运行环境。库主要为安卓操作系统提供其所需的各类资源。安卓操作系统运行环境用于为安卓操作系统提供软件环境。The system runtime layer includes libraries (also called system libraries) and the Android operating system runtime environment. The library mainly provides various resources required by the Android operating system. The Android operating system operating environment is used to provide a software environment for the Android operating system.

内核层是安卓操作系统的操作系统层，属于安卓操作系统软件层次的最底层。内核层基于Linux内核为安卓操作系统提供核心系统服务和与硬件相关的驱动程序。The kernel layer is the operating system layer of the Android operating system and belongs to the bottom layer of the Android operating system software layer. The kernel layer provides core system services and hardware-related drivers for the Android operating system based on the Linux kernel.

以安卓操作系统为例，本发明实施例中，开发人员可以基于上述如图1所示的安卓操作系统的系统架构，开发实现本发明实施例提供的图像处理方法的软件程序，从而使得该图像处理方法可以基于如图1所示的安卓操作系统运行。即处理器或者电子设备可以通过在安卓操作系统中运行该软件程序实现本发明实施例提供的图像处理方法。Taking the Android operating system as an example, in the embodiment of the present invention, developers can develop a software program that implements the image processing method provided in the embodiment of the present invention based on the system architecture of the Android operating system shown in Figure 1 above, so that the image The processing method can be run based on the Android operating system as shown in FIG. 1 . That is, the processor or the electronic device can implement the image processing method provided by the embodiment of the present invention by running the software program in the Android operating system.

本发明实施例中的电子设备可以为移动电子设备，也可以为非移动电子设备。示例性的，移动电子设备可以为移动终端设备，例如手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本或者个人数字助理(personal digital assistant，PDA)等，非移动电子设备可以为非移动终端设备，例如个人计算机(personal computer，PC)、电视机(television，TV)、柜员机或者自助机等，本发明实施例不作具体限定。The electronic device in the embodiment of the present invention may be a mobile electronic device, or may be a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile terminal device, such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal Digital assistant (personal digital assistant, PDA), etc., non-mobile electronic equipment can be non-mobile terminal equipment, such as personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., the embodiment of the present invention Not specifically limited.

下面结合附图，通过具体的实施例及其应用场景对本发明实施例提供的一种图像处理方法及电子设备进行详细地说明。An image processing method and an electronic device provided by the embodiments of the present invention will be described in detail below through specific embodiments and application scenarios with reference to the accompanying drawings.

为了解决上述技术问题，本发明实施例提供的一种图像处理方法，图2示出了本发明实施例提供的一种图像处理方法的流程图，该方法可以应用于具有如图1所示的安卓操作系统的电子设备。如图2所示，本发明实施例提供的图像处理方法可以包括下述的步骤201至步骤204。In order to solve the above technical problems, an image processing method provided by an embodiment of the present invention, Fig. 2 shows a flow chart of an image processing method provided by an embodiment of the present invention, this method can be applied to the image processing method as shown in Fig. 1 Electronic devices with Android operating system. As shown in FIG. 2 , the image processing method provided by the embodiment of the present invention may include the following steps 201 to 204 .

步骤201、电子设备识别目标图像中第一人脸图像的第一特征点信息。Step 201. The electronic device identifies first feature point information of a first human face image in a target image.

可选的，本发明实施例中，在拍摄预览界面显示目标图像的情况下，电子设备可以识别该目标图像中的第一人脸图像，以获取第一特征点信息。Optionally, in this embodiment of the present invention, when the target image is displayed on the shooting preview interface, the electronic device may identify the first human face image in the target image, so as to obtain the first feature point information.

具体的，电子设备可以对拍摄预览界面显示的目标图像进行人脸检测，以确定该目标图像中是否包括人脸图像，并在确定该目标图像中包括人脸图像(例如第一人脸图像)的情况下，识别该人脸图像的第一特征点信息。Specifically, the electronic device may perform face detection on the target image displayed on the shooting preview interface to determine whether the target image includes a human face image, and determine whether the target image includes a human face image (for example, the first human face image) In the case of , identify the first feature point information of the face image.

可选的，本发明实施例中，用户可以通过在电子设备的应用程序(例如相机应用程序)中进行拍照输入，以触发电子设备采集目标图像，并在电子设备的拍摄预览界面显示该目标图像。Optionally, in the embodiment of the present invention, the user can trigger the electronic device to capture the target image by taking a picture in the application program (such as the camera application program) of the electronic device, and display the target image on the shooting preview interface of the electronic device .

可选的，本发明实施例中，上述第一人脸图像可以包括至少一个人脸图像。Optionally, in this embodiment of the present invention, the first human face image may include at least one human face image.

可选的，本发明实施例中，上述第一特征点信息可以为第一人脸图像的特征点的坐标信息，该坐标信息可以为第一人脸图像的特征点在默认坐标系上的坐标值，该默认坐标系为电子设备的显示屏上的坐标系。Optionally, in the embodiment of the present invention, the above-mentioned first feature point information may be the coordinate information of the feature points of the first face image, and the coordinate information may be the coordinates of the feature points of the first face image on the default coordinate system value, the default coordinate system is the coordinate system on the display screen of the electronic device.

可选的，本发明实施例中，上述第一特征点信息还可以包括以下至少一项：第一人脸图像的人脸倾斜角度值和第一人脸图像的特征点的置信度值。其中，第一人脸图像的人脸倾斜角度值可以理解为：第一人脸图像的正脸图像所在平面与电子设备的显示屏所在平面之间的角度值。Optionally, in this embodiment of the present invention, the above-mentioned first feature point information may further include at least one of the following: a face inclination angle value of the first face image and a confidence value of the feature point of the first face image. Wherein, the face inclination angle value of the first face image can be understood as: the angle value between the plane where the front face image of the first face image is located and the plane where the display screen of the electronic device is located.

示例性的，以电子设备为手机为例进行说明。用户在手机的相册应用程序中进行拍照输入之后，如图3中的(A)所示，手机可以在拍摄预览界面10上显示采集的人脸图像11，然后手机可以获取该人脸图像11的特征点的信息，该人脸图像11的特征点的分布情况如图3中的(B)所示。Exemplarily, the electronic device is a mobile phone as an example for description. After the user takes a photo in the photo album application program of the mobile phone, as shown in (A) in Figure 3, the mobile phone can display the collected face image 11 on the shooting preview interface 10, and then the mobile phone can obtain the face image 11. The information of the feature points, the distribution of the feature points of the face image 11 is shown in (B) in FIG. 3 .

需要说明的是，上述第一人脸图像的特征点可以理解为第一人脸图像在显示屏上的一些像素点，且这些像素点可以反映第一人脸图像的轮廓特征。It should be noted that the aforementioned feature points of the first human face image may be understood as some pixel points of the first human face image on the display screen, and these pixel points may reflect contour features of the first human face image.

步骤202、电子设备根据第一特征点信息，确定第一人脸图像中的目标特征点的移动参数。Step 202, the electronic device determines the moving parameters of the target feature points in the first face image according to the first feature point information.

本发明实施例中，上述移动参数包括目标移动方向和目标移动距离。In the embodiment of the present invention, the above-mentioned moving parameters include the moving direction of the target and the moving distance of the target.

可以理解，本发明实施例中，上述目标移动方向为第一人脸图像中的目标特征点的移动方向，目标移动距离为第一人脸图像中的目标特征点的移动距离。It can be understood that in the embodiment of the present invention, the target moving direction is the moving direction of the target feature point in the first face image, and the target moving distance is the moving distance of the target feature point in the first face image.

可选的，本发明实施例中，在电子设备检测第一人脸图像的人脸倾斜角度值在预设角度值范围内的情况下，电子设备可以根据第一特征点信息，确定目标特征点的移动参数。Optionally, in this embodiment of the present invention, when the electronic device detects that the face inclination angle value of the first face image is within a preset angle value range, the electronic device may determine the target feature point according to the first feature point information the movement parameters.

可选的，本发明实施例中，在电子设备检测第一人脸图像的特征点的置信度值大于或等于预设置信度值的情况下，电子设备可以根据第一特征点信息，确定第一人脸图像中的目标特征点的移动参数。Optionally, in this embodiment of the present invention, when the electronic device detects that the confidence value of the feature points of the first face image is greater than or equal to a preset confidence value, the electronic device may determine the first feature point information according to the first face image. A moving parameter of a target feature point in a face image.

可选的，本发明实施例中，结合图2，如图4所示，上述步骤202具体可以通过下述的步骤202a和步骤202b实现。Optionally, in this embodiment of the present invention, with reference to FIG. 2 , as shown in FIG. 4 , the foregoing step 202 may specifically be implemented through the following steps 202a and 202b.

步骤202a、电子设备根据第一特征点信息，确定目标中轴线。Step 202a, the electronic device determines the target central axis according to the first feature point information.

本发明实施例中，上述目标中轴线为第一人脸图像中的第一特征点和第二特征点的连线。In the embodiment of the present invention, the target central axis is a line connecting the first feature point and the second feature point in the first face image.

可选的，本发明实施例中，电子设备可以检测第一人脸图像，以确定该第一人脸图像对应的人脸中的各个部位在该第一人脸图像上的分布情况(例如坐标信息)，从而从该第一人脸图像的特征点中确定人脸中的两个目标部位分别对应的特征点(即第一特征点和第二特征点)。Optionally, in this embodiment of the present invention, the electronic device may detect the first human face image to determine the distribution of each part of the human face corresponding to the first human face image on the first human face image (such as coordinates information), so as to determine the feature points corresponding to the two target parts in the face (ie, the first feature point and the second feature point) from the feature points of the first face image.

可选的，本发明实施例中，上述两个目标部位可以为人脸中的下巴部位和鼻子部位，上述第一特征点和第二特征点可以为第一人脸图像的特征点中下巴部位对应的特征点和鼻子部位对应的特征点。Optionally, in the embodiment of the present invention, the above two target parts may be the chin part and the nose part in the human face, and the above-mentioned first feature point and the second feature point may be corresponding to the chin part in the feature points of the first face image. The feature points of and the feature points corresponding to the nose part.

示例性的，结合图3中的(B)，如图5所示，手机可以根据人脸图像11中的特征点的分布情况，从人脸图像11中的特征点中选取第一特征点和第二特征点(例如下巴部位对应的特征点B₁和鼻子部位对应的特征点B₂)，并将该第一特征点和第二特征点的连线12确定为目标中轴线。Exemplarily, in conjunction with (B) in FIG. 3 , as shown in FIG. 5 , the mobile phone can select the first feature point and The second feature point (for example, the feature point B₁ corresponding to the chin and the feature point B₂ corresponding to the nose), and the line 12 connecting the first feature point and the second feature point is determined as the target central axis.

步骤202b、电子设备根据目标中轴线，确定移动参数。Step 202b, the electronic device determines movement parameters according to the target central axis.

可选的，本发明实施例中，电子设备可以根据目标中轴线，确定第一人脸图像在目标中轴线两侧分布的图像的尺寸情况，并根据该图像的尺寸情况确定第一人脸图像的特征点的移动参数。Optionally, in this embodiment of the present invention, the electronic device may determine, according to the central axis of the target, the size of the image of the first face image distributed on both sides of the central axis of the target, and determine the size of the first human face image according to the size of the image The moving parameters of the feature points.

可选的，本发明实施例中，结合图4，如图6所示，上述步骤202b具体可以通过下述的步骤202c至步骤202e实现。Optionally, in this embodiment of the present invention, referring to FIG. 4 , as shown in FIG. 6 , the above step 202b may specifically be implemented through the following steps 202c to 202e.

步骤202c、电子设备获取第一距离和第二距离。Step 202c, the electronic device obtains the first distance and the second distance.

本发明实施例中，上述第一距离为第三特征点与目标中轴线之间的距离，第二距离为第四特征点与目标中轴线之间的距离，该第三特征点和第四特征点相对于目标中轴线相对应。In the embodiment of the present invention, the above-mentioned first distance is the distance between the third feature point and the target central axis, and the second distance is the distance between the fourth feature point and the target central axis. The third feature point and the fourth feature The points correspond relative to the target central axis.

可以理解，上述第三特征点和第四特征点对应分布在目标中轴线的两侧。It can be understood that the above-mentioned third feature point and fourth feature point are correspondingly distributed on both sides of the central axis of the target.

可选的，本发明实施例中，上述第三特征点可以包括第一人脸图像的特征点中的至少一个第五特征点，该至少一个第五特征点位于目标中轴线的同一侧(例如下述实施例中的第一侧)。上述第四特征点可以包括第一人脸图像的特征点中的至少一个第六特征点，该至少一个第六特征点位于目标中轴线的同一侧(例如下述实施例中的第二侧)。Optionally, in this embodiment of the present invention, the above-mentioned third feature point may include at least one fifth feature point among the feature points of the first face image, and the at least one fifth feature point is located on the same side of the target central axis (for example, the first side in the following examples). The above-mentioned fourth feature point may include at least one sixth feature point among the feature points of the first face image, and the at least one sixth feature point is located on the same side of the target central axis (such as the second side in the following embodiments) .

可以理解，电子设备可以从目标中轴线的第一侧的所有特征点中，选取至少一个第五特征点，并从目标中轴线的第二侧的所有特征点中，选取至少一个第六特征点，然后再根据该至少一个第五特征点和至少一个第六特征点，计算得到第一距离和第二距离。It can be understood that the electronic device may select at least one fifth characteristic point from all the characteristic points on the first side of the target central axis, and select at least one sixth characteristic point from all the characteristic points on the second side of the target central axis , and then calculate the first distance and the second distance according to the at least one fifth feature point and the at least one sixth feature point.

可选的，本发明实施例中，电子设备可以基于默认坐标系，获取第三特征点的坐标信息、第四特征点的坐标信息以及目标中轴线的坐标信息，并根据第三特征点的坐标信息和目标中轴线的坐标信息计算得到第一距离，以及根据第四特征点的坐标信息和目标中轴线的坐标信息计算得到第二距离。Optionally, in this embodiment of the present invention, the electronic device may obtain the coordinate information of the third feature point, the coordinate information of the fourth feature point, and the coordinate information of the target central axis based on the default coordinate system, and based on the coordinate information of the third feature point The information and the coordinate information of the target central axis are calculated to obtain the first distance, and the second distance is calculated according to the coordinate information of the fourth feature point and the coordinate information of the target central axis.

可选的，本发明实施例中，上述第三特征点包括一个第五特征点，且第四特征点包括一个第六特征点，上述第一距离为该一个第五特征点与目标中轴线之间的距离，第二距离为该一个第六特征点与目标中轴线之间的距离。Optionally, in this embodiment of the present invention, the above-mentioned third feature point includes a fifth feature point, and the fourth feature point includes a sixth feature point, and the above-mentioned first distance is the distance between the fifth feature point and the target central axis The second distance is the distance between the sixth feature point and the central axis of the target.

可选的，本发明实施例中，上述第三特征点包括至少两个第五特征点，且第四特征点包括至少两个第六特征点，上述第一距离可以为按照预设算法，根据每个第五特征点与目标中轴线之间的距离计算得到的值，第二距离可以为按照预设算法，根据每个第六特征点与目标中轴线之间的距离计算得到的值。Optionally, in this embodiment of the present invention, the above-mentioned third feature point includes at least two fifth feature points, and the fourth feature point includes at least two sixth feature points, and the above-mentioned first distance can be according to a preset algorithm, according to The value obtained by calculating the distance between each fifth feature point and the target central axis, and the second distance may be a value calculated according to the distance between each sixth feature point and the target central axis according to a preset algorithm.

可选的，本发明实施例中，上述预设算法可以为均值算法、方差算法或者标准差算法等。Optionally, in this embodiment of the present invention, the preset algorithm may be a mean value algorithm, a variance algorithm, or a standard deviation algorithm.

可选的，本发明实施例中，上述第一距离可以为每个第五特征点与目标中轴线之间的距离的均值，第二距离可以为每个第六特征点与目标中轴线之间的距离的均值。Optionally, in this embodiment of the present invention, the above-mentioned first distance may be the mean value of the distance between each fifth feature point and the target central axis, and the second distance may be the distance between each sixth feature point and the target central axis The mean value of the distance.

可选的，本发明实施例中，上述预设算法可以为均值算法A为第一距离(或第二距离)，P_i为第三特征点(包括m个第五特征点，m为大于1的整数)中的第i个第五特征点的坐标信息(或第四特征点(包括m个第六特征点)中的第i个第六特征点的坐标信息)，L为目标中轴线的坐标信息。Optionally, in the embodiment of the present invention, the above-mentioned preset algorithm may be a mean value algorithm A is the first distance (or the second distance), Pi is the coordinate information of the_i -th fifth feature point (or the fifth feature point) in the third feature point (including m fifth feature points, m is an integer greater than 1). The coordinate information of the i-th sixth feature point among the four feature points (including m sixth feature points), L is the coordinate information of the central axis of the target.

示例性的，结合图5，如图7所示，假设第三特征点为人脸图像11的特征点中分布在目标中轴线(即直线12)的一侧(例如左侧)的三个特征点(例如特征点B₃、特征点B₄和特征点B₅)，其中，特征点B₃与直线12之间的距离为a，特征点B₄与直线12之间的距离为b，特征点B₅与直线12之间的距离为c，则电子设备可以按照均值算法，计算得到第一距离Exemplarily, in conjunction with FIG. 5, as shown in FIG. 7, it is assumed that the third feature point is three feature points distributed on one side (for example, the left side) of the target central axis (ie, the straight line 12) among the feature points of the face image 11 (such as feature point B₃ , feature point B₄ and feature point B₅ ), wherein, the distance between feature point B₃ and line 12 is a, the distance between feature point B₄ and line 12 is b, feature point The distance between B₅ and the straight line 12 is c, then the electronic device can calculate the first distance according to the mean value algorithm

步骤202d、电子设备根据第一距离和第二距离的比值，确定目标移动距离。Step 202d, the electronic device determines the target moving distance according to the ratio of the first distance to the second distance.

可选的，本发明实施例中，上述目标移动距离包括第一移动距离和第二移动距离。上述步骤202d具体可以通过下述的步骤202f实现。Optionally, in this embodiment of the present invention, the foregoing target moving distance includes a first moving distance and a second moving distance. The above step 202d can be specifically implemented through the following step 202f.

步骤202f、电子设备根据第一距离和第二距离的比值，确定第一移动距离和第二移动距离。Step 202f, the electronic device determines the first moving distance and the second moving distance according to the ratio of the first distance to the second distance.

本发明实施例中，上述第一移动距离为第一特征点集合的移动距离，该第一特征点集合包括第一人脸图像中第一侧的所有特征点，该第一侧为第三特征点相对于目标中轴线所在的一侧。In the embodiment of the present invention, the above-mentioned first moving distance is the moving distance of the first feature point set, the first feature point set includes all feature points on the first side of the first face image, and the first side is the third feature point. The side of the point relative to the center axis of the target.

本发明实施例中，上述第二移动距离为第二特征点集合的移动距离，该第二特征点集合包括第一人脸图像中第二侧的所有特征点，该第二侧为第四特征点相对于目标中轴线所在的一侧。In the embodiment of the present invention, the second moving distance is the moving distance of the second feature point set, the second feature point set includes all feature points on the second side of the first face image, and the second side is the fourth feature point. The side of the point relative to the center axis of the target.

可选的，本发明实施例中，上述第一移动距离和第二移动距离的比值，与第一距离和第二距离的比值成反比。可以理解，上述第一移动距离可以与第二距离相同，且第二移动距离可以与第一距离相同。Optionally, in the embodiment of the present invention, the ratio of the above-mentioned first moving distance to the second moving distance is inversely proportional to the ratio of the first distance to the second distance. It can be understood that the above-mentioned first moving distance may be the same as the second distance, and the second moving distance may be the same as the first distance.

步骤202e、电子设备根据第一距离和第二距离的大小关系，确定目标移动方向。Step 202e, the electronic device determines the moving direction of the target according to the size relationship between the first distance and the second distance.

可选的，本发明实施例中，上述步骤202e具体可以通过下述的步骤202g或步骤202h实现。Optionally, in the embodiment of the present invention, the above step 202e may be specifically implemented through the following step 202g or step 202h.

步骤202g、若第一距离大于第二距离，则电子设备将第一方向确定为目标移动方向。Step 202g, if the first distance is greater than the second distance, the electronic device determines the first direction as the target moving direction.

本发明实施例中，上述第一方向为第三特征点朝向目标中轴线的方向，且该第一方向与目标中轴线所在方向垂直。In the embodiment of the present invention, the above-mentioned first direction is a direction in which the third feature point faces the central axis of the target, and the first direction is perpendicular to the direction where the central axis of the target is located.

需要说明的是，若第一距离大于第二距离，则电子设备可以确定第一人脸图像在目标中轴线两侧分布的图像的尺寸不同，且第一人脸图像在目标中轴线的第一侧分布的图像的尺寸大于第一人脸图像在目标中轴线的第二侧分布的图像的尺寸。It should be noted that if the first distance is greater than the second distance, the electronic device may determine that the sizes of the images distributed on both sides of the target central axis by the first human face image are different, and the first human face image is at the first distance from the target central axis. The size of the images distributed on the side is larger than the size of the images distributed on the second side of the target central axis of the first human face image.

可以理解，电子设备可以基于目标移动方向(即第一方向)移动第一人脸图像的特征点，以使得第一侧的所有特征点靠近目标中轴线，且第二侧的所有特征点远离目标中轴线，从而以调整第一人脸图像在目标中轴线两侧分布的图像的尺寸。It can be understood that the electronic device can move the feature points of the first face image based on the moving direction of the target (that is, the first direction), so that all the feature points on the first side are close to the central axis of the target, and all the feature points on the second side are far away from the target The central axis, so as to adjust the size of the first human face image distributed on both sides of the target central axis.

本发明实施例中，上述目标移动方向可以为第一特征点集合的移动方向和第二特征点集合的移动方向。In the embodiment of the present invention, the target moving direction may be the moving direction of the first feature point set and the moving direction of the second feature point set.

示例性的，结合图5，如图8所示，假设第三特征点为人脸图像11的特征点中分布在目标中轴线(即直线12)的一侧(例如左侧)的特征点B₃，第四特征点为人脸图像11的特征点中分布在直线12的一侧(例如右侧)的特征点B₆，且特征点B₃与直线12之间的距离(即第一距离)为a，特征点B₆与直线12之间的距离(即第一距离)为d，若a>d，则手机可以将方向13(即特征点B₃朝向直线12、且与该直线12垂直的方向)确定为目标移动方向。Exemplarily, in conjunction with FIG. 5, as shown in FIG. 8, it is assumed that the third feature point is a feature point B3 distributed on one side (for example, the left side) of the target central axis (ie, the straight line 12) among the feature points of the face image₁₁ , the fourth feature point is the feature point B₆ distributed on one side (for example, the right side) of the straight line 12 among the feature points of the face image 11, and the distance between the feature point B₃ and the straight line 12 (ie, the first distance) is a, the distance between the feature point B₆ and the straight line 12 (that is, the first distance) is d, if a>d, then the mobile phone can direct the direction 13 (that is, the feature point B₃ toward the straight line 12 and perpendicular to the straight line 12) direction) is determined as the target movement direction.

步骤202h、若第一距离小于第二距离，则电子设备将第二方向确定为目标移动方向。Step 202h, if the first distance is smaller than the second distance, the electronic device determines the second direction as the target moving direction.

本发明实施例中，上述第二方向为第四特征点朝向目标中轴线的方向，且该第二方向与目标中轴线所在方向垂直。In the embodiment of the present invention, the above-mentioned second direction is a direction in which the fourth feature point faces the central axis of the target, and the second direction is perpendicular to the direction of the central axis of the target.

需要说明的是，若第一距离小于第二距离，则电子设备可以确定第一人脸图像在目标中轴线两侧分布的图像的尺寸不同，且第一人脸图像在目标中轴线的第二侧分布的图像的尺寸大于第一人脸图像在目标中轴线的第一侧分布的图像的尺寸。It should be noted that if the first distance is smaller than the second distance, the electronic device may determine that the sizes of the images distributed on both sides of the target central axis of the first face image are different, and the first face image is located at the second distance of the target central axis. The size of the side distribution image is larger than the size of the first human face image distribution on the first side of the target central axis.

可以理解，电子设备可以基于目标移动方向(即第二方向)移动第一人脸图像的特征点，以使得第二侧的所有特征点靠近目标中轴线，且第一侧的所有特征点远离目标中轴线，从而以调整第一人脸图像在目标中轴线两侧分布的图像的尺寸。It can be understood that the electronic device can move the feature points of the first face image based on the moving direction of the target (that is, the second direction), so that all the feature points on the second side are close to the central axis of the target, and all the feature points on the first side are far away from the target The central axis, so as to adjust the size of the first human face image distributed on both sides of the target central axis.

可选的，本发明实施例中，若第一距离等于第二距离，则电子设备可以不移动第一人脸图像的特征点。Optionally, in this embodiment of the present invention, if the first distance is equal to the second distance, the electronic device may not move the feature points of the first human face image.

步骤203、电子设备基于移动参数，在目标图像中移动目标特征点，并生成目标显示图像。Step 203, the electronic device moves the target feature points in the target image based on the movement parameters, and generates a target display image.

本发明实施例中，电子设备可以控制第一人脸图像中的目标特征点，沿着目标移动方向移动目标移动距离。In the embodiment of the present invention, the electronic device may control the target feature points in the first face image, and move the target moving distance along the target moving direction.

可选的，本发明实施例中，电子设备基于第一移动距离、第二移动距离以及目标移动方向，移动第一人脸图像中的目标特征点，并生成目标显示图像。Optionally, in this embodiment of the present invention, the electronic device moves the target feature points in the first face image based on the first moving distance, the second moving distance, and the target moving direction, and generates a target display image.

可选的，本发明实施例中，电子设备可以控制第一特征点集合，沿着目标移动方向移动第一移动距离，并控制第二特征点集合，沿着目标移动方向移动第二移动距离。Optionally, in this embodiment of the present invention, the electronic device may control the first feature point set to move a first moving distance along the target moving direction, and control the second feature point set to move a second moving distance along the target moving direction.

可选的，本发明实施例中，上述目标特征点可以为第一人脸图像中的所有特征点。Optionally, in this embodiment of the present invention, the aforementioned target feature points may be all feature points in the first face image.

可以理解，电子设备控制第一特征点集合，沿着目标移动方向移动第一移动距离，并控制第二特征点集合，沿着目标移动方向移动第二移动距离，可以使得第一人脸图像在目标中轴线两侧分布的图像的尺寸之间的差值在预设范围内(例如使得第一人脸图像在目标中轴线两侧分布的图像的尺寸相同)，即使得第一人脸图像相对于目标中轴线对称分布。It can be understood that the electronic device controls the first feature point set to move the first moving distance along the target moving direction, and controls the second feature point set to move the second moving distance along the target moving direction, so that the first face image can be The difference between the sizes of the images distributed on both sides of the central axis of the target is within a preset range (such as making the first face image the same size as the images distributed on both sides of the central axis of the target), even if the first human face image is relatively Symmetrically distributed about the central axis of the target.

可选的，本发明实施例中，结合图2，如图9所示，上述步骤203具体可以通过下述的步骤203a至步骤203c实现。Optionally, in this embodiment of the present invention, with reference to FIG. 2 , as shown in FIG. 9 , the foregoing step 203 may specifically be implemented through the following steps 203a to 203c.

步骤203a、电子设备基于移动参数，在目标图像中移动目标特征点，并根据第一特征点信息，生成第一模型。Step 203a, the electronic device moves the target feature points in the target image based on the movement parameters, and generates a first model according to the first feature point information.

本发明实施例中，上述第一模型可以为第一人脸图像的特征点的连线构成的模型。In the embodiment of the present invention, the above-mentioned first model may be a model formed by connecting lines of feature points of the first face image.

可选的，本发明实施例中，电子设备可以采用二维图像的三角剖分算法，生成第一模型。Optionally, in this embodiment of the present invention, the electronic device may use a triangulation algorithm of a two-dimensional image to generate the first model.

需要说明的是，上述三角剖分算法是指：根据采集的人脸图像的特征点生成多个三角形，以形成三角形网格(或三角形模型)。可以理解，上述第一模型可以为三角形模型。It should be noted that the above-mentioned triangulation algorithm refers to generating a plurality of triangles according to the feature points of the collected face image to form a triangle mesh (or triangle model). It can be understood that the above-mentioned first model may be a triangular model.

可以理解，电子设备可以采用三角剖分算法，将第一人脸图像的所有特征点进行连线，以得到第一模型。It can be understood that the electronic device may use a triangulation algorithm to connect all the feature points of the first face image to obtain the first model.

示例性的，结合图3中的(B)，如图10所示，手机可以根据人脸图像11的特征点的信息，采用三角剖分算法，将人脸图像11的所有特征点进行连线，以生成第一模型(例如三角形网格14)。Exemplarily, in conjunction with (B) in FIG. 3 , as shown in FIG. 10 , the mobile phone can use the triangulation algorithm to connect all the feature points of the face image 11 according to the information of the feature points of the face image 11 , to generate the first model (eg, triangular mesh 14).

步骤203b、电子设备根据第二特征点信息，生成第二模型。Step 203b, the electronic device generates a second model according to the second feature point information.

本发明实施例中，上述第二特征点信息为第一人脸图像的移动后的特征点的信息，第二模型可以为第一人脸图像的移动后的特征点的连线构成的模型。In the embodiment of the present invention, the above-mentioned second feature point information is the information of the moved feature points of the first face image, and the second model may be a model formed by connecting lines of the moved feature points of the first face image.

可选的，本发明实施例中，电子设备可以采用三角剖分算法，生成第二模型。可以理解，上述第二模型可以为三角形模型。Optionally, in this embodiment of the present invention, the electronic device may use a triangulation algorithm to generate the second model. It can be understood that the above second model may be a triangular model.

可以理解，电子设备可以采用三角剖分算法，将第一人脸图像的移动后的所有特征点进行连线，以得到第二模型。It can be understood that the electronic device may use a triangulation algorithm to connect all the moved feature points of the first face image to obtain the second model.

步骤203c、电子设备基于第一模型和第二模型，生成目标显示图像。Step 203c, the electronic device generates a target display image based on the first model and the second model.

可选的，本发明实施例中，电子设备可以采用二维图像的三角形变形算法(例如错切-变形(shear-warp)算法)，基于第一模型和第二模型，生成第二人脸图像，以生成目标显示图像。Optionally, in this embodiment of the present invention, the electronic device may use a triangular deformation algorithm of a two-dimensional image (such as a shear-warp algorithm) to generate a second face image based on the first model and the second model , to generate the target display image.

可选的，本发明实施例中，电子设备在目标图像中移动目标特征点之后，可以基于第一模型和第二模型，在目标图像中移动第一人脸图像中的其他像素点，以生成第二人脸图像，从而生成目标显示图像，该其他像素点为第一人脸图像中除目标特征点之外的像素点。Optionally, in this embodiment of the present invention, after the electronic device moves the target feature points in the target image, it can move other pixels in the first face image in the target image based on the first model and the second model, so as to generate the second The human face image, so as to generate the target display image, the other pixel points are the pixel points in the first human face image except the target feature points.

可以理解，电子设备可以将目标图像中的第一人脸图像更新为第二人脸图像，以得到目标显示图像。It can be understood that the electronic device may update the first human face image in the target image to the second human face image to obtain the target display image.

需要说明的是，上述三角形变形算法是指：将一个三角形模型中的每个三角形区域内的其他像素点(一个三角形区域内的其他像素点为该一个三角形区域内除特征点之外的像素点)，变形到另一个三角形模型中与该三角形区域对应的一个三角形区域内。It should be noted that the above-mentioned triangle deformation algorithm refers to: other pixels in each triangle area in a triangle model (other pixels in a triangle area are pixel points other than feature points in this triangle area ), deformed into a triangle area corresponding to this triangle area in another triangle model.

可选的，本发明实施例中，电子设备可以采用上述三角形变形算法，将第一模型中的每个第一三角形区域内的其他像素点，变形到第二模型中与该第一三角形区域对应的一个第二三角形区域内，以生成第二人脸图像。Optionally, in this embodiment of the present invention, the electronic device may adopt the above-mentioned triangle deformation algorithm to deform other pixels in each first triangular area in the first model to correspond to the first triangular area in the second model. In a second triangular area of , to generate a second face image.

具体的，针对第一模型中的一个第一三角形区域和第二模型中的与该一个第一三角形区域对应的第二三角形区域，电子设备可以根据该一个第一三角形区域的顶点坐标信息和该第二三角形区域的顶点坐标信息，得到变换矩阵，然后通过该变换矩阵将该一个第一三角形区域内的像素点逐一变换到该一个第二三角形区域内。Specifically, for a first triangular area in the first model and a second triangular area corresponding to the first triangular area in the second model, the electronic device may use the vertex coordinate information of the first triangular area and the The coordinate information of the vertices of the second triangular area is used to obtain a transformation matrix, and then the pixels in the first triangular area are transformed one by one into the second triangular area through the transformation matrix.

示例性的，以第一模型中的一个第一三角形区域(例如三角形区域C₁C₂C₃)以及第二模型中的一个第二三角形区域(例如三角形区域C₁′C₂′C₃′)为例进行说明。如图11所示，第一模型中的三角形区域C₁C₂C₃为由人脸图像11的特征点C₁、特征点C₂以及特征点C₃构成的三角形区域，第二模型中的三角形区域C₁′C₂′C₃′为由人脸图像11的移动后的特征点C₁′、特征点C₂′以及特征点C₃′构成的三角形区域，且特征点C₁与特征点C₁′对应，特征点C₂与特征点C₂′对应，以及特征点C₃与特征点C₃′对应；手机可以根据三角形区域C₁C₂C₃的顶点C₁的坐标值、顶点C₂的坐标值和顶点C₃的坐标值，以及三角形区域C₁′C₂′C₃′的顶点C₁′的坐标值、顶点C₂′的坐标值和顶点C₃′的坐标值，得到一个变换矩阵，并通过该变换矩阵，将三角形区域C₁C₂C₃内的像素点逐一变换到三角形区域C₁′C₂′C₃′内。Exemplarily, with a first triangular region (such as triangular region C₁ C₂ C₃ ) in the first model and a second triangular region (such as triangular region C₁ ′C₂ ′C₃ ′) in the second model ) as an example for illustration. As shown in Figure 11, the triangular area C₁ C₂ C₃ in the first model is a triangular area composed of the feature point C₁ , feature point C₂ and feature point C₃ of the face image 11, and the triangular area in the second model The triangular area C₁ ′C₂ ′C₃ ′ is a triangular area composed of the moved feature point C₁ ′, feature point C₂ ′, and feature point C₃ ′ of the face image 11, and the feature point C₁ and the feature point Point C₁ ′ corresponds, feature point C₂ corresponds to feature point C₂ ′, and feature point C₃ corresponds to feature point C₃ ′; the mobile phone can use the coordinate value of vertex C₁ of triangular area C₁ C₂ C₃ , The coordinate value of vertex C₂ and the coordinate value of vertex C₃ , and the coordinate value of vertex C₁ ′, the coordinate value of vertex C₂ ′ and the coordinate value of vertex C₃ ′ of the triangle area C₁ ′C₂ ′C₃ ′ , to obtain a transformation matrix, and through the transformation matrix, the pixels in the triangle area C₁ C₂ C₃ are transformed one by one into the triangle area C₁ ′C₂ ′C₃ ′.

可以理解，上述第二人脸图像在该第二人脸图像的中轴线两侧分布的图像的尺寸之间的差值在预设范围内(例如第二人脸图像在该第二人脸图像的中轴线两侧分布的图像的尺寸相同)，即第二人脸图像相对于该第二人脸图像的中轴线对称分布。It can be understood that the difference between the sizes of the images distributed on both sides of the central axis of the second human face image by the above-mentioned second human face image is within a preset range (for example, the second human face image is between the two sides of the second human face image The images distributed on both sides of the central axis have the same size), that is, the second human face images are distributed symmetrically with respect to the central axis of the second human face image.

可选的，本发明实施例中，在电子设备移动第一人脸图像的特征点之后，电子设备可以检测第一人脸图像在目标中轴线两侧的图像分布情况，若检测到第一人脸图像相对于目标中轴线不对称，则电子设备可以再次执行步骤201至步骤203，直至检测到第一人脸图像相对于目标中轴线对称分布。Optionally, in this embodiment of the present invention, after the electronic device moves the feature points of the first human face image, the electronic device may detect the image distribution of the first human face image on both sides of the target central axis. If the face image is asymmetrical with respect to the central axis of the target, the electronic device may perform steps 201 to 203 again until it detects that the first human face image is distributed symmetrically with respect to the central axis of the target.

本发明实施例中，电子设备可以根据第一模型和第二模型，快速地、精确地生成第二人脸图像，以生成目标显示图像。In the embodiment of the present invention, the electronic device can quickly and accurately generate the second face image according to the first model and the second model, so as to generate the target display image.

步骤204、电子设备显示目标显示图像。Step 204, the electronic device displays the target display image.

本发明实施例中，电子设备可以更新拍摄预览界面显示的目标图像，即将目标图像更新为目标显示图像。In the embodiment of the present invention, the electronic device may update the target image displayed on the shooting preview interface, that is, update the target image to the target display image.

示例性的，结合图3中的(A)，如图12所示，手机可以将拍摄预览界面10显示的目标图像(例如人脸图像11)更新为目标显示图像(例如人脸图像15)。Exemplarily, referring to (A) in FIG. 3 , as shown in FIG. 12 , the mobile phone may update the target image (such as the face image 11 ) displayed on the shooting preview interface 10 to the target display image (such as the face image 15 ).

本发明实施例提供一种图像处理方法，电子设备可以获取第一特征点信息(该第一特征信点息包括第一人脸图像的特征点的信息)，并根据该第一特征点信息，确定第一人脸图像中的目标特征点的移动参数，从而以基于该移动参数，移动第一人脸图像的特征点。由于电子设备可以直接基于根据第一特征点信息确定的移动参数，移动第一人脸图像的特征点，以调整第一人脸图像，从而得到比较对称的人脸图像，而无需用户多次调整电子设备的拍摄角度以进行多次拍摄，如此可以在提升电子设备的拍摄效果的同时，简化用户拍摄过程的操作且节省耗时，从而可以提高电子设备拍摄过程的效率。An embodiment of the present invention provides an image processing method, the electronic device can obtain the first feature point information (the first feature information point information includes the feature point information of the first face image), and according to the first feature point information, A moving parameter of the target feature point in the first human face image is determined, so as to move the feature point of the first human face image based on the moving parameter. Since the electronic device can directly move the feature points of the first face image based on the movement parameters determined according to the first feature point information to adjust the first face image, thereby obtaining a more symmetrical face image without the need for multiple adjustments by the user The shooting angle of the electronic device can be used for multiple shooting, so that while improving the shooting effect of the electronic device, the operation of the user's shooting process can be simplified and time-consuming can be saved, thereby improving the efficiency of the shooting process of the electronic device.

图13示出了本发明实施例中涉及的电子设备的一种可能的结构示意图。如图13所示，电子设备90可以包括：识别模块91、确定模块92、移动模块93、生成模块94和显示模块95。Fig. 13 shows a possible structural diagram of the electronic device involved in the embodiment of the present invention. As shown in FIG. 13 , the electronic device 90 may include: an identification module 91 , a determination module 92 , a movement module 93 , a generation module 94 and a display module 95 .

其中，识别模块91，用于识别目标图像中第一人脸图像的第一特征点信息。确定模块92，用于根据识别模块91识别的第一特征点信息，确定第一人脸图像中的目标特征点的移动参数，该移动参数包括目标移动方向和目标移动距离。移动模块93，用于基于确定模块92确定的移动参数，在目标图像中移动目标特征点。生成模块94，用于生成目标显示图像。显示模块95，用于显示生成模块94生成的目标显示图像。Wherein, the identifying module 91 is configured to identify the first feature point information of the first face image in the target image. The determination module 92 is configured to determine the movement parameters of the target feature points in the first face image according to the first feature point information identified by the identification module 91, the movement parameters including the target moving direction and the target moving distance. The moving module 93 is configured to move the target feature point in the target image based on the moving parameter determined by the determining module 92 . A generation module 94, configured to generate a target display image. The display module 95 is configured to display the target display image generated by the generation module 94 .

在一种可能的实现方式中，结合图13，如图14所示，上述确定模块92具体包括：第一确定子模块921和第二确定子模块922。其中，第一确定子模块921，用于根据第一特征点信息，确定目标中轴线，该目标中轴线为第一人脸图像中的第一特征点和第二特征点的连线。第二确定子模块922，用于根据第一确定子模块921确定的目标中轴线，确定移动参数。In a possible implementation manner, referring to FIG. 13 , as shown in FIG. 14 , the determination module 92 specifically includes: a first determination submodule 921 and a second determination submodule 922 . Wherein, the first determination sub-module 921 is configured to determine the target central axis according to the first feature point information, and the target central axis is a line connecting the first feature point and the second feature point in the first face image. The second determination sub-module 922 is configured to determine the moving parameter according to the target central axis determined by the first determination sub-module 921 .

在一种可能的实现方式中，结合图14，如图15所示，上述第二确定子模块922具体包括：第一获取子模块923、第三确定子模块924和第四确定子模块925。其中，第一获取子模块923，用于获取第一距离和第二距离，该第一距离为第三特征点与目标中轴线之间的距离，该第二距离为第四特征点与目标中轴线之间的距离，该第三特征点和第四特征点相对于目标中轴线相对应。第三确定子模块924，用于根据第一获取子模块923获取的第一距离和第二距离的比值，确定目标移动距离。第四确定子模块925，用于根据第一获取子模块923获取的第一距离和第二距离的大小关系，确定目标移动方向。In a possible implementation manner, referring to FIG. 14 , as shown in FIG. 15 , the second determination submodule 922 specifically includes: a first acquisition submodule 923 , a third determination submodule 924 and a fourth determination submodule 925 . Among them, the first acquisition sub-module 923 is used to acquire the first distance and the second distance, the first distance is the distance between the third feature point and the center axis of the target, and the second distance is the distance between the fourth feature point and the center axis of the target. The distance between the axes, the third feature point and the fourth feature point correspond to the target central axis. The third determination sub-module 924 is configured to determine the target moving distance according to the ratio of the first distance and the second distance acquired by the first acquisition sub-module 923 . The fourth determination sub-module 925 is configured to determine the moving direction of the target according to the magnitude relationship between the first distance and the second distance acquired by the first acquisition sub-module 923 .

在一种可能的实现方式中，上述目标移动距离包括第一移动距离和第二移动距离。结合图15，如图16所示，上述第三确定子模块924具体包括：第五确定子模块926。其中，第五确定子模块926，用于根据第一距离和第二距离的比值，确定第一移动距离和第二移动距离，该第一移动距离为第一特征点集合的移动距离，该第一特征点集合包括第一人脸图像中第一侧的所有特征点，该第一侧为第三特征点相对于目标中轴线所在的一侧，该第二移动距离为第二特征点集合的移动距离，该第二特征点集合包括第一人脸图像中第二侧的所有特征点，该第二侧为第四特征点相对于目标中轴线所在的一侧。In a possible implementation manner, the foregoing target moving distance includes a first moving distance and a second moving distance. Referring to FIG. 15 , as shown in FIG. 16 , the third determining submodule 924 specifically includes: a fifth determining submodule 926 . Wherein, the fifth determination sub-module 926 is configured to determine the first moving distance and the second moving distance according to the ratio of the first distance to the second distance, the first moving distance is the moving distance of the first feature point set, and the first moving distance is the moving distance of the first feature point set. A set of feature points includes all feature points on the first side of the first face image, the first side is the side where the third feature point is located relative to the central axis of the target, and the second moving distance is the second set of feature points The second set of feature points includes all feature points on the second side of the first face image, and the second side is the side where the fourth feature point is located relative to the central axis of the target.

在一种可能的实现方式中，结合图15，如图17所示，上述第四确定子模块925具体包括：第六确定子模块927。其中，第六确定子模块927，用于若第一距离大于第二距离，则将第一方向确定为目标移动方向，该第一方向为第三特征点朝向目标中轴线的方向，且第一方向与目标中轴线所在方向垂直；或者，若第一距离小于第二距离，则将第二方向确定为目标移动方向，该第二方向为第四特征点朝向目标中轴线的方向，且第二方向与目标中轴线所在方向垂直。In a possible implementation manner, referring to FIG. 15 , as shown in FIG. 17 , the fourth determination submodule 925 specifically includes: a sixth determination submodule 927 . Wherein, the sixth determination sub-module 927 is configured to determine the first direction as the moving direction of the target if the first distance is greater than the second distance, the first direction is the direction in which the third feature point faces the central axis of the target, and the first The direction is perpendicular to the direction of the central axis of the target; or, if the first distance is less than the second distance, the second direction is determined as the moving direction of the target, the second direction is the direction of the fourth feature point towards the central axis of the target, and the second The direction is perpendicular to the direction where the central axis of the target is located.

在一种可能的实现方式中，结合图13，如图18所示，上述生成模块94具体包括：第一生成子模块941、第二生成子模块942和第三生成子模块943。其中，第一生成子模块941，用于根据第一特征点信息，生成第一模型，该第一模型可以为第一人脸图像中的特征点的连线构成的模型。第二生成子模块942，用于根据第二特征点信息，生成第二模型，该第二特征点信息为第一人脸图像的移动后的特征点的信息，该第二模型可以为第一人脸图像的移动后的特征点的连线构成的模型。第三生成子模块943，用于基于第一生成子模块941生成的第一模型和第二生成子模块942生成的第二模型，生成目标显示图像。In a possible implementation manner, referring to FIG. 13 , as shown in FIG. 18 , the generating module 94 specifically includes: a first generating submodule 941 , a second generating submodule 942 and a third generating submodule 943 . Wherein, the first generation sub-module 941 is configured to generate a first model according to the first feature point information, and the first model may be a model formed by connecting lines of feature points in the first face image. The second generation sub-module 942 is used to generate a second model according to the second feature point information, the second feature point information is the information of the moved feature points of the first face image, and the second model can be the first The model formed by the connection of the moving feature points of the face image. The third generation sub-module 943 is configured to generate the target display image based on the first model generated by the first generation sub-module 941 and the second model generated by the second generation sub-module 942 .

本发明实施例提供的电子设备能够实现上述方法实施例中电子设备实现的各个过程，为避免重复，详细描述这里不再赘述。The electronic device provided by the embodiment of the present invention can realize each process realized by the electronic device in the foregoing method embodiment. To avoid repetition, the detailed description will not be repeated here.

本发明实施例提供一种电子设备，由于电子设备可以直接基于根据第一特征点信息确定的移动参数，移动第一人脸图像的特征点，以调整第一人脸图像，从而得到比较对称的人脸图像，而无需用户多次调整电子设备的拍摄角度以进行多次拍摄，如此可以在提升电子设备的拍摄效果的同时，简化用户拍摄过程的操作且节省耗时，从而可以提高电子设备拍摄过程的效率。An embodiment of the present invention provides an electronic device, because the electronic device can directly move the feature points of the first face image based on the moving parameters determined according to the first feature point information to adjust the first face image, thereby obtaining a more symmetrical Face images, without the need for the user to adjust the shooting angle of the electronic device multiple times to take multiple shots, so that while improving the shooting effect of the electronic device, the operation of the user's shooting process is simplified and time-consuming, thereby improving the shooting of the electronic device process efficiency.

下述实施例中，是以本发明实施例提供的电子设备为终端设备为例，对电子设备的硬件示意图进行说明的。In the following embodiments, the electronic device provided by the embodiment of the present invention is taken as a terminal device as an example, and a schematic diagram of hardware of the electronic device is described.

图19为实现本发明各个实施例的一种终端设备的硬件示意图。如图19所示，终端设备100包括但不限于：射频单元101、网络模块102、音频输出单元103、输入单元104、传感器105、显示单元106、用户输入单元107、接口单元108、存储器109、处理器110、以及电源111等部件。Fig. 19 is a schematic diagram of hardware of a terminal device implementing various embodiments of the present invention. As shown in Figure 19, the terminal device 100 includes but not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, Processor 110, power supply 111 and other components.

需要说明的是，本领域技术人员可以理解，图19中示出的终端设备结构并不构成对终端设备的限定，终端设备可以包括比图19所示更多或更少的部件，或者组合某些部件，或者不同的部件布置。在本发明实施例中，终端设备包括但不限于手机、平板电脑、笔记本电脑、掌上电脑、车载终端、可穿戴设备、以及计步器等。It should be noted that those skilled in the art can understand that the structure of the terminal device shown in FIG. some components, or a different arrangement of components. In the embodiment of the present invention, the terminal devices include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, vehicle-mounted terminals, wearable devices, and pedometers.

其中，处理器110，用于识别目标图像中第一人脸图像的第一特征点信息；并根据第一特征点信息，确定第一人脸图像中的目标特征点的移动参数，该移动参数包括目标移动方向和目标移动距离；以及，基于移动参数，在目标图像中移动目标特征点，并生成目标显示图像。Wherein, the processor 110 is used to identify the first feature point information of the first human face image in the target image; and determine the movement parameters of the target feature points in the first human face image according to the first feature point information, the movement parameter Including the moving direction of the target and the moving distance of the target; and, based on the moving parameters, moving the target feature points in the target image to generate a target display image.

显示单元106，用于显示处理器110生成的目标显示图像。The display unit 106 is configured to display the target display image generated by the processor 110 .

本发明实施例提供一种电子设备，由于电子设备可以直接基于根据第一特征点信息确定的移动参数，移动第一人脸图像的特征点，以调整第一人脸图像，从而得到比较对称的人脸图像，而无需用户多次调整电子设备的拍摄角度以进行多次拍摄，如此可以在提升电子设备的拍摄效果的同时，简化用户拍摄过程的操作且节省耗时，从而可以提高电子设备拍摄过程的效率。An embodiment of the present invention provides an electronic device, because the electronic device can directly move the feature points of the first face image based on the moving parameters determined according to the first feature point information to adjust the first face image, thereby obtaining a more symmetrical Face images, without the need for the user to adjust the shooting angle of the electronic device multiple times to take multiple shots, so that while improving the shooting effect of the electronic device, the operation of the user's shooting process is simplified and time-consuming, thereby improving the shooting of the electronic device process efficiency.

应理解的是，本发明实施例中，射频单元101可用于收发信息或通话过程中，信号的接收和发送，具体的，将来自基站的下行数据接收后，给处理器110处理；另外，将上行的数据发送给基站。通常，射频单元101包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外，射频单元101还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, after receiving the downlink data from the base station, the processor 110 processes it; Uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with the network and other devices through a wireless communication system.

终端设备通过网络模块102为用户提供了无线的宽带互联网访问，如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The terminal device provides users with wireless broadband Internet access through the network module 102, such as helping users send and receive emails, browse web pages, and access streaming media.

音频输出单元103可以将射频单元101或网络模块102接收的或者在存储器109中存储的音频数据转换成音频信号并且输出为声音。而且，音频输出单元103还可以提供与终端设备100执行的特定功能相关的音频输出(例如，呼叫信号接收声音、消息接收声音等等)。音频输出单元103包括扬声器、蜂鸣器以及受话器等。The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the terminal device 100 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.

输入单元104用于接收音频或视频信号。输入单元104可以包括图形处理器(Graphics Processing Unit，GPU)1041和麦克风1042，图形处理器1041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元106上。经图形处理器1041处理后的图像帧可以存储在存储器109(或其它存储介质)中或者经由射频单元101或网络模块102进行发送。麦克风1042可以接收声音，并且能够将这样的声音处理为音频数据。处理后的音频数据可以在电话通话模式的情况下转换为可经由射频单元101发送到移动通信基站的格式输出。The input unit 104 is used to receive audio or video signals. The input unit 104 may include a graphics processing unit (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processing unit 1041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The data is processed. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the network module 102 . The microphone 1042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 101 for output in the case of a phone call mode.

终端设备100还包括至少一种传感器105，比如光传感器、运动传感器以及其他传感器。具体地，光传感器包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板1061的亮度，接近传感器可在终端设备100移动到耳边时，关闭显示面板1061和/或背光。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别终端设备姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；传感器105还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等，在此不再赘述。The terminal device 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and the / or backlighting. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the posture of terminal equipment (such as horizontal and vertical screen switching, related games) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 105 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.

显示单元106用于显示由用户输入的信息或提供给用户的信息。显示单元106可包括显示面板1061，可以采用液晶显示器(Liquid Crystal Display，LCD)、有机发光二极管(Organic Light-Emitting Diode，OLED)等形式来配置显示面板1061。The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061 , and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD) or an organic light-emitting diode (Organic Light-Emitting Diode, OLED).

用户输入单元107可用于接收输入的数字或字符信息，以及产生与终端设备的用户设置以及功能控制有关的键信号输入。具体地，用户输入单元107包括触控面板1071以及其他输入设备1072。触控面板1071，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板1071上或在触控面板1071附近的操作)。触控面板1071可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器110，接收处理器110发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板1071。除了触控面板1071，用户输入单元107还可以包括其他输入设备1072。具体地，其他输入设备1072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。The user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the terminal device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operate). The touch panel 1071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 110, receive the command sent by the processor 110 and execute it. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Specifically, other input devices 1072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

进一步的，触控面板1071可覆盖在显示面板1061上，当触控面板1071检测到在其上或附近的触摸操作后，传送给处理器110以确定触摸事件的类型，随后处理器110根据触摸事件的类型在显示面板1061上提供相应的视觉输出。虽然在图19中，触控面板1071与显示面板1061是作为两个独立的部件来实现终端设备的输入和输出功能，但是在某些实施例中，可以将触控面板1071与显示面板1061集成而实现终端设备的输入和输出功能，具体此处不做限定。Further, the touch panel 1071 can be covered on the display panel 1061, and when the touch panel 1071 detects a touch operation on or near it, it will be sent to the processor 110 to determine the type of the touch event, and then the processor 110 can The type of event provides a corresponding visual output on the display panel 1061 . Although in FIG. 19, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the terminal device, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated. The implementation of the input and output functions of the terminal device is not specifically limited here.

接口单元108为外部装置与终端设备100连接的接口。例如，外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元108可以用于接收来自外部装置的输入(例如，数据信息、电力等等)并且将接收到的输入传输到终端设备100内的一个或多个元件或者可以用于在终端设备100和外部装置之间传输数据。The interface unit 108 is an interface for connecting an external device to the terminal device 100 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

存储器109可用于存储软件程序以及各种数据。存储器109可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器109可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 109 can be used to store software programs as well as various data. The memory 109 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.) etc.; Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

处理器110是终端设备的控制中心，利用各种接口和线路连接整个终端设备的各个部分，通过运行或执行存储在存储器109内的软件程序和/或模块，以及调用存储在存储器109内的数据，执行终端设备的各种功能和处理数据，从而对终端设备进行整体监控。处理器110可包括一个或多个处理单元；可选的，处理器110可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器110中。The processor 110 is the control center of the terminal equipment, uses various interfaces and lines to connect various parts of the entire terminal equipment, runs or executes software programs and/or modules stored in the memory 109, and calls data stored in the memory 109 , execute various functions of the terminal equipment and process data, so as to monitor the terminal equipment as a whole. The processor 110 may include one or more processing units; optionally, the processor 110 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem The tuner processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .

终端设备100还可以包括给各个部件供电的电源111(比如电池)，可选的，电源111可以通过电源管理系统与处理器110逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The terminal device 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. Management and other functions.

另外，终端设备100包括一些未示出的功能模块，在此不再赘述。In addition, the terminal device 100 includes some functional modules not shown, which will not be repeated here.

可选的，本发明实施例还提供一种终端设备，包括如图19所示的处理器110，存储器109，存储在存储器109上并可在所述处理器110上运行的计算机程序，该计算机程序被处理器110执行时实现上述方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。Optionally, an embodiment of the present invention also provides a terminal device, including a processor 110 as shown in FIG. When the program is executed by the processor 110, each process of the foregoing method embodiments can be realized, and the same technical effect can be achieved, so details are not repeated here to avoid repetition.

本发明实施例还提供一种计算机可读存储介质，计算机可读存储介质上存储有计算机程序，该计算机程序被处理器执行时实现上述方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。其中，所述的计算机可读存储介质，如只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等。The embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, each process of the above-mentioned method embodiment can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here. Wherein, the computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in various embodiments of the present invention.

上面结合附图对本发明的实施例进行了描述，但是本发明并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本发明的启示下，在不脱离本发明宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本发明的保护之内。Embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementations, and the above-mentioned specific implementations are only illustrative, rather than restrictive, and those of ordinary skill in the art will Under the enlightenment of the present invention, without departing from the gist of the present invention and the protection scope of the claims, many forms can also be made, all of which belong to the protection of the present invention.

Claims (13)

Translated fromChinese

1.一种图像处理方法，应用于电子设备，其特征在于，所述方法包括：1. A kind of image processing method, is applied to electronic equipment, is characterized in that, described method comprises:识别目标图像中第一人脸图像的第一特征点信息；identifying the first feature point information of the first human face image in the target image;根据所述第一特征点信息，确定所述第一人脸图像中的目标特征点的移动参数，所述移动参数包括目标移动方向和目标移动距离；According to the first feature point information, determine the moving parameters of the target feature points in the first face image, the moving parameters include target moving direction and target moving distance;基于所述移动参数，在所述目标图像中移动所述目标特征点，并生成目标显示图像；moving the target feature point in the target image based on the moving parameter, and generating a target display image;显示所述目标显示图像。Display the target display image.2.根据权利要求1所述的方法，其特征在于，所述根据所述第一特征点信息，确定所述第一人脸图像中的目标特征点的移动参数，包括：2. The method according to claim 1, wherein, according to the first feature point information, determining the movement parameters of the target feature point in the first human face image comprises:根据所述第一特征点信息，确定目标中轴线，所述目标中轴线为所述第一人脸图像中的第一特征点和第二特征点的连线；determining a target central axis according to the first feature point information, the target central axis being a line connecting the first feature point and the second feature point in the first face image;根据所述目标中轴线，确定所述移动参数。The movement parameter is determined according to the target central axis.3.根据权利要求2所述的方法，其特征在于，所述根据所述目标中轴线，确定所述移动参数，包括：3. The method according to claim 2, wherein said determining said movement parameters according to said target central axis comprises:获取第一距离和第二距离，所述第一距离为第三特征点与所述目标中轴线之间的距离，所述第二距离为第四特征点与所述目标中轴线之间的距离，所述第三特征点和所述第四特征点相对于所述目标中轴线相对应；Obtain a first distance and a second distance, the first distance is the distance between the third feature point and the target central axis, and the second distance is the distance between the fourth feature point and the target central axis , the third feature point and the fourth feature point correspond to the target central axis;根据所述第一距离和所述第二距离的比值，确定所述目标移动距离；determining the moving distance of the target according to the ratio of the first distance to the second distance;根据所述第一距离和所述第二距离的大小关系，确定所述目标移动方向。Determine the moving direction of the target according to the size relationship between the first distance and the second distance.4.根据权利要求3所述的方法，其特征在于，所述目标移动距离包括第一移动距离和第二移动距离；4. The method according to claim 3, wherein the target moving distance comprises a first moving distance and a second moving distance;所述根据所述第一距离和所述第二距离的比值，确定所述目标移动距离，包括：The determining the target moving distance according to the ratio of the first distance to the second distance includes:根据所述第一距离和所述第二距离的比值，确定所述第一移动距离和所述第二移动距离，所述第一移动距离为第一特征点集合的移动距离，所述第一特征点集合包括所述第一人脸图像中第一侧的所有特征点，所述第一侧为所述第三特征点相对于所述目标中轴线所在的一侧，所述第二移动距离为第二特征点集合的移动距离，所述第二特征点集合包括所述第一人脸图像中第二侧的所有特征点，所述第二侧为所述第四特征点相对于所述目标中轴线所在的一侧。According to the ratio of the first distance to the second distance, determine the first moving distance and the second moving distance, the first moving distance is the moving distance of the first feature point set, and the first The set of feature points includes all feature points on the first side of the first face image, the first side being the side where the third feature point is located relative to the target central axis, and the second moving distance is the moving distance of the second feature point set, the second feature point set includes all feature points on the second side of the first face image, and the second side is the distance between the fourth feature point and the The side of the target's central axis.5.根据权利要求3或4所述的方法，其特征在于，所述根据所述第一距离和所述第二距离的大小关系，确定所述目标移动方向，包括：5. The method according to claim 3 or 4, wherein the determining the moving direction of the target according to the size relationship between the first distance and the second distance comprises:若所述第一距离大于所述第二距离，则将第一方向确定为所述目标移动方向，所述第一方向为所述第三特征点朝向所述目标中轴线的方向，且所述第一方向与所述目标中轴线所在方向垂直；If the first distance is greater than the second distance, then determine the first direction as the moving direction of the target, the first direction is the direction in which the third feature point faces the central axis of the target, and the The first direction is perpendicular to the direction of the target central axis;若所述第一距离小于所述第二距离，则将第二方向确定为所述目标移动方向，所述第二方向为所述第四特征点朝向所述目标中轴线的方向，且所述第二方向与所述目标中轴线所在方向垂直。If the first distance is smaller than the second distance, then determine the second direction as the moving direction of the target, the second direction is the direction of the fourth feature point towards the central axis of the target, and the The second direction is perpendicular to the direction where the target central axis is located.6.根据权利要求1所述的方法，其特征在于，所述生成目标显示图像，包括：6. The method according to claim 1, wherein said generating the target display image comprises:根据所述第一特征点信息，生成第一模型；generating a first model according to the first feature point information;根据第二特征点信息，生成第二模型，所述第二特征点信息为所述第一人脸图像的移动后的特征点的信息；Generate a second model according to the second feature point information, where the second feature point information is the information of the moved feature points of the first face image;基于所述第一模型和所述第二模型，生成所述目标显示图像。The target display image is generated based on the first model and the second model.7.一种电子设备，其特征在于，所述电子设备包括：识别模块、确定模块、移动模块、生成模块和显示模块；7. An electronic device, characterized in that the electronic device comprises: an identification module, a determination module, a movement module, a generation module and a display module;所述识别模块，用于识别目标图像中第一人脸图像的第一特征点信息；The identification module is used to identify the first feature point information of the first human face image in the target image;所述确定模块，用于根据所述识别模块识别的所述第一特征点信息，确定所述第一人脸图像中的目标特征点的移动参数，所述移动参数包括目标移动方向和目标移动距离；The determination module is configured to determine the movement parameters of the target feature points in the first face image according to the first feature point information identified by the identification module, and the movement parameters include target movement direction and target movement distance;所述移动模块，用于基于所述确定模块确定的所述移动参数，在所述目标图像中移动所述目标特征点；The moving module is configured to move the target feature point in the target image based on the moving parameter determined by the determining module;所述生成模块，用于生成目标显示图像；The generation module is used to generate a target display image;所述显示模块，用于显示所述生成模块生成的所述目标显示图像。The display module is configured to display the target display image generated by the generating module.8.根据权利要求7所述的电子设备，其特征在于，所述确定模块具体包括：第一确定子模块和第二确定子模块；8. The electronic device according to claim 7, wherein the determining module specifically comprises: a first determining submodule and a second determining submodule;所述第一确定子模块，用于根据所述第一特征点信息，确定目标中轴线，所述目标中轴线为所述第一人脸图像中的第一特征点和第二特征点的连线；The first determining submodule is configured to determine a target central axis according to the first feature point information, and the target central axis is the connection between the first feature point and the second feature point in the first face image. Wire;所述第二确定子模块，用于根据所述第一确定子模块确定的所述目标中轴线，确定所述移动参数。The second determination submodule is configured to determine the movement parameter according to the target central axis determined by the first determination submodule.9.根据权利要求8所述的电子设备，其特征在于，所述第二确定子模块具体包括：第一获取子模块、第三确定子模块和第四确定子模块；9. The electronic device according to claim 8, wherein the second determination submodule specifically comprises: a first acquisition submodule, a third determination submodule and a fourth determination submodule;所述第一获取子模块，用于获取第一距离和第二距离，所述第一距离为第三特征点与所述目标中轴线之间的距离，所述第二距离为第四特征点与所述目标中轴线之间的距离，所述第三特征点和所述第四特征点相对于所述目标中轴线相对应；The first obtaining submodule is used to obtain a first distance and a second distance, the first distance is the distance between the third feature point and the target central axis, and the second distance is the fourth feature point The distance between the target central axis, the third feature point and the fourth feature point correspond to the target central axis;所述第三确定子模块，用于根据所述第一获取子模块获取的所述第一距离和所述第二距离的比值，确定所述目标移动距离；The third determining submodule is configured to determine the target moving distance according to the ratio of the first distance and the second distance obtained by the first obtaining submodule;所述第四确定子模块，用于根据所述第一获取子模块获取的所述第一距离和所述第二距离的大小关系，确定所述目标移动方向。The fourth determining submodule is configured to determine the moving direction of the target according to the size relationship between the first distance and the second distance obtained by the first obtaining submodule.10.根据权利要求9所述的电子设备，其特征在于，所述目标移动距离包括第一移动距离和第二移动距离；10. The electronic device according to claim 9, wherein the target moving distance comprises a first moving distance and a second moving distance;所述第三确定子模块具体包括：第五确定子模块；The third determining submodule specifically includes: a fifth determining submodule;所述第五确定子模块，用于根据所述第一距离和所述第二距离的比值，确定所述第一移动距离和所述第二移动距离，所述第一移动距离为第一特征点集合的移动距离，所述第一特征点集合包括所述第一人脸图像中第一侧的所有特征点，所述第一侧为所述第三特征点相对于所述目标中轴线所在的一侧，所述第二移动距离为第二特征点集合的移动距离，所述第二特征点集合包括所述第一人脸图像中第二侧的所有特征点，所述第二侧为所述第四特征点相对于所述目标中轴线所在的一侧。The fifth determining submodule is configured to determine the first moving distance and the second moving distance according to the ratio of the first distance to the second distance, the first moving distance being the first feature The moving distance of the point set, the first feature point set includes all feature points on the first side in the first face image, and the first side is where the third feature point is located relative to the target central axis , the second moving distance is the moving distance of the second feature point set, the second feature point set includes all feature points on the second side in the first face image, and the second side is The side where the fourth feature point is located relative to the target central axis.11.根据权利要求9或10所述的电子设备，其特征在于，所述第四确定子模块具体包括：第六确定子模块；11. The electronic device according to claim 9 or 10, wherein the fourth determining submodule specifically comprises: a sixth determining submodule;所述第六确定子模块，用于若所述第一距离大于所述第二距离，则将第一方向确定为所述目标移动方向，所述第一方向为所述第三特征点朝向所述目标中轴线的方向，且所述第一方向与所述目标中轴线所在方向垂直；或者，若所述第一距离小于所述第二距离，则将第二方向确定为所述目标移动方向，所述第二方向为所述第四特征点朝向所述目标中轴线的方向，且所述第二方向与所述目标中轴线所在方向垂直。The sixth determining submodule is configured to determine a first direction as the moving direction of the target if the first distance is greater than the second distance, and the first direction is that the third feature point faces the target moving direction. The direction of the central axis of the target, and the first direction is perpendicular to the direction of the central axis of the target; or, if the first distance is less than the second distance, the second direction is determined as the moving direction of the target , the second direction is a direction in which the fourth feature point faces the central axis of the target, and the second direction is perpendicular to the direction of the central axis of the target.12.根据权利要求7所述的电子设备，其特征在于，所述生成模块具体包括：第一生成子模块、第二生成子模块和第三生成子模块；12. The electronic device according to claim 7, wherein the generating module specifically comprises: a first generating submodule, a second generating submodule and a third generating submodule;所述第一生成子模块，用于根据所述第一特征点信息，生成第一模型；The first generating submodule is configured to generate a first model according to the first feature point information;所述第二生成子模块，用于根据第二特征点信息，生成第二模型，所述第二特征点信息为所述第一人脸图像的移动后的特征点的信息；The second generating submodule is configured to generate a second model according to second feature point information, where the second feature point information is the information of the moved feature points of the first face image;所述第三生成子模块，用于基于所述第一生成子模块生成的所述第一模型和所述第二生成子模块生成的所述第二模型，生成所述目标显示图像。The third generation submodule is configured to generate the target display image based on the first model generated by the first generation submodule and the second model generated by the second generation submodule.13.一种电子设备，其特征在于，包括处理器、存储器及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被所述处理器执行时实现如权利要求1至6中任一项所述的图像处理方法的步骤。13. An electronic device, characterized by comprising a processor, a memory, and a computer program stored on the memory and operable on the processor, when the computer program is executed by the processor, the The steps of the image processing method described in any one of claims 1 to 6.