CN114581291A - Method and system for presenting facial makeup images in cockpit - Google Patents
Method and system for presenting facial makeup images in cockpitDownload PDFInfo
- Publication number
- CN114581291A CN114581291ACN202210207547.3ACN202210207547ACN114581291ACN 114581291 ACN114581291 ACN 114581291ACN 202210207547 ACN202210207547 ACN 202210207547ACN 114581291 ACN114581291 ACN 114581291A
- Authority
- CN
- China
- Prior art keywords
- makeup
- image
- face
- dimensional
- facial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/08—Projecting images onto non-planar surfaces, e.g. geodetic screens
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
- G06T7/344—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving models
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Computer Graphics (AREA)
- Mechanical Engineering (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明主要涉及智能汽车领域，尤其涉及一种座舱内呈现人脸美妆图像的方法和系统。The invention mainly relates to the field of smart cars, and in particular, to a method and system for presenting facial beauty images in a cockpit.
背景技术Background technique
随着汽车智能化程度的逐渐升高，人们对于在座舱内的智能驾驶体验有了更高的追求。在其他的领域，如多媒体等，人脸图像自动美妆的技术已经有一些应用，但是在汽车座舱内这一效果尚未被实现。另外，传统的自动美妆技术往往采用2D图像关键点检测，并经过三角剖分的手段对人脸美妆进行妆容迁移，然而，这样的方式存在一些弊端，例如对于侧脸或大角度的美妆迁移时，可能会因为图像的重合或叠加而导致妆容存在异常，尤其是在座舱内的场景中，采用传统的人脸图像自动美妆的方式，会导致最终的美妆效果不稳定或效果较差。With the gradual increase in the degree of automobile intelligence, people have a higher pursuit of intelligent driving experience in the cockpit. In other fields, such as multimedia, the technology of automatic facial makeup has been applied, but this effect has not been realized in the car cockpit. In addition, the traditional automatic beauty technology often uses 2D image key point detection, and performs makeup migration for facial beauty through triangulation. However, this method has some drawbacks, such as for profile or large-angle beauty. During makeup migration, there may be abnormalities in the makeup due to the overlapping or superimposition of images. Especially in the scene in the cockpit, the use of the traditional automatic makeup method of face images will lead to unstable or effective final makeup effects. poor.
发明内容SUMMARY OF THE INVENTION
本发明要解决的技术问题是提供一种座舱内呈现人脸美妆图像的方法和系统，可以在汽车的场景中实现对人脸图像的美妆处理效果，提升座舱内的智能体验。The technical problem to be solved by the present invention is to provide a method and system for presenting a facial makeup image in the cockpit, which can realize the facial makeup processing effect on the facial image in the scene of the car, and improve the intelligent experience in the cockpit.
为解决上述技术问题，本发明提供了一种座舱内呈现人脸美妆图像的方法，包括：In order to solve the above technical problems, the present invention provides a method for presenting a facial beauty image in a cockpit, including:
在UV展开图上获取妆容模板，所述妆容模板包括一个或多个具有妆容的人脸图像；Obtaining a makeup look template on the UV unwrapped map, the makeup look template including one or more face images with makeup looks;
通过车内摄像头采集座舱内用户的面部图像；Capture facial images of users in the cockpit through in-vehicle cameras;
基于预先设置或手动选择的操作，通过妆容迁移算法将所述妆容模板渲染到所述面部图像中，以获得美妆图像；以及rendering the makeup look template into the face image through a makeup look transfer algorithm based on pre-set or manually selected operations to obtain a beauty makeup image; and
将所述美妆图像投影在汽车内的前风挡玻璃或侧窗玻璃上。The cosmetic image is projected on the front windshield or side window glass in the car.
在本发明的一实施例中，任一妆容模板中的每一个像素点与所述任一妆容模板对应的人脸图像转换为三维人脸图像后的三维特征点相对应，在采集所述面部图像之后以及执行所述渲染的步骤之前，还包括：In an embodiment of the present invention, each pixel point in any makeup template corresponds to a three-dimensional feature point after the face image corresponding to any makeup template is converted into a three-dimensional face image. After the image and before performing the step of rendering, it also includes:
获取所述面部图像中的二维人脸关键点；obtaining the two-dimensional face key points in the facial image;
通过三维人脸重建方法获得与所述二维人脸关键点对应的三维人脸关键点，并依据所述三维人脸关键点构建所述面部图像对应的三维人脸图像；Obtain three-dimensional face key points corresponding to the two-dimensional face key points by a three-dimensional face reconstruction method, and construct a three-dimensional face image corresponding to the face image according to the three-dimensional face key points;
基于预先设置或手动选择的操作，将所述妆容模板渲染到所述用户的面部图像中，其中，所述人脸图图像对应的三维特征点与所述面部头像对应的三维人脸关键点相互对应；以及Based on a preset or manually selected operation, the makeup template is rendered into the user's face image, wherein the three-dimensional feature points corresponding to the face map image and the three-dimensional face key points corresponding to the facial avatar are mutually correspond; and
将渲染后的面部图像转换为二维的美妆图像。Convert the rendered face image into a 2D beauty image.
在本发明的一实施例中，所述妆容迁移算法包括对所述妆容模板和所述三维人脸图像分别进行分层建模，所述分层建模包括构建光照层、细粒度脸部结构层和细粒度皮肤细节层。In an embodiment of the present invention, the makeup migration algorithm includes separately performing hierarchical modeling on the makeup template and the three-dimensional face image, and the hierarchical modeling includes constructing an illumination layer and a fine-grained facial structure. layers and fine-grained skin detail layers.
在本发明的一实施例中，还包括通过车外摄像头检测位于车辆前方或侧方的行人，并最终将所述美妆图像投影在汽车内的前风挡玻璃或侧窗玻璃的预设区域中，其中，所述预设区域由所述行人位置和所述车内摄像头的位置决定。In an embodiment of the present invention, the method further includes detecting pedestrians located in front of or beside the vehicle through an exterior camera, and finally projecting the beauty image on a preset area of the front windshield or side window in the vehicle , wherein the preset area is determined by the position of the pedestrian and the position of the in-vehicle camera.
在本发明的一实施例中，还包括对所述车内摄像头进行畸变矫正的步骤。In an embodiment of the present invention, the step of performing distortion correction on the in-vehicle camera is further included.
为了解决上述的技术问题，本发明的另一方面还提出了一种座舱内呈现人脸美妆图像的系统，包括：In order to solve the above-mentioned technical problems, another aspect of the present invention also proposes a system for presenting facial beauty images in a cockpit, including:
车内摄像头，适于采集座舱内用户的面部图像；In-vehicle camera, suitable for collecting facial images of users in the cockpit;
车机，包括妆容模板获取模块以及妆容渲染模块，其中，所述妆容模板获取模块配置为在UV展开图上获取妆容模板，所述妆容模板包括一个或多个具有妆容的人脸图像；所述妆容渲染模块配置为基于预先设置或手动选择的操作，通过妆容迁移算法将所述妆容模板渲染到所述面部图像中；以及The car machine includes a makeup template acquisition module and a makeup rendering module, wherein the makeup template acquisition module is configured to acquire a makeup template on a UV unwrapped map, and the makeup template includes one or more face images with makeup; the a makeup rendering module configured to render the makeup template into the facial image through a makeup migration algorithm based on pre-set or manually selected operations; and
车内投影仪，适于将所述美妆图像投影在汽车内的前风挡玻璃或侧窗玻璃上。The in-vehicle projector is suitable for projecting the cosmetic image on the front windshield or side window glass in the automobile.
在本发明的一实施例中，系统还包括车外摄像头，所述车外摄像头适于检测位于车辆前方或侧方的行人，所述车内投影仪适于将所述美妆图像投影在汽车内的前风挡玻璃或侧窗玻璃的预设区域中，其中，所述预设区域由所述行人位置和所述车内摄像头的位置决定。In an embodiment of the present invention, the system further includes an exterior camera, the exterior camera is adapted to detect pedestrians located in front of or beside the vehicle, and the interior projector is adapted to project the beauty image on the vehicle In a preset area of the inner front windshield or side window glass, the preset area is determined by the position of the pedestrian and the position of the in-vehicle camera.
在本发明的一实施例中，任一妆容模板中的每一个像素点与所述任一妆容模板对应的人脸图像转换为三维人脸图像后的三维特征点相对应，且所述车机还包括三维重建模块，所述三维重建模块配置为：In an embodiment of the present invention, each pixel point in any makeup template corresponds to a three-dimensional feature point after the face image corresponding to any makeup template is converted into a three-dimensional face image, and the vehicle Also includes a three-dimensional reconstruction module, the three-dimensional reconstruction module is configured to:
获取所述面部图像中的二维人脸关键点；obtaining the two-dimensional face key points in the facial image;
通过三维人脸重建方法获得与所述二维人脸关键点对应的三维人脸关键点，并依据所述三维人脸关键点构建所述面部图像对应的三维人脸图像；Obtain three-dimensional face key points corresponding to the two-dimensional face key points by a three-dimensional face reconstruction method, and construct a three-dimensional face image corresponding to the face image according to the three-dimensional face key points;
基于预先设置或手动选择的操作，将所述妆容模板渲染到所述用户的面部图像中，其中，所述人脸图图像对应的三维特征点与所述面部头像对应的三维人脸关键点相互对应；以及Based on a preset or manually selected operation, the makeup template is rendered into the user's face image, wherein the three-dimensional feature points corresponding to the face map image and the three-dimensional face key points corresponding to the facial avatar are mutually correspond; and
将渲染后的面部图像转换为二维的美妆图像。Convert the rendered face image into a 2D beauty image.
本发明还提出了一种座舱内呈现人脸美妆图像的系统，包括：The present invention also proposes a system for presenting facial beauty images in the cockpit, including:
存储器，用于存储可由处理器执行的指令；以及处理器，用于执行所述指令以实现上述的座舱内呈现美妆图像的方法。a memory for storing instructions executable by a processor; and a processor for executing the instructions to implement the above-mentioned method for presenting a cosmetic image in a cabin.
本发明的另一方面还提出了一种存储有计算机程序代码的计算机可读介质，所述计算机程序代码在由处理器执行时实现上述座舱内呈现美妆图像的方法。Another aspect of the present invention also provides a computer-readable medium storing computer program code, the computer program code implementing the above-mentioned method for presenting a cosmetic image in a cabin when executed by a processor.
与现有技术相比，本发明具有以下优点：本发明的人脸美妆图像的方法和系统，可以在汽车座舱的场景下，通过适配的妆容迁移算法实现对用户面部图像的自动美妆，并可以通过汽车内投影仪的配置，将美妆后的图像呈现在车内不同的位置，以与不同的美妆图像的应用场景相对应，普适性高，智能化程度高，且美妆效果好。Compared with the prior art, the present invention has the following advantages: the method and system for a facial makeup image of the present invention can realize automatic makeup on a user's facial image through an adapted makeup migration algorithm in the scene of a car cockpit. , and through the configuration of the projector in the car, the post-beauty images can be presented in different positions in the car to correspond to different application scenarios of the beauty images, with high universality, high intelligence, and beauty. Makeup works well.
附图说明Description of drawings
包括附图是为提供对本申请进一步的理解，它们被收录并构成本申请的一部分，附图示出了本申请的实施例，并与本说明书一起起到解释本发明原理的作用。附图中：The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the principles of the invention. In the attached picture:
图1是本发明一实施例的一种座舱内呈现人脸美妆图像的方法的流程示意图；1 is a schematic flowchart of a method for presenting a facial beauty image in a cockpit according to an embodiment of the present invention;
图2是本发明一实施例的一种座舱内呈现人脸美妆图像的方法的原理图；FIG. 2 is a schematic diagram of a method for presenting a facial beauty makeup image in a cockpit according to an embodiment of the present invention;
图3是本发明一实施例的一种座舱内呈现人脸美妆图像的系统的系统框图；以及FIG. 3 is a system block diagram of a system for presenting facial beauty images in a cockpit according to an embodiment of the present invention; and
图4是本发明另外一实施例的一种座舱内呈现人脸美妆图像的系统的系统框图。FIG. 4 is a system block diagram of a system for presenting a face beauty makeup image in a cockpit according to another embodiment of the present invention.
具体实施方式Detailed ways
为了更清楚地说明本申请的实施例的技术方案，下面将对实施例描述中所需要使用的附图作简单的介绍。显而易见地，下面描述中的附图仅仅是本申请的一些示例或实施例，对于本领域的普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图将本申请应用于其他类似情景。除非从语言环境中显而易见或另做说明，图中相同标号代表相同结构或操作。In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings that are used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some examples or embodiments of the present application. For those of ordinary skill in the art, without any creative effort, the present application can also be applied to the present application according to these drawings. other similar situations. Unless obvious from the locale or otherwise specified, the same reference numbers in the figures represent the same structure or operation.
如本申请和权利要求书中所示，除非上下文明确提示例外情形，“一”、“一个”、“一种”和/或“该”等词并非特指单数，也可包括复数。一般说来，术语“包括”与“包含”仅提示包括已明确标识的步骤和元素，而这些步骤和元素不构成一个排它性的罗列，方法或者设备也可能包含其他的步骤或元素。As shown in this application and in the claims, unless the context clearly dictates otherwise, the words "a", "an", "an" and/or "the" are not intended to be specific in the singular and may include the plural. Generally speaking, the terms "comprising" and "comprising" only imply that the clearly identified steps and elements are included, and these steps and elements do not constitute an exclusive list, and the method or apparatus may also include other steps or elements.
除非另外具体说明，否则在这些实施例中阐述的部件和步骤的相对布置、数字表达式和数值不限制本申请的范围。同时，应当明白，为了便于描述，附图中所示出的各个部分的尺寸并不是按照实际的比例关系绘制的。对于相关领域普通技术人员已知的技术、方法和设备可能不作详细讨论，但在适当情况下，所述技术、方法和设备应当被视为授权说明书的一部分。在这里示出和讨论的所有示例中，任何具体值应被解释为仅仅是示例性的，而不是作为限制。因此，示例性实施例的其它示例可以具有不同的值。应注意到：相似的标号和字母在下面的附图中表示类似项，因此，一旦某一项在一个附图中被定义，则在随后的附图中不需要对其进行进一步讨论。The relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present application unless specifically stated otherwise. Meanwhile, it should be understood that, for the convenience of description, the dimensions of various parts shown in the accompanying drawings are not drawn in an actual proportional relationship. Techniques, methods, and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such techniques, methods, and devices should be considered part of the authorized description. In all examples shown and discussed herein, any specific value should be construed as illustrative only and not as limiting. Accordingly, other examples of exemplary embodiments may have different values. It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further discussion in subsequent figures.
在本申请的描述中，需要理解的是，方位词如“前、后、上、下、左、右”、“横向、竖向、垂直、水平”和“顶、底”等所指示的方位或位置关系通常是基于附图所示的方位或位置关系，仅是为了便于描述本申请和简化描述，在未作相反说明的情况下，这些方位词并不指示和暗示所指的装置或元件必须具有特定的方位或者以特定的方位构造和操作，因此不能理解为对本申请保护范围的限制；方位词“内、外”是指相对于各部件本身的轮廓的内外。In the description of this application, it should be understood that the orientations indicated by the orientation words such as "front, rear, top, bottom, left, right", "horizontal, vertical, vertical, horizontal" and "top, bottom" etc. Or the positional relationship is usually based on the orientation or positional relationship shown in the drawings, which is only for the convenience of describing the present application and simplifying the description, and these orientations do not indicate or imply the indicated devices or elements unless otherwise stated. It must have a specific orientation or be constructed and operated in a specific orientation, so it cannot be construed as a limitation on the protection scope of the application; the orientation words "inside and outside" refer to the inside and outside relative to the contour of each component itself.
为了便于描述，在这里可以使用空间相对术语，如“在……之上”、“在……上方”、“在……上表面”、“上面的”等，用来描述如在图中所示的一个器件或特征与其他器件或特征的空间位置关系。应当理解的是，空间相对术语旨在包含除了器件在图中所描述的方位之外的在使用或操作中的不同方位。例如，如果附图中的器件被倒置，则描述为“在其他器件或构造上方”或“在其他器件或构造之上”的器件之后将被定位为“在其他器件或构造下方”或“在其他器件或构造之下”。因而，示例性术语“在……上方”可以包括“在……上方”和“在……下方”两种方位。该器件也可以其他不同方式定位(旋转90度或处于其他方位)，并且对这里所使用的空间相对描述作出相应解释。For ease of description, spatially relative terms, such as "on", "over", "on the surface", "above", etc., may be used herein to describe what is shown in the figures. The spatial positional relationship of one device or feature shown to other devices or features. It should be understood that spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as "above" or "over" other devices or features would then be oriented "below" or "over" the other devices or features under other devices or constructions". Thus, the exemplary term "above" can encompass both an orientation of "above" and "below." The device may also be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptions used herein interpreted accordingly.
此外，需要说明的是，使用“第一”、“第二”等词语来限定零部件，仅仅是为了便于对相应零部件进行区别，如没有另行声明，上述词语并没有特殊含义，因此不能理解为对本申请保护范围的限制。此外，尽管本申请中所使用的术语是从公知公用的术语中选择的，但是本申请说明书中所提及的一些术语可能是申请人按他或她的判断来选择的，其详细含义在本文的描述的相关部分中说明。此外，要求不仅仅通过所使用的实际术语，而是还要通过每个术语所蕴含的意义来理解本申请。In addition, it should be noted that the use of words such as "first" and "second" to define components is only for the convenience of distinguishing corresponding components. Unless otherwise stated, the above words have no special meaning and therefore cannot be understood to limit the scope of protection of this application. In addition, although the terms used in this application are selected from well-known and common terms, some terms mentioned in the specification of this application may be chosen by the applicant at his or her judgment, and the detailed meanings of which are set forth herein. described in the relevant section of the description. Furthermore, it is required that the application be understood not only by the actual terms used, but also by the meaning implied by each term.
应当理解，当一个部件被称为“在另一个部件上”、“连接到另一个部件”、“耦合于另一个部件”或“接触另一个部件”时，它可以直接在该另一个部件之上、连接于或耦合于、或接触该另一个部件，或者可以存在插入部件。相比之下，当一个部件被称为“直接在另一个部件上”、“直接连接于”、“直接耦合于”或“直接接触”另一个部件时，不存在插入部件。同样的，当第一个部件被称为“电接触”或“电耦合于”第二个部件，在该第一部件和该第二部件之间存在允许电流流动的电路径。该电路径可以包括电容器、耦合的电感器和/或允许电流流动的其它部件，甚至在导电部件之间没有直接接触。It will be understood that when an element is referred to as being "on," "connected to," "coupled to," or "contacting" another element, it can be directly between the other element on, connected to or coupled to, or in contact with the other component, or an intervening component may be present. In contrast, when an element is referred to as being "directly on," "directly connected to," "directly coupled to," or "directly in contact with" another element, there are no intervening elements present. Likewise, when a first component is referred to as being "in electrical contact" or "electrically coupled to" a second component, there is an electrical path between the first component and the second component that allows current to flow. The electrical path may include capacitors, coupled inductors, and/or other components that allow current to flow, even without direct contact between conductive components.
参照图1，本发明的一实施例提出了一种座舱内呈现人脸美妆图像的方法10(以下简称方法10)，可以在汽车的场景中实现对人脸图像的美妆处理效果，提升座舱内的智能体验。本申请图1中使用了流程图用来说明根据本申请的实施例的系统所执行的操作。应当理解的是，前面或下面操作不一定按照顺序来精确地执行。相反，可以按照倒序或同时处理各种步骤。同时，或将其他操作添加到这些过程中，或从这些过程移除某一步或数步操作。Referring to FIG. 1 , an embodiment of the present invention proposes a
根据图1，方法10包括如下的步骤：According to FIG. 1, the
步骤11为在UV展开图上获取妆容模板，妆容模板包括一个或多个具有妆容的人脸图像。其中，UV展开图中的U和V为二维空间的水平轴和垂直轴，此步骤中的妆容模板可以是按需制作的或预先存储在数据库中的。这些妆容模板中的人脸图像可以来自于一些特定的模特拍摄的带有妆容的模板，并具有不同的化妆类型和妆容多少/深浅的程度等，以便于用户在后面人脸图像自动美妆的步骤中可以定制化的选择。在此步骤前创建或生成妆容模板的方式可以参考现有技术，由于不是本发明的重点，在此不做展开。
步骤12为通过车内摄像头采集座舱内用户的面部图像。示例性的，车内摄像头可以安置在汽车内便于采集用户面部图像信息的位置，例如是针对驾驶员用户，则车内摄像头可以安置在驾驶座前正对驾驶员的位置上，本发明不对此做出限制。
步骤13为基于预先设置或手动选择的操作，通过妆容迁移算法将妆容模板渲染到面部图像中，以获得美妆图像。示例性的，在无任何特别优化的方案中，妆容模板和用户的面部图像都是二维的图像，则可以直接通过特征点对比等基础的妆容迁移算法将妆容模板渲染到面部图像中。而在本发明的一些优选地的实施例中，本发明的方案还可以适用于一些大角度的三维图像之间的妆容迁移过程。在这样的实施例中，需要执行步骤13前，进行如下的步骤。
首先基于步骤12中所采集的面部图像获取该面部图像中的二维人脸关键点，以完成准备工作。Firstly, the two-dimensional face key points in the face image are acquired based on the face image collected in
进一步的，通过三维人脸重建方法获得与二维人脸关键点对应的三维人脸关键点，并依据三维人脸关键点构建面部图像对应的三维人脸图像，由此，基于步骤12中的二维的面部图像的三维图像生成过程完成。Further, the 3D face key points corresponding to the 2D face key points are obtained by the 3D face reconstruction method, and the 3D face image corresponding to the facial image is constructed according to the 3D face key points. The three-dimensional image generation process of the two-dimensional facial image is completed.
再一步的，基于预先设置或手动选择的操作，将妆容模板渲染到用户的面部图像中，其中，人脸图图像对应的三维特征点与面部头像对应的三维人脸关键点相互对应。在此步骤中，由于基于UV展开图的妆容模板中的各特征点，具有各自对应的三维点位坐标，因此，可以直接进行三维图像和三维图像之间的美妆效果的迁移。Further, based on a preset or manually selected operation, the makeup template is rendered into the user's face image, wherein the three-dimensional feature points corresponding to the face map image and the three-dimensional face key points corresponding to the facial avatar correspond to each other. In this step, since each feature point in the makeup template based on the UV unwrapped map has its corresponding 3D point coordinates, it is possible to directly transfer the beauty effect between the 3D image and the 3D image.
最后，将渲染后的面部图像转换为二维的美妆图像，以便于在后续的步骤中将该二维的美妆图像进行投影和呈现。Finally, the rendered face image is converted into a two-dimensional beauty image, so that the two-dimensional beauty image can be projected and presented in subsequent steps.
示例性的，在本发明的这样的实施例中，妆容迁移算法可以包括对妆容模板和三维人脸图像分别进行分层建模，分层建模包括构建光照层、细粒度脸部结构层和细粒度皮肤细节层。进一步的，对分解后的图像进行处理，如对于不同的分层采用不同的手段进行分别再处理或融合，并取决于人脸结构中的一些高亮或阴影的部分使用梯度进行妆容的迁移，从而实现将来自于妆容模板上的妆容直接迁移到准备好的人脸图像中，最终得到美妆图像。Exemplarily, in such an embodiment of the present invention, the makeup transfer algorithm may include layered modeling of makeup templates and three-dimensional face images, respectively, where the layered modeling includes constructing an illumination layer, a fine-grained face structure layer, and Fine-grained skin detail layers. Further, the decomposed images are processed, for example, different layers are used for reprocessing or fusion respectively, and gradients are used to transfer makeup depending on some highlighted or shadowed parts of the face structure, In this way, the makeup from the makeup template is directly transferred to the prepared face image, and finally the beauty image is obtained.
最后，参照图1，步骤14为将美妆图像投影在汽车内的前风挡玻璃或侧窗玻璃上。Finally, referring to FIG. 1 ,
具体来说，将妆容呈现在座舱内的应用场景可以具有不同的变型。例如，在一些场景中，用户需要在车内使用具有美妆效果的人脸图像，如在车内进行视频会议等。此时，在座舱内直接将美妆图像投影在对应的玻璃上位置即可，示例性的，如投影在汽车内的前风挡玻璃上，可以基于具有增强现实功能的抬头显示屏等，但是本发明不以此为限。另一方面，在一些场景中，还可以使得车外的人透过特定位置的玻璃看到具有美妆效果的人脸图像，从而提升汽车的智能感和科技感。例如，在本发明的一些实施例中，还包括通过车外摄像头检测位于车辆前方或侧方的行人的步骤，并最终将美妆图像投影在汽车内的前风挡玻璃或侧窗玻璃的预设区域中，其中，预设区域由行人位置和车内摄像头的位置决定。另外，在这样的实施例中，还包括对车内摄像头进行畸变矫正的步骤，以使得最终呈现的美妆图像更加真实，效果更完善。Specifically, the application scenarios for presenting makeup in the cockpit can have different variants. For example, in some scenarios, users need to use facial images with beauty effects in the car, such as video conferences in the car. At this time, the beauty image can be directly projected on the corresponding glass in the cockpit. For example, it can be projected on the front windshield in the car, based on the head-up display with augmented reality function, etc., but this The invention is not limited to this. On the other hand, in some scenarios, people outside the car can also see face images with beauty effects through the glass in a specific position, thereby enhancing the car's sense of intelligence and technology. For example, in some embodiments of the present invention, the step of detecting pedestrians located in front of or on the side of the vehicle through the exterior camera is further included, and finally the beauty image is projected on the preset front windshield or side window of the car. area, where the preset area is determined by the location of the pedestrian and the location of the in-vehicle camera. In addition, in such an embodiment, the step of performing distortion correction on the in-vehicle camera is also included, so that the final presented beauty makeup image is more realistic and the effect is more perfect.
如图2所示，以通过侧窗玻璃最终在车外呈现美妆图像为例，图2示出了人脸、车内摄像头、侧窗玻璃、行人以及车内投影仪光路方向的位置示意图。在该实施例中，首先对车内摄像头进行标定，并通过车外摄像头检测行人所在位置(例如是行人眉心所在位置)，通过车内摄像头和车外摄像头以及人脸位置的关系，可以找出车外行人可以透过侧窗玻璃的哪个区域看到美妆图像的位置区间，例如是图2示出的A-B的位置区间。这意味着，需要通过车内投影仪将美妆后的图像通过侧窗玻璃A-B的区间投射到车外，由此，区间A-B便为侧窗玻璃的预设区域。示例性的，如果侧窗玻璃采用基于增强显示的显示屏等结构，还需要通过该显示屏做镜像变换以使位于车外的行人看到美妆后的图像。As shown in Figure 2, taking the example of finally presenting a beauty image outside the car through the side window glass, Figure 2 shows a schematic diagram of the positions of the human face, the in-vehicle camera, the side window glass, the pedestrian, and the light path direction of the in-vehicle projector. In this embodiment, the in-vehicle camera is first calibrated, and the location of the pedestrian (for example, the location of the pedestrian's eyebrows) is detected by the out-of-vehicle camera, and the relationship between the in-vehicle camera and the out-of-vehicle camera and the position of the face can be found. The position interval in which a pedestrian outside the vehicle can see the beauty image through which area of the side window glass, for example, the position interval A-B shown in FIG. 2 . This means that the in-car projector needs to project the image after beautification to the outside of the car through the section A-B of the side window glass. Therefore, the section A-B is the preset area of the side window glass. Exemplarily, if a structure such as a display screen based on enhanced display is adopted for the side window glass, mirror transformation needs to be performed on the display screen so that pedestrians outside the vehicle can see the image after beauty makeup.
通过上述的座舱内呈现美妆图像的方法，可以使得用户在不同的应用场景中在座舱内看到、或者使位于车外的行人透过汽车玻璃看到自己的美妆图像，提升了汽车智能感和科技感，提升了即使体验。Through the above method of presenting beauty images in the cockpit, users can see their own beauty images in the cockpit in different application scenarios, or pedestrians outside the car can see their own beauty images through the car glass, which improves the intelligence of the car. The sense of technology and the sense of technology enhances the real-time experience.
参照图3所示，本发明的另一方面还提出了一种座舱内呈现人脸美妆图像的系统30。系统30包括车内摄像头31、车机32以及车内投影仪33。其中，车内摄像头31适于采集座舱内用户的面部图像。车机32进一步包括妆容模板获取模块321以及妆容渲染模块322；其中，妆容模板获取模块321配置为在UV展开图上获取妆容模板，妆容模板包括一个或多个具有妆容的人脸图像；妆容渲染模块322配置为基于预先设置或手动选择的操作，通过妆容迁移算法将妆容模板渲染到面部图像中。最后，车内投影仪33适于将美妆图像投影在汽车内的前风挡玻璃或侧窗玻璃上。Referring to FIG. 3 , another aspect of the present invention also provides a system 30 for presenting a face beauty image in a cockpit. The system 30 includes an in-vehicle camera 31 , an in-vehicle machine 32 and an in-vehicle projector 33 . Wherein, the in-vehicle camera 31 is suitable for collecting the facial image of the user in the cockpit. The car machine 32 further includes a makeup look template obtaining module 321 and a makeup
在图3示出的实施例中，优选地，系统30还包括车外摄像头34。车外摄像头34适于检测位于车辆前方或侧方的行人，此时的车内投影仪33适于将美妆图像投影在汽车内的前风挡玻璃或侧窗玻璃的预设区域中，其中，预设区域由行人位置和车内摄像头31的位置决定。In the embodiment shown in FIG. 3 , preferably, the system 30 further includes an exterior camera 34 . The exterior camera 34 is suitable for detecting pedestrians located in front of or on the side of the vehicle, and the interior projector 33 at this time is suitable for projecting the beauty image on the predetermined area of the front windshield or side window glass in the vehicle, wherein, The preset area is determined by the position of the pedestrian and the position of the in-vehicle camera 31 .
优选地，在本发明的一些实施例中，在座舱内呈现人脸美妆图像的系统中，任一妆容模板中的每一个像素点与任一妆容模板对应的人脸图像转换为三维人脸图像后的三维特征点相对应，在这样的实施例中，如图3所示的车机32还包括三维重建模块，三维重建模块配置为：Preferably, in some embodiments of the present invention, in the system for presenting facial beauty images in the cockpit, each pixel in any makeup template and the face image corresponding to any makeup template are converted into three-dimensional faces Corresponding to the three-dimensional feature points after the image, in such an embodiment, the vehicle 32 shown in FIG. 3 further includes a three-dimensional reconstruction module, and the three-dimensional reconstruction module is configured as:
获取面部图像中的二维人脸关键点；Obtain the two-dimensional face key points in the face image;
通过三维人脸重建方法获得与二维人脸关键点对应的三维人脸关键点，并依据三维人脸关键点构建面部图像对应的三维人脸图像；Obtaining the 3D face key points corresponding to the 2D face key points by the 3D face reconstruction method, and constructing the 3D face image corresponding to the facial image according to the 3D face key points;
基于预先设置或手动选择的操作，将妆容模板渲染到用户的面部图像中，其中，人脸图图像对应的三维特征点与面部头像对应的三维人脸关键点相互对应；以及Rendering the makeup template to the user's facial image based on a preset or manually selected operation, wherein the 3D feature points corresponding to the face map image correspond to the 3D face key points corresponding to the facial avatar; and
将渲染后的面部图像转换为二维的美妆图像。Convert the rendered face image into a 2D beauty image.
如图3所示的系统30可以使用前文参照图1说明的座舱内呈现人脸美妆图像的方法10，因此，其他关于系统30的细节可以参考前文所述，在此不再赘述。The system 30 shown in FIG. 3 can use the
本发明的一实施例还提出了一种如图4所示的座舱内呈现人脸美妆图像的系统40。根据图4，座舱内呈现人脸美妆图像的系统40可包括内部通信总线41、处理器(Processor)42、只读存储器(ROM)43、随机存取存储器(RAM)44、以及通信端口45。当应用在个人计算机上时，座舱内呈现人脸美妆图像的系统40还可以包括硬盘46。An embodiment of the present invention also provides a
内部通信总线41可以实现座舱内呈现人脸美妆图像的系统40组件间的数据通信。处理器42可以进行判断和发出提示。在一些实施例中，处理器42可以由一个或多个处理器组成。通信端口45可以实现座舱内呈现人脸美妆图像的系统40与外部的数据通信。在一些实施例中，座舱内呈现人脸美妆图像的系统40可以通过通信端口45从网络发送和接受信息以及数据。The
座舱内呈现人脸美妆图像的系统40还可以包括不同形式的程序储存单元以及数据储存单元，例如硬盘46，只读存储器(ROM)43和随机存取存储器(RAM)44，能够存储计算机处理和/或通信使用的各种数据文件，以及处理器42所执行的可能的程序指令。处理器执行这些指令以实现方法的主要部分。处理器处理的结果通过通信端口传给用户设备，在用户界面上显示。The
除此之外，本发明另一方面还提出了一种存储有计算机程序代码的计算机可读介质，计算机程序代码在由处理器执行时实现上述的座舱内呈现人脸美妆图像方法。In addition, another aspect of the present invention also provides a computer-readable medium storing computer program codes. The computer program codes, when executed by a processor, implement the above-mentioned method for presenting a facial beauty image in a cockpit.
上文已对基本概念做了描述，显然，对于本领域技术人员来说，上述发明披露仅仅作为示例，而并不构成对本申请的限定。虽然此处并没有明确说明，本领域技术人员可能会对本申请进行各种修改、改进和修正。该类修改、改进和修正在本申请中被建议，所以该类修改、改进、修正仍属于本申请示范实施例的精神和范围。The basic concept has been described above. Obviously, for those skilled in the art, the above disclosure of the invention is only an example, and does not constitute a limitation to the present application. Although not explicitly described herein, various modifications, improvements, and corrections to this application may occur to those skilled in the art. Such modifications, improvements, and corrections are suggested in this application, so such modifications, improvements, and corrections still fall within the spirit and scope of the exemplary embodiments of this application.
同时，本申请使用了特定词语来描述本申请的实施例。如“一个实施例”、“一实施例”、和/或“一些实施例”意指与本申请至少一个实施例相关的某一特征、结构或特点。因此，应强调并注意的是，本说明书中在不同位置两次或多次提及的“一实施例”或“一个实施例”或“一替代性实施例”并不一定是指同一实施例。此外，本申请的一个或多个实施例中的某些特征、结构或特点可以进行适当的组合。Meanwhile, the present application uses specific words to describe the embodiments of the present application. As "one embodiment," "an embodiment," and/or "some embodiments" means a certain feature, structure, or characteristic associated with at least one embodiment of the present application. Therefore, it should be emphasized and noted that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in different places in this specification are not necessarily referring to the same embodiment . Furthermore, certain features, structures or characteristics of the one or more embodiments of the present application may be combined as appropriate.
本申请的一些方面可以完全由硬件执行、可以完全由软件(包括固件、常驻软件、微码等)执行、也可以由硬件和软件组合执行。以上硬件或软件均可被称为“数据块”、“模块”、“引擎”、“单元”、“组件”或“系统”。处理器可以是一个或多个专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理器件(DAPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、处理器、控制器、微控制器、微处理器或者其组合。此外，本申请的各方面可能表现为位于一个或多个计算机可读介质中的计算机产品，该产品包括计算机可读程序编码。例如，计算机可读介质可包括，但不限于，磁性存储设备(例如，硬盘、软盘、磁带……)、光盘(例如，压缩盘CD、数字多功能盘DVD……)、智能卡以及闪存设备(例如，卡、棒、键驱动器……)。Some aspects of the present application may be performed entirely in hardware, entirely in software (including firmware, resident software, microcode, etc.), or in a combination of hardware and software. The above hardware or software may be referred to as a "data block", "module", "engine", "unit", "component" or "system". The processor may be one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DAPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors , controller, microcontroller, microprocessor, or a combination thereof. Furthermore, aspects of the present application may be embodied as a computer product comprising computer readable program code embodied in one or more computer readable media. For example, computer-readable media may include, but are not limited to, magnetic storage devices (eg, hard disks, floppy disks, magnetic tapes, ...), optical disks (eg, compact discs, CDs, digital versatile disks, DVDs, ...), smart cards, and flash memory devices ( For example, cards, sticks, key drives...).
计算机可读介质可能包含一个内含有计算机程序编码的传播数据信号，例如在基带上或作为载波的一部分。该传播信号可能有多种表现形式，包括电磁形式、光形式等等、或合适的组合形式。计算机可读介质可以是除计算机可读存储介质之外的任何计算机可读介质，该介质可以通过连接至一个指令执行系统、装置或设备以实现通讯、传播或传输供使用的程序。位于计算机可读介质上的程序编码可以通过任何合适的介质进行传播，包括无线电、电缆、光纤电缆、射频信号、或类似介质、或任何上述介质的组合。A computer-readable medium may contain a propagated data signal with the computer program code embodied therein, for example, on baseband or as part of a carrier wave. The propagating signal may take a variety of manifestations, including electromagnetic, optical, etc., or a suitable combination. A computer-readable medium can be any computer-readable medium other than a computer-readable storage medium that can communicate, propagate, or transmit a program for use by being coupled to an instruction execution system, apparatus, or device. Program code on a computer readable medium may be propagated by any suitable medium, including radio, cable, fiber optic cable, radio frequency signal, or the like, or a combination of any of the foregoing.
同理，应当注意的是，为了简化本申请披露的表述，从而帮助对一个或多个发明实施例的理解，前文对本申请实施例的描述中，有时会将多种特征归并至一个实施例、附图或对其的描述中。但是，这种披露方法并不意味着本申请对象所需要的特征比权利要求中提及的特征多。实际上，实施例的特征要少于上述披露的单个实施例的全部特征。Similarly, it should be noted that, in order to simplify the expressions disclosed in the present application and thus help the understanding of one or more embodiments of the invention, in the foregoing description of the embodiments of the present application, various features are sometimes combined into one embodiment, in the drawings or descriptions thereof. However, this method of disclosure does not imply that the subject matter of the application requires more features than those mentioned in the claims. Indeed, there are fewer features of an embodiment than all of the features of a single embodiment disclosed above.
一些实施例中使用了描述成分、属性数量的数字，应当理解的是，此类用于实施例描述的数字，在一些示例中使用了修饰词“大约”、“近似”或“大体上”来修饰。除非另外说明，“大约”、“近似”或“大体上”表明所述数字允许有±20％的变化。相应地，在一些实施例中，说明书和权利要求中使用的数值参数均为近似值，该近似值根据个别实施例所需特点可以发生改变。在一些实施例中，数值参数应考虑规定的有效数位并采用一般位数保留的方法。尽管本申请一些实施例中用于确认其范围广度的数值域和参数为近似值，在具体实施例中，此类数值的设定在可行范围内尽可能精确。Some examples use numbers to describe quantities of ingredients and attributes, it should be understood that such numbers used to describe the examples, in some examples, use the modifiers "about", "approximately" or "substantially" to retouch. Unless stated otherwise, "about", "approximately" or "substantially" means that a variation of ±20% is allowed for the stated number. Accordingly, in some embodiments, the numerical parameters set forth in the specification and claims are approximations that can vary depending upon the desired characteristics of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and use a general digit reservation method. Notwithstanding that the numerical fields and parameters used in some embodiments of the present application to confirm the breadth of their ranges are approximations, in particular embodiments such numerical values are set as precisely as practicable.
虽然本申请已参照当前的具体实施例来描述，但是本技术领域中的普通技术人员应当认识到，以上的实施例仅是用来说明本申请，在没有脱离本申请精神的情况下还可作出各种等效的变化或替换，因此，只要在本申请的实质精神范围内对上述实施例的变化、变型都将落在本申请的权利要求书的范围内。Although the present application has been described with reference to the current specific embodiments, those skilled in the art should recognize that the above embodiments are only used to illustrate the present application, and can be made without departing from the spirit of the present application. Various equivalent changes or substitutions, therefore, as long as the changes and modifications to the above-mentioned embodiments within the spirit and scope of the present application, all fall within the scope of the claims of the present application.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210207547.3ACN114581291A (en) | 2022-03-04 | 2022-03-04 | Method and system for presenting facial makeup images in cockpit |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210207547.3ACN114581291A (en) | 2022-03-04 | 2022-03-04 | Method and system for presenting facial makeup images in cockpit |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114581291Atrue CN114581291A (en) | 2022-06-03 |
Family
ID=81775805
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210207547.3APendingCN114581291A (en) | 2022-03-04 | 2022-03-04 | Method and system for presenting facial makeup images in cockpit |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114581291A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115147529A (en)* | 2022-06-22 | 2022-10-04 | 重庆长安汽车股份有限公司 | Face beautifying method based on cockpit |
| US20250218131A1 (en)* | 2023-12-29 | 2025-07-03 | Harman International Industries, Incorporated | Augmented reality for occupants |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105164999A (en)* | 2013-04-17 | 2015-12-16 | 松下知识产权经营株式会社 | Image processing method and image processing device |
| CN109272579A (en)* | 2018-08-16 | 2019-01-25 | Oppo广东移动通信有限公司 | Beauty method, device, electronic device and storage medium based on three-dimensional model |
| JP2020042569A (en)* | 2018-09-11 | 2020-03-19 | 株式会社デンソー | Vehicle decoration image synthesizing apparatus |
| CN111783511A (en)* | 2019-10-31 | 2020-10-16 | 北京沃东天骏信息技术有限公司 | Beauty treatment method, device, terminal and storage medium |
| CN113628322A (en)* | 2021-07-26 | 2021-11-09 | 阿里巴巴（中国）有限公司 | Image processing method, AR display live broadcast method, AR display equipment, AR display live broadcast equipment and storage medium |
| CN113671695A (en)* | 2020-05-15 | 2021-11-19 | 华为技术有限公司 | Head-up display device and head-up display method |
- 2022
- 2022-03-04CNCN202210207547.3Apatent/CN114581291A/enactivePending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105164999A (en)* | 2013-04-17 | 2015-12-16 | 松下知识产权经营株式会社 | Image processing method and image processing device |
| CN109272579A (en)* | 2018-08-16 | 2019-01-25 | Oppo广东移动通信有限公司 | Beauty method, device, electronic device and storage medium based on three-dimensional model |
| JP2020042569A (en)* | 2018-09-11 | 2020-03-19 | 株式会社デンソー | Vehicle decoration image synthesizing apparatus |
| CN111783511A (en)* | 2019-10-31 | 2020-10-16 | 北京沃东天骏信息技术有限公司 | Beauty treatment method, device, terminal and storage medium |
| CN113671695A (en)* | 2020-05-15 | 2021-11-19 | 华为技术有限公司 | Head-up display device and head-up display method |
| CN113628322A (en)* | 2021-07-26 | 2021-11-09 | 阿里巴巴（中国）有限公司 | Image processing method, AR display live broadcast method, AR display equipment, AR display live broadcast equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 言有三: "《深度学习之人脸图像处理：核心算法与案例实战》", vol. 978, 31 July 2020, 机械工业出版社, pages: 264 - 285* |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115147529A (en)* | 2022-06-22 | 2022-10-04 | 重庆长安汽车股份有限公司 | Face beautifying method based on cockpit |
| US20250218131A1 (en)* | 2023-12-29 | 2025-07-03 | Harman International Industries, Incorporated | Augmented reality for occupants |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108447017B (en) | Face virtual face-lifting method and device | |
| US12354228B2 (en) | Generating 3D data in a messaging system | |
| KR102697772B1 (en) | Augmented reality content generators that include 3D data within messaging systems | |
| US11457196B2 (en) | Effects for 3D data in a messaging system | |
| US20210065448A1 (en) | Providing 3d data for messages in a messaging system | |
| CN106846410B (en) | Driving environment imaging method and device based on three dimensions | |
| CN105701863B (en) | The method and apparatus of image procossing | |
| CN113646736A (en) | Gesture recognition method, device, system and vehicle | |
| KR20220051376A (en) | 3D Data Generation in Messaging Systems | |
| CN114581291A (en) | Method and system for presenting facial makeup images in cockpit | |
| JP2017220923A (en) | Image generating apparatus, image generating method, and program | |
| CN109754363B (en) | Around-the-eye image synthesis method and device based on fish eye camera | |
| WO2019237745A1 (en) | Facial image processing method and apparatus, electronic device and computer readable storage medium | |
| WO2023050677A1 (en) | Vehicle, image capture method and apparatus, device, storage medium, and computer program product | |
| CN109584358A (en) | A kind of three-dimensional facial reconstruction method and device, equipment and storage medium | |
| CN111680758B (en) | Image training sample generation method and device | |
| CN110378947A (en) | 3D model reconstruction method, device and electronic equipment | |
| WO2022134441A1 (en) | Image processing method, device and system, and computer readable medium | |
| JPWO2019230169A1 (en) | Display control device, program and display control method | |
| JP2024041895A (en) | Modular image interpolation method | |
| CN116863078B (en) | Three-dimensional human body model reconstruction method, device, electronic device and readable medium | |
| CN113888645A (en) | Driving equipment, computer vision processing method and device and electronic equipment | |
| CN114120260A (en) | Method and system for identifying travelable area, computer device, and storage medium | |
| CN111489323B (en) | Dual light field image fusion method, device, equipment and readable storage medium | |
| CN112967201A (en) | Image illumination adjusting method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | Address after:314500 988 Tong Tong Road, Wu Tong Street, Tongxiang, Jiaxing, Zhejiang Applicant after:United New Energy Automobile Co.,Ltd. Address before:314500 988 Tong Tong Road, Wu Tong Street, Tongxiang, Jiaxing, Zhejiang Applicant before:Hozon New Energy Automobile Co., Ltd. | |
| CB02 | Change of applicant information |