Movatterモバイル変換


[0]ホーム

URL:


CN105046661A - Method, apparatus and intelligent terminal for improving video beautification efficiency - Google Patents

Method, apparatus and intelligent terminal for improving video beautification efficiency
Download PDF

Info

Publication number
CN105046661A
CN105046661ACN201510386633.5ACN201510386633ACN105046661ACN 105046661 ACN105046661 ACN 105046661ACN 201510386633 ACN201510386633 ACN 201510386633ACN 105046661 ACN105046661 ACN 105046661A
Authority
CN
China
Prior art keywords
face area
current frame
preset range
frame
beautification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510386633.5A
Other languages
Chinese (zh)
Other versions
CN105046661B (en
Inventor
吴磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp LtdfiledCriticalGuangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201510386633.5ApriorityCriticalpatent/CN105046661B/en
Publication of CN105046661ApublicationCriticalpatent/CN105046661A/en
Application grantedgrantedCritical
Publication of CN105046661BpublicationCriticalpatent/CN105046661B/en
Expired - Fee Relatedlegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Landscapes

Abstract

The invention discloses a method, apparatus and intelligent terminal for improving video beautification efficiency. The method includes obtaining the face area of a current frame, and beautifying the face area of the current frame according to the beautifying effect of the face area of the last frame, if the overlapping rate of the face area of the current frame with the face area of the last frame reaches a preset scope. When the overlapping rate of the face area of the current frame with the face area of the last frame reaches a preset scope, the face area of the current frame is beautified according to the beautifying effect of the face area of the last frame. In this way, beautifying a video for each frame one by one is not required, and the video beautification efficiency is improved.

Description

Translated fromChinese
一种提升视频美颜效率的方法、装置及智能终端A method, device and intelligent terminal for improving the efficiency of video beautification

技术领域technical field

本发明涉及视频美颜技术领域,尤其涉及一种提升视频美颜效率的方法、装置及智能终端。The present invention relates to the technical field of video beautification, in particular to a method, device and intelligent terminal for improving the efficiency of video beautification.

背景技术Background technique

现在的移动终端,除了在拍照的时候进行美颜外,在视频录制及视频聊天的时候,也需要进行实时美颜以满足用户爱美的心,现在视频美颜常见的方式是针对视频的每一帧进行美化,往往会造成美化效率低,导致视频录制的卡顿,视频整体效果不够流畅,降低了用户的体验度。Today’s mobile terminals, in addition to beautifying when taking pictures, also need to perform real-time beautification during video recording and video chatting to satisfy users’ love for beauty. Now the common way of video beautification is to target each frame of the video Beautification often results in low beautification efficiency, resulting in video recording freezes, and the overall effect of the video is not smooth enough, which reduces the user experience.

发明内容Contents of the invention

本发明的目的在于提出一种提升视频美颜效率的方法、装置及智能终端,若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围时,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域,不需要对视频进行逐帧美颜,提高了视频美颜的效率。The purpose of the present invention is to propose a method, device and intelligent terminal for improving the efficiency of video beautification. The face area beautification effect is used to beautify the face area of the current frame without performing frame-by-frame beautification on the video, which improves the efficiency of video beautification.

为达此目的,本发明采用以下技术方案:For reaching this purpose, the present invention adopts following technical scheme:

一方面,本发明提供一种提升视频美颜效率的方法,包括:On the one hand, the present invention provides a method for improving the efficiency of video beautification, including:

获取当前帧的人脸区域;Get the face area of the current frame;

若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域。If the overlapping rate of the face area of the current frame and the face area of the previous frame reaches a preset range, the face area of the current frame is beautified according to the beautification effect of the face area of the previous frame.

另一方面,本发明还提出一种提升视频美颜效率的装置,包括:On the other hand, the present invention also proposes a device for improving the efficiency of video beautification, including:

人脸区域获取单元,用于获取当前帧的人脸区域;A human face area acquiring unit, configured to acquire the human face area of the current frame;

承接美化单元,用于若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域。The beautification unit is used to beautify the face area of the current frame according to the beautification effect of the face area of the previous frame if the overlap rate of the face area of the current frame and the face area of the previous frame reaches a preset range.

第三方面,本发明提出一种智能终端,所述智能移动终端包括任一项所述的提升视频美颜效率的装置。In a third aspect, the present invention provides an intelligent terminal, and the intelligent mobile terminal includes any device for improving the efficiency of video beautification.

本发明提供的技术方案带来的有益效果:The beneficial effects brought by the technical solution provided by the invention:

为解决视频美颜效率低的问题,本发明提出了一种提升视频美颜效率的解决方案,获取当前帧的人脸区域,若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域;本发明提供的技术方案通过比较当前帧与上一帧人脸区域的重合率,判断是否可以根据上一帧的人脸区域美化效果直接对当前帧进行美化;不需要对视频进行逐帧美颜,提高了视频美颜的效率。In order to solve the problem of low efficiency of video beautification, the present invention proposes a solution to improve the efficiency of video beautification, obtain the face area of the current frame, if the face area of the current frame overlaps with the face area of the previous frame rate reaches the preset range, beautify the face area of the current frame according to the beautification effect of the face area of the previous frame; the technical solution provided by the present invention judges whether The current frame can be beautified directly according to the face area beautification effect of the previous frame; there is no need to perform frame-by-frame beautification on the video, which improves the efficiency of video beautification.

附图说明Description of drawings

图1是本发明提升视频美颜效率的方法的第一实施例的方法流程图。Fig. 1 is a method flowchart of the first embodiment of the method for improving the efficiency of video beautification according to the present invention.

图2是本发明提升视频美颜效率的方法的第二实施例的方法流程图。Fig. 2 is a method flowchart of the second embodiment of the method for improving the efficiency of video beautification according to the present invention.

图3是本发明提升视频美颜效率的装置的第一实施例的结构方框图。Fig. 3 is a structural block diagram of the first embodiment of the device for improving the efficiency of video beautification according to the present invention.

图4是本发明提升视频美颜效率的装置的第二实施例的结构方框图。Fig. 4 is a structural block diagram of the second embodiment of the device for improving the efficiency of video beautification according to the present invention.

具体实施方式detailed description

下面结合附图并通过具体实施方式来进一步说明本发明的技术方案。The technical solution of the present invention will be further described below in conjunction with the accompanying drawings and through specific implementation methods.

实施例一Embodiment one

参照图1,图1是本发明提升视频美颜效率的方法的第一实施例的方法流程图。Referring to FIG. 1 , FIG. 1 is a method flowchart of the first embodiment of the method for improving the efficiency of video beautification according to the present invention.

在第一实施例中,该提升视频美颜效率的方法包括:In the first embodiment, the method for improving the efficiency of video beautification includes:

S101,获取当前帧的人脸区域;S101, acquiring the face area of the current frame;

S102,若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域。S102. If the overlapping rate of the face area of the current frame and the face area of the previous frame reaches a preset range, beautify the face area of the current frame according to the beautification effect of the face area of the previous frame.

对一帧图像进行美颜的基本步骤为:The basic steps for beautifying a frame of image are:

通过图像检测技术调用人脸识别模块,获取人脸的坐标区域;Call the face recognition module through image detection technology to obtain the coordinate area of the face;

调用美颜模块当中的人脸建模模块进行人脸建模得到人脸模型;Call the face modeling module in the beauty module to perform face modeling to obtain a face model;

对上述人脸模型进行区域划分,根据各区域的肤色计算出人脸区域中需要进行美颜的部分;Carry out region division to above-mentioned human face model, calculate the part that needs to carry out beautification in human face region according to the skin color of each region;

对上述需要进行美颜的部分进行美化磨皮等操作,得到美化之后的人脸区域。Perform operations such as beautification and microdermabrasion on the above-mentioned parts that need to be beautified to obtain the beautified face area.

用户在进行美颜视频录制的时候,一般不会有过大幅度的面部移动及晃动,因此当前帧与上一帧的人脸区域的重合率是比较大的,若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,使用上一帧美化之后的人脸区域对当前帧的人脸区域进行美化。When the user is recording beauty video, generally there will not be a large amount of facial movement and shaking, so the overlap rate of the face area of the current frame and the previous frame is relatively large. If the face area of the current frame and the The overlap rate of the face area of the previous frame reaches the preset range, and the face area of the current frame is beautified by using the beautified face area of the previous frame.

综上,本发明实施例提升视频美颜效率的方法,获取当前帧的人脸区域,若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域;根据当前帧的人脸区域与上一帧的人脸区域的重合率,判断是否根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域;不需要对视频进行逐帧美颜,提高了视频美颜的效率,同时提高了用户的体验度。To sum up, the method for improving the efficiency of video beautification in the embodiment of the present invention is to obtain the face area of the current frame, and if the overlap rate of the face area of the current frame and the face area of the previous frame reaches the preset Beautify the face area of the current frame with the beautification effect of the face area of the current frame; judge whether to beautify according to the beautification effect of the face area of the previous frame according to the overlap rate of the face area of the current frame and the face area of the previous frame The face area of the current frame does not need to beautify the video frame by frame, which improves the efficiency of video beautification and improves user experience at the same time.

实施例二Embodiment two

参照图2,图2是本发明提升视频美颜效率的方法的第二实施例的方法流程图。Referring to FIG. 2 , FIG. 2 is a method flowchart of the second embodiment of the method for improving the efficiency of video beautification according to the present invention.

在第二实施例中,该提升视频美颜效率的方法包括:In the second embodiment, the method for improving the efficiency of video beautification includes:

S201,获取当前帧的人脸区域;S201, acquiring the face area of the current frame;

S202,判断所述当前帧的人脸区域与上一帧的人脸区域的重合率是否达到预设范围;若是同时继续步骤S203和步骤S204,若不是继续步骤S207;S202, judging whether the overlap rate of the face area of the current frame and the face area of the previous frame reaches a preset range; if it is, continue to step S203 and step S204 at the same time, if not, continue to step S207;

所述预设范围包括第一预设范围和第二预设范围,所述第一预设范围的下限大于等于所述第二预设范围的上限,若当前帧的人脸区域与上一帧的人脸区域的重合率落入这两个范围分别采用不同的美化方法,重合率没有落入这两个范围的当前帧的人脸区域采用常规的美化方法,即逐帧视频美颜。The preset range includes a first preset range and a second preset range, the lower limit of the first preset range is greater than or equal to the upper limit of the second preset range, if the face area of the current frame is the same as that of the previous frame Different beautification methods are used if the coincidence rate of the face area falls into these two ranges, and the conventional beautification method is used for the face area of the current frame whose coincidence rate does not fall into these two ranges, that is, frame-by-frame video beautification.

S203,判断重合率是否达到第一预设范围,若是继续步骤S205;S203, judging whether the overlapping rate reaches the first preset range, if so, continue to step S205;

S204,判断重合率是否达到第二预设范围,若是继续步骤S206;S204, judging whether the overlapping rate reaches the second preset range, if so, continue to step S206;

S205,用上一帧美化之后的人脸区域刷新当前帧的人脸区域;S205, using the beautified face area of the previous frame to refresh the face area of the current frame;

若当前帧的人脸区域与上一帧的人脸区域的重合率落入第一预设范围,确定当前帧的人脸区域之后,用上一帧美化之后的人脸区域刷新当前帧的人脸区域,无需按照常规的美化方法逐步进行;If the overlap rate between the face area of the current frame and the face area of the previous frame falls within the first preset range, after determining the face area of the current frame, refresh the face area of the current frame with the beautified face area of the previous frame Face area, no need to follow the conventional beautification method step by step;

优选的,该第一预设范围为[90%,100%]。Preferably, the first preset range is [90%, 100%].

S206,将所述当前帧的人脸区域进行预定范围的平移,并继续步骤S203;S206. Translate the face area of the current frame within a predetermined range, and continue to step S203;

若当前帧的人脸区域与上一帧的人脸区域的重合率落入第二预设范围,确定当前帧的人脸区域之后,将其进行预定范围的平移,若平移之后当前帧的人脸区域与上一帧的人脸区域的重合率落入了第一预设范围,用上一帧美化之后的人脸区域刷新当前帧的人脸区域。If the coincidence rate between the face area of the current frame and the face area of the previous frame falls within the second preset range, after the face area of the current frame is determined, it will be translated within a predetermined range. The overlap rate of the face area and the face area of the previous frame falls within the first preset range, and the face area of the current frame is refreshed with the beautified face area of the previous frame.

优选的,该第二预设范围为[70%,90%)。Preferably, the second preset range is [70%, 90%).

若平移之后当前帧的人脸区域无法落入预设范围,表明当前帧与上一帧的人脸区域发生了大幅度的移动或晃动,此时不能根据上一帧的美化效果对当前帧进行美化,需按照常规的美化方法进行美化,即逐帧美颜。If the face area of the current frame cannot fall into the preset range after panning, it means that the face area of the current frame and the previous frame have moved or shaken a lot. At this time, the current frame cannot be modified according to the beautification effect of the previous frame. Beautification needs to be beautified according to the conventional beautification method, that is, frame-by-frame beautification.

S207,调用人脸建模模块对所述人脸区域进行建模得到人脸模型;S207, calling the face modeling module to model the face area to obtain a face model;

S208,获取所述人脸模型中需要进行美颜的部分;S208, acquiring the part of the face model that needs to be beautified;

S209,对所述需要进行美颜的部分进行美化,得到美化之后的人脸区域。S209. Beautify the portion to be beautified to obtain a beautified human face area.

步骤S207~S209为逐帧美颜的基本步骤。Steps S207-S209 are the basic steps of frame-by-frame beautification.

综上,本发明实施例提升视频美颜效率的方法,获取当前帧的人脸区域之后,判断当前帧的人脸区域与上一帧的人脸区域的重合率是否落入第一预设范围或者第二预设范围;若该重合率落入第二预设范围,则对当前帧的人脸区域进行预定范围的平移,若平移之后的重合率落入第一预设范围,用上一帧美化之后的人脸区域刷新当前帧的人脸区域。根据当前帧的人脸区域与上一帧的人脸区域的重合率,分两种情况对当前帧的人脸区域其进行基于上一帧美化效果的处理,不需要对视频进行逐帧美颜,提高了视频美颜的效率,同时提高了用户的体验度。To sum up, the method for improving the efficiency of video beautification in the embodiment of the present invention, after obtaining the face area of the current frame, judges whether the overlap rate between the face area of the current frame and the face area of the previous frame falls within the first preset range Or the second preset range; if the coincidence rate falls into the second preset range, the face area of the current frame is shifted within a predetermined range, if the coincidence rate after translation falls into the first preset range, use the last The face area after frame beautification refreshes the face area of the current frame. According to the overlap rate between the face area of the current frame and the face area of the previous frame, the face area of the current frame is processed based on the beautification effect of the previous frame in two cases, and there is no need to perform frame-by-frame beautification on the video , which improves the efficiency of video beautification and improves user experience.

以下为本方案一种提升视频美颜效率的装置的实施例,提升视频美颜效率的装置的实施例基于提升视频美颜效率的方法的实施例实现,在装置的实施例中未尽的描述,请参考方法的实施例。The following is an embodiment of a device for improving the efficiency of video beautification in this solution. The embodiment of the device for improving the efficiency of video beautification is realized based on the embodiment of the method for improving the efficiency of video beautification. The description in the embodiment of the device is not exhaustive. , please refer to the example of the method.

实施例三Embodiment three

参照图3,图3是本发明提升视频美颜效率的装置的第一实施例的结构方框图。Referring to FIG. 3 , FIG. 3 is a structural block diagram of the first embodiment of the device for improving the efficiency of video beautification according to the present invention.

在第三实施例中,该提升视频美颜效率的装置包括:In the third embodiment, the device for improving the efficiency of video beautification includes:

人脸区域获取单元101,用于获取当前帧的人脸区域。A human face area acquisition unit 101 is configured to acquire the human face area of the current frame.

承接美化单元102,用于若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域。Undertake the beautification unit 102, be used to beautify the face area of the current frame according to the beautification effect of the face area of the previous frame if the overlap rate of the face area of the current frame and the face area of the previous frame reaches a preset range .

用户在进行美颜视频录制的时候,一般不会有过大幅度的面部移动及晃动,因此当前帧与上一帧的人脸区域的重合率是比较大的,若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,使用上一帧美化之后的人脸区域对当前帧的人脸区域进行美化。When the user is recording beauty video, generally there will not be a large amount of facial movement and shaking, so the overlap rate of the face area of the current frame and the previous frame is relatively large. If the face area of the current frame and the The overlap rate of the face area of the previous frame reaches the preset range, and the face area of the current frame is beautified by using the beautified face area of the previous frame.

综上,本发明实施例提升视频美颜效率的装置,获取当前帧的人脸区域,若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域;根据当前帧的人脸区域与上一帧的人脸区域的重合率,判断是否根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域;不需要对视频进行逐帧美颜,提高了视频美颜的效率,同时提高了用户的体验度。To sum up, the device for improving the efficiency of video beautification in the embodiment of the present invention obtains the face area of the current frame. If the overlap rate of the face area of the current frame and the face area of the previous frame reaches the preset range, according to the Beautify the face area of the current frame with the beautification effect of the face area of the current frame; judge whether to beautify according to the beautification effect of the face area of the previous frame according to the overlap rate of the face area of the current frame and the face area of the previous frame The face area of the current frame does not need to beautify the video frame by frame, which improves the efficiency of video beautification and improves user experience at the same time.

实施例四Embodiment four

参照图4,图4是本发明提升视频美颜效率的装置的第二实施例的结构方框图。Referring to Fig. 4, Fig. 4 is a structural block diagram of the second embodiment of the device for improving the efficiency of video beautification according to the present invention.

在第四实施例中,在第三实施例的基础上,该提升视频美颜效率的装置还包括:In the fourth embodiment, on the basis of the third embodiment, the device for improving video beautification efficiency further includes:

所述承接美化单元102包括:Described undertaking beautification unit 102 comprises:

刷新单元1022,用于若当前帧的人脸区域与上一帧的人脸区域的重合率达到第一预设范围时,用上一帧美化之后的人脸区域刷新当前帧的人脸区域。Refresh unit 1022, configured to refresh the face area of the current frame with the beautified face area of the previous frame when the overlap rate between the face area of the current frame and the face area of the previous frame reaches a first preset range.

平移单元1021,用于若当前帧的人脸区域与上一帧的人脸区域的重合率达到第二预设范围时,将所述当前帧的人脸区域进行预定范围的平移。The translation unit 1021 is configured to translate the human face area of the current frame within a predetermined range when the overlap ratio between the human face area of the current frame and the human face area of the previous frame reaches a second preset range.

所述刷新单元1022还用于,若平移之后当前帧的人脸区域与所述上一帧的人脸区域重合率落入所述第一预设范围内,用上一帧美化之后的人脸区域刷新当前帧的人脸区域。The refresh unit 1022 is further configured to, if the coincidence rate of the face area of the current frame and the face area of the previous frame falls within the first preset range after translation, use the face after beautification of the previous frame Region refreshes the face region of the current frame.

比较当前帧的人脸区域与上一帧的人脸区域,得到二者的重合率,若该重合率落入第一预设范围,直接用上一帧美化之后的人脸区域刷新当前帧的人脸区域;若该重合率落入第二预设范围,对当前帧的人脸区域进行预定范围的平移,即上下左右移动,若平移之后当前帧的人脸区域与上一帧的人脸区域的重合率落入了第一预设范围,用上一帧美化之后的人脸区域刷新当前帧的人脸区域。Compare the face area of the current frame with the face area of the previous frame to obtain the coincidence rate of the two. If the coincidence rate falls into the first preset range, directly refresh the face area of the current frame with the beautified face area of the previous frame. Face area; if the overlap rate falls into the second preset range, the face area of the current frame is shifted within a predetermined range, that is, up, down, left, and right. If the face area of the current frame is the same as the face of the previous frame after the translation The overlap rate of the area falls into the first preset range, and the face area of the current frame is refreshed with the beautified face area of the previous frame.

第一预设范围设置单元104,用于设置所述第一预设范围。The first preset range setting unit 104 is configured to set the first preset range.

第二预设范围设置单元105,用于设置所述第二预设范围。The second preset range setting unit 105 is configured to set the second preset range.

上述预设范围包括第一预设范围和第二预设范围,将当前帧的人脸区域与上一帧的人脸区域的重合率划分为两个区域,优选的,第一预设范围为[90%,100%];第二预设范围为[70%,90%)。The above preset range includes a first preset range and a second preset range, and the overlap rate of the face area of the current frame and the face area of the previous frame is divided into two areas. Preferably, the first preset range is [90%, 100%]; the second preset range is [70%, 90%).

判断单元103,用于判断当前帧的人脸区域与上一帧的人脸区域的重合率是否达到预设范围;所述预设范围包括第一预设范围和第二预设范围。The judging unit 103 is configured to judge whether the overlap rate of the face area of the current frame and the face area of the previous frame reaches a preset range; the preset range includes a first preset range and a second preset range.

判断单元103同时判断上述重合率是否落入了第一预设范围或者第二预设范围。The judging unit 103 simultaneously judges whether the above-mentioned overlap rate falls within the first preset range or the second preset range.

建模单元106,用于在所述判断单元的判断结果为否时,调用人脸建模模块对所述人脸区域进行建模得到人脸模型。The modeling unit 106 is configured to call a face modeling module to model the face area to obtain a face model when the judgment result of the judgment unit is negative.

区域获取单元107,用于获取所述人脸模型中需要进行美颜的部分。The area acquisition unit 107 is configured to acquire the part of the face model that needs to be beautified.

美颜处理单元108,用于对所述需要进行美颜的部分进行美化,得到美化之后的人脸区域。The beautification processing unit 108 is configured to beautify the portion to be beautified to obtain a beautified human face area.

以上三个单元用于常规美化,即逐帧视频美化方法,通过图像处理技术获取人脸区域之后,调用人脸建模模块得到人脸模型,然后对该人脸模型进行区域划分,根据各区域的肤色找到人脸模型中需要美颜的部分,并对其进行磨皮等美化处理。The above three units are used for conventional beautification, that is, the frame-by-frame video beautification method. After obtaining the face area through image processing technology, the face modeling module is called to obtain the face model, and then the face model is divided into regions. Find the part of the face model that needs to be beautified according to the skin color, and perform beautification such as skin smoothing on it.

综上,本发明实施例提升视频美颜效率的装置,获取当前帧的人脸区域之后,判断当前帧的人脸区域与上一帧的人脸区域的重合率是否落入第一预设范围或者第二预设范围;若该重合率落入第二预设范围,则对当前帧的人脸区域进行预定范围的平移,若平移之后的重合率落入第一预设范围,用上一帧美化之后的人脸区域刷新当前帧的人脸区域。根据当前帧的人脸区域与上一帧的人脸区域的重合率,分两种情况对当前帧的人脸区域其进行基于上一帧美化效果的处理,不需要对视频进行逐帧美颜,提高了视频美颜的效率,同时提高了用户的体验度。To sum up, the device for improving the efficiency of video beautification in the embodiment of the present invention, after obtaining the face area of the current frame, judges whether the overlap rate between the face area of the current frame and the face area of the previous frame falls within the first preset range Or the second preset range; if the coincidence rate falls into the second preset range, the face area of the current frame is shifted within a predetermined range, if the coincidence rate after translation falls into the first preset range, use the last The face area after frame beautification refreshes the face area of the current frame. According to the overlap rate between the face area of the current frame and the face area of the previous frame, the face area of the current frame is processed based on the beautification effect of the previous frame in two cases, and there is no need to perform frame-by-frame beautification on the video , which improves the efficiency of video beautification and improves user experience.

实施例五Embodiment five

该实施例为本发明一种智能终端的实施例。This embodiment is an embodiment of an intelligent terminal in the present invention.

该智能终端包括以上装置实施例3和4任一项所述的提升视频美颜效率的装置。The smart terminal includes the device for improving the efficiency of video beautification described in any one of the above device embodiments 3 and 4.

该智能终端包括相机、手机、平板、笔记本,台式电脑等可以摄影的设备。The smart terminal includes cameras, mobile phones, tablets, notebooks, desktop computers and other devices that can take pictures.

综上,通过本实施例提供的智能终端,在用户进行视频聊天或视频拍摄时,获取当前帧的人脸区域,若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域;根据当前帧的人脸区域与上一帧的人脸区域的重合率,判断是否根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域;不需要对视频进行逐帧美颜,提高了视频美颜的效率,同时提高了用户的体验度。To sum up, through the intelligent terminal provided by this embodiment, when the user performs video chat or video shooting, the face area of the current frame is obtained. If the overlap rate of the face area of the current frame and the face area of the previous frame reaches Set the range, beautify the face area of the current frame according to the beautification effect of the face area of the previous frame; The face area beautification effect is used to beautify the face area of the current frame; there is no need to perform frame-by-frame beautification on the video, which improves the efficiency of video beautification and improves user experience at the same time.

以上结合具体实施例描述了本发明的技术原理。这些描述只是为了解释本发明的原理,而不能以任何方式解释为对本发明保护范围的限制。基于此处的解释,本领域的技术人员不需要付出创造性的劳动即可联想到本发明的其它具体实施方式,这些方式都将落入本发明的保护范围之内。The above describes the technical principles of the present invention in conjunction with specific embodiments. These descriptions are only for explaining the principles of the present invention, and cannot be construed as limiting the protection scope of the present invention in any way. Based on the explanations herein, those skilled in the art can think of other specific implementation modes of the present invention without creative efforts, and these modes will all fall within the protection scope of the present invention.

Claims (10)

Translated fromChinese
1.一种提升视频美颜效率的方法,其特征在于,包括:1. A method for improving video beauty efficiency, comprising:获取当前帧的人脸区域;Get the face area of the current frame;若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域。If the overlapping rate of the face area of the current frame and the face area of the previous frame reaches a preset range, the face area of the current frame is beautified according to the beautification effect of the face area of the previous frame.2.根据权利要求1所述的方法,其特征在于,所述预设范围包括第一预设范围和第二预设范围,所述第一预设范围的下限大于等于所述第二预设范围的上限。2. The method according to claim 1, wherein the preset range includes a first preset range and a second preset range, and the lower limit of the first preset range is greater than or equal to the second preset range The upper limit of the range.3.根据权利要求2所述的方法,其特征在于,若当前帧的人脸区域与上一帧的人脸区域的重合率达到第一预设范围时,所述根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域具体为:用上一帧美化之后的人脸区域刷新当前帧的人脸区域。3. The method according to claim 2, wherein if the overlap rate between the face area of the current frame and the face area of the previous frame reaches a first preset range, the face The area beautification effect to beautify the face area of the current frame specifically includes: refreshing the face area of the current frame with the beautified face area of the previous frame.4.根据权利要求2所述的方法,其特征在于,若当前帧的人脸区域与上一帧的人脸区域的重合率达到第二预设范围时,所述根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域具体为:将所述当前帧的人脸区域进行预定范围的平移,若平移之后当前帧的人脸区域与所述上一帧的人脸区域重合率落入所述第一预设范围内,用上一帧美化之后的人脸区域刷新当前帧的人脸区域。4. The method according to claim 2, wherein if the overlap rate between the face area of the current frame and the face area of the previous frame reaches a second preset range, the face The area beautification effect to beautify the face area of the current frame is specifically: to translate the face area of the current frame within a predetermined range, if the face area of the current frame is different from the face area of the previous frame after the translation If the coincidence rate falls within the first preset range, the face area of the current frame is refreshed with the beautified face area of the previous frame.5.根据权利要求1所述的方法,其特征在于,所述获取当前帧的人脸区域之后,还包括:判断所述当前帧的人脸区域与上一帧的人脸区域的重合率是否达到预设范围;5. The method according to claim 1, characterized in that, after the acquisition of the face area of the current frame, further comprising: judging whether the overlap rate between the face area of the current frame and the face area of the previous frame reached the preset range;若当前帧的人脸区域与上一帧的人脸区域的重合率未达到所述预设范围,重新调用人脸建模模块对所述当前帧的人脸区域进行建模得到人脸模型;If the coincidence rate of the face area of the current frame and the face area of the previous frame does not reach the preset range, re-call the face modeling module to model the face area of the current frame to obtain a face model;获取所述人脸模型中需要进行美颜的部分;Obtaining the part of the face model that needs to be beautified;对所述需要进行美颜的部分进行美化,得到美化之后的人脸区域。Beautify the part that needs to be beautified to obtain the beautified human face area.6.根据权利要求5所述的方法,其特征在于,所述对所述需要进行美颜的部分进行美化具体为:对所述需要进行美颜的部分进行磨皮操作。6 . The method according to claim 5 , wherein the beautifying the part that needs to be beautified is specifically: performing a skin grinding operation on the part that needs to be beautified.7.一种提升视频美颜效率的装置,其特征在于,包括:7. A device for improving the efficiency of video beautification, characterized in that it comprises:人脸区域获取单元,用于获取当前帧的人脸区域;A human face area acquiring unit, configured to acquire the human face area of the current frame;承接美化单元,用于若当前帧的人脸区域与上一帧的人脸区域的重合率达到预设范围,根据上一帧的人脸区域美化效果来美化所述当前帧的人脸区域。The beautification unit is used to beautify the face area of the current frame according to the beautification effect of the face area of the previous frame if the overlap rate of the face area of the current frame and the face area of the previous frame reaches a preset range.8.根据权利要求7所述的装置,其特征在于,所述承接美化单元包括:8. The device according to claim 7, characterized in that, the receiving and beautifying unit comprises:刷新单元,用于若当前帧的人脸区域与上一帧的人脸区域的重合率达到第一预设范围时,用上一帧美化之后的人脸区域刷新当前帧的人脸区域;Refresh unit, for if the coincidence rate of the face area of the current frame and the face area of the previous frame reaches the first preset range, refresh the face area of the current frame with the face area of the previous frame beautified;平移单元,用于若当前帧的人脸区域与上一帧的人脸区域的重合率达到第二预设范围时,将所述当前帧的人脸区域进行预定范围的平移;The translation unit is used to translate the human face area of the current frame within a predetermined range if the overlap rate between the human face area of the current frame and the human face area of the previous frame reaches a second preset range;所述刷新单元还用于,若平移之后当前帧的人脸区域与所述上一帧的人脸区域重合率落入所述第一预设范围内,用上一帧美化之后的人脸区域刷新当前帧的人脸区域;The refresh unit is also used for, if the coincidence ratio between the face area of the current frame and the face area of the previous frame falls within the first preset range after translation, use the face area after beautification of the previous frame Refresh the face area of the current frame;其中,所述第一预设范围的下限大于等于所述第二预设范围的上限。Wherein, the lower limit of the first preset range is greater than or equal to the upper limit of the second preset range.9.根据权利要求7所述的装置,其特征在于,还包括:9. The device according to claim 7, further comprising:判断单元,用于判断当前帧的人脸区域与上一帧的人脸区域的重合率是否达到预设范围;A judging unit, configured to judge whether the overlap rate of the face area of the current frame and the face area of the previous frame reaches a preset range;建模单元,用于在所述判断单元的判断结果为否时,对所述当前帧的人脸区域进行建模得到人脸模型;A modeling unit, configured to model the face area of the current frame to obtain a face model when the judgment result of the judgment unit is No;区域获取单元,用于获取所述人脸模型中需要进行美颜的部分;an area acquisition unit, configured to acquire the part of the face model that needs to be beautified;美颜处理单元,用于对所述需要进行美颜的部分进行美化,得到美化之后的人脸区域。The beautification processing unit is configured to beautify the part to be beautified to obtain the beautified human face area.10.一种智能终端,其特征在于,所述智能移动终端包括如权利要求7-9任一项所述的提升视频美颜效率的装置。10. An intelligent terminal, characterized in that the intelligent mobile terminal comprises the device for improving the efficiency of video beautification according to any one of claims 7-9.
CN201510386633.5A2015-07-022015-07-02A kind of method, apparatus and intelligent terminal for lifting video U.S. face efficiencyExpired - Fee RelatedCN105046661B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201510386633.5ACN105046661B (en)2015-07-022015-07-02A kind of method, apparatus and intelligent terminal for lifting video U.S. face efficiency

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201510386633.5ACN105046661B (en)2015-07-022015-07-02A kind of method, apparatus and intelligent terminal for lifting video U.S. face efficiency

Publications (2)

Publication NumberPublication Date
CN105046661Atrue CN105046661A (en)2015-11-11
CN105046661B CN105046661B (en)2018-04-06

Family

ID=54453181

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201510386633.5AExpired - Fee RelatedCN105046661B (en)2015-07-022015-07-02A kind of method, apparatus and intelligent terminal for lifting video U.S. face efficiency

Country Status (1)

CountryLink
CN (1)CN105046661B (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN105979195A (en)*2016-05-262016-09-28努比亚技术有限公司Video image processing apparatus and method
WO2017084011A1 (en)*2015-11-162017-05-26华为技术有限公司Method and apparatus for smoothing video
CN106791347A (en)*2015-11-202017-05-31比亚迪股份有限公司A kind of image processing method, device and the mobile terminal using the method
CN107657590A (en)*2017-09-012018-02-02北京小米移动软件有限公司Image processing method and device
CN108428214A (en)*2017-02-132018-08-21阿里巴巴集团控股有限公司A kind of image processing method and device
CN108629730A (en)*2018-05-212018-10-09深圳市梦网科技发展有限公司Video U.S. face method, apparatus and terminal device
CN108762829A (en)*2018-05-032018-11-06北京奇虎科技有限公司A kind of method, client and terminal for image beautification
CN109002776A (en)*2018-06-292018-12-14金蝶软件(中国)有限公司Face identification method, system, computer equipment and computer readable storage medium
CN109190576A (en)*2018-09-132019-01-11深圳市梦网百科信息技术有限公司A kind of more people's U.S. face methods of adjustment and system based on video multidate information
CN113994652A (en)*2019-04-032022-01-28三星电子株式会社 Electronic equipment and control method thereof
CN114025105A (en)*2021-12-152022-02-08北京达佳互联信息技术有限公司Video processing method and device, electronic equipment and storage medium
US12159377B2 (en)2019-12-232024-12-03Tencent Technology (Shenzhen) Company LimitedImage processing method and apparatus, video processing method and apparatus, electronic device, and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101031030A (en)*2007-04-172007-09-05北京中星微电子有限公司Method and system for adding special effects into image
CN101068314A (en)*2006-09-292007-11-07腾讯科技(深圳)有限公司Network video frequency showing method and system
CN101527838A (en)*2008-03-042009-09-09华为技术有限公司Method and system for feedback-type object detection and tracing of video object
CN102880864A (en)*2012-04-282013-01-16王浩Method for snap-shooting human face from streaming media file
CN103325089A (en)*2012-03-212013-09-25腾讯科技(深圳)有限公司Method and device for processing skin color in image
US20140009465A1 (en)*2012-07-052014-01-09Samsung Electronics Co., Ltd.Method and apparatus for modeling three-dimensional (3d) face, and method and apparatus for tracking face
CN104008534A (en)*2014-06-182014-08-27福建天晴数码有限公司Intelligent human face beautifying method and device
CN104217417A (en)*2013-05-312014-12-17张伟伟A video multiple-target tracking method and device
CN104318262A (en)*2014-09-122015-01-28上海明穆电子科技有限公司Method and system for replacing skin through human face photos
CN104392420A (en)*2014-12-102015-03-04厦门美图之家科技有限公司Method for optimizing skin color quickly

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101068314A (en)*2006-09-292007-11-07腾讯科技(深圳)有限公司Network video frequency showing method and system
CN101031030A (en)*2007-04-172007-09-05北京中星微电子有限公司Method and system for adding special effects into image
CN101527838A (en)*2008-03-042009-09-09华为技术有限公司Method and system for feedback-type object detection and tracing of video object
CN103325089A (en)*2012-03-212013-09-25腾讯科技(深圳)有限公司Method and device for processing skin color in image
CN102880864A (en)*2012-04-282013-01-16王浩Method for snap-shooting human face from streaming media file
US20140009465A1 (en)*2012-07-052014-01-09Samsung Electronics Co., Ltd.Method and apparatus for modeling three-dimensional (3d) face, and method and apparatus for tracking face
CN104217417A (en)*2013-05-312014-12-17张伟伟A video multiple-target tracking method and device
CN104008534A (en)*2014-06-182014-08-27福建天晴数码有限公司Intelligent human face beautifying method and device
CN104318262A (en)*2014-09-122015-01-28上海明穆电子科技有限公司Method and system for replacing skin through human face photos
CN104392420A (en)*2014-12-102015-03-04厦门美图之家科技有限公司Method for optimizing skin color quickly

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
梁凌宇: "人脸图像的自适应美化与渲染研究", 《中国博士学位论文全文数据库信息科技辑》*

Cited By (22)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2017084011A1 (en)*2015-11-162017-05-26华为技术有限公司Method and apparatus for smoothing video
US10559106B2 (en)2015-11-162020-02-11Huawei Technologies Co., Ltd.Video smoothing method and apparatus
CN106791347A (en)*2015-11-202017-05-31比亚迪股份有限公司A kind of image processing method, device and the mobile terminal using the method
CN105979195A (en)*2016-05-262016-09-28努比亚技术有限公司Video image processing apparatus and method
CN105979195B (en)*2016-05-262019-04-19努比亚技术有限公司A kind of video image processing device and method
CN108428214A (en)*2017-02-132018-08-21阿里巴巴集团控股有限公司A kind of image processing method and device
CN108428214B (en)*2017-02-132022-03-08斑马智行网络(香港)有限公司Image processing method and device
CN107657590B (en)*2017-09-012021-01-15北京小米移动软件有限公司Picture processing method and device and storage medium
CN107657590A (en)*2017-09-012018-02-02北京小米移动软件有限公司Image processing method and device
CN108762829A (en)*2018-05-032018-11-06北京奇虎科技有限公司A kind of method, client and terminal for image beautification
CN108762829B (en)*2018-05-032021-07-09北京奇虎科技有限公司 A method, client and terminal for image beautification
CN108629730A (en)*2018-05-212018-10-09深圳市梦网科技发展有限公司Video U.S. face method, apparatus and terminal device
CN108629730B (en)*2018-05-212021-11-30深圳市梦网科技发展有限公司Video beautifying method and device and terminal equipment
CN109002776A (en)*2018-06-292018-12-14金蝶软件(中国)有限公司Face identification method, system, computer equipment and computer readable storage medium
CN109190576A (en)*2018-09-132019-01-11深圳市梦网百科信息技术有限公司A kind of more people's U.S. face methods of adjustment and system based on video multidate information
CN109190576B (en)*2018-09-132021-10-12深圳市梦网视讯有限公司Multi-user beauty adjustment method and system based on video dynamic information
CN113994652A (en)*2019-04-032022-01-28三星电子株式会社 Electronic equipment and control method thereof
US11907290B2 (en)2019-04-032024-02-20Samsung Electronics Co., Ltd.Electronic device and control method thereof
CN113994652B (en)*2019-04-032024-08-30三星电子株式会社Electronic apparatus and control method thereof
US12159377B2 (en)2019-12-232024-12-03Tencent Technology (Shenzhen) Company LimitedImage processing method and apparatus, video processing method and apparatus, electronic device, and storage medium
CN114025105A (en)*2021-12-152022-02-08北京达佳互联信息技术有限公司Video processing method and device, electronic equipment and storage medium
CN114025105B (en)*2021-12-152023-11-28北京达佳互联信息技术有限公司Video processing method, device, electronic equipment and storage medium

Also Published As

Publication numberPublication date
CN105046661B (en)2018-04-06

Similar Documents

PublicationPublication DateTitle
CN105046661B (en)A kind of method, apparatus and intelligent terminal for lifting video U.S. face efficiency
WO2020140798A1 (en)Gesture recognition method, device, electronic apparatus, and storage medium
CN102436304B (en)Method and terminal for switching horizontal and vertical display modes of screen
TWI678099B (en)Video processing method and device and storage medium
WO2016145830A1 (en)Image processing method, terminal and computer storage medium
CN104049760B (en)The acquisition methods and system of a kind of man-machine interaction order
CN104657974A (en)Image processing method and device
CN104850228B (en)The method of the watching area of locking eyeball based on mobile terminal
CN107977934B (en)Image processing method and device
CN103413268B (en)A kind of photographic method of Automatic Optimal shape of face
CN103299342B (en)Method and apparatus for providing a mechanism for gesture recognition
CN104850852B (en)Feature vector computational methods and device
CN104484858B (en)Character image processing method and processing device
EP4113430A1 (en)Beauty treatment method and device
US8538089B2 (en)Method of performing eyebrow shaping on an image and related computing device
CN106570472A (en)Skin color detecting method and device and terminal
CN103164119B (en)The adaptive display method of communication terminal and image
WO2016029399A1 (en)Object selection based on region of interest fusion
JP2018538608A (en) Face verification method and electronic device
CN107492067A (en)A kind of image beautification method and mobile terminal
CN106648344A (en)Screen content adjustment method and equipment
CN107786811B (en) A camera method and mobile terminal
CN105739817B (en) Icon hiding method, device and mobile terminal
WO2018019068A1 (en)Photographing method and device, and mobile terminal
CN106814959A (en) A method, device and terminal for beautifying and taking photos

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant
CP01Change in the name or title of a patent holder
CP01Change in the name or title of a patent holder

Address after:Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee after:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before:Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee before:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

CF01Termination of patent right due to non-payment of annual fee
CF01Termination of patent right due to non-payment of annual fee

Granted publication date:20180406


[8]ページ先頭

©2009-2025 Movatter.jp