Movatterモバイル変換


[0]ホーム

URL:


CN100515082C - Method for reducing video decoding complexity via decoding quality - Google Patents

Method for reducing video decoding complexity via decoding quality
Download PDF

Info

Publication number
CN100515082C
CN100515082CCNB2006100810555ACN200610081055ACN100515082CCN 100515082 CCN100515082 CCN 100515082CCN B2006100810555 ACNB2006100810555 ACN B2006100810555ACN 200610081055 ACN200610081055 ACN 200610081055ACN 100515082 CCN100515082 CCN 100515082C
Authority
CN
China
Prior art keywords
decoding
video
video decoding
motion compensation
discrete cosine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2006100810555A
Other languages
Chinese (zh)
Other versions
CN101080007A (en
Inventor
陈志辉
张泰乐
陈国平
贺鹏程
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING ZHONGKE CHINESE SHADOW MEDIA TECHNOLOGY CO LTD
Institute of Acoustics CAS
Original Assignee
Beijing Yi Wei Information Technology Co ltd AS
Institute of Acoustics CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Yi Wei Information Technology Co ltd AS, Institute of Acoustics CASfiledCriticalBeijing Yi Wei Information Technology Co ltd AS
Priority to CNB2006100810555ApriorityCriticalpatent/CN100515082C/en
Publication of CN101080007ApublicationCriticalpatent/CN101080007A/en
Application grantedgrantedCritical
Publication of CN100515082CpublicationCriticalpatent/CN100515082C/en
Expired - Fee Relatedlegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Landscapes

Abstract

Translated fromChinese

本发明公开了一种通过解码质量控制降低视频解码复杂度的方法,包括:视频终端接收视频帧,并计算视频终端的系统当前时间与当前视频帧显示时间标签间的差值;根据差值对视频终端当前的视频解码压力进行估计,确定视频解码压力的级别;利用视频解码压力的级别,对当前帧进行解码质量控制,根据色度优先处理策略和边缘优先处理策略,选择解码时的简化算法,确定简化处理的程度,然后对视频帧做解码操作。本发明可根据当前的视频解码压力动态降低视频解码复杂度;不对视频帧序列进行丢帧,保持了视频的连贯性;并利用人眼的视觉特性和观众的关注区域差异性,在降低复杂度解码时能够尽量保持视觉效果。

Figure 200610081055

The invention discloses a method for reducing video decoding complexity through decoding quality control, comprising: a video terminal receives a video frame, and calculates the difference between the system current time of the video terminal and the display time label of the current video frame; Estimate the current video decoding pressure of the video terminal to determine the level of video decoding pressure; use the level of video decoding pressure to control the decoding quality of the current frame, and select a simplified algorithm for decoding according to the chroma priority processing strategy and the edge priority processing strategy , determine the degree of simplification, and then decode the video frame. The present invention can dynamically reduce the complexity of video decoding according to the current video decoding pressure; does not drop frames for the video frame sequence, and maintains the continuity of the video; and utilizes the visual characteristics of the human eye and the differences in the attention areas of the audience to reduce the complexity When decoding, try to maintain the visual effect as much as possible.

Figure 200610081055

Description

Translated fromChinese
通过解码质量控制降低视频解码复杂度的方法A Method for Reducing Video Decoding Complexity Through Decoding Quality Control

技术领域technical field

本发明涉及视频播放终端,特别涉及到多媒体处理能力有限的视频播放终端。The present invention relates to a video playing terminal, in particular to a video playing terminal with limited multimedia processing capability.

背景技术Background technique

MPEG视频压缩标准是目前使用最广泛的视频压缩标准。MPEG视频的解码过程一般包括以下步骤:The MPEG video compression standard is currently the most widely used video compression standard. The decoding process of MPEG video generally includes the following steps:

1)、变长熵解码;1), variable length entropy decoding;

2)、反量化;2), inverse quantization;

3)、反离散余弦变换(IDCT,Inverse Discrete Cosine Transform);3), Inverse Discrete Cosine Transform (IDCT, Inverse Discrete Cosine Transform);

4)、运动补偿。4), motion compensation.

在H.264等新标准中,在运动补偿后还包括环内去块滤波环节。上述的解码过程实现的具体技术细节可参见参考文献1:《ISO/IEC 14496-2》(MPEG4的视频编解码标准)以及参考文献2:《ISO/IEC 14496-10》(H.264的视频编解码标准)。In new standards such as H.264, an in-loop deblocking filtering link is also included after motion compensation. The specific technical details of the above decoding process can be found in reference 1: "ISO/IEC 14496-2" (MPEG4 video codec standard) and reference 2: "ISO/IEC 14496-10" (H.264 video codec standard).

随着MPEG视频编码复杂度的增加,视频解码的压力也越来越大。在MPEG视频播放系统中,经常会遇到这样的问题:输入到播放终端的视频序列的平均解码复杂度超出了终端的处理能力,当解码器解码完几帧视频图像之后,系统的当前时间便滞后于视频帧的正常显示时间,如果继续进行逐帧解码,则会进一步加剧视频图像显示的滞后,造成用户看到的是慢速播放的视频。With the increase of MPEG video coding complexity, the pressure of video decoding is also increasing. In the MPEG video playback system, such a problem is often encountered: the average decoding complexity of the video sequence input to the playback terminal exceeds the processing capability of the terminal. After the decoder has decoded several frames of video images, the current time of the system will be Lag behind the normal display time of the video frame, if the frame-by-frame decoding continues, the lag of the video image display will be further aggravated, causing the user to see a slow-playing video.

目前处理这种问题的方法一般是进行丢帧:即对输入的视频序列进行尽力解码,如果当前的系统时间已经滞后于要解码的输入视频帧,则丢弃该视频帧,不进行解码。丢帧虽然能尽量保持被解码的视频图像的显示时间接近视频图像要求的显示时间,但是,丢帧意味着显示帧频的下降,容易造成观看时的不连续和停顿感。于是,如何在终端处理能力受限的情况下减轻视频解码的压力,避免丢帧造成的显示停顿,便具有实际应用价值。The current method to deal with this problem is generally to drop frames: that is, to decode the input video sequence as best as possible. If the current system time has lagged behind the input video frame to be decoded, the video frame is discarded and no decoding is performed. Although frame loss can keep the display time of the decoded video image as close as possible to the display time required by the video image, frame loss means a decrease in the display frame rate, which is likely to cause discontinuity and pause when watching. Therefore, how to reduce the pressure of video decoding and avoid display pauses caused by frame loss when the terminal processing capability is limited has practical application value.

发明内容Contents of the invention

本发明的目的在于克服现有技术在多媒体处理能力不足的终端上进行视频播放时丢帧造成的播放画面停顿的弊端,减轻终端的视频解码压力,在尽量保持视频质量的原则下提高视频播放的流畅度。The purpose of the present invention is to overcome the drawbacks of the prior art in the video playback caused by frame loss on a terminal with insufficient multimedia processing capabilities, reduce the video decoding pressure of the terminal, and improve the efficiency of video playback under the principle of maintaining video quality as much as possible. fluency.

为了实现上述目的,本发明提供了一种通过解码质量控制降低视频解码复杂度的方法,包含以下步骤:In order to achieve the above object, the present invention provides a method for reducing video decoding complexity through decoding quality control, comprising the following steps:

1)、视频终端接收视频帧,并计算视频终端的系统当前时间与当前视频帧显示时间标签间的差值;1), the video terminal receives the video frame, and calculates the difference between the current system time of the video terminal and the display time label of the current video frame;

2)、根据步骤1)计算所得到的差值对视频终端当前的视频解码压力进行估计,确定视频解码压力的级别;2), estimate the current video decoding pressure of the video terminal according to the difference calculated in step 1), and determine the level of video decoding pressure;

3)、利用步骤2)得到的视频解码压力的级别,对当前视频帧进行解码质量控制,根据色度优先处理策略和边缘优先处理策略,选择解码时的简化算法,确定简化处理的程度,然后对当前视频帧做解码操作。3), utilize the level of the video decoding pressure that step 2) obtains, carry out decoding quality control to current video frame, according to chrominance priority processing strategy and edge priority processing strategy, select the simplification algorithm when decoding, determine the degree of simplification processing, then Perform decoding operations on the current video frame.

上述技术方案中,在所述的步骤3)中,所述的解码时的简化算法包括反离散余弦变换简化运算和运动补偿简化运算,在视频解码时至少采用其中的一种;所述的反离散余弦变换简化运算在视频解码过程中代替反离散余弦变换运算,所述的运动补偿简化运算在视频解码过程中代替运动补偿运算。In the above-mentioned technical scheme, in the described step 3), the simplified algorithm during the decoding includes the simplified operation of the inverse discrete cosine transform and the simplified operation of the motion compensation, at least one of which is adopted when the video is decoded; The discrete cosine transform simplified operation replaces the inverse discrete cosine transform operation in the video decoding process, and the motion compensation simplified operation replaces the motion compensation operation in the video decoding process.

在所述的步骤3)中,所述的解码时的简化算法还包括环内去块滤波控制,在视频解码过程中,所述的环内去块滤波控制代替视频解码过程中的环内去块滤波。In the step 3), the simplified algorithm during decoding also includes in-loop deblocking filter control, and in the video decoding process, the in-loop deblocking filter control replaces the in-loop deblocking filter control in the video decoding process. block filtering.

所述的色度优先处理策略是利用人眼对色度的灵敏度远低于对亮度的灵敏度的特点,在进行降低复杂度的解码时,优先对色度块采用反离散余弦变换简化运算、或运动补偿简化运算、或环内去块滤波控制;所述的边缘优先处理策略是利用人一般对视频图像中央区域的关注程度较高,对视频图像边缘区域的关注较低的特点,在进行降低复杂度的解码时,优先对视频图像边缘的块或宏块采用反离散余弦变换简化运算、或运动补偿简化运算、或环内去块滤波控制。The chroma priority processing strategy utilizes the fact that the sensitivity of the human eye to chroma is much lower than the sensitivity to luminance. When performing decoding with reduced complexity, the chroma blocks are preferentially simplified by inverse discrete cosine transform, or Simplified operation of motion compensation, or in-loop deblocking filtering control; the edge priority processing strategy is to use the characteristics that people generally pay more attention to the central area of the video image and pay less attention to the edge area of the video image. When decoding the complexity, priority is given to adopting inverse discrete cosine transform simplified operations, motion compensation simplified operations, or in-loop deblocking filtering control for the blocks or macroblocks at the edge of the video image.

所述的反离散余弦变换简化运算是将解码块中的部分离散余弦变换系数高频分量置为零,利用离散余弦变换系数低频分量构成的稀疏矩阵进行反离散余弦变换。The simplified operation of the inverse discrete cosine transform is to set the high-frequency components of part of the discrete cosine transform coefficients in the decoding block to zero, and use the sparse matrix formed by the low-frequency components of the discrete cosine transform coefficients to perform the inverse discrete cosine transform.

所述的运动补偿简化运算是降低视频帧解码过程中的运动矢量的象素精度,简化运动补偿中的象素插值运算。The motion compensation simplified operation is to reduce the pixel precision of the motion vector in the video frame decoding process, and simplify the pixel interpolation operation in the motion compensation.

所述的环内去块滤波控制是对进行控制的块禁止使用环内去块滤波的操作。The in-loop deblocking filter control is an operation of prohibiting the use of in-loop deblocking filter for the controlled block.

在所述的步骤3)中,所述的确定简化处理的程度是指对反离散余弦变换简化运算,确定反离散余弦变换中置零的高频分量的比例;对运动补偿简化运算,确定运动矢量精度下降的程度。In said step 3), said degree of determining the simplification process refers to simplifying the operation of the inverse discrete cosine transform, determining the ratio of the high-frequency components zeroed in the inverse discrete cosine transform; The degree to which vector precision is reduced.

在所述的步骤2)中,所述的确定视频解码压力的级别是在差值可能的取值范围内设定至少一个阈值,从而形成不同的区域,根据步骤1)所得到的差值位于哪一个区域来确定视频解码压力的级别。In said step 2), the determination of the level of video decoding pressure is to set at least one threshold within the possible value range of the difference, thereby forming different regions, and the difference obtained according to step 1) is located at Which area determines the level of video decoding pressure.

所述的阈值有6个,按照时间从小到大分别用a、b、c、d、e、f表示;所述的级别有7个,分别用S1~S7表示,其中,There are 6 thresholds, represented by a, b, c, d, e, f in ascending order of time; there are 7 levels, represented by S1-S7 respectively, wherein,

S1:D<a;S1: D<a;

S2:a<=D<b;S2: a<=D<b;

S3:b<=D<c;S3: b<=D<c;

S4:c<=D<d;S4: c<=D<d;

S5:d<=D<e;S5: d<=D<e;

S6:e<=D<f;S6: e<=D<f;

S7:D>=f。S7: D>=f.

在所述的步骤3)中,对不同级别的视频解码压力采用不同的视频解码算法,其中,In said step 3), different video decoding algorithms are adopted for different levels of video decoding pressure, wherein,

a、当解码压力为S1时,采用常规视频解码算法;a. When the decoding pressure is S1, the conventional video decoding algorithm is adopted;

b、当解码压力为S2时,在视频解码时,对视频图像的左右各1/4区域内的色度块采用反离散余弦变换简化运算代替反离散余弦变换运算;b. When the decoding pressure is S2, during video decoding, the chrominance blocks in the left and right 1/4 regions of the video image are replaced by the simplified inverse discrete cosine transform operation;

c、当解码压力为S3时,在视频解码时,对视频图像的左右各1/4区域内的色度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算;c. When the decoding pressure is S3, during video decoding, the chrominance blocks in the left and right 1/4 regions of the video image are replaced by the simplified operation of the inverse discrete cosine transform, and the simplified operation of motion compensation is used instead of the motion Compensation operation;

d、当解码压力为S4时,在视频解码时,对视频图像的左右各1/4区域内的色度块、亮度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算;d. When the decoding pressure is S4, during video decoding, the chrominance blocks and luma blocks in the left and right 1/4 areas of the video image are replaced by inverse discrete cosine transform simplified operations, and motion compensation is used to simplify operation instead of motion compensation operation;

e、当解码压力为S5时,在视频解码时,对视频图像的左右各1/4区域内的色度、亮度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波;e. When the decoding pressure is S5, during video decoding, the chrominance and luminance blocks in the left and right 1/4 areas of the video image are replaced by the simplified operation of the inverse discrete cosine transform, and the simplified operation of the motion compensation is adopted Instead of motion compensation operations, and disable in-loop deblocking filtering;

f、当解码压力为S6时,在视频解码时,对视频图像的左右和上下各1/4区域内的色度、亮度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波;f. When the decoding pressure is S6, during video decoding, the chrominance and luminance blocks in the left and right and top and bottom 1/4 areas of the video image are replaced by the simplified inverse discrete cosine transform operation, and the motion compensation is adopted Simplify calculations instead of motion compensation calculations, and disable in-loop deblocking filtering;

g、当解码压力为S7时,在视频解码时,对视频图像的所有区域内的色度、亮度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波。g. When the decoding pressure is S7, during video decoding, the simplified operation of inverse discrete cosine transform is used instead of the operation of inverse discrete cosine transform for the chrominance and luma blocks in all regions of the video image, and the simplified operation of motion compensation is used instead of the operation of motion compensation , and disable in-loop deblocking filtering.

本发明的优点在于:The advantages of the present invention are:

(1)在视频解码的过程中,可根据当前的视频解码压力动态降低视频解码复杂度;(1) During the video decoding process, the video decoding complexity can be dynamically reduced according to the current video decoding pressure;

(2)不对视频帧序列进行丢帧,保持了视频的连贯性;(2) The sequence of video frames is not dropped, and the continuity of the video is maintained;

(3)利用人眼的视觉特性和观众的关注区域差异性,在降低复杂度解码时能够尽量保持视觉效果。(3) Utilizing the visual characteristics of the human eye and the differences in the attention areas of the audience, the visual effect can be kept as much as possible when decoding with reduced complexity.

附图说明Description of drawings

图1本发明的机顶盒应用场景示意图;Fig. 1 is a schematic diagram of a set-top box application scenario of the present invention;

图2当前系统时间与当前帧显示时间标签的差值对应的解码压力;Figure 2 The decoding pressure corresponding to the difference between the current system time and the current frame display time label;

图3图像的左右各1/4区域示意图;Schematic diagram of the left and right 1/4 areas of the image in Figure 3;

图4图像的上下左右各1/4区域示意图;Figure 4 schematic diagram of the top, bottom, left, and right 1/4 areas of the image;

图5为本发明的通过解码质量控制降低视频解码复杂度的方法的流程图。FIG. 5 is a flowchart of a method for reducing video decoding complexity through decoding quality control according to the present invention.

具体实施方式Detailed ways

下面结合附图和具体实施例对本发明做进一步的描述。The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

本发明的通过解码质量控制降低视频解码复杂度的方法可应用于如图1所示的数字电视播放系统中。机顶盒通过宽带网络向流媒体服务器发出视频服务请求,流媒体服务器响应该请求,并通过网络向机顶盒发送视频数据,机顶盒接受到视频数据后进行解码,然后送到电视机进行显示。在本实施例中,该系统的网络带宽能够满足视频流的传送需求,机顶盒的网络接收模块也有足够的能力进行数据接收,但机顶盒的视频解码能力不足,无法满足对视频流的全部数据进行实时解码。本发明的解码质量控制降低视频解码复杂度的方法正适用于这种视频终端(机顶盒)解码能力不足的情况。The method for reducing video decoding complexity through decoding quality control of the present invention can be applied to the digital TV broadcasting system as shown in FIG. 1 . The set-top box sends a video service request to the streaming media server through the broadband network. The streaming media server responds to the request and sends video data to the set-top box through the network. After receiving the video data, the set-top box decodes it and sends it to the TV for display. In this embodiment, the network bandwidth of the system can meet the transmission requirements of the video stream, and the network receiving module of the set-top box also has sufficient capacity to receive data, but the video decoding capability of the set-top box is insufficient to meet the requirements for real-time processing of all data of the video stream. decoding. The method for reducing the complexity of video decoding by controlling the decoding quality of the present invention is suitable for the situation where the decoding capability of the video terminal (set-top box) is insufficient.

本发明的解码质量控制降低视频解码复杂度的方法具体包含以下步骤:The decoding quality control of the present invention reduces the method for video decoding complexity to specifically comprise the following steps:

1、机顶盒接收视频帧,并计算机顶盒的系统当前时间与当前视频帧显示时间标签的差值。在本实施例中,用D表示差值,则D=系统当前时间—当前视频帧显示时间标签。1. The set-top box receives the video frame, and calculates the difference between the system current time of the top box and the time tag displayed on the current video frame. In this embodiment, D is used to represent the difference, then D=the current time of the system—the display time label of the current video frame.

2、根据步骤1计算所得到的差值对机顶盒的视频解码压力进行估计,确定当前的机顶盒的视频解码压力的级别。在本发明方法中,按照差值的取值范围,将视频解码压力划分成不同的级别,差值的数值越大,则视频解码压力也越大。在本实施例中,机顶盒的视频解码压力划分为7个级别,用S1~S7表示。在图2中表示了各个级别的划分方法,其中:2. Estimate the video decoding pressure of the set-top box according to the difference calculated in step 1, and determine the current video decoding pressure level of the set-top box. In the method of the present invention, the video decoding pressure is divided into different levels according to the value range of the difference, and the greater the value of the difference, the greater the video decoding pressure. In this embodiment, the video decoding pressure of the set-top box is divided into seven levels, denoted by S1-S7. The division method of each level is shown in Figure 2, where:

S1:D<-10;S1: D<-10;

S2:-10<=D<0;S2: -10<=D<0;

S3:0<=D<10;S3: 0<=D<10;

S4:10<=D<20;S4: 10<=D<20;

S5:20<=D<30;S5: 20<=D<30;

S6:30<=D<40;S6: 30<=D<40;

S7:D>=40。S7: D>=40.

3、根据机顶盒当前的视频解码压力,判断是否需要对当前帧进行解码质量控制,当机顶盒的视频解码压力较大时,根据色度优先处理策略和边缘优先处理策略,降低视频解码复杂度。在对当前帧进行解码质量控制时,根据视频解码压力的不同级别,选择解码时的简化算法,确定简化处理的程度,然后再对视频帧做解码操作。3. According to the current video decoding pressure of the set-top box, it is judged whether the decoding quality control of the current frame is required. When the video decoding pressure of the set-top box is high, the video decoding complexity is reduced according to the chroma priority processing strategy and the edge priority processing strategy. When performing decoding quality control on the current frame, according to different levels of video decoding pressure, select a simplification algorithm during decoding, determine the degree of simplification, and then decode the video frame.

解码时的简化算法主要包括IDCT简化运算、运动补偿简化运算和环内去块滤波控制。在本实施例中,所述的IDCT简化运算保留解码块DCT系数中1/4低频分量,将其余系数分量均置为零,然后对稀疏DCT系数矩阵进行IDCT。所述的运动补偿简化运算把运动矢量的象素精度从子象素精度降为整象素精度,以避免象素插值,从而简化解码的复杂度。所述的环内去块滤波控制是指对进行控制的Block禁止使用环内去块滤波的操作。The simplification algorithm during decoding mainly includes IDCT simplification operation, motion compensation simplification operation and in-loop deblocking filter control. In this embodiment, the IDCT simplification operation retains 1/4 low-frequency components in the DCT coefficients of the decoded block, sets the remaining coefficient components to zero, and then performs IDCT on the sparse DCT coefficient matrix. The motion compensation simplification operation reduces the pixel precision of the motion vector from sub-pixel precision to integer pixel precision, so as to avoid pixel interpolation, thereby simplifying the complexity of decoding. The in-loop deblocking filter control refers to the operation of prohibiting the use of in-loop deblocking filter for the controlled Block.

所述的简化处理的程度是指对反离散余弦变换简化运算,确定反离散余弦变换中置零的高频分量的比例;对运动补偿简化运算,确定运动矢量精度下降的程度。如在本实施例中,置零的高频分量占到3/4,象素精度从子象素精度降为整象素精度。The degree of simplification refers to determining the proportion of the high-frequency components set to zero in the inverse discrete cosine transform for the simplified operation of the inverse discrete cosine transform; and for the simplified operation of the motion compensation, to determine the degree of motion vector precision degradation. As in this embodiment, the high-frequency components of zeroing account for 3/4, and the pixel precision is reduced from sub-pixel precision to integer pixel precision.

在降低视频解码复杂度时主要遵循两个策略,色度优先处理策略和边缘优先处理策略。所述的色度优先处理策略主要考虑到人眼的视觉特性,一般来说,人眼对亮度的敏感度高,对色度的敏感度低,因此在降低视频解码复杂度时优先简化色度信息。所述的边缘优先处理策略主要考虑到人眼对视觉对象在不同位置的关注程度是不同的,通常位于图像中心位置的对象所受到的关注度最高,而在边缘位置的对象所受到的关注度相对较低,因此,在降低视频解码复杂度时可优先简化图像边缘部分的信息。There are mainly two strategies to be followed when reducing the complexity of video decoding, chrominance priority processing strategy and edge priority processing strategy. The chroma priority processing strategy mainly takes into account the visual characteristics of the human eye. Generally speaking, the human eye has a high sensitivity to brightness and a low sensitivity to chroma. Therefore, simplification of chroma is given priority when reducing the complexity of video decoding. information. The edge-priority processing strategy mainly takes into account that human eyes pay different attention to visual objects at different positions. Usually, the object at the center of the image receives the highest attention, while the object at the edge receives the most attention. Relatively low, therefore, when reducing the complexity of video decoding, the information at the edge of the image can be simplified first.

根据上述策略,在本实施例中,对7种不同级别的视频解码压力有不同的处理流程,其具体实现如下:According to the above strategy, in this embodiment, there are different processing flows for seven different levels of video decoding pressure, and its specific implementation is as follows:

a、当解码压力为S1时,采用常规视频解码算法;a. When the decoding pressure is S1, the conventional video decoding algorithm is adopted;

b、当解码压力为S2时,在视频解码时,对视频图像的左右各1/4区域内的色度块采用IDCT简化运算代替IDCT运算;b. When the decoding pressure is S2, during video decoding, the IDCT simplified operation is used instead of the IDCT operation for the chrominance blocks in the left and right 1/4 areas of the video image;

c、当解码压力为S3时,在视频解码时,对视频图像的左右各1/4区域内的色度块采用IDCT简化运算代替IDCT运算,采用运动补偿简化运算代替运动补偿运算;c. When the decoding pressure is S3, during video decoding, the IDCT simplified operation is used instead of the IDCT operation for the chrominance blocks in the left and right 1/4 regions of the video image, and the motion compensation simplified operation is used instead of the motion compensation operation;

d、当解码压力为S4时,在视频解码时,对视频图像的左右各1/4区域内的色度块、亮度块采用IDCT简化运算代替IDCT运算,采用运动补偿简化运算代替运动补偿运算;d. When the decoding pressure is S4, during video decoding, the IDCT simplified operation is used instead of the IDCT operation for the chrominance blocks and luma blocks in the left and right 1/4 regions of the video image, and the motion compensation simplified operation is used instead of the motion compensation operation;

e、当解码压力为S5时,在视频解码时,对视频图像的左右各1/4区域内的色度、亮度块采用IDCT简化运算代替IDCT运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波;e. When the decoding pressure is S5, during video decoding, the IDCT simplified operation is used instead of the IDCT operation for the chrominance and luminance blocks in the left and right 1/4 regions of the video image, and the motion compensation simplified operation is used instead of the motion compensation operation, and Disable in-loop deblocking filtering;

f、当解码压力为S6时,在视频解码时,对视频图像的左右和上下各1/4区域内的色度、亮度块采用IDCT简化运算代替IDCT运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波;f. When the decoding pressure is S6, during video decoding, the IDCT simplified operation is used instead of the IDCT operation for the chrominance and luminance blocks in the left and right and upper and lower 1/4 areas of the video image, and the motion compensation simplified operation is used instead of the motion compensation operation , and disable in-loop deblocking filtering;

g、当解码压力为S7时,在视频解码时,对视频图像的所有区域内的色度、亮度块采用IDCT简化运算代替IDCT运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波。g. When the decoding pressure is S7, during video decoding, the IDCT simplified operation is used instead of the IDCT operation for the chrominance and luminance blocks in all regions of the video image, and the motion compensation simplified operation is used instead of the motion compensation operation, and the in-loop removal is prohibited. block filtering.

Claims (11)

Translated fromChinese
1、一种通过解码质量控制降低视频解码复杂度的方法,包含以下步骤:1. A method for reducing video decoding complexity by decoding quality control, comprising the following steps:1)、视频终端接收视频帧,并计算视频终端的系统当前时间与当前视频帧显示时间标签间的差值;1), the video terminal receives the video frame, and calculates the difference between the current system time of the video terminal and the display time label of the current video frame;2)、根据步骤1)计算所得到的差值对视频终端当前的视频解码压力进行估计,确定视频解码压力的级别;2), estimate the current video decoding pressure of the video terminal according to the difference calculated in step 1), and determine the level of video decoding pressure;3)、利用步骤2)得到的视频解码压力的级别,对当前视频帧进行解码质量控制,根据色度优先处理策略和边缘优先处理策略,选择解码时的简化算法,确定简化处理的程度,然后对当前视频帧做解码操作。3), utilize the level of the video decoding pressure that step 2) obtains, carry out decoding quality control to current video frame, according to chrominance priority processing strategy and edge priority processing strategy, select the simplification algorithm when decoding, determine the degree of simplification processing, then Perform decoding operations on the current video frame.2、根据权利要求1所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,在所述的步骤3)中,所述的解码时的简化算法包括反离散余弦变换简化运算和运动补偿简化运算,在视频解码时至少采用其中的一种;所述的反离散余弦变换简化运算在视频解码过程中代替反离散余弦变换运算,所述的运动补偿简化运算在视频解码过程中代替运动补偿运算。2. The method for reducing video decoding complexity through decoding quality control according to claim 1, characterized in that, in said step 3), said simplified algorithm during decoding includes inverse discrete cosine transform simplified operations and Motion compensation simplification operation, at least one of them is adopted during video decoding; the described inverse discrete cosine transform simplification operation replaces the inverse discrete cosine transform operation in the video decoding process, and the described motion compensation simplification operation replaces the video decoding process motion compensation calculations.3、根据权利要求2所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,在所述的步骤3)中,所述的解码时的简化算法还包括环内去块滤波控制,在视频解码过程中,所述的环内去块滤波控制代替视频解码过程中的环内去块滤波。3. The method for reducing video decoding complexity through decoding quality control according to claim 2, characterized in that, in said step 3), said simplified algorithm during decoding also includes in-loop deblocking filter control , in the video decoding process, the in-loop deblocking filtering control replaces the in-loop deblocking filtering in the video decoding process.4、根据权利要求3所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,所述的色度优先处理策略是利用人眼对色度的灵敏度远低于对亮度的灵敏度的特点,在进行降低复杂度的解码时,优先对色度块采用反离散余弦变换简化运算、运动补偿简化运算、环内去块滤波控制;所述的边缘优先处理策略是利用人眼一般对视频图像中央区域的关注程度较高,对视频图像边缘区域的关注程度较低的特点,在进行降低复杂度的解码时,优先对视频图像边缘的块或宏块采用反离散余弦变换简化运算、运动补偿简化运算或环内去块滤波控制。4. The method for reducing video decoding complexity through decoding quality control according to claim 3, characterized in that the chroma priority processing strategy utilizes the fact that the sensitivity of human eyes to chroma is much lower than that to brightness Features, when performing decoding with reduced complexity, the chrominance block is preferentially used to simplify the operation of inverse discrete cosine transform, the simplified operation of motion compensation, and the control of deblocking filtering in the loop; The central area of the image has a high degree of attention, and the degree of attention to the edge area of the video image is relatively low. When decoding with reduced complexity, the inverse discrete cosine transform is used to simplify the operation and motion of the block or macroblock at the edge of the video image. Compensation simplifies operation or in-loop deblocking filter control.5、根据权利要求4所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,所述的反离散余弦变换简化运算是将解码块中的部分离散余弦变换系数高频分量置为零,利用离散余弦变换系数低频分量构成的稀疏矩阵进行反离散余弦变换。5. The method for reducing video decoding complexity through decoding quality control according to claim 4, characterized in that the simplified operation of the inverse discrete cosine transform is to set the high-frequency components of part of the discrete cosine transform coefficients in the decoding block as Zero, the inverse discrete cosine transform is performed using a sparse matrix composed of low-frequency components of the discrete cosine transform coefficients.6、根据权利要求5所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,所述的运动补偿简化运算是降低视频帧解码过程中的运动矢量的象素精度,简化运动补偿中的象素插值运算。6. The method for reducing video decoding complexity through decoding quality control according to claim 5, characterized in that the simplified operation of motion compensation is to reduce the pixel precision of motion vectors in the video frame decoding process, simplifying motion compensation Pixel interpolation operation in .7、根据权利要求6所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,所述的环内去块滤波控制是对进行控制的块禁止使用环内去块滤波的操作。7. The method for reducing video decoding complexity through decoding quality control according to claim 6, characterized in that said in-loop deblocking filter control is an operation of prohibiting the use of in-loop deblocking filter for the controlled block.8、根据权利要求7所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,在所述的步骤3)中,所述的确定简化处理的程度是指对反离散余弦变换简化运算,确定反离散余弦变换中置零的高频分量的比例;对运动补偿简化运算,确定运动矢量精度下降的程度。8. The method for reducing video decoding complexity through decoding quality control according to claim 7, characterized in that, in said step 3), said determining the degree of simplification refers to simplifying the inverse discrete cosine transform Operation, to determine the proportion of high-frequency components that are zeroed in the inverse discrete cosine transform; to simplify the operation for motion compensation, to determine the degree of motion vector accuracy degradation.9、根据权利要求8所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,在所述的步骤2)中,所述的确定视频解码压力的级别是在差值可能的取值范围内设定至少一个阈值,从而形成不同的区域,根据步骤1)所得到的差值位于哪一个区域来确定视频解码压力的级别。9. The method for reducing video decoding complexity through decoding quality control according to claim 8, characterized in that, in said step 2), said determination of the level of video decoding pressure is based on the possible value of the difference At least one threshold is set within the range of values to form different regions, and the level of video decoding pressure is determined according to which region the difference obtained in step 1) is located in.10、根据权利要求9所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,所述的阈值有6个,按照时间从小到大分别用a、b、c、d、e、f表示;所述的级别有7个,分别用S1~S7表示,其中,10. The method for reducing the complexity of video decoding through decoding quality control according to claim 9, characterized in that there are 6 thresholds, which are respectively used as a, b, c, d, e, Indicated by f; there are 7 levels, represented by S1-S7 respectively, wherein,S1:D<a;S1: D<a;S2:a<=D<b;S2: a<=D<b;S3:b<=D<c;S3: b<=D<c;S4:c<=D<d;S4: c<=D<d;S5:d<=D<e;S5: d<=D<e;S6:e<=D<f;S6: e<=D<f;S7:D>=f。S7: D>=f.11、根据权利要求10所述的通过解码质量控制降低视频解码复杂度的方法,其特征在于,在所述的步骤3)中,对不同级别的视频解码压力采用不同的视频解码算法,其中,11. The method for reducing video decoding complexity through decoding quality control according to claim 10, characterized in that, in said step 3), different video decoding algorithms are used for different levels of video decoding pressure, wherein,a、当解码压力为S1时,采用常规视频解码算法;a. When the decoding pressure is S1, the conventional video decoding algorithm is adopted;b、当解码压力为S2时,在视频解码时,对视频图像的左右各1/4区域内的色度块采用反离散余弦变换简化运算代替反离散余弦变换运算;b. When the decoding pressure is S2, during video decoding, the chrominance blocks in the left and right 1/4 regions of the video image are replaced by the simplified inverse discrete cosine transform operation;c、当解码压力为S3时,在视频解码时,对视频图像的左右各1/4区域内的色度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算;c. When the decoding pressure is S3, during video decoding, the chrominance blocks in the left and right 1/4 regions of the video image are replaced by the simplified operation of the inverse discrete cosine transform, and the simplified operation of motion compensation is used instead of the motion Compensation operation;d、当解码压力为S4时,在视频解码时,对视频图像的左右各1/4区域内的色度块、亮度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算;d. When the decoding pressure is S4, during video decoding, the chrominance blocks and luma blocks in the left and right 1/4 areas of the video image are replaced by inverse discrete cosine transform simplified operations, and motion compensation is used to simplify operation instead of motion compensation operation;e、当解码压力为S5时,在视频解码时,对视频图像的左右各1/4区域内的色度、亮度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波;e. When the decoding pressure is S5, during video decoding, the chrominance and luminance blocks in the left and right 1/4 areas of the video image are replaced by the simplified operation of the inverse discrete cosine transform, and the simplified operation of the motion compensation is adopted Instead of motion compensation operations, and disable in-loop deblocking filtering;f、当解码压力为S6时,在视频解码时,对视频图像的左右和上下各1/4区域内的色度、亮度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波;f. When the decoding pressure is S6, during video decoding, the chrominance and luminance blocks in the left and right and top and bottom 1/4 areas of the video image are replaced by the simplified operation of the inverse discrete cosine transform, and the motion compensation is adopted Simplify calculations instead of motion compensation calculations, and disable in-loop deblocking filtering;g、当解码压力为S7时,在视频解码时,对视频图像的所有区域内的色度、亮度块采用反离散余弦变换简化运算代替反离散余弦变换运算,采用运动补偿简化运算代替运动补偿运算,并禁止环内去块滤波。g. When the decoding pressure is S7, during video decoding, the simplified operation of inverse discrete cosine transform is used instead of the operation of inverse discrete cosine transform for the chrominance and luma blocks in all regions of the video image, and the simplified operation of motion compensation is used instead of the operation of motion compensation , and disable in-loop deblocking filtering.
CNB2006100810555A2006-05-232006-05-23Method for reducing video decoding complexity via decoding qualityExpired - Fee RelatedCN100515082C (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CNB2006100810555ACN100515082C (en)2006-05-232006-05-23Method for reducing video decoding complexity via decoding quality

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CNB2006100810555ACN100515082C (en)2006-05-232006-05-23Method for reducing video decoding complexity via decoding quality

Publications (2)

Publication NumberPublication Date
CN101080007A CN101080007A (en)2007-11-28
CN100515082Ctrue CN100515082C (en)2009-07-15

Family

ID=38907195

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CNB2006100810555AExpired - Fee RelatedCN100515082C (en)2006-05-232006-05-23Method for reducing video decoding complexity via decoding quality

Country Status (1)

CountryLink
CN (1)CN100515082C (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101282466B (en)*2008-05-132011-03-16中兴通讯股份有限公司Method and system for reducing switching time of mobile phone television channel
CN103945261B (en)*2013-01-232017-05-31深圳市快播科技有限公司A kind of video broadcasting method and device
FR3018417B1 (en)*2014-03-042017-07-28Sagemcom Broadband Sas METHOD FOR MODIFYING A BINARY VIDEO STREAM
CN104717509B (en)*2015-03-312017-09-26北京奇艺世纪科技有限公司A kind of video encoding/decoding method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP2000165812A (en)*1998-11-252000-06-16Sony CorpMpeg reproducing device and mpeg reproducing method
US6078693A (en)*1995-01-312000-06-20Sony CorporationMethod and apparatus for reproducing encoded data
US6148032A (en)*1998-05-122000-11-14Hitachi America, Ltd.Methods and apparatus for reducing the cost of video decoders
CN1535027A (en)*2004-01-162004-10-06北京工业大学 A Method of Intra-frame Prediction for Video Coding
WO2005069632A1 (en)*2004-01-052005-07-28Thomson LicensingEncoding method, decoding method, and encoding apparatus for a digital picture sequence

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US6078693A (en)*1995-01-312000-06-20Sony CorporationMethod and apparatus for reproducing encoded data
US6148032A (en)*1998-05-122000-11-14Hitachi America, Ltd.Methods and apparatus for reducing the cost of video decoders
JP2000165812A (en)*1998-11-252000-06-16Sony CorpMpeg reproducing device and mpeg reproducing method
WO2005069632A1 (en)*2004-01-052005-07-28Thomson LicensingEncoding method, decoding method, and encoding apparatus for a digital picture sequence
CN1535027A (en)*2004-01-162004-10-06北京工业大学 A Method of Intra-frame Prediction for Video Coding

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
H264标准的特点及其改进研究. 楼剑,陆亮,虞露,董洁.电视技术,第252期. 2003*
HDTV系统音视频显示时间标签同步生成和自适应交织策略. 张伟,周源华,叶玮.上海交通大学学报,第37卷第6期. 2003*
MPEG_4视频解码器系统设计与实现. 钟林钢,虞露.江南大学学报(自然科学版),第3卷第6期. 2004*

Also Published As

Publication numberPublication date
CN101080007A (en)2007-11-28

Similar Documents

PublicationPublication DateTitle
US12375694B2 (en)Rate control in video coding
US10027966B2 (en)Apparatus and method for compressing pictures with ROI-dependent compression parameters
CN104639948B (en)For Video coding and decoded loop adaptive wiener filter
JP5180294B2 (en) Buffer-based rate control that utilizes frame complexity, buffer level, and intra-frame location in video encoding
JP5479504B2 (en) Region-of-interest video processing on the decoder side
US7289562B2 (en)Adaptive filter to improve H-264 video quality
US8374236B2 (en)Method and apparatus for improving the average image refresh rate in a compressed video bitstream
CN102150427B (en)System and method for video encoding using adaptive loop filter
JP2010166133A (en)Moving picture coding apparatus
JP2002514023A (en) Method and apparatus for reducing breathing artifacts in compressed video
JP2006519565A (en) Video encoding
WO2003061295A2 (en)Sharpness enhancement in post-processing of digital video signals using coding information and local spatial features
EP2824925B1 (en)Video decoding with reduced-complexity deblocking
CN101984665A (en) Method and system for evaluating video transmission quality
US9955160B1 (en)Video encoding using adaptive pre-filtering
CN100515082C (en)Method for reducing video decoding complexity via decoding quality
US7787541B2 (en)Dynamic pre-filter control with subjective noise detector for video compression
TWI280060B (en)Video encoder and method for detecting and encoding noise
TWI237995B (en)Method and apparatus for removing blocking artifact of video picture via loop filtering using perceptual threshold
US9542611B1 (en)Logo detection for macroblock-based video processing
EP1721469A1 (en)System and method for global indication of mpeg impairments in compressed digital video
US20100208800A1 (en)Method and decoder for decoding an image frame of an image frame sequence
KR101051331B1 (en) Adaptive Fast Mode Decision Method Using Dynamic Threshold
Basavaraju et al.Modified pre and post processing methods for optimizing and improving the quality of VP8 video codec
HK1075159B (en)Method and apparatus for improving the average image refresh rate in a compressed video bitstream

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
C14Grant of patent or utility model
GR01Patent grant
ASSSuccession or assignment of patent right

Owner name:BEIJING ZHONGKE CHINA FILM MEDIA TECHNOLOGY CO., L

Free format text:FORMER OWNER: BEIJING YISHIWEI INFORMATION TECHNOLOGY CO., LTD.

C41Transfer of patent application or patent right or utility model
TR01Transfer of patent right

Effective date of registration:20100609

Address after:100080, No. 21 West Fourth Ring Road, Beijing, Haidian District

Co-patentee after:Beijing Zhongke Chinese Shadow Media Technology Co.,Ltd.

Patentee after:Institute of acoustics, Chinese Academy of Sciences

Address before:100080, No. 21 West Fourth Ring Road, Beijing, Haidian District

Co-patentee before:Beijing EZTV Technology Co., Ltd.

Patentee before:Institute of acoustics, Chinese Academy of Sciences

C17Cessation of patent right
CF01Termination of patent right due to non-payment of annual fee

Granted publication date:20090715

Termination date:20110523


[8]ページ先頭

©2009-2025 Movatter.jp