US20140192861A1

Movatterモバイル変換

Info

Publication number: US20140192861A1
Application number: US14/234,151
Authority: US
Inventors: Tzu-Der Chuang; Ching-Yeh Chen; Yu-Wen Huang
Original assignee: MediaTek Inc
Current assignee: HFI Innovation Inc
Priority date: 2011-08-04
Filing date: 2012-08-02
Publication date: 2014-07-10
Also published as: EP2740272A1; CN106101727B; CN106101727A; CN103597834B; EP2988511A1; MX2013015212A; WO2013017092A1; US20170041022A1; US9509989B2; EP2740272A4; CN103597834A; US9838034B2

Abstract

A method and apparatus of context-based adaptive binary arithmetic encoding/decoding for syntax elements of one or more blocks are disclosed. According to one embodiment of the present invention, the binarization results of the x and y positions of the last significant coefficient of a transform unit are reordered by collecting the bypass bins together. According to another embodiment of the present invention, binarization results of syntax elements from two or more of four Intra N×N prediction units, including prev_intra_luma_pred_flag, rem_intra_luma_pred_mode, and mpm_idx are reordered by collecting the bypass bins together. In yet another embodiment according to the present invention, the binarization results of other syntax elements are also reordered by collecting bypass bins together. Furthermore, the above reordering of binarization results may be used for binarization results corresponding to a block and its neighboring blocks.

Description

CROSS REFERENCE TO RELATED APPLICATIONS

The present invention claims priority to U.S. Provisional Patent Application Ser. No. 61/514,986, filed Aug. 4, 2011, entitled “Reordered binarization of last_significant_coeff_x and last_significant_coeff_y”. The U.S. Provisional Patent Application is hereby incorporated by reference in its entirety.

FIELD OF INVENTION

The present invention relates to video coding or video processing. In particular, the present invention relates to reordering binarization results consisting of regular bins and bypass bins in Context-Based Adaptive Binary Arithmetic Coding (CABAC).

BACKGROUND OF THE INVENTION

The arithmetic coding is known as one of the efficient data compressing methods and is widely used in coding standards, such as JBIG, JPEG2000, H.264/AVC, and High-Efficiency Video Coding (HEVC). In H.264/AVC JVT Test Model (JM) and HEVC Test Model (HM), Context-Based Adaptive Binary Arithmetic Coding (CABAC) is adopted as the entropy coding tool for various syntax elements in the video coding system.

FIG. 1 illustrates an example ofCABAC encoder100 which includes three parts:Binarization110,Context Modeling120, and Binary Arithmetic Coding (BAC)130. In the binarization step, each syntax element is uniquely mapped into a binary string (also called bin or bins in this disclosure). In the context modeling step, a probability model is selected for each bin. The corresponding probability model may depend on previously encoded syntax elements, bin indexes, side information, or any combination of the above. After the binarization and the context model assignment, a bin value along with its associated context model is provided to the binary arithmetic coding engine, i.e., the BAC130 block inFIG. 1. The bin value can be coded in two coding modes depending on the syntax element and bin indexes, where one is the regular coding mode, and the other is the bypass mode. The bins corresponding to regular coding mode are referred to as regular bins and the bins corresponding to bypass coding mode are referred to as bypass bins in this disclosure. In the regular coding mode, the probability of the Most Probable Symbol (MPS) and the probability of the Least Probable Symbol (LPS) for BAC are derived from the associated context model. In the bypass coding mode, the probability of the MPS and the LPS are equal. In CABAC, the bypass mode is introduced to speed up the encoding process.

The simplicity of the bypass coding mode allows the encoding/decoding of the CABAC to be implemented in parallel architecture and to achieve high throughput. However, the encoding/decoding throughput for the regular coding mode cannot be accelerated efficiently due to the complex derivation process of the probability of MPS and LPS. For hardware-based CABAC, the throughput based on a series of regular bins followed by a series of bypass bins is higher than the throughput associated with interleaved regular bins and bypass bins. Therefore, reordering the binarization of syntax elements to collect the bypass bins together can improve the encoding and decoding throughput. In High-Efficiency Video Coding Test Model Version 4.0 (HM-4.0), the binarization of certain syntax elements, such asmvd_—10,mvd_—11, mvd_—1c, and coeff_abs_level_minus3, has collected the bypass bins together.

TABLE 1

	Binarized	Unary codeword	Fixed-length codeword
Value	codeword	Part (regular mode)	Part (bypass mode)

0	1	1
1	01	01
2	001	001
3	0001	0001
4	000000	0000	00
5	000001	0000	01
6	000010	0000	10
7	000011	0000	11

It is desirable to further improve the encoding/decoding throughput of CABAC that incorporates a bypass mode.

SUMMARY OF THE INVENTION

A method and apparatus for context-based adaptive binary arithmetic encoding/decoding for syntax elements of one or more blocks are disclosed. According to one embodiment of the present invention, the binarization results of the x and y positions of the last significant coefficient of a transform unit are reordered by collecting the bypass bins together. Furthermore, the above reordering can be used for binarization results corresponding to a block and its neighboring blocks. According to another embodiment of the present invention, binarization results of syntax elements from two or more of four N×N prediction units, including prev_intra_luma_pred_flag, rem_intra_luma_pred_mode, and mpm_idx are reordered by collecting the bypass bins together. Furthermore, the above reordering can be used for binarization results corresponding to all four N×N prediction units. In yet another embodiment according to the present invention, the binarization results of one or more members from a syntax element group consisting of syntax associated with SAO parameters, ALF parameters, coding unit parameters, mode coding parameters, motion parameters, and coefficient coding are reordered by collecting the bypass bins together. Also, the above reordering can be used for binarization results of one or more syntax elements from a block and its neighboring blocks.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates exemplary architecture of CABAC encoding system with a bypass mode.

FIG. 2 illustrates exemplary codewords for syntax elements last_significant_coeff_x and last_significant_coeff_y of 8×8 coding unit.

FIG. 3A illustrates last_significant_coeff_x and last_significant_coeff_y binarization results according to HM-4.0, which results in interleaved regular bins and bypass bins.

FIG. 3B illustrates an example of reordering the binarization results of last_significant_coeff_x and last_significant_coeff_y to collect the bypass bins together according to an embodiment of the present invention.

FIG. 3C illustrates an example of reordering the binarization results of last_significant_coeff_x and last_significant_coeff_y to collect the bypass bins together according to another embodiment of the present invention.

FIG. 4 illustrates an exemplary flow chart of a CABAC decoding system according to one embodiment of the present invention for the x and y positions of last significant coefficient of a transform unit.

FIG. 5 illustrates an exemplary flow chart of a CABAC encoding system according to one embodiment of the present invention for the x and y positions of last significant coefficient of a transform unit.

FIG. 6 illustrates an exemplary flow chart of a CABAC decoding system according to one embodiment of the present invention for Intra N×N prediction units.

FIG. 7 illustrates an exemplary flow chart of a CABAC encoding system according to one embodiment of the present invention for Intra N×N prediction units.

FIG. 8 illustrates an exemplary flow chart of a CABAC decoding system according to one embodiment of the present invention for various syntax elements of one or more blocks.

FIG. 9 illustrates an exemplary flow chart of a CABAC encoding system according to one embodiment of the present invention for various syntax elements of one or more blocks.

DETAILED DESCRIPTION

One embodiment of the present invention improves the encoding/decoding throughput by reordering binarization results of last_significant_coeff_x and last_significant_coeff_y to collect the bypass bins together. After binarization of last_significant_coeff_x and last_significant_coeff_y, the corresponding binarization results are reordered so that the bypass mode bins corresponding to these two syntax elements will be adjacent to each other. Also, the regular bins corresponding to these two syntax elements will also be adjacent to each other.FIG. 2 illustrates an exemplary binarization results for an 8×8 TU according to HM-4.0, where the binarization result of last_significant_coeff_x with a value of 7 is 000011. The first four bits, i.e., 0000 are coded in the regular mode and the last two bits, i.e., 11 are coded in the bypass mode. The binarization result of last_significant_coeff_y having a value of 6 is 000010. The first four bits, i.e., 0000 are coded in the regular mode and the last two bits, i.e., 10 are coded in the bypass mode. According to HM-4.0, the last_significant_coeff_x and last_significant_coeff_y are coded sequentially, which result in interleaved regular bins and bypass bins as shown inFIG. 3A. On the other hand, an embodiment of the present invention reorders the binarization results of last_significant_coeff_x and last_significant_coeff_y to collect the bypass bins together as shown inFIG. 3B. Accordingly, the reordered binarization results have the following arrangement: regular_x, regular_y, bypass_x and bypass_y, where these parts correspond to regular parts and bypass parts for last_significant_coeff_x and last_significant_coeff_y respectively.

While an exemplary reordering of binarization result is illustrated for an 8×8 TU (Transform Unit), embodiments according to the present invention can be applied to TUs of other sizes. Furthermore, the exemplary reordering as shown inFIG. 3B results in an ordered binarization as regular_x, regular_y, bypass_x and bypass_y. Other reordering may also be used to generate consecutive regular bins and/or consecutive bins. For example, the bin locations for regular_x and bypass_y can be switched to cause consecutive regular bins and consecutive bins as shown inFIG. 3C.FIG. 3B illustrates an example of reordering the binarization results of last_significant_coeff_x and last_significant_coeff_y to collect the bypass bins together according to an embodiment of the present invention.FIG. 3C illustrates an example of reordering the binarization results of last_significant_coeff_x and last_significant_coeff_y to collect the bypass bins together according to another embodiment of the present invention.

While the binarization result for each syntax element inFIG. 2 consists of regular bins as well as bypass bins, the present invention can also be applied to binarization results containing only regular bins, only bypass bins, or both regular bins and bypass bins. For example, the binarization result for syntax A may consist of two parts, where one part belongs to regular bins, regular_A and the other part belongs to bypass bins, bypass_A. The binarization result for syntax B may consist of bypass bins, bypass_B only. An embodiment according to the present invention reorders the binarization results by grouping bypass bins from bypass_A and bypass_B. The ordering can also be applied to syntax A and syntax B from multiple blocks. For example, bypass_A and bypass_B from multiple blocks can be grouped together. Similarly, the regular bins for regular_A from multiple blocks can also be grouped together. In another example, the syntax element of the block further comprises syntax C and the binarization result for syntax C may consist of bypass bins, bypass_C only.

An embodiment according to the present invention may reorder the binarization results for syntax elements A, B, and C by collecting bypass bins together and the regular bins together. For example, the reordered binarization results may be as regular_A, regular_B, bypass_A and bypass_C. Other reordering may also be used to collect bypass bins together and/or regular bins together. For example, the reordering corresponding to bypass_A, bypass_C, regular_A, and regular_B also groups bypass bins together and regular bins together. Furthermore, the reordering may be applied to syntax elements from multiple blocks. The above syntax element A and B or syntax elements A, B and C can be selected from a syntax element group consisting of syntax associated with SAO parameters, ALF parameters, coding unit parameters, mode coding parameters, motion parameters, and coefficient coding for a coding system. Typically, each coding system defines a set of syntax for the system. For example, in HM-5.0 (WD5:Working Draft5of High-Efficiency Video Coding,Bross, et. al., Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting: Geneva, CH, 21-30 Nov., 2011, Document: JCTVC-G1103), SAO parameters include sao_merge_left_flag, sao_merge_up_flag, sao_type_idx, sao_band_position, sao_offset_abs, and sao_offset_sign; ALF parameters include alf_cu_flag; coding unit parameters include split_coding_unit_flag, cu_qp_delta, end_of_slice_flag; mode coding parameters include skip_flag, cu_transquant_bypass_flag, part_mode, pred_mode_flag, pcm_flag, pred_type, prev_intra_luma_pred_flag, rem_intra_luma_pred_mode, mpm_idx, intra_chroma_pred_mode, motion parameters include merge_flag, merge_idx, inter_pred_flag, ref_idx_—1c,ref_idx_—10,ref_idx_—11, mvp_idx_—1c,mvp_idx_—10,mvp_idx_—11; and coefficient coding include transform_skip_flag, split_transform_flag, significant_coeff_group_flag, no_residual_data_flag, cbf_luma, cbf_cb, cbf_cr, last_significant_coeff_x, last_significant_coeff_y, significant_coeff_flag, coeff_abs_level_greater1_flag, coeff_abs_level_greater2_flag. While HM-5.0 syntax is illustrated as an example of the syntax element group for practicing the present invention, a person skilled in the art may use different syntax names or syntax element to practice the present invention without departing from the spirit of the present invention.

In yet another embodiment of the present invention, the reordering of binarization results is applied to CABAC coding for an Intra N×N Coding Unit (CU), where the CU is partitioned into four Intra N×N Prediction Units (PUs). Syntax elements associated with the four Intra_N×N PUs coding comprise prev_intra_luma_pred_flag, rem_intra_luma_pred_mode and mpm_idx. When prev_intra_luma_pred_flag has a value of 1, syntax element mpm_idx is incorporated. When prev_intra_luma_pred_flag has a value of 0, syntax element rem_intra_luma_pred_mode is incorporated. The prev_intra_luma_pred_flag is binarized and the binarization results are coded according to the regular coding mode while the rem_intra_luma_pred_mode and mpm_idx are binarized and the binarization results are coded according to the bypass coding mode. The binarized results can be reordered to cause bypass bins corresponding to different syntax elements to be grouped together. The reordering can be applied to the syntax elements from two or more Intra N×N PUs. For example, bypass bins corresponding to binarization results associated with rem_intra_luma_pred_mode and mpm_idx from four Intra N×N PUs can be grouped together. The binarization results corresponding to regular bins associated with syntax element, prev_intra_luma_pred_flag from four N×N PUs can also be grouped into consecutive bins. In the reordered bins, the group of bins associated with binarization results for both rem_intra_luma_pred_mode and mpm_idx from two or more Intra N×N PUs can be before or after the group of bins associated with binarization results for prev_intra_luma_pred_flag from two or more Intra N×N PUs. When reordering is applied to four PUs, bypass bins associated with the four PUs may correspond to four rem_intra_luma_pred_mode's, four mpm_idx's, or any mix of rem_intra_luma_pred_mode's and mpm_idx's, depending on prev_intra_luma_pred_flag's.

FIG. 4 illustrates an exemplary flow chart of a CABAC decoding system according to one embodiment of the present invention for the x and y positions of last significant coefficient of a transform unit. The decoder will decode reordered bins associated with one or more TUs into a first part and a second part, wherein the first part is processed by regular decoding and the second part is processed by bypass decoding as shown instep410. The first regular bins and second regular bins are then determined from the first part associated with said one or more TUs as shown in step420. The first bypass bins and second bypass bins are determined from the second part associated with said one or more TUs as shown instep430. A first codeword corresponding to a first syntax element for each TU is determined, wherein the first codeword comprises the first regular bins and the first bypass bins, and wherein the first syntax element is associated with x-position of a last significant coefficient in said each TU as shown instep440. A second codeword corresponding to a second syntax element corresponding for said each TU is determined, wherein the second codeword comprises the second regular bins and the second bypass bins, and wherein the second syntax element is associated with y-position of the last significant coefficient in said each TU as shown instep450. The first syntax element and the second syntax element for said each TU are then outputted as shown instep460.

FIG. 5 illustrates an exemplary flow chart of a CABAC encoding system according to one embodiment of the present invention for the x and y positions of last significant coefficient of a transform unit. The encoder receives a first syntax element, wherein the first syntax element is associated with x-position of a last significant coefficient for each TU as shown instep510. The encoder further receives a second syntax element, wherein the second syntax element is associated with y-position of the last significant coefficient for said each TU as shown instep520. A first codeword corresponding to the first syntax element for said each TU is determined, wherein the first codeword comprises first regular bins and first bypass bins as shown instep530. A second codeword corresponding to the second syntax element for said each TU is determined, wherein the second codeword comprises second regular bins and second bypass bins as shown instep540. A first part comprising the first regular bins and the second regular bins associated with said one or more TUs is determined as shown instep550. A second part comprising the first bypass bins and the second bypass bins associated with said one or more TUs is determined as shown instep560. The first part and the second part associated with said one or more TUs for binary arithmetic coding are outputted, wherein the first part is processed by regular coding and the second part is processed by bypass coding as shown instep570.

FIG. 6 illustrates an exemplary flow chart of a CABAC decoding system according to one embodiment of the present invention for Intra N×N prediction units. The decoder receives reordered bins comprising a first part and a second part, wherein the first part comprises regular bins associated with each of two or more PUs and the second part comprises first bypass bins or second bypass bins associated with said each of two or more PUs as shown instep610. A first codeword corresponding to a first syntax element for said each of two or more PUs is determined, wherein the first codeword comprises the regular bins, and wherein the first syntax element corresponds to an indication of intra prediction mode selection for said each of two or more PUs as shown instep620. A second codeword corresponding to a second syntax element for said each of two or more PUs if the indication corresponds to most-probable-mode coding, wherein the second syntax element corresponds to an index for a most probable mode is determined, and wherein the second codeword comprises the first bypass bins as shown instep630. A third codeword corresponding to a third syntax element for said each of two or more PUs if the indication corresponds to remaining-prediction-mode coding, wherein the third syntax element corresponds to a remaining prediction mode is determined, wherein the third codeword comprises the second bypass bins as shown instep640. The first syntax element, the second syntax element and the third syntax element for said each of two or more PUs are outputted as shown instep650.

FIG. 7 illustrates an exemplary flow chart of a CABAC encoding system according to one embodiment of the present invention for Intra N×N prediction units. The encoder receives a first syntax element for each PU, wherein the first syntax element corresponds to an indication of intra prediction mode selection for said each PU as shown instep710. The encoder then receives a second syntax element for said each PU if the indication corresponds to most-probable-mode coding, wherein the second syntax element corresponds to an index for a most probable mode as shown instep720. The encoder further receives a third syntax element for said each PU if the indication corresponds to remaining-prediction-mode coding, wherein the third syntax element corresponds to a remaining prediction mode as shown instep730. A first codeword for the first syntax element for said each PU is determined, wherein the first codeword comprises regular bins as shown instep740. A second codeword for the second syntax element for said each PU if the indication corresponds to the most-probable-mode coding is determined, wherein the second codeword comprises first bypass bins as shown instep750. A third codeword for the third syntax element for said each PU if the indication corresponds to the remaining-prediction-mode coding is determined, wherein the third codeword comprises second bypass bins as shown instep760. A first part is determined, wherein the first part comprises the regular bins associated with two or more PUs as shown in step770. A second part is determined, wherein the second part comprises the first bypass bins or the second bypass bins associated with each of said two or more PUs as shown in step780. The first part and the second part for binary arithmetic coding are outputted, wherein the first part is processed by regular coding and the second part is processed by bypass coding as shown instep790.

FIG. 8 illustrates an exemplary flow chart of a CABAC decoding system according to one embodiment of the present invention for various syntax elements of one or more blocks. The decoder decodes reordered bins associated with said one or more blocks into regular bins and a first part, wherein the regular bins are processed by regular decoding and the first part is processed by bypass decoding as shown instep810. The first bypass bins and second bypass bins from the first part associated with said one or more blocks are determined as shown instep820. A first codeword corresponding to a first syntax element for each block is determined, wherein the first codeword comprises the first bypass bins as shown instep830. A second codeword corresponding to a second syntax element corresponding for said each block, wherein the second codeword comprises the second bypass bins, wherein at least one of the first codeword and the second codeword further comprises the regular bins, and wherein the first syntax element and the second syntax element are selected from a syntax element group consisting of syntax associated with SAO parameters, ALF parameters, coding unit parameters, mode coding parameters, motion parameters, and coefficient coding for a coding system as shown instep840. Again, HM-5.0 syntax may be used as an example of the syntax element group for practicing the present invention. The first syntax element and the second syntax element for said each block are outputted as shown instep850.

FIG. 9 illustrates an exemplary flow chart of a CABAC encoding system according to one embodiment of the present invention for various syntax elements of one or more blocks. The encoder receives a first syntax element and a second syntax element from one or more blocks, wherein the first syntax element and the second syntax element are selected from a syntax element group consisting of syntax associated with SAO parameters, ALF parameters, coding unit parameters, mode coding parameters, motion parameters, and coefficient coding for a coding system as shown in step910. Again, HM-5.0 syntax may be used as an example of the syntax element group for practicing the present invention. A first codeword corresponding to the first syntax element is determined, wherein the first codeword comprises first bypass bins as shown instep920. A second codeword corresponding to the second syntax element is determined, wherein the second codeword comprises second bypass bins, and wherein at least one of the first codeword and the second codeword comprises regular bins as shown instep930. A first part comprising the first bypass bins and the second bypass bins associated with said one or more blocks is determined as shown instep940. The first part associated with said one or more blocks for binary arithmetic coding is outputted, wherein the first part is processed by bypass coding as shown instep950.

The above description is presented to enable a person of ordinary skill in the art to practice the present invention as provided in the context of a particular application and its requirement. Various modifications to the described embodiments will be apparent to those with skill in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed. In the above detailed description, various specific details are illustrated in order to provide a thorough understanding of the present invention. Nevertheless, it will be understood by those skilled in the art that the present invention may be practiced.

Embodiment of reordering of binarization results to cause bypass bins together according to the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware codes may be developed in different programming languages and different formats or styles. The software code may also be compiled for different target platforms. However, different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.

The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.