本申请为同一申请人于2009年6月18日提交的申请号为200980159915.4(PCT/JP2009/061130)、发明名称为“运动图像编码装置以及运动图像解码装置”的中国专利申请的分案申请。This application is a divisional application of the Chinese patent application with the application number 200980159915.4 (PCT/JP2009/061130) and the title of the invention "moving image encoding device and moving image decoding device" submitted by the same applicant on June 18, 2009.
技术领域technical field
本发明涉及根据编码以及解码完毕的图像求出运动矢量并进行补偿预测的运动图像编码装置以及运动图像解码装置。The present invention relates to a moving picture coding device and a moving picture decoding device which obtain motion vectors from coded and decoded pictures and perform compensation prediction.
背景技术Background technique
作为运动图像的编码中使用的技术之一，有运动补偿预测。在运动补偿预测中，在运动图像编码装置中使用希望新编码的编码对象图像、和已经得到的局部解码图像求出运动矢量，并使用该运动矢量进行运动补偿，从而生成预测图像。As one of techniques used in encoding of moving pictures, there is motion compensation prediction. In motion-compensated prediction, a motion image encoding device obtains a motion vector using a target image to be newly encoded and an already-obtained local decoded image, and performs motion compensation using the motion vector to generate a predicted image.
作为在运动补偿预测中求出运动矢量的方法之一，有使用从编码完毕的块的运动矢量导出的编码对象块的运动矢量，生成预测图像的直接模式(参照日本专利第4020789号以及美国专利第7233621号)。在直接模式中，不对运动矢量进行编码，所以可以削减运动矢量信息的代码量。在H.264/AVC中采用直接模式。As one of the methods of obtaining the motion vector in motion compensation prediction, there is a direct mode in which a predicted image is generated using the motion vector of the coding target block derived from the motion vector of the coded block (see Japanese Patent No. 4020789 and U.S. Patent No. No. 7233621). In the direct mode, the motion vector is not coded, so the code amount of the motion vector information can be reduced. Direct mode is used in H.264/AVC.
发明内容Contents of the invention
在直接模式中，在预测生成编码对象块的运动矢量时，通过根据与编码对象块邻接的编码完毕的块的运动矢量的中央值计算运动矢量的被固定的方法生成运动矢量。因此，运动矢量计算的自由度低。另外，在为了提高上述自由度而使用了从多个编码完毕的块中选择1个的运动矢量的计算方法的情况下，为了表示所选择出的编码完毕的块，必须始终将该块的位置作为运动矢量选择信息而发送。因此，导致代码量增加。In the direct mode, when predicting and generating the motion vector of the current block to be coded, the motion vector is generated by a fixed method of calculating the motion vector from the median value of the motion vectors of coded blocks adjacent to the current block to be coded. Therefore, the degree of freedom in motion vector calculation is low. In addition, in the case where a calculation method of selecting one motion vector from among a plurality of coded blocks is used in order to increase the above-mentioned degree of freedom, in order to represent the selected coded block, the position of the block must always be Sent as motion vector selection information. Therefore, an increase in the amount of code is caused.
本发明的目的在于提供一种运动图像编码装置以及运动图像解码装置，从编码完毕的块中选择1个而提高运动矢量计算的自由度，并且削减运动矢量选择信息的附加信息。It is an object of the present invention to provide a moving image encoding device and a moving image decoding device which increase the degree of freedom in motion vector calculation by selecting one of coded blocks and reduce additional information of motion vector selection information.
本发明的一个方式提供一种运动图像编码装置，对运动图像进行运动补偿预测编码，该运动图像编码装置具备：取得部，从与编码对象块邻接的编码完毕的块，求出作为具有运动矢量的块的可利用的块以及所述可利用的块的数量；选择部，从作为编码完毕的块的所述可利用的块中选择1个选择块；选择信息编码部，使用与所述可利用的块的数量对应的代码表，对确定所述选择块的选择信息进行编码；以及图像编码部，使用所述选择块具有的运动矢量对所述编码对象块进行运动补偿预测编码。One aspect of the present invention provides a moving image coding device for performing motion compensation predictive coding on a moving image, the moving image coding device includes: an acquisition unit that obtains a block having a motion vector The number of available blocks of the block and the available blocks; the selection unit selects one selection block from the available blocks as encoded blocks; the selection information encoding unit uses the same as the available blocks. encoding the selection information specifying the selected block using a code table corresponding to the number of blocks used; and an image encoding unit performing motion compensation predictive encoding on the encoding target block using a motion vector of the selected block.
本发明的另一方式提供一种运动图像解码装置，对运动图像进行运动补偿预测解码，该运动图像解码装置具备：选择信息解码部，根据作为与解码对象块邻接且具有运动矢量的已解码块的可利用的块的数量切换代码表，对选择信息进行解码；运动矢量选择部，从所述可利用的块中选择由通过所述选择信息解码部解码了的选择信息所示的1个运动矢量；以及图像解码部，使用由所述运动矢量选择部选择出的运动矢量，对解码对象图像进行运动补偿预测解码。Another aspect of the present invention provides a video decoding device for performing motion-compensated predictive decoding on a video, the video decoding device including: a selection information decoding unit configured based on a decoded block that is adjacent to a block to be decoded and has a motion vector The number of available blocks switches the code table and decodes the selection information; the motion vector selection unit selects one motion shown by the selection information decoded by the selection information decoding unit from the available blocks. a vector; and an image decoding unit for performing motion compensation predictive decoding on the decoding target image using the motion vector selected by the motion vector selection unit.
附图说明Description of drawings
图1是本发明的实施方式的运动图像编码装置的框图。FIG. 1 is a block diagram of a video encoding device according to an embodiment of the present invention.
图2是示出运动图像编码装置的处理步骤的流程图。FIG. 2 is a flowchart showing the processing procedure of the video encoding device.
图3是示出取得部/选择部的处理步骤的流程图。FIG. 3 is a flowchart showing a processing procedure of an acquisition unit/selection unit.
图4A是说明基于块尺寸的判别方法的图。FIG. 4A is a diagram illustrating a method of discrimination based on block size.
图4B是说明基于块尺寸的判别方法的图。FIG. 4B is a diagram illustrating a method of discrimination based on block size.
图4C是说明基于块尺寸的判别方法的图。FIG. 4C is a diagram illustrating a method of discrimination based on block size.
图5是说明基于单向或者双向预测的判别方法的图。FIG. 5 is a diagram explaining a method of discrimination based on unidirectional or bidirectional prediction.
图6是示出选择信息编码部的处理步骤的流程图。FIG. 6 is a flowchart showing a processing procedure of a selection information encoding unit.
图7是选择信息的索引的一个例子。FIG. 7 is an example of an index of selection information.
图8是选择信息的代码表的一个例子。Fig. 8 is an example of a code table of selection information.
图9是语法构造的概略。Fig. 9 is an outline of the syntax structure.
图10是宏块层的数据构造。Fig. 10 shows the data structure of the macroblock layer.
图11是本发明的实施方式的运动图像解码装置的框图。FIG. 11 is a block diagram of a video decoding device according to an embodiment of the present invention.
图12是示出运动图像解码装置的处理步骤的流程图。Fig. 12 is a flowchart showing the processing procedure of the video decoding device.
具体实施方式detailed description
以下，参照附图，说明本发明的实施方式。Hereinafter, embodiments of the present invention will be described with reference to the drawings.
参照图1，说明一个实施方式的运动图像编码装置。减法器101构成为计算输入运动图像信号11与预测图像信号15的差分并输出预测误差信号12。减法器101的输出端经由正交变换器102以及量化器103连接到可变长度编码器111。正交变换器102对来自减法器101的预测误差信号12进行正交变换，生成正交变换系数，量化器103对正交变换系数进行量化，输出量化正交变换系数信息13。可变长度编码器111对来自量化器103的量化正交变换系数信息13进行可变长度编码。Referring to FIG. 1 , a video encoding device according to an embodiment will be described. The subtractor 101 is configured to calculate the difference between the input moving image signal 11 and the predicted image signal 15 and output a prediction error signal 12 . The output terminal of the subtractor 101 is connected to a variable length coder 111 via an orthogonal transformer 102 and a quantizer 103 . The orthogonal transformer 102 performs orthogonal transformation on the prediction error signal 12 from the subtractor 101 to generate orthogonal transformation coefficients, and the quantizer 103 quantizes the orthogonal transformation coefficients to output quantized orthogonal transformation coefficient information 13 . The variable length encoder 111 performs variable length encoding on the quantized orthogonal transform coefficient information 13 from the quantizer 103 .
量化器103的输出端经由逆量化器104以及逆正交变换器105连接到加法器106。逆量化器104对量化正交变换系数信息13进行逆量化，变换为正交变换系数。逆正交变换器105将正交变换系数变换为预测误差信号。加法器106对逆正交变换器105的预测误差信号和预测图像信号15进行加法运算，生成局部解码图像信号14。加法器105的输出端经由帧存储器107连接到运动补偿预测器108。The output terminal of the quantizer 103 is connected to the adder 106 via the inverse quantizer 104 and the inverse orthogonal transformer 105 . The inverse quantizer 104 dequantizes the quantized orthogonal transform coefficient information 13 and transforms it into an orthogonal transform coefficient. The inverse orthogonal transformer 105 transforms the orthogonal transform coefficients into prediction error signals. The adder 106 adds the predicted error signal from the inverse orthogonal transformer 105 to the predicted image signal 15 to generate a locally decoded image signal 14 . The output of the adder 105 is connected to a motion compensated predictor 108 via a frame memory 107 .
帧存储器107保存局部解码图像信号14。设定部114设定编码对象块的运动补偿预测模式(预测模式)。预测模式包括使用1幅参照图像的单向预测、和使用2幅参照图像的双向预测。单向预测包括AVC的L0预测以及L1预测。运动补偿预测器108具备预测器109和取得部/选择部110。取得部/选择部110根据与编码对象块邻接的编码完毕的块，求出作为具有运动矢量的块的可利用的块以及上述可利用的块的数量，从可利用的块中选择1个选择块。运动补偿预测器108从帧存储器107根据局部解码图像信号14和输入运动图像信号11生成预测图像信号15。取得部/选择部110从与编码对象块邻接的邻接块选择1个块(选择块)。例如，将邻接块中的具有适合的运动矢量的块选择为选择块。取得部/选择部110将选择块具有的运动矢量选择为用于运动补偿预测的运动矢量16，并发送到预测器109。另外，取得部/选择部110生成选择块的选择信息17，并发送到可变长度编码器111。The frame memory 107 stores the locally decoded image signal 14 . The setting unit 114 sets the motion compensation prediction mode (prediction mode) of the coding target block. The prediction modes include unidirectional prediction using one reference picture and bidirectional prediction using two reference pictures. Unidirectional prediction includes AVC L0 prediction and L1 prediction. The motion compensation predictor 108 includes a predictor 109 and an acquisition unit/selection unit 110 . The acquisition unit/selection unit 110 obtains available blocks as blocks having motion vectors and the number of available blocks from the encoded blocks adjacent to the encoding target block, and selects one of the available blocks. Piece. The motion compensation predictor 108 generates a predicted image signal 15 from the frame memory 107 from the locally decoded image signal 14 and the input moving image signal 11 . The acquisition unit/selection unit 110 selects one block (selected block) from adjacent blocks adjacent to the encoding target block. For example, a block having an appropriate motion vector among adjacent blocks is selected as the selected block. The acquisition unit/selection unit 110 selects the motion vector of the selected block as the motion vector 16 used for motion compensation prediction, and sends it to the predictor 109 . Also, the acquiring unit/selecting unit 110 generates selection information 17 for selecting a block, and sends it to the variable length encoder 111 .
可变长度编码器111具有选择信息编码部112。选择信息编码部112以在代码表中具有与作为编码完毕的块的可利用块的块的数量相等数量的记录的方式切换代码表，并且对选择信息17进行可变长度编码。可利用的块是指与编码对象块邻接的编码完毕的块中的、具有运动矢量的块。复用器(多路复用器)113对编码后的量化正交变换系数信息以及选择信息进行复用，输出编码数据。The variable length encoder 111 has a selection information encoding unit 112 . The selection information coding unit 112 switches the code table so that the number of records equal to the number of available blocks as coded blocks exists in the code table, and performs variable-length coding on the selection information 17 . An available block refers to a block having a motion vector among coded blocks adjacent to the current block to be coded. The multiplexer (multiplexer) 113 multiplexes the encoded quantized orthogonal transform coefficient information and selection information, and outputs encoded data.
参照图2的流程图，说明上述结构的运动图像编码装置的作用。Referring to the flowchart of FIG. 2, the operation of the moving image coding apparatus having the above configuration will be described.
首先，生成预测误差信号12(S11)。在该预测误差信号12的生成中，选择运动矢量，使用所选择出的运动矢量生成预测图像。通过减法器101计算该预测图像的信号即预测图像信号15与输入运动图像信号11的差分，从而生成预测误差信号12。First, the prediction error signal 12 is generated (S11). In generating the prediction error signal 12, a motion vector is selected, and a predicted image is generated using the selected motion vector. The subtractor 101 calculates the difference between the predicted image signal 15 , which is a signal of the predicted image, and the input video signal 11 to generate a prediction error signal 12 .
通过正交变换器102对预测误差信号12实施正交变换，生成正交变换系数(S12)。通过量化器103对正交变换系数进行量化(S13)。通过逆量化器104对量化后的正交变换系数信息进行逆量化(S14)，之后，通过逆正交变换器105进行逆正交变换，得到再生的预测误差信号(S15)。在加法器106中，通过对再生的预测误差信号和预测图像信号15进行加法运算，生成局部解码图像信号14(S16)。局部解码图像信号14被保存到帧存储器107(作为参照图像)(S17)，从帧存储器107读出的局部解码图像信号被输入到运动补偿预测器108。The prediction error signal 12 is subjected to orthogonal transformation by the orthogonal transformer 102 to generate orthogonal transformation coefficients (S12). The orthogonal transform coefficients are quantized by the quantizer 103 (S13). The quantized orthogonal transform coefficient information is inversely quantized by the inverse quantizer 104 (S14), and then inversely orthogonally transformed by the inverse orthogonal transformer 105 to obtain a reproduced prediction error signal (S15). In the adder 106, the reproduced prediction error signal and the predicted image signal 15 are added to generate the local decoded image signal 14 (S16). The locally decoded image signal 14 is stored in the frame memory 107 (as a reference image) ( S17 ), and the locally decoded image signal read from the frame memory 107 is input to the motion compensation predictor 108 .
运动补偿预测器108的预测器109使用运动矢量16对局部解码图像信号(参照图像)进行运动补偿预测，生成预测图像信号15。为了取得与输入运动图像信号11的差分，预测图像信号15被发送到减法器101，进而为了生成局部解码图像信号14还被发送到加法器106。The predictor 109 of the motion compensation predictor 108 performs motion compensation prediction on the locally decoded image signal (reference image) using the motion vector 16 to generate the predicted image signal 15 . The predicted image signal 15 is sent to the subtractor 101 to obtain a difference from the input moving image signal 11 , and is also sent to the adder 106 to generate the local decoded image signal 14 .
取得部/选择部110从邻接块中选择运动补偿预测中使用的1个运动矢量，将所选择出的运动矢量16发送到预测器109，生成选择信息17。选择信息17被发送到选择信息编码部112。在从邻接块中选择运动矢量时，能够选择代码量变小那样的适合的运动矢量。The acquisition unit/selection unit 110 selects one motion vector used for motion compensation prediction from adjacent blocks, sends the selected motion vector 16 to the predictor 109 , and generates selection information 17 . The selection information 17 is sent to the selection information encoding unit 112 . When selecting a motion vector from adjacent blocks, it is possible to select an appropriate motion vector with a reduced code amount.
由量化器103量化后的正交变换系数信息13还输入到可变长度编码器111，实施可变长度编码(S18)。从取得部/选择部110，输出运动补偿预测中使用的选择信息16，并输入到选择信息编码部112。在选择信息编码部112中，以在代码表中具有与作为和编码对象块邻接并具有运动矢量的编码完毕的块的可利用的块的数量相等的数量的记录的方式切换代码表，对选择信息17进行可变长度编码。通过复用器113对来自可变长度编码器111的量化正交变换系数信息以及选择信息进行复用，输出编码数据18的比特流(S19)。编码数据18被送出到未图示的保存系统或者传送路径。The orthogonal transform coefficient information 13 quantized by the quantizer 103 is also input to the variable length encoder 111, and subjected to variable length encoding (S18). The selection information 16 used for motion compensation prediction is output from the acquisition unit/selection unit 110 and input to the selection information encoding unit 112 . In the selection information encoding unit 112, the code table is switched so that the number of records equal to the number of available blocks that are encoded blocks that are adjacent to the encoding target block and have a motion vector are stored in the code table. The information 17 is variable-length coded. The quantized orthogonal transform coefficient information and selection information from the variable length encoder 111 are multiplexed by the multiplexer 113, and the bit stream of the coded data 18 is output (S19). The coded data 18 is sent to a storage system or transmission path not shown.
在图2的流程图中，步骤S14～S17的流程和步骤S18以及S19的流程可以置换。即，可以接着量化步骤S13进行可变长度编码步骤S18以及复用步骤S19，并对复用步骤S19进行逆量化步骤S14～存储步骤S17。In the flow chart of FIG. 2 , the flow of steps S14 to S17 and the flow of steps S18 and S19 can be replaced. That is, the variable length encoding step S18 and the multiplexing step S19 may be performed following the quantization step S13, and the inverse quantization step S14 to the storage step S17 may be performed on the multiplexing step S19.
接下来，使用图3所示的流程图，说明取得部/选择部110的作用。Next, the operation of the acquisition unit/selection unit 110 will be described using the flowchart shown in FIG. 3 .
首先，参照帧存储器107，搜索与编码对象块邻接的、作为具有运动矢量的编码完毕的块的可利用的块候补(S101)。如果搜索到可利用的块候补，则判别这些可利用的块候补的运动补偿预测的块尺寸(S102)。接下来，判别可利用的块候补是单向还是双向预测(S103)。根据判别结果和编码对象块的预测模式，从可利用的块候补中抽出可利用的块。从所抽出的可利用的块中选择1个选择块，求出确定选择块的信息作为选择信息(S104)。First, with reference to the frame memory 107, an available block candidate that is an encoded block having a motion vector adjacent to the encoding target block is searched (S101). If available block candidates are searched, the block size of the motion compensation prediction of these available block candidates is judged (S102). Next, it is determined whether the available block candidates are unidirectional or bidirectional prediction (S103). An available block is extracted from available block candidates based on the determination result and the prediction mode of the coding target block. One selection block is selected from the extracted available blocks, and information specifying the selection block is obtained as selection information (S104).
接下来，参照图4A～4C，说明块尺寸的判别(S102)。Next, the determination of the block size (S102) will be described with reference to FIGS. 4A to 4C.
本实施方式中使用的邻接块是位于编码对象块的左、左上、上、右上的块。因此，在编码对象块位于帧的最左上的情况下，由于没有与编码对象块邻接的可利用的块，所以无法对该编码对象块应用本发明。在编码对象块处于画面的上端的情况下，可利用的块仅为左侧的1块，在编码对象块是画面的左端、并且并非右端的情况下，可利用的块成为编码对象块的上、右上这2块。Adjacent blocks used in this embodiment are blocks located to the left, upper left, upper, and upper right of the block to be encoded. Therefore, when the coding target block is located at the uppermost left of the frame, since there is no usable block adjacent to the coding target block, the present invention cannot be applied to the coding target block. When the encoding target block is at the upper end of the screen, the available block is only one block on the left, and when the encoding target block is at the left end of the screen and not the right end, the available block is the upper end of the encoding target block , These 2 blocks on the upper right.
在宏块尺寸是16×16尺寸的情况下，邻接块的运动补偿预测的块尺寸如图4A～4C所示有16×16尺寸、16×8尺寸、8×16尺寸、8×8尺寸这4种。在考虑了这些4种时，能够成为可利用的块的邻接块为图4A～4C所示那样的20种。即，在图4A所示的16×16尺寸下为4种、在图4B所示的16×8尺寸以及8×16尺寸下为10种、在图4C所示的8x8尺寸下为6种。在块尺寸的判别(S102)中，从这20种的块中根据块尺寸搜索可利用的块。例如，在将可利用的块的尺寸设为仅16×16的情况下，在该块尺寸下判定出的可利用的块如图4A所示是16×16尺寸的4种块。即，可利用的块是编码对象块的左上侧的块、编码对象块的上侧的块、编码对象块的左侧的块、以及编码对象块的右上侧的块。另外，对于宏块尺寸被扩展成16×16尺寸以上的情况，也与宏块尺寸是16×16尺寸的情况同样地能够得到可利用的块。例如，在宏块尺寸是32×32尺寸的情况下，邻接块的运动补偿预测的块尺寸有32×32尺寸、32×16尺寸、16×32尺寸、16×16尺寸这4种，能够成为可利用的块的邻接块为20种。When the macroblock size is 16×16, the block sizes of motion compensation prediction of adjacent blocks are 16×16, 16×8, 8×16, and 8×8 as shown in FIGS. 4A to 4C . 4 kinds. When these four types are considered, there are 20 types of adjacent blocks that can be used as blocks as shown in FIGS. 4A to 4C . That is, there are 4 types in the 16×16 size shown in FIG. 4A , 10 types in the 16×8 size and 8×16 size shown in FIG. 4B , and 6 types in the 8×8 size shown in FIG. 4C . In the determination of the block size (S102), an available block is searched for according to the block size among these 20 types of blocks. For example, when the available block size is set to only 16×16, the available blocks determined in this block size are four types of blocks of 16×16 size as shown in FIG. 4A . That is, the available blocks are the upper left block of the encoding target block, the upper block of the encoding target block, the left side block of the encoding target block, and the upper right block of the encoding target block. Also, when the macroblock size is extended to 16×16 or larger, usable blocks can be obtained similarly to the case where the macroblock size is 16×16. For example, when the macroblock size is 32×32, there are four types of block sizes for motion compensation prediction of adjacent blocks: 32×32, 32×16, 16×32, and 16×16. There are 20 types of adjacent blocks available for use.
接下来，参照图5，举出例子来说明由取得部/选择部110进行的单向或者双向预测的判别(S103)。Next, with reference to FIG. 5 , the determination of unidirectional or bidirectional prediction by the acquisition unit/selection unit 110 ( S103 ) will be described with an example.
例如，将块尺寸限制为16×16，针对编码对象块，邻接的块的单向或者双向预测为图5所示那样的情况。在单向或者双向预测的判别(S103)中，根据预测的方向搜索可利用的块。例如，将包括预测方向L0的邻接块设为在预测方向上判定出的可利用的块。即，图5(a)所示的、编码对象块的上、左、右上的块成为在预测方向上判定出的可利用的块。在该情况下，不使用编码对象块的左上的块。如果将包括预测方向L1的邻接块设为通过预测方法判定出的可利用的块，则图5(b)所示的、编码对象块的左上以及上侧的块成为在预测方向上判定出的可利用的块。在该情况下，不使用编码对象块的左以及右上的块。如果将包括预测方向L0/L1的邻接块设为通过预测方法判定出的可利用的块，则仅图5(c)所示的、编码对象块的上侧的块成为在预测方向上判定出的可利用的块。在该情况下，不使用编码对象块的左、左上以及右上的块。另外，预测方向L0(L1)对应于AVC中的L0预测(L1预测)的预测方向。For example, the block size is limited to 16×16, and the unidirectional or bidirectional prediction of adjacent blocks for the coding target block is as shown in FIG. 5 . In the determination of unidirectional or bidirectional prediction (S103), an available block is searched according to the direction of prediction. For example, let an adjacent block including the prediction direction L0 be an available block determined in the prediction direction. That is, the upper, left, and upper right blocks of the coding target block shown in FIG. 5( a ) are available blocks determined in the prediction direction. In this case, the upper left block of the encoding target block is not used. If the adjacent blocks including the prediction direction L1 are set as available blocks determined by the prediction method, the upper left and upper blocks of the coding target block shown in FIG. 5(b) become the blocks determined in the prediction direction. blocks available. In this case, the left and upper right blocks of the coding target block are not used. If the adjacent blocks including the prediction direction L0/L1 are set as available blocks determined by the prediction method, only the block above the coding target block shown in FIG. 5(c) will be determined in the prediction direction. available blocks. In this case, the left, upper left, and upper right blocks of the coding target block are not used. In addition, the prediction direction L0 (L1) corresponds to the prediction direction of L0 prediction (L1 prediction) in AVC.
接下来，参照图6所示的流程图，说明选择信息编码部112。Next, the selection information coding unit 112 will be described with reference to the flowchart shown in FIG. 6 .
从与编码对象块邻接的邻接块中，搜索作为具有运动矢量的编码完毕的块的可利用的块，取得块尺寸以及在单向或者双向预测中判定出的可利用的块信息(S201)。使用该可利用的块信息，进行图8所示那样的与可利用的块的数量对应的代码表的切换(S202)。使用切换后的代码表，对从取得部/选择部110发送的选择信息17进行可变长度编码(S203)。From adjacent blocks adjacent to the current block to be encoded, an available block that is an encoded block having a motion vector is searched for, and block size and available block information determined by unidirectional or bidirectional prediction are obtained (S201). Using the available block information, switching of the code table corresponding to the number of available blocks as shown in FIG. 8 is performed (S202). The selection information 17 sent from the acquisition unit/selection unit 110 is variable-length coded using the switched code table (S203).
接下来，参照图7，说明选择信息的索引的一个例子。Next, an example of an index of selection information will be described with reference to FIG. 7 .
在如图7(a)所示地没有可利用的块的情况下，本发明不能应用于该块，所以不发送选择信息。在如图7(b)所示地可利用的块是1个的情况下，编码对象块的运动补偿中使用的可利用的块的运动矢量唯一地确定，所以不发送选择信息。在如图7(c)所示地可利用的块是2个的情况下，发送索引0或者1的选择信息。在如图7(d)所示地可利用的块是3个的情况下，发送索引0、1或者2的选择信息。在如图7(e)所示地可利用的块是4个的情况下，发送索引0、1、2或者3的选择信息。In the case where there is no available block as shown in FIG. 7( a ), the present invention cannot be applied to the block, so selection information is not transmitted. When there is one available block as shown in FIG. 7( b ), since the motion vector of the available block used for motion compensation of the current block to be encoded is uniquely determined, selection information is not transmitted. When there are two available blocks as shown in FIG. 7( c ), selection information of index 0 or 1 is transmitted. When there are three available blocks as shown in FIG. 7( d ), selection information of index 0, 1, or 2 is transmitted. When there are four available blocks as shown in FIG. 7( e ), selection information of index 0, 1, 2, or 3 is transmitted.
另外，作为可利用的块的索引的附加方法的一个例子，按照编码对象块的左、左上、上、右上的顺序，对可利用的块附加了索引的例子如图7所示。即，去除不使用的块而对所使用的块连续附加索引。In addition, as an example of a method of adding indexes of available blocks, an example in which indexes are added to available blocks in the order of left, upper left, upper, and upper right of the encoding target block is shown in FIG. 7 . That is, unused blocks are removed and indexes are continuously added to used blocks.
接下来，参照图8，说明选择信息17的代码表。Next, the code table of the selection information 17 will be described with reference to FIG. 8 .
在选择信息编码部112中，根据可利用的块的数量进行代码表的切换(S202)。如上所述，需要对选择信息17进行编码的是可利用的块为2个以上的情况。In the selection information encoding unit 112, the code table is switched according to the number of available blocks (S202). As described above, it is necessary to encode the selection information 17 when there are two or more available blocks.
首先，在可利用的块是2个的情况下，索引需要0和1，代码表成为图8的左侧所示的表。在可利用的块是3个的情况下，索引成为0、1、2，代码表成为图8的中央所示的表。在可利用的块是4个的情况下，索引需要0、1、2、3，代码表成为图8的右侧所示的表。根据可利用的块的数量，切换这些代码表。First, when there are two available blocks, 0 and 1 are required for the index, and the code table becomes the table shown on the left side of FIG. 8 . When there are three available blocks, the indexes are 0, 1, and 2, and the code table is the table shown in the center of FIG. 8 . When there are four available blocks, the indexes need to be 0, 1, 2, and 3, and the code table becomes the table shown on the right side of FIG. 8 . Depending on the number of blocks available, these code tables are switched.
接下来，说明选择信息的编码方法。Next, a method of encoding selection information will be described.
图9示出在本实施方式中使用的语法的构造的概略。语法主要由3个部分构成，High Level Syntax801(高级语法)被填入切片以上的上位层的语法信息。在Slice LevelSyntax804(切片级语法)中，针对每个切片明记有所需的信息，在Macroblock LevelSyntax807(宏块级语法)中，针对每个宏块明记有所需的可变长度编码后的误差信号、模式信息等。FIG. 9 shows an outline of the syntax structure used in this embodiment. The syntax is mainly composed of three parts, and the High Level Syntax 801 (high level syntax) is filled with the syntax information of the upper layer above the slice. In Slice LevelSyntax804 (slice-level syntax), the required information is clearly recorded for each slice, and in Macroblock LevelSyntax807 (macroblock-level syntax), the required variable-length coded information is clearly recorded for each macroblock Error signals, mode information, etc.
这些句法分别由更详细的语法构成，在High Level Syntax801中，由Sequenceparameter set syntax(时序参数组语法)802和Picture parameter set syntax(图片参数组语法)803等序列、图片级的语法构成。在Slice Level Syntax804中，由Slice headersyntax(切片头语法)405、Slice data syntax(切片数据语法)406等构成。进而，Macroblock Level Syntax807由macroblock layer syntax(宏块层语法)808、macroblockprediction syntax(宏块预测语法)809等构成。These syntaxes are composed of more detailed syntaxes. High Level Syntax 801 consists of sequence and picture-level syntaxes such as Sequence parameter set syntax (sequence parameter set syntax) 802 and Picture parameter set syntax (picture parameter set syntax) 803 . The Slice Level Syntax 804 is composed of a Slice header syntax 405, a Slice data syntax 406, and the like. Furthermore, Macroblock Level Syntax 807 is composed of macroblock layer syntax (macroblock layer syntax) 808, macroblock prediction syntax (macroblock prediction syntax) 809, and the like.
在本实施方式中所需的语法信息是macroblock layer syntax808，以下说明语法。Syntax information required in this embodiment is macroblock layer syntax 808, and the syntax will be described below.
图10(a)(b)所示的available_block_num表示可利用的块的数量，在其是2以上的情况下，需要选择信息的编码。另外，mvcopy_flag是表示在运动补偿预测中是否使用可利用的块的运动矢量的标志，在可利用的块是1以上、并且该标志是1的情况下，能够在运动补偿预测中使用可利用的块的运动矢量。进而，mv_select_info表示选择信息，代码表如上所述。available_block_num shown in (a)(b) of FIG. In addition, mvcopy_flag is a flag indicating whether to use the motion vector of an available block in motion compensation prediction. When the number of available blocks is 1 or more and this flag is 1, the available block can be used in motion compensation prediction. The block's motion vector. Furthermore, mv_select_info indicates selection information, and the code table is as described above.
图10(a)示出在mb_type之后对选择信息进行编码的情况的句法。在例如块尺寸仅为16×16的情况下，如果mb_type不是16×16，则无需对mvcopy_flag以及mv_select_info进行编码。如果mb_type是16x16，则对mvcopy_flag以及mv_select_info进行编码。FIG. 10( a ) shows the syntax of a case where selection information is encoded after mb_type. For example, when the block size is only 16×16, if mb_type is not 16×16, there is no need to encode mvcopy_flag and mv_select_info. If mb_type is 16x16, encode mvcopy_flag and mv_select_info.
图10(b)示出在mb_type之前对选择信息进行编码的情况的语法。如果例如mvcopy_flag是1，则无需对mb_type进行编码。如果mv_copy_flag是0，则对mb_type进行编码。FIG. 10( b ) shows the syntax of the case where selection information is encoded before mb_type. If e.g. mvcopy_flag is 1, there is no need to encode mb_type. If mv_copy_flag is 0, mb_type is encoded.
在本实施方式中，对于编码的扫描顺序，可以是任意的顺序。例如，对行扫描、Z扫描等都可以应用本发明。In this embodiment, the scanning order of encoding may be any order. For example, the present invention can be applied to line scan, Z scan, and the like.
参照图11，说明其他实施方式的运动图像解码装置。A video decoding device according to another embodiment will be described with reference to FIG. 11 .
将从图1的运动图像编码装置输出的编码数据18经由保存系统或者传送系统作为解码对象的编码数据21输入到运动图像解码装置的逆复用器201。逆复用器(多路分离器)201对编码数据21进行逆复用，将编码数据21分离为量化正交变换系数信息以及选择信息。逆复用器201的输出端连接到可变长度解码器202。可变长度解码器202对量化正交变换系数信息以及选择信息进行解码。将可变长度解码器202的输出端经由逆量化器204以及逆正交变换器205连接到加法器206。逆量化器204对量化正交变换系数信息进行逆量化，变换为正交变换系数。逆正交变换器205对正交变换系数进行逆正交变换，生成为预测误差信号。加法器206将预测误差信号加到来自预测图像生成器207的预测图像信号，生成运动图像信号。The coded data 18 output from the video coding device in FIG. 1 is input to the inverse multiplexer 201 of the video decoding device as coded data 21 to be decoded via a storage system or a transmission system. The inverse multiplexer (demultiplexer) 201 inversely multiplexes the coded data 21, and separates the coded data 21 into quantized orthogonal transform coefficient information and selection information. The output of the inverse multiplexer 201 is connected to a variable length decoder 202 . The variable length decoder 202 decodes quantized orthogonal transform coefficient information and selection information. The output terminal of the variable length decoder 202 is connected to the adder 206 via the inverse quantizer 204 and the inverse orthogonal transformer 205 . The inverse quantizer 204 dequantizes the quantized orthogonal transform coefficient information and transforms it into an orthogonal transform coefficient. The inverse orthogonal transform unit 205 performs inverse orthogonal transform on the orthogonal transform coefficients to generate a prediction error signal. The adder 206 adds the prediction error signal to the predicted image signal from the predicted image generator 207 to generate a moving image signal.
预测图像生成器207包括预测器208和选择部209。选择部209通过由可变长度解码器202的选择信息解码器203解码了的选择信息23选择运动矢量，将选择运动矢量25发送到预测器208。预测器208通过运动矢量25对帧存储器210中保存的参照图像进行运动补偿，生成预测图像。The predicted image generator 207 includes a predictor 208 and a selection section 209 . The selection unit 209 selects a motion vector using the selection information 23 decoded by the selection information decoder 203 of the variable length decoder 202 , and sends the selected motion vector 25 to the predictor 208 . The predictor 208 performs motion compensation on the reference image stored in the frame memory 210 using the motion vector 25 to generate a predicted image.
参照图12的流程图，说明上述结构的运动图像解码装置的作用。Referring to the flowchart of FIG. 12, the operation of the moving picture decoding apparatus having the above configuration will be described.
通过逆复用器201对编码数据21进行逆复用(S31)，通过可变长度解码器202进行解码，生成量化正交变换系数信息22(S32)。另外，通过选择信息解码器203，调查与解码对象块邻接的邻接块的状态，根据作为具有运动矢量的邻接的编码完毕的块的可利用的块的数量，与编码装置的选择信息编码部112同样地，如图8那样地切换代码表而进行解码。由此，输出选择信息23(S33)。The encoded data 21 is inversely multiplexed by the inverse multiplexer 201 (S31), decoded by the variable length decoder 202, and quantized orthogonal transform coefficient information 22 is generated (S32). In addition, the selection information decoder 203 checks the state of adjacent blocks adjacent to the block to be decoded, and communicates with the selection information encoding unit 112 of the encoding device based on the number of available blocks as adjacent encoded blocks having motion vectors. Similarly, decoding is performed by switching the code table as shown in FIG. 8 . Thereby, selection information 23 is output (S33).
作为从可变解码器202输出的信息的、量化后的正交变换系数信息22被发送到逆量化器204，作为从选择信息解码部203输出的信息的、选择信息23被发送到选择部209。Quantized orthogonal transform coefficient information 22, which is information output from the variable decoder 202, is sent to the inverse quantizer 204, and selection information 23, which is information output from the selection information decoding section 203, is sent to the selection section 209. .
通过逆量化器204对量化正交变换系数信息22进行逆量化(S34)，之后，通过逆正交变换器205进行逆正交变换(S35)。由此，得到预测误差信号24。在加法器206中对预测误差信号24加上预测图像信号，从而再生运动图像信号26(S36)。所再生的运动图像信号27保存到帧存储器210(S37)。The quantized orthogonal transform coefficient information 22 is inversely quantized by the inverse quantizer 204 (S34), and then inversely transformed by the inverse orthogonal transformer 205 (S35). Thus, a prediction error signal 24 is obtained. The predictive image signal is added to the predictive error signal 24 in the adder 206 to reproduce the moving image signal 26 (S36). The reproduced video signal 27 is stored in the frame memory 210 (S37).
在预测图像生成器207中，使用通过所解码出的选择信息23选择出的、作为与解码对象块邻接并具有运动矢量的既解码块的可利用的块的运动矢量，生成预测图像26。在选择部209中，调查邻接块的状态，根据邻接块的可利用的块信息和由选择信息解码部203解码出的选择信息23，与编码装置的取得部/选择部110同样地，从邻接块中选择1个运动补偿预测中使用的运动矢量。使用该选择出的运动矢量25，通过预测器208生成预测图像26，并且为了得到运动图像信号27将预测图像26发送到加法器206。The predicted image generator 207 generates the predicted image 26 using the motion vector of an available block that is a decoded block that is adjacent to the block to be decoded and has a motion vector and is selected by the decoded selection information 23 . In the selection unit 209, the state of the adjacent block is checked, and based on the available block information of the adjacent block and the selection information 23 decoded by the selection information decoding unit 203, similarly to the acquisition unit/selection unit 110 of the encoding device, the adjacent block is selected. One motion vector used for motion compensation prediction is selected in the block. The predicted image 26 is generated by the predictor 208 using the selected motion vector 25 , and the predicted image 26 is sent to the adder 206 to obtain the moving image signal 27 .
根据本发明，通过对与可利用的块的数量对应的选择信息进行编码，能够使用适合的编码表来发送选择信息，能够削减选择信息的附加信息。According to the present invention, by encoding the selection information corresponding to the number of available blocks, the selection information can be transmitted using an appropriate coding table, and the additional information of the selection information can be reduced.
另外，通过将可利用的块的运动矢量用于编码对象块的运动补偿预测，能够削减与运动矢量信息相关的附加信息。In addition, by using an available motion vector of a block for motion-compensated prediction of a block to be coded, it is possible to reduce additional information related to motion vector information.
进而，通过不固定运动矢量计算方法而从可利用的块选择适合的1个块，相比于直接模式，运动矢量计算的自由度变高。Furthermore, by selecting an appropriate block from available blocks without fixing the motion vector calculation method, the degree of freedom in motion vector calculation is increased compared to the direct mode.
本发明的实施方式记载的本发明的手法能够通过计算机执行，并且，还可以作为能够使计算机执行的程序，保存到磁盘(软盘、硬盘等)、光盘(CD-ROM、DVD等)、半导体存储器等记录介质而发布。The method of the present invention described in the embodiments of the present invention can be executed by a computer, and can also be stored in a magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory as a program that can be executed by the computer. and other recording media.
另外，本发明不限于上述实施方式，可以在实施阶段在不脱离其要旨的范围内使构成要素变形而具体化。另外，可以通过上述实施方式公开的多个构成要素的适宜的组合，形成各种发明。例如，也可以从实施方式所示的所有构成要素中删除几个构成要素。进而，也可以适宜地组合不同的实施方式的构成要素。In addition, the present invention is not limited to the above-described embodiments, and the constituent elements may be modified and embodied in a range not departing from the gist at the stage of implementation. In addition, various inventions can be formed by appropriate combinations of a plurality of constituent elements disclosed in the above embodiments. For example, some constituent elements may be deleted from all the constituent elements described in the embodiment. Furthermore, components of different embodiments may be combined as appropriate.
产业上的可利用性Industrial availability
本发明的装置使用于通信、保存以及广播中的图像压缩处理。The device of the present invention is used for image compression processing in communication, storage, and broadcasting.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410082064.0ACN103826126B (en) | 2009-06-18 | 2009-06-18 | Dynamic image encoding device and dynamic image encoding method |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410082064.0ACN103826126B (en) | 2009-06-18 | 2009-06-18 | Dynamic image encoding device and dynamic image encoding method |
| CN200980159915.4ACN102461172B (en) | 2009-06-18 | 2009-06-18 | Moving picture coding apparatus |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200980159915.4ADivisionCN102461172B (en) | 2009-06-18 | 2009-06-18 | Moving picture coding apparatus |
| Publication Number | Publication Date |
|---|---|
| CN103826126A CN103826126A (en) | 2014-05-28 |
| CN103826126Btrue CN103826126B (en) | 2017-09-29 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410082064.0AActiveCN103826126B (en) | 2009-06-18 | 2009-06-18 | Dynamic image encoding device and dynamic image encoding method |
| Country | Link |
|---|---|
| CN (1) | CN103826126B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1449197A (en)* | 2002-03-29 | 2003-10-15 | Lg电子株式会社 | B image mode determining method and apparatus of video coding system |
| WO2006052577A2 (en)* | 2004-11-04 | 2006-05-18 | Thomson Licensing | Method and apparatus for fast mode decision of b-frames in a video encoder |
| CN1812586A (en)* | 2002-10-04 | 2006-08-02 | Lg电子株式会社 | Direct mode motion vector calculation method for b picture |
| WO2008086316A2 (en)* | 2007-01-08 | 2008-07-17 | Qualcomm Incorporated | Variable length coding techniques for coded block patterns |
| JP2008205790A (en)* | 2007-02-20 | 2008-09-04 | Matsushita Electric Ind Co Ltd | H. H.264 decoding device, program, and recording medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1449197A (en)* | 2002-03-29 | 2003-10-15 | Lg电子株式会社 | B image mode determining method and apparatus of video coding system |
| CN1812586A (en)* | 2002-10-04 | 2006-08-02 | Lg电子株式会社 | Direct mode motion vector calculation method for b picture |
| WO2006052577A2 (en)* | 2004-11-04 | 2006-05-18 | Thomson Licensing | Method and apparatus for fast mode decision of b-frames in a video encoder |
| WO2008086316A2 (en)* | 2007-01-08 | 2008-07-17 | Qualcomm Incorporated | Variable length coding techniques for coded block patterns |
| JP2008205790A (en)* | 2007-02-20 | 2008-09-04 | Matsushita Electric Ind Co Ltd | H. H.264 decoding device, program, and recording medium |
| Publication number | Publication date |
|---|---|
| CN103826126A (en) | 2014-05-28 |
| Publication | Publication Date | Title |
|---|---|---|
| CN102461172B (en) | Moving picture coding apparatus | |
| JP5739025B2 (en) | Moving picture decoding apparatus and method | |
| CN103826126B (en) | Dynamic image encoding device and dynamic image encoding method | |
| CN103888772B (en) | Moving image decoding apparatus and dynamic image decoding method | |
| CN103888778B (en) | Moving image decoding apparatus | |
| JP6356762B2 (en) | Video encoding apparatus and method | |
| CN103826132B (en) | Moving image decoding apparatus and dynamic image decoding method | |
| CN103826127B (en) | Dynamic image encoding device and dynamic image encoding method | |
| JP7431935B2 (en) | Video encoding device and video decoding device | |
| JP6608904B2 (en) | Video encoding apparatus and method | |
| JP6514307B2 (en) | Video coding apparatus and method | |
| JP2015233299A (en) | Moving picture decoding apparatus and method | |
| JP5498597B2 (en) | Video encoding apparatus and method | |
| JP5547312B2 (en) | Moving picture decoding apparatus and method | |
| JP5739026B2 (en) | Video encoding apparatus and method | |
| JP5784158B2 (en) | Video encoding apparatus and method | |
| AU2019202533A1 (en) | Dynamic Image Decoding Device | |
| JP2014131288A (en) | Moving image decoder and method |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |