本發明係有關於利用運動補償預測的動態影像編碼及解碼技術，尤其是有關於，將運動補償預測中所利用的運動資訊予以編碼及解碼的動態影像編碼及解碼技術。The present invention relates to a motion picture coding and decoding technique using motion compensation prediction, and more particularly to a motion picture coding and decoding technique for encoding and decoding motion information used in motion compensation prediction.
在一般的動態影像壓縮編碼中，會利用運動補償預測。運動補償預測，係將對象影像分割成細小的區塊，將已解碼之影像當作參照影像，基於運動向量所示的運動量，將從對象影像之處理對象區塊移動至參照影像之參照區塊的位置的訊號，當作預測訊號而加以生成的技術。運動補償預測係有，利用1條運動向量而單預測地進行者，和利用2條運動向量而雙預測地進行者。In general dynamic image compression coding, motion compensation prediction is utilized. The motion compensation prediction divides the target image into small blocks, and uses the decoded image as a reference image to move from the processing target block of the target image to the reference block of the reference image based on the motion amount indicated by the motion vector. The signal of the position is generated as a predictive signal. The motion compensation prediction is performed by one prediction using one motion vector and by two predictions using two motion vectors.
關於運動向量，係將處理對象區塊所相鄰之已編碼區塊的運動向量當作預測運動向量(亦簡稱為「預測向量」，求出處理對象區塊之運動向量與預測向量的差分，藉由差分向量當作編碼向量而予以傳輸，以提升壓縮效率。Regarding the motion vector, the motion vector of the coded block adjacent to the processing target block is regarded as a prediction motion vector (also referred to as a "prediction vector", and the difference between the motion vector and the prediction vector of the processing target block is obtained. It is transmitted by using a difference vector as an encoding vector to improve compression efficiency.
在MPEG-4 AVC/H.264(以下簡稱MPEG-4AVC)這類動態影像壓縮編碼中，藉由把進行運動補償預測的區塊尺寸切割成細緻且多樣化，就可進行高精度的運動補償預測。另一方面，縮小區塊尺寸，會造成編碼向量的編碼量變大之問題。In motion picture compression coding such as MPEG-4 AVC/H.264 (hereinafter referred to as MPEG-4 AVC), high-precision motion compensation can be performed by cutting the block size for motion compensation prediction into detailed and diversified. prediction. On the other hand, reducing the block size causes a problem that the code amount of the code vector becomes large.
於是，在MPEG-4AVC中，著眼於時間方向的運動的連續性，將與處理對象區塊位於同一位置的參照影像之區塊所擁有的運動向量，當作處理對象區塊之運動向量來利用，而不傳輸編碼向量即實現運動補償預測的運動補償預測，是採用此種時間直接運動補償預測。Therefore, in MPEG-4 AVC, focusing on the continuity of the motion in the time direction, the motion vector owned by the block of the reference image located at the same position as the processing target block is used as the motion vector of the processing target block. The motion compensation prediction that realizes motion compensation prediction without transmitting the coding vector is the direct motion compensation prediction using such time.
又，在專利文獻1中係揭露，著眼於空間方向的運動的連續性，將處理對象區塊所相鄰之已處理區塊所擁有的運動向量，當作處理對象區塊之運動向量來利用，而不傳輸編碼向量即實現運動補償預測的方法。Further, in Patent Document 1, it is disclosed that, considering the continuity of the motion in the spatial direction, the motion vector possessed by the processed block adjacent to the processing target block is used as the motion vector of the processing target block. A method of implementing motion compensation prediction without transmitting a coding vector.
[專利文獻1]日本特開平10-276439號公報[Patent Document 1] Japanese Patent Laid-Open No. Hei 10-276439
在專利文獻1所記載的方法中，當進行運動補償預測的區塊尺寸是可變時係以最小的區塊尺寸為基準，適用於如MPEG-AVC那樣事前定義多樣區塊尺寸這類動態影像壓縮編碼時，會有無法直接適用之課題。In the method described in Patent Document 1, when the block size for performing motion compensation prediction is variable, based on the smallest block size, it is suitable for a motion picture such as MPEG-AVC that defines a plurality of block sizes in advance. When compression coding, there is a problem that cannot be directly applied.
本發明係有鑑於此種狀況而研發，其目的在於提供一種，不傳輸編碼向量即可高效率地實現運動補償預測的動態影像編碼及解碼技術。The present invention has been developed in view of such circumstances, and an object thereof is to provide a motion picture encoding and decoding technique capable of efficiently performing motion compensation prediction without transmitting an encoding vector.
為了解決上記課題，本發明的某個樣態的動態影像編碼裝置，係屬於基於分割類型而將編碼區塊分割成1或複數個預測區塊而進行運動補償預測以將動態影像進行編碼的動態影像編碼裝置，其特徵為，具備：候補導出部(140)，係從編碼對象之預測區塊所相鄰的複數預測區塊中，選擇出運動資訊係為有效的已編碼之預測區塊；其中，該運動資訊係含有運動向量之資訊與參照影像之資訊；將前記選擇之已編碼之預測區塊的運動資訊，視為選擇候補；和無效化部(140)，係基於前記編碼對象之預測區塊的分割類型與前記編碼對象之預測區塊在前記編碼區塊內之位置，將前記編碼對象之預測區塊所相鄰之複數預測區塊內的特定之預測區塊的運動資訊，不視為前記選擇候補；和候補清單生成部(140)，係生成含有前記選擇候補的候補清單；和追加部(140)，係將前記候補清單中所含之選擇候補之一方的預測方向之運動資訊、和前記候補清單中所含之另一選擇候補之另一方的預測方向之運動資訊，加以組合，生成雙預測的新選擇候補而加入前記候補清單；和決定部(141)，係從前記候補清單中，決定出前記編碼對象之預測區塊的運動補償預測時所使用的運動資訊；和編碼部(104)，係將用來在前記候補清單中特定出前記已被決定之運動資訊所需的資訊，予以編碼。In order to solve the above problem, a dynamic image coding apparatus according to a certain aspect of the present invention belongs to dividing a coding block into 1 or a complex based on a division type.A motion picture coding apparatus that performs motion compensation prediction by a plurality of prediction blocks to encode a motion picture, and includes a candidate derivation unit (140) that is a complex prediction area adjacent to a prediction block to be coded. In the block, the motion information is selected as a valid encoded prediction block; wherein the motion information includes information of the motion vector and the reference image; and the motion information of the encoded prediction block selected by the pre-record is regarded as The selection candidate; and the invalidation unit (140) are based on the division type of the prediction block of the pre-coded object and the position of the prediction block of the pre-coded object in the pre-coded block, and the prediction block of the pre-coded object The motion information of the specific prediction block in the adjacent complex prediction block is not regarded as a pre-selection candidate; and the candidate list generation unit (140) generates a candidate list including the pre-selection candidate; and an additional unit (140) , the motion information of the prediction direction of one of the selection candidates included in the candidate list, and the other candidate of the other selection candidate included in the candidate list The motion information of the direction is combined to generate a new selection candidate for the bi-prediction, and the candidate list is added; and the determining unit (141) determines the motion compensation prediction of the prediction block of the pre-coded object from the candidate list. The motion information used; and the coding unit (104) are used to encode the information required to specify the motion information that has been determined in the pre-recorded list.
本發明的另一樣態，係亦為動態影像編碼裝置。該裝置係屬於基於分割類型而將編碼區塊分割成1或複數個預測區塊而進行運動補償預測的動態影像編碼裝置，其特徵為，具備：隱性結合運動資訊候補判定部(166)，係基於編碼對象之預測區塊的分割類型與前記編碼對象之預測區塊在前記編碼區塊內之位置，從前記編碼對象之預測區塊所相鄰的已編碼之複數相鄰區塊之運動資訊所組成的第1運動資訊群之中，選擇出可以用比前記編碼對象之預測區塊之尺寸還大之尺寸的預測區塊來進行運動補償預測的隱性結合運動資訊候補；和結合運動資訊候補清單生成部(140)，係使用從前記第1運動資訊群排除了前記隱性結合運動資訊候補而成的第2運動資訊群，來生成用來利用於前記編碼對象之預測區塊所需的結合運動資訊候補的結合運動資訊候補清單；和結合運動資訊候補追加部(163)，係將至少1個前記隱性結合運動資訊候補，追加至前記結合運動資訊候補清單；和結合運動資訊選擇部(141)，係從前記結合運動資訊候補清單中選擇出1個結合運動資訊候補，視為前記編碼對象之預測區塊的運動資訊；和編碼部(104)，係將用來在前記結合運動資訊候補清單中特定出前記已被選擇之結合運動資訊候補所需的索引當作候補特定索引而予以編碼。Another aspect of the invention is also a motion picture encoding device. The apparatus is a motion picture coding apparatus that performs motion compensation prediction by dividing a coding block into one or a plurality of prediction blocks based on a division type, and includes: a recessive combined motion information candidate determination unit (166), BaseThe segmentation type of the prediction block of the coding object and the position of the prediction block of the preamble coding object in the preamble coding block, and the motion information of the encoded plural adjacent block adjacent to the prediction block of the precoding object Among the first motion information groups, the implicit combined motion information candidate for performing motion compensation prediction is selected from the prediction block that is larger than the size of the prediction block of the pre-coded target; and the motion information is combined The candidate list generating unit (140) uses the second motion information group in which the pre-recorded combined motion information candidate is excluded from the first motion information group, and generates a prediction block for use in the pre-recording target. The combined motion information candidate list combined with the motion information candidate; and the combined motion information candidate addition unit (163), the at least one pre-recorded combined motion information candidate is added to the pre-recorded sports information candidate list; and the combined sports information selection Department (141) selects one combined motion information candidate from the list of sports information candidates from the previous record, which is regarded as the prediction of the pre-recorded coding object. Motion information block; and an encoding unit (104), the former referred to the Department of binding a specific motion information candidate list has been selected, the note before the desired movement combined index information indexes a particular candidate as a candidate to be coded.
本發明的另一其他樣態，係為動態影像編碼方法。此方法係屬於基於分割類型而將編碼區塊分割成1或複數個預測區塊而進行運動補償預測以將動態影像進行編碼的動態影像編碼方法，其特徵為，具備：候補導出步驟，係從編碼對象之預測區塊所相鄰的複數預測區塊中，選擇出運動資訊係為有效的已編碼之預測區塊；其中，該運動資訊係含有運動向量之資訊與參照影像之資訊；將前記選擇之已編碼之預測區塊的運動資訊，視為選擇候補；和無效化步驟，係基於前記編碼對象之預測區塊的分割類型與前記編碼對象之預測區塊在前記編碼區塊內之位置，將前記編碼對象之預測區塊所相鄰之複數預測區塊內的特定之預測區塊的運動資訊，不視為前記選擇候補；和候補清單生成步驟，係生成含有前記選擇候補的候補清單；和追加步驟，係將前記候補清單中所含之選擇候補之一方的預測方向之運動資訊、和前記候補清單中所含之另一選擇候補之另一方的預測方向之運動資訊，加以組合，生成雙預測的新選擇候補而加入前記候補清單；和決定步驟，係從前記候補清單中，決定出使用於前記編碼對象之預測區塊的運動補償預測中的運動資訊；和編碼步驟，係將用來在前記候補清單中特定出前記已被決定之運動資訊所需的資訊，予以編碼。Another aspect of the present invention is a motion picture coding method. The method belongs to a motion picture coding method for performing motion compensation prediction to encode a motion picture by dividing a coding block into one or a plurality of prediction blocks based on a division type, and is characterized in that: a candidate extraction step is performed In the complex prediction block adjacent to the prediction block of the coding object, the coded prediction block whose motion information is valid is selected; wherein the motion information contains the information of the motion vector and the information of the reference image; ChooseThe motion information of the encoded prediction block is regarded as a selection candidate; and the invalidation step is based on the division type of the prediction block of the pre-coded object and the position of the prediction block of the pre-coded object in the pre-coded block. The motion information of the specific prediction block in the complex prediction block adjacent to the prediction block of the pre-coded object is not regarded as a pre-selection candidate; and the candidate list generation step is to generate a candidate list including the pre-selection candidate; The additional step is to combine the motion information of the prediction direction of one of the selection candidates included in the candidate list and the motion information of the prediction direction of the other selection candidate included in the candidate list, to generate a double The predicted new candidate candidate is added to the predecessor list; and the decision step is to determine the motion information in the motion compensation prediction of the prediction block used in the preamble encoding object from the predecessor list; and the encoding step is used The information required to specify the motion information that has been determined in the pre-recorded candidate list is encoded.
本發明的另一其他樣態，係為送訊裝置。該裝置係具備：封包處理部，係將編碼串流予以封包化而獲得編碼資料，該編碼串流係藉由，基於分割類型而將編碼區塊分割成1或複數個預測區塊而進行運動補償預測以將動態影像進行編碼的動態影像編碼方法所編碼而成者；和送訊部，係將已被封包化之前記編碼資料，予以發送。前記動態影像編碼方法係具備：候補導出步驟，係從編碼對象之預測區塊所相鄰的複數預測區塊中，選擇出運動資訊係為有效的已編碼之預測區塊；其中，該運動資訊係含有運動向量之資訊與參照影像之資訊；將前記選擇之已編碼之預測區塊的運動資訊，視為選擇候補；和無效化步驟，係基於前記編碼對象之預測區塊的分割類型與前記編碼對象之預測區塊在前記編碼區塊內之位置，將前記編碼對象之預測區塊所相鄰之複數預測區塊內的特定之預測區塊的運動資訊，不視為前記選擇候補；和候補清單生成步驟，係生成含有前記選擇候補的候補清單；和追加步驟，係將前記候補清單中所含之選擇候補之一方的預測方向之運動資訊、和前記候補清單中所含之另一選擇候補之另一方的預測方向之運動資訊，加以組合，生成雙預測的新選擇候補而加入前記候補清單；和決定步驟，係從前記候補清單中，決定出使用於前記編碼對象之預測區塊的運動補償預測中的運動資訊；和編碼步驟，係將用來在前記候補清單中特定出前記已被決定之運動資訊所需的資訊，予以編碼。Still another aspect of the present invention is a transmitting device. The apparatus includes a packet processing unit that encapsulates a coded stream to obtain coded data by dividing the coded block into one or a plurality of prediction blocks based on the type of division and performing motion. The compensation prediction is encoded by a motion picture coding method for encoding a motion picture; and the transmission unit transmits the coded data before being encapsulated. The pre-recorded video coding method has a candidate derivation step of selecting a coded prediction block from which a motion information system is valid from a complex prediction block adjacent to a prediction block of the coding target; wherein the motion information is valid Information containing the information of the motion vector and the reference image; the predicted prediction area selected by the pre-recordThe motion information of the block is regarded as a selection candidate; and the invalidation step is based on the prediction type of the prediction block of the pre-coded object and the position of the prediction block of the pre-coded object in the pre-coded block, and the prediction of the pre-coded object The motion information of the specific prediction block in the complex prediction block adjacent to the block is not regarded as the pre-selection candidate; and the candidate list generation step is to generate a candidate list including the pre-selection candidate; and an appending step The motion information of the prediction direction of one of the selection candidates included in the candidate list and the motion information of the prediction direction of the other selection candidate included in the candidate list are combined to generate a new selection candidate for the bi-prediction. And adding a pre-recorded candidate list; and determining the step, determining, from the pre-recorded candidate list, the motion information in the motion-compensated prediction of the prediction block used in the pre-recorded coding object; and the coding step, which is used in the pre-recorded candidate list The information required to prioritize the sports information that has been determined is coded.
本發明的另一其他樣態，係為送訊方法。該方法係具備：封包處理步驟，係將編碼串流予以封包化而獲得編碼資料，該編碼串流係藉由，基於分割類型而將編碼區塊分割成1或複數個預測區塊而進行運動補償預測以將動態影像進行編碼的動態影像編碼方法所編碼而成者；和送訊步驟，係將已被封包化之前記編碼資料，予以發送。前記動態影像編碼方法係具備：候補導出步驟，係從編碼對象之預測區塊所相鄰的複數預測區塊中，選擇出運動資訊係為有效的已編碼之預測區塊；其中，該運動資訊係含有運動向量之資訊與參照影像之資訊；將前記選擇之已編碼之預測區塊的運動資訊，視為選擇候補；和無效化步驟，係基於前記編碼對象之預測區塊的分割類型與前記編碼對象之預測區塊在前記編碼區塊內之位置，將前記編碼對象之預測區塊所相鄰之複數預測區塊內的特定之預測區塊的運動資訊，不視為前記選擇候補；和候補清單生成步驟，係生成含有前記選擇候補的候補清單；和追加步驟，係將前記候補清單中所含之選擇候補之一方的預測方向之運動資訊、和前記候補清單中所含之另一選擇候補之另一方的預測方向之運動資訊，加以組合，生成雙預測的新選擇候補而加入前記候補清單；和決定步驟，係從前記候補清單中，決定出使用於前記編碼對象之預測區塊的運動補償預測中的運動資訊；和編碼步驟，係將用來在前記候補清單中特定出前記已被決定之運動資訊所需的資訊，予以編碼。Another aspect of the present invention is a method of transmitting. The method includes: a packet processing step of packetizing a coded stream to obtain coded data, wherein the coded stream is divided into one or a plurality of prediction blocks based on a segmentation type to perform motion The compensation prediction is encoded by a motion picture coding method for encoding a motion picture; and the transmission step is to transmit the coded data before being encapsulated. The pre-recorded video coding method has a candidate derivation step of selecting a coded prediction block from which a motion information system is valid from a complex prediction block adjacent to a prediction block of the coding target; wherein the motion information is valid Information containing the motion vector and the reference image; the motion information of the encoded prediction block selected by the pre-record is regarded as a candidate; and the invalidation step is performed.The prediction type of the prediction block of the preamble encoding object and the position of the prediction block of the preamble coding object in the preamble coding block, and the specific prediction area in the complex prediction block adjacent to the prediction block of the preamble coding object The motion information of the block is not regarded as a pre-selection candidate; and the candidate list generation step is to generate a candidate list including the pre-selection candidate; and the additional step is to move the prediction direction of one of the selection candidates included in the pre-recorded candidate list. The information and the motion information of the prediction direction of the other selection candidate included in the candidate list are combined to generate a new selection candidate for the bi-prediction and added to the pre-list candidate list; and the decision step is from the pre-review list. Determining the motion information in the motion compensation prediction of the prediction block used in the preamble coding object; and the coding step, which is used to encode the information required to specify the motion information that has been determined in the pre-recorded candidate list .
本發明的某個樣態的動態影像解碼裝置，係屬於基於分割類型而將解碼區塊分割成1或複數個預測區塊而進行運動補償預測，將動態影像之編碼串流予以解碼的動態影像解碼裝置，其特徵為，具備：候補導出部(230)，係從解碼對象之預測區塊所相鄰的複數預測區塊中，選擇出運動資訊係為有效的已解碼之預測區塊；其中，該運動資訊係含有運動向量之資訊與參照影像之資訊；將前記選擇之已解碼之預測區塊的運動資訊，視為選擇候補；和無效化部(230)，係基於前記解碼對象之預測區塊的分割類型與前記解碼對象之預測區塊在前記解碼區塊內之位置，將前記解碼對象之預測區塊所相鄰之複數預測區塊內的特定之預測區塊的運動資訊，不視為前記選擇候補；和候補清單生成部(230)，係生成含有前記選擇候補的候補清單；和追加部(230)，係將前記候補清單中所含之選擇候補之一方的預測方向之運動資訊、和前記候補清單中所含之另一選擇候補之另一方的預測方向之運動資訊，加以組合，生成雙預測的新選擇候補而加入前記候補清單；和編碼列解析部(201)，係將表示在前記候補清單內之位置的資訊，予以解碼；和選擇部(231)，係基於已解碼之前記表示位置之資訊，從前記候補清單中選擇出前記解碼對象之預測區塊的運動補償預測時所使用的運動資訊。A motion picture decoding apparatus according to a certain aspect of the present invention belongs to a motion picture in which a decoding block is divided into one or a plurality of prediction blocks based on a division type to perform motion compensation prediction, and a coded stream of a motion picture is decoded. The decoding apparatus is characterized in that the candidate deriving unit (230) selects, from the complex prediction blocks adjacent to the prediction block to be decoded, the decoded prediction block in which the motion information is valid; The motion information includes information of the motion vector and the reference image; the motion information of the decoded prediction block selected by the pre-record is regarded as a selection candidate; and the invalidation unit (230) is based on the prediction of the pre-decoded object The partition type of the block and the position of the prediction block of the pre-decoded object in the pre-decode block, and the complex prediction block adjacent to the prediction block of the pre-decoded objectThe motion information of the predetermined prediction block is not regarded as a pre-selection candidate; the candidate list generation unit (230) generates a candidate list including the pre-selection candidate; and the additional unit (230) is included in the pre-recorded candidate list. Selecting the motion information of the prediction direction of one of the candidates and the motion information of the prediction direction of the other selection candidate included in the candidate list, and combining them to generate a new selection candidate for the bi-prediction and adding the pre-recorded candidate list; The coded column analysis unit (201) decodes the information indicating the position in the candidate list, and the selection unit (231) selects the previous record from the previous candidate list based on the information indicating the position before decoding. The motion information used in the motion compensation prediction of the prediction block of the decoding object.
本發明的另一樣態，係亦為動態影像解碼裝置。該裝置係屬於基於分割類型而將解碼區塊分割成1或複數個預測區塊而進行運動補償預測的動態影像解碼裝置，其特徵為，具備：解碼部(201)，係從用來在結合運動資訊候補清單中特定出結合運動資訊候補所需的索引被當成候補特定索引所被編碼而成的編碼列，解碼出前記候補特定索引；和隱性結合運動資訊候補判定部(166)，係基於解碼對象之預測區塊的分割類型與前記解碼對象之預測區塊在前記解碼區塊內之位置，從前記解碼對象之預測區塊所相鄰的已解碼之複數相鄰區塊之運動資訊所組成的第1運動資訊群之中，選擇出可以用比前記解碼對象之預測區塊之尺寸還大之尺寸的預測區塊來進行運動補償預測的隱性結合運動資訊候補；和結合運動資訊候補清單生成部(230)，係使用從前記第1運動資訊群排除了前記隱性結合運動資訊候補而成的第2運動資訊群，來生成用來利用於前記解碼對象之預測區塊所需的結合運動資訊候補的結合運動資訊候補清單；和結合運動資訊候補追加部(163)，係將至少1個前記隱性結合運動資訊候補，追加至前記結合運動資訊候補清單；和結合運動資訊選擇部(231)，係根據前記候補特定索引而從前記結合運動資訊候補清單中選擇出1個結合運動資訊候補，視為前記解碼對象之預測區塊的運動資訊。Another aspect of the present invention is also a motion picture decoding device. The apparatus is a motion picture decoding apparatus that performs motion compensation prediction by dividing a decoding block into one or a plurality of prediction blocks based on a division type, and is characterized in that it includes a decoding unit (201) for combining The index required for the combined motion information candidate in the motion information candidate list is encoded as a coded column in which the candidate specific index is encoded, and the preamble candidate specific index is decoded; and the implicit combined motion information candidate determination unit (166) is Based on the segmentation type of the prediction block of the decoding object and the position of the prediction block of the pre-decoded object in the pre-decode block, the motion information of the decoded complex adjacent blocks adjacent to the prediction block of the pre-coded object is recorded. Among the first motion information groups that are formed, an implicit combined motion information candidate that can perform motion compensation prediction using a prediction block larger than the size of the prediction block of the previous decoding target is selected; and combined motion information The candidate list generating unit (230) excludes the preemptiveness from the first motion information group.Combining the second motion information group of the motion information candidate to generate a combined motion information candidate list for the combined motion information candidate required for the prediction block of the pre-recording target; and the combined motion information candidate adding unit (163) And adding at least one pre-receiving combined motion information candidate to the pre-recorded combined sports information candidate list; and the combined sports information selecting unit (231), selecting from the pre-recorded combined sports information candidate list according to the pre-recorded candidate specific index One combined with the motion information candidate is regarded as the motion information of the prediction block of the pre-recorded decoding object.
本發明的另一其他樣態，係為動態影像解碼方法。該方法係屬於基於分割類型而將解碼區塊分割成1或複數個預測區塊而進行運動補償預測，將動態影像之編碼串流予以解碼的動態影像解碼方法，其特徵為，具備：候補導出步驟，係從解碼對象之預測區塊所相鄰的複數預測區塊中，選擇出運動資訊係為有效的已解碼之預測區塊；其中，該運動資訊係含有運動向量之資訊與參照影像之資訊；將前記選擇之已解碼之預測區塊的運動資訊，視為選擇候補；和無效化步驟，係基於前記解碼對象之預測區塊的分割類型與前記解碼對象之預測區塊在前記解碼區塊內之位置，將前記解碼對象之預測區塊所相鄰之複數預測區塊內的特定之預測區塊的運動資訊，不視為前記選擇候補；和候補清單生成步驟，係生成含有前記選擇候補的候補清單；和追加步驟，係將前記候補清單中所含之選擇候補之一方的預測方向之運動資訊、和前記候補清單中所含之另一選擇候補之另一方的預測方向之運動資訊，加以組合，生成雙預測的新選擇候補而加入前記候補清單；和編碼列解析步驟，係將表示在前記候補清單內之位置的資訊，予以解碼；和選擇步驟，係基於已解碼之前記表示位置之資訊，從前記候補清單中選擇出，使用於前記解碼對象之預測區塊的運動補償預測中的運動資訊。Another aspect of the present invention is a motion picture decoding method. The method belongs to a motion picture decoding method for performing motion compensation prediction by dividing a decoding block into one or a plurality of prediction blocks based on a division type, and decoding a coded stream of a motion picture, characterized in that: The step of selecting, from the complex prediction block adjacent to the prediction block of the decoding object, the decoded prediction block whose motion information is valid; wherein the motion information includes the information of the motion vector and the reference image Information; the motion information of the decoded prediction block selected as the pre-selection is regarded as a selection candidate; and the invalidation step is based on the segmentation type of the prediction block of the pre-decoded object and the prediction block of the pre-decoded object in the pre-decoding area The position within the block, the motion information of the specific prediction block in the complex prediction block adjacent to the prediction block of the pre-decoded object is not regarded as the pre-selection candidate; and the candidate list generation step is generated with the pre-selection a candidate list of candidates; and an additional step of moving the predicted direction of one of the selection candidates included in the predecessor list The information on the prediction direction of the other side of the other selection candidate contained in the information and the candidate list is groupedAnd generating a bi-predictive new selection candidate and adding a pre-recorded candidate list; and a coding column parsing step of decoding the information indicating the position in the pre-recorded candidate list; and selecting the step based on the decoded position The information is selected from the candidate list to be used for the motion information in the motion compensation prediction of the prediction block of the pre-recorded decoding object.
本發明的另一其他樣態，係為收訊裝置。該裝置係屬於在所接收到的動態影像的編碼串流中，將解碼區塊分割成1或複數個預測區塊而進行運動補償預測以進行解碼處理的收訊裝置，其特徵為，具備：收訊部，係將基於分割類型而將編碼區塊分割成1或複數個預測區塊而進行運動補償預測所編碼而成的動態影像的編碼串流所被封包化而成的編碼資料，予以接收；和復原部，係將已被接收到的前記編碼資料進行封包處理，以復原出原本的編碼串流；和候補導出部(230)，係從解碼對象之預測區塊所相鄰的複數預測區塊中，選擇出運動資訊係為有效的已解碼之預測區塊；其中，該運動資訊係含有運動向量之資訊與參照影像之資訊；將前記選擇之已解碼之預測區塊的運動資訊，視為選擇候補；和無效化部(230)，係基於前記解碼對象之預測區塊的分割類型與前記解碼對象之預測區塊在前記解碼區塊內之位置，將前記解碼對象之預測區塊所相鄰之複數預測區塊內的特定之預測區塊的運動資訊，不視為前記選擇候補；和候補清單生成部(230)，係生成含有前記選擇候補的候補清單；和追加部(230)，係將前記候補清單中所含之選擇候補之一方的預測方向之運動資訊、和前記候補清單中所含之另一選擇候補之另一方的預測方向之運動資訊，加以組合，生成雙預測的新選擇候補而加入前記候補清單；和編碼列解析部(201)，係從已被復原之編碼串流，解碼出表示在前記候補清單內之位置的資訊；和選擇部(231)，係基於已解碼之前記表示位置之資訊，從前記候補清單中選擇出前記解碼對象之預測區塊的運動補償預測時所使用的運動資訊。Another aspect of the invention is a receiving device. The device belongs to a receiving device that divides a decoding block into one or a plurality of prediction blocks and performs motion compensation prediction for decoding processing in the encoded stream of the received moving image, and is characterized in that: The receiving unit is a coded data obtained by packetizing a coded stream of a moving image encoded by motion compensation prediction by dividing a coded block into one or a plurality of prediction blocks based on a division type. And a restoring unit that performs packet processing on the received preamble encoded data to restore the original encoded stream; and the candidate deriving unit (230) is a plural number adjacent to the predicted block of the decoding target In the prediction block, the decoded prediction block is selected as the effective motion information, wherein the motion information includes the information of the motion vector and the information of the reference image; and the motion information of the decoded prediction block selected by the pre-recording And the invalidation unit (230) is based on the partition type of the prediction block of the pre-decoded object and the prediction block of the pre-decoded object in the pre-decode block The motion information of the specific prediction block in the complex prediction block adjacent to the prediction block of the pre-decoded object is not regarded as a pre-selection candidate; and the candidate list generation unit (230) generates a pre-selection selection The candidate list of candidates; and the addition unit (230) is a motion of predicting direction of one of the selection candidates included in the predecessor list.The information and the motion information of the prediction direction of the other selection candidate included in the candidate list are combined to generate a new prediction candidate for the bi-prediction, and the candidate list is added; and the code column analysis unit (201) The information indicating the position in the pre-recorded list is decoded from the restored encoded stream; and the selecting unit (231) selects the pre-decoding object from the pre-recorded list based on the information indicating the position before decoding. The motion information used in the prediction of the motion compensation prediction of the block.
本發明的另一其他樣態，係為收訊方法。該方法係屬於在所接收到的動態影像的編碼串流中，將解碼區塊分割成1或複數個預測區塊而進行運動補償預測以進行解碼處理的收訊方法，其特徵為，具備：收訊步驟，係將基於分割類型而將編碼區塊分割成1或複數個預測區塊而進行運動補償預測所編碼而成的動態影像的編碼串流所被封包化而成的編碼資料，予以接收；和復原步驟，係將已被接收到的前記編碼資料進行封包處理，以復原出原本的編碼串流；和候補導出步驟，係從解碼對象之預測區塊所相鄰的複數預測區塊中，選擇出運動資訊係為有效的已解碼之預測區塊；其中，該運動資訊係含有運動向量之資訊與參照影像之資訊；將前記選擇之已解碼之預測區塊的運動資訊，視為選擇候補；和無效化步驟，係基於前記解碼對象之預測區塊的分割類型與前記解碼對象之預測區塊在前記解碼區塊內之位置，將前記解碼對象之預測區塊所相鄰之複數預測區塊內的特定之預測區塊的運動資訊，不視為前記選擇候補；和候補清單生成步驟，係生成含有前記選擇候補的候補清單；和追加步驟，係將前記候補清單中所含之選擇候補之一方的預測方向之運動資訊、和前記候補清單中所含之另一選擇候補之另一方的預測方向之運動資訊，加以組合，生成雙預測的新選擇候補而加入前記候補清單；和編碼列解析步驟，係從已被復原之編碼串流，解碼出表示在前記候補清單內之位置的資訊；和選擇步驟，係基於已解碼之前記表示位置之資訊，從前記候補清單中選擇出，使用於前記解碼對象之預測區塊的運動補償預測中的運動資訊。Another aspect of the present invention is a receiving method. The method belongs to a receiving method for dividing a decoding block into one or a plurality of prediction blocks and performing motion compensation prediction for decoding processing in the encoded stream of the received moving image, and is characterized in that: The receiving step is to encode the encoded stream of the moving image encoded by the motion compensation prediction by dividing the coding block into one or a plurality of prediction blocks based on the division type, and And the recovering step is: performing packet processing on the received pre-coded data to recover the original encoded stream; and the candidate deriving step is from the complex predictive block adjacent to the predicted block of the decoding target The motion information is selected as a valid decoded prediction block; wherein the motion information includes information of the motion vector and the reference image; and the motion information of the decoded prediction block selected by the pre-record is regarded as The selection candidate; and the invalidation step are based on the segmentation type of the prediction block of the pre-decoded object and the prediction block of the pre-decoded object in the pre-decode block Prediction block within a particular location, the former referred to the decoded prediction block adjacent to the prediction block of a plurality of motion information, not considered before selecting candidate referred to; and a candidate list generating step comprises generating based mind before selectionThe candidate list of the candidate; and the additional step, the motion information of the prediction direction of one of the selection candidates included in the candidate list, and the motion information of the prediction direction of the other of the other selection candidates included in the candidate list And combining to generate a new prediction candidate for bi-prediction and adding a pre-recorded candidate list; and a coding column parsing step of decoding the information indicating the position in the pre-recorded list from the reconstructed encoded stream; and selecting a step, Based on the information indicating the position before decoding, the motion information in the motion compensation prediction of the prediction block of the pre-recording target is selected from the pre-recorded list.
此外，即使將以上構成要素之任意組合、本發明之表現，在方法、裝置、系統、記錄媒體、電腦程式等之間做轉換而成者，對本發明的樣態而言皆為有效。Further, even if any combination of the above constituent elements and the expression of the present invention are converted between a method, an apparatus, a system, a recording medium, a computer program, etc., it is effective for the aspect of the present invention.
若依據本發明，則可不傳輸編碼向量即可高效率地實現運動補償預測。According to the present invention, motion compensation prediction can be efficiently performed without transmitting an encoding vector.
首先說明作為本發明的實施形態之前提的技術。First, the technique proposed as an embodiment of the present invention will be described.
目前，以MPEG(Moving Picture Experts Group)等之編碼方式為依據的裝置及系統，已經普及。在此種編碼方式中，是將時間軸上連續的複數影像，以數位訊號的資訊的方式來對待。此時，為了高效率的資訊播送、傳輸或積存等目的，將影像分割成複數區塊而利用時間方向之冗長性的運動補償預測、及利用空間方向之冗長性的離散餘弦轉換等，會使用這類正交轉換而進行壓縮編碼。At present, devices and systems based on encoding methods such as MPEG (Moving Picture Experts Group) have become widespread. In this type of coding, a continuous plurality of images on the time axis are treated as information of digital signals. In this case, for the purpose of efficient information transmission, transmission, or accumulation, the video is divided into complex blocks, and the motion compensation prediction using the verbosity of the time direction and the discrete cosine transform using the redundancy of the spatial direction are used. This type of orthogonal conversion is compression-encoded.
在2003年，由國際標準化機構(ISO)與國際電氣標準會議(IEC)之聯合技術委員會(ISO/IEC)，和國際電氣通訊聯合電氣通訊標準化部門(ITU-T)的共同作業，一種稱作MPEG-4 AVC/H.264的編碼方式(在ISO/IEC中稱作14496-10、在ITU-T中編號為H.264之規格號碼。以下稱之為MPEG-4AVC)係被制定成為國際標準。在MPEG-4AVC中，基本上是將處理對象區塊的複數相鄰區塊之運動向量的中央值，當作預測向量。當預測區塊尺寸並非正方形時且處理對象區塊的特定之相鄰區塊的參照索引與處理對象區塊的參照索引一致時，則將該特定之相鄰區塊的運動向量，當作預測向量。In 2003, the Joint Technical Committee (ISO/IEC) of the International Organization for Standardization (ISO) and the International Conference on Electrical Standards (IEC), and the International Telecommunications Standardization Sector (ITU-T), a joint operation, The encoding method of MPEG-4 AVC/H.264 (referred to as 14496-10 in ISO/IEC and the standard number of H.264 in ITU-T. hereinafter referred to as MPEG-4 AVC) is formulated as an international standard. In MPEG-4 AVC, basically, the median value of the motion vector of the complex adjacent block of the processing target block is regarded as a prediction vector. When the prediction block size is not a square and the reference index of the specific adjacent block of the processing target block coincides with the reference index of the processing target block, the motion vector of the specific adjacent block is regarded as a prediction. vector.
目前，由國際標準化機構(ISO)與國際電氣標準會議(IEC)之聯合技術委員會(ISO/IEC)，和國際電氣通訊聯合電氣通訊標準化部門(ITU-T)的共同作業，一種稱作HEVC的編碼方式的標準化，正在研討中。Currently, the Joint Technical Committee (ISO/IEC) of the International Organization for Standardization (ISO) and the International Conference on Electrical Standards (IEC), and the International Telecommunications Standardization Sector (ITU-T), a joint operation, called HEVC The standardization of coding methods is under discussion.
在HEVC的標準化中係研討了，將複數相鄰區塊與已解碼之另一影像的區塊當作候補區塊群，從這些候補區塊群中選擇出1個候補區塊，將已被選擇之候補區塊的資訊予以編碼及解碼的合併模式。In the standardization of HEVC, it is studied that a plurality of adjacent blocks and a block of another decoded image are regarded as candidate block groups, and one candidate block is selected from the candidate block groups, and The merge mode in which the information of the candidate block is selected for encoding and decoding.
在本實施形態中，係已被輸入之影像訊號係被分割成最大編碼區塊單位，將已被分割之最大編碼區塊，以逐線掃描順序進行處理。編碼區塊係呈現階層構造，考慮編碼效率等而依序均等地做4分割，藉此而可變成更小的編碼區塊。此外，已被4分割之編碼區塊，係以曲折掃描(Zig Zag Scan)順序而被編碼。無法變得更小的編碼區塊，稱作最小編碼區塊。編碼區塊係為編碼的單位，最大編碼區塊若分割數為0時也是視為編碼區塊。在本實施形態中，係假設最大編碼區塊為64像素×64像素，最小編碼區塊為8像素×8像素。In this embodiment, the image signal that has been input is divided into maximum coding block units, and the largest coded block that has been divided is line by line.The scan order is processed. The coding block exhibits a hierarchical structure, and is equally divided into four in order to consider coding efficiency and the like, thereby becoming a smaller coding block. In addition, the coded blocks that have been divided by 4 are encoded in the Zig Zag Scan order. It is impossible to become a smaller coding block, called a minimum coding block. The coding block is a coding unit, and the maximum coding block is also regarded as a coding block if the number of divisions is zero. In the present embodiment, it is assumed that the maximum coding block is 64 pixels × 64 pixels, and the minimum coding block is 8 pixels × 8 pixels.
圖1(a)、(b)係編碼區塊的說明圖。在圖1(a)的例子中，編碼區塊係被分割成10個。CU0、CU1及CU9係為32像素×32像素的編碼區塊，CU2、CU3及CU8係為16像素×16像素的編碼區塊，還有CU4、CU5、CU6及CU7係為8像素×8像素的編碼區塊。在圖1(b)的例子中，編碼區塊係被分割成1個。1(a) and 1(b) are explanatory diagrams of coding blocks. In the example of Fig. 1(a), the coding block is divided into ten. CU0, CU1 and CU9 are 32-pixel×32-pixel coding blocks, CU2, CU3 and CU8 are 16-pixel×16-pixel coding blocks, and CU4, CU5, CU6 and CU7 are 8 pixels×8 pixels. Encoding block. In the example of Fig. 1(b), the coding block is divided into one.
在本實施形態中，編碼區塊係還會再被分割成預測區塊。編碼區塊係藉由預測區塊尺寸類型(亦稱作「分割類型」)而被分割成1個以上的預測區塊。圖2(a)~(d)係預測區塊尺寸類型的說明圖。圖2(a)係表示未分割編碼區塊的2N×2N，圖2(b)係表示水平2分割的2N×N，圖2(c)係表示垂直2分割的N×2N，及圖2(d)係表示水平與垂直4分割的N×N。2N×2N係由1個預測區塊0所成，2N×N和N×2N係由2個的預測區塊0和預測區塊1所成，N×N係由4個的預測區塊0、預測區塊1、預測區塊2、預測區塊3所成。In this embodiment, the coding block is further divided into prediction blocks. The coding block is divided into one or more prediction blocks by predicting the block size type (also referred to as "segmentation type"). 2(a) to (d) are explanatory diagrams of predicted block size types. 2(a) shows 2N×2N of the undivided coded block, FIG. 2(b) shows 2N×N of horizontal 2 division, and FIG. 2(c) shows N×2N of vertical 2 division, and FIG. 2 (d) is N x N which is divided into horizontal and vertical divisions. 2N×2N is formed by one prediction block 0, and 2N×N and N×2N systems are composed of two prediction blocks.And the prediction block 1 is formed, and the N×N system is formed by four prediction blocks 0, prediction block 1, prediction block 2, and prediction block 3.
圖3係編碼區塊的分割數和預測區塊尺寸類型所致之預測區塊尺寸的說明圖。本實施形態中的預測區塊尺寸，係存在有從CU分割數為0且預測區塊尺寸類型為2N×2N的64像素×64像素，到CU分割數為3且預測區塊尺寸類型N×N的4像素×4像素為止的13種預測區塊尺寸。Fig. 3 is an explanatory diagram of the prediction block size caused by the number of divisions of the coding block and the prediction block size type. In the prediction block size in this embodiment, there are 64 pixels × 64 pixels whose number of divisions from the CU is 0 and the prediction block size type is 2N × 2N, and the number of CU divisions is 3 and the prediction block size type N × 13 prediction block sizes up to 4 pixels × 4 pixels of N.
在本實施形態中，雖然假設最大編碼區塊為64像素×64像素，最小編碼區塊為8像素×8像素，但不限定於此一組合。又，雖然將預測區塊的分割模態示於圖2(a)~(d)，但只要有被分割成1個以上的組合即可，並非限定於此。In the present embodiment, although the maximum coding block is assumed to be 64 pixels × 64 pixels, and the minimum coding block is 8 pixels × 8 pixels, it is not limited to this combination. In addition, although the division mode of the prediction block is shown in FIGS. 2(a) to 2(d), it is not limited thereto as long as it is divided into one or more combinations.
在本實施形態中，係可將運動補償預測或編碼向量數，對預測區塊之每一區塊來做切換。此處，關於把運動補償預測與編碼向量數建立關連而成的預測編碼模式之一例，使用圖4來簡單說明。圖4係預測編碼模式的說明圖。In this embodiment, the motion compensation prediction or the number of coding vectors can be switched for each block of the prediction block. Here, an example of a predictive coding mode in which the motion compensation prediction is associated with the number of coding vectors is briefly described using FIG. 4 is an explanatory diagram of a prediction encoding mode.
圖4所示的預測編碼模式中，係有：運動補償預測之預測方向為單預測(L0預測)且編碼向量數為1的PredL0、運動補償預測之預測方向為單預測(L1預測)且編碼向量數為1的PredL1、運動補償預測之預測方向為雙預測(BI預測)且編碼向量數為2的PredBI、及運動補償預測之預測方向為單預測(L0預測/L1預測)或雙預測(BI預測)且編碼向量數為0的合併模式(MERGE)。又，還有不實施運動補償預測的預測編碼模式亦即畫面內模式(Intra)。此處，PredL0、PredL1、及PredBI係為預測向量模式。In the prediction coding mode shown in FIG. 4, the prediction direction of the motion compensation prediction is single prediction (L0 prediction) and the number of coding vectors is 1 for PredL0, and the prediction direction for motion compensation prediction is single prediction (L1 prediction) and coding. PredL1 with vector number 1 and Pred prediction for motion compensated prediction with double prediction (BI prediction) and coded vector number 2, and motionThe prediction direction of the compensation prediction is a single prediction (L0 prediction/L1 prediction) or a bi-prediction (BI prediction) and a merge mode (MERGE) in which the number of coding vectors is zero. Further, there is an intra-picture mode (Intra) which is a predictive coding mode in which motion compensation prediction is not performed. Here, PredL0, PredL1, and PredBI are prediction vector modes.
在合併模式中，預測方向係可能是L0預測/L1預測/BI預測之任一者，但這是因為，合併模式的預測方向是直接繼承從候補區塊群所選擇出來之候補區塊的預測方向，或是從已解碼之資訊所導出的緣故。又，在合併模式下，編碼向量係不被編碼。這是因為，合併模式的編碼向量是直接繼承從候補區塊群所選擇出來之候補區塊的運動向量，或是從已解碼之資訊所導出的緣故。In the merge mode, the prediction direction may be any of L0 prediction/L1 prediction/BI prediction, but this is because the prediction direction of the merge mode is the direct inheritance of the prediction of the candidate block selected from the candidate block group. Direction, or the reason derived from the decoded information. Also, in the merge mode, the code vector is not encoded. This is because the coding vector of the merge mode directly inherits the motion vector of the candidate block selected from the candidate block group or is derived from the decoded information.
在本實施形態中，為了提升運動補償預測之精度，在運動補償預測時，可從複數參照影像之中，選擇出最佳的參照影像。因此，將運動補償預測時所利用之參照影像，當作參照影像索引，而連同編碼向量一起編碼。運動補償預測時所被利用的參照影像索引，係為0以上之數值。若運動補償預測是單預測，則參照索引係被利用1個，若運動補償預測是雙預測，則會利用2個參照索引(圖4)。In the present embodiment, in order to improve the accuracy of the motion compensation prediction, an optimum reference image can be selected from the plurality of reference images during motion compensation prediction. Therefore, the reference image used in the motion compensation prediction is taken as a reference image index and encoded together with the code vector. The reference image index used for motion compensation prediction is a value of 0 or more. If the motion compensation prediction is a single prediction, one reference index is used, and if the motion compensation prediction is double prediction, two reference indices are used (Fig. 4).
在合併模式下，參照索引係不被編碼。這是因為，合併模式的參照索引是直接繼承從候補區塊群所選擇出來之候補區塊的參照索引，或是從已解碼之資訊所導出的緣故。In merge mode, the reference index is not encoded. This is because the reference index of the merge mode directly inherits the reference index of the candidate block selected from the candidate block group, or the edge derived from the decoded information.Therefore.
在本實施形態中，將運動補償預測時所能利用之複數參照影像，事先登錄在參照索引清單內，藉由參照索引來表示已被登錄在參照索引清單內的參照影像，就可確定參照影像而在運動補償預測時進行利用。在參照索引清單中，係有參照索引清單L0和參照索引清單L1。當運動補償預測是單預測時，則會利用使用了參照索引清單L0之中之參照影像的L0預測、或使用了參照索引清單L1之中之參照影像的L1預測之任一者。雙預測時係利用，利用了將參照索引清單L0和參照索引清單L1這2者的BI預測。各參照索引清單中所能登錄的參照影像的最大數，係為16。In the present embodiment, the reference video that can be used in the motion compensation prediction is registered in the reference index list in advance, and the reference image that has been registered in the reference index list is indicated by the reference index, and the reference image can be determined. It is used in the prediction of motion compensation. In the reference index list, there is a reference index list L0 and a reference index list L1. When the motion compensation prediction is a single prediction, either the L0 prediction using the reference image in the reference index list L0 or the L1 prediction using the reference image in the reference index list L1 is used. The double prediction time is utilized, and the BI prediction of the reference index list L0 and the reference index list L1 is utilized. The maximum number of reference images that can be registered in each reference index list is 16.
在本實施形態中，若為合併模式，則將處理對象影像內的複數相鄰區塊及已編碼之另一影像內的與處理對象區塊位於同一位置之周邊的區塊，當作候補區塊群，從候補區塊群之中，選擇出具有最佳預測編碼模式、運動向量、及參照索引的候補區塊，將用來表示已選擇之候補區塊的合併索引，予以編碼及解碼。只有在合併模式時，才會利用1個合併索引(圖4)。合併索引的最大數(亦稱作合併候補最大數)係為5，合併索引係為0至4的整數。此處，雖然將合併索引的最大數設成5，但只要2以上即可，並非限定於此。In the present embodiment, in the merge mode, the plurality of adjacent blocks in the image to be processed and the blocks in the other image that are encoded in the same position as the processing target block are regarded as candidate regions. The block group selects a candidate block having the best prediction coding mode, motion vector, and reference index from among the candidate block groups, and uses the combined index of the selected candidate block to encode and decode. Only one merge index is used in the merge mode (Figure 4). The maximum number of merged indexes (also known as the maximum number of merge candidates) is 5, and the combined index is an integer from 0 to 4. thisIn addition, although the maximum number of merged indexes is set to 5, it is only required to be 2 or more, and is not limited to this.
以後，將合併索引之對象的候補區塊的運動資訊，稱作結合運動資訊候補，將結合運動資訊候補的集合體稱作結合運動資訊候補清單。以下，所謂運動資訊係包含有預測方向、運動向量、及參照索引。Hereinafter, the motion information of the candidate block of the target of the merged index is referred to as a combined motion information candidate, and the aggregate of the combined motion information candidates is referred to as a combined motion information candidate list. Hereinafter, the motion information includes a prediction direction, a motion vector, and a reference index.
此外，關於合併索引與編碼列之關係，使用圖來說明。圖5係合併索引與編碼列之關係的說明圖。合併索引為0時的編碼列係為'0'，合併索引為1時的編碼列係為'10'，合併索引為2時的編碼列係為'110'，合併索引為3時的編碼列係為'1110'，合併索引為4時的編碼列係為'11110'，合併索引越大則編碼列設定得越長。因此，藉由對選擇率高的候補區塊分配較小的合併索引，就可提升編碼效率。In addition, the relationship between the merge index and the code column is illustrated using a graph. Figure 5 is an explanatory diagram of the relationship between a merged index and a coded column. The coded column with the merge index of 0 is '0', the coded column with the merge index of 1 is '10', the coded column with the merge index of 2 is '110', and the coded column with the merge index of 3 The code column is '1110', and the code column when the merge index is 4 is '11110'. The larger the merge index, the longer the code column is set. Therefore, coding efficiency can be improved by assigning a smaller merge index to candidate blocks with a high selectivity.
在本實施形態中，為了提升預測向量之精度，將複數相鄰區塊及已編碼之另一影像的與處理對象區塊位於同一位置之周邊的區塊，當作候補區塊群，從候補區塊群選擇出具有最佳運動向量來作為預測向量的候補區塊，將用來表示已選擇之候補區塊的預測向量索引，予以編碼及解碼。若運動補償預測是單預測，則預測向量索引係被利用1個，若運動補償預測是雙預測，則會利用2個預測向量索引(圖4)。預測向量索引的最大數(亦稱作預測向量候補最大數)係為2，預測向量索引係為0或1之整數。此處，雖然將預測向量候補最大數設成2，但只要2以上即可，並非限定於此。In the present embodiment, in order to improve the accuracy of the prediction vector, a plurality of adjacent blocks and another block of the encoded other image located at the same position as the processing target block are regarded as candidate block groups, and candidates are candidates. The block group selects the candidate block having the best motion vector as the prediction vector, and uses the prediction vector index used to represent the selected candidate block to be encoded and decoded. If the motion compensation prediction is a single prediction, the prediction vector index is used one. If the motion compensation prediction is bi-prediction, two prediction vector indexes are used (Fig. 4). The maximum number of prediction vector indices (also known as prediction vectors)The candidate maximum number is 2, and the prediction vector index is an integer of 0 or 1. Here, although the maximum number of prediction vector candidates is set to 2, it is only required to be 2 or more, and is not limited thereto.
以後，將預測向量索引之對象的候補區塊的運動向量稱作預測向量候補，將預測向量候補的集合體稱作預測向量候補清單。Hereinafter, the motion vector of the candidate block of the target of the prediction vector index is referred to as a prediction vector candidate, and the aggregate of the prediction vector candidates is referred to as a prediction vector candidate list.
關於本實施形態所述之預測區塊之語法之一例，使用圖6來說明。預測區塊是否為畫面內還是畫面間，是由上位的編碼區塊所指定，圖6係圖示了預測區塊為畫面間時的預測區塊之語法。又，關於預測區塊尺寸類型也是由編碼區塊所指定。An example of the syntax of the prediction block described in the present embodiment will be described with reference to FIG. 6. Whether the prediction block is intra-picture or inter-picture is specified by the upper coding block, and FIG. 6 illustrates the syntax of the prediction block when the prediction block is between pictures. Also, the prediction block size type is also specified by the coding block.
在預測區塊(圖6的PU)中係配置有：合併旗標(merge_flag)、合併索引(merge_idx)、畫面間預測類型(inter_pred_type)、L0預測的參照索引(ref_idx_l0)、L0預測的差分向量(mvd_l0[0]、mvd_l0[1])、L0預測的預測向量索引(mvp_idx_l0)、L1預測的參照索引(ref_idx_l1)、L1預測的差分向量(mvd_l1[0]、mvd_l1[1])、及L1預測的預測向量索引(mvp_idx_l1)。差分向量的[0]係表示水平成分，[1]係表示垂直成分。In the prediction block (PU of FIG. 6), a merge flag (merge_flag), a merge index (merge_idx), an inter-picture prediction type (inter_pred_type), a L0 prediction reference index (ref_idx_l0), and a L0 predicted difference vector are configured. (mvd_l0[0], mvd_l0[1]), L0 predicted prediction vector index (mvp_idx_l0), L1 predicted reference index (ref_idx_l1), L1 predicted difference vector (mvd_l1[0], mvd_l1[1]), and L1 The predicted prediction vector index (mvp_idx_l1). The [0] of the difference vector represents a horizontal component, and [1] represents a vertical component.
此處，inter_pred_type係表示運動補償預測之預測方向(亦稱作畫面間預測類型)，係有Pred_L0(L0預測的單預測)、Pred_L1(L1預測的單預測)及Pred_BI(BI預測的雙預測)這3種類。當inter_pred_type是Pred_L0或Pred_BI時，係被設置有關於L0預測之資訊，當inter_pred_type是Pred_L1或Pred_BI時，係被設置有關於L1預測之資訊。Here, inter_pred_type indicates the prediction direction of motion compensation prediction (also called inter-picture prediction type), which is Pred_L0 (L0 predictedThree types of single prediction, Pred_L1 (single prediction of L1 prediction) and Pred_BI (bi prediction of BI prediction). When inter_pred_type is Pred_L0 or Pred_BI, information about L0 prediction is set, and when inter_pred_type is Pred_L1 or Pred_BI, information about L1 prediction is set.
此外，雖然將本實施形態所述之預測區塊之語法設定成如圖6所示，但並非限定於此。Further, although the syntax of the prediction block described in the present embodiment is set as shown in FIG. 6, it is not limited thereto.
以下，連同圖式來說明本發明的理想實施形態所述之動態影像編碼裝置、動態影像編碼方法及動態影像編碼程式、以及動態影像解碼裝置、動態影像解碼方法及動態影像解碼程式之細節。此外，圖式的說明中，對同一要素係賦予同一符號，並省略重複說明。The details of the motion picture coding apparatus, the motion picture coding method, the motion picture coding program, and the motion picture decoding apparatus, the motion picture decoding method, and the motion picture decoding program according to the preferred embodiment of the present invention will be described below with reference to the drawings. In the description of the drawings, the same reference numerals will be given to the same elements, and overlapping description will be omitted.
圖7係圖示本實施形態1所述的動態影像編碼裝置100之構成。動態影像編碼裝置100係為將動態影像訊號，以實施運動補償預測之預測區塊單位來進行編碼的裝置。編碼區塊的分割、預測區塊尺寸類型的決定、預測區塊尺寸與預測區塊在編碼區塊內之位置(預測區塊的位置資訊)的決定、預測編碼模式是否為畫面內的決定，係由未圖示的上位編碼控制部所決定，在實施形態1中係針對預測編碼模式不是畫面內的情形加以說明。又，實施形態1中是針對對應於雙預測的B圖像來說明，但針對不是對應於雙預測的P圖像，係只要省略L1預測即可。FIG. 7 is a view showing the configuration of the motion picture coding apparatus 100 according to the first embodiment. The motion picture coding apparatus 100 is a apparatus for coding a motion picture signal by performing prediction unit blocks of motion compensation prediction. The division of the coding block, the determination of the prediction block size type, the prediction of the block size, the determination of the position of the prediction block in the coding block (the position information of the prediction block), and whether the prediction coding mode is a decision within the picture, This is determined by a higher-level coding control unit (not shown). In the first embodiment, the case where the prediction coding mode is not in the picture will be described. Further, in the first embodiment, the B image corresponding to the bi-prediction is described. However, for the P image that is not corresponding to the bi-prediction, the L1 prediction may be omitted.
動態影像編碼裝置100，係由具備CPU(Central Processing Unit)、畫格記憶體、硬碟等的資訊處理裝置等硬體所實現。動態影像編碼裝置100，係藉由上記的構成要素的作動，而實現以下說明的機能性構成要素。此外，關於處理對象之預測區塊的位置資訊、預測區塊尺寸及運動補償預測之預測方向，係在動態影像編碼裝置100內被共用，而未圖示。The motion image coding device 100 is realized by a hardware such as an information processing device including a CPU (Central Processing Unit), a frame memory, and a hard disk. The motion picture coding apparatus 100 realizes the functional constituent elements described below by the operation of the above-described constituent elements. Further, the position information of the prediction block to be processed, the prediction block size, and the prediction direction of the motion compensation prediction are shared in the motion picture coding apparatus 100, and are not shown.
實施形態1的動態影像編碼裝置100係含有：預測區塊影像取得部101、減算部102、預測誤差編碼部103、編碼列生成部104、預測誤差解碼部105、運動補償部106、加算部107、運動向量偵測部108、運動資訊生成部109、畫格記憶體110、及運動資訊記憶體111。The motion picture coding apparatus 100 according to the first embodiment includes a prediction block video acquisition unit 101, a subtraction unit 102, a prediction error coding unit 103, a code sequence generation unit 104, a prediction error decoding unit 105, a motion compensation unit 106, and an addition unit 107. The motion vector detecting unit 108, the motion information generating unit 109, the frame memory 110, and the motion information memory 111.
以下，說明各部的機能與動作。預測區塊影像取得部101，係基於預測區塊的位置資訊與預測區塊尺寸，從端子10所供給的影像訊號，取得處理對象之預測區塊的影像訊號，將預測區塊的影像訊號，供給至減算部102、運動向量偵測部108及運動資訊生成部109。Hereinafter, the functions and operations of the respective units will be described. The prediction block image acquisition unit 101 acquires the video signal of the prediction block to be processed from the video signal supplied from the terminal 10 based on the position information of the prediction block and the prediction block size, and predicts the video signal of the block. It is supplied to the subtraction unit 102, the motion vector detecting unit 108, and the motion information generating unit 109.
運動向量偵測部108，係從預測區塊影像取得部101所供給之影像訊號及內部所記憶之相當於複數參照影像之影像訊號，偵測出L0預測與L1預測各自的運動向量與表示參照影像之參照影像索引。將該當L0預測和L1預測的運動向量、及該當L0預測和L1預測的參照索引，供給至運動資訊生成部109。此處，雖然運動向量偵測部108係利用內部所記憶的相當於複數參照影像的影像訊號來作為參照影像，但亦可利用畫格記憶體110中所記憶的參照影像。The motion vector detecting unit 108 detects the motion vector and the reference vector of the L0 prediction and the L1 prediction from the video signal supplied from the prediction block image acquisition unit 101 and the video signal corresponding to the complex reference image stored therein. The reference image index of the image. Supplying the motion vector of the L0 prediction and the L1 prediction, and the reference index of the L0 prediction and the L1 prediction toMotion information generating unit 109. Here, although the motion vector detecting unit 108 uses the video signal corresponding to the plurality of reference pictures stored therein as the reference picture, the reference picture stored in the frame memory 110 may be used.
一般的運動向量之偵測方法，係針對從與對象影像之影像訊號同一位置起移動了所定之移動量的參照影像的預測訊號而算出誤差評價值，將誤差評價值為最小的移動量，當作運動向量。若參照影像為複數時，則針對各參照影像偵測出運動向量，將誤差評價值呈最小的參照影像予以選擇。作為誤差評價值，係可利用表示絕對差分和的SAD(Sum of Absolute Difference)或表示平方誤差平均的MSE(Mean Square Error)等。又，亦可將運動向量編碼量加算至誤差評價值來評估。The general motion vector detection method is to calculate an error evaluation value for a prediction signal of a reference image that has been moved by a predetermined amount of movement from the same position as the image signal of the target image, and to minimize the error evaluation value. Make a motion vector. When the reference image is a complex number, a motion vector is detected for each reference image, and the reference image having the smallest error evaluation value is selected. As the error evaluation value, an SAD (Sum of Absolute Difference) indicating an absolute difference sum or an MSE (Mean Square Error) indicating a squared error average or the like can be used. Alternatively, the motion vector coding amount may be added to the error evaluation value for evaluation.
運動資訊生成部109，係根據運動向量偵測部108所供給之L0預測與L1預測之運動向量及L0預測與L1預測之參照索引、運動資訊記憶體111所供給之候補區塊群、參照索引所示的畫格記憶體110內的參照影像、及預測區塊影像取得部101所供給的影像訊號，來決定預測編碼模式。The motion information generating unit 109 is a reference index based on the L0 prediction and the L1 prediction and the L0 prediction and L1 prediction referenced by the motion vector detecting unit 108, and the candidate block group and the reference index supplied from the motion information memory 111. The reference video in the illustrated tile memory 110 and the video signal supplied from the predicted tile image acquisition unit 101 determine the prediction coding mode.
基於已被決定之預測編碼模式，而將合併旗標、合併索引、運動補償預測之預測方向、L0預測與L1預測的參照索引、L0預測與L1預測的差分向量及L0預測與L1預測的預測向量索引，因應需要而供給至編碼列生成部104。將運動補償預測之預測方向、L0預測與L1預測的參照索引、及L0預測和L1預測的運動向量，供給至運動補償部106及運動資訊記憶體111。至於運動資訊生成部109之細節，將於後述。Based on the predicted prediction coding mode, the combined flag, the combined index, the prediction direction of the motion compensation prediction, the reference index of the L0 prediction and the L1 prediction, the difference vector of the L0 prediction and the L1 prediction, and the prediction of the L0 prediction and the L1 prediction The vector index is supplied to the code column generating unit 104 as needed. Prediction direction of motion compensation prediction, L0 prediction and L1 predictionThe reference index and the motion vector of the L0 prediction and the L1 prediction are supplied to the motion compensation unit 106 and the motion information memory 111. The details of the motion information generating unit 109 will be described later.
運動補償部106，係若運動資訊生成部109所供給之運動補償預測之預測方向是LN預測，則將運動資訊生成部109所供給之LN預測之參照索引所示的畫格記憶體110內的參照影像，基於運動資訊生成部109所供給之LN預測之運動向量，進行運動補償，生成LN預測之預測訊號。N係為0或1。此處，若運動補償預測之預測方向是雙預測，則L0預測與L1預測之預測訊號的平均值就成為預測訊號。此外，亦可將L0預測與L1預測之預測訊號予以加權。運動補償部106，係將該當預測訊號，供給至減算部102。When the prediction direction of the motion compensation prediction supplied from the motion information generating unit 109 is the LN prediction, the motion compensation unit 106 sets the intra-frame memory 110 indicated by the reference index of the LN prediction supplied from the motion information generating unit 109. The reference image is subjected to motion compensation based on the motion vector of the LN prediction supplied from the motion information generating unit 109, and a prediction signal of the LN prediction is generated. The N system is 0 or 1. Here, if the prediction direction of the motion compensation prediction is bi-prediction, the average value of the prediction signals of the L0 prediction and the L1 prediction becomes a prediction signal. In addition, the L0 prediction and the prediction signal of the L1 prediction can also be weighted. The motion compensation unit 106 supplies the prediction signal to the subtraction unit 102.
減算部102，係將預測區塊影像取得部101所供給之影像訊號與運動補償部106所供給之預測訊號，進行減算，以算出預測誤差訊號，將該當預測誤差訊號供給至預測誤差編碼部103。The subtraction unit 102 subtracts the video signal supplied from the predicted block video acquisition unit 101 and the prediction signal supplied from the motion compensation unit 106 to calculate a prediction error signal, and supplies the prediction error signal to the prediction error coding unit 103. .
預測誤差編碼部103，係對於減算部102所供給的預測誤差訊號，進行正交轉換或量化等之處理以生成預測誤差編碼資料，將該當預測誤差編碼資料供給至編碼列生成部104及預測誤差解碼部105。The prediction error coding unit 103 performs processing such as orthogonal conversion or quantization on the prediction error signal supplied from the subtraction unit 102 to generate prediction error coded data, and supplies the prediction error coded data to the code column generation unit 104 and the prediction error. Decoding unit 105.
編碼列生成部104，係將預測誤差編碼部103所供給之預測誤差編碼資料、以及運動資訊生成部109所供給之合併旗標、合併索引、運動補償預測之預測方向(畫面間預測類型)、L0預測與L1預測的參照索引、L0預測與L1預測的差分向量及L0預測與L1預測的預測向量索引，按照圖6所示之語法的順序來進行熵編碼以生成編碼列，將該當編碼列供給至端子11。熵編碼係藉由包含算術編碼或霍夫曼編碼等之可變長度編碼的方法來實施。The coded column generation unit 104 is a prediction error coded data supplied from the prediction error coding unit 103, and a prediction direction of the merge flag, the merge index, and the motion compensation prediction supplied from the motion information generation unit 109 (between the screens)The prediction type), the reference index of the L0 prediction and the L1 prediction, the difference vector of the L0 prediction and the L1 prediction, and the prediction vector index of the L0 prediction and the L1 prediction are entropy encoded in the order of the syntax shown in FIG. 6 to generate a coding column. The code column is supplied to the terminal 11. Entropy coding is implemented by a method including variable length coding such as arithmetic coding or Huffman coding.
預測誤差解碼部105，係對於預測誤差編碼部103所供給之預測誤差編碼資料，進行逆量化或逆正交轉換等之處理以生成預測誤差訊號，將該當預測誤差訊號供給至加算部107。加算部107，係將預測誤差解碼部105所供給之預測誤差訊號、和運動補償部106所供給之預測訊號，進行加算，以生成解碼影像訊號，將該當解碼影像訊號供給至畫格記憶體110。The prediction error decoding unit 105 performs processing such as inverse quantization or inverse orthogonal conversion on the prediction error coded data supplied from the prediction error coding unit 103 to generate a prediction error signal, and supplies the prediction error signal to the addition unit 107. The adding unit 107 adds the prediction error signal supplied from the prediction error decoding unit 105 and the prediction signal supplied from the motion compensation unit 106 to generate a decoded video signal, and supplies the decoded video signal to the frame memory 110. .
畫格記憶體110係將加算部107所供給之解碼影像訊號，加以記憶。又，針對影像全體之解碼已經完成的解碼影像，係視為參照影像，而記憶1以上之所定影像數。畫格記憶體110，係將所記憶之參照影像訊號，供給至運動補償部106及運動資訊生成部109。記憶參照影像的記憶領域，係以FIFO(First In First Out)方式而被控制。The frame memory 110 stores the decoded video signal supplied from the adding unit 107. Further, the decoded image in which the decoding of the entire image has been completed is regarded as a reference image, and the number of predetermined images of one or more is memorized. The frame memory 110 supplies the stored reference image signal to the motion compensation unit 106 and the motion information generating unit 109. The memory area of the memory reference image is controlled by the FIFO (First In First Out) method.
運動資訊記憶體111，係將運動資訊生成部109所供給之運動資訊，以最小預測區塊尺寸單位，記憶所定之影像數。將處理對象之預測區塊的相鄰區塊之運動資訊，視為空間候補區塊群。The motion information memory 111 stores the motion information supplied from the motion information generating unit 109 in a minimum prediction block size unit and memorizes the predetermined number of images. The motion information of the adjacent blocks of the prediction block of the processing object is regarded as a space candidate block group.
又，運動資訊記憶體111，係將與處理對象之預測區塊位於同一位置的ColPic上的區塊和其周邊區塊的運動資訊，視為時間候補區塊群。運動資訊記憶體111，係將空間候補區塊群與時間候補區塊群當作候補區塊群而供給至運動資訊生成部109。運動資訊記憶體111，係與畫格記憶體110同步，以FIFO(First In First Out)方式而被控制。Further, the motion information memory 111 is a motion of a block on the ColPic and a peripheral block thereof which are located at the same position as the prediction block of the processing target.Information is regarded as a time candidate block group. The motion information memory 111 supplies the space candidate block group and the time candidate block group to the motion information generating unit 109 as a candidate block group. The motion information memory 111 is synchronized with the frame memory 110 and controlled in a FIFO (First In First Out) manner.
此處，所謂ColPic，係指有別於處理對象之預測區塊的另一已解碼之影像，且在畫格記憶體110中當成參照影像而被記憶。在實施形態1中，ColPic係為處理對象影像的前一個已解碼之參照影像。此外，雖然在實施形態1中，ColPic係設為處理對象影像的前一個已解碼之參照影像，但只要是已解碼之影像即可，例如，亦可為顯示順序上前一個參照影像或顯示順序上後一個參照影像，亦可在編碼串流中做指定。Here, the term "ColPic" refers to another decoded image that is different from the prediction block of the processing target, and is stored as a reference image in the frame memory 110. In the first embodiment, the ColPic is the previous decoded reference image of the processing target image. Further, in the first embodiment, the ColPic system is the previous decoded reference image of the processing target image, but may be the decoded image, for example, the previous reference image or the display order in the display order. The last reference image can also be specified in the encoded stream.
此處，說明運動資訊記憶體111中的運動資訊之管理方法。運動資訊係以最小預測區塊單位而被記憶在各記憶區域中。各記憶區域中係至少記憶著：預測方向、L0預測的運動向量、L0預測的參照索引、L1預測的運動向量、及L1預測的參照索引。Here, a method of managing motion information in the motion information memory 111 will be described. The motion information is memorized in each memory area in units of minimum prediction blocks. At least the prediction direction, the motion vector of the L0 prediction, the reference index of the L0 prediction, the motion vector of the L1 prediction, and the reference index of the L1 prediction are stored in each memory area.
此外，若預測編碼模式是畫面內模式，則作為L0預測與L1預測之運動向量是記憶著(0,0)，作為L0預測與L預測之參照索引是記憶著「-1」。以後，運動向量(H、V)係為，H是表示水平成分、V是表示垂直成分。此外，參照索引的「-1」係為只要是能夠判定其為不實施運動補償預測之模式，則可為任意之值。此後的說明中，單純表現為區塊的時候，若沒有特別聲明，則是代表最小的預測區塊單位。又，即使在領域外之區塊的情況下，也是和畫面內模式同樣地，作為L0預測與L1預測之運動向量是記憶著(0,0)，作為L0預測與L1預測之參照索引是記憶著「-1」。若LX方向(X為0或1)為有效則LX方向的參照索引係為0以上，若LX方向為無效(非有效)則LX方向的參照索引係為「-1」。此外，所謂領域外，係表示一般而言處理對象之預測區塊所隸屬之圖像之外的領域或切片之外的領域。Further, when the prediction coding mode is the intra-picture mode, the motion vector as the L0 prediction and the L1 prediction is stored (0, 0), and the reference index of the L0 prediction and the L prediction is "-1". Hereinafter, the motion vector (H, V) is such that H is a horizontal component and V is a vertical component. Further, the "-1" of the reference index may be any value as long as it can be determined that the motion compensation prediction is not performed. In the following description,When it is simply expressed as a block, if it is not specifically stated, it is the smallest forecast block unit. Further, even in the case of a block outside the field, as in the intra-picture mode, the motion vector as the L0 prediction and the L1 prediction is stored (0, 0), and the reference index as the L0 prediction and the L1 prediction is the memory. "-1". When the LX direction (X is 0 or 1) is valid, the reference index in the LX direction is 0 or more, and if the LX direction is invalid (not valid), the reference index in the LX direction is "-1". Further, the term "outside the field" refers to a field other than the image to which the prediction block of the object is to be processed or a field other than the slice.
接著說明運動資訊生成部109的詳細構成。圖8係圖示運動資訊生成部109之構成。運動資訊生成部109係含有：預測向量模式決定部120、合併模式決定部121及預測編碼模式決定部122。端子12係連接至運動資訊記憶體111，端子13係連接至運動向量偵測部108，端子14係連接至畫格記憶體110，端子15係連接至預測區塊影像取得部101，端子16係連接至編碼列生成部104，端子50係連接至運動補償部106，及端子51係連接至運動資訊記憶體111。Next, the detailed configuration of the motion information generating unit 109 will be described. FIG. 8 is a diagram showing the configuration of the motion information generating unit 109. The motion information generating unit 109 includes a prediction vector mode determining unit 120, a merge mode determining unit 121, and a predictive encoding mode determining unit 122. The terminal 12 is connected to the motion information memory 111, the terminal 13 is connected to the motion vector detecting unit 108, the terminal 14 is connected to the frame memory 110, the terminal 15 is connected to the predicted block image obtaining unit 101, and the terminal 16 is connected. The terminal 50 is connected to the code column generating unit 104, the terminal 50 is connected to the motion compensating unit 106, and the terminal 51 is connected to the motion information memory 111.
以下，說明各部的機能與動作。預測向量模式決定部120，係根據端子12所供給之候補區塊群、端子13所供給之L0預測與L1預測之運動向量及L0預測與L1預測之參照索引、端子14所供給之參照索引所示之參照影像、及端子15所供給之影像訊號，來決定畫面間預測類型，依照畫面間預測類型，選擇L0預測與L1預測之預測向量索引而算出L0預測與L1預測之差分向量，並且算出預測誤差，算出位元率失真評價值。然後，將基於該當畫面間預測類型的運動資訊、差分向量、預測向量索引、及位元率失真評價值，供給至預測編碼模式決定部122。Hereinafter, the functions and operations of the respective units will be described. The prediction vector mode determining unit 120 is provided based on the candidate block group and the terminal 13 supplied from the terminal 12.The L0 prediction and L1 prediction motion vector, the reference index of L0 prediction and L1 prediction, the reference image indicated by the reference index supplied from the terminal 14, and the video signal supplied from the terminal 15 are used to determine the inter-picture prediction type. For the inter-picture prediction type, the difference vector of the L0 prediction and the L1 prediction is calculated by selecting the prediction vector index of the L0 prediction and the L1 prediction, and the prediction error is calculated, and the bit rate distortion evaluation value is calculated. Then, the motion information, the difference vector, the prediction vector index, and the bit rate distortion evaluation value based on the inter-picture prediction type are supplied to the predictive coding mode determining unit 122.
合併模式決定部121，係根據端子12所供給之候補區塊群、端子14所供給之參照影像、及端子15所供給之影像訊號，來生成結合運動資訊候補清單，從該當結合運動資訊候補清單之中選擇出1個結合運動資訊候補並決定合併索引，算出位元率失真評價值。然後，將該當結合運動資訊候補之運動資訊、該當合併索引及該當位元率失真評價值，供給至預測編碼模式決定部122。合併模式決定部121的細節，將於後述。The merge mode determining unit 121 generates a combined motion information candidate list based on the candidate block group supplied from the terminal 12, the reference image supplied from the terminal 14, and the video signal supplied from the terminal 15, and the combined motion information candidate list is selected from the combined motion information candidate list. Among them, one combined motion information candidate is selected and the combined index is determined, and the bit rate distortion evaluation value is calculated. Then, the motion information combined with the motion information candidate, the combined index, and the bit rate distortion evaluation value are supplied to the predictive coding mode determining unit 122. Details of the merge mode determining unit 121 will be described later.
預測編碼模式決定部122，係將預測向量模式決定部120所供給之位元率失真評價值、和合併模式決定部121所供給之位元率失真評價值，進行比較，然後決定合併旗標。The prediction coding mode determination unit 122 compares the bit rate distortion evaluation value supplied from the prediction vector mode determination unit 120 with the bit rate distortion evaluation value supplied from the merge mode determination unit 121, and then determines the merge flag.
若預測向量模式位元率失真評價值未滿合併模式位元率失真評價值，則將合併旗標設定成「0」。預測編碼模式決定部122，係將該當合併旗標、預測向量模式決定部120所供給之畫面間預測類型、參照索引、差分向量和預測向量索引，供給至端子16，將預測向量模式決定部120所供給之運動資訊，供給至端子50及端子51。If the prediction vector mode bit rate distortion evaluation value is less than the merge mode bit rate distortion evaluation value, the merge flag is set to "0". The prediction coding mode determining unit 122 is an inter-picture prediction type, a reference index, a difference vector, and a preamble supplied by the merge flag and prediction vector mode determining unit 120.The vector index is supplied to the terminal 16, and the motion information supplied from the predicted vector mode determining unit 120 is supplied to the terminal 50 and the terminal 51.
若合併模式位元率失真評價值是預測向量模式位元率失真評價值以下，則將合併旗標設定成「1」。預測編碼模式決定部122，係將該當合併旗標及合併模式決定部121所供給之合併索引，供給至端子16，將合併模式決定部121所供給之運動資訊，供給至端子50及端子51。此外，位元率失真評價值的具體算出方法係不是本發明的重點因此省略詳細說明，但從預測誤差與編碼量算出每一編碼量的預測誤差量，位元率失真評價值係為越小則帶有越高編碼效率之特性的評價值。因此，藉由選擇位元率失真評價值較小的預測編碼模式，就可提升編碼效率。If the merge mode bit rate distortion evaluation value is below the prediction vector mode bit rate distortion evaluation value, the merge flag is set to "1". The prediction encoding mode determining unit 122 supplies the combined index supplied from the merge flag and the merge mode determining unit 121 to the terminal 16, and supplies the motion information supplied from the merge mode determining unit 121 to the terminal 50 and the terminal 51. In addition, the specific calculation method of the bit rate distortion evaluation value is not the focus of the present invention, and thus detailed description is omitted. However, the prediction error amount for each code amount is calculated from the prediction error and the code amount, and the bit rate distortion evaluation value is smaller. Then, the evaluation value with the characteristics of higher coding efficiency. Therefore, by selecting a predictive coding mode with a small bit rate distortion evaluation value, the coding efficiency can be improved.
接著說明合併模式決定部121的詳細構成。圖9係用來說明合併模式決定部121之構成的圖。合併模式決定部121係含有：結合運動資訊候補清單生成部140及結合運動資訊選擇部141。結合運動資訊候補清單生成部140，係將在實施形態1所述之動態影像編碼裝置100所生成之編碼列加以解碼的動態影像解碼裝置200中也被同樣設置，在動態影像編碼裝置100與動態影像解碼裝置200中生成同一結合運動資訊清單。Next, the detailed configuration of the merge mode determining unit 121 will be described. FIG. 9 is a diagram for explaining the configuration of the merge mode determining unit 121. The merge mode determination unit 121 includes a combined motion information candidate list generation unit 140 and a combined motion information selection unit 141. The motion information candidate list generating unit 140 is also provided similarly to the motion picture decoding device 200 that decodes the code sequence generated by the motion picture coding device 100 according to the first embodiment, and the motion picture coding apparatus 100 and the dynamic picture coding apparatus 100 The same combined motion information list is generated in the video decoding device 200.
以下，說明各部的機能與動作。結合運動資訊候補清單生成部140，係根據端子12所供給之候補區塊群而生成含有合併候補最大數之結合運動資訊候補的結合運動資訊候補清單，將該當結合運動資訊候補清單，供給至結合運動資訊選擇部141。關於結合運動資訊候補清單生成部140之詳細構成，將於後述。Hereinafter, the functions and operations of the respective units will be described. The combined motion information candidate list generating unit 140 generates a combined motion information candidate list including the combined motion information candidates having the maximum number of combined candidates based on the candidate block group supplied from the terminal 12, and supplies the combined motion information candidate list to the combined Motion information selection unit 141. The detailed configuration of the combined motion information candidate list generating unit 140 will be described later.
結合運動資訊選擇部141，係從結合運動資訊候補清單生成部140所供給之結合運動資訊候補清單之中，選擇出最佳的結合運動資訊候補，決定表示已被選擇之結合運動資訊候補的資訊亦即合併索引，將該當合併索引供給至端子17。The combined motion information selection unit 141 selects the best combined motion information candidate from the combined motion information candidate list supplied from the combined motion information candidate list generating unit 140, and determines the information indicating the combined combined motion information candidate. That is, the index is merged, and the merge index is supplied to the terminal 17.
此處，說明最佳之結合運動資訊候補的選擇方法。根據基於結合運動資訊候補之預測方向、運動向量及參照索引而進行運動補償預測所得之由端子14所供給之參照影像、和端子15所供給之影像訊號，來算出預測誤差量。合併索引的編碼量、和該當預測誤差量而算出位元率失真評價值，位元率失真評價值呈最小之結合運動資訊候補，會被當成最佳結合運動資訊候補而選擇。Here, the selection method of the optimal combined motion information candidate will be described. The prediction error amount is calculated based on the reference image supplied from the terminal 14 and the video signal supplied from the terminal 15 obtained by the motion compensation prediction based on the prediction direction, the motion vector, and the reference index of the motion information candidate. The combination of the coding amount of the combined index and the prediction error amount to calculate the bit rate distortion evaluation value, and the bit rate distortion evaluation value which is the smallest combined motion information candidate is selected as the best combined motion information candidate.
接著，關於被供給至結合運動資訊候補清單生成部140的候補區塊群，使用圖10和圖11來說明。在候補區塊群中係含有空間候補區塊群與時間候補區塊群。Next, the candidate block group supplied to the combined motion information candidate list generating unit 140 will be described with reference to FIGS. 10 and 11 . The candidate block group includes a space candidate block group and a time candidate block group.
圖10係圖示了，處理對象之預測區塊尺寸為16像素×16像素時的處理對象之預測區塊的相鄰區塊。在實施形態1中，作為空間候補區塊群係假設為圖10所示的區塊A1、區塊C、區塊D、區塊B1及區塊E這5個區塊。雖然此處是將空間候補區塊群假設為區塊A1、區塊C、區塊D、區塊B1及區塊E這5個區塊，但空間候補區塊群係只要是相鄰於處理對象之預測區塊的至少1個以上的已處理之區塊即可，並非限定於此。例如，區塊A1、區塊A2、區塊A3、區塊A4、區塊B1、區塊B2、區塊B3、區塊B4、區塊C、區塊D及區塊E全部都可以當成空間候補區塊。FIG. 10 is a diagram showing adjacent blocks of a prediction block of a processing target when a prediction block size of a processing object is 16 pixels×16 pixels. In the first embodiment, the space candidate block group is assumed to be five blocks of the block A1, the block C, the block D, the block B1, and the block E shown in FIG. Although the space candidate block group is assumed to be five blocks of block A1, block C, block D, block B1, and block E, the space candidate block group is adjacent to the processing. At least one or more processed blocks of the prediction block of the object may be used, and are not limited thereto. For example, block A1, block A2, block A3, block A4, block B1, block B2, block B3, block B4, block C, block D, and block E can all be considered as spaces. Alternate block.
接著，關於時間候補區塊群，使用圖11來說明。圖11係圖示了，處理對象之預測區塊尺寸為16像素×16像素時的與處理對象之預測區塊位於同一位置的ColPic上的預測區塊內的區塊和其周邊區塊。在實施形態1中，作為時間候補區塊群係假設為圖11所示的區塊H與區塊I6這2個區塊。雖然此處是將時間候補區塊群假設為ColPic上的區塊H及區塊I6這2個區塊，但時間候補區塊群係只要是有別於處理對象之預測區塊的另一已解碼影像上的至少1個以上之區塊即可，並非限定於此。例如，亦可只有區塊H。以後，將區塊A4表示成區塊A，將區塊B4表示成區塊B，將區塊I6表示成區塊I，將區塊H和區塊I6之區塊，表示成時間區塊。Next, the time candidate block group will be described using FIG. 11 is a block diagram showing a block in a prediction block on a ColPic located at the same position as a prediction block of a processing target when the prediction block size of the processing object is 16 pixels×16 pixels, and a peripheral block thereof. In the first embodiment, the time candidate block group is assumed to be two blocks of the block H and the block I6 shown in FIG. Although the time candidate block group is assumed to be the two blocks of the block H and the block I6 on the ColPic, the time candidate block group is only another one that is different from the predicted block of the processing target. It is sufficient to decode at least one or more blocks on the image, and is not limited thereto. For example, there may be only block H. Thereafter, block A4 is represented as block A, block B4 is represented as block B, block I6 is represented as block I, and block H and block I6 are represented as time blocks.
接著說明，結合運動資訊候補清單生成部140的詳細構成。圖12係結合運動資訊候補清單生成部140之構成的說明圖。端子19係連接至結合運動資訊選擇部141。結合運動資訊候補清單生成部140係含有：空間結合運動資訊候補生成部160、時間結合運動資訊候補生成部161、冗長結合運動資訊候補刪除部162、隱性結合運動資訊候補追加部163、第1結合運動資訊候補補充部164、及第2結合運動資訊候補補充部165。空間結合運動資訊候補生成部160係含有隱性結合運動資訊候補判定部166。Next, the detailed configuration of the motion information candidate list generating unit 140 will be described. FIG. 12 is an explanatory diagram of a configuration of the combined motion information candidate list generating unit 140. The terminal 19 is connected to the combined motion information selection section 141. The combined motion information candidate list generating unit 140 includes a spatial combined motion information candidate generating unit 160, a time combined motion information candidate generating unit 161, a redundant combined motion information candidate deleting unit 162, and an implicit combined motion information candidate adding unit 163, and the first The motion information candidate supplementing unit 164 and the second combined motion information candidate complementing unit 165 are combined. The spatial combined motion information candidate generation unit 160 includes an implicit combined motion information candidate determination unit 166.
以下，說明各部的機能與動作。圖13係結合運動資訊候補清單生成部140之動作的說明用流程圖。首先，結合運動資訊候補清單生成部140，係將結合運動資訊候補清單予以初期化(S100)。已被初期化之結合運動資訊候補清單中係不存在有結合運動資訊候補。Hereinafter, the functions and operations of the respective units will be described. FIG. 13 is a flowchart for explaining the operation of the combined motion information candidate list generating unit 140. First, the combined motion information candidate list generating unit 140 initializes the combined motion information candidate list (S100). There is no combined motion information candidate in the list of combined sports information candidates that has been initialized.
接著，隱性結合運動資訊候補判定部166，係選擇隱性結合運動資訊候補而將該當隱性結合運動資訊候補予以記憶(S101)。已被記憶之隱性結合運動資訊候補，係在結合運動資訊候補清單生成部140內被共用。隱性結合運動資訊候補判定部166的詳細動作，將於後述。接著，空間結合運動資訊候補生成部160，係根據端子12所供給之候補區塊群而生成0個至空間結合運動資訊候補最大數的空間結合運動資訊候補然後追加至結合運動資訊候補清單(S102)，將該當結合運動資訊候補清單和候補區塊群，供給至時間結合運動資訊候補生成部161。空間結合運動資訊候補生成部160的詳細動作，將於後述。又，關於空間結合運動資訊候補最大數，也將於後述。Next, the implicit combined motion information candidate determination unit 166 selects the implicit combined motion information candidate to memorize the implicit combined motion information candidate (S101). The implicit combined motion information candidates that have been memorized are shared by the combined motion information candidate list generating unit 140. The detailed operation of the implicit combined motion information candidate determination unit 166 will be described later. Next, the spatial combined motion information candidate generation unit 160 generates 0 to the maximum number of spatial combined motion information candidates based on the candidate block group supplied from the terminal 12.The space combined with the motion information candidate is added to the combined motion information candidate list (S102), and the combined motion information candidate list and the candidate block group are supplied to the time combined motion information candidate generating unit 161. The detailed operation of the space combined motion information candidate generation unit 160 will be described later. In addition, the maximum number of spatial combined motion information candidates will be described later.
接著，時間結合運動資訊候補生成部161，係根據空間結合運動資訊候補生成部160所供給之候補區塊群來生成0個或時間結合運動資訊候補最大數的時間結合運動資訊候補然後追加至空間結合運動資訊候補生成部160所供給之結合運動資訊候補清單(S103)，將該當結合運動資訊候補清單，供給至隱性結合運動資訊候補追加部163。時間結合運動資訊候補生成部161的詳細動作，將於後述。又，關於時間結合運動資訊候補最大數，也將於後述。Then, the time-integrated motion information candidate generation unit 161 generates a time-joined motion information candidate that is zero or the maximum number of time-combined motion information candidates, and then adds it to the space, based on the candidate block group supplied from the spatial combined motion information candidate generation unit 160. The combined motion information candidate list is supplied to the recessive combined motion information candidate adding unit 163 in conjunction with the combined motion information candidate list (S103) supplied from the motion information candidate generating unit 160. The detailed operation of the time combined motion information candidate generation unit 161 will be described later. In addition, the maximum number of time combined motion information candidates will be described later.
接著，冗長結合運動資訊候補刪除部162，係檢查時間結合運動資訊候補生成部161所供給之結合運動資訊候補清單中所被登錄的結合運動資訊候補，若有同一運動資訊的結合運動資訊候補是複數存在時，則留下1個結合運動資訊候補而刪除其他結合運動資訊候補(S104)，將該當結合運動資訊候補清單，供給至隱性結合運動資訊候補追加部163。因此，該當結合運動資訊候補清單中所被登錄的結合運動資訊候補，係為全部都是不同的結合運動資訊候補。Then, the redundant combined motion information candidate deleting unit 162 checks the combined motion information candidate registered in the combined motion information candidate list supplied by the time combined with the motion information candidate generating unit 161, and if the combined motion information candidate of the same motion information is When the plural number exists, one combined motion information candidate is deleted, and the other combined motion information candidates are deleted (S104), and the combined motion information candidate list is supplied to the implicit combined motion information candidate adding unit 163. Therefore, the combined motion information candidates registered in the combined motion information candidate list are all combined motion information candidates.
接著，隱性結合運動資訊候補追加部163，係若隱性結合運動資訊候補為有效，則在冗長結合運動資訊候補刪除部162所供給之結合運動資訊候補清單的最末尾，追加隱性結合運動資訊候補(S105)，將該當結合運動資訊候補清單，供給至第1結合運動資訊候補補充部164。若隱性結合運動資訊候補並非有效，則將冗長結合運動資訊候補刪除部162所供給之結合運動資訊候補清單，供給至第1結合運動資訊候補補充部164。隱性結合運動資訊候補追加部163的詳細動作，將於後述。Next, the implicit combined motion information candidate adding unit 163 is implicit.When the combined motion information candidate is valid, the implicit combined motion information candidate is added to the end of the combined motion information candidate list supplied by the redundant combined motion information candidate deleting unit 162 (S105), and the combined motion information candidate list is supplied to The first combined motion information candidate supplementing unit 164. When the implicit combined motion information candidate is not valid, the combined motion information candidate list supplied from the motion information candidate deletion unit 162 is supplied to the first combined motion information candidate complementing unit 164. The detailed operation of the implicit combined motion information candidate adding unit 163 will be described later.
接著，第1結合運動資訊候補補充部164，係根據隱性結合運動資訊候補追加部163所供給之結合運動資訊候補清單中所登錄的結合運動資訊候補，生成0個至2個的第1補充結合運動資訊候補然後追加至結合運動資訊候補清單(S106)，將該當結合運動資訊候補清單，供給至第2結合運動資訊候補補充部165。第1結合運動資訊候補補充部164的詳細動作，將於後述。Then, the first combined motion information candidate supplementing unit 164 generates 0 to 2 first supplements based on the combined motion information candidates registered in the combined motion information candidate list supplied from the implicit combined motion information candidate adding unit 163. The combined motion information candidate list is added to the combined motion information candidate list (S106), and the combined motion information candidate list is supplied to the second combined motion information candidate complementing unit 165. The detailed operation of the first combined motion information candidate supplementing unit 164 will be described later.
接著，第2結合運動資訊候補補充部165，係生成不依存於第1結合運動資訊候補補充部164所供給之結合運動資訊候補清單的0個至2個的第2補充結合運動資訊候補，然後追加至第1結合運動資訊候補補充部164所供給之結合運動資訊候補清單(S107)，將該當結合運動資訊候補清單供給至端子19。第2結合運動資訊候補補充部165的詳細動作，將於後述。Then, the second combined motion information candidate supplementing unit 165 generates 0 to 2 second supplementary combined motion information candidates that are not dependent on the combined motion information candidate list supplied from the first combined motion information candidate supplementing unit 164, and then generates The combined motion information candidate list supplied by the first combined motion information candidate supplementing unit 164 is added (S107), and the combined motion information candidate list is supplied to the terminal 19. The detailed operation of the second combined motion information candidate supplementing unit 165 will be described later.
以下說明隱性結合運動資訊候補。圖14(a)至(d)係用來說明隱性結合運動資訊候補的圖。編碼區塊，上面已經說明過可以分割成1或2或4個預測區塊。圖14係表示編碼區塊為16x16的例子。藉由將編碼區塊分割成多數預測區塊，可使涉及編碼區塊的預測誤差最小化，但是另一方面，圖6所示的涉及預測區塊的語法的負荷，會隨預測區塊的個數而增加。因此，針對運動資訊為相同且預測誤差為相同的複數預測區塊，係總結成1個預測區塊，抑制預測區塊的分割數，就可提升編碼效率。The following describes the implicit combined motion information candidates. 14(a) to (d) are diagrams for explaining implicit binding motion information candidates. The coding block, which has been described above, can be divided into 1 or 2 or 4 prediction blocks. Fig. 14 is a diagram showing an example in which the coding block is 16x16. The prediction error involving the coding block can be minimized by dividing the coding block into a plurality of prediction blocks, but on the other hand, the load of the syntax related to the prediction block shown in FIG. 6 will follow the prediction block. Increase in number. Therefore, for a complex prediction block whose motion information is the same and the prediction error is the same, it is summarized into one prediction block, and the number of divisions of the prediction block is suppressed, so that the coding efficiency can be improved.
圖14(a)係用來說明候補區塊A是隱性結合運動資訊候補之例1的圖。圖示了編碼區塊係為合併模式，且預測區塊尺寸類型係為N×2N而被編碼時的預測區塊1的空間結合運動資訊候補的位置。此處，若預測區塊0的運動資訊與預測區塊1的運動資訊是相同，則將預測區塊0與預測區塊1總結成2N×2N來進行編碼，藉此可減少涉及預測區塊的語法之負荷，可提升編碼效率。亦即，當預測區塊尺寸類型是N×2N且處理對象區塊是預測區塊1的情況下，設成2N×2N而被編碼時的候補區塊所相當之候補區塊A被選擇成為結合運動資訊候補的可能性係較低。因此，當預測區塊尺寸類型是N×2N且處理對象區塊是預測區塊1的情況下，將候補區塊A當作隱性結合運動資訊候補。Fig. 14 (a) is a diagram for explaining an example 1 in which the candidate block A is a recessive combined motion information candidate. The position where the coding block is the merge mode and the prediction block size type is N×2N and the space of the prediction block 1 is combined with the motion information candidate is illustrated. Here, if the motion information of the prediction block 0 is the same as the motion information of the prediction block 1, the prediction block 0 and the prediction block 1 are summarized into 2N×2N for encoding, thereby reducing the prediction block involved. The grammatical load can improve coding efficiency. In other words, when the prediction block size type is N×2N and the processing target block is the prediction block 1, the candidate block A corresponding to the candidate block when 2N×2N is encoded is selected as The possibility of combining sports information candidates is lower. Therefore, when the prediction block size type is N×2N and the processing target block is the prediction block 1, the candidate block A is regarded as a recessive combined motion information candidate.
圖14(b)係用來說明候補區塊A是隱性結合運動資訊候補之例2的圖。圖示了編碼區塊係為合併模式，且預測區塊尺寸類型係為N×N而被編碼時的預測區塊3的空間結合運動資訊候補的位置。此處，若預測區塊0的運動資訊與預測區塊1的運動資訊是相同、且預測區塊2的運動資訊與預測區塊3的運動資訊是相同，則將預測區塊0與預測區塊1總結，而且還將預測區塊2與預測區塊3總結成2N×N來進行編碼，藉此就可減少涉及預測區塊的語法之負荷，可提升編碼效率。因此，預測區塊尺寸類型為N×N且預測區塊0的運動資訊與預測區塊1的運動資訊為相同且為預測區塊3的情況下，則將候補區塊A當作隱性結合運動資訊候補。Fig. 14 (b) is a diagram for explaining an example 2 in which the candidate block A is a recessive combined motion information candidate. The coding block is shown as a merge mode, andThe space of the prediction block 3 when the block size type is N×N is combined with the position of the motion information candidate. Here, if the motion information of the prediction block 0 is the same as the motion information of the prediction block 1, and the motion information of the prediction block 2 is the same as the motion information of the prediction block 3, the prediction block 0 and the prediction area will be predicted. Block 1 is summarized, and the prediction block 2 and the prediction block 3 are also summarized into 2N×N for encoding, whereby the load of the syntax involving the prediction block can be reduced, and the coding efficiency can be improved. Therefore, if the prediction block size type is N×N and the motion information of the prediction block 0 is the same as the motion information of the prediction block 1 and is the prediction block 3, the candidate block A is regarded as implicit combination. Sports information candidates.
圖14(c)係用來說明候補區塊B是隱性結合運動資訊候補之例1的圖。係圖示了，編碼區塊為合併模式，且預測區塊尺寸類型係設成2N×N來進行編碼的樣子。此處，若預測區塊0的運動資訊與預測區塊1的運動資訊是相同，則將預測區塊0與預測區塊1總結成2N×2N來進行編碼，藉此可減少涉及預測區塊的語法之負荷，可提升編碼效率。因此，當預測區塊尺寸類型是2N×N且處理對象區塊是預測區塊1的情況下，將候補區塊B當作隱性結合運動資訊候補。Fig. 14 (c) is a diagram for explaining an example 1 in which the candidate block B is a recessive combined motion information candidate. It is shown that the coding block is in merge mode, and the prediction block size type is set to 2N×N for encoding. Here, if the motion information of the prediction block 0 is the same as the motion information of the prediction block 1, the prediction block 0 and the prediction block 1 are summarized into 2N×2N for encoding, thereby reducing the prediction block involved. The grammatical load can improve coding efficiency. Therefore, when the prediction block size type is 2N×N and the processing target block is the prediction block 1, the candidate block B is regarded as a recessive combined motion information candidate.
圖14(d)係用來說明候補區塊B是隱性結合運動資訊候補之例2的圖。圖示了編碼區塊係為合併模式，且預測區塊尺寸類型係為N×N而被編碼時的預測區塊3的空間結合運動資訊候補的位置。此處，預測區塊0的運動資訊與預測區塊2的運動資訊是相同且預測區塊1的運動資訊與預測區塊3的運動資訊是相同，則將預測區塊0與預測區塊2總結，而且還將預測區塊1與預測區塊3總結成N×2N來進行編碼，藉此可減少涉及預測區塊的語法之負荷，可提升編碼效率。因此，預測區塊尺寸類型為N×N且預測區塊0的運動資訊與預測區塊2的運動資訊為相同且為預測區塊3的情況下，則將候補區塊B當作隱性結合運動資訊候補。Fig. 14 (d) is a diagram for explaining an example 2 in which the candidate block B is a recessive combined motion information candidate. The position where the coding block is the merge mode and the prediction block size type is N×N and the space of the prediction block 3 is combined with the motion information candidate is illustrated. Here, the motion information of the prediction block 0 is the same as the motion information of the prediction block 2, and the motion resource of the prediction block 1 is predicted.The motion information of the prediction block 3 is the same, and the prediction block 0 and the prediction block 2 are summarized, and the prediction block 1 and the prediction block 3 are also summarized into N×2N for encoding, thereby reducing The load of the syntax involved in predicting blocks can improve coding efficiency. Therefore, if the prediction block size type is N×N and the motion information of the prediction block 0 is the same as the motion information of the prediction block 2 and is the prediction block 3, the candidate block B is regarded as a recessive combination. Sports information candidates.
如此，基於編碼對象之預測區塊的分割類型與編碼對象之預測區塊在編碼區塊內之位置，以比編碼對象之預測區塊的尺寸還大之尺寸的預測區塊來進行運動補償預測，係可將編碼效率之觀點上較為適切的結合運動資訊候補，選擇來作為隱性結合運動資訊候補。如以上，所謂隱性結合運動資訊候補，係為藉由被結合成更大預測區塊尺寸，而編碼效率有所提升的結合運動資訊候補。所謂隱性結合運動資訊，係為隱性結合運動資訊候補的運動資訊。In this way, based on the partition type of the prediction block of the encoding object and the position of the prediction block of the encoding object in the encoding block, the motion compensation prediction is performed with the prediction block larger than the size of the prediction block of the encoding object. It is possible to combine motion information candidates with a view of coding efficiency, and select them as implicit combined motion information candidates. As described above, the implicit combined motion information candidate is a combined motion information candidate that is improved in coding efficiency by being combined into a larger prediction block size. The so-called implicit combined sports information is the sports information that implicitly combines sports information candidates.
圖15係用來說明隱性結合運動資訊候補判定部166的判定處理之一例的流程圖。FIG. 15 is a flowchart for explaining an example of determination processing of the recessive combined motion information candidate determination unit 166.
首先，檢查預測區塊尺寸類型是否為2N×2N(S150)。若預測區塊尺寸類型是2N×2N(S150的Y)，則結束處理。若預測區塊尺寸類型不是2N×2N(S150的N)，則檢查預測區塊尺寸類型(S151)。若預測區塊尺寸類型為N×2N(S151的N×2N)，則檢查是否為預測區塊1(S152)。若預測區塊尺寸類型為2N×N(S151的2N×N)，則檢查是否為預測區塊1(S154)。若預測區塊尺寸類型為N×N(S151的N×N)，則檢查是否為預測區塊3(S156)。若預測區塊尺寸類型是N×2N，且為預測區塊1(S152的Y)，則將區塊A當作隱性結合運動資訊候補(S153)。若預測區塊尺寸類型是N×2N，且並非預測區塊1(S152的N)，則結束處理。若預測區塊尺寸類型是2N×N，且為預測區塊1(S154的Y)，則將區塊B當作隱性結合運動資訊候補(S155)。若預測區塊尺寸類型是2N×N，且並非預測區塊1(S154的N)，則結束處理。First, it is checked whether the predicted block size type is 2N × 2N (S150). If the predicted block size type is 2N × 2N (Y of S150), the processing is ended. If the predicted block size type is not 2N × 2N (N of S150), the predicted block size type is checked (S151). If the prediction block size type is N×2N (N×2N of S151), check if it is a prediction area.Block 1 (S152). If the prediction block size type is 2N×N (2N×N of S151), it is checked whether it is the prediction block 1 (S154). If the prediction block size type is N × N (N × N of S151), it is checked whether it is the prediction block 3 (S156). If the predicted block size type is N × 2N and is predicted block 1 (Y of S152), block A is regarded as a recessive combined motion information candidate (S153). If the predicted block size type is N × 2N and is not predicted block 1 (N of S152), the processing is ended. If the predicted block size type is 2N×N and is predicted block 1 (Y of S154), block B is regarded as a recessive combined motion information candidate (S155). If the predicted block size type is 2N×N and is not predicted block 1 (N of S154), the processing is ended.
若預測區塊尺寸類型是N×N，且為預測區塊3(S156的Y)，則檢查預測區塊0與預測區塊2是否相同(S157)。若預測區塊尺寸類型是N×N，且並非預測區塊3(S156的N)，則結束處理。若預測區塊0與預測區塊2的運動資訊相同(S157的Y)，則將區塊A當作隱性結合運動資訊候補(S158)。若預測區塊0與預測區塊2的運動資訊並非相同(S157的N)，則檢查預測區塊0與預測區塊1的運動資訊是否相同(S159)。若預測區塊0與預測區塊1的運動資訊相同(S159的Y)，則將區塊B當作隱性結合運動資訊候補(S160)。若預測區塊0與預測區塊1的運動資訊並非相同(S159的N)，則結束處理。If the predicted block size type is N×N and is predicted block 3 (Y of S156), it is checked whether the predicted block 0 and the predicted block 2 are identical (S157). If the predicted block size type is N×N and is not predicted block 3 (N of S156), the processing ends. If the motion information of the prediction block 0 and the prediction block 2 are the same (Y of S157), the block A is regarded as a recessive combined motion information candidate (S158). If the motion information of the prediction block 0 and the prediction block 2 are not the same (N of S157), it is checked whether the motion information of the prediction block 0 and the prediction block 1 are the same (S159). If the motion information of the prediction block 0 and the prediction block 1 are the same (Y of S159), the block B is regarded as a recessive combined motion information candidate (S160). If the motion information of the prediction block 0 and the prediction block 1 are not the same (N of S159), the processing ends.
如以上所述，若隱性結合運動資訊候補已被決定時則隱性結合運動資訊候補係為有效，若隱性結合運動資訊候補未被決定時則隱性結合運動資訊候補係為無效。As described above, if the implicit combined motion information candidate has been determined, the implicit combined motion information candidate system is effective, if implicitly combined with the motion informationWhen the compensation is not determined, the implicit combined motion information candidate system is invalid.
圖15係隱性結合運動資訊候補判定部166之判定處理的一例，只要能夠至少使用編碼區塊往預測區塊之分割數和預測區塊在編碼區塊內之位置之雙方或任一方來判定隱性結合運動資訊候補即可，並非限定於此。15 is an example of determination processing by the implicit combined motion information candidate determination unit 166, and can be determined using at least either or both of the number of divisions of the coding block to the prediction block and the position of the prediction block in the coding block. The implicit combination of motion information candidates is not limited to this.
例如，為了簡化預測區塊類型是N×N時的條件判定，亦可省略預測區塊0與預測區塊1的運動資訊同一性判定(步驟S159)或預測區塊0與預測區塊2(步驟S157)的運動資訊同一性判定，在預測區塊3上係可總是將區塊A與B視為隱性結合運動資訊候補。然後，亦可在預測區塊1上係總是將區塊A視為隱性結合運動資訊候補，在預測區塊2上係總是將區塊B視為隱性結合運動資訊候補。For example, in order to simplify the conditional decision when the prediction block type is N×N, the motion information identity determination of the prediction block 0 and the prediction block 1 may be omitted (step S159) or the prediction block 0 and the prediction block 2 ( The motion information identity determination of step S157), in the prediction block 3, always considers blocks A and B as implicit combined motion information candidates. Then, block A can always be regarded as a recessive combined motion information candidate in prediction block 1, and block B is always regarded as a recessive combined motion information candidate in prediction block 2.
又，作為簡化預測區塊類型是N×N時的條件判定的另一手法，亦可當預測區塊類型是N×N時，不進行隱性結合運動資訊候補的判定。這就變成，基於編碼區塊往預測區塊之分割數，來進行隱性結合運動資訊的追加控制。Further, as another method of simplifying the conditional determination when the prediction block type is N × N, when the prediction block type is N × N, the determination of the implicit combined motion information candidate may not be performed. This becomes an additional control of the implicit combined motion information based on the number of divisions of the coding block to the prediction block.
接著說明空間結合運動資訊候補生成部160的詳細動作。圖16係空間結合運動資訊候補生成部160之動作的說明用流程圖。空間結合運動資訊候補生成部160，係按照候補區塊群之空間候補區塊群中所含之候補區塊亦即區塊A、區塊B、區塊C、區塊E、區塊D之順序，重複進行以下處理(S110至S115)。Next, the detailed operation of the space combined motion information candidate generation unit 160 will be described. FIG. 16 is a flowchart for explaining the operation of the space combined motion information candidate generation unit 160. The spatial combined motion information candidate generating unit 160 is a candidate block included in the space candidate block group of the candidate block group, that is, block A, block B, block C, block E, and block D. Order, repeatThe following processing is performed (S110 to S115).
首先，檢查候補區塊是否有效(S111)。所謂候補區塊是有效，係為候補區塊的L0預測與L1預測之參照索引的至少一方是0以上。若候補區塊是有效(S111之Y)，則檢查隱性結合運動資訊候補是否有效(S112)。若候補區塊並非有效(S111的N)，則略過步驟S112至步驟S115而檢查下個候補區塊(S116)。若隱性結合運動資訊候補是有效(S112的Y)，則檢查候補區塊的運動資訊是否和隱性結合運動資訊候補的運動資訊相同(S113)。若隱性結合運動資訊候補並非有效(S112的N)，則將候補區塊之運動資訊當作空間結合運動資訊候補而追加至結合運動資訊候補清單中(S114)。若候補區塊的運動資訊和隱性結合運動資訊候補的運動資訊相同(S113的Y)，則略過步驟S114和步驟S115而檢查下個候補區塊(S116)。若候補區塊的運動資訊和隱性結合運動資訊候補的運動資訊並非相同(S113的N)，則將候補區塊之運動資訊當作空間結合運動資訊候補而追加至結合運動資訊候補清單中(S114)。接在步驟S114之後，檢查結合運動資訊候補清單中所被追加之空間結合運動資訊候補的數目是否為空間結合運動資訊候補最大數(S115)。此處，假設空間結合運動資訊候補最大數為4。若結合運動資訊候補清單中所被追加之空間結合運動資訊候補的數目不是空間結合運動資訊候補最大數(S115的N)，則檢查下個候補區塊(S115)。若結合運動資訊候補清單中所被追加之空間結合運動資訊候補的數目是空間結合運動資訊候補最大數(S115的Y)，則結束處理。First, it is checked whether the candidate block is valid (S111). The candidate block is valid, and at least one of the L0 prediction and the L1 prediction reference index of the candidate block is 0 or more. If the candidate block is valid (Y of S111), it is checked whether the implicit combined motion information candidate is valid (S112). If the candidate block is not valid (N of S111), the next candidate block is checked by skipping steps S112 to S115 (S116). If the implicit combined motion information candidate is valid (Y of S112), it is checked whether the motion information of the candidate block is the same as the motion information of the implicit combined motion information candidate (S113). If the implicit combined motion information candidate is not valid (N of S112), the motion information of the candidate block is added to the combined motion information candidate list as a spatial combined motion information candidate (S114). If the motion information of the candidate block and the motion information of the implicit combined motion information candidate are the same (Y of S113), the next candidate block is checked by skipping steps S114 and S115 (S116). If the motion information of the candidate block and the motion information of the implicit combined motion information candidate are not the same (N of S113), the motion information of the candidate block is added to the combined motion information candidate list as a spatial combined motion information candidate ( S114). After step S114, it is checked whether the number of spatial combined motion information candidates added to the combined motion information candidate list is the maximum number of spatial combined motion information candidates (S115). Here, it is assumed that the maximum number of spatial combined motion information candidates is four. If the number of spatial combined motion information candidates added to the combined motion information candidate list is not the maximum number of spatial combined motion information candidates (N of S115), the next candidate block is checked (S115). If added in conjunction with the sports information candidate listThe number of spatial combined motion information candidates is the maximum number of spatial combined motion information candidates (Y of S115), and the processing ends.
於空間結合運動資訊候補生成部160中藉由不將隱性結合運動資訊候補登錄至結合運動資訊候補清單，例如，若區塊A、區塊B、區塊C、區塊E、區塊D全部都是有效時，則可取代掉隱性結合運動資訊候補而改為將選擇機率比隱性結合運動資訊候補相對較高的區塊D的運動資訊，登錄至結合運動資訊候補清單，可提升編碼效率。The spatial combined motion information candidate generating unit 160 does not register the implicit combined motion information candidate to the combined motion information candidate list, for example, if the block A, the block B, the block C, the block E, and the block D When all are valid, the motion information of the block D having a relatively higher probability of selection than the implicitly combined motion information candidate can be replaced by the implicit combined motion information candidate, and can be added to the combined motion information candidate list to improve Coding efficiency.
此處，雖然是為了使得與處理對象區塊之接線較長的一般認為與處理對象區塊之相關性較高的區塊A與區塊B的運動資訊，能被優先登錄至結合運動資訊候補清單，而將處理的順序，設計成區塊A、區塊B、區塊C、區塊E、區塊D，但只要能夠以相關性較高之順序來把結合運動資訊候補登錄至結合運動資訊候補清單即可，並非限定於此。又，雖然將空間結合運動資訊候補最大數設成4，但空間結合運動資訊候補最大數係只要是1以上且為空間候補區塊群中所含之候補區塊數以下即可，並非限定於此。又，為了簡化空間結合運動資訊候補之導出，亦可省略步驟S112和步驟S113，若候補區塊為有效(S111的Y)，則可將候補區塊之運動資訊當作空間結合運動資訊候補而追加至結合運動資訊候補清單中(S114)。Here, although the motion information of the block A and the block B which are generally considered to have a high correlation with the processing target block, which is long in connection with the processing target block, can be preferentially registered to the combined motion information candidate. List, and the order of processing is designed into block A, block B, block C, block E, block D, but as long as the combined motion information candidate can be registered to the combined motion in a higher correlation order The information candidate list is optional and is not limited to this. In addition, the maximum number of spatial combined motion information candidates is set to four, but the maximum number of spatial combined motion information candidates is not less than 1 or more and is equal to or less than the number of candidate blocks included in the spatial candidate block group. this. Moreover, in order to simplify the derivation of the spatial combined motion information candidate, step S112 and step S113 may be omitted. If the candidate block is valid (Y of S111), the motion information of the candidate block may be regarded as a spatial combined motion information candidate. It is added to the combined exercise information candidate list (S114).
接著說明時間結合運動資訊候補生成部161的詳細動作。圖17係時間結合運動資訊候補生成部161之動作的說明用流程圖。針對L0預測與L1預測的各預測方向LX，重複進行以下處理(S120至S127)。此處，X係為0或1。又，候補區塊群的時間候補區塊群中所含之候補區塊亦即區塊H、區塊I之順序，重複進行以下處理(S121至S126)。Next, the detailed motion of the time combined motion information candidate generation unit 161 will be described.Work. FIG. 17 is a flowchart for explaining the operation of the time combined motion information candidate generation unit 161. The following processing is repeated for each prediction direction LX of the L0 prediction and the L1 prediction (S120 to S127). Here, the X system is 0 or 1. Further, in the order of the block H and the block I, the candidate blocks included in the time candidate block group of the candidate block group, the following processing is repeated (S121 to S126).
時間結合運動資訊候補生成部161，係檢查候補區塊的LN預測是否有效(S122)。此處，N係為0或1。此處N係和X相同。所謂候補區塊的LN預測是有效，係為候補區塊的LN預測之參照索引是0以上。若候補區塊的LN預測是有效(S122之Y)，則將候補區塊的LN預測之運動向量，當作基準運動向量(S123)。若候補區塊的LN預測並非有效(S122的N)，則略過步驟123至步驟126而檢查下個候補區塊(S126)。The time combined motion information candidate generation unit 161 checks whether or not the LN prediction of the candidate block is valid (S122). Here, the N system is 0 or 1. Here N is the same as X. The LN prediction of the candidate block is valid, and the reference index of the LN prediction of the candidate block is 0 or more. If the LN prediction of the candidate block is valid (Y of S122), the motion vector of the LN prediction of the candidate block is taken as the reference motion vector (S123). If the LN prediction of the candidate block is not valid (N of S122), the next candidate block is checked by skipping steps 123 to 126 (S126).
接在步驟S123之後，決定時間結合運動資訊候補的LX預測之參照影像(S124)。此處，時間結合運動資訊候補的LX預測之參照影像，係空間候補區塊群中所含之候補區塊的作為LX預測之參照影像被利用最多的參照影像。接著，將基準運動向量進行比例縮放使得處理對象影像與時間結合運動資訊候補的LX預測之參照影像的距離相符，而算出比例縮放向量，將該當比例縮放向量當作時間結合運動資訊候補的LX預測之運動向量(S125)，處理下個預測方向(S127)。此處，關於比例縮放向量的算出式，係和MPEG-4AVC中的時間直接運動補償預測的比例縮放向量的算出式相同。在針對L0預測與L1預測結束處理的步驟S127之後，檢查時間結合運動資訊候補的L0預測與L1預測之至少一方的預測是否有效(S128)。所謂時間結合運動資訊候補的LN預測是有效，係為時間結合運動資訊候補的LN預測之參照影像是已經決定的意思。若時間結合運動資訊候補的L0預測與L1預測之至少一方的預測是有效(S128的Y)，則決定時間結合運動資訊候補的畫面間預測類型，將該當時間結合運動資訊候補，追加至結合運動資訊候補清單(S129)。此處，畫面間預測類型的決定，係若只有L0預測有效，則將時間結合運動資訊候補的畫面間預測類型設成Pred_L0，若只有L1預測有效，則將時間結合運動資訊候補的畫面間預測類型設成Pred_L1，若L0預測與L1預測雙方都有效，則將時間結合運動資訊候補的畫面間預測類型設成Pred_BI。After the step S123, the LX predicted reference image of the motion information candidate is determined (S124). Here, the reference image of the LX prediction of the temporal combined motion information candidate is the reference video that is used most as the reference image of the LX prediction in the candidate block included in the spatial candidate block group. Then, the reference motion vector is scaled so that the processing target image matches the distance of the LX predicted reference image of the time combined with the motion information candidate, and the scaling vector is calculated, and the scaling vector is regarded as the LX prediction of the time combined motion information candidate. The motion vector (S125) processes the next prediction direction (S127). Here, the calculation formula of the scaling vector is compared with the time direct motion compensation prediction in MPEG-4 AVC.The calculation formula of the example scaling vector is the same. After step S127 for the L0 prediction and L1 prediction end processing, it is checked whether or not the prediction of at least one of the L0 prediction and the L1 prediction of the time combined motion information candidate is valid (S128). The LN prediction of the time-integrated motion information candidate is effective, and the reference image of the LN prediction in which the time is combined with the motion information candidate is determined. When the prediction of at least one of the L0 prediction and the L1 prediction of the time-integrated motion information candidate is valid (Y of S128), the inter-screen prediction type of the time-integrated motion information candidate is determined, and the time-integrated motion information candidate is added to the combined motion. Information candidate list (S129). Here, the determination of the inter-picture prediction type is such that if only the L0 prediction is valid, the inter-picture prediction type of the temporal combined motion information candidate is set to Pred_L0, and if only the L1 prediction is valid, the inter-picture prediction of the temporal combined motion information candidate is performed. The type is set to Pred_L1, and if both the L0 prediction and the L1 prediction are valid, the inter-picture prediction type of the time combined with the motion information candidate is set to Pred_BI.
此處，將結合運動資訊候補清單中所能登錄之時間結合運動資訊候補的最大數亦即時間結合運動資訊候補最大數，設成1。因此，圖17中雖然省略說明空間結合運動資訊候補生成部160之動作流程圖亦即相當於圖16所示之步驟S115的處理，但當時間結合運動資訊候補最大數為2以上時，係亦可在步驟S129之後追加相當於步驟S115之處理。Here, the maximum number of combined motion information candidates, that is, the maximum number of time combined motion information candidates, is set to 1 in combination with the time available for registration in the motion information candidate list. Therefore, although the flowchart corresponding to the operation of step S115 shown in FIG. 16 is omitted in FIG. 17, the operation of the spatial combined motion information candidate generating unit 160 is omitted. However, when the maximum number of time combined motion information candidates is 2 or more, The process corresponding to step S115 may be added after step S129.
此處，雖然令N係和X相同，但N亦可和X不同，並非限定於此。又，雖然假設時間結合運動資訊候補的LX預測之參照影像，係為空間候補區塊群中所含之候補區塊的作為LX預測之參照影像被利用最多的參照影像，但並非限定於此，亦可決定成參照索引0的參照影像等。又，雖然畫面間預測類型設成Pred_L0、Pred_L1、Pred_BI之任一者，但亦可僅為Pred_BI，並非限定於此。Here, although the N system and the X are the same, N may be different from X, and is not limited thereto. Also, although the time is combined with the motion information candidateThe reference image of the LX prediction is the reference image that is used as the reference image of the LX prediction in the candidate block included in the spatial candidate block group, but is not limited thereto, and may be determined as the reference image of the reference index 0. Wait. Further, although the inter-picture prediction type is set to any of Pred_L0, Pred_L1, and Pred_BI, it may be only Pred_BI, and is not limited thereto.
在實施形態1中，將空間候補區塊群設成5、將空間結合運動資訊候補最大數設成4、將時間結合運動資訊候補最大數設成1而取代掉隱性結合運動資訊候補改為將選擇機率相對高於隱性結合運動資訊候補的區塊D，登錄至結合運動資訊候補清單，但只要能取代掉隱性結合運動資訊候補改為將選擇機率相對高於隱性結合運動資訊候補的空間結合運動資訊候補或時間結合運動資訊候補予以登錄至結合運動資訊候補清單即可，不限定於該組合。例如，亦可為，將空間結合運動資訊候補最大數設成5、將時間結合運動資訊候補最大數設成1，隱性結合運動資訊候補並非有效時，係將空間結合運動資訊候補的5個優先追加至結合運動資訊候補清單，若隱性結合運動資訊候補為有效時，則將選擇機率相對高於隱性結合運動資訊候補的時間結合運動資訊候補，追加至結合運動資訊候補清單。In the first embodiment, the space candidate block group is set to 5, the space combined motion information candidate maximum number is set to 4, and the time combined motion information candidate maximum number is set to 1 instead of the recessive combined motion information candidate. The selected block D with the probability of being relatively higher than the implicit combined motion information candidate is registered to the combined motion information candidate list, but as long as the recessive combined motion information candidate can be replaced, the selection probability is relatively higher than the implicit combined motion information candidate. The space is combined with the motion information candidate or the time combined with the motion information candidate to be registered in the combined motion information candidate list, and is not limited to the combination. For example, the maximum number of spatial combined motion information candidates may be set to 5, the maximum number of time combined motion information candidates may be set to 1, and when the implicit combined motion information candidates are not valid, the space is combined with five motion information candidate candidates. If it is added to the combined motion information candidate list, if the implicit combined motion information candidate is valid, the time is selected to be combined with the time of the implicit combined motion information candidate in combination with the motion information candidate, and added to the combined motion information candidate list.
接著說明隱性結合運動資訊候補追加部163的詳細動作。圖18係隱性結合運動資訊候補追加部163之動作的說明用流程圖。首先，檢查隱性結合運動資訊候補是否為有效(S140)。若隱性結合運動資訊候補是有效(S140的Y)，則將隱性結合運動資訊候補的運動資訊，追加至結合運動資訊候補清單的最末尾(S141)。若隱性結合運動資訊候補並非有效(S140的N)，則結束處理。這裡雖然是若隱性結合運動資訊候補是有效則將隱性結合運動資訊候補的運動資訊追加至結合運動資訊候補清單的最末尾，但為了從結合運動資訊候補清單內排除冗長的結合運動資訊候補之存在，亦可設計成，若隱性結合運動資訊候補為有效且結合運動資訊候補清單中沒有與隱性結合運動資訊候補的運動資訊相同的運動資訊時，則追加至結合運動資訊候補清單的最末尾。此情況下，從結合運動資訊候補清單內排除冗長的結合運動資訊候補之存在，取而代之是將第1補充結合運動資訊候補或第2補充結合運動資訊候補追加至結合運動資訊候補清單，藉此就可提升合併模式的選擇率而提升編碼效率。Next, the detailed operation of the recessive combined motion information candidate adding unit 163 will be described. FIG. 18 is a flowchart for explaining the operation of the implicit combined motion information candidate adding unit 163. First, check if the implicit combined motion information candidate isValid (S140). If the implicit combined motion information candidate is valid (Y of S140), the motion information of the implicit combined motion information candidate is added to the end of the combined motion information candidate list (S141). If the implicit combined motion information candidate is not valid (N of S140), the processing ends. Here, although the implicit combined motion information candidate is valid, the motion information of the implicit combined motion information candidate is added to the end of the combined motion information candidate list, but in order to exclude the lengthy combined motion information candidate from the combined motion information candidate list The existence may also be designed to be added to the combined motion information candidate list if the implicit combined motion information candidate is valid and combined with the motion information of the motion information candidate list that is not identical to the motion information of the implicit combined motion information candidate. At the end. In this case, the existence of the redundant combined motion information candidate is excluded from the combined motion information candidate list, and the first supplementary combined motion information candidate or the second supplementary combined sports information candidate is added to the combined exercise information candidate list, thereby It can improve the selection rate of the merge mode and improve the coding efficiency.
一般而言，候補區塊A或候補區塊B，係相較於其他區塊是選擇率相對較高的結合運動資訊候補，因此被分配了編碼長度較短的合併索引。可是，如上記，候補區塊A或候補區塊B是該當於隱性結合運動資訊候補之條件時，由於被結合成比候補區塊A或候補區塊B還大的預測區塊，編碼效率較為良好，因此被選擇來作為結合運動資訊候補的可能性較低。因此，於空間結合運動資訊候補生成部160中，先把與隱性結合運動資訊候補相同的運動資訊，從結合運動資訊候補清單中予以排除，於隱性結合運動資訊候補追加部163中，令隱性結合運動資訊候補移動至結合運動資訊候補清單的最末尾，對隱性結合運動資訊候補分配編碼長度較長的合併索引，對選擇率相對變高之隱性結合運動資訊候補以外的候補區塊，分配編碼長度較短的合併索引，藉此就可提升編碼效率。隱性結合運動資訊候補判定部166，係為了簡化預測區塊類型是N×N時的條件判定，而省略預測區塊0與預測區塊1的運動資訊同一性判定(步驟S159)或預測區塊0與預測區塊2(步驟S157)的運動資訊同一性判定，在預測區塊3上係總是將區塊A與B視為隱性結合運動資訊候補的此種情況下，則亦可將圖18之動作，針對區塊A與區塊B這2個隱性結合運動資訊候補，重複處理。In general, the candidate block A or the candidate block B is a combined motion information candidate having a relatively high selection rate compared to other blocks, and thus is assigned a merged index having a shorter coding length. However, as described above, the candidate block A or the candidate block B is a prediction block which is larger than the candidate block A or the candidate block B when the condition is implicitly combined with the motion information candidate, and the coding efficiency is high. It is better, so it is less likely to be selected as a candidate for combining sports information. Therefore, in the spatial combined motion information candidate generating unit 160, the same motion information as the implicit combined motion information candidate is first excluded from the combined motion information candidate list, and is implicitly combined.In the motion information candidate adding unit 163, the implicit combined motion information candidate is moved to the end of the combined motion information candidate list, and the combined index having a long encoding length is assigned to the implicit combined motion information candidate, and the selection rate is relatively high. The candidate block other than the motion information candidate is allocated a combined index with a shorter coding length, thereby improving coding efficiency. The implicit combined motion information candidate determination unit 166 omits the motion information identity determination of the prediction block 0 and the prediction block 1 (step S159) or the prediction area in order to simplify the conditional determination when the prediction block type is N×N. The motion information identity determination between the block 0 and the prediction block 2 (step S157), and in the case where the prediction block 3 always considers the blocks A and B as implicitly combined motion information candidates, The operation of FIG. 18 is repeated for the two implicit combined motion information candidates of the block A and the block B.
接著說明第1結合運動資訊候補補充部164的詳細動作。圖19係第1結合運動資訊候補補充部164之動作的說明用流程圖。首先，根據隱性結合運動資訊候補追加部163所供給之結合運動資訊候補清單中所被登錄的結合運動資訊候補之數目(NumCandList)與合併候補最大數(MaxNumMergeCand)，將生成第1補充結合運動資訊候補的最大數MaxNumGenCand，由式1予以算出(S170)。Next, the detailed operation of the first combined motion information candidate supplementing unit 164 will be described. FIG. 19 is a flowchart for explaining the operation of the first combined motion information candidate supplementing unit 164. First, the first supplementary combined motion is generated based on the number of combined motion information candidates (NumCandList) and the maximum number of combined candidates (MaxNumMergeCand) registered in the combined motion information candidate list supplied from the implicit combined motion information candidate adding unit 163. The maximum number of information candidates, MaxNumGenCand, is calculated by Equation 1 (S170).
MaxNumGenCand=MaxNumMergeCand-NumCandList；(NumCandList>0)MaxNumGenCand=0；(NumCandList==0) 式1MaxNumGenCand=MaxNumMergeCand-NumCandList;(NumCandList>0)MaxNumGenCand=0;(NumCandList==0) Equation 1
接著，檢查MaxNumGenCand是否大於0(S171)。若MaxNumGenCand並非大於0(S171的N)，則結束處理。若MaxNumGenCand大於0(S171的Y)，則進行以下處理。首先，決定組合檢查次數loopTimes。loopTimes係設定成NumCandList×NumCandList。但是，loopTimes超過8時則loopTimes係限制成8(S172)。此處，loopTimes係為0至7的整數。重複進行以下的處理loopTimes次(S172至S180)。決定結合運動資訊候補M與結合運動資訊候補N之組合(S173)。此處，說明組合檢查次數和結合運動資訊候補M與結合運動資訊候補N之關係。圖20係用來說明組合檢查次數和結合運動資訊候補M與結合運動資訊候補N之關係的圖。如圖20所示，M與N係不同值，M與N的合計值是被設定成由小而大之順序。檢查是否為結合運動資訊候補M的L0預測為有效且結合運動資訊候補N的L1預測為有效(S174)。若結合運動資訊候補M的L0預測為有效且結合運動資訊候補N的L1預測為有效(S174的Y)，則檢查結合運動資訊候補M的L0預測之參照影像和運動向量，是否和結合運動資訊候補N的L1預測之參照影像和運動向量不同(S175)。若並非結合運動資訊候補M的L0預測為有效且結合運動資訊候補N的L1預測為有效(S174的N)，則處理下個組合。若結合運動資訊候補M的L0預測之參照影像與結合運動資訊候補N的L1預測之參照影像不同(S175的Y)，則將結合運動資訊候補M的L0預測之運動向量與參照影像與結合運動資訊候補N的L1預測之運動向量與參照影像進行組合，生成畫面間預測類型為Pred_BI的雙結合運動資訊候補(S176)。此處，作為第1補充結合運動資訊候補，將某結合運動資訊候補的L0預測與和其不同之結合運動資訊候補的L1預測之運動資訊加以組合而生成雙結合運動資訊。若結合運動資訊候補M的L0預測之參照影像與結合運動資訊候補N的L1預測之參照影像相同(S175的N)，則處理下個組合。接在步驟S176之後，檢查雙結合運動資訊候補是否存在於結合運動資訊候補清單中(S177)。若雙結合運動資訊候補不存在於結合運動資訊候補清單中(S177的Y)，則將雙結合運動資訊候補追加至結合運動資訊候補清單(S178)。若雙結合運動資訊候補存在於結合運動資訊候補清單中(S177的N)，則略過步驟S178。皆在步驟S177或步驟S178之後，檢查已生成之雙結合運動資訊的數目是否為MaxNumGenCand(S179)。若已被生成之雙結合運動資訊的數目是MaxNumGenCand(S179的Y)，則結束處理。若已被生成之雙結合運動資訊的數目不是MaxNumGenCand(S179的N)，則處理下個組合。Next, it is checked whether MaxNumGenCand is greater than 0 (S171).If MaxNumGenCand is not greater than 0 (N of S171), the process ends. If MaxNumGenCand is greater than 0 (Y of S171), the following processing is performed. First, decide the number of combined check loopTimes. The loopTimes is set to NumCandList×NumCandList. However, when loopTimes exceeds 8, the loopTimes is limited to 8 (S172). Here, loopTimes is an integer from 0 to 7. The following processing loopTimes is repeated (S172 to S180). A combination of the motion information candidate M and the combined motion information candidate N is determined (S173). Here, the relationship between the number of combined inspections and the combined motion information candidate M and the combined motion information candidate N will be described. Fig. 20 is a view for explaining the relationship between the number of combined inspections and the combined motion information candidate M and the combined motion information candidate N. As shown in FIG. 20, M and N are different values, and the total value of M and N is set to be small and large. It is checked whether or not the L0 prediction combined with the motion information candidate M is valid and the L1 prediction combined with the motion information candidate N is valid (S174). If the L0 prediction combined with the motion information candidate M is valid and the L1 prediction combined with the motion information candidate N is valid (Y of S174), check whether the reference image and the motion vector of the L0 prediction combined with the motion information candidate M are combined with the motion information. The reference image of the L1 prediction of the candidate N is different from the motion vector (S175). If the L0 prediction that is not combined with the motion information candidate M is valid and the L1 prediction combined with the motion information candidate N is valid (N of S174), the next combination is processed. If the reference image of the L0 prediction combined with the motion information candidate M is different from the reference image of the L1 prediction combined with the motion information candidate N (Y of S175), the motion vector of the L0 prediction combined with the motion information candidate M and the reference image and the combined motion are combined. Information candidate NThe motion vector of the L1 prediction is combined with the reference image to generate a double combined motion information candidate of the inter prediction type Pred_BI (S176). Here, as the first supplementary combined motion information candidate, the L0 prediction of the combined motion information candidate and the L1 predicted motion information of the combined motion information candidate are combined to generate the double combined motion information. If the reference image of the L0 prediction combined with the motion information candidate M is the same as the reference image of the L1 prediction combined with the motion information candidate N (N of S175), the next combination is processed. After step S176, it is checked whether the double combined motion information candidate exists in the combined motion information candidate list (S177). If the double combined motion information candidate does not exist in the combined motion information candidate list (Y of S177), the double combined motion information candidate is added to the combined motion information candidate list (S178). If the double combined motion information candidate exists in the combined motion information candidate list (N of S177), step S178 is skipped. After step S177 or step S178, it is checked whether the number of generated double combined motion information is MaxNumGenCand (S179). If the number of double combined motion information that has been generated is MaxNumGenCand (Y of S179), the processing ends. If the number of double combined motion information that has been generated is not MaxNumGenCand (N of S179), the next combination is processed.
此處，雖然是將第1補充結合運動資訊候補設計成，將已被登錄至結合運動資訊候補清單中的某一結合運動資訊候補的L0預測之運動向量與參照影像，與另一結合運動資訊候補的L1預測之運動向量與參照影像進行組合，成為運動補償預測之方向為雙向的雙結合運動資訊候補，但並非限定於此。例如，亦可為對已被登錄至結合運動資訊候補清單中的某一結合運動資訊候補的L0預測之運動向量與L1預測之運動向量加上+1等偏置值而成的運動補償預測之方向為雙向的結合運動資訊候補、對已被登錄至結合運動資訊候補清單中的某一結合運動資訊候補的L0預測之運動向量或L1預測之運動向量加上+1等偏置值而成的運動補償預測之方向為單向的結合運動資訊候補。作為第1補充結合運動資訊候補的另一例，亦可將已被登錄至結合運動資訊候補清單中的某一結合運動資訊候補的L0預測之運動向量當作基準而將L1預測之運動向量進行比例縮放而求出，將其予以組合以生成運動補償預測之方向為雙向的新的結合運動資訊候補。又，亦可將它們做任意組合。Here, the first supplementary combined motion information candidate is designed such that the L0 predicted motion vector and the reference image that have been registered to one of the combined motion information candidates in the combined motion information candidate list are combined with the other reference motion information. The motion vector of the candidate L1 prediction is combined with the reference image, and the motion compensation prediction direction is a bidirectional combined motion information candidate, but is not limited thereto. For example, it can also be that the pair has been logged into the combined sports capital.In the candidate list, the motion vector of the L0 prediction combined with the motion information of the L1 prediction and the motion vector of the L1 prediction plus the offset value of +1 are the bidirectional combined motion information candidates, and the pair has been The direction of the motion compensation prediction in which the motion vector of the L0 prediction combined with the motion vector of the L1 prediction combined with the motion vector of the L1 prediction plus the offset value of +1 is combined with the motion information of the motion information candidate list is a one-way combined motion information. Alternate. As another example of the first supplementary combined motion information candidate, the motion vector of the L0 prediction that has been registered to the combined motion information candidate in the combined motion information candidate list may be used as a reference to scale the motion vector of the L1 prediction. It is obtained by scaling, and is combined to generate a new combined motion information candidate in which the direction of motion compensation prediction is bidirectional. Also, they can be combined in any combination.
此處，第1補充結合運動資訊候補，係當已被登錄在結合運動資訊候補清單中的結合運動資訊候補的運動資訊和處理對象的運動資訊候補之運動有微妙的偏差時，將已被登錄在結合運動資訊候補清單中的結合運動資訊候補的運動資訊予以修正而生成有效的結合運動資訊候補，藉此就可提高編碼效率。Here, the first supplementary combined motion information candidate is registered when the motion information of the combined motion information candidate registered in the combined motion information candidate list and the motion information candidate motion of the processing target are subtly deviated. The motion information combined with the motion information candidate in the motion information candidate list is corrected to generate an effective combined motion information candidate, thereby improving coding efficiency.
如以上所述，即使被選擇來作為結合運動資訊候補之可能性較低的隱性結合運動資訊候補的運動資訊，仍有L0預測或L1預測之任一方是與處理對象區塊之運動資訊相同的情況，或處理對象區塊之運動資訊是與隱性結合運動資訊候補之運動資訊有微小偏差的可能性。因此，不要刪除隱性結合運動資訊候補的運動資訊，而是令隱性結合運動資訊候補的運動資訊與其他結合運動資訊候補之運動資訊做組合，或修正隱性結合運動資訊候補的運動資訊等等，以生成選擇率比隱性結合運動資訊候補相對較高的第1補充結合運動資訊候補，藉此就可提高編碼效率。尤其是，在利用雙結合運動資訊候補時係至少需要2個結合運動資訊候補，因此當隱性結合運動資訊候補以外的結合運動資訊候補是在結合運動資訊候補清單中僅被登錄1個的情況下，則不要刪除隱性結合運動資訊候補的運動資訊，而是令隱性結合運動資訊候補的運動資訊與其他結合運動資訊候補之運動資訊做組合，藉此就可提高編碼效率。As described above, even if the motion information selected as the implicit combined motion information candidate having a low probability of combining the motion information candidates is selected, either the L0 prediction or the L1 prediction is the same as the motion information of the processing target block. The situation, or the motion information of the processing target block, may be slightly different from the motion information of the implicit combined motion information candidate. Therefore, do not delete the sports information of the implicit combined motion information candidate, but let the implicit combinationThe sports information candidate sports information is combined with other sports information candidate sports information, or the motion information of the implicit combined motion information candidate is corrected, so as to generate the first supplement whose selection rate is relatively higher than the implicit combined motion information candidate. Combined with the motion information candidate, the coding efficiency can be improved. In particular, when the double combined motion information candidate is used, at least two combined motion information candidates are required. Therefore, the combined motion information candidate other than the recessive combined motion information candidate is only registered in the combined motion information candidate list. In the next case, the motion information of the implicit combined motion information candidate is not deleted, but the motion information of the implicit combined motion information candidate is combined with other motion information combined with the motion information candidate, thereby improving the coding efficiency.
接著說明第2結合運動資訊候補補充部165的詳細動作。圖21係第2結合運動資訊候補補充部165之動作的說明用流程圖。首先，根據第1結合運動資訊候補補充部164所供給之結合運動資訊候補清單中所被登錄的結合運動資訊候補之數目(NumCandList)與合併候補最大數(MaxNumMergeCand)，將生成第2補充結合運動資訊候補的最大數MaxNumGenCand，由式2予以算出(S190)。Next, the detailed operation of the second combined motion information candidate complementing unit 165 will be described. FIG. 21 is a flowchart for explaining the operation of the second combined motion information candidate complementing unit 165. First, based on the number of combined motion information candidates (NumCandList) and the maximum number of merge candidates (MaxNumMergeCand) registered in the combined motion information candidate list supplied from the first combined motion information candidate supplementing unit 164, a second supplementary combined motion is generated. The maximum number of information candidates, MaxNumGenCand, is calculated by Equation 2 (S190).
MaxNumGenCand=MaxNumMergeCand-NumCandList；(NumCandList>0)MaxNumGenCand=2；(NumCandList==0) 式2MaxNumGenCand=MaxNumMergeCand-NumCandList;(NumCandList>0)MaxNumGenCand=2;(NumCandList==0) Equation 2
接著，將以下的處理，針對i重複進行MaxNumGenCand次(S191至S195)。此處，i係為0至MaxNumGenCand-1的整數。生成L0預測之運動向量為(0,0)、參照索引為i，且L1預測之運動向量為(0,0)、參照索引為i的畫面間預測類型為Pred_BI的第2補充結合運動資訊候補(S192)。檢查第2補充結合運動資訊候補是否存在於結合運動資訊候補清單中(S193)。若第2補充結合運動資訊候補不存在於結合運動資訊候補清單中(S193的Y)，則將第2補充結合運動資訊候補追加至結合運動資訊候補清單(S194)。若第2補充結合運動資訊候補存在於結合運動資訊候補清單中(S193的N)，則針對下個i進行處理(S195)。Next, the following processing is repeated for MaxNumGenCand times (S191 to S195). Here, i is an integer of 0 to MaxNumGenCand-1. The motion vector for generating the L0 prediction is (0, 0), the reference indexIt is i, and the motion vector predicted by L1 is (0, 0), and the inter-picture prediction type whose reference index is i is Pred_BI is the second supplementary combined motion information candidate (S192). It is checked whether the second supplementary combined motion information candidate exists in the combined motion information candidate list (S193). When the second supplementary combined motion information candidate does not exist in the combined exercise information candidate list (Y in S193), the second supplementary combined exercise information candidate is added to the combined exercise information candidate list (S194). When the second supplementary combined motion information candidate exists in the combined motion information candidate list (N in S193), processing is performed for the next i (S195).
此處，將第2補充結合運動資訊候補設成，L0預測之運動向量為(0,0)、參照索引為i，且L1預測之運動向量為(0,0)、參照索引為i的畫面間預測類型為Pred_BI的結合運動資訊候補。這是因為，在一般的動態影像中，L0預測之運動向量與L1預測之運動向量為(0,0)的結合運動資訊候補的發生頻率在統計上較高的緣故。不依存於已被登錄在結合運動資訊候補清單中的結合運動資訊候補的運動資訊，只要是統計上利用頻率較高的結合運動資訊候補即可，並非限定於此。例如，L0預測或L1預測之運動向量係亦可分別是(0,0)以外的向量值，亦可設定成L0預測與L1預測的參照索引不同。又，亦可將第2補充結合運動資訊候補，當成已編碼之影像或已編碼之影像之一部分的發生頻率較高的運動資訊，編碼在編碼串流中加以傳輸而設定。Here, the second supplementary combined motion information candidate is set such that the motion vector of the L0 prediction is (0, 0), the reference index is i, and the motion vector of the L1 prediction is (0, 0), and the reference index is i. The combined prediction type is Pred_BI combined motion information candidate. This is because, in a general motion picture, the frequency of occurrence of the combined motion information candidate of the L0 predicted motion vector and the L1 predicted motion vector of (0, 0) is statistically higher. The motion information that does not depend on the combined motion information candidate that has been registered in the combined motion information candidate list is not limited thereto as long as it is a combined motion information candidate having a high statistical frequency. For example, the motion vector system of the L0 prediction or the L1 prediction may also be a vector value other than (0, 0), or may be set such that the L0 prediction is different from the reference index of the L1 prediction. In addition, the second supplementary combined motion information candidate may be used as the encoded information or the motion information having a higher frequency of occurrence of one of the encoded images, and the encoded information is transmitted and transmitted in the encoded stream.
此處，藉由設定不依存於被當成第2補充結合運動資訊候補而登錄在結合運動資訊候補清單中之結合運動資訊候補的結合運動資訊候補，當已被登錄在結合運動資訊候補清單中的結合運動資訊候補為0個時，就可利用合併模式，可提升編碼效率。又，當已被登錄在結合運動資訊候補清單中的結合運動資訊候補的運動資訊和處理對象的運動資訊候補之運動有所不同的情況下，對結合運動資訊候補清單追加統計上利用頻率較高之新的結合運動資訊候補來擴展選擇幅度，藉此就可提升編碼效率。Here, by setting the non-dependency to be regarded as the second supplementary combined sports capitalWhen the combined motion information candidate combined with the motion information candidate in the motion information candidate list is registered, if the combined motion information candidate registered in the combined motion information candidate list is 0, the merge mode can be utilized. Improve coding efficiency. Further, when the motion information of the combined motion information candidate registered in the combined motion information candidate list and the motion information candidate motion of the processing target are different, the combined use of the combined motion information candidate list is relatively high. The new combination of motion information candidates to expand the selection range, thereby improving coding efficiency.
接著，說明實施形態1的動態影像解碼裝置。圖22係實施形態1所述之動態影像解碼裝置200之構成的圖示。動態影像解碼裝置200，係為將動態影像編碼裝置100所編碼之編碼列予以解碼以生成再生影像的裝置。Next, a motion picture decoding device according to the first embodiment will be described. Fig. 22 is a diagram showing the configuration of a video decoding device 200 according to the first embodiment. The motion picture decoding device 200 is a device that decodes a code sequence encoded by the motion picture coding device 100 to generate a reproduced picture.
動態影像解碼裝置200，係由具備CPU(Central Processing Unit)、畫格記憶體、硬碟等的資訊處理裝置等硬體所實現。動態影像解碼裝置200，係藉由上記的構成要素的作動，而實現以下說明的機能性構成要素。編碼區塊的分割、預測區塊尺寸類型的決定、預測區塊尺寸與預測區塊在編碼區塊內之位置(預測區塊的位置資訊)的決定、預測編碼模式是否為畫面內的決定，係由未圖示的上位之控制部所決定，此處係係針對預測編碼模式不是畫面內的情形加以說明。此外，關於解碼對象之預測區塊的位置資訊、預測區塊尺寸，係在動態影像解碼裝置200內被共用，而未圖示。The motion picture decoding device 200 is realized by a hardware such as an information processing device including a CPU (Central Processing Unit), a frame memory, and a hard disk. The motion picture decoding device 200 realizes the functional components described below by the operation of the above-described constituent elements. The division of the coding block, the determination of the prediction block size type, the prediction of the block size, the determination of the position of the prediction block in the coding block (the position information of the prediction block), and whether the prediction coding mode is a decision within the picture, This is determined by a higher-level control unit (not shown). Here, the case where the prediction encoding mode is not in the screen will be described. Further, the position information and the prediction block size of the prediction block of the decoding target are within the motion picture decoding device 200.It is shared and not shown.
實施形態1的動態影像解碼裝置200係具備：編碼列解析部201、預測誤差解碼部202、加算部203、運動資訊再生部204、運動補償部205、畫格記憶體206及運動資訊記憶體207。The motion picture decoding device 200 according to the first embodiment includes a code line analysis unit 201, a prediction error decoding unit 202, an addition unit 203, a motion information reproduction unit 204, a motion compensation unit 205, a frame memory 206, and a motion information memory 207. .
以下，說明各部的機能與動作。編碼列解析部201，係將端子30所供給之編碼列予以解析而將預測誤差編碼資料、合併旗標、合併索引、運動補償預測之預測方向(畫面間預測類型)、參照索引、差分向量、及預測向量索引，依照語法而進行熵解碼。熵解碼係藉由包含算術編碼或霍夫曼編碼等之可變長度編碼的方法來實施。然後，將該當預測誤差編碼資料供給至預測誤差解碼部202，將該當合併旗標、該當合併索引、該當畫面間預測類型、該當參照索引、該當差分向量、及該當預測向量索引，供給至運動資訊再生部204。Hereinafter, the functions and operations of the respective units will be described. The coded column analysis unit 201 analyzes the coded column supplied from the terminal 30, and predicts the error coded data, the merged flag, the merged index, and the motion compensation prediction (inter-picture prediction type), the reference index, and the difference vector. And predictive vector index, entropy decoding according to the syntax. Entropy decoding is implemented by a method including variable length coding such as arithmetic coding or Huffman coding. Then, the prediction error coded data is supplied to the prediction error decoding unit 202, and the integration flag, the merging index, the inter-picture prediction type, the reference reference index, the difference vector, and the prediction vector index are supplied to the motion information. Reproduction unit 204.
運動資訊再生部204，係根據編碼列解析部201所供給之合併旗標、合併索引、畫面間預測類型、參照索引、差分向量、及預測向量索引，和運動資訊記憶體207所供給之候補區塊群，而再生出運動資訊，將該當運動資訊供給至運動補償部205及運動資訊記憶體207。運動資訊再生部204之詳細構成，將於後述。The motion information reproducing unit 204 is based on the merge flag, the merge index, the inter-picture prediction type, the reference index, the difference vector, and the prediction vector index supplied from the code column analyzing unit 201, and the candidate region supplied from the motion information memory 207. The block group reproduces the motion information, and supplies the motion information to the motion compensation unit 205 and the motion information memory 207. The detailed configuration of the motion information reproducing unit 204 will be described later.
運動補償部205，係基於運動資訊再生部204所供給之運動資訊，將畫格記憶體206內的參照索引所示的參照影像，基於運動向量進行運動補償，以生成預測訊號。若預測方向為雙預測，則將L0預測與L1預測之預測訊號進行平均後的訊號加以生成來作為預測訊號，將該當預測訊號供給至加算部203。The motion compensation unit 205 is supplied based on the motion information reproducing unit 204.The motion information is used to perform motion compensation based on the motion vector of the reference image indicated by the reference index in the frame memory 206 to generate a prediction signal. When the prediction direction is bi-predicted, the signal obtained by averaging the L0 prediction and the prediction signal of the L1 prediction is generated as a prediction signal, and the prediction signal is supplied to the addition unit 203.
預測誤差解碼部202，係對於編碼列解析部201所供給之預測誤差編碼資料，進行逆量化或逆正交轉換等之處理以生成預測誤差訊號，將該當預測誤差訊號供給至加算部203。The prediction error decoding unit 202 performs processing such as inverse quantization or inverse orthogonal conversion on the prediction error coded data supplied from the code column analysis unit 201 to generate a prediction error signal, and supplies the prediction error signal to the addition unit 203.
加算部203，係將預測誤差解碼部202所供給之預測誤差訊號、和運動補償部205所供給之預測訊號，進行加算，以生成解碼影像訊號，將該當解碼影像訊號供給至畫格記憶體206及端子31。The adding unit 203 adds the prediction error signal supplied from the prediction error decoding unit 202 and the prediction signal supplied from the motion compensation unit 205 to generate a decoded video signal, and supplies the decoded video signal to the frame memory 206. And terminal 31.
畫格記憶體206及運動資訊記憶體207，係具有和動態影像編碼裝置100的畫格記憶體110及運動資訊記憶體111相同之機能。畫格記憶體206係將加算部203所供給之解碼影像訊號，加以記憶。運動資訊記憶體207，係將運動資訊再生部204所供給之運動資訊，以最小預測區塊尺寸單位，加以記憶。The frame memory 206 and the motion information memory 207 have the same functions as the frame memory 110 and the motion information memory 111 of the motion picture coding apparatus 100. The frame memory 206 stores the decoded video signal supplied from the adding unit 203. The motion information memory 207 stores the motion information supplied from the motion information reproducing unit 204 in units of minimum prediction block sizes.
接著說明運動資訊再生部204的詳細構成。圖23係圖示運動資訊再生部204之構成。運動資訊再生部204係含有：編碼模式判定部210、運動向量再生部211及結合運動資訊再生部212。端子32係連接至編碼列解析部201，端子33係連接至運動資訊記憶體207，端子34係連接至運動補償部205，端子36係連接至運動資訊記憶體207。Next, the detailed configuration of the motion information reproducing unit 204 will be described. FIG. 23 is a diagram showing the configuration of the motion information reproducing unit 204. The motion information reproducing unit 204 includes an encoding mode determining unit 210, a motion vector reproducing unit 211, and a combination thereof.Motion information reproduction unit 212. The terminal 32 is connected to the code column analysis unit 201, the terminal 33 is connected to the motion information memory 207, the terminal 34 is connected to the motion compensation unit 205, and the terminal 36 is connected to the motion information memory 207.
以下，說明各部的機能與動作。編碼模式判定部210，係判定編碼列解析部201所供給之合併旗標係為「0」還是「1」。若合併旗標為「0」，則將編碼列解析部201所供給之畫面間預測類型、參照索引、差分向量、及預測向量索引，供給至運動向量再生部211。若合併旗標為「1」，則將編碼列解析部201所供給之合併索引，供給至結合運動資訊再生部212。Hereinafter, the functions and operations of the respective units will be described. The coding mode determination unit 210 determines whether the merge flag system supplied from the code column analysis unit 201 is "0" or "1". When the merge flag is "0", the inter-picture prediction type, the reference index, the difference vector, and the prediction vector index supplied from the code column analysis unit 201 are supplied to the motion vector reproduction unit 211. When the merge flag is "1", the merge index supplied from the code column analysis unit 201 is supplied to the combined motion information reproducing unit 212.
運動向量再生部211，係根據編碼模式判定部210所供給之畫面間預測類型、參照索引、差分向量、及預測向量索引，和端子33所供給之候補區塊群，再生出運動向量而生成運動資訊，供給至端子34及端子36。The motion vector reproduction unit 211 generates motion by reproducing a motion vector based on the inter prediction type, the reference index, the difference vector, and the prediction vector index supplied from the coding mode determination unit 210, and the candidate block group supplied from the terminal 33. Information is supplied to terminal 34 and terminal 36.
結合運動資訊再生部212，係根據編碼模式判定部210所供給之合併索引、端子33所供給之候補區塊群，再生出運動資訊並供給至端子34及端子36。The combined motion information reproducing unit 212 reproduces motion information based on the merge index supplied from the encoding mode determining unit 210 and the candidate block group supplied from the terminal 33, and supplies the motion information to the terminal 34 and the terminal 36.
接著說明結合運動資訊再生部212的詳細構成。圖24係圖示結合運動資訊再生部212之構成。結合運動資訊再生部212，係含有結合運動資訊候補清單生成部230及結合運動資訊選擇部231。端子35係連接至編碼模式判定部210。Next, the detailed configuration of the combined motion information reproducing unit 212 will be described. FIG. 24 is a diagram showing the configuration of the combined motion information reproducing unit 212. Combine sports informationThe birth unit 212 includes a combined motion information candidate list generating unit 230 and a combined motion information selecting unit 231. The terminal 35 is connected to the encoding mode determination unit 210.
以下，說明各部的機能與動作。結合運動資訊候補清單生成部230係具有和動態影像編碼裝置100之結合運動資訊候補清單生成部140相同的機能，藉由和動態影像編碼裝置100的結合運動資訊候補清單生成部140相同的動作而生成結合運動資訊候補清單，將該當結合運動資訊候補清單，供給至結合運動資訊選擇部231。Hereinafter, the functions and operations of the respective units will be described. The combined motion information candidate list generating unit 230 has the same function as the combined motion information candidate list generating unit 140 of the video encoding device 100, and is operated in the same manner as the combined motion information candidate list generating unit 140 of the video encoding device 100. The combined motion information candidate list is generated, and the combined motion information candidate list is supplied to the combined motion information selection unit 231.
結合運動資訊選擇部231，係從結合運動資訊候補清單生成部230所供給之結合運動資訊候補清單之中，選擇出端子35所供給之合併索引所表示的結合運動資訊候補而決定結合運動資訊，將該當結合運動資訊的運動資訊，供給至端子34及端子36。The combined motion information selection unit 231 determines the combined motion information from the combined motion information candidate indicated by the merge index supplied from the terminal 35 from the combined motion information candidate list supplied from the combined motion information candidate list generating unit 230. The motion information combined with the motion information is supplied to the terminal 34 and the terminal 36.
說明本發明的實施形態1的動態影像編碼裝置及動態影像解碼裝置所致之效果。圖25係本發明的實施形態1所致之效果之一例的說明圖。圖25係表示候補區塊A為隱性結合運動資訊候補時，隱性結合運動資訊候補往結合運動資訊候補清單之後方追加所致之效果。此處，假設在結合運動資訊候補清單中係被登錄有：候補區塊A、候補區塊B、候補區塊C、候補區塊E、候補區塊T。假設合併索引0(候補區塊A)、合併索引1(候補區塊B)、合併索引2(候補區塊C)、合併索引3(候補區塊E)、合併索引4(候補區塊T)的選擇機率分別為2%、60%、14%、12%、12%。嚴謹來說，將隱性結合運動資訊候補追加至結合運動資訊候補清單的前方時和將隱性結合運動資訊候補追加至結合運動資訊候補清單的後方時，合併索引的選擇機率會有所變動，但此處為了簡化說明而假設合併索引的選擇機率沒有變動來進行說明。這在之後的效果說明例子中也是同樣如此。此時，前方追加的合併索引的編碼長度的期望值係為2.6位元(式3)。另一方面，後方追加的合併索引的編碼長度的期望值係為1.8位元(式4)。因此，後方追加的合併索引的編碼長度的期望值係比前方追加短了0.8位元，可知編碼效率有提升。The effects of the motion picture coding apparatus and the motion picture decoding apparatus according to the first embodiment of the present invention will be described. Fig. 25 is an explanatory diagram showing an example of the effect of the first embodiment of the present invention. FIG. 25 shows an effect obtained by adding the implicit combined motion information candidate to the combined motion information candidate list when the candidate block A is the implicit combined motion information candidate. Here, it is assumed that the combined motion information candidate list is registered with: candidate block A, candidateBlock B, candidate block C, candidate block E, and candidate block T. Assume that merge index 0 (candidate block A), merge index 1 (candidate block B), merge index 2 (candidate block C), merge index 3 (candidate block E), merge index 4 (wait block T) The selection chances are 2%, 60%, 14%, 12%, and 12%, respectively. Strictly speaking, when the implicit combined motion information candidate is added to the front of the combined motion information candidate list and the implicit combined motion information candidate is added to the rear of the combined motion information candidate list, the probability of selecting the combined index may change. However, in order to simplify the description, it is assumed that the selection probability of the merged index is not changed. This is also the case in the example of the effect description that follows. At this time, the expected value of the code length of the merge index added in front is 2.6 bits (Expression 3). On the other hand, the expected value of the code length of the merge index added later is 1.8 bits (Expression 4). Therefore, the expected value of the code length of the merge index added later is 0.8 bits shorter than the front addition, and it is understood that the coding efficiency is improved.
0.02x1+0.6x2+0.14x3+0.12x4+0.12x4=2.6 式30.02x1+0.6x2+0.14x3+0.12x4+0.12x4=2.6 Equation 3
0.6x1+0.14x2+0.12x3+0.12x4+0.02x4=1.8 式40.6x1+0.14x2+0.12x3+0.12x4+0.02x4=1.8 Equation 4
如以上所述，將隱性結合運動資訊候補追加至比空間結合運動資訊候補或時間結合運動資訊候補的合併索引編碼長度還長的結合運動資訊候補清單之最末尾，對選擇率相對變高之隱性結合運動資訊候補以外的候補區塊，分配編碼長度較短的合併索引，藉此就可提升編碼效率。As described above, the implicit combined motion information candidate is added to the end of the combined motion information candidate list longer than the combined index code length of the spatial combined motion information candidate or the time combined motion information candidate, and the selection rate is relatively high. The candidate block other than the implicit motion information candidate is allocated a merged index with a shorter coding length, thereby improving coding efficiency.
圖26係本發明的實施形態1所致之效果之另一例的說明圖。此處，假設在候補區塊群之中僅候補區塊A、候補區塊B、及候補區塊T為有效，候補區塊A與候補區塊B的運動補償預測之方向係皆為Pred_BI。又，假設在結合運動資訊候補清單中係登錄有：候補區塊A、候補區塊B、候補區塊T、從候補區塊A與候補區塊B所生成的2個雙結合運動資訊候補亦即BD0與BD1。假設合併索引0(候補區塊A)、合併索引1(候補區塊B)、合併索引2(候補區塊T)、合併索引3(雙結合運動資訊候補BD0)、合併索引4(雙結合運動資訊候補BD1)的選擇機率係分別為5%、60%、15%、10%、10%。雖然省略計算式，但前方追加的合併索引的編碼長度的期望值係為2.36位元。另一方面，後方追加的合併索引的編碼長度的期望值係為1.46位元。因此，後方追加的合併索引的編碼長度的期望值係比前方追加短了0.9位元，可知編碼效率有提升。Fig. 26 is an explanatory view showing another example of the effect of the first embodiment of the present invention. Here, it is assumed that only the candidate block A, the candidate block B, and the candidate block T are valid among the candidate block groups, and the direction of the motion compensation prediction of the candidate block A and the candidate block B is Pred_BI. Again, assumingIn the combined motion information candidate list, the candidate block A, the candidate block B, the candidate block T, and the two double combined motion information candidates generated from the candidate block A and the candidate block B, that is, BD0 and BD1 are registered. . Assume that merge index 0 (candidate block A), merge index 1 (candidate block B), merge index 2 (candidate block T), merge index 3 (double combined motion information candidate BD0), merge index 4 (double combined motion) The selection probability of the information candidate BD1) is 5%, 60%, 15%, 10%, and 10%, respectively. Although the calculation formula is omitted, the expected value of the code length of the merge index added in front is 2.36 bits. On the other hand, the expected value of the code length of the merge index added later is 1.46 bits. Therefore, the expected value of the code length of the merge index added later is 0.9 bits shorter than the front addition, and it is understood that the coding efficiency is improved.
實施形態1的隱性結合運動資訊候補判定部166之判定處理，係如圖15所示般地至少使用編碼區塊往預測區塊之分割數和預測區塊在編碼區塊內之位置之雙方或任一方，來判定隱性結合運動資訊候補。例如，作為在預測區塊類型為N×N時不判定隱性結合運動資訊候補的條件判定簡略化手法，亦可如圖27所示般地，使用編碼區塊往預測區塊之分割數和預測區塊之寬度與預測區塊之高度，來判定隱性結合運動資訊候補。圖27係用來說明隱性結合運動資訊候補判定部166的判定處理之一例的流程圖。以下，關於實施形態1的變形例2的隱性結合運動資訊候補判定部166之動作，使用圖27來說明。In the determination process of the implicit combined motion information candidate determination unit 166 of the first embodiment, as shown in FIG. 15, at least the number of divisions of the coding block to the prediction block and the position of the prediction block in the coding block are used. Or either party to determine the implicit combined motion information candidate. For example, as a conditional simplification method for not determining the implicit combined motion information candidate when the prediction block type is N×N, the number of divisions of the coding block to the prediction block may be used as shown in FIG. 27 . The width of the block is predicted and the height of the block is predicted to determine the implicit combined motion information candidate. FIG. 27 is a flowchart for explaining an example of determination processing of the recessive combined motion information candidate determination unit 166. Hereinafter, the recessive combined motion information of the second modification of the first embodimentThe operation of the complement determination unit 166 will be described using FIG.
首先，檢查是否為預測區塊1(S200)。若為預測區塊1(S200的Y)，則檢查預測區塊的高度是否大於預測區塊的寬度(S201)。若非預測區塊1(S200的N)，則結束處理。若預測區塊的高度大於預測區塊的寬度(S201的Y)，則將區塊A當作隱性結合運動資訊候補(S202)，結束處理。若預測區塊的高度沒有大於預測區塊的寬度(S201的N)，則檢查預測區塊的高度是否小於預測區塊的寬度(S203)。若預測區塊的高度小於預測區塊的寬度(S203的Y)，則將區塊B當作隱性結合運動資訊候補(S204)，結束處理。若預測區塊的高度沒有小於預測區塊的寬度(S203的N)，則結束處理。First, it is checked whether it is the prediction block 1 (S200). If it is the prediction block 1 (Y of S200), it is checked whether the height of the prediction block is larger than the width of the prediction block (S201). If block 1 is not predicted (N of S200), the processing is terminated. If the height of the prediction block is larger than the width of the prediction block (Y of S201), the block A is regarded as a recessive combined motion information candidate (S202), and the processing ends. If the height of the prediction block is not larger than the width of the prediction block (N of S201), it is checked whether the height of the prediction block is smaller than the width of the prediction block (S203). If the height of the prediction block is smaller than the width of the prediction block (Y of S203), the block B is regarded as a recessive combined motion information candidate (S204), and the processing ends. If the height of the prediction block is not smaller than the width of the prediction block (N of S203), the processing is ended.
實施形態1的結合運動資訊候補清單生成部140之構成係如圖12所示般地將隱性結合運動資訊候補追加部163設置在冗長結合運動資訊候補刪除部162之後，但亦可將隱性結合運動資訊候補追加部163設置在空間結合運動資訊候補生成部160之後。The configuration of the combined motion information candidate list generating unit 140 of the first embodiment is such that the recessive combined motion information candidate adding unit 163 is provided in the redundant combined motion information candidate deleting unit 162 as shown in FIG. 12, but may be recessive. The combined motion information candidate adding unit 163 is provided after the space combined motion information candidate generating unit 160.
此情況下，在結合運動資訊候補清單中，雖然無法將隱性結合運動資訊候補登錄在比時間結合運動資訊候補還要後面，但亦可構成為隱性結合運動資訊候補的追加處理是在空間結合運動資訊候補生成部160內完成，因此可提高空間結合運動資訊候補生成部160與時間結合運動資訊候補生成部161的獨立性，可使電路設計或軟體設計變得容易。In this case, in the combined motion information candidate list, although the implicit combined motion information candidate cannot be registered after the time combined with the motion information candidate, the additional processing of the implicit combined motion information candidate may be configured in the space. The combination of the motion information candidate generation unit 160 is completed, so that the spatial combined motion information candidate generation unit 160 and the time combined motion information can be improved.The independence of the candidate generation unit 161 makes it easy to design a circuit or a software.
實施形態1的結合運動資訊候補清單生成部140之構成係如圖12所示般地將隱性結合運動資訊候補追加部163設置在冗長結合運動資訊候補刪除部162之後，但亦可將隱性結合運動資訊候補追加部163設置在第1結合運動資訊候補補充部164或第2結合運動資訊候補補充部165之後。The configuration of the combined motion information candidate list generating unit 140 of the first embodiment is such that the recessive combined motion information candidate adding unit 163 is provided in the redundant combined motion information candidate deleting unit 162 as shown in FIG. 12, but may be recessive. The combined motion information candidate adding unit 163 is provided after the first combined motion information candidate adding unit 164 or the second combined motion information candidate adding unit 165.
此情況下，在第1結合運動資訊候補補充部164中，從隱性結合運動資訊候補以外的結合運動資訊候補來生成第1補充結合運動資訊候補的時候，對選擇機率相對高於隱性結合運動資訊候補的第1補充結合運動資訊候補，分配比隱性結合運動資訊候補編碼長度還短的合併索引，就可提升編碼效率。又，若第2補充結合運動資訊候補的選擇機率是相對高於隱性結合運動資訊候補，則藉由對第2補充結合運動資訊候補分配編碼長度比隱性結合運動資訊候補還短的合併索引，就可提升編碼效率。In this case, when the first combined motion information candidate complementing unit 164 generates the first supplementary combined motion information candidate from the combined motion information candidate other than the recessive combined motion information candidate, the probability of selection is relatively higher than the recessive combination. The first supplement of the motion information candidate is combined with the motion information candidate to allocate a combined index that is shorter than the implicit combined motion information candidate code length, thereby improving coding efficiency. In addition, if the selection probability of the second supplementary combined motion information candidate is relatively higher than the implicit combined motion information candidate, the combined index of the second supplementary combined motion information candidate allocation code length is shorter than the implicit combined motion information candidate. , can improve coding efficiency.
如以上，不要刪除與隱性結合運動資訊候補相同的運動資訊，而是令與隱性結合運動資訊候補相同的運動資訊與其他結合運動資訊候補之運動資訊做組合，或修正與隱性結合運動資訊候補相同的運動資訊等等，以生成選擇率比隱性結合運動資訊候補相對較高的第1補充結合運動資訊候補，藉此就可提高編碼效率。尤其是，在利用雙結合運動資訊候補時係至少需要2個結合運動資訊候補，因此當隱性結合運動資訊候補以外的結合運動資訊候補是在結合運動資訊候補清單中僅被登錄1個的情況下，則不要刪除與隱性結合運動資訊候補相同的運動資訊，而是令與隱性結合運動資訊候補相同的運動資訊與其他結合運動資訊候補之運動資訊做組合，藉此就可提高編碼效率。For example, do not delete the same sports information as the implicit combined motion information candidate, but combine the same sports information as the implicit combined sports information candidate with other sports information combined with the sports information candidate, or modify and implicitly combine sports. Information waiting for the same sports information, etc., to generate a first supplementary combined sports capital with a relatively higher selection rate than the implicit combined sports information candidateWaiting for the news, to improve coding efficiency. In particular, when the double combined motion information candidate is used, at least two combined motion information candidates are required. Therefore, the combined motion information candidate other than the recessive combined motion information candidate is only registered in the combined motion information candidate list. Under the above, do not delete the same sports information as the implicit combined motion information candidate, but combine the same sports information as the implicit combined sports information candidate with other sports information combined with the sports information candidate, thereby improving coding efficiency. .
實施形態1的結合運動資訊候補清單生成部140之構成係如圖12所示般地，空間結合運動資訊候補生成部160是含有隱性結合運動資訊候補判定部166，但只要在隱性結合運動資訊候補追加部163之前，隱性結合運動資訊候補沒有被登錄至結合運動資訊候補清單中即可，並非限定於此。例如，亦可構成為，冗長結合運動資訊候補刪除部162是含有隱性結合運動資訊候補判定部166。As shown in FIG. 12, the combined motion information candidate list generating unit 140 of the first embodiment includes the recessive combined motion information candidate determining unit 166, but only in the recessive combined motion. Before the information candidate addition unit 163, the implicit combined motion information candidate is not registered in the combined exercise information candidate list, and is not limited thereto. For example, the redundant combined motion information candidate deletion unit 162 may include a recessive combined motion information candidate determination unit 166.
此情況下，在冗長結合運動資訊候補刪除部162中，可將帶有與隱性結合運動資訊候補的運動資訊相同運動資訊的空間集合運動資訊候補，從結合運動資訊候補清單中予以排除，取而代之是將第1補充結合運動資訊候補或第2補充結合運動資訊候補追加至結合運動資訊候補清單，藉此就可提升合併模式的選擇率而提升編碼效率。In this case, in the redundant combined motion information candidate deletion unit 162, the spatial collective motion information candidate having the same motion information as the motion information of the implicit combined motion information candidate can be excluded from the combined motion information candidate list, and replaced. The first supplementary combined motion information candidate or the second supplementary combined motion information candidate is added to the combined motion information candidate list, whereby the selection rate of the merge mode can be improved and the coding efficiency can be improved.
實施形態1的結合運動資訊候補清單生成部140之構成係如圖12所示，但第1結合運動資訊候補補充部164和第2結合運動資訊候補補充部165係亦可其中一方或雙方都刪除。The configuration of the combined motion information candidate list generating unit 140 of the first embodiment is as shown in FIG. 12, but the first combined motion information candidate supplementing unit 164 and the second combined motion information candidate complementing unit 165 may be deleted by one or both of them. .
以下，說明實施形態2。和實施形態1係結合運動資訊候補清單生成部140之構成與動作有所不同。Hereinafter, the second embodiment will be described. The configuration and operation of the combined motion information candidate list generating unit 140 differs from that of the first embodiment.
首先說明，結合運動資訊候補清單生成部140的構成。圖28係實施形態2的結合運動資訊候補清單生成部140之構成的說明圖。和圖12的實施形態1的結合運動資訊候補清單生成部140係為，隱性結合運動資訊候補刪除部167是被追加在第1結合運動資訊候補補充部164之後，這點有所不同。First, the configuration of the motion information candidate list generating unit 140 will be described. Fig. 28 is an explanatory diagram showing the configuration of the combined motion information candidate list generating unit 140 of the second embodiment. The combined motion information candidate list generating unit 140 of the first embodiment of FIG. 12 is different in that the implicit combined motion information candidate deleting unit 167 is added to the first combined motion information candidate complementing unit 164.
接著說明，結合運動資訊候補清單生成部140的動作。圖29係實施形態2的結合運動資訊候補清單生成部140之動作的說明圖。和圖13的實施形態1的結合運動資訊候補清單生成部140之動作係為，接在步驟S106之後，設置有隱性結合運動資訊候補刪除部167會從結合運動資訊候補清單中刪除隱性結合運動資訊候補的步驟(S108)，這點有所不同。Next, the operation of the motion information candidate list generating unit 140 will be described. Fig. 29 is an explanatory diagram showing the operation of the combined motion information candidate list generating unit 140 of the second embodiment. The operation of the combined motion information candidate list generating unit 140 of the first embodiment of FIG. 13 is such that after the step S106, the implicit combined motion information candidate deleting unit 167 deletes the implicit combination from the combined motion information candidate list. This is different in the step of the motion information candidate (S108).
接著說明，隱性結合運動資訊候補刪除部167的動作。圖30係隱性結合運動資訊候補刪除部167之動作的說明圖。針對第1結合運動資訊候補補充部164所供給之結合運動資訊候補清單中所被登錄的結合運動資訊候補之數目(NumCandList)份的結合運動資訊候補M，重複進行以下處理(S210至S213)。此處，M係為0至NumCandList-1的整數。檢查候補區塊M是否為隱性結合運動資訊(S211)。若候補區塊M是隱性結合運動資訊(S211的Y)，則從結合運動資訊候補清單中刪除隱性結合運動資訊候補(S212)，結束處理。若候補區塊M不是隱性結合運動資訊(S211的N)，則處理下個結合運動資訊候補(S213)。Next, the operation of the implicitly combined motion information candidate deletion unit 167 will be described. FIG. 30 is an explanatory diagram of the operation of the implicit combined motion information candidate deletion unit 167. The first combined motion information candidate supplementing unit 164 supplies the same.The following processing is repeated in conjunction with the combined motion information candidate M of the number of combined motion information candidates (NumCandList) registered in the motion information candidate list (S210 to S213). Here, M is an integer of 0 to NumCandList-1. It is checked whether the candidate block M is implicitly combined with motion information (S211). If the candidate block M is the implicit combined motion information (Y of S211), the implicit combined motion information candidate is deleted from the combined motion information candidate list (S212), and the processing ends. If the candidate block M is not implicitly combined with motion information (N of S211), the next combined motion information candidate is processed (S213).
說明本發明的實施形態2的動態影像編碼裝置及動態影像解碼裝置所致之效果。像是第2補充結合運動資訊候補是利用已編碼之影像或已編碼之影像之一部分中發生頻率較高之運動資訊而被設定的情形或預先設定選擇率高的運動資訊候補的情形等，若第2補充結合運動資訊候補的選擇機率比隱性結合運動資訊候補的選擇機率相對較高，則從結合運動資訊候補清單中刪除隱性結合運動資訊候補，對結合運動資訊候補清單追加第2補充結合運動資訊候補，藉此，可提升編碼效率。The effects of the motion picture coding device and the motion picture decoding device according to the second embodiment of the present invention will be described. For example, the second supplementary combined motion information candidate is a case in which a motion information having a higher frequency is generated in one of the encoded video or the encoded video, or a motion information candidate in which a high selection rate is set in advance, and the like. The selection probability of the second supplementary combined motion information candidate is relatively higher than the selection probability of the implicit combined motion information candidate, and the implicit combined motion information candidate is deleted from the combined motion information candidate list, and the second supplement is added to the combined sports information candidate list. Combined with motion information candidates, this can improve coding efficiency.
實施形態2的隱性結合運動資訊候補刪除部167之動作係如圖32所示般地將已被登錄在結合運動資訊候補清單中的隱性結合運動資訊候補單純地予以刪除，但藉由判定隱性結合運動資訊候補亦即預測區塊的結合運動資訊是否為重複結合運動資訊候補，也可決定是否刪除已被登錄在結合運動資訊候補清單中的隱性結合運動資訊候補。The operation of the recessive combined motion information candidate deletion unit 167 of the second embodiment is as shown in FIG.The implicit combined motion information candidate in the single is simply deleted, but it can also be determined whether the deletion has been registered by determining whether the implicit combined motion information candidate, that is, the combined motion information of the predicted block is a repeated combined motion information candidate. The implicit combined motion information candidate in the motion information candidate list is combined.
以下說明伴隨重複結合運動資訊候補之判定的實施形態2的擴充例。圖31係實施形態2的變形例中的隱性結合運動資訊候補刪除部167之動作的說明圖。與圖30的不同點在於，追加了步驟S213。檢查含有隱性結合運動資訊候補的預測區塊的結合運動資訊，是否為重複結合運動資訊候補(步驟S213)。若含有隱性結合運動資訊候補的預測區塊的結合運動資訊候補是重複結合運動資訊候補(步驟S213的Y)，則從結合運動資訊候補清單中刪除隱性結合運動資訊候補(S212)，結束處理。若含有隱性結合運動資訊候補的預測區塊的結合運動資訊不是重複結合運動資訊候補(步驟S213的N)，則結束處理。An example of the expansion of the second embodiment along with the determination of the repeated combined motion information candidate will be described below. FIG. 31 is an explanatory diagram showing an operation of the recessive combined motion information candidate deletion unit 167 in the modification of the second embodiment. The difference from FIG. 30 is that step S213 is added. It is checked whether the combined motion information of the prediction block including the implicit combined motion information candidate is a repeated combined motion information candidate (step S213). If the combined motion information candidate of the prediction block including the implicit combined motion information candidate is the repeated combined motion information candidate (Y in step S213), the implicit combined motion information candidate is deleted from the combined motion information candidate list (S212), and the process ends. deal with. If the combined motion information of the prediction block including the implicit combined motion information candidate is not the repeated combined motion information candidate (N of step S213), the processing ends.
接著說明重複結合運動資訊候補。圖32係用來說明重複結合運動資訊候補的圖。圖32係表示編碼區塊為16x16的例子。圖32(a)係為預測區塊尺寸類型是N×2N時的重複結合運動資訊候補的說明圖，圖示了預測區塊尺寸類型為N×2N時的預測區塊1的隱性結合運動資訊候補亦即預測區塊0的空間結合運動資訊候補亦即候補區塊A、候補區塊B、候補區塊C、候補區塊D、及候補區塊E。圖32(b)係圖示了預測區塊尺寸類型是2N×2N之預測區塊0時的空間結合運動資訊候補亦即候補區塊A、候補區塊B、候補區塊C、候補區塊D、及候補區塊E。在圖32(a)和圖32(b)中，可看出候補區塊A、候補區塊D、及候補區塊E的位置係為重複。這些在某預測區塊尺寸類型下與較大預測區塊尺寸類型之候補區塊的位置發生重複的候補區塊，稱作重複結合運動資訊候補。Next, the repeated combined motion information candidates will be described. Figure 32 is a diagram for explaining the repeated combined motion information candidates. Fig. 32 is a diagram showing an example in which the coding block is 16x16. 32(a) is an explanatory diagram of the repeated combined motion information candidate when the prediction block size type is N×2N, and illustrates the implicit combined motion of the prediction block 1 when the prediction block size type is N×2N. The information candidate, that is, the spatial combined motion information candidate of the prediction block 0, that is, the candidate block A, the candidate block B, the candidate block C, the candidate block D, and the candidate block E. 32(b) is a diagram showing the spatial combined motion information candidate, that is, the candidate block A, when the predicted block size type is 2N×2N prediction block 0.The block B, the candidate block C, the candidate block D, and the candidate block E are added. In FIGS. 32(a) and 32(b), it can be seen that the positions of the candidate block A, the candidate block D, and the candidate block E are repeated. These candidate blocks that overlap with the positions of the candidate blocks of the larger prediction block size type under a certain prediction block size type are called repeated combined motion information candidates.
此處，在預測區塊尺寸類型為N×2N時的預測區塊1的隱性結合運動資訊候補亦即預測區塊0中，當這些重複結合運動資訊候補是被選擇來作為結合運動資訊候補時，在預測區塊1上選擇重複結合運動資訊候補，係等價於設成2N×2N而選擇了重複結合運動資訊候補的情形，因此必定伴隨著編碼效率的降低。另一方面，在預測區塊尺寸類型為N×2N時的預測區塊1的隱性結合運動資訊候補亦即預測區塊0中，當這些非重複結合運動資訊候補的候補區塊B或候補區塊C是被選擇來作為結合運動資訊候補時，由於並非被當成2N×2N而選擇，因此在預測區塊1上藉由選擇候補區塊B或候補區塊C，編碼效率係有可能提升。圖32(c)係預測區塊尺寸類型是2N×N之預測區塊0時的重複結合運動資訊候補是候補區塊B、候補區塊C、及候補區塊D的圖示。圖32(d)係預測區塊尺寸類型是N×N之預測區塊2時的重複結合運動資訊候補是候補區塊A、候補區塊D、及候補區塊E的圖示。圖32(e)係預測區塊尺寸類型是N×N之預測區塊1時的重複結合運動資訊候補是候補區塊B、候補區塊C、及候補區塊D的圖示。Here, in the prediction block 0 of the prediction block 1 when the prediction block size type is N×2N, that is, in the prediction block 0, when these repeated combined motion information candidates are selected as the combined motion information candidates In the case where the repeated combined motion information candidate is selected on the prediction block 1, it is equivalent to the case where the repeated combined motion information candidate is selected to be 2N×2N, and thus the coding efficiency is necessarily reduced. On the other hand, in the implicit combined motion information candidate of the prediction block 1 when the prediction block size type is N×2N, that is, in the prediction block 0, when these non-repetitive combined motion information candidates are candidate blocks B or candidates When the block C is selected as the combined motion information candidate, since it is not selected as 2N×2N, the coding efficiency may be improved by selecting the candidate block B or the candidate block C in the prediction block 1. . 32(c) is a diagram showing the repeated combined motion information candidates when the prediction block size type is 2N×N prediction block 0 is the candidate block B, the candidate block C, and the candidate block D. 32(d) is a diagram showing the repeated combined motion information candidates when the prediction block size type is the N×N prediction block 2, which is the candidate block A, the candidate block D, and the candidate block E. 32(e) is a diagram showing the repeated combined motion information candidates when the prediction block size type is N×N prediction block 1 is the candidate block B, the candidate block C, and the candidate block D.
如以上所述，藉由判定隱性結合運動資訊候補亦即預測區塊的結合運動資訊是否為重複結合運動資訊候補，決定是否刪除已被登錄在結合運動資訊候補清單中的隱性結合運動資訊候補，藉此可提升編碼效率。As described above, by determining whether the implicit combined motion information candidate, that is, the combined motion information of the predicted block is a repeated combined motion information candidate, whether to delete the implicit combined motion information that has been registered in the combined motion information candidate list is determined. Alternate, which can improve coding efficiency.
以上所述的實施形態的動態影像編碼裝置所輸出的動態影像的編碼串流，係為了可隨著實施形態中所使用之編碼方法來進行解碼，而具有特定的資料格式，對應於動態影像編碼裝置的動態影像解碼裝置係可將此特定資料格式的編碼串流加以解碼。The coded stream of the video stream output by the motion picture coding apparatus according to the embodiment described above has a specific data format corresponding to the motion picture coding in order to be decoded in accordance with the coding method used in the embodiment. The dynamic video decoding device of the device can decode the encoded stream of this particular data format.
動態影像編碼裝置與動態影像解碼裝置之間為了收授編碼串流，而使用有線或無線網路的情況下，可將編碼串流轉換成適合於通訊路之傳輸形態的資料形式來進行傳輸。此情況下，會設置有：將動態影像編碼裝置所輸出之編碼串流轉換成適合於通訊路之傳輸形態之資料形式的編碼資料然後發送至網路的動態影像送訊裝置、和從網路接收編碼資料並復原成編碼串流而供給至動態影像解碼裝置的動態影像收訊裝置。When a video or wireless network is used between the motion picture coding apparatus and the motion picture decoding apparatus to receive the code stream, the code stream can be converted into a data format suitable for the transmission mode of the communication path. In this case, a dynamic image transmitting device that converts the encoded stream outputted by the motion image encoding device into encoded data suitable for the transmission form of the communication path and then transmits it to the network, and the slave network are provided. The motion picture receiving device that receives the coded data and restores it into a coded stream and supplies it to the motion picture decoding device.
動態影像送訊裝置，係含有：將動態影像編碼裝置所輸出之編碼串流予以緩衝的記憶體、將編碼串流予以封包化的封包處理部、將已被封包化的編碼資料透過網路而進行發送的送訊部。動態影像收訊裝置，係含有：將已被封包化的編碼資料透過網路而進行接收的收訊部、將已被接收之編碼資料予以緩衝的記憶體、將編碼資料進行封包處理而生成編碼串流並提供給動態影像解碼裝置的封包處理部。The motion picture transmitting device includes a memory that buffers a coded stream output by the motion picture coding device, a packet processing unit that encapsulates the coded stream, and transmits the encapsulated coded data through the network. The transmitting unit that sends the message. The motion picture receiving device includes a receiving unit that receives the encoded encoded data through the network, a memory that buffers the received encoded data, and encodes the encoded data to generate a code. Streaming and providing packet processing to the motion picture decoding deviceunit.
以上的關於編碼及解碼之處理，係可用硬體而以傳輸、積存、收訊裝置的方式來加以實現，當然，也可藉由記憶在ROM(唯讀記憶體)或快閃記憶體等中的韌體、或電腦等之軟體來加以實現。亦可將該韌體程式、軟體程式記錄至電腦等可讀取之記錄媒體來加以提供，或可透過有線或無線網路從伺服器來提供，也可用地表波或衛星數位播送的資料播送方式來提供之。The above processing for encoding and decoding can be implemented by means of hardware, transmission, accumulation, and receiving device. Of course, it can also be stored in ROM (read only memory) or flash memory. The firmware, or software such as a computer, is implemented. The firmware program and software program can also be recorded on a readable recording medium such as a computer, or can be provided from a server through a wired or wireless network, or can be broadcast by means of a surface wave or satellite digital broadcast. Come and provide it.
以上係依據實施形態來說明了本發明。實施形態係為例示，這些各構成要素或各處理程序之組合中還有各種可能的變形例，而這些變形例也都屬於本發明之範圍，而能被當業者所理解。The present invention has been described above based on the embodiments. The embodiments are exemplified, and there are various possible modifications in the combinations of these constituent elements or processing programs, and these modifications are also within the scope of the invention and can be understood by the practitioner.
本發明係可利用於，將運動補償預測中所利用之運動資訊予以編碼的動態影像編碼技術。The present invention is applicable to a motion picture coding technique that encodes motion information used in motion compensation prediction.
100‧‧‧動態影像編碼裝置100‧‧‧Dynamic image coding device
101‧‧‧預測區塊影像取得部101‧‧‧Predicted Block Image Acquisition Department
102‧‧‧減算部102‧‧‧Reduction Department
103‧‧‧預測誤差編碼部103‧‧‧Predictive Error Coding Section
104‧‧‧編碼列生成部104‧‧‧Code Column Generation Department
105‧‧‧預測誤差解碼部105‧‧‧Predictive Error Decoding Unit
106‧‧‧運動補償部106‧‧‧Sports Compensation Department
107‧‧‧加算部107‧‧‧Additional Department
108‧‧‧運動向量偵測部108‧‧‧Sport Vector Detection Department
109‧‧‧運動資訊生成部109‧‧‧Sports Information Generation Department
110‧‧‧畫格記憶體110‧‧‧Characteristic memory
111‧‧‧運動資訊記憶體111‧‧‧Sports information memory
120‧‧‧預測向量模式決定部120‧‧‧Predictive Vector Mode Decision Department
121‧‧‧合併模式決定部121‧‧‧Combined Mode Decision Department
122‧‧‧預測編碼模式決定部122‧‧‧Predictive coding mode decision
130‧‧‧預測向量候補清單生成部130‧‧‧ Forecast vector candidate list generation unit
131‧‧‧預測向量決定部131‧‧‧ Forecast Vector Decision Department
140‧‧‧結合運動資訊候補清單生成部140‧‧‧Combined sports information candidate list generation unit
141‧‧‧結合運動資訊選擇部141‧‧‧Combined with the Sports Information Selection Department
160‧‧‧空間結合運動資訊候補生成部160‧‧‧ Space combined with sports information candidate generation
161‧‧‧時間結合運動資訊候補生成部161‧‧‧Time combined with sports information candidate generation department
162‧‧‧冗長結合運動資訊候補刪除部162‧‧‧ lengthy combined with the Sports Information Alternate Removal Department
163‧‧‧隱性結合運動資訊候補追加部163‧‧‧Invisible combined sports information candidate additional department
164‧‧‧第1結合運動資訊候補補充部164‧‧‧1st combined sports information candidate supplement
165‧‧‧第2結合運動資訊候補補充部165‧‧‧2nd Combined Sports Information Supplementary Supplement
166‧‧‧隱性結合運動資訊候補判定部166‧‧‧Recessive combined motion information candidate judgment department
167‧‧‧隱性結合運動資訊候補刪除部167‧‧‧Invisible combined sports information candidate deletion department
200‧‧‧動態影像解碼裝置200‧‧‧Dynamic image decoding device
201‧‧‧編碼列解析部201‧‧‧Code Column Analysis Department
202‧‧‧預測誤差解碼部202‧‧‧Predictive Error Decoding Department
203‧‧‧加算部203‧‧‧Additional Department
204‧‧‧運動資訊再生部204‧‧‧Sports Information Recycling Department
205‧‧‧運動補償部205‧‧‧Sports Compensation Department
206‧‧‧畫格記憶體206‧‧‧Characteristic memory
207‧‧‧運動資訊記憶體207‧‧‧Sports information memory
210‧‧‧編碼模式判定部210‧‧‧Code Mode Judgment Department
211‧‧‧運動向量再生部211‧‧‧Sports Vector Reproduction Department
212‧‧‧結合運動資訊再生部212‧‧‧Combined with the Ministry of Sports Information Regeneration
230‧‧‧結合運動資訊候補清單生成部230‧‧‧Combined sports information candidate list generation unit
231‧‧‧結合運動資訊選擇部231‧‧‧Combined with the Sports Information Selection Department
[圖1]圖1(a)、(b)係編碼區塊的說明圖。Fig. 1 (a) and (b) are explanatory views of coding blocks.
[圖2]圖2(a)~(d)係預測區塊尺寸類型的說明圖。[Fig. 2] Fig. 2 (a) to (d) are explanatory diagrams of prediction block size types.
[圖3]預測區塊尺寸類型的說明圖。[Fig. 3] An explanatory diagram of a prediction block size type.
[圖4]預測編碼模式的說明圖。FIG. 4 is an explanatory diagram of a prediction encoding mode.
[圖5]合併索引與編碼列之關係的說明圖。[Fig. 5] An explanatory diagram of a relationship between a merged index and a coded column.
[圖6]預測區塊的語法之一例的說明圖。[Fig. 6] An explanatory diagram of an example of a syntax of a prediction block.
[圖7]實施形態1所述之動態影像編碼裝置之構成的圖示。Fig. 7 is a view showing the configuration of a motion picture coding apparatus according to the first embodiment.
[圖8]圖7的運動資訊生成部之構成的圖示。FIG. 8 is a view showing a configuration of a motion information generating unit of FIG. 7. FIG.
[圖9]圖8的合併模式決定部之構成的說明圖。FIG. 9 is an explanatory diagram of a configuration of a merge mode determining unit of FIG. 8. FIG.
[圖10]處理對象之預測區塊尺寸為16像素×16像素時的處理對象之預測區塊的相鄰區塊的圖示。FIG. 10 is a diagram showing adjacent blocks of a prediction block of a processing target when the prediction block size of the processing target is 16 pixels×16 pixels.
[圖11]處理對象之預測區塊尺寸為16像素×16像素時的與處理對象之預測區塊位於同一位置的ColPic上的預測區塊內的區塊和其周邊區塊的圖示。[Fig. 11] A block diagram of a block in a prediction block on a ColPic located at the same position as a prediction block of a processing target when the prediction block size of the processing target is 16 pixels × 16 pixels, and a peripheral block thereof.
[圖12]圖9的結合運動資訊候補清單生成部之構成的說明圖。FIG. 12 is an explanatory diagram of a configuration of a combined motion information candidate list generating unit of FIG. 9. FIG.
[圖13]圖9的結合運動資訊候補清單生成部之動作的流程圖。FIG. 13 is a flowchart of the operation of the combined motion information candidate list generating unit of FIG. 9.
[圖14]圖14(a)至(d)係隱性結合運動資訊候補的說明圖。Fig. 14 (a) to (d) are explanatory diagrams of implicit combined motion information candidates.
[圖15]隱性結合運動資訊候補之判定處理的說明用流程圖。[Fig. 15] A flowchart for explaining the determination process of the implicit combined motion information candidate.
[圖16]圖12的空間結合運動資訊候補生成部之動作的說明用流程圖。FIG. 16 is a flowchart for explaining the operation of the spatial combined motion information candidate generating unit of FIG.
[圖17]圖12的時間結合運動資訊候補生成部之動作的說明用流程圖。FIG. 17 is a flowchart for explaining the operation of the time combined motion information candidate generating unit of FIG.
[圖18]圖12的隱性結合運動資訊候補追加部之動作的說明用流程圖。FIG. 18 is a flowchart for explaining the operation of the recessive combined motion information candidate adding unit of FIG.
[圖19]圖12的第1結合運動資訊候補補充部之動作的流程圖。FIG. 19 is a flowchart showing the operation of the first combined motion information candidate supplementing unit of FIG.
[圖20]組合檢查次數和結合運動資訊候補M與結合運動資訊候補N之關係的說明圖。[Fig. 20] An explanatory diagram of the relationship between the number of combined inspections and the combined motion information candidate M and the combined motion information candidate N.
[圖21]圖12的第2結合運動資訊候補補充部之動作的流程圖。FIG. 21 is a flowchart showing the operation of the second combined motion information candidate supplementing unit of FIG.
[圖22]實施形態1所述之動態影像解碼裝置之構成的圖示。Fig. 22 is a diagram showing the configuration of a video decoding device according to the first embodiment.
[圖23]圖22的運動資訊再生部之構成的圖示。Fig. 23 is a view showing the configuration of a motion information reproducing unit of Fig. 22;
[圖24]圖23的結合運動資訊再生部之構成的圖示。Fig. 24 is a view showing the configuration of a combined motion information reproducing unit of Fig. 23;
[圖25]實施形態1所致之效果之一例的說明圖。Fig. 25 is an explanatory diagram showing an example of the effect of the first embodiment.
[圖26]實施形態1所致之效果之另一例的說明圖。Fig. 26 is an explanatory diagram showing another example of the effect of the first embodiment.
[圖27]隱性結合運動資訊候補之判定處理的說明用流程圖。[Fig. 27] A flow chart for explaining the determination process of the implicit combined motion information candidate.
[圖28]實施形態2的結合運動資訊候補清單生成部之構成的說明圖。FIG. 28 is an explanatory diagram showing a configuration of a combined motion information candidate list generating unit in the second embodiment.
[圖29]實施形態2的結合運動資訊候補清單生成部之動作的說明圖。FIG. 29 is an explanatory diagram of an operation of the combined motion information candidate list generating unit in the second embodiment.
[圖30]圖28的隱性結合運動資訊候補刪除部之動作的說明圖。FIG. 30 is an explanatory diagram of an operation of the recessive combined motion information candidate deletion unit of FIG. 28.
[圖31]實施形態2的變形例中的隱性結合運動資訊候補刪除部之動作的說明圖。FIG. 31 is an explanatory diagram of an operation of the recessive combined motion information candidate deletion unit in the modification of the second embodiment.
[圖32]重複結合運動資訊候補的說明圖。[Fig. 32] An explanatory diagram of the repeated combined motion information candidate.
12,14,15,17‧‧‧端子12,14,15,17‧‧‧terminal
121‧‧‧合併模式決定部121‧‧‧Combined Mode Decision Department
140‧‧‧結合運動資訊候補清單生成部140‧‧‧Combined sports information candidate list generation unit
141‧‧‧結合運動資訊選擇部141‧‧‧Combined with the Sports Information Selection Department
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2011244801 | 2011-11-08 | ||
| JP2011244802 | 2011-11-08 | ||
| JP2012244596AJP2013123218A (en) | 2011-11-08 | 2012-11-06 | Moving-image decoding device, moving-image decoding method, moving-image decoding program, reception device, reception method, and reception program |
| JP2012244595AJP2013123217A (en) | 2011-11-08 | 2012-11-06 | Moving-image encoding device, moving-image encoding method, moving-image encoding program, transmission device, transmission method, and transmission program |
| Publication Number | Publication Date |
|---|---|
| TW201325258Atrue TW201325258A (en) | 2013-06-16 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW101141590ATW201325258A (en) | 2011-11-08 | 2012-11-08 | Video encoding device, method, program, transmission device, transmission method, transmission program; and video decoding device, method, program, reception device, reception method, and reception program |
| Country | Link |
|---|---|
| TW (1) | TW201325258A (en) |
| Publication | Publication Date | Title |
|---|---|---|
| US10631001B2 (en) | Moving picture coding device, moving picture coding method, and moving picture coding program | |
| TWI552571B (en) | Image decoding apparatus, image decoding method and image decoding program | |
| TWI580263B (en) | Dynamic image decoding device, dynamic image decoding method and dynamic image decoding program | |
| TWI580259B (en) | Dynamic image decoding device, dynamic image decoding method, and dynamic image decoding program | |
| KR102464103B1 (en) | Image encoding device, image encoding method, image encoding program, image decoding device, image decoding method, and image decoding program | |
| KR101561461B1 (en) | Video encoding and decoding method and apparatus using the same | |
| JP6256539B2 (en) | Moving picture decoding apparatus, moving picture decoding method, and moving picture decoding program | |
| TW201325258A (en) | Video encoding device, method, program, transmission device, transmission method, transmission program; and video decoding device, method, program, reception device, reception method, and reception program | |
| JP2013118626A (en) | Moving image encoding apparatus, moving image encoding method, moving image encoding program, transmitting apparatus, transmitting method and transmitting program | |
| TW201342930A (en) | Moving-image encoding device, method, program, transmitter, transmission method and program, and moving-image decoding device, method, program, receiver, method and program | |
| WO2013065300A1 (en) | Moving-image encoding device, moving-image encoding method, moving-image encoding program, transmitter, transmission method and transmission program, and moving-image decoding device, moving-image decoding method, moving-image decoding program, receiver, and reception method and reception program | |
| JP2013123218A (en) | Moving-image decoding device, moving-image decoding method, moving-image decoding program, reception device, reception method, and reception program | |
| JP2013121164A (en) | Image decoding device, image decoding method, and image decoding program | |
| JP2013121163A (en) | Image encoding device, image encoding method, and image encoding program | |
| WO2013069269A1 (en) | Video encoding device, video encoding method, video encoding program, transmission device, transmission method, transmission program, video decoding device, video decoding method, video decoding program, reception device, reception method, and reception program | |
| JP2013021613A (en) | Image decoder, image decoding method and image decoding program | |
| JP2013123217A (en) | Moving-image encoding device, moving-image encoding method, moving-image encoding program, transmission device, transmission method, and transmission program | |
| JP2013021612A (en) | Image encoder, image encoding method and image encoding program |