Movatterモバイル変換


[0]ホーム

URL:


CN108616758B - Multi-view video encoding and decoding methods, encoder and decoder - Google Patents

Multi-view video encoding and decoding methods, encoder and decoder
Download PDF

Info

Publication number
CN108616758B
CN108616758BCN201611162916.2ACN201611162916ACN108616758BCN 108616758 BCN108616758 BCN 108616758BCN 201611162916 ACN201611162916 ACN 201611162916ACN 108616758 BCN108616758 BCN 108616758B
Authority
CN
China
Prior art keywords
inter
view prediction
view
information
prediction information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611162916.2A
Other languages
Chinese (zh)
Other versions
CN108616758A (en
Inventor
张峻
陈杰
吴越
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co LtdfiledCriticalSamsung Electronics Co Ltd
Priority to CN201611162916.2ApriorityCriticalpatent/CN108616758B/en
Publication of CN108616758ApublicationCriticalpatent/CN108616758A/en
Application grantedgrantedCritical
Publication of CN108616758BpublicationCriticalpatent/CN108616758B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Classifications

Landscapes

Abstract

Translated fromChinese

本发明公开了一种多视点视频编码方法,其包括:确定当前编码区域的视间预测信息;根据当前编码区域的视间预测信息确定当前编码区域的视间预测解码辅助信息;在码流中编码写入视间预测解码辅助信息,以允许解码器根据视间预测解码辅助信息确定相应解码区域的视间预测信息。与现有技术相比,本发明利用多视点视频编码相邻块之间在视间预测中的相关性对多视点视频流编码,显著提高了视频的压缩效率;将视间预测解码辅助信息融入编码过程,节省了直接传输视间预测信息的码率开销,显著提高了编码效率。此外,本发明还公开了一种多视点视频解码方法及编码器、解码器。

The invention discloses a multi-viewpoint video coding method, which includes: determining inter-view prediction information of the current coding area; determining inter-view prediction decoding auxiliary information of the current coding area according to the inter-view prediction information of the current coding area; in the code stream The encoding writes the inter-view prediction decoding auxiliary information to allow the decoder to determine the inter-view prediction information of the corresponding decoding region based on the inter-view prediction decoding auxiliary information. Compared with the existing technology, the present invention utilizes the correlation between adjacent blocks in multi-view video coding in inter-view prediction to encode multi-view video streams, significantly improving the compression efficiency of the video; and integrates inter-view prediction decoding auxiliary information The encoding process saves the code rate overhead of directly transmitting inter-view prediction information and significantly improves encoding efficiency. In addition, the invention also discloses a multi-viewpoint video decoding method, encoder and decoder.

Description

Translated fromChinese
多视点视频编码、解码方法及编码器、解码器Multi-viewpoint video encoding and decoding methods and encoders and decoders

技术领域Technical field

本发明涉及信息处理领域,更具体地,涉及一种多视点视频编、解码方法及编码器、解码器。The present invention relates to the field of information processing, and more specifically, to a multi-viewpoint video encoding and decoding method, an encoder, and a decoder.

背景技术Background technique

多视点视频是使用多个摄像机在不同的空间位置以不同的角度同时获取同一场景的一组视频信号。对多视点视频进行压缩编码和解压解码的过程称为多视点视频编码和解码。多视点视频编码通常包含一个或多个基本视点以及若干个依赖视点,基本视点独立编解码,依赖视点可以参考基本视点进行编解码。由于多视点视频的视点之间有冗余信息存在,因此采用视(点)间预测编码能有效去除视间冗余,提高编码效率。Multi-viewpoint video uses multiple cameras to simultaneously acquire a set of video signals of the same scene at different spatial locations and different angles. The process of compressing, encoding and decompressing multi-viewpoint videos is called multi-viewpoint video encoding and decoding. Multi-viewpoint video coding usually includes one or more basic viewpoints and several dependent viewpoints. The basic viewpoints are encoded and decoded independently, and the dependent views can refer to the basic viewpoints for encoding and decoding. Since there is redundant information between viewpoints in multi-view videos, inter-view (point) predictive coding can effectively remove inter-view redundancy and improve coding efficiency.

在视频编码块中,时(间)域相邻块和空(间)域相邻之间的内容有很强的相关性,因此它们的预测信息也有很强的相关性。对于当前编码块,AVS2-3D视频编码标准参考其相邻块中的时间预测块直接导出当前编码块的时间预测信息,在一定程度上提高了编码效率。但在AVS2-3D视频编码标准中,仅当相邻块是时间预测块的时候,才会被用来导出当前块的时间预测信息;而如果相邻块是视间预测块,则会直接忽略此相邻块,认为其“不可用”。这种方法没有考虑到相邻块之间在视间预测中的相似性,忽略了视间预测相邻块的预测信息,因此,其编码效率还存在提升的空间。In video coding blocks, the content between adjacent blocks in the temporal (temporal) domain and adjacent blocks in the spatial (inter) domain has a strong correlation, so their prediction information also has a strong correlation. For the current coding block, the AVS2-3D video coding standard directly derives the temporal prediction information of the current coding block with reference to the temporal prediction blocks in its adjacent blocks, which improves coding efficiency to a certain extent. However, in the AVS2-3D video coding standard, only when the adjacent block is a temporal prediction block, it will be used to derive the temporal prediction information of the current block; if the adjacent block is an inter-view prediction block, it will be directly ignored. This adjacent block is considered "unavailable". This method does not take into account the similarity between adjacent blocks in inter-view prediction and ignores the prediction information of adjacent blocks in inter-view prediction. Therefore, there is still room for improvement in its coding efficiency.

有鉴于此,有必要提供一种能够解决上述技术问题的多视点视频编、解码方法及编码器、解码器。In view of this, it is necessary to provide a multi-viewpoint video encoding and decoding method and an encoder and decoder that can solve the above technical problems.

发明内容Contents of the invention

本发明的目的在于:克服现有技术的不足,提供一种压缩效率高、传输码率开销小、编码效率高的多视点视频编、解码方法及编码器、解码器。The object of the present invention is to overcome the shortcomings of the existing technology and provide a multi-viewpoint video encoding and decoding method, encoder and decoder with high compression efficiency, low transmission bit rate overhead and high coding efficiency.

为了实现上述目的,本发明提供了一种多视点视频编码方法,其包括以下步骤:In order to achieve the above objectives, the present invention provides a multi-viewpoint video coding method, which includes the following steps:

确定当前编码区域的视间预测信息;Determine the inter-view prediction information of the current coding area;

根据该当前编码区域的视间预测信息确定当前编码区域的视间预测解码辅助信息;Determine inter-view prediction decoding auxiliary information of the current coding region according to the inter-view prediction information of the current coding region;

在码流中编码写入该视间预测解码辅助信息,以允许解码器根据该视间预测解码辅助信息确定相应解码区域的视间预测信息。The inter-view prediction decoding auxiliary information is encoded and written in the code stream to allow the decoder to determine the inter-view prediction information of the corresponding decoding area based on the inter-view prediction decoding auxiliary information.

优选地,所述编码区域包括编码块、预测块、部分图像、条带、图像拼贴Tile、最大编码单元、编码单元、预测单元及宏块中的至少一项,所述解码区域包括与所述编码区域对应的编码块、预测块、部分图像、条带、图像拼贴Tile、最大编码单元、编码单元、预测单元及宏块中的至少一项。Preferably, the coding area includes at least one of a coding block, a prediction block, a partial image, a slice, an image tile, a maximum coding unit, a coding unit, a prediction unit and a macroblock, and the decoding area includes the At least one of a coding block, a prediction block, a partial image, a slice, an image tile, a maximum coding unit, a coding unit, a prediction unit, and a macroblock corresponding to the coding area.

优选地,所述当前编码区域所在的图像位于纹理图像层或深度图像层,所述图像包括帧间编码图像、单向帧间编码图像、双向帧间编码图像、双假设帧间编码图像、视间帧间编码图像、依赖视点图像、依赖视点帧间编码图像、纹理帧间编码图像及深度帧间编码图像中的至少一项。Preferably, the image where the current coding area is located is located in the texture image layer or the depth image layer, and the image includes an inter-frame coded image, a one-way inter-frame coded image, a bi-directional inter-frame coded image, a dual-hypothesis inter-frame coded image, a visual At least one of an inter-coded image, a viewpoint-dependent image, a viewpoint-dependent inter-coded image, a texture inter-coded image, and a depth inter-coded image.

优选地,确定当前编码区域的视间预测信息的步骤,包括:根据编码候选视间预测信息确定当前编码区域的视间预测信息,所述编码候选视间预测信息包括已编码的其它编码区域的N1个视间预测信息、由已编码的其它编码区域的多个视间预测信息计算得到的N2个视间预测信息、预设的N3个视间预测信息、当前编码区域的局部视差信息、当前编码区域所在图像的全局视差信息中的至少一个信息,其中,N1、N2和N3均为正整数。Preferably, the step of determining the inter-view prediction information of the current coding region includes: determining the inter-view prediction information of the current coding region based on coding candidate inter-view prediction information, where the coding candidate inter-view prediction information includes coded inter-view prediction information of other coding regions. N1 pieces of inter-view prediction information, N2 pieces of inter-view prediction information calculated from multiple pieces of inter-view prediction information that have been encoded in other coding regions, preset N3 pieces of inter-view prediction information, local disparity information of the current coding region, the current At least one piece of information in the global disparity information of the image where the encoding area is located, where N1, N2 and N3 are all positive integers.

优选地,所述已编码的其它编码区域与所述当前编码区域位于相同或不同视点,所述已编码的其它编码区域与所述当前编码区域位于相同或不同图像层。Preferably, the coded other coding areas and the current coding area are located at the same or different viewpoints, and the coded other coding areas and the current coding area are located at the same or different image layers.

优选地,所述由已编码的其它编码区域的多个视间预测信息计算得到的N2个视间预测信息,包括:由已编码的其它编码区域的视间预测信息经过求平均值、最大值、最小值、中值、组合值、缩放值中的一种或多种计算得到的N2个视间预测信息。Preferably, the N2 pieces of inter-view prediction information calculated from a plurality of inter-view prediction information of other coded coding areas include: averaging and maximizing the inter-view prediction information of other coding areas that have been coded. , N2 inter-view prediction information calculated from one or more of the minimum value, median value, combination value, and scaling value.

优选地,所述根据编码候选视间预测信息确定当前编码区域的视间预测信息,包括:将编码候选视间预测信息中的一个信息,作为当前编码区域的视间预测信息。Preferably, determining the inter-view prediction information of the current coding region based on the coding candidate inter-view prediction information includes: using one of the coding candidate inter-view prediction information as the inter-view prediction information of the current coding region.

优选地,所述将编码候选视间预测信息中的一个信息,作为当前编码区域的视间预测信息,包括:将编码候选视间预测信息中,与解码器的约定规则规定的一个信息,作为当前编码区域的视间预测信息。Preferably, using one of the encoding candidate inter-view prediction information as the inter-view prediction information of the current coding area includes: encoding one of the information on the candidate inter-view prediction information specified by the agreement with the decoder as Inter-view prediction information of the current coding area.

优选地,所述将编码候选视间预测信息中的一个信息,作为当前编码区域的视间预测信息,包括:将编码候选视间预测信息中的多个信息进行排序索引和淘汰处理以选择一个信息,作为当前编码区域的视间预测信息。Preferably, encoding one piece of information among the candidate inter-view prediction information as the inter-view prediction information of the current encoding region includes: sorting, indexing and eliminating multiple pieces of information among the encoding candidate inter-view prediction information to select one. information as the inter-view prediction information of the current coding area.

优选地,所述当前编码区域的视间预测解码辅助信息,包括:所述在编码候选视间预测信息中所选择的信息的索引号。Preferably, the inter-view prediction decoding auxiliary information of the current encoding region includes: an index number of the information selected in the encoding candidate inter-view prediction information.

优选地,所述当前编码区域的视间预测解码辅助信息,包括:当前编码区域是否采用所述多视点视频编码方法的信息。Preferably, the inter-view prediction decoding auxiliary information of the current coding area includes: information on whether the current coding area adopts the multi-viewpoint video coding method.

为了实现上述目的,本发明还提供了一种多视点视频解码方法,其包括以下步骤:In order to achieve the above objects, the present invention also provides a multi-viewpoint video decoding method, which includes the following steps:

从码流中解析出当前解码区域的视间预测解码辅助信息,该视间预测解码辅助信息由编码器根据相应编码区域的视间预测信息确定、并编码写入码流;Parse the inter-view prediction decoding auxiliary information of the current decoding area from the code stream. The inter-view prediction decoding auxiliary information is determined by the encoder based on the inter-view prediction information of the corresponding coding area, and is encoded and written into the code stream;

根据该视间预测解码辅助信息导出当前解码区域的视间预测信息。Inter-view prediction information of the current decoding area is derived based on the inter-view prediction decoding auxiliary information.

优选地,所述解码区域包括编码块、预测块、部分图像、条带、图像拼贴、最大编码单元、编码单元、预测单元及宏块中的至少一项,所述编码区域包括与所述解码区域对应的编码块、预测块、部分图像、条带、图像拼贴、最大编码单元、编码单元、预测单元及宏块中的至少一项。Preferably, the decoding area includes at least one of a coding block, a prediction block, a partial image, a slice, an image tile, a maximum coding unit, a coding unit, a prediction unit, and a macroblock, and the coding area includes the decoding area and the decoding area. At least one of a coding block, a prediction block, a partial image, a slice, an image tile, a maximum coding unit, a coding unit, a prediction unit, and a macroblock corresponding to the decoding area.

优选地,所述当前解码区域所在的图像位于纹理图像层或深度图像层,所述图像包括帧间编码图像、单向帧间编码图像、双向帧间编码图像、双假设帧间编码图像、视间帧间编码图像、依赖视点图像、依赖视点帧间编码图像、纹理帧间编码图像及深度帧间编码图像中的至少一项。Preferably, the image where the current decoding area is located is located in the texture image layer or the depth image layer, and the image includes an inter-frame coded image, a one-way inter-frame coded image, a bi-directional inter-frame coded image, a dual-hypothesis inter-frame coded image, a visual At least one of an inter-coded image, a viewpoint-dependent image, a viewpoint-dependent inter-coded image, a texture inter-coded image, and a depth inter-coded image.

优选地,所述当前解码区域的视间预测解码辅助信息包括当前解码区域是否采用所述多视点视频编码方法的信息。Preferably, the inter-view prediction decoding auxiliary information of the current decoding area includes information on whether the current decoding area adopts the multi-view video encoding method.

优选地,若所述当前解码区域采用所述多视点视频编码方法,则所述导出当前解码区域的视间预测信息,包括:根据解码候选视间预测信息确定当前解码区域的视间预测信息,所述解码候选视间预测信息包括已解码的其它解码区域的N1个视间预测信息、由已解码的其它解码区域的多个视间预测信息计算得到的N2个视间预测信息、预设的N3个视间预测信息、当前解码区域的局部视差信息、当前解码区域所在图像的全局视差信息中的至少一个信息,其中,N1、N2和N3均为正整数。Preferably, if the current decoding area adopts the multi-viewpoint video encoding method, then deriving the inter-view prediction information of the current decoding area includes: determining the inter-view prediction information of the current decoding area based on the decoding candidate inter-view prediction information, The decoding candidate inter-view prediction information includes N1 inter-view prediction information of other decoded areas that have been decoded, N2 inter-view prediction information calculated from a plurality of inter-view prediction information of other decoded areas that have been decoded, and preset At least one of N3 inter-view prediction information, local disparity information of the current decoding area, and global disparity information of the image where the current decoding area is located, where N1, N2, and N3 are all positive integers.

优选地,所述已解码的其它解码区域与所述当前解码区域位于相同或不同视点,所述已解码的其它解码区域与所述当前解码区域位于相同或不同图像层。Preferably, the other decoded areas and the current decoded area are located at the same or different viewpoints, and the other decoded areas and the current decoded area are located at the same or different image layers.

优选地,所述由已解码的其它解码区域的多个视间预测信息计算得到的N2个视间预测信息,包括:由已解码的其它解码区域的视间预测信息经过求平均值、最大值、最小值、中值、组合值、缩放值中的一种或多种计算得到的N2个视间预测信息。Preferably, the N2 pieces of inter-view prediction information calculated from a plurality of decoded inter-view prediction information of other decoding areas include: the decoded inter-view prediction information of other decoding areas through averaging and maximum values. , N2 inter-view prediction information calculated from one or more of the minimum value, median value, combination value, and scaling value.

优选地,所述根据解码候选视间预测信息确定当前解码区域的视间预测信息,包括:将解码候选视间预测信息中的一个信息,作为当前解码区域的视间预测信息。Preferably, determining the inter-view prediction information of the current decoding region based on the decoding candidate inter-view prediction information includes: using one piece of information in the decoding candidate inter-view prediction information as the inter-view prediction information of the current decoding region.

优选地,所述将解码候选视间预测信息中的一个信息,作为当前解码区域的视间预测信息,包括:将解码候选视间预测信息中,与编码器的约定规则规定的一个信息,作为当前解码区域的视间预测信息。Preferably, using one of the decoding candidate inter-view prediction information as the inter-view prediction information of the current decoding area includes: using one of the decoding candidate inter-view prediction information specified by the agreement with the encoder as Inter-view prediction information for the current decoding area.

优选地,所述当前解码区域的视间预测解码辅助信息,包括:编码器在编码候选视间预测信息索引中所选择的索引号,所述编码候选视间预测信息的索引号与所述解码候选视间预测信息的索引号相对应;所述将解码候选视间预测信息中的一个信息,作为当前解码区域的视间预测信息,包括:根据所述编码器所选择的索引号,在解码候选视间预测信息中选择索引号相对应的一个信息,作为当前解码区域的视间预测信息。Preferably, the inter-view prediction decoding auxiliary information of the current decoding area includes: an index number selected by the encoder in the encoding candidate inter-view prediction information index, and the index number of the encoding candidate inter-view prediction information is the same as the decoding inter-view prediction information. The index numbers of the candidate inter-view prediction information correspond to each other; the decoding of one of the candidate inter-view prediction information as the inter-view prediction information of the current decoding area includes: according to the index number selected by the encoder, during decoding One piece of information corresponding to the index number is selected from the candidate inter-view prediction information as the inter-view prediction information of the current decoding area.

为了实现上述目的,本发明还提供了一种多视点视频编码器,其包括:In order to achieve the above object, the present invention also provides a multi-viewpoint video encoder, which includes:

确定预测信息模块,用于确定当前编码区域的视间预测信息;Determine the prediction information module, used to determine the inter-view prediction information of the current coding area;

确定辅助信息模块,用于根据该当前编码区域的视间预测信息确定当前编码区域的视间预测解码辅助信息;a determining auxiliary information module, configured to determine inter-view prediction decoding auxiliary information of the current coding region based on the inter-view prediction information of the current coding region;

写入信息模块,用于在码流中编码写入该视间预测解码辅助信息,以允许解码器根据该视间预测解码辅助信息确定相应解码区域的视间预测信息。The writing information module is configured to encode and write the inter-view prediction decoding auxiliary information in the code stream to allow the decoder to determine the inter-view prediction information of the corresponding decoding area based on the inter-view prediction decoding auxiliary information.

为了实现上述目的,本发明还提供了一种多视点视频解码器,其包括:In order to achieve the above object, the present invention also provides a multi-view video decoder, which includes:

解析信息模块,用于从码流中解析出当前解码区域的视间预测解码辅助信息,该视间预测解码辅助信息由编码器根据相应编码区域的视间预测信息确定、并编码写入码流;The parsing information module is used to parse the inter-view prediction decoding auxiliary information of the current decoding area from the code stream. The inter-view prediction decoding auxiliary information is determined by the encoder based on the inter-view prediction information of the corresponding coding area, and is encoded and written into the code stream. ;

导出预测信息模块,用于根据该视间预测解码辅助信息导出当前解码区域的视间预测信息。A deriving prediction information module is configured to derive inter-view prediction information of the current decoding area based on the inter-view prediction decoding auxiliary information.

与现有技术相比,本发明的技术效果包括但不限于:Compared with the existing technology, the technical effects of the present invention include but are not limited to:

第一,利用多视点视频编码相邻块之间在视间预测中的相关性对多视点视频流编码,显著提高了视频的压缩效率。First, the correlation between adjacent blocks in multi-view video coding in inter-view prediction is used to encode multi-view video streams, which significantly improves the compression efficiency of the video.

第二,将视间预测解码辅助信息融入编码过程,节省了直接传输视间预测信息的码率开销,显著提高了编码效率。Second, inter-view prediction decoding auxiliary information is integrated into the encoding process, which saves the code rate overhead of directly transmitting inter-view prediction information and significantly improves coding efficiency.

第三,在码流中编码写入视间预测解码辅助信息,为解码器提供解码辅助信息,提高了解码效率。Third, inter-view prediction decoding auxiliary information is encoded and written in the code stream to provide the decoder with decoding auxiliary information and improve decoding efficiency.

附图说明Description of the drawings

为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域技术人员,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.

图1为本发明多视点视频编码方法的流程图;Figure 1 is a flow chart of the multi-viewpoint video encoding method of the present invention;

图2为本发明多视点视频解码方法的流程图;Figure 2 is a flow chart of the multi-viewpoint video decoding method of the present invention;

图3为本发明多视点视频编码器的模块框图;Figure 3 is a module block diagram of the multi-viewpoint video encoder of the present invention;

图4为本发明多视点视频解码器的模块框图。Figure 4 is a module block diagram of the multi-viewpoint video decoder of the present invention.

具体实施方式Detailed ways

为了使本技术领域的人员更好地理解本具体实施方式方案,下面将结合本具体实施方式实施例中的附图,对本具体实施方式实施例中的技术方案进行清楚、完整地描述。In order to enable those skilled in the art to better understand the technical solutions of this specific implementation mode, the technical solutions in the examples of this specific implementation mode will be clearly and completely described below in conjunction with the drawings in the examples of this specific implementation mode.

在本具体实施方式的说明书和权利要求书及上述附图中的描述的一些流程中,包含了按照特定顺序出现的多个操作,但是应该清楚了解,这些操作可以不按照其在本文中出现的顺序来执行或并行执行,操作的序号如101、102等,仅仅是用于区分开各个不同的操作,序号本身不代表任何的执行顺序。另外,这些流程可以包括更多或更少的操作,并且这些操作可以按顺序执行或并行执行。需要说明的是,本文中的“第一”、“第二”等描述,是用于区分不同的消息、设备、模块等,不代表先后顺序,也不限定“第一”和“第二”是不同的类型。Some of the processes described in the description and claims of this specific embodiment and the above-mentioned drawings include multiple operations that appear in a specific order, but it should be clearly understood that these operations may not be in the order they appear in this document. Executed sequentially or in parallel. The sequence numbers of operations, such as 101, 102, etc., are only used to distinguish different operations. The sequence numbers themselves do not represent any execution order. Additionally, these processes may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that the descriptions such as "first" and "second" in this article are used to distinguish different messages, devices, modules, etc., and do not represent the order, nor do they limit "first" and "second" are different types.

下面将结合本具体实施方式实施例中的附图,对本具体实施方式实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本具体实施方式一部分实施例,而不是全部的实施例。基于本具体实施方式中的实施例,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本具体实施方式保护的范围。The technical solutions in the embodiments of this embodiment will be clearly and completely described below with reference to the accompanying drawings in the embodiments of this embodiment. Obviously, the described embodiments are only part of the embodiments of this embodiment, not All examples. Based on the embodiments in this specific embodiment, all other embodiments obtained by those skilled in the art without making creative efforts fall within the scope of protection of this specific embodiment.

请参阅图1,本具体实施方式多视点视频编码方法包括以下步骤:Please refer to Figure 1. The multi-viewpoint video coding method in this specific implementation includes the following steps:

步骤101,确定当前编码区域的视间预测信息;Step 101, determine the inter-view prediction information of the current coding area;

步骤102,根据该当前编码区域的视间预测信息确定当前编码区域的视间预测解码辅助信息;Step 102: Determine the inter-view prediction decoding auxiliary information of the current coding area based on the inter-view prediction information of the current coding area;

步骤103,在码流中编码写入该视间预测解码辅助信息,以允许解码器根据该视间预测解码辅助信息确定相应解码区域的视间预测信息。Step 103: Encoding and writing the inter-view prediction decoding auxiliary information in the code stream to allow the decoder to determine the inter-view prediction information of the corresponding decoding area based on the inter-view prediction decoding auxiliary information.

请参阅图2,本具体实施方式多视点视频解码方法包括以下步骤:Please refer to Figure 2. The multi-viewpoint video decoding method in this specific implementation includes the following steps:

步骤201,从码流中解析出当前解码区域的视间预测解码辅助信息,该视间预测解码辅助信息由编码器根据相应编码区域的视间预测信息确定、并编码写入码流;Step 201: Parse the inter-view prediction decoding auxiliary information of the current decoding area from the code stream. The inter-view prediction decoding auxiliary information is determined by the encoder based on the inter-view prediction information of the corresponding coding area, and is encoded and written into the code stream;

步骤202,根据该视间预测解码辅助信息导出当前解码区域的视间预测信息。Step 202: Derive inter-view prediction information of the current decoding area based on the inter-view prediction decoding auxiliary information.

下面详细阐述本具体实施方式多视点视频编码方法与本具体实施方式多视点视频解码方法相互配合利用视间预测信息完成多视点视频编解码的完整过程。The following is a detailed description of the complete process of using the inter-view prediction information to complete multi-view video encoding and decoding in conjunction with the multi-view video encoding method of this specific embodiment and the multi-view video decoding method of this specific embodiment.

步骤301,编码器确定当前编码块的视间预测信息。Step 301: The encoder determines inter-view prediction information of the current coding block.

本实施例中,编码区域为编码块,而在其它实施例中,编码区域也可以是其它类型的单元,例如预测块、部分图像、条带、图像拼贴(Tile)、最大编码单元、编码单元、预测单元、宏块等。In this embodiment, the coding area is a coding block, but in other embodiments, the coding area can also be other types of units, such as prediction blocks, partial images, strips, image tiles, maximum coding units, coding units, etc. Unit, prediction unit, macroblock, etc.

当前编码块所在的图像可以位于纹理图像层,也可以位于深度图像层。其中,所在的图像可以是帧间编码图像、单向帧间编码图像、双向帧间编码图像、双假设帧间编码图像、视间帧间编码图像、依赖视点图像、依赖视点帧间编码图像、纹理帧间编码图像或者深度帧间编码图像等。The image where the current coding block is located can be located in the texture image layer or the depth image layer. Among them, the image can be an inter-frame coded image, a one-way inter-frame coded image, a bi-directional inter-frame coded image, a dual-hypothesis inter-frame coded image, an inter-view inter-frame coded image, a viewpoint-dependent image, a viewpoint-dependent inter-frame coded image, Texture inter-coded images or depth inter-frame coded images, etc.

编码器参考编码候选视间预测信息确定当前编码块的视间预测信息。编码候选视间预测信息包括已编码的其它编码块的N1个视间预测信息、由已编码的其它编码块的N1个(或多个)视间预测信息计算得到的N2个视间预测信息、预设的N3个视间预测信息、当前编码块的局部视差信息、当前编码块所在图像的全局视差信息中的至少一个信息,其中,N1、N2和N3均为正整数。The encoder determines the inter-view prediction information of the current coding block with reference to the coding candidate inter-view prediction information. The coding candidate inter-view prediction information includes N1 inter-view prediction information of other coded blocks that have been coded, N2 inter-view prediction information calculated from N1 (or more) inter-view prediction information of other coded blocks that have been coded, At least one of the preset N3 inter-view prediction information, the local disparity information of the current coding block, and the global disparity information of the image where the current coding block is located, where N1, N2 and N3 are all positive integers.

已编码的其它编码块是指在当前编码块之前已经编码完成的编码块。已编码的其它编码块与当前编码块可以属于同一视点、也可以属于不同的视点,可以属于同一图像层、也可以属于不同的图像层。例如,假设当前待编码的是纹理层的编码块,那么,可以参考当前编码块之前已经编码完成的N1个纹理层图像块或深度层图像块的视间预测信息,来确定当前待编码的纹理层图像块的视间预测信息;或者,也可以是部分参考纹理层图像块的视间预测信息,另一部分参考深度层图像块的视间预测信息,来确定当前待编码的纹理层图像编码块的视间预测信息。对于当前待编码的是深度层的编码块的情况也与之类似。Other coded blocks that have been coded refer to code blocks that have been coded before the current code block. The other coded blocks that have been coded and the current coded block may belong to the same viewpoint or different viewpoints, and may belong to the same image layer or different image layers. For example, assuming that what is currently to be encoded is a coding block of the texture layer, then the texture to be currently coded can be determined by referring to the inter-view prediction information of N1 texture layer image blocks or depth layer image blocks that have been coded before the current coding block. The inter-view prediction information of the layer image block; or, it can also be partly referenced to the inter-view prediction information of the texture layer image block, and the other part of the inter-view prediction information of the depth layer image block to determine the texture layer image coding block currently to be encoded. inter-view prediction information. The situation is similar when the encoding block of the depth layer is currently to be encoded.

由已编码的其它编码块的N1个视间预测信息计算得到的N2个视间预测信息,包括:由N1个视间预测信息经过求平均值、最大值、最小值、中值、组合值、缩放值或其它特征值中的一种或多种方式计算得到的N2个视间预测信息。N2 inter-view prediction information calculated from N1 inter-view prediction information of other coded blocks, including: average value, maximum value, minimum value, median value, combined value, N2 inter-view prediction information calculated using one or more methods of scaling values or other feature values.

具体地,编码器可以参考编码候选视间预测信息,采用以下几种方式确定当前编码块的视间预测信息。Specifically, the encoder may refer to the coding candidate inter-view prediction information and use the following methods to determine the inter-view prediction information of the current coding block.

本实施例中,编码器选择使用编码候选视间预测信息中的一个信息作为当前编码块的视间预测信息。例如,编码器将编码候选视间预测信息中的多个信息按照某种规则进行排序索引和淘汰处理,以选择一个信息作为当前编码块的视间预测信息,并记录所选择信息的索引号。In this embodiment, the encoder selects to use one of the coding candidate inter-view prediction information as the inter-view prediction information of the current coding block. For example, the encoder sorts, indexes, and eliminates multiple pieces of information in the encoding candidate inter-view prediction information according to certain rules to select one piece of information as the inter-view prediction information of the current encoding block, and records the index number of the selected information.

在其它的实施例中,编码器也可以固定使用编码候选视间预测信息中的一个信息作为当前编码块的视间预测信息。例如,编码器直接将已编码的其它编码块的N1个视间预测信息中的某一个视间预测信息作为当前编码块的视间预测信息,或者将当前编码块的局部视差信息作为当前编码块的视间预测信息。需要说明的是,在其它的实施例中,编码器也可以只对当前编码区域进行相关处理,而同一视点中与当前编码块属于不同图像层的对应的编码块则直接使用经过上述处理的当前编码块的计算结果。例如,编码器得到当前编码块的视间预测信息后,同一视点的深度层图像中与当前编码块对应的编码块的视间预测信息可以直接使用当前编码块的视间预测信息。In other embodiments, the encoder may also fixedly use one of the coding candidate inter-view prediction information as the inter-view prediction information of the current coding block. For example, the encoder directly uses one of the N1 inter-view prediction information of other coded blocks that has been coded as the inter-view prediction information of the current coded block, or uses the local disparity information of the current coded block as the current coded block. inter-view prediction information. It should be noted that in other embodiments, the encoder can also only perform relevant processing on the current coding area, and the corresponding coding blocks in the same viewpoint that belong to different image layers as the current coding block directly use the current coding block that has undergone the above processing. The calculation result of the coding block. For example, after the encoder obtains the inter-view prediction information of the current coding block, the inter-view prediction information of the coding block corresponding to the current coding block in the depth layer image of the same viewpoint can directly use the inter-view prediction information of the current coding block.

步骤302,编码器根据当前编码块的视间预测信息确定当前编码块的视间预测解码辅助信息。Step 302: The encoder determines the inter-view prediction decoding auxiliary information of the current coding block based on the inter-view prediction information of the current coding block.

本实施例中,当前编码块的视间预测解码辅助信息包括当前编码块是否采用步骤301的方法进行编码的标识,以及步骤301中,编码器在编码候选视间预测信息中所选择的信息对应的索引号。视间预测解码辅助信息能够帮助解码器对使用步骤301方法进行编码的码流进行解码。在其它的实施例中,当前编码块的视间预测解码辅助信息也可以仅包括当前编码块是否采用步骤301的方法进行编码的标识。In this embodiment, the inter-view prediction decoding auxiliary information of the current coding block includes an identification of whether the current coding block is encoded using the method of step 301, and in step 301, the information selected by the encoder in the coding candidate inter-view prediction information corresponds to index number. The inter-view prediction decoding auxiliary information can help the decoder decode the code stream encoded using the method of step 301. In other embodiments, the inter-view prediction decoding auxiliary information of the current coding block may also only include an identification of whether the current coding block is coded using the method of step 301.

步骤303,编码器在码流中编码写入视间预测解码辅助信息。Step 303: The encoder encodes and writes the inter-view prediction decoding auxiliary information in the code stream.

例如,对于当前编码块,编码器在码流中写入标识当前编码块采用了步骤301的方法进行编码的信息,或者写入标识当前编码块没有采用步骤301的方法进行编码的信息。For example, for the current encoding block, the encoder writes information in the code stream indicating that the current encoding block is encoded using the method of step 301, or writes information indicating that the current encoding block is not encoded using the method of step 301.

步骤304,解码器从码流中解析出当前解码块的视间预测解码辅助信息。Step 304: The decoder parses the inter-view prediction decoding auxiliary information of the current decoding block from the code stream.

本实施例中,解码区域为编码块,而在其它实施例中,解码区域也可以是其它类型的单元,例如预测块、部分图像、条带、图像拼贴(Tile)、最大编码单元、编码单元、预测单元、宏块等。In this embodiment, the decoding area is a coding block, but in other embodiments, the decoding area can also be other types of units, such as prediction blocks, partial images, strips, image tiles, maximum coding units, coding units, etc. Unit, prediction unit, macroblock, etc.

当前解码块所在的图像可以位于纹理图像层,也可以位于深度图像层。其中,所在的图像可以是帧间编码图像、单向帧间编码图像、双向帧间编码图像、双假设帧间编码图像、视间帧间编码图像、依赖视点图像、依赖视点帧间编码图像、纹理帧间编码图像或者深度帧间编码图像等。The image where the current decoding block is located can be located in the texture image layer or the depth image layer. Among them, the image can be an inter-frame coded image, a one-way inter-frame coded image, a bi-directional inter-frame coded image, a dual-hypothesis inter-frame coded image, an inter-view inter-frame coded image, a viewpoint-dependent image, a viewpoint-dependent inter-frame coded image, Texture inter-coded images or depth inter-frame coded images, etc.

当前解码块的视间预测解码辅助信息对应于步骤302中当前编码块的视间预测解码辅助信息。The inter-view prediction decoding auxiliary information of the current decoding block corresponds to the inter-view prediction decoding auxiliary information of the current encoding block in step 302.

步骤305,解码器根据该视间预测解码辅助信息导出当前解码区域的视间预测信息。Step 305: The decoder derives inter-view prediction information of the current decoding area based on the inter-view prediction decoding auxiliary information.

若当前解码块的视间预测解码辅助信息指示当前编码块采用了视间预测编码,则编码器参考解码候选视间预测信息确定当前解码块的视间预测信息。解码候选视间预测信息包括已解码的其它解码块的N1个视间预测信息、由已解码的其它解码块的N1个(或多个)视间预测信息计算得到的N2个视间预测信息、预设的N3个视间预测信息、当前解码块的局部视差信息、当前解码块所在图像的全局视差信息中的至少一个信息,其中,N1、N2和N3均为正整数。If the inter-view prediction decoding auxiliary information of the current decoding block indicates that the current coding block adopts inter-view prediction coding, the encoder determines the inter-view prediction information of the current decoding block with reference to the decoding candidate inter-view prediction information. The decoding candidate inter-view prediction information includes N1 inter-view prediction information of other decoded blocks that have been decoded, N2 inter-view prediction information calculated from the N1 (or more) inter-view prediction information of other decoded blocks that have been decoded, At least one of the preset N3 inter-view prediction information, the local disparity information of the current decoding block, and the global disparity information of the image where the current decoding block is located, where N1, N2 and N3 are all positive integers.

已解码的其它解码块是指在当前解码块之前已经解码完成的解码块。已解码的其它解码块与当前解码块可以属于同一视点、也可以属于不同的视点,可以属于同一图像层、也可以属于不同的图像层。例如,假设当前待解码的是纹理层的解码块,那么,可以参考当前解码块之前已经解码完成的N1个纹理层图像块或深度层图像块的视间预测信息,来确定当前待解码的纹理层图像块的视间预测信息;或者,也可以是部分参考纹理层图像块的视间预测信息,另一部分参考深度层图像块的视间预测信息,来确定当前待解码的纹理层图像编码块的视间预测信息。对于当前待解码的是深度层的解码块的情况也与之类似。Other decoded blocks that have been decoded refer to decoded blocks that have been decoded before the current decoded block. Other decoded blocks that have been decoded and the current decoded block may belong to the same viewpoint or different viewpoints, and may belong to the same image layer or different image layers. For example, assuming that what is currently to be decoded is a decoding block of the texture layer, then the texture that is currently to be decoded can be determined by referring to the inter-view prediction information of N1 texture layer image blocks or depth layer image blocks that have been decoded before the current decoding block. The inter-view prediction information of the layer image block; or, it can also be partially referenced to the inter-view prediction information of the texture layer image block, and the other part refers to the inter-view prediction information of the depth layer image block to determine the texture layer image coding block currently to be decoded. inter-view prediction information. The situation is similar when the decoding block of the depth layer is currently to be decoded.

由已解码的其它编码块的N1个视间预测信息计算得到的N2个视间预测信息,包括:由N1个视间预测信息经过求平均值、最大值、最小值、中值、组合值、缩放值或其它特征值中的一种或多种方式计算得到的N2个视间预测信息。N2 inter-view prediction information calculated from N1 inter-view prediction information of other decoded coding blocks, including: average value, maximum value, minimum value, median value, combined value, N2 inter-view prediction information calculated using one or more methods of scaling values or other feature values.

具体地,解码器可以参考解码候选视间预测信息,以与步骤301中编码器确定当前编码块视间预测信息的相同方式,确定当前解码块的视间预测信息。Specifically, the decoder may refer to the decoding candidate inter-view prediction information to determine the inter-view prediction information of the current decoding block in the same manner as the encoder determines the inter-view prediction information of the current encoding block in step 301.

本实施例中,解码器选择使用解码候选视间预测信息中的一个信息作为当前解码块的视间预测信息。例如,解码器通过步骤304中解析出的当前解码块视间预测解码辅助信息,获知编码器在编码候选视间预测信息中所选择的视间预测信息对应的索引号。然后,解码器在解码候选视间预测信息中查找相应的索引号(编码候选视间预测信息的索引号与解码候选视间预测信息的索引号相对应),并将查找到索引号对应的视间预测信息作为当前解码块的视间预测信息。这种情况下当前解码块的视间预测解码辅助信息包括当前解码块是否采用步骤301的方法进行编码的标识,以及步骤301中,编码器在编码候选视间预测信息中所选择的信息对应的索引号。In this embodiment, the decoder selects and uses one of the decoding candidate inter-view prediction information as the inter-view prediction information of the current decoding block. For example, the decoder obtains the index number corresponding to the inter-view prediction information selected by the encoder in the encoding candidate inter-view prediction information through the inter-view prediction decoding auxiliary information of the current decoding block parsed in step 304. Then, the decoder searches for the corresponding index number in the decoded candidate inter-view prediction information (the index number of the encoded candidate inter-view prediction information corresponds to the index number of the decoded candidate inter-view prediction information), and searches for the view corresponding to the index number. The inter-prediction information is used as the inter-view prediction information of the current decoding block. In this case, the inter-view prediction decoding auxiliary information of the current decoding block includes an identification of whether the current decoding block is encoded using the method of step 301, and the information corresponding to the information selected by the encoder in the encoding candidate inter-view prediction information in step 301. The index number.

在其它的实施例中,解码器也可以根据与编码器的约定规则,固定使用解码候选视间预测信息中的一个信息作为当前解码块的视间预测信息。例如,解码器中设定,以与编码器相同的方式(即预先约定的方式),直接将已解码的其它解码块的N1个视间预测信息中的某一个视间预测信息作为当前解码块的视间预测信息,或者将当前解码块的局部视差信息作为当前解码块的视间预测信息。这种情况下当前解码块的视间预测解码辅助信息仅包括当前解码块是否采用步骤301的方法进行编码的标识。需要说明的是,在其它的实施例中,解码器也可以只对当前解码区域进行相关处理,而同一视点中与当前解码块属于不同图像层的对应的解码块则直接使用经过上述处理的当前解码块的计算结果。例如,解码器得到当前解码块的视间预测信息后,同一视点的深度层图像中与当前解码块对应的解码块的视间预测信息可以直接使用当前解码块的视间预测信息。In other embodiments, the decoder may also fixedly use one piece of information in the decoding candidate inter-view prediction information as the inter-view prediction information of the current decoding block according to the agreed rules with the encoder. For example, the decoder is set to directly use one of the inter-view prediction information among the N1 inter-view prediction information of other decoded blocks as the current decoding block in the same manner as the encoder (that is, a pre-agreed manner). inter-view prediction information, or use the local disparity information of the current decoding block as the inter-view prediction information of the current decoding block. In this case, the inter-view prediction decoding auxiliary information of the current decoded block only includes an identification of whether the current decoded block is encoded using the method of step 301. It should be noted that in other embodiments, the decoder may only perform relevant processing on the current decoding area, and the corresponding decoding blocks in the same viewpoint that belong to different image layers as the current decoding block directly use the current decoding area that has undergone the above processing. The calculation result of the decoded block. For example, after the decoder obtains the inter-view prediction information of the current decoding block, the inter-view prediction information of the decoding block corresponding to the current decoding block in the depth layer image of the same viewpoint can directly use the inter-view prediction information of the current decoding block.

请参阅图3,本具体实施方式多视点视频编码器包括:Please refer to Figure 3. The multi-view video encoder in this specific implementation includes:

确定预测信息模块,用于确定当前编码区域的视间预测信息;Determine the prediction information module, used to determine the inter-view prediction information of the current coding area;

确定辅助信息模块,用于根据该当前编码区域的视间预测信息确定当前编码区域的视间预测解码辅助信息;a determining auxiliary information module, configured to determine inter-view prediction decoding auxiliary information of the current coding region based on the inter-view prediction information of the current coding region;

写入信息模块,用于在码流中编码写入该视间预测解码辅助信息,以允许解码器根据该视间预测解码辅助信息确定相应解码区域的视间预测信息。The writing information module is configured to encode and write the inter-view prediction decoding auxiliary information in the code stream to allow the decoder to determine the inter-view prediction information of the corresponding decoding area based on the inter-view prediction decoding auxiliary information.

确定预测信息模块、确定辅助信息模块和写入信息模块的工作过程分别对应于本具体实施方式多视点视频编码方法的步骤101、102和103,此处不再赘述。The working processes of determining the prediction information module, determining the auxiliary information module and writing information module respectively correspond to steps 101, 102 and 103 of the multi-viewpoint video coding method in this specific embodiment, and will not be described again here.

请参阅图4,本具体实施方式多视点视频解码器包括:Please refer to Figure 4. In this specific implementation, the multi-view video decoder includes:

解析信息模块,用于从码流中解析出当前解码区域的视间预测解码辅助信息,该视间预测解码辅助信息由编码器根据相应编码区域的视间预测信息确定、并编码写入码流;The parsing information module is used to parse the inter-view prediction decoding auxiliary information of the current decoding area from the code stream. The inter-view prediction decoding auxiliary information is determined by the encoder based on the inter-view prediction information of the corresponding coding area, and is encoded and written into the code stream. ;

导出预测信息模块,用于根据该视间预测解码辅助信息导出当前解码区域的视间预测信息。A deriving prediction information module is configured to derive inter-view prediction information of the current decoding area based on the inter-view prediction decoding auxiliary information.

解析信息模块和导出预测信息模块的工作过程分别对应于本具体实施方式随机接入请求方法的步骤201和202,此处不再赘述。The working processes of the parsing information module and the derived prediction information module respectively correspond to steps 201 and 202 of the random access request method in this specific embodiment, and will not be described again here.

为检验本具体实施方式的技术效果,在AVS2-3D标准的参考软件RFD7.0上应用本具体实施方式多视点视频编、解码方法。由于依赖视点中的编码块可以参考其它已经编码完成的编码块的视间预测信息来确定当前编码块的视间预测信息,节省了直接传输视间预测信息的编码位数,压缩效率大大提高。经过测试,当参考了空域相邻的左、上、左上、右上块和时域相邻块的视间预测信息时,单个视点的平均性能增益3%~4%。In order to test the technical effect of this specific implementation, the multi-viewpoint video encoding and decoding method of this specific implementation is applied on the reference software RFD7.0 of the AVS2-3D standard. Since coding blocks in dependent views can refer to the inter-view prediction information of other coded blocks that have been coded to determine the inter-view prediction information of the current coding block, the number of coding bits required to directly transmit the inter-view prediction information is saved, and the compression efficiency is greatly improved. After testing, when inter-view prediction information of adjacent left, upper, upper left, upper right blocks in the spatial domain and adjacent blocks in the temporal domain is referred to, the average performance gain of a single view is 3% to 4%.

需要说明的是,本具体实施方式的多视点视频编码方法、多视点视频解码方法、多视点视频编码器和多视点视频解码器可以应用于存储于存储介质中的视频文件,也可以应用于以码流方式实时传送的视频流中。例如,在编码方法中,编码器可以获取待编码的视频内容,通过上述方法对该视频内容进行编码。其中,编码器可以从存储介质中获取待编码的视频内容,也可以实时获取待编码的内容。又如,在编码方法中,编码器在进行编码之后,可以实时传输编码后的码流,也可以将编码后的码流保存在存储介质中。再如,在解码方法中,解码器可以获取待解码的视频码流,通过上述方法对该视频内容进行解码。其中,解码器可以从存储介质中获取待解码的视频码流,也可以实时获取待解码的码流。又如,在解码方法中,解码器在进行解码之后,可以实时播放解码之后的视频内容,也可以将解码后的视频内容存储在存储介质中。It should be noted that the multi-viewpoint video encoding method, multi-viewpoint video decoding method, multi-viewpoint video encoder and multi-viewpoint video decoder of this specific embodiment can be applied to video files stored in storage media, and can also be applied to video files stored in storage media. In the video stream transmitted in real time through code streaming. For example, in the encoding method, the encoder can obtain the video content to be encoded and encode the video content through the above method. Among them, the encoder can obtain the video content to be encoded from the storage medium, and can also obtain the content to be encoded in real time. For another example, in the encoding method, after encoding, the encoder can transmit the encoded code stream in real time or save the encoded code stream in a storage medium. For another example, in the decoding method, the decoder can obtain the video code stream to be decoded, and decode the video content through the above method. Among them, the decoder can obtain the video code stream to be decoded from the storage medium, or can obtain the code stream to be decoded in real time. For another example, in the decoding method, after decoding, the decoder can play the decoded video content in real time or store the decoded video content in a storage medium.

结合以上对本具体实施方式的详细描述可以看出,与现有技术相比,本具体实施方式至少具有以下有益的技术效果:Based on the above detailed description of this specific implementation mode, it can be seen that compared with the existing technology, this specific implementation mode has at least the following beneficial technical effects:

第一,利用多视点视频编码相邻块之间在视间预测中的相关性对多视点视频流编码,显著提高了视频的压缩效率。First, the correlation between adjacent blocks in multi-view video coding in inter-view prediction is used to encode multi-view video streams, which significantly improves the compression efficiency of the video.

第二,在码流中编码写入视间预测解码辅助信息,节省了直接传输视间预测信息的码率开销,显著提高了编码效率;同时为解码器提供解码辅助信息,提高了解码效率。Second, coding and writing inter-view prediction decoding auxiliary information in the code stream saves the code rate overhead of directly transmitting inter-view prediction information and significantly improves coding efficiency; at the same time, it provides decoding auxiliary information to the decoder, which improves decoding efficiency.

第三,根据已编码相邻块的视间预测信息确定当前编码块的视间预测信息,进一步提高了视频压缩率和编解码效率。Third, the inter-view prediction information of the current encoding block is determined based on the inter-view prediction information of the encoded adjacent blocks, which further improves the video compression rate and coding and decoding efficiency.

第四,针对多视点视频编码中基本视点和依赖视点的编码特点,在编码码流中传输当前编码区域是否采用视间预测信息编码的信息,进一步提高了编解码效率。Fourth, in view of the coding characteristics of basic viewpoint and viewpoint-dependent coding in multi-view video coding, the information of whether the current coding area is coded using inter-view prediction information is transmitted in the coding stream, which further improves the coding and decoding efficiency.

在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

另外,在本具体实施方式各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of this specific implementation mode can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.

本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:只读存储器(ROM,Read Only Memory)、随机存取存储器(RAM,RandomAccess Memory)、磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. The storage medium can include: Read Only Memory (ROM, Read Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.

以上对本具体实施方式所提供的方法和装置进行了详细介绍,对于本领域的一般技术人员,依据本具体实施方式实施例的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本具体实施方式的限制。The methods and devices provided by this specific embodiment have been introduced in detail above. For those of ordinary skill in the art, there will be changes in the specific implementation and application scope based on the ideas of the examples of this specific implementation. In summary, As mentioned above, the content of this description should not be understood as limiting this specific implementation.

Claims (44)

CN201611162916.2A2016-12-152016-12-15Multi-view video encoding and decoding methods, encoder and decoderActiveCN108616758B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201611162916.2ACN108616758B (en)2016-12-152016-12-15Multi-view video encoding and decoding methods, encoder and decoder

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201611162916.2ACN108616758B (en)2016-12-152016-12-15Multi-view video encoding and decoding methods, encoder and decoder

Publications (2)

Publication NumberPublication Date
CN108616758A CN108616758A (en)2018-10-02
CN108616758Btrue CN108616758B (en)2023-09-29

Family

ID=63658298

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201611162916.2AActiveCN108616758B (en)2016-12-152016-12-15Multi-view video encoding and decoding methods, encoder and decoder

Country Status (1)

CountryLink
CN (1)CN108616758B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN111935557B (en)*2019-05-132022-06-28华为技术有限公司Video processing method, device and system
CN112788325B (en)*2019-11-062023-06-02Oppo广东移动通信有限公司Image processing method, encoding device, decoding device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101222639A (en)*2007-01-092008-07-16华为技术有限公司 Inter-view prediction method, encoder and decoder in multi-view video technology
CN103747264A (en)*2014-01-032014-04-23华为技术有限公司Motion vector prediction method, coding equipment and decoding equipment
CN104079944A (en)*2014-06-302014-10-01华为技术有限公司Video coding motion vector list establishing method and system
CN104104963A (en)*2013-04-122014-10-15浙江大学Vector candidate list generation method and device
CN105264894A (en)*2013-04-052016-01-20三星电子株式会社 Method of determining inter prediction candidates for inter-layer decoding and encoding methods and devices

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP6039178B2 (en)*2011-09-152016-12-07シャープ株式会社 Image encoding apparatus, image decoding apparatus, method and program thereof
CN104604232A (en)*2012-04-302015-05-06数码士控股有限公司Method and apparatus for encoding multi-view images, and method and apparatus for decoding multi-view images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101222639A (en)*2007-01-092008-07-16华为技术有限公司 Inter-view prediction method, encoder and decoder in multi-view video technology
CN105264894A (en)*2013-04-052016-01-20三星电子株式会社 Method of determining inter prediction candidates for inter-layer decoding and encoding methods and devices
CN104104963A (en)*2013-04-122014-10-15浙江大学Vector candidate list generation method and device
CN103747264A (en)*2014-01-032014-04-23华为技术有限公司Motion vector prediction method, coding equipment and decoding equipment
CN104079944A (en)*2014-06-302014-10-01华为技术有限公司Video coding motion vector list establishing method and system

Also Published As

Publication numberPublication date
CN108616758A (en)2018-10-02

Similar Documents

PublicationPublication DateTitle
US9866847B2 (en)Method and module for acquiring position information of transform block
CN102055982B (en)Coding and decoding methods and devices for three-dimensional video
CN102857764B (en)The method and apparatus of intra prediction mode process
CN101986716B (en)Quick depth video coding method
JP2019528025A5 (en)
CN104581159B (en) Method and related device for determining block division method in video coding and decoding
CN109005412B (en)Method and apparatus for motion vector acquisition
CN102946536A (en)Candidate vector list constructing method and device thereof
CN103338370B (en)A kind of multi-view depth video fast encoding method
CN101355707B (en)Error control method for demixing and encoding stereo video
CN103379333B (en)The decoding method and its corresponding device of decoding method, video sequence code stream
CN101404766A (en)Multi-view point video signal encoding method
CN107820095A (en)A kind of long term reference image-selecting method and device
CN112042201A (en)Method and apparatus for encoding/decoding a point cloud representing a 3D object
WO2023142716A1 (en)Encoding method and apparatus, real-time communication method and apparatus, device, and storage medium
CN113709458A (en)Displacement vector prediction method, device and equipment in video coding and decoding
CN108616758B (en)Multi-view video encoding and decoding methods, encoder and decoder
CN116670714A (en)Method and apparatus for encoding/decoding point cloud geometry data captured by a spin sensor head
CN101568038B (en)Multi-viewpoint error resilient coding scheme based on disparity/movement joint estimation
CN102300098B (en)Video fault tolerance coding method based on reversible information hiding and redundancy technology
CN104782126A (en)Apparatus and method for coding/decoding multi-view image
CN101222640A (en) Method and device for determining reference frame
CN106170089B (en) Multiplex Coding Method Based on H.265
US10750201B2 (en)Encoding method, decoding method and device for video global disparity vector
WO2012095030A1 (en)Slice encoding method and device and slice decoding method and device

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp