技术领域Technical field
本发明涉及视频编码领域，具体而言，涉及一种便于VR视频编码的方法、装置、电子设备及存储介质。The present invention relates to the field of video coding, and in particular to a method, device, electronic device and storage medium for facilitating VR video coding.
背景技术Background technique
在目前的视频编码方案中，根据视频内容做自适应分层编码的算法主要有以下三类：对图像做分割、对编码块进行复杂度分析、对图像内容做分割或者识别。上述算法的主要问题是计算量普遍过大，对图像的分割和识别通常不具有实时性，使得在实时性很强的视频直播应用中无法应用上述算法。In the current video coding scheme, the algorithms for adaptive layered coding according to video content mainly have the following three types: segmentation of images, complexity analysis of coding blocks, and segmentation or recognition of image content. The main problem of the above algorithm is that the calculation amount is generally too large, and the segmentation and recognition of images are usually not real-time, so that the above algorithm cannot be applied in a live broadcast application with strong real-time performance.
全景VR的体育比赛直播，对视频的分辨率和帧速率指标要求都很高。如果直接采用普通的编码方法，视频流码率过高，会使得网络直播的困难极大。The panoramic VR sports live broadcast, the video resolution and frame rate indicators are very high. If the ordinary encoding method is directly adopted, the video stream rate is too high, which makes the live broadcast difficult.
发明内容Summary of the invention
有鉴于此，本发明实施例的目的在于提供一种便于VR视频编码的方法、装置、电子设备及存储介质，以缓解上述问题。In view of this, an object of the embodiments of the present invention is to provide a method, an apparatus, an electronic device, and a storage medium for facilitating VR video coding to alleviate the above problems.
第一方面，本发明实施例提供了一种便于VR视频编码的方法，所述方法包括：获取待编码的VR视频图像，所述VR视频图像包括第一图像以及第二图像；将所述第一图像以及所述第二图像均划分成预设行列数的像素块；针对所述第一图像中的每个所述像素块，在所述第二图像中确定出一个像素块作为适配块，计算该像素块到所述适配块之间的距离，其中，该像素块与所述适配块之间的相似度差异值最小；基于所述距离计算得到与所述距离对应的像素块的深度信息；在进行编码前，根据所述深度信息，将每个所述像素块进行分组，使得所述VR视频图像至少被分为两组。In a first aspect, an embodiment of the present invention provides a method for facilitating VR video coding, the method comprising: acquiring a VR video image to be encoded, where the VR video image includes a first image and a second image; An image and the second image are each divided into pixel blocks of a preset number of rows and columns; for each of the pixel blocks in the first image, one pixel block is determined as an adaptation block in the second image Calculating a distance between the pixel block and the adaptation block, wherein a similarity difference value between the pixel block and the adaptation block is the smallest; calculating a pixel block corresponding to the distance based on the distance Depth information; prior to encoding, each of the pixel blocks is grouped according to the depth information such that the VR video images are at least divided into two groups.
第二方面，本发明实施例提供了一种便于VR视频编码的装置，获取模块，用于获取待编码的VR视频图像，所述VR视频图像包括第一图像以及第二图像；划分模块，用于将所述第一图像以及所述第二图像均划分成预设行列数的像素块；计算模块，用于针对所述第一图像中的每个所述像素块，在所述第二图像中确定出一个像素块作为适配块，计算该像素块到所述适配块之间的距离，其中，该像素块与所述适配块之间的相似度差异值最小；所述计算模块，还用于基于所述距离计算得到与所述距离对应的像素块的深度信息；分组模块，用于在进行编码前，根据所述深度信息，将每个所述像素块进行分组，使得所述VR视频图像至少被分为两组。In a second aspect, an embodiment of the present invention provides a device for facilitating VR video coding, and an acquiring module, configured to acquire a VR video image to be encoded, where the VR video image includes a first image and a second image; And dividing the first image and the second image into pixel blocks of a preset number of rows and columns; and a calculating module, configured to: in the second image, for each of the pixel blocks in the first image Determining a pixel block as an adaptation block, calculating a distance between the pixel block and the adaptation block, wherein a similarity difference value between the pixel block and the adaptation block is the smallest; the calculation module And determining, by using the distance, a depth information of a pixel block corresponding to the distance, and a grouping module, configured to group each of the pixel blocks according to the depth information before performing encoding, so that The VR video images are divided into at least two groups.
第三方面，本发明实施例提供一种电子设备，包括相互连接的存储器、处理器，所述存储器内存储计算机程序，当所述计算机程序被所述处理器执行时，使得所述电子设备执行第一方面所述的方法。In a third aspect, an embodiment of the present invention provides an electronic device including a memory and a processor connected to each other, wherein the memory stores a computer program, and when the computer program is executed by the processor, causing the electronic device to execute The method of the first aspect.
第四方面，本发明实施例提供一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行第一方面所述的方法。In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium, where the computer readable storage medium stores a computer program, and when the computer program runs on a computer, causes the computer to execute the first aspect The method described.
与现有技术相比，本发明各实施例提出的便于VR视频编码的方法、装置、电子设备及存储介质的有益效果是：在获取到待编码的VR视频图像后，先将VR视频图像包括第一图像以及第二图像划分成预设行列数的像素块；然后针对所述第一图像中的每个所述像素块，在所述第二图像中确定出一个像素块作为适配块，计算该像素块到所述适配块之间的距离，其中，该像素块与所述适配块之间的相似度差异值最小；然后基于所述距离计算得到与所述距离对应的像素块的深度信息；在进行编码前，根据所述深度信息，将每个所述像素块进行分组，使得所述VR视频图像至少被分为两组，那么在后续进行VR视频编码时，与低质量组的视频内容相比，对高质量组的视频内容分配相对更多的码率，从而可以提高压缩效率，节省带宽。Compared with the prior art, the method, the device, the electronic device and the storage medium provided by the embodiments of the present invention have the beneficial effects of: after acquiring the VR video image to be encoded, first including the VR video image. The first image and the second image are divided into pixel blocks of a preset number of rows and columns; then, for each of the pixel blocks in the first image, one pixel block is determined as an adaptation block in the second image, Calculating a distance between the pixel block and the adaptation block, wherein a similarity difference value between the pixel block and the adaptation block is minimum; and then calculating a pixel block corresponding to the distance based on the distance Depth information; before encoding, each of the pixel blocks is grouped according to the depth information, so that the VR video image is divided into at least two groups, and then in the subsequent VR video encoding, with low quality Compared with the video content of the group, relatively high bit rate is allocated to the video content of the high quality group, thereby improving compression efficiency and saving bandwidth.
为使本发明的上述目的、特征和优点能更明显易懂，下文特举较佳实施例，并配合所附附图，作详细说明如下。The above described objects, features, and advantages of the invention will be apparent from the description and appended claims appended claims
附图说明DRAWINGS
为了更清楚地说明本发明实施例的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，应当理解，以下附图仅示出了本发明的某些实施例，因此不应被看作是对范围的限定，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他相关的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly described below. It should be understood that the following drawings show only certain embodiments of the present invention, and therefore It should be seen as a limitation on the scope, and those skilled in the art can obtain other related drawings according to these drawings without any creative work.
图1为本发明实施例提供的电子设备的结构框图；1 is a structural block diagram of an electronic device according to an embodiment of the present invention;
图2为本发明第一实施例提供的便于VR视频编码的方法的流程图之一；2 is a flowchart of a method for facilitating VR video coding according to a first embodiment of the present invention;
图3为本发明第一实施例提供的像素块到适配块之间的距离的示意图；3 is a schematic diagram of a distance between a pixel block and an adaptation block according to a first embodiment of the present invention;
图4为本发明第一实施例提供的领域像素块的示意图；4 is a schematic diagram of a domain pixel block according to a first embodiment of the present invention;
图5为本发明第一实施例提供的适配块的确定示意图；FIG. 5 is a schematic diagram of determining a matching block according to a first embodiment of the present invention;
图6为本发明第一实施例提供的常数a、b的计算示意图；FIG. 6 is a schematic diagram of calculations of constants a and b according to the first embodiment of the present invention; FIG.
图7为本发明第二实施例提供的便于VR视频编码的装置的结构框图。FIG. 7 is a structural block diagram of an apparatus for facilitating VR video coding according to a second embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。通常在此处附图中描述和示出的本发明实施例的组件可以以各种不同的配置来布置和设计。因此，以下对在附图中提供的本发明的实施例的详细描述并非旨在限制要求保护的本发明的范围，而是仅仅表示本发明的选定实施例。基于本发明的实施例，本领域技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of the embodiments of the invention, which are generally described and illustrated in the figures herein, may be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the invention in the claims All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
应注意到：相似的标号和字母在下面的附图中表示类似项，因此，一旦某一项在一个附图中被定义，则在随后的附图中不需要对其进行进一步定义和解释。同时，在本发明的描述中，术语“第一”、“第二”等仅用于区分描述，而不能理解为指示或暗示相对重要性。It should be noted that similar reference numerals and letters indicate similar items in the following figures. Therefore, once an item is defined in one figure, it is not necessary to further define and explain it in the subsequent figures. Also, in the description of the present invention, the terms "first", "second", and the like are used merely to distinguish a description, and are not to be construed as indicating or implying a relative importance.
如图1所示，是电子设备100的方框示意图。所述电子设备100可以包括：便于VR视频编码的装置、存储器110、存储控制器120、处理器130、外设接口140、输入输出单元150、音频单元160、显示单元170。其中，所述电子设备100可以是用户终端，例如个人电脑(personal computer，PC)、平板电脑、智能手机、个人数字助理(personal digitalassistant，PDA)等，也可以是服务器。As shown in FIG. 1, it is a block schematic diagram of an electronic device 100. The electronic device 100 may include: a device for facilitating VR video encoding, a memory 110, a memory controller 120, a processor 130, a peripheral interface 140, an input and output unit 150, an audio unit 160, and a display unit 170. The electronic device 100 may be a user terminal, such as a personal computer (PC), a tablet computer, a smart phone, a personal digital assistant (PDA), or the like, or may be a server.
所述存储器110、存储控制器120、处理器130、外设接口140、输入输出单元150、音频单元160以及显示单元170各元件相互之间直接或间接地电性连接，以实现数据的传输或交互。例如，这些元件相互之间可通过一条或多条通讯总线或信号线实现电性连接。所述便于VR视频编码的装置包括至少一个可以软件或固件(firmware)的形式存储于所述存储器110中或固化在电子设备的操作系统(operating system，OS)中的软件功能模块。所述处理器130用于执行存储器110中存储的可执行模块，例如所述便于VR视频编码的装置包括的软件功能模块或计算机程序。The components of the memory 110, the memory controller 120, the processor 130, the peripheral interface 140, the input and output unit 150, the audio unit 160, and the display unit 170 are electrically connected directly or indirectly to each other to implement data transmission or Interaction. For example, the components can be electrically connected to one another via one or more communication buses or signal lines. The apparatus for facilitating VR video encoding includes at least one software function module that can be stored in the memory 110 in the form of software or firmware or that is solidified in an operating system (OS) of the electronic device. The processor 130 is configured to execute an executable module stored in the memory 110, such as a software function module or a computer program included in the device for facilitating VR video encoding.
其中，存储器110可以是，但不限于，随机存取存储器(Random Access Memory，RAM)，只读存储器(Read Only Memory，ROM)，可编程只读存储器(Programmable Read-OnlyMemory，PROM)，可擦除只读存储器(Erasable Programmable Read-Only Memory，EPROM)，电可擦除只读存储器(Electric Erasable Programmable Read-Only Memory，EEPROM)等。其中，存储器110用于存储程序，所述处理器130在接收到执行指令后，执行所述程序，前述本发明实施例任一实施例揭示的流程定义的方法可以应用于处理器130中，或者由处理器130实现。The memory 110 may be, but not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read only memory (Programmable Read-Only Memory (PROM), and an erasable memory. Erasable Programmable Read-Only Memory (EPROM), Electric Erasable Programmable Read-Only Memory (EEPROM), and the like. The memory 110 is used to store a program, and the processor 130 executes the program after receiving the execution instruction. The method defined by any of the foregoing embodiments of the present invention may be applied to the processor 130, or It is implemented by the processor 130.
处理器130可能是一种集成电路芯片，具有信号的处理能力。上述的处理器130可以是通用处理器，包括中央处理器(Central Processing Unit，简称CPU)、网络处理器(Network Processor，简称NP)等；还可以是数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。Processor 130 may be an integrated circuit chip with signal processing capabilities. The processor 130 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP Processor, etc.), or a digital signal processor (DSP), an application specific integrated circuit. (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The methods, steps, and logical block diagrams disclosed in the embodiments of the present invention may be implemented or carried out. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
所述外设接口140将各种输入/输出装置耦合至处理器130以及存储器110。在一些实施例中，外设接口140，处理器130以及存储控制器120可以在单个芯片中实现。在其他一些实例中，他们可以分别由独立的芯片实现。The peripheral interface 140 couples various input/output devices to the processor 130 and the memory 110. In some embodiments, peripheral interface 140, processor 130, and memory controller 120 can be implemented in a single chip. In other instances, they can be implemented by separate chips.
输入输出单元150用于提供给用户输入数据实现用户与电子设备100的交互。所述输入输出单元150可以是，但不限于，鼠标和键盘等。The input and output unit 150 is configured to provide input data to the user to implement user interaction with the electronic device 100. The input and output unit 150 may be, but not limited to, a mouse, a keyboard, and the like.
音频单元160向用户提供音频接口，其可包括一个或多个麦克风、一个或者多个扬声器以及音频电路。The audio unit 160 provides an audio interface to the user, which may include one or more microphones, one or more speakers, and audio circuitry.
显示单元170在电子设备100与用户之间提供一个交互界面(例如用户操作界面)或用于显示图像数据给用户参考。在本实施例中，所述显示单元170可以是液晶显示器或触控显示器。若为触控显示器，其可为支持单点和多点触控操作的电容式触控屏或电阻式触控屏等。支持单点和多点触控操作是指触控显示器能感应到来自该触控显示器上一个或多个位置处同时产生的触控操作，并将该感应到的触控操作交由处理器130进行计算和处理。The display unit 170 provides an interactive interface (eg, a user interface) between the electronic device 100 and the user or for displaying image data to the user for reference. In this embodiment, the display unit 170 may be a liquid crystal display or a touch display. For a touch display, it can be a capacitive touch screen or a resistive touch screen that supports single-point and multi-touch operations. Supporting single-point and multi-touch operations means that the touch display can sense a touch operation simultaneously generated from one or more positions on the touch display, and the touch operation is transferred to the processor 130. Perform calculations and processing.
第一实施例First embodiment
请参照图2，图2是本发明第一实施例提供的一种便于VR视频编码的方法的流程图，所述方法应用于电子设备。下面将对图2所示的流程进行详细阐述，所述方法包括：Please refer to FIG. 2. FIG. 2 is a flowchart of a method for facilitating VR video coding according to a first embodiment of the present invention, where the method is applied to an electronic device. The flow shown in FIG. 2 will be elaborated below, and the method includes:
步骤S110：获取待编码的VR视频图像，所述VR视频图像包括第一图像以及第二图像。Step S110: Acquire a VR video image to be encoded, where the VR video image includes a first image and a second image.
由于VR视频图像有左右两种模式，因此，电子设备100获取到的VR视频图像可以包括左图像以及右图像。其中，左图像与右图像之间存在视角差异。Since the VR video image has two modes, the VR video image acquired by the electronic device 100 may include a left image and a right image. Among them, there is a difference in viewing angle between the left image and the right image.
可选的，所述第一图像可以为左图像，相应的，所述第二图像为右图像；可选的，所述第一图像可以为右图像，相应的，所述第二图像为左图像。Optionally, the first image may be a left image, and correspondingly, the second image is a right image. Optionally, the first image may be a right image, and correspondingly, the second image is a left image. image.
步骤S120：将所述第一图像以及所述第二图像均划分成预设行列数的像素块。Step S120: Dividing the first image and the second image into pixel blocks of a preset number of rows and columns.
其中，所述预设行列数可以为8行8列，即把所述第一图像以及所述第二图像均划分成8×8的像素块，每个像素块的尺寸大小相同。当然，作为一种可选的实施方式，也可以使用更大(例如9×9)或者更小(例如6×6)的分块原则。The preset number of rows and columns may be 8 rows and 8 columns, that is, the first image and the second image are all divided into 8×8 pixel blocks, and each pixel block has the same size. Of course, as an alternative embodiment, a larger (e.g., 9 x 9) or smaller (e.g., 6 x 6) blocking principle can also be used.
当然，作为一种可选的实施方式，在将所述第一图像以及所述第二图像均划分成预设数量的像素块之前，为了提高计算效率，还可以将所述第一图像以及所述第二图像分别进行二值化处理，得到与所述第一图像对应的第一梯度图像以及与所述第二图像对应的第二梯度图像。其中，图像二值化处理就是将图像上的像素点的灰度值设置为0或255，也就是将整个图像呈现出明显的黑白效果，其中，0表示白色，255表示黑色。将256个亮度等级的灰度图像通过选取适当的阈值而获得仍然可以反映图像整体和局部特征的二值化图像。例如，将灰度值大于或等于阈值的像素点的灰度值重置为255，将灰度值小于预设阈值的像素点的灰度值重置为0。Of course, as an optional implementation manner, before the first image and the second image are divided into a preset number of pixel blocks, in order to improve computational efficiency, the first image and the The second image is separately binarized to obtain a first gradient image corresponding to the first image and a second gradient image corresponding to the second image. Among them, the image binarization process is to set the gray value of the pixel on the image to 0 or 255, that is, to display the whole image with a distinct black and white effect, wherein 0 represents white and 255 represents black. A grayscale image of 256 brightness levels is obtained by selecting an appropriate threshold to obtain a binarized image that still reflects the overall and local features of the image. For example, the gradation value of the pixel point whose gradation value is greater than or equal to the threshold value is reset to 255, and the gradation value of the pixel point whose gradation value is less than the preset threshold value is reset to 0.
图像的二值化有利于图像的进一步处理，使图像变得简单，数据量减小，不仅能凸显出感兴趣的目标的轮廓，而且能降低计算复杂度。The binarization of the image facilitates the further processing of the image, making the image simple and reducing the amount of data, not only highlighting the contour of the target of interest, but also reducing the computational complexity.
其中，可以通过SOBEL或CANNEY算法对第一图像以及所述第二图像进行二值化处理，从而得到与所述第一图像对应的第一梯度图像以及与所述第二图像对应的第二梯度图像。The first image and the second image may be binarized by a SOBEL or CANNEY algorithm to obtain a first gradient image corresponding to the first image and a second gradient corresponding to the second image. image.
步骤S130：针对所述第一图像中的每个所述像素块，在所述第二图像中确定出一个像素块作为适配块，计算该像素块到所述适配块之间的距离，其中，该像素块与所述适配块之间的相似度差异值最小。Step S130: determining, for each of the pixel blocks in the first image, a pixel block as an adaptation block in the second image, and calculating a distance between the pixel block and the adaptation block, The difference in similarity between the pixel block and the adaptation block is the smallest.
由于第一图像与第二图像之间的关系是属于同一个VR视频图像，因此，第一图像与第二图像之间差异度主要是由于视角差异造成的。在这种情况下，针对第一图像中的每个像素块S，都可以在第二图像中找到与该像素块S对应的一个适配块D。其中，在将像素块S与第二图像中的每个像素块进行相似度差异值计算时，作为像素块S的适配块D与像素块S之间的相似度差异值最小。即当在所述第二图像中搜索到一个像素块D使得所述SAD最小时，其中，SAD为所述相似度差异值，确定该像素块D为与第一图像中的像素块S所对应的所述适配块，其中，S可以称之为源像素块，D可以称之为目的像素块。Since the relationship between the first image and the second image belongs to the same VR video image, the degree of difference between the first image and the second image is mainly due to the difference in viewing angle. In this case, for each pixel block S in the first image, one of the adaptation blocks D corresponding to the pixel block S can be found in the second image. Wherein, when the similarity difference value is calculated for each pixel block in the pixel block S and the second image, the similarity difference value between the adaptive block D and the pixel block S as the pixel block S is the smallest. That is, when a pixel block D is searched for in the second image such that the SAD is minimized, wherein SAD is the similarity difference value, it is determined that the pixel block D is corresponding to the pixel block S in the first image. The adaptation block, where S may be referred to as a source pixel block, and D may be referred to as a destination pixel block.
当预设行列数为8×8，且在进行相似度差异值计算时，可选的，针对所述第一图像中的每个所述像素块，将该像素块作为源像素块S，每个像素块对应的像素块矩阵的维度为8×8，其中，该像素块矩阵中的元素值为该像素块中的像素点的像素值，可以基于公式计算出该像素块与所述第二图像中的每个像素块之间的相似度差异值，其中，SAD为所述相似度差异值，Sij为该像素块中第i行第j列的像素点的像素值，dij为所述第二图像中某个像素块中第i行第j列的像素点的像素值。其中，i，j是像素块矩阵中像素元素的下标。When the preset number of rows and columns is 8×8, and when the similarity difference value calculation is performed, optionally, for each of the pixel blocks in the first image, the pixel block is used as the source pixel block S, and each The pixel block matrix corresponding to the pixel block has a dimension of 8×8, wherein the element value in the pixel block matrix is a pixel value of the pixel point in the pixel block, and may be based on a formula Calculating a similarity difference value between the pixel block and each of the pixel blocks in the second image, wherein SAD is the similarity difference value, and Sij is the i-th row and the j-th column in the pixel block The pixel value of the pixel, dij is the pixel value of the pixel of the i-th row and the j-th column in a certain pixel block in the second image. Where i, j is the subscript of the pixel element in the pixel block matrix.
请结合图3，针对所述第一图像中的每个所述像素块，在找到与之对应的适配块后，可以通过窗口搜索，计算得到该像素块(即源像素块S)和与之对应的适配块(即目的像素块D)之间的运动位移，即距离mv。Referring to FIG. 3, for each of the pixel blocks in the first image, after finding the matching block corresponding thereto, the pixel block (ie, the source pixel block S) and the The motion displacement between the corresponding adaptation blocks (ie, the destination pixel block D), that is, the distance mv.
为了计算mv，因此，无论是源像素块还是目的像素块，其坐标(x,y)分别基于像素块各自所在的1/2图像的左上角为原点来确定，其中，源像素块的左上角像素点的坐标和目的像素块左上角像素点的坐标的差值就是运动向量mv。由于第一图像和第二图像是左右图像，因此，源像素块的左上角像素点的坐标和目的像素块的左上角像素点的坐标之间的水平距离为运动向量mv。In order to calculate mv, therefore, whether it is a source pixel block or a destination pixel block, its coordinates (x, y) are determined based on the upper left corner of the 1/2 image in which the pixel blocks are respectively located, wherein the upper left corner of the source pixel block The difference between the coordinates of the pixel and the coordinates of the pixel at the upper left corner of the destination pixel block is the motion vector mv. Since the first image and the second image are left and right images, the horizontal distance between the coordinates of the upper left corner pixel of the source pixel block and the coordinates of the upper left corner pixel of the destination pixel block is the motion vector mv.
假设源像素块的坐标是(x＝8，y＝6),可以表述为S(8,16),目的像素块的坐标是(x＝25，y＝16)，可以表述为D(25,16)，那么mv的数值就是25-8＝17；当然也可能是负数，比如目的像素块的坐标是(x＝-2，y＝16)，那么运动向量mv就是-10。Suppose the coordinates of the source pixel block are (x=8, y=6), which can be expressed as S(8 ,16) , and the coordinates of the destination pixel block are (x=25, y=16), which can be expressed as D(25, 16) , then the value of mv is 25-8=17; of course, it may be a negative number. For example, the coordinates of the destination pixel block are (x=-2, y=16), then the motion vector mv is -10.
作为另一种可选的实施方式，针对第一图像中的源像素块S，在所述第二图像中搜索到多个像素块使得所述SAD最小时，为了确定出源像素块S的适配块，因此，将与所述源像素块S相邻的多个像素块确定为领域像素块，其中，请参看图4，领域像素块可以是第一图像中以S中心的8个像素块。As another optional implementation manner, for the source pixel block S in the first image, when searching for a plurality of pixel blocks in the second image such that the SAD is minimized, in order to determine the appropriateness of the source pixel block S a block, therefore, a plurality of pixel blocks adjacent to the source pixel block S are determined as domain pixel blocks, wherein, referring to FIG. 4, the domain pixel block may be 8 pixel blocks in the first image with S center. .
在确定了领域像素块之后，电子设备100可以获取所述领域像素块中所包括的每个像素块对应的适配块的位置区域，并统计出领域像素块中每个像素块的适配块的位置分布，然后将位置分布中出现频率最高的区域作为目标区域。由于领域像素块与源像素块S之间存在一定的相似度，因此，源像素块S的适配块D也极有可能出现在目标区域。因此，可以将使得所述SAD最小的所述多个像素块中属于所述目标区域的像素块确定为与所述源像素块S对应的适配块。请参看图5，图中A点作为适配块出现的频率最高，因此将A点作为与源像素块S对应的适配块。After determining the domain pixel block, the electronic device 100 may acquire a location area of the adaptation block corresponding to each pixel block included in the domain pixel block, and count the adaptation block of each pixel block in the domain pixel block. The position distribution, and then the area with the highest frequency of occurrence in the position distribution is taken as the target area. Since there is a certain degree of similarity between the domain pixel block and the source pixel block S, the adaptation block D of the source pixel block S is also highly likely to appear in the target area. Therefore, a pixel block belonging to the target area among the plurality of pixel blocks that minimizes the SAD may be determined as an adaptation block corresponding to the source pixel block S. Referring to FIG. 5, point A appears as the adaptation block with the highest frequency, so point A is used as the adaptation block corresponding to the source pixel block S.
步骤S140：基于所述距离计算得到与所述距离对应的像素块的深度信息。Step S140: Calculate depth information of the pixel block corresponding to the distance based on the distance.
可选的，可以基于公式计算得到所述深度信息，其中，深度信息为拍摄物体和摄像机之间的距离，Z为所述深度信息，a与b为常数，mv为所述源像素块S和所述适配块之间的距离。Optional, based on formula Calculating the depth information, wherein the depth information is a distance between the photographic subject and the camera, Z is the depth information, a and b are constants, and mv is between the source pixel block S and the adaptation block the distance.
请结合图6，的推导过程可以参考如下过程：Please refer to Figure 6, The derivation process can refer to the following process:
为了建立深度信息与mv之间的关系，因此，根据拍摄物体和摄像机之间的距离(d)、左右眼图像之间的视差(mv)，以及三角形的相似性，可以得到：d/dt＝dv/mv，其中，dv为摄像机与左右眼图像之间的距离，dt为瞳距，由于摄像机与左右眼图像之间的距离是变量不是常量，因此，需要将d/dt＝dv/mv中的dv消去。In order to establish the relationship between the depth information and the mv, therefore, according to the distance between the object and the camera (d), the parallax between the left and right eye images (mv), and the similarity of the triangle, it can be obtained: d/dt= Dv/mv, where dv is the distance between the camera and the left and right eye images, and dt is the pupil distance. Since the distance between the camera and the left and right eye images is not a constant, it is necessary to use d/dt=dv/mv. The dv disappeared.
由于相机焦距是fk，根据相机成像原理，建立dv与d的线性关系，继而可以得到：1/d+1/dv＝1/fk，使得dv由d来表示，请参考下式。Since the camera focal length is fk, according to the camera imaging principle, a linear relationship between dv and d is established, and then: 1/d+1/dv=1/fk can be obtained, so that dv is represented by d, please refer to the following formula.
dv＝1/(1/fk-1/d)Dv=1/(1/fk-1/d)
通过将dv的表达式带入d/dt＝dv/mv，继而可以得到：By bringing the expression of dv into d/dt=dv/mv, you can get:
d/dt＝1/((1/fk-1/d)*mv)，使得该表达式不受dv的影响。d/dt=1/((1/fk-1/d)*mv), so that the expression is not affected by dv.
通过将d/dt＝1/((1/fk-1/d)*mv)作进一步变形，继而可以得到：By further deforming d/dt=1/((1/fk-1/d)*mv), it is then obtained:
d*mv＝dt/(1/fk-1/d)d*mv=dt/(1/fk-1/d)
d*mv＝dt/((d-fk)/(fk*d))d*mv=dt/((d-fk)/(fk*d))
d*mv＝dt*fk*d/(d-fk)d*mv=dt*fk*d/(d-fk)
(d-fk)*mv＝dt*fk(d-fk)*mv=dt*fk
进一步地，得到等式：d＝dt*fk/mv+fk。Further, the equation is obtained: d = dt * fk / mv + fk.
由于瞳距和焦距都是常量，上式可进一步转换为：Since both the pupil distance and the focal length are constant, the above equation can be further converted to:
由于上式中存在两个未知参数a和b，因此，需要构建两个方程来联立求解a和b，其中，这两个参数可以通过两组实物拍摄图像得到：Since there are two unknown parameters a and b in the above formula, it is necessary to construct two equations to solve a and b in parallel, wherein these two parameters can be obtained by two sets of physical images:
其中，d0为第一组实物拍摄图像中的实物与摄像机的距离，mv0为第一组实物拍摄图像中的实物的左眼重叠图像与右眼图像之间的运动向量,d1为第二组实物拍摄图像中的实物与摄像机的距离，mv1为第二组实物拍摄图像中的实物的左眼重叠图像与右眼图像之间的运动向量，d0、d1、mv0以及mv1都是可以通过测量得到的数据，代入上述方程组，即可解出a，b的数值。 Wherein d0 is the distance between the physical object and the camera in the first set of physical captured images, and mv0 is the motion vector between the left-eye superimposed image and the right-eye image of the real object in the first set of physical captured images, and d1 is the second set of physical objects. The distance between the object and the camera in the captured image, mv1 is the motion vector between the left-eye superimposed image and the right-eye image of the object in the second group of the physical captured image, and d0, d1, mv0, and mv1 are all obtainable by measurement. Data, substituted into the above equations, can solve the values of a, b.
步骤S150：在进行编码前，根据所述深度信息，将每个所述像素块进行分组，使得所述VR视频图像至少被分为两组。Step S150: Before performing encoding, group each of the pixel blocks according to the depth information, so that the VR video images are at least divided into two groups.
在摄像机在拍摄物体前时，在对图像进行编码时，需要以对某些区域的图像分配高码率，某些区域的图像分配低码率，从而可以提高压缩效率，节省带宽，在主观质量没有明显差别的前提下，节约码率，因此，需要对摄像机拍摄到区域进行划分，作为一种实施方式，可以人为地在拍摄环境下设置四个标志物，从而计算得到常数a与b，并得到标志物的深度数据作为深度裁剪的窗口边界值，并根据深度裁剪的窗口边界值以对摄像机拍摄到区域进行划分，根据像素块的深度数据判断该像素块是否属于根据深度裁剪的窗口边界值确定的窗口区域内，将位于窗口区域内的像素块划分为高质量组，将位于窗口区域外的像素块划分为低质量组，在对VR视频图像进行编码时，基于第一码率对属于高质量组的像素块进行编码，基于第二码率对属于低质量组的像素块进行编码，其中，第一码率的值大于第二码率的值。When the camera is in front of the object, when encoding the image, it is necessary to assign a high code rate to the image of some areas, and the image of some areas is assigned a low code rate, thereby improving compression efficiency, saving bandwidth, and subjective quality. Without significant difference, the code rate is saved. Therefore, it is necessary to divide the area captured by the camera. As an implementation manner, four markers can be artificially set in the shooting environment, thereby calculating the constants a and b, and Obtaining the depth data of the marker as a window clipping value of the depth clipping, and dividing the image captured by the camera according to the depth of the window boundary value, and determining whether the pixel block belongs to the window boundary value according to the depth according to the depth data of the pixel block. In the determined window area, the pixel block located in the window area is divided into high quality groups, and the pixel blocks located outside the window area are divided into low quality groups, and when the VR video image is encoded, the first code rate pair is belonged to The pixel block of the high quality group is encoded, and the pixel block belonging to the low quality group is performed based on the second code rate. Encoding, wherein the value of the first code rate is greater than the value of the second code rate.
因此，通过将VR视频图像进行分层，在后续进行VR视频编码时，基于上述码率分配方式，与低质量组的视频图像相比，对高质量组的视频图像分配相对较多的码率，可以提高压缩效率，节省带宽，在主观质量没有明显差别的前提下，可以节省码率。Therefore, by layering the VR video image, when the VR video encoding is performed later, based on the above-described rate allocation method, a relatively high code rate is allocated to the high quality group of video images compared to the low quality group video image. It can improve the compression efficiency and save bandwidth. Under the premise that there is no significant difference in subjective quality, the code rate can be saved.
本发明第一实施例提供的一种便于VR视频编码的方法，在获取到待编码的VR视频图像后，先将VR视频图像包括第一图像以及第二图像划分成预设行列数的像素块；然后针对所述第一图像中的每个所述像素块，在所述第二图像中确定出一个像素块作为适配块，计算该像素块到所述适配块之间的距离，其中，该像素块与所述适配块之间的相似度差异值最小；然后基于所述距离计算得到与所述距离对应的像素块的深度信息；在进行编码前，根据所述深度信息，将每个所述像素块进行分组，使得所述VR视频图像至少被分为两组，那么在后续进行VR视频编码时，与低质量组的视频图像相比，对高质量组的视频图像分配相对更多的码率，从而可以提高压缩效率，节省带宽。A method for facilitating VR video coding according to the first embodiment of the present invention, after acquiring a VR video image to be encoded, first dividing the VR video image including the first image and the second image into pixel blocks of a preset number of rows and columns And then determining, for each of the pixel blocks in the first image, a pixel block as an adaptation block in the second image, and calculating a distance between the pixel block and the adaptation block, wherein And obtaining a similarity difference value between the pixel block and the adaptation block; and then calculating depth information of the pixel block corresponding to the distance based on the distance; before performing encoding, according to the depth information, Each of the pixel blocks is grouped such that the VR video images are divided into at least two groups, and then, when VR video encoding is performed subsequently, the video image allocation of the high quality group is relatively compared with the video image of the low quality group. More code rates, which can improve compression efficiency and save bandwidth.
第二实施例Second embodiment
请参照图7，图7是本发明第二实施例提供的一种便于VR视频编码的装置400的结构框图。下面将对图7所示的结构框图进行阐述，所示装置包括：Please refer to FIG. 7. FIG. 7 is a structural block diagram of an apparatus 400 for facilitating VR video coding according to a second embodiment of the present invention. The structural block diagram shown in FIG. 7 will be explained below, and the device shown includes:
获取模块410，用于获取待编码的VR视频图像，所述VR视频图像包括第一图像以及第二图像；The obtaining module 410 is configured to acquire a VR video image to be encoded, where the VR video image includes a first image and a second image;
划分模块420，用于将所述第一图像以及所述第二图像均划分成预设行列数的像素块；a dividing module 420, configured to divide the first image and the second image into pixel blocks of a preset number of rows and columns;
计算模块430，用于针对所述第一图像中的每个所述像素块，在所述第二图像中确定出一个像素块作为适配块，计算该像素块到所述适配块之间的距离，其中，该像素块与所述适配块之间的相似度差异值最小；a calculating module 430, configured to determine, in the second image, a pixel block as an adaptation block for each of the pixel blocks in the first image, and calculate the pixel block to be between the adaptation blocks a distance in which a difference in similarity between the pixel block and the adaptation block is the smallest;
所述计算模块430，还用于基于所述距离计算得到与所述距离对应的像素块的深度信息；The calculating module 430 is further configured to calculate, according to the distance, depth information of a pixel block corresponding to the distance;
分组模块440，用于在进行编码前，根据所述深度信息，将每个所述像素块进行分组，使得所述VR视频图像至少被分为两组。The grouping module 440 is configured to group each of the pixel blocks according to the depth information before encoding, so that the VR video images are divided into at least two groups.
可选的，所述装置还包括：预处理模块，用于将所述第一图像以及所述第二图像分别进行二值化处理，得到与所述第一图像对应的第一梯度图像以及与所述第二图像对应的第二梯度图像。Optionally, the device further includes: a pre-processing module, configured to separately perform binarization processing on the first image and the second image to obtain a first gradient image corresponding to the first image and a second gradient image corresponding to the second image.
可选的，所述计算模块430，用于针对所述第一图像中的每个所述像素块，基于公式计算出该像素块与所述第二图像中的每个像素块之间的相似度差异值，其中，SAD为所述相似度差异值，Sij为所述第一图像中第i行第j列的像素块，dij为所述第二图像中第i行第j列的像素块；当在所述第二图像中搜索到一个像素块使得所述SAD最小时，确定该像素块为与所述Sij对应的所述适配块。Optionally, the calculating module 430 is configured to be based on a formula for each of the pixel blocks in the first image. Calculating a similarity difference value between the pixel block and each of the pixel blocks in the second image, wherein SAD is the similarity difference value, and Sij is the i-th row in the first image a pixel block of a column, dij is a pixel block of an i-th row and a j-th column in the second image; when a pixel block is searched for in the second image such that the SAD is minimized, determining the pixel block as The adaptation block corresponding to the Sij .
可选的，所述计算模块430，还用于当在所述第二图像中搜索到多个像素块使得所述SAD最小时，将与所述Sij相邻的多个像素块确定为领域像素块；获取所述领域像素块所包括的每个像素块对应的适配块的位置区域，确定出适配块出现频率最高的区域作为目标区域；将使得所述SAD最小的所述多个像素块中属于所述目标区域的像素块确定为与所述Sij对应的适配块。Optionally, the calculating module 430 is further configured to: when a plurality of pixel blocks are searched in the second image such that the SAD is minimized, determine a plurality of pixel blocks adjacent to the Sij as a domain. a pixel block; acquiring a location area of the adaptation block corresponding to each pixel block included in the domain pixel block, determining an area where the adaptation block has the highest frequency of occurrence as the target area; and the plurality of the SAD to be minimized A pixel block belonging to the target area in the pixel block is determined as an adaptation block corresponding to the Sij .
可选的，所述计算模块430，还用于基于公式计算得到所述深度信息，其中，Z为所述深度信息，a与b为常数，mv为所述距离。Optionally, the calculating module 430 is further configured to be based on a formula The depth information is calculated, wherein Z is the depth information, a and b are constants, and mv is the distance.
本实施例对便于VR视频编码的装置400的各功能模块实现各自功能的过程，请参见上述图1至图5所示实施例中描述的内容，此处不再赘述。For the process of implementing the respective functions of the function modules of the apparatus 400 for facilitating the VR video encoding, refer to the content described in the embodiment shown in FIG. 1 to FIG. 5, and details are not described herein again.
此外，本发明实施例还提供了一种电子设备，其示意图可以如图1所示，包括相互连接的存储器110、处理器120，所述存储器110内存储计算机程序，当所述计算机程序被所述处理器120执行时，使得所述电子设备100执行本发明任一项实施方式所提供的便于VR视频编码的方法。In addition, an embodiment of the present invention further provides an electronic device, which may be shown in FIG. 1 , and includes a memory 110 and a processor 120 connected to each other. The memory 110 stores a computer program, where the computer program is When the processor 120 is executed, the electronic device 100 is caused to perform a method for facilitating VR video encoding provided by any of the embodiments of the present invention.
此外，本发明实施例还提供了一种计算机可读存储介质，在该计算机可读存储介质中存储有计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行本发明任一项实施方式所提供的便于VR视频编码的方法。Furthermore, embodiments of the present invention also provide a computer readable storage medium having stored therein a computer program that, when executed on a computer, causes the computer to perform any of the present invention A method for facilitating VR video coding provided by an embodiment.
此外，本发明实施例还提供了一种计算机程序，该计算机程序可以存储在云端或者本地的存储介质上，当所述计算机程序在计算机上运行时，使得所述计算机执行本发明任一项实施方式所提供的便于VR视频编码的方法。In addition, an embodiment of the present invention further provides a computer program, which may be stored in a cloud or a local storage medium, and when the computer program runs on a computer, causes the computer to perform any implementation of the present invention. The method provided by the method for facilitating VR video coding.
综上所述，本发明实施例提出的便于VR视频编码的方法、装置、电子设备及存储介质，在获取到待编码的VR视频图像后，先将VR视频图像包括第一图像以及第二图像划分成预设行列数的像素块；然后针对所述第一图像中的每个所述像素块，在所述第二图像中确定出一个像素块作为适配块，计算该像素块到所述适配块之间的距离，其中，该像素块与所述适配块之间的相似度差异值最小；然后基于所述距离计算得到与所述距离对应的像素块的深度信息；在进行编码前，根据所述深度信息，将每个所述像素块进行分组，使得所述VR视频图像至少被分为两组，那么在后续进行VR视频编码时，与低质量组的视频图像相比，对高质量组的视频图像分配相对更多的码率，从而可以提高压缩效率，节省带宽。In summary, the method, device, electronic device and storage medium for facilitating VR video coding according to embodiments of the present invention, after acquiring the VR video image to be encoded, first including the VR video image with the first image and the second image. a pixel block divided into a preset number of rows and columns; then, for each of the pixel blocks in the first image, one pixel block is determined as an adaptation block in the second image, and the pixel block is calculated to the Adapting a distance between blocks, wherein a similarity difference value between the pixel block and the adaptation block is minimum; and then calculating depth information of the pixel block corresponding to the distance based on the distance; Before, according to the depth information, each of the pixel blocks is grouped, so that the VR video image is divided into two groups at least, and then, when the VR video encoding is performed later, compared with the video image of the low quality group, A relatively high code rate is allocated to a high-quality group of video images, thereby improving compression efficiency and saving bandwidth.
在本申请所提供的几个实施例中，应该理解到，所揭露的装置和方法，也可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的，例如，附图中的流程图和框图显示了根据本发明的多个实施例的装置、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分，所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现方式中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个连续的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或动作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may also be implemented in other manners. The apparatus embodiments described above are merely illustrative, for example, the flowcharts and block diagrams in the figures illustrate the architecture, functionality, and functionality of possible implementations of apparatus, methods, and computer program products according to various embodiments of the invention. operating. In this regard, each block of the flowchart or block diagram can represent a module, a program segment, or a portion of code that includes one or more of the Executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may also occur in a different order than those illustrated in the drawings. For example, two consecutive blocks may be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or action. Or it can be implemented by a combination of dedicated hardware and computer instructions.
另外，在本发明各个实施例中的各功能模块可以集成在一起形成一个独立的部分，也可以是各个模块单独存在，也可以两个或两个以上模块集成形成一个独立的部分。In addition, each functional module in each embodiment of the present invention may be integrated to form a separate part, or each module may exist separately, or two or more modules may be integrated to form a separate part.
所述功能如果以软件功能模块的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。The functions, if implemented in the form of software functional modules and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. . It should be noted that, in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is any such actual relationship or order between them. Furthermore, the term "comprises" or "comprises" or "comprises" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。应注意到：相似的标号和字母在下面的附图中表示类似项，因此，一旦某一项在一个附图中被定义，则在随后的附图中不需要对其进行进一步定义和解释。The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention. It should be noted that similar reference numerals and letters indicate similar items in the following figures. Therefore, once an item is defined in one figure, it is not necessary to further define and explain it in the subsequent figures.
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应所述以权利要求的保护范围为准。The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910022693.7ACN109451318B (en) | 2019-01-09 | 2019-01-09 | Method, apparatus, electronic device and storage medium for facilitating VR video encoding |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910022693.7ACN109451318B (en) | 2019-01-09 | 2019-01-09 | Method, apparatus, electronic device and storage medium for facilitating VR video encoding |
| Publication Number | Publication Date |
|---|---|
| CN109451318Atrue CN109451318A (en) | 2019-03-08 |
| CN109451318B CN109451318B (en) | 2022-11-01 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910022693.7AExpired - Fee RelatedCN109451318B (en) | 2019-01-09 | 2019-01-09 | Method, apparatus, electronic device and storage medium for facilitating VR video encoding |
| Country | Link |
|---|---|
| CN (1) | CN109451318B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111954085A (en)* | 2020-08-06 | 2020-11-17 | 咪咕文化科技有限公司 | VR video display method, device, network device and storage medium |
| CN114786037A (en)* | 2022-03-17 | 2022-07-22 | 青岛虚拟现实研究院有限公司 | Self-adaptive coding compression method facing VR projection |
| US12363317B2 (en) | 2019-09-27 | 2025-07-15 | Tencent America LLC | Method for signaling output subpicture layer set |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101965733A (en)* | 2008-03-09 | 2011-02-02 | Lg电子株式会社 | Be used to encode or the method and apparatus of decoded video signal |
| CN104427345A (en)* | 2013-09-11 | 2015-03-18 | 华为技术有限公司 | Motion vector acquisition method, acquisition device, video codec and method thereof |
| CN104702954A (en)* | 2013-12-05 | 2015-06-10 | 华为技术有限公司 | Video coding method and device |
| WO2015200820A1 (en)* | 2014-06-26 | 2015-12-30 | Huawei Technologies Co., Ltd. | Method and device for providing depth based block partitioning in high efficiency video coding |
| CN102970529B (en)* | 2012-10-22 | 2016-02-17 | 北京航空航天大学 | A kind of object-based multi-view point video fractal image compression & decompression method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101965733A (en)* | 2008-03-09 | 2011-02-02 | Lg电子株式会社 | Be used to encode or the method and apparatus of decoded video signal |
| CN102970529B (en)* | 2012-10-22 | 2016-02-17 | 北京航空航天大学 | A kind of object-based multi-view point video fractal image compression & decompression method |
| CN104427345A (en)* | 2013-09-11 | 2015-03-18 | 华为技术有限公司 | Motion vector acquisition method, acquisition device, video codec and method thereof |
| CN104702954A (en)* | 2013-12-05 | 2015-06-10 | 华为技术有限公司 | Video coding method and device |
| WO2015200820A1 (en)* | 2014-06-26 | 2015-12-30 | Huawei Technologies Co., Ltd. | Method and device for providing depth based block partitioning in high efficiency video coding |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12363317B2 (en) | 2019-09-27 | 2025-07-15 | Tencent America LLC | Method for signaling output subpicture layer set |
| CN111954085A (en)* | 2020-08-06 | 2020-11-17 | 咪咕文化科技有限公司 | VR video display method, device, network device and storage medium |
| CN114786037A (en)* | 2022-03-17 | 2022-07-22 | 青岛虚拟现实研究院有限公司 | Self-adaptive coding compression method facing VR projection |
| CN114786037B (en)* | 2022-03-17 | 2024-04-12 | 青岛虚拟现实研究院有限公司 | VR projection-oriented adaptive coding compression method |
| Publication number | Publication date |
|---|---|
| CN109451318B (en) | 2022-11-01 |
| Publication | Publication Date | Title |
|---|---|---|
| KR102319177B1 (en) | Method and apparatus, equipment, and storage medium for determining object pose in an image | |
| US10198623B2 (en) | Three-dimensional facial recognition method and system | |
| US10885660B2 (en) | Object detection method, device, system and storage medium | |
| US11600008B2 (en) | Human-tracking methods, systems, and storage media | |
| CN108596944B (en) | Method and device for extracting moving target and terminal equipment | |
| US20110267348A1 (en) | Systems and methods for generating a virtual camera viewpoint for an image | |
| CN111402170B (en) | Image enhancement method, device, terminal and computer readable storage medium | |
| CN111008935B (en) | Face image enhancement method, device, system and storage medium | |
| CN106845331A (en) | A kind of image processing method and terminal | |
| CN112785492A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN109451318B (en) | Method, apparatus, electronic device and storage medium for facilitating VR video encoding | |
| WO2018082308A1 (en) | Image processing method and terminal | |
| CN108510529A (en) | A kind of figure based on adaptive weight cuts solid matching method | |
| CN107272899B (en) | A VR interaction method, device and electronic device based on dynamic gestures | |
| CN110782390A (en) | Image correction processing method and device, electronic equipment | |
| CN113963305A (en) | Video key frame and close-up segment extraction method | |
| CN109118441B (en) | A low-illumination image and video enhancement method, computer device and storage medium | |
| CN107004276A (en) | A Method for Perceiving 3D Structures from a Pair of Images | |
| CN114663980A (en) | Behavior recognition method, and deep learning model training method and device | |
| CN111311603B (en) | Method and device for outputting number information of target objects | |
| CN110288552A (en) | Video beautification method, device and electronic equipment | |
| CN111754411A (en) | Image noise reduction method, image noise reduction device and terminal equipment | |
| CN110264488A (en) | A kind of bianry image edge extraction device | |
| CN113971671B (en) | Instance segmentation method, device, electronic device and storage medium | |
| CN115375740A (en) | Pose determination method, three-dimensional model generation method, device, equipment and medium |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20221101 | |
| CF01 | Termination of patent right due to non-payment of annual fee |