技术领域technical field
本发明涉及通信技术领域，尤其涉及视频传输方法、服务器及计算机可读存储介质。The invention relates to the technical field of communication, in particular to a video transmission method, a server and a computer-readable storage medium.
背景技术Background technique
随着科技的发展，移动终端的功能变得越来越强大。目前，许多移动终端均具备云游戏功能。在云游戏实现方案中，云端需要将音频和视频传输到移动终端，以控制移动终端的显示内容。With the development of technology, the functions of mobile terminals become more and more powerful. At present, many mobile terminals are equipped with cloud gaming functions. In the cloud game implementation solution, the cloud needs to transmit audio and video to the mobile terminal to control the display content of the mobile terminal.
在相关技术中，为了降低视频传输开销，一般会先根据视频帧之间的相似度确定待传输的视频中的关键帧，然后将关键帧之外的其它非关键视频帧丢弃，而只向终端传输关键帧及被丢弃的帧的数量。当在进行静态动画传输时，可能连续很长时间内的视频对应的视频帧的相似度均较高，这就会导致长时间段的视频帧均被丢弃，从而导致视频出现卡顿。In related technologies, in order to reduce the video transmission overhead, the key frames in the video to be transmitted are generally determined according to the similarity between the video frames, and then other non-key video frames other than the key frames are discarded, and only the key frames and the number of discarded frames are transmitted to the terminal. When performing static animation transmission, the similarity of video frames corresponding to videos for a long period of time may be high, which will cause video frames for a long period of time to be discarded, resulting in video freezes.
上述内容仅用于辅助理解本发明的技术方案，并不代表承认上述内容是现有技术。The above content is only used to assist in understanding the technical solution of the present invention, and does not mean that the above content is admitted as prior art.
发明内容Contents of the invention
本发明的主要目的在于提供一种视频传输方法、服务器及计算机可读存储介质，旨在达成避免客户端出现画面卡顿现象的效果。The main purpose of the present invention is to provide a video transmission method, server and computer-readable storage medium, aiming to achieve the effect of avoiding the image freeze phenomenon of the client.
为实现上述目的，本发明提供一种视频传输方法，所述视频传输方法包括以下步骤：To achieve the above object, the present invention provides a video transmission method, the video transmission method comprising the following steps:
根据待传输视频的各个视频帧之间的相似度，确定原始关键帧；Determine the original key frame according to the similarity between each video frame of the video to be transmitted;
当满足预设条件时，根据相邻的原始关键帧生成平滑关键帧；When the preset conditions are met, smooth keyframes are generated according to the adjacent original keyframes;
根据所述原始关键帧及所述平滑关键帧生成目标输帧序列，并依次发送所述目标帧序列中的视频帧。A target frame input sequence is generated according to the original key frame and the smoothed key frame, and video frames in the target frame sequence are sequentially sent.
可选地，所述根据相邻的原始关键帧生成平滑关键帧的步骤包括：Optionally, the step of generating smooth keyframes according to adjacent original keyframes includes:
确定原始关键帧对应的帧背景；Determine the frame background corresponding to the original key frame;
基于所述帧背景确定第一原始关键帧对应的第一前景图，以及第二原始关键帧对应的第二前景图，其中，所述第一原始关键帧与所述第二原始关键帧相邻；determining a first foreground image corresponding to a first original key frame and a second foreground image corresponding to a second original key frame based on the frame background, wherein the first original key frame is adjacent to the second original key frame;
根据所述第一前景图和所述第二前景图确定平滑前景图；determining a smoothed foreground map based on the first foreground map and the second foreground map;
根据所述帧背景和所述平滑前景图生成所述平滑关键帧。The smooth key frame is generated according to the frame background and the smooth foreground image.
可选地，所述预设条件包括以下至少一个：Optionally, the preset conditions include at least one of the following:
相邻的原始关键帧之间的帧间隔时长大于预设时长；The frame interval duration between adjacent original keyframes is greater than the preset duration;
接收到提升帧率的控制指令。Received a control command to increase the frame rate.
可选地，所述根据待传输视频的各个视频帧之间的相似度，确定所述待传输视频对应的原始关键帧的步骤之后，还包括：Optionally, after the step of determining the original key frame corresponding to the video to be transmitted according to the similarity between each video frame of the video to be transmitted, further comprising:
在不满足所述预设条件时，确定每一原始关键帧对应的帧标签；When the preset condition is not met, determine the frame label corresponding to each original key frame;
基于所述帧标签向客户端发送所述待传输视频，其中，在发送所述待传输视频时，所述原始关键帧对应的码流包括所述帧标签和帧数据，非原始关键帧对应的码流包括所述帧标签和无帧数据标识。Sending the video to be transmitted to the client based on the frame tag, wherein, when sending the video to be transmitted, the code stream corresponding to the original key frame includes the frame tag and frame data, and the code stream corresponding to the non-original key frame includes the frame tag and no frame data identifier.
可选地，所述视频传输方法还包括：Optionally, the video transmission method also includes:
缓存所述待传输视频对应的传输帧序列；Caching the transmission frame sequence corresponding to the video to be transmitted;
在再次接收到所述待传输视频对应的传输请求时，反馈所述传输帧序列。When the transmission request corresponding to the video to be transmitted is received again, the transmission frame sequence is fed back.
此外，本发明还提供另一种视频传输方法，所述视频传输方法包括以下步骤：In addition, the present invention also provides another video transmission method, which includes the following steps:
接收服务器的视频传输码流；Receive the video transmission code stream of the server;
基于所述传输码流确定当前帧对应的帧标签，以及确定所述码流是否包括帧数据；determining a frame label corresponding to the current frame based on the transmission code stream, and determining whether the code stream includes frame data;
在所述码流不包括所述帧数据时，基于所述帧标签在预存数据中确定当前对应的帧数据。When the code stream does not include the frame data, the currently corresponding frame data is determined in prestored data based on the frame tag.
可选地，所述基于所述传输码流确定当前帧对应的帧标签，以及确定所述码流是否包括帧数据的步骤之后，还包括：Optionally, after the step of determining the frame label corresponding to the current frame based on the transmission code stream, and determining whether the code stream includes frame data, it also includes:
在所述码流包括所述帧数据时，将所述帧标签及是所述帧数据关联保存。When the code stream includes the frame data, store the frame tag and the frame data in association.
此外，为实现上述目的，本发明还提供一种服务器，所述服务器包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的视频传输程序，所述视频传输程序被所述处理器执行时实现如上所述的视频传输方法的步骤。In addition, to achieve the above object, the present invention also provides a server, the server includes a memory, a processor, and a video transmission program stored in the memory and operable on the processor, when the video transmission program is executed by the processor, the steps of the video transmission method as described above are implemented.
此外，为实现上述目的，本发明还提供一种服务器，所述服务器包括:In addition, in order to achieve the above object, the present invention also provides a server, the server includes:
确定模块，根据待传输视频的各个视频帧之间的相似度，确定原始关键帧；Determine the module, according to the similarity between each video frame of the video to be transmitted, determine the original key frame;
生成模块，用于当满足预设条件时，根据相邻的原始关键帧生成平滑关键帧；A generating module, configured to generate smooth keyframes according to adjacent original keyframes when preset conditions are met;
发送模块，用于根据所述原始关键帧及所述平滑关键帧生成目标输帧序列，并依次发送所述目标帧序列中的视频帧。A sending module, configured to generate a target input frame sequence according to the original key frame and the smoothed key frame, and sequentially send video frames in the target frame sequence.
此外，为实现上述目的，本发明还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有视频传输程序，所述视频传输程序被处理器执行时实现如上所述的视频传输方法的步骤。In addition, to achieve the above object, the present invention also provides a computer-readable storage medium, on which a video transmission program is stored, and when the video transmission program is executed by a processor, the steps of the above-mentioned video transmission method are realized.
本发明实施例提出的一种视频传输方法、服务器及计算机可读存储介质，根据待传输视频的各个视频帧之间的相似度，确定原始关键帧，当满足预设条件时，根据相邻的原始关键帧生成平滑关键帧，根据所述原始关键帧及所述平滑关键帧生成目标输帧序列，并依次向客户端发送所述目标帧序列中的视频帧。由于可以在初始传输帧序列的对应为上，插入所述平滑关键帧，以生成目标输帧序列。然后依次向客户端发送所述目标帧序列中的视频帧。使得客户端在接收到所述平滑关键帧后，可以基于所述平滑关键帧渲染原始关键帧之间的过度画面。从而使得客户端的显示输出更加流畅。这样达成了避免客户端视频播放过程出现卡顿现象，提高了客户端视频显示的流畅度。A video transmission method, a server, and a computer-readable storage medium proposed in the embodiments of the present invention determine an original key frame according to the similarity between video frames to be transmitted, and when a preset condition is met, generate a smooth key frame based on adjacent original key frames, generate a target input frame sequence based on the original key frame and the smooth key frame, and sequentially send the video frames in the target frame sequence to a client. Because the smooth key frame can be inserted on the correspondence of the initial transmission frame sequence to generate the target transmission frame sequence. Then send the video frames in the target frame sequence to the client in sequence. After receiving the smooth key frame, the client can render the transitional picture between the original key frames based on the smooth key frame. This makes the display output of the client more smooth. In this way, the phenomenon of stuttering in the video playback process of the client is avoided, and the fluency of video display on the client is improved.
附图说明Description of drawings
图1是本发明实施例方案涉及的硬件运行环境的终端结构示意图；Fig. 1 is a schematic diagram of the terminal structure of the hardware operating environment involved in the solution of the embodiment of the present invention;
图2为本发明视频传输方法的一实施例的流程示意图；Fig. 2 is a schematic flow chart of an embodiment of the video transmission method of the present invention;
图3为本发明视频传输方法的一实施例中，一可选方案的流程示意图；FIG. 3 is a schematic flowchart of an alternative solution in an embodiment of the video transmission method of the present invention;
图4为本发明视频传输方法的另一实施例的流程示意图；4 is a schematic flow diagram of another embodiment of the video transmission method of the present invention;
图5为本发明实施例涉及的服务器的模块化示意图。FIG. 5 is a schematic diagram of a server module according to an embodiment of the present invention.
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
具体实施方式Detailed ways
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
如图1所示，图1是本发明实施例方案涉及的硬件运行环境的终端结构示意图。As shown in FIG. 1 , FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in the solution of the embodiment of the present invention.
本发明实施例终端可以是服务器或者计算机等。The terminal in this embodiment of the present invention may be a server or a computer.
如图1所示，该终端可以包括：处理器1001，例如CPU，网络接口1003，存储器1004，通信总线1002。其中，通信总线1002用于实现这些组件之间的连接通信。网络接口1003可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1004可以是高速RAM存储器，也可以是稳定的存储器(non-volatile memory)，例如磁盘存储器。存储器1004可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1 , the terminal may include: a processor 1001 , such as a CPU, a network interface 1003 , a memory 1004 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. Optionally, the network interface 1003 may include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1004 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. Optionally, the memory 1004 may also be a storage device independent of the aforementioned processor 1001 .
本领域技术人员可以理解，图1中示出的终端结构并不构成对终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。Those skilled in the art can understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than those shown in the figure, or combine some components, or arrange different components.
如图1所示，作为一种计算机存储介质的存储器1004中可以包括操作系统、网络通信模块以及视频传输程序。As shown in FIG. 1 , the memory 1004 as a computer storage medium may include an operating system, a network communication module, and a video transmission program.
在图1所示的终端中，处理器1001可以用于调用存储器1004中存储的视频传输程序，并执行以下操作：In the terminal shown in FIG. 1, the processor 1001 can be used to call the video transmission program stored in the memory 1004, and perform the following operations:
根据待传输视频的各个视频帧之间的相似度，确定原始关键帧；Determine the original key frame according to the similarity between each video frame of the video to be transmitted;
当满足预设条件时，根据相邻的原始关键帧生成平滑关键帧；When the preset conditions are met, smooth keyframes are generated according to the adjacent original keyframes;
根据所述原始关键帧及所述平滑关键帧生成目标输帧序列，并依次发送所述目标帧序列中的视频帧。A target frame input sequence is generated according to the original key frame and the smoothed key frame, and video frames in the target frame sequence are sequentially sent.
进一步地，处理器1001可以调用存储器1005中存储的视频传输程序，还执行以下操作：Further, the processor 1001 can call the video transmission program stored in the memory 1005, and also perform the following operations:
确定原始关键帧对应的帧背景；Determine the frame background corresponding to the original key frame;
基于所述帧背景确定第一原始关键帧对应的第一前景图，以及第二原始关键帧对应的第二前景图，其中，所述第一原始关键帧与所述第二原始关键帧相邻；determining a first foreground image corresponding to a first original key frame and a second foreground image corresponding to a second original key frame based on the frame background, wherein the first original key frame is adjacent to the second original key frame;
根据所述第一前景图和所述第二前景图确定平滑前景图；determining a smoothed foreground map based on the first foreground map and the second foreground map;
根据所述帧背景和所述平滑前景图生成所述平滑关键帧。The smooth key frame is generated according to the frame background and the smooth foreground image.
进一步地，处理器1001可以调用存储器1005中存储的视频传输程序，还执行以下操作：Further, the processor 1001 can call the video transmission program stored in the memory 1005, and also perform the following operations:
相邻的原始关键帧之间的帧间隔时长大于预设时长；The frame interval duration between adjacent original keyframes is greater than the preset duration;
接收到提升帧率的控制指令。Received a control command to increase the frame rate.
进一步地，处理器1001可以调用存储器1005中存储的视频传输程序，还执行以下操作：Further, the processor 1001 can call the video transmission program stored in the memory 1005, and also perform the following operations:
在不满足所述预设条件时，确定每一原始关键帧对应的帧标签；When the preset condition is not met, determine the frame label corresponding to each original key frame;
基于所述帧标签向客户端发送所述待传输视频，其中，在发送所述待传输视频时，所述原始关键帧对应的码流包括所述帧标签和帧数据，非原始关键帧对应的码流包括所述帧标签和无帧数据标识。Sending the video to be transmitted to the client based on the frame tag, wherein, when sending the video to be transmitted, the code stream corresponding to the original key frame includes the frame tag and frame data, and the code stream corresponding to the non-original key frame includes the frame tag and no frame data identifier.
进一步地，处理器1001可以调用存储器1005中存储的视频传输程序，还执行以下操作：Further, the processor 1001 can call the video transmission program stored in the memory 1005, and also perform the following operations:
缓存所述待传输视频对应的传输帧序列；Caching the transmission frame sequence corresponding to the video to be transmitted;
在再次接收到所述待传输视频对应的传输请求时，反馈所述传输帧序列。When the transmission request corresponding to the video to be transmitted is received again, the transmission frame sequence is fed back.
此外，处理器1001可以用于调用存储器1004中存储的视频传输程序，并执行以下操作：In addition, the processor 1001 can be used to call the video transmission program stored in the memory 1004, and perform the following operations:
接收服务器的视频传输码流；Receive the video transmission code stream of the server;
基于所述传输码流确定当前帧对应的帧标签，以及确定所述码流是否包括帧数据；determining a frame label corresponding to the current frame based on the transmission code stream, and determining whether the code stream includes frame data;
在所述码流不包括所述帧数据时，基于所述帧标签在预存数据中确定当前对应的帧数据。When the code stream does not include the frame data, the currently corresponding frame data is determined in prestored data based on the frame tag.
进一步地，处理器1001可以调用存储器1005中存储的视频传输程序，还执行以下操作：Further, the processor 1001 can call the video transmission program stored in the memory 1005, and also perform the following operations:
在所述码流包括所述帧数据时，将所述帧标签及是所述帧数据关联保存。When the code stream includes the frame data, store the frame tag and the frame data in association.
随着科技的发展，移动终端的功能变得越来越强大。目前，许多移动终端均具备云游戏功能。在云游戏实现方案中，云端需要将音频和视频传输到移动终端，以控制移动终端的显示内容。With the development of technology, the functions of mobile terminals become more and more powerful. At present, many mobile terminals are equipped with cloud gaming functions. In the cloud game implementation solution, the cloud needs to transmit audio and video to the mobile terminal to control the display content of the mobile terminal.
在相关技术中，为了降低视频传输开销，一般会先根据视频帧之间的相似度确定待传输的视频中的关键帧，然后将关键帧之外的其它非关键视频帧之间丢弃，而只向终端传输关键帧及被丢弃的帧的数量。当在进行静态动画传输时，可能连续很长时间内的视频对应的视频帧的相似度均较高，这就会导致长时间段的视频帧均被丢弃，从而导致视频出现卡顿。In related technologies, in order to reduce the video transmission overhead, the key frames in the video to be transmitted are generally determined according to the similarity between the video frames, and then other non-key video frames other than the key frames are discarded, and only the key frames and the number of discarded frames are transmitted to the terminal. When performing static animation transmission, the similarity of video frames corresponding to videos for a long period of time may be high, which will cause video frames for a long period of time to be discarded, resulting in video freezes.
为解决相关技术存在的上述缺陷，本发明实施例提出一种视频传输方法旨在通过基于相邻的关键帧生成两个关键帧中间的平滑关键帧，从而使得客户端接收到的帧序列在播放过程中，更加流程。从而达成避免视频出现卡顿的现象发生。In order to solve the above-mentioned defects in related technologies, an embodiment of the present invention proposes a video transmission method aimed at generating a smooth key frame between two key frames based on adjacent key frames, so that the frame sequence received by the client is more streamlined during playback. In order to avoid the phenomenon of video freeze.
参照图2，在本发明视频传输方法的一实施例中，所述视频传输方法包括以下步骤：Referring to Fig. 2, in an embodiment of the video transmission method of the present invention, the video transmission method includes the following steps:
步骤S10、根据待传输视频的各个视频帧之间的相似度，确定所述待传输视频对应的原始关键帧；Step S10, according to the similarity between each video frame of the video to be transmitted, determine the original key frame corresponding to the video to be transmitted;
步骤S20、当满足预设条件时，根据相邻的所述原始关键帧生成平滑关键帧；Step S20, when the preset condition is met, generate a smooth key frame according to the adjacent original key frame;
步骤S30、根据所述原始关键帧及所述平滑关键帧生成目标输帧序列，并依次向客户端发送所述目标帧序列中的视频帧。Step S30, generating a target frame sequence according to the original key frame and the smoothed key frame, and sequentially sending the video frames in the target frame sequence to the client.
在本实施例中，服务器确定待传视频后，可以根据待传输视频的各个视频帧之间的相似度，确定所述待传输视频对应的原始关键帧。其中待传输视频是指服务器准备发生至客户端的视频数据。其中，所述视频数据可以由多个视频画面帧(即所述视频帧)组成。所述原始关键帧是指所述待传输视频中，相似度交小的一个或者多个视频帧。In this embodiment, after determining the video to be transmitted, the server may determine the original key frame corresponding to the video to be transmitted according to the similarity between each video frame of the video to be transmitted. The video to be transmitted refers to the video data that the server prepares to transmit to the client. Wherein, the video data may consist of multiple video picture frames (ie, the video frames). The original key frame refers to one or more video frames with a smaller similarity in the video to be transmitted.
示例性地，当确定待传输视频后，若所述待传输视频由依次排序的视频帧1、视频帧2，视频帧3、视频帧4、……视频帧n组成。则可以先获取视频帧1和视频帧2之间的相似度。当视频帧1和视频帧2之间的相似度大于预设相似度时，将视频帧1作为所述原始关键帧。将视频帧2作为非原始关键帧。进而，确定视频帧1和视频帧3之间的相似度。若所述相似度大于预设相似度，则将视频帧3作为非原始关键帧。并继续获取视频帧1和视频帧4之间的相似度，以根据所述相似度确定视频帧4是否为原始关键帧。若所述相似度小于或者等于所述预设相似度，则将视频帧3也确定为原始关键帧，并获取视频帧3与视频帧4之间的相识度。依次类推，直至处理完视频帧n。即处理完待传输视频对应全部视频帧。可以确定待传输视频对应的至少一个原始关键帧。其中，所述预设相似度为自定义的数值，例如，可以设置为90％-95％之间的任意数值，优选地，所述预设相似度设置为92％。Exemplarily, after the video to be transmitted is determined, if the video to be transmitted is composed of video frame 1, video frame 2, video frame 3, video frame 4, . . . video frame n in sequence. Then the similarity between video frame 1 and video frame 2 may be obtained first. When the similarity between video frame 1 and video frame 2 is greater than the preset similarity, video frame 1 is used as the original key frame. Make video frame 2 the non-original keyframe. Furthermore, the similarity between video frame 1 and video frame 3 is determined. If the similarity is greater than the preset similarity, video frame 3 is taken as a non-original key frame. And continue to obtain the similarity between video frame 1 and video frame 4, to determine whether video frame 4 is the original key frame according to the similarity. If the similarity is less than or equal to the preset similarity, video frame 3 is also determined as the original key frame, and the degree of acquaintance between video frame 3 and video frame 4 is obtained. And so on until the video frame n is processed. That is, all video frames corresponding to the video to be transmitted are processed. At least one original key frame corresponding to the video to be transmitted may be determined. Wherein, the preset similarity is a user-defined value, for example, can be set to any value between 90%-95%, preferably, the preset similarity is set to 92%.
可选地，在一实施方式中，在根据待传输视频的各个视频帧之间的相似度，确定所述待传输视频对应的原始关键帧之后，还可以在向客户端发送所述待传输视频时，若待发送的视频帧为原始关键帧，则发送视频帧对应的帧标签和帧数据。若待发送的视频帧为非原始视频帧时，则发送帧标签和无帧数据的标识。Optionally, in one embodiment, after the original key frame corresponding to the video to be transmitted is determined according to the similarity between each video frame of the video to be transmitted, when the video to be transmitted is sent to the client, if the video frame to be transmitted is the original key frame, then the frame tag and frame data corresponding to the video frame are sent. If the video frame to be sent is a non-original video frame, then send a frame tag and an identifier of no frame data.
示例性地，若所述待传输视频对应的待发送帧序列为视频帧1、视频帧2，视频帧3、视频帧4、……视频帧n。其中，视频帧1为原始关键帧，视频帧2和3为非原始关键帧，视频帧4为原始关键帧……视频帧n为原始关键帧。则在发送过程中，在发送视频帧1时，发送视频帧1对应的帧标签1以及视频帧1对应的具体帧数据。在传输视频帧2和3时，则发送视频帧2和3对应的帧标签，和无帧数据标识。其中，视频帧2和视频帧3对应的帧标签与视频帧1相同。同理，可以根据相同的方式发送其它原始关键帧和非原始关键帧。客户端在接收到服务器发送的码流时，可以解析码流，以确定当前帧对于应的帧标签和待显示内容。在当前帧为原始关键帧时，可以根据进一步解析帧数据，并将所述帧数据对应的内容作为待显示内容。在当前帧为非原始关键帧时，则可以根据所述帧标签，获取与所述非原始关键帧的帧标签相同的原始关键帧对应的帧数据，作为当前帧对应的显示内容。由于在传输过程中，非原始关键帧占用的传输开销极小，因此，本实施方案提供的传输方式，达成了降低视频数据的传输开销的效果。可以理解的是，由于在本方案中，每一视频帧都具有传输数据，从而使得本方案可以很好的适应于需要不间断传输视频帧的场景。例如，在云游戏场景中，由于传输游戏画面需要不间断发送视频帧，因此相关的通过丢弃非关键帧的方案，无法适用于游戏传输场景中。Exemplarily, if the frame sequence to be sent corresponding to the video to be transmitted is video frame 1, video frame 2, video frame 3, video frame 4, ... video frame n. Among them, video frame 1 is the original key frame, video frames 2 and 3 are non-original key frames, video frame 4 is the original key frame...video frame n is the original key frame. Then, during the sending process, when sending the video frame 1, the frame tag 1 corresponding to the video frame 1 and the specific frame data corresponding to the video frame 1 are sent. When transmitting video frames 2 and 3, the frame labels corresponding to video frames 2 and 3 and the no-frame data identifier are sent. Wherein, the frame labels corresponding to video frame 2 and video frame 3 are the same as video frame 1. Similarly, other original keyframes and non-original keyframes can be sent in the same manner. When the client receives the code stream sent by the server, it can parse the code stream to determine the frame tag corresponding to the current frame and the content to be displayed. When the current frame is the original key frame, the frame data can be further analyzed, and the content corresponding to the frame data can be used as the content to be displayed. When the current frame is a non-original key frame, according to the frame label, frame data corresponding to an original key frame having the same frame label as the non-original key frame may be obtained as display content corresponding to the current frame. Since the transmission overhead occupied by the non-original key frame is extremely small during the transmission process, the transmission mode provided by this embodiment achieves the effect of reducing the transmission overhead of video data. It can be understood that, in this solution, each video frame has transmission data, so that this solution can be well adapted to the scene where uninterrupted transmission of video frames is required. For example, in the cloud game scenario, since the transmission of the game screen requires uninterrupted sending of video frames, the related solution of discarding non-key frames cannot be applied to the game transmission scenario.
进一步地，当服务器确定原始关键帧后，可以基于所述原始关键帧生成初始传输帧序列。在所述初始传输帧序列中，原始关键帧包具体的帧数据和帧标签，而非原始关键帧则不包括具体帧数据，包括帧标签。使得可以通过非原始关键帧的帧标签，选定对应的原始关键帧的帧数据，作为该非原始关键帧对应的显示数据。使得在需要在此向客户端发送所述待传输视频时，可以直接根据所述初始传输帧序列进行视频帧传输，而无需进行重复的相似度对比，以确定原始关键帧。Further, after the server determines the original key frame, an initial transmission frame sequence may be generated based on the original key frame. In the initial transmission frame sequence, the original key frame includes specific frame data and frame label, while the non-original key frame does not include specific frame data, including frame label. The frame data of the corresponding original key frame can be selected as the display data corresponding to the non-original key frame through the frame label of the non-original key frame. In this way, when the video to be transmitted needs to be sent to the client, the video frame transmission can be directly performed according to the initial transmission frame sequence without repeated similarity comparisons to determine the original key frame.
可选地，作为一种可选实施方案，当客户端具备缓存功能时，客户端也可以在接收到服务器发送的所述初始传输帧序列时，缓存所述初始传输帧序列。当客户端第二次请求所述待传输视频时，则服务器可以只像客户端发送相应的帧标签，客户端则基于上述帧标签在缓存数据中查询相应的帧数据，以渲染显示画面。Optionally, as an optional implementation solution, when the client has a caching function, the client may also cache the initial transmission frame sequence when receiving the initial transmission frame sequence sent by the server. When the client requests the video to be transmitted for the second time, the server may only send the corresponding frame tag to the client, and the client then queries the cached data for the corresponding frame data based on the above frame tag to render the display screen.
需要说明的是，上述传输方式和服务器及客户端缓存初始传输帧序列的方式的最佳应用场景是云游戏的静态动画传输场景。例如，对于云游戏的登录界面动画而言，其画面重复率交高，且客户端每次登录游戏时均需要向服务器请求该登录画面对应的静态动画。并且，在云游戏中，因为游戏的同步机制的需求，需要服务器不间断地向客户端发送每一时刻对应的用户渲染游戏界面画面帧信息。因此，使用上述方法可以很好地节省该场景下的传输开销。It should be noted that the best application scenario for the above-mentioned transmission method and the method for the server and client to cache the initial transmission frame sequence is the static animation transmission scene of cloud games. For example, the animation of the login interface of cloud games has a high screen repetition rate, and each time the client logs in to the game, it needs to request the server for the static animation corresponding to the login screen. Moreover, in cloud games, due to the requirements of the game's synchronization mechanism, the server needs to send the corresponding user-rendered game interface frame information at each moment to the client without interruption. Therefore, using the above method can well save the transmission overhead in this scenario.
在上述云游戏视频传输场景中，服务器可以预先设定上述传输方式的启动条件和退出条件。例如，当服务器检测到当前进入静态动画传输场景时启用上述传输方式。当有触控发生时，退出该模式，恢复成正常音视频传输。或者，服务器端经更复杂的图像识别后，判断为非静态动画模式时，恢复正常模式。循环播放过程中，定时监测，每隔几秒，将采集的帧和静态动画序列进行相似度比较，找不到相似度高的帧，即判定退出该模式。In the above cloud game video transmission scenario, the server may pre-set the start condition and exit condition of the above transmission mode. For example, the above transmission mode is enabled when the server detects that the static animation transmission scene is currently being entered. When a touch occurs, exit this mode and return to normal audio and video transmission. Or, after more complex image recognition on the server side, when it is judged to be a non-static animation mode, the normal mode will be restored. During the loop playback process, regular monitoring, every few seconds, compare the similarity between the captured frame and the static animation sequence, if no frame with high similarity can be found, it is judged to exit this mode.
进一步地，当根据待传输视频的各个视频帧之间的相似度，确定所述待传输视频对应的原始关键帧后，还可以判断是否满足预设条件。其中，所述预设条件可以包括一下至少一个：Further, after the original key frame corresponding to the video to be transmitted is determined according to the similarity between each video frame of the video to be transmitted, it may also be determined whether a preset condition is met. Wherein, the preset conditions may include at least one of the following:
相邻的所述原始关键帧之间的帧间隔时长大于预设时长；The frame interval duration between the adjacent original key frames is greater than the preset duration;
接收到提升帧率的控制指令。Received a control command to increase the frame rate.
需要说明是，所述帧间隔时长是指两个相邻的原始关键帧之间的间隔时长T。其中，所述预设时长可以根据客户端播放所述视频数据的刷新率(即每秒传输帧数，FPS，Frames Per Second)确定。例如，可以设置为2*(1000/Fps)。及当原始关键帧之间的间隔时长T＞2*(1000/Fps)时，判定满足所述预设条件。It should be noted that the frame interval refers to the interval T between two adjacent original key frames. Wherein, the preset duration may be determined according to the refresh rate of the video data played by the client (that is, the number of transmission frames per second, FPS, Frames Per Second). For example, it can be set to 2*(1000/Fps). And when the interval between original key frames is T>2*(1000/Fps), it is determined that the preset condition is satisfied.
为了适应不同场景下的帧率要求，当原始采集帧序列是低帧率的，需生成高帧率的帧序列，如原始帧率30帧，生成高帧率60帧的传输流。则可以触发所述提升帧率的控制指令。当检测到提升帧率的控制指令时，可以判定满足所述预设条件。In order to meet the frame rate requirements in different scenarios, when the original acquisition frame sequence is low frame rate, it is necessary to generate a high frame rate frame sequence, for example, the original frame rate is 30 frames, and a high frame rate 60 frame transmission stream is generated. Then the control instruction for increasing the frame rate may be triggered. When a control instruction to increase the frame rate is detected, it may be determined that the preset condition is met.
进一步地，当满足所述预设条件时，可以根据相邻的所述原始关键帧生成平滑关键帧。Further, when the preset condition is satisfied, a smooth key frame may be generated according to the adjacent original key frame.
可选地，参照图3，所述当满足所述预设条件时，可以根据相邻的原始关键帧生成平滑关键帧，其中，在根据相邻的原始关键帧生成平滑关键帧时，可以包括以下步骤：Optionally, referring to FIG. 3 , when the preset condition is met, a smooth key frame may be generated according to adjacent original key frames, wherein, when generating a smooth key frame according to adjacent original key frames, the following steps may be included:
步骤S21、确定原始关键帧对应的帧背景；Step S21, determining the frame background corresponding to the original key frame;
步骤S22基于所述帧背景确定第一原始关键帧对应的第一前景图，以及第二原始关键帧对应的第二前景图，其中，所述第一原始关键帧与所述第二原始关键帧相邻；Step S22 determines a first foreground image corresponding to a first original key frame and a second foreground image corresponding to a second original key frame based on the frame background, wherein the first original key frame is adjacent to the second original key frame;
步骤S23、根据所述第一前景图和所述第二前景图确定平滑前景图；Step S23, determining a smooth foreground image according to the first foreground image and the second foreground image;
步骤S24、根据所述帧背景和所述平滑前景图生成所述平滑关键帧。Step S24, generating the smooth key frame according to the frame background and the smooth foreground image.
示例性地，可以根据原始帧序列的灰度值进行区间统计从而得到一个具有统计意义的背景Fb，即得到所述帧背景Fb。将第一原始关键帧Fx和帧背景Fb做差，求得第一背景差图。将第二原始关键帧Fx+1和帧背景Fb做差，求得第二背景差图。然后第一背景差图和第二背景差图进行二值化，获得运动前景区域。即实现图像分割，得到第一原始关键帧Fx对应地第一前景图Ffx，同上处理得到第二原始关键帧Fx+1的第二前景图Ffx+1。Exemplarily, interval statistics may be performed according to the gray value of the original frame sequence to obtain a statistically significant background Fb , that is, to obtain the frame background Fb . The difference between the first original key frame Fx and the frame background Fb is made to obtain the first background difference map. Making a difference between the second original key frame Fx+1 and the frame background Fb to obtain a second background difference map. Then the first background difference image and the second background difference image are binarized to obtain the moving foreground area. That is, the image segmentation is realized, and the first foreground image Ffx corresponding to the first original key frame Fx is obtained, and the second foreground image Ffx+1 of the second original key frame F x +1 is obtained through the same process as above.
根据第一前景图Ffx、第二前景图Ffx+1、以及第一原始关键帧Fx和第二原始关键帧Fx+1的帧间隔之间的帧间隔时长Tx，计算平滑关键帧Fx’的平滑前景图Ffx’。根据所述帧背景和所述平滑前景图生成所述平滑关键帧。According to the first foreground image Ffx , the second foreground image Ffx+1 , and the frame interval duration Tx between the frame intervals of the first original key frame Fx and the second original key frame Fx+1 , calculate the smooth foreground image F fx' of the smooth key frame Fx' . The smooth key frame is generated according to the frame background and the smooth foreground image.
当得到所述平滑关键帧后，根据所述原始关键帧及所述平滑关键帧生成目标输帧序列，并依次向客户端发送所述目标帧序列中的视频帧。After the smooth key frame is obtained, a target input frame sequence is generated according to the original key frame and the smooth key frame, and video frames in the target frame sequence are sequentially sent to the client.
可选地，在不满足所述预设条件时，可以确定每一所述原始关键帧对应的帧标签，然后基于所述帧标签向客户端发送所述待传输视频，其中，在发送所述待传输视频时，所述原始关键帧对应的码流包括所述帧标签和帧数据，非原始关键帧对应的码流包括所述帧标签和无帧数据标识。Optionally, when the preset condition is not satisfied, the frame tag corresponding to each original key frame may be determined, and then the video to be transmitted is sent to the client based on the frame tag, wherein, when the video to be transmitted is sent, the code stream corresponding to the original key frame includes the frame tag and frame data, and the code stream corresponding to the non-original key frame includes the frame tag and no frame data identifier.
可选地，还可以缓存所述待传输视频对应的传输帧序列，在再次接收到所述待传输视频对应的传输请求时，基于所述传输帧序列向所述传输请求的发起端发送所述传输帧序列。Optionally, the transmission frame sequence corresponding to the video to be transmitted may also be cached, and when the transmission request corresponding to the video to be transmitted is received again, the transmission frame sequence is sent to the initiator of the transmission request based on the transmission frame sequence.
示例性地，可以在初始传输帧序列的对应为上，插入所述平滑关键帧，以生成目标输帧序列。然后依次向客户端发送所述目标帧序列中的视频帧。使得客户端在接收到所述平滑关键帧后，可以基于所述平滑关键帧渲染原始关键帧之间的过度画面。从而使得客户端的显示输出更加流畅。这样达成了避免客户端视频播放过程出现卡顿现象，提高了客户端视频显示的流畅度。Exemplarily, the smoothing key frame may be inserted into the correspondence of the initial transmission frame sequence to generate the target transmission frame sequence. Then send the video frames in the target frame sequence to the client in sequence. After receiving the smooth key frame, the client can render the transitional picture between the original key frames based on the smooth key frame. This makes the display output of the client more smooth. In this way, the phenomenon of stuttering in the video playback process of the client is avoided, and the fluency of video display on the client is improved.
参照图4、在本发明视频传输方法的另一实施例中，所述视频传输方法包括以下步骤：Referring to Fig. 4, in another embodiment of the video transmission method of the present invention, the video transmission method includes the following steps:
步骤S1、接收服务器的视频传输码流；Step S1, receiving the video transmission code stream of the server;
步骤S2、基于所述传输码流确定当前帧对应的帧标签，以及确定所述码流是否包括帧数据；Step S2. Determine the frame label corresponding to the current frame based on the transmission code stream, and determine whether the code stream includes frame data;
步骤S3、在所述码流不包括所述帧数据时，基于所述帧标签在预存数据中确定当前对应的帧数据。Step S3. When the code stream does not include the frame data, determine the current corresponding frame data in the pre-stored data based on the frame tag.
在本实施例中，所述视频传输方法可以用于客户端。其中，客户端可以根据主动向服务器请求视频数据。例如，当客户端处于云游戏的运行界面时，可以请求也游戏界面对应的视频数据。即所述游戏界面的渲染参数。可以理解的是，所述服务器和所述客户端之间可以基于实时传输协议(RTP，Real-time Transport Protocol)进行数据传输。在传输过程中，服务器可以在每一视频帧对应的码流的头部，添加所述视频帧对应的帧标签。客户端可以接收服务器的视频传输码流。当接收到所述码流后，可以解析出所述码流中携带的视频帧的帧标签，以及确定码流中时否包含当前视频帧对应的帧数据。In this embodiment, the video transmission method can be used for the client. Wherein, the client can request video data from the server according to the initiative. For example, when the client is in the running interface of the cloud game, it may request video data corresponding to the game interface. That is, the rendering parameters of the game interface. It can be understood that, the data transmission between the server and the client may be based on Real-time Transport Protocol (RTP, Real-time Transport Protocol). During the transmission process, the server may add a frame tag corresponding to the video frame to the header of the code stream corresponding to each video frame. The client can receive the video transmission code stream of the server. After receiving the code stream, the frame tag of the video frame carried in the code stream can be parsed out, and it can be determined whether the code stream contains frame data corresponding to the current video frame.
需要说明的是，服务器在发送所述生成所述码流时，包括一下情况：It should be noted that when the server sends the generated code stream, it includes the following situations:
情况一、初次发送时，若发送关键帧对应的码流时，在码流中添加该关键帧对应的帧标签和帧数据；Case 1. When sending for the first time, if the code stream corresponding to the key frame is sent, the frame label and frame data corresponding to the key frame are added to the code stream;
情况二、初次发送时，若在发送非关键帧时，在码流中添加该非关键帧对应的帧标签，以及无帧数据标识。其中，非关键帧对应的帧标签，与所述非关键帧所在位置的前一关键帧对应的帧标签相同。Case 2: When sending a non-key frame for the first time, add the frame label corresponding to the non-key frame and the no-frame data identifier in the code stream. Wherein, the frame label corresponding to the non-key frame is the same as the frame label corresponding to the previous key frame where the non-key frame is located.
情况三、在再次发送过程中，仅发送当前帧对应的帧标签。Case 3: During the retransmission process, only the frame label corresponding to the current frame is sent.
进一步地，当确定当前帧对应的帧标签后，若码流中包括当前帧对应的帧数据，则基于所述帧数据渲染当前帧对应的显示画面。不包含当前帧对应的帧数据，则或者当前时刻之前接收的，与当前帧的帧标签相同的具备帧数据的画面的帧帧数据。并基于获取到的帧数据渲染当前帧的显示画面。Further, after the frame tag corresponding to the current frame is determined, if the code stream includes the frame data corresponding to the current frame, the display image corresponding to the current frame is rendered based on the frame data. Does not contain the frame data corresponding to the current frame, or is received before the current time, and has the same frame tag as the frame data of the current frame. And render the display image of the current frame based on the acquired frame data.
可选地，在所述码流包括所述帧数据时，将所述帧标签及是所述帧数据关联保存。Optionally, when the code stream includes the frame data, the frame tag and the frame data are stored in association.
当接收到的码流仅包括帧标签时，从缓存数据中，获取与所述帧标签相匹配的帧数据，并基于获取都是数据渲染当前画面。When the received code stream only includes a frame tag, acquire frame data matching the frame tag from the cached data, and render the current picture based on the acquired data.
在本实施例公开的技术方案中，接收服务器的视频传输码流，然后基于所述传输码流确定当前帧对应的帧标签，以及确定所述码流是否包括帧数据在所述码流不包括所述帧数据时，基于所述帧标签在预存数据中确定当前对应的帧数据。由于传输过程中仅传输关键帧的帧数据，从而达成了节约传输开销的效果。In the technical solution disclosed in this embodiment, the video transmission code stream of the server is received, and then the frame label corresponding to the current frame is determined based on the transmission code stream, and whether the code stream includes frame data. When the code stream does not include the frame data, the current corresponding frame data is determined in the pre-stored data based on the frame label. Since only the frame data of the key frame is transmitted during the transmission process, the effect of saving transmission overhead is achieved.
此外，本发明实施例还提出一种服务器，所述服务器包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的视频传输程序，所述视频传输程序被所述处理器执行时实现如上各个实施例所述的视频传输方法的步骤。In addition, an embodiment of the present invention also proposes a server, the server includes a memory, a processor, and a video transmission program stored on the memory and operable on the processor, when the video transmission program is executed by the processor, the steps of the video transmission method described in the above embodiments are implemented.
参照图5，本发明实施例还提出一种服务器100，所述服务器包括：Referring to FIG. 5, the embodiment of the present invention also proposes a server 100, the server includes:
确定模块101，根据待传输视频的各个视频帧之间的相似度，确定原始关键帧；Determine module 101, according to the similarity between each video frame of video to be transmitted, determine original key frame;
生成模块102，用于当满足预设条件时，根据相邻的原始关键帧生成平滑关键帧；A generation module 102, configured to generate smooth keyframes according to adjacent original keyframes when preset conditions are met;
发送模块103，用于根据所述原始关键帧及所述平滑关键帧生成目标输帧序列，并依次发送所述目标帧序列中的视频帧。The sending module 103 is configured to generate a target input frame sequence according to the original key frame and the smoothed key frame, and sequentially send video frames in the target frame sequence.
此外，本发明实施例还提出一种计算机可读存储介质，所述计算机可读存储介质上存储有视频传输程序，所述视频传输程序被处理器执行时实现如上各个实施例所述的视频传输方法的步骤。In addition, the embodiments of the present invention also provide a computer-readable storage medium, where a video transmission program is stored on the computer-readable storage medium, and when the video transmission program is executed by a processor, the steps of the video transmission method described in the foregoing embodiments are implemented.
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion, such that a process, method, article or system comprising a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such a process, method, article or system. Without further limitations, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system comprising that element.
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。The serial numbers of the above embodiments of the present invention are for description only, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台服务器执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above, and includes several instructions to make a server execute the method described in each embodiment of the present invention.
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and do not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields, are all included in the scope of patent protection of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110753126.6ACN113596556B (en) | 2021-07-02 | 2021-07-02 | Video transmission method, server and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110753126.6ACN113596556B (en) | 2021-07-02 | 2021-07-02 | Video transmission method, server and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN113596556A CN113596556A (en) | 2021-11-02 |
| CN113596556Btrue CN113596556B (en) | 2023-07-21 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110753126.6AActiveCN113596556B (en) | 2021-07-02 | 2021-07-02 | Video transmission method, server and storage medium |
| Country | Link |
|---|---|
| CN (1) | CN113596556B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382938A (en)* | 2008-10-23 | 2009-03-11 | 浙江大学 | A network video ranking method based on user attention time |
| CN103810711A (en)* | 2014-03-03 | 2014-05-21 | 郑州日兴电子科技有限公司 | Keyframe extracting method and system for monitoring system videos |
| CN106375849A (en)* | 2015-07-23 | 2017-02-01 | 无锡天脉聚源传媒科技有限公司 | Template generation method, template generation device, video updating method and video updating device |
| CN108401188A (en)* | 2018-03-05 | 2018-08-14 | 青岛海信传媒网络技术有限公司 | A kind of method and device of media play |
| EP3493535A1 (en)* | 2017-11-29 | 2019-06-05 | Mitsubishi Electric R & D Centre Europe B.V. | Method for controlling a video encoder of a video camera installed on a moving conveyance |
| CN110225299A (en)* | 2019-05-06 | 2019-09-10 | 平安科技（深圳）有限公司 | Video monitoring method, device, computer equipment and storage medium |
| CN112954450A (en)* | 2021-02-02 | 2021-06-11 | 北京字跳网络技术有限公司 | Video processing method and device, electronic equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102098504A (en)* | 2009-12-11 | 2011-06-15 | 宏碁股份有限公司 | Audio-visual decoding device |
| US9076043B2 (en)* | 2012-08-03 | 2015-07-07 | Kodak Alaris Inc. | Video summarization using group sparsity analysis |
| CN103532923B (en)* | 2012-11-14 | 2016-07-13 | Tcl集团股份有限公司 | A kind of real-time media stream transmission method and system |
| CN103716644A (en)* | 2013-12-05 | 2014-04-09 | 南京肯麦思智能技术有限公司 | H264 multi-granularity parallel handling method |
| US10070154B2 (en)* | 2017-02-07 | 2018-09-04 | Fyusion, Inc. | Client-server communication for live filtering in a camera view |
| CN108924574B (en)* | 2018-08-01 | 2021-07-06 | 广州视源电子科技股份有限公司 | Packet loss processing method, device, device and storage medium in recording and broadcasting system |
| CN110675420B (en)* | 2019-08-22 | 2023-03-24 | 华为技术有限公司 | Image processing method and electronic equipment |
| CN112584232A (en)* | 2019-09-30 | 2021-03-30 | 北京金山云网络技术有限公司 | Video frame insertion method and device and server |
| CN112637538B (en)* | 2020-12-15 | 2022-08-02 | 重庆紫光华山智安科技有限公司 | Smart tag method, system, medium, and terminal for optimizing video analysis |
| CN112804561A (en)* | 2020-12-29 | 2021-05-14 | 广州华多网络科技有限公司 | Video frame insertion method and device, computer equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382938A (en)* | 2008-10-23 | 2009-03-11 | 浙江大学 | A network video ranking method based on user attention time |
| CN103810711A (en)* | 2014-03-03 | 2014-05-21 | 郑州日兴电子科技有限公司 | Keyframe extracting method and system for monitoring system videos |
| CN106375849A (en)* | 2015-07-23 | 2017-02-01 | 无锡天脉聚源传媒科技有限公司 | Template generation method, template generation device, video updating method and video updating device |
| EP3493535A1 (en)* | 2017-11-29 | 2019-06-05 | Mitsubishi Electric R & D Centre Europe B.V. | Method for controlling a video encoder of a video camera installed on a moving conveyance |
| CN108401188A (en)* | 2018-03-05 | 2018-08-14 | 青岛海信传媒网络技术有限公司 | A kind of method and device of media play |
| CN110225299A (en)* | 2019-05-06 | 2019-09-10 | 平安科技（深圳）有限公司 | Video monitoring method, device, computer equipment and storage medium |
| CN112954450A (en)* | 2021-02-02 | 2021-06-11 | 北京字跳网络技术有限公司 | Video processing method and device, electronic equipment and storage medium |
| Title |
|---|
| 《Moving object detection for content based video retrieval》;Nitya Raviprakash;《2016 International Conference on Communication and Signal Processing》;全文* |
| 《分布式视频编解码技术研究》;封颖;《中国优秀博士学位论文全文数据库》;全文* |
| Publication number | Publication date |
|---|---|
| CN113596556A (en) | 2021-11-02 |
| Publication | Publication Date | Title |
|---|---|---|
| US8693553B2 (en) | Methods, apparatuses, and computer program products for adaptive synchronized decoding of digital video | |
| US11172227B2 (en) | Video sending and receiving method, apparatus, and terminal thereof | |
| WO2019062050A1 (en) | Live broadcast control method, apparatus, and electronic device | |
| CN110933517B (en) | Rate switching method, client and computer-readable storage medium | |
| US10476928B2 (en) | Network video playback method and apparatus | |
| CN111970215B (en) | Data packet management method and device | |
| CN112104893B (en) | Video stream management method and device for realizing plug-in-free playing of webpage end | |
| CN106998485B (en) | Video live broadcasting method and device | |
| US20220060532A1 (en) | Method for transmitting resources and electronic device | |
| CN115955590B (en) | Video processing method, device, computer equipment and medium | |
| CN111093094A (en) | Video transcoding method, device and system, electronic equipment and readable storage medium | |
| CN111726657A (en) | Playback processing method, device and server of live video | |
| WO2015120766A1 (en) | Video optimisation system and method | |
| CN113225585B (en) | Video definition switching method and device, electronic equipment and storage medium | |
| CN114268830B (en) | Cloud guide synchronization method, device, equipment and storage medium | |
| CN112423140A (en) | Video playing method and device, electronic equipment and storage medium | |
| WO2018233539A1 (en) | Video processing method, computer storage medium and device | |
| US20240214521A1 (en) | Video processing method and apparatus, computer, and readable storage medium | |
| CN111436009B (en) | Real-time video stream transmission and display method and transmission and play system | |
| CN107396136A (en) | A kind of video data acquisition methods, device, server and medium | |
| CN113507639A (en) | Channel fast switching method, player and readable storage medium | |
| CN115022725B (en) | Video playback method and device | |
| CN113596556B (en) | Video transmission method, server and storage medium | |
| CN111202980A (en) | Information transmission method, streaming media cloud platform and computer-readable storage medium | |
| CN115883962A (en) | Camera control method, system, electronic equipment and storage medium |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |