技术领域technical field
本发明涉及音视频处理技术领域，具体涉及一种实现多屏间视频无缝切换的系统及方法。The invention relates to the technical field of audio and video processing, in particular to a system and method for realizing seamless video switching between multiple screens.
背景技术Background technique
一个用户通常拥有多块屏幕，例如TV(电视机)、移动终端(智能手机或者平板电脑，iOS或者android操作系统)、PC(计算机)等。在一个终端上，实现视频播放断点管理比较普遍。A user usually has multiple screens, such as TV (television), mobile terminal (smart phone or tablet computer, iOS or android operating system), PC (computer) and so on. On a terminal, it is common to implement video playback breakpoint management.
例如：申请号为201110144970.5、发明名称为《一种音视频连续播放无缝切换系统和方法》的中国发明专利公开了一种音视频连续播放无缝切换系统和方法，包括：多路径管理模块、数据缓冲模块、数据输出模块和至少两个文件存储服务器，系统初始化后进行填充操作，用于电视在音视频文件播放过程中遇到网络故障或者读取错误等异常情况时，进行无缝切换操作，达到系统连续播出的目的，避免人为操作带来的繁琐性和不确定性。For example: the Chinese invention patent with the application number 201110144970.5 and the invention name "A System and Method for Seamless Switching of Continuous Playing of Audio and Video" discloses a system and method for seamless switching of continuous playing of audio and video, including: multi-path management module, The data buffer module, the data output module and at least two file storage servers perform filling operations after the system is initialized, and are used for seamless switching operations when the TV encounters abnormal situations such as network failures or reading errors during the playback of audio and video files , to achieve the purpose of continuous broadcasting of the system, and avoid the tediousness and uncertainty brought about by human operation.
再例如，申请号为201510150780.2、发明名称为《实时视频流的无缝切换方法》的中国发明专利申请公开一种实时视频流的无缝切换方法，包括：视频流采集终端收到用户终端的规格切换请求后，保持原编码器实例继续运行，并启动一个新编码器实例；再将新视频流与原视频流进行帧号同步；然后在新视频流中选择一个关键帧，并从该关键帧开始向用户终端传送新视频流，原视频流传送完该关键帧的上一帧数据后结束，且该关键帧的帧号与原视频流的最后一个关键帧的帧号之间的间距大于新视频流GOP长度的1/2；然后再关闭原编码器实例。该方法适用于实时视频传输系统中的前端采集压缩设备。For another example, the Chinese invention patent application with the application number 201510150780.2 and the invention title "Seamless Switching Method of Real-time Video Streams" discloses a seamless switching method of real-time video streams, including: the video stream collection terminal receives the user terminal specifications After switching the request, keep the original encoder instance running and start a new encoder instance; then synchronize the frame number of the new video stream with the original video stream; then select a key frame in the new video stream, and start from the key frame Start to transmit the new video stream to the user terminal, and the original video stream ends after transmitting the previous frame data of the key frame, and the distance between the frame number of the key frame and the frame number of the last key frame of the original video stream is greater than that of the new video stream 1/2 of the GOP length of the video stream; then close the original encoder instance. The method is suitable for the front-end acquisition and compression equipment in the real-time video transmission system.
上述现有技术均是基于同一终端上的断点播放无缝切换。现实中，用户拥有的多媒体信息终端数量和类型逐步丰富，但由于多种终端的接入网络、信息获取平台的不同，造成了多种设备彼此独立、资源不能共享的局面。随着三网融合进程的不断推进，如何对使用者的机顶盒、计算机、PAD终端和智能手机等终端进行有效关联，从而为用户提供多种业务融合的多屏互动体验已成为当前所考虑的主要问题。多屏互动技术是指电视、计算机、手机、PAD及各种具有网络接入能力的多媒体信息终端件通过相关协议建立通信关系，实现多屏可同时收看运营商平台提供的视频内容，并可在多个屏幕间进行视频分享、无缝切换、播放控制等功能。The above-mentioned existing technologies are all based on seamless switching of breakpoint playback on the same terminal. In reality, the number and types of multimedia information terminals owned by users are gradually increasing. However, due to the different access networks and information acquisition platforms of various terminals, various devices are independent of each other and resources cannot be shared. With the continuous advancement of the triple play process, how to effectively associate users' set-top boxes, computers, PAD terminals, and smart phones, so as to provide users with a multi-screen interactive experience that integrates multiple services has become the main consideration currently. question. Multi-screen interactive technology refers to TVs, computers, mobile phones, PADs and various multimedia information terminal components with network access capabilities to establish communication relationships through related protocols, so that multiple screens can watch video content provided by the operator platform at the same time. Video sharing, seamless switching, playback control and other functions between multiple screens.
但是，现有的跨屏切换技术在不同文件格式间进行基于相同时间戳的切换时，通常依靠动态解析，难以做到断点无缝切换，甚至出现切换过程中断点无法衔接的问题。However, the existing cross-screen switching technology usually relies on dynamic analysis when switching between different file formats based on the same time stamp.
发明内容Contents of the invention
本发明的发明目的是提供一种实现多屏间视频无缝切换的系统及方法，用户可以随意在多个屏幕上续接多次而完成观看某个视频，跨屏播放实现无缝切换。The purpose of the present invention is to provide a system and method for realizing seamless switching of videos between multiple screens. Users can watch a certain video by connecting multiple times on multiple screens at will, and realize seamless switching by cross-screen playback.
为了解决上述技术问题，本发明采用的技术方案如下：In order to solve the problems of the technologies described above, the technical scheme adopted in the present invention is as follows:
一种实现多屏间视频无缝切换的系统,包括第一视频播放终端和第二视频播放终端、屏幕切换服务器，其中，A system for realizing seamless video switching between multiple screens, comprising a first video playback terminal, a second video playback terminal, and a screen switching server, wherein,
所述第一视频播放终端和第二视频播放终端适用于播放视频文件，并对当前正在播放的视频文件进行屏幕切换操作；The first video playback terminal and the second video playback terminal are suitable for playing video files, and performing screen switching operations on the currently playing video files;
所述屏幕切换服务器适用于检测并记录所述第一视频播放终端和所述第二视频播放终端的设备信息、屏幕切换操作的信息，根据所述设备信息和所述屏幕切换操作的信息，确定从所述第一视频播放终端切换至所述第二视频播放终端播放的视频文件的切入帧对应的时间点，将所述时间点发送给所述第二视频播放终端；The screen switching server is adapted to detect and record the device information and screen switching operation information of the first video playback terminal and the second video playback terminal, and determine according to the device information and the screen switching operation information Switching from the first video player terminal to the time point corresponding to the cut-in frame of the video file played by the second video player terminal, and sending the time point to the second video player terminal;
所述第一视频播放终端和/或所述第二视频播放终端的媒体播放器包括媒体格式解码器、流媒体协议栈模块和音视频解码器，还包括屏幕切换通信模块和屏幕切换数据缓冲器，所述屏幕切换通信模块用于实现所述第一视频播放终端和所述第二视频播放终端的数据通信功能，所述屏幕切换数据缓冲器用于在所述第一视频播放终端执行屏幕切换操作时，存储当前正在播放的视频的切换数据。The media player of the first video playback terminal and/or the second video playback terminal includes a media format decoder, a streaming media protocol stack module, and an audio and video decoder, and also includes a screen switching communication module and a screen switching data buffer, The screen switching communication module is used to realize the data communication function between the first video playback terminal and the second video playback terminal, and the screen switching data buffer is used when the first video playback terminal performs a screen switching operation , which stores the switching data of the currently playing video.
进一步的，所述屏幕切换服务器包括中央服务器、解析器和判决器，所述中央服务器分别与所述第一视频播放终端、第二视频播放终端和所述判决器连接，所述解析器分别与所述第一视频播放终端和所述第二视频播放终端连接，其中，Further, the screen switching server includes a central server, a parser and a decision device, the central server is respectively connected to the first video playback terminal, the second video playback terminal and the decision device, and the parser is respectively connected to the The first video playback terminal is connected to the second video playback terminal, wherein,
所述中央服务器适用于记录屏幕切换操作的信息，所述屏幕切换操作的信息至少包括所述第一视频播放终端在播放所述视频文件时最新执行屏幕切换操作的时间戳信息；The central server is adapted to record the information of the screen switching operation, and the information of the screen switching operation at least includes the time stamp information of the latest screen switching operation performed by the first video playback terminal when playing the video file;
所述解析器适用于将所述视频文件离线生成对应于所述第一视频播放终端和所述第二视频播放终端的时间静态表；The parser is adapted to generate a temporal static table corresponding to the first video playback terminal and the second video playback terminal offline from the video file;
所述判决器适用于根据所述时间戳信息和所述时间静态表，获得同一时间戳所述第一视频播放终端和所述第二视频播放终端之间的时间偏移量，作为所述时间点。The determiner is adapted to obtain the time offset between the first video playback terminal and the second video playback terminal at the same time stamp as the time according to the time stamp information and the time static table point.
进一步的，所述屏幕切换服务器还包括码流器，所述码流器连接所述判决器，其适用于接收所述码流器发送的所述时间偏移量，根据所述时间偏移量推送码流进入所述第二视频播放终端。Further, the screen switching server further includes a streamer, the streamer is connected to the decision unit, and is adapted to receive the time offset sent by the streamer, and according to the time offset The code stream is pushed into the second video playback terminal.
进一步的，所述中央服务器包括用户信息存储器、设备信息存储器、绑定关系存储器和视频播放信息存储器，其中，Further, the central server includes a user information storage, a device information storage, a binding relationship storage, and a video playback information storage, wherein,
所述用户信息存储器适用于存储用户在所述第一视频播放终端和/或所述第二视频播放终端上的注册信息，所述注册信息包括用户账户信息和密码；The user information storage is adapted to store user registration information on the first video playback terminal and/or the second video playback terminal, the registration information including user account information and passwords;
所述设备信息存储器适用于存储所述第一视频播放终端和所述第二视频播放终端的设备信息，包括设备类型、分辨率和/或码率；The device information storage is suitable for storing device information of the first video playback terminal and the second video playback terminal, including device type, resolution and/or code rate;
所述绑定关系存储器适用于存储所述第一视频播放终端和所述第二视频播放终端的设备信息与所述注册信息之间的对应关系；The binding relationship memory is suitable for storing the correspondence between the device information of the first video playback terminal and the second video playback terminal and the registration information;
所述视频播放信息存储器适用于存储所述第一视频播放终端和/或所述第二视频播放终端的所述屏幕切换操作信息。The video playing information storage is suitable for storing the screen switching operation information of the first video playing terminal and/or the second video playing terminal.
进一步的，还包括视频服务器，所述视频服务器分别与所述解析器、所述第一视频播放终端和所述第二视频播放终端连接，其适用于对所有进入系统的媒体内容进行处理，生成针对不同媒体格式的相关索引文件。Further, it also includes a video server, the video server is respectively connected with the parser, the first video playback terminal and the second video playback terminal, which is suitable for processing all media content entering the system, generating Related index files for different media formats.
根据本发明的另一个方面，还提供了一种实现多屏间视频无缝切换的方法，包括以下步骤：According to another aspect of the present invention, a method for realizing seamless video switching between multiple screens is also provided, including the following steps:
通过第一视频播放终端播放视频文件；Play the video file through the first video playback terminal;
执行屏幕切换操作；Perform screen switching operations;
根据所述第一视频播放终端和所述第二视频播放终端的设备信息和所述屏幕切换操作信息，确定所述第二视频播放终端播放所述视频文件的切入帧对应的时间点；According to the device information of the first video playback terminal and the second video playback terminal and the screen switching operation information, determine the time point corresponding to the cut-in frame of the video file played by the second video playback terminal;
将所述时间点发送给所述第二视频播放终端，以便通过所述第二视频终端根据所述时间点继续播放所述视频文件。The time point is sent to the second video playback terminal, so that the second video terminal continues to play the video file according to the time point.
进一步的，所述根据所述第一视频播放终端和所述第二视频播放终端的设备信息和所述屏幕切换操作信息，确定所述第二视频播放终端播放所述视频文件的切入帧对应的时间点的步骤，具体包括以下步骤：Further, according to the device information of the first video playback terminal and the second video playback terminal and the screen switching operation information, it is determined that the cut-in frame corresponding to the cut-in frame of the video file played by the second video playback terminal The steps at the time point specifically include the following steps:
记录屏幕切换的信息，所述屏幕切换的信息至少包括所述视频文件在所述第一视频播放终端最新执行屏幕切换操作的时间戳信息；Recording screen switching information, where the screen switching information at least includes timestamp information of the latest screen switching operation performed by the video file on the first video playback terminal;
将所述视频文件离线生成对应于所述第一视频播放终端和所述第二视频播放终端的时间静态表；The video file is generated offline corresponding to the time static table of the first video playback terminal and the second video playback terminal;
根据所述时间戳信息和所述时间静态表，获得同一时间戳所述第一视频播放终端和所述第二视频播放终端之间的时间偏移量，作为所述时间点。According to the time stamp information and the time static table, a time offset between the first video playback terminal and the second video playback terminal with the same time stamp is obtained as the time point.
进一步的，该方法还包括：Further, the method also includes:
根据所述时间偏移量推送码流进入所述第二视频播放终端；Pushing code streams into the second video playback terminal according to the time offset;
所述第二视频播放终端继续播放所述视频文件。The second video playing terminal continues to play the video file.
进一步的，所述通过第一视频播放终端播放视频文件的步骤之前，还包括以下步骤：Further, before the step of playing the video file through the first video playback terminal, the following steps are also included:
存储用户在所述第一视频播放终端和/或所述第二视频播放终端上的注册信息，所述注册信息包括用户账户信息和密码；storing user registration information on the first video playback terminal and/or the second video playback terminal, the registration information including user account information and passwords;
存储所述第一视频播放终端和所述第二视频播放终端的设备信息，包括设备类型、分辨率和/或码率；storing device information of the first video playback terminal and the second video playback terminal, including device type, resolution and/or code rate;
存储所述第一视频播放终端和所述第二视频播放终端的设备信息与所述注册信息之间的对应关系。storing the correspondence between the device information of the first video playing terminal and the second video playing terminal and the registration information.
进一步的，还包括：Further, it also includes:
接收所有进入系统的媒体内容；Receive all media content entering the system;
生成针对不同媒体格式的相关索引文件在所述第一视频播放终端执行屏幕切换操作时，存储当前正在播放的视频的切换数据，并将存储的切换数据发送给第二视频播放终端。Generating related index files for different media formats When the first video player terminal performs a screen switching operation, store the switching data of the currently playing video, and send the stored switching data to the second video player terminal.
进一步的，还包括媒体内容处理步骤，具体包括：Further, it also includes media content processing steps, specifically including:
接收所有进入系统的媒体内容；Receive all media content entering the system;
生成针对不同媒体格式的相关索引文件。Generate relevant index files for different media formats.
本发明公开了一种实现多屏间视频无缝切换的系统及方法，实现计算机、手机、PAD等多媒体终端在媒体内容播放过程中，媒体内容由一个终端屏幕向另一个终端屏幕的无缝切换，提高了用户访问的便利性，获取内容的灵活性，用户可以随意在多个屏幕上续接多次而完成观看某个视频，跨屏播放实现无缝切换。The invention discloses a system and method for realizing seamless switching of videos between multiple screens, which realizes the seamless switching of media content from one terminal screen to another terminal screen during the media content playing process of multimedia terminals such as computers, mobile phones, and PADs , which improves the convenience of user access and the flexibility of content acquisition. Users can watch a certain video by continuing multiple times on multiple screens at will, and realize seamless switching through cross-screen playback.
上述说明仅是本发明技术方案的概述，为了能够使得本发明的技术手段更加清楚明白，达到本领域技术人员可依照说明书的内容予以实施的程度，并且为了能够让本发明的上述和其它目的、特征和优点能够更明显易懂，下面以本发明的具体实施方式进行举例说明。The above description is only an overview of the technical solution of the present invention. In order to make the technical means of the present invention clearer, to the extent that those skilled in the art can implement it according to the contents of the description, and to enable the above and other purposes of the present invention, The features and advantages can be more obvious and understandable, and the specific implementation manners of the present invention are illustrated below for illustration.
附图说明Description of drawings
通过阅读下文优选的具体实施方式中的详细描述，本发明各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。说明书附图仅用于示出优选实施方式的目的，而并不认为是对本发明的限制。显而易见地，下面描述的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。而且在整个附图中，用相同的附图标记表示相同的部件。在附图中：Various other advantages and benefits of the present invention will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings in the description are for the purpose of illustrating preferred embodiments only and are not to be considered as limiting the invention. Obviously, the drawings described below are only some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to these drawings without creative efforts. Also throughout the drawings, the same reference numerals are used to denote the same parts. In the attached picture:
图1示出了根据本发明实施例一的实现多屏间视频无缝切换的系统结构示意图；FIG. 1 shows a schematic structural diagram of a system for realizing seamless video switching between multiple screens according to Embodiment 1 of the present invention;
图2示出了根据本发明实施例二的实现多屏间视频无缝切换的系统结构示意图；FIG. 2 shows a schematic structural diagram of a system for realizing seamless video switching between multiple screens according to Embodiment 2 of the present invention;
图3示出了基于本发明实施例二的实现多屏间视频无缝切换的系统中生成时间静态表示意图；FIG. 3 shows a schematic diagram of generating time static representations in a system for realizing seamless video switching among multiple screens based on Embodiment 2 of the present invention;
图4示出了根据本发明实施例三的实现多屏间视频无缝切换的方法流程图。FIG. 4 shows a flowchart of a method for realizing seamless video switching between multiple screens according to Embodiment 3 of the present invention.
具体实施方式Detailed ways
下面将参照附图更详细地描述本发明的具体实施例。虽然附图中显示了本发明的具体实施例，然而应当理解，可以以各种形式实现本发明而不应被这里阐述的实施例所限制。相反，提供这些实施例是为了能够更透彻地理解本发明，并且能够将本发明的范围完整的传达给本领域的技术人员。Specific embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although specific embodiments of the invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and is not limited to the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.
需要说明的是，在说明书及权利要求当中使用了某些词汇来指称特定组件。本领域技术人员应可以理解，硬件制造商可能会用不同名词来称呼同一个组件。本说明书及权利要求并不以名词的差异来作为区分组件的方式，而是以组件在功能上的差异来作为区分的准则。如在通篇说明书及权利要求当中所提及的“包含”或“包括”为一开放式用语，故应解释成“包含但不限定于”。说明书后续描述为实施本发明的较佳实施方式，然所述描述乃以说明书的一般原则为目的，并非用以限定本发明的范围。本发明的保护范围当视所附权利要求所界定者为准。It should be noted that certain terms are used in the specification and claims to refer to specific components. Those skilled in the art should understand that hardware manufacturers may use different terms to refer to the same component. The specification and claims do not use differences in nouns as a way of distinguishing components, but use differences in functions of components as a criterion for distinguishing. "Includes" or "comprises" mentioned throughout the specification and claims is an open term, so it should be interpreted as "including but not limited to". The subsequent description in the specification is a preferred implementation mode for implementing the present invention, but the description is for the purpose of the general principles of the specification, and is not intended to limit the scope of the present invention. The scope of protection of the present invention should be defined by the appended claims.
为便于对本发明实施例的理解，下面将结合附图以几个具体实施例为例做进一步的解释说明，且各个附图并不构成对本发明实施例的限定。In order to facilitate the understanding of the embodiments of the present invention, several specific embodiments will be taken as examples for further explanation below in conjunction with the accompanying drawings, and each drawing does not constitute a limitation to the embodiments of the present invention.
实施例一、一种实现多屏间视频无缝切换的系统。Embodiment 1. A system for realizing seamless video switching between multiple screens.
图1为本发明实施例一的实现多屏间视频无缝切换的系统结构示意图，本发明实施例将结合图1进行具体说明。FIG. 1 is a schematic structural diagram of a system for realizing seamless video switching between multiple screens according to Embodiment 1 of the present invention. The embodiment of the present invention will be described in detail with reference to FIG. 1 .
如图1所示，本发明实施例提供了一种实现多屏间视频无缝切换的系统100，包括第一视频播放终端101和第二视频播放终端103、屏幕切换服务器102，所述屏幕切换服务器102能够与所述第一视频播放终端101和所述第二视频播放终端103双向通信，其中，As shown in FIG. 1 , the embodiment of the present invention provides a system 100 for realizing seamless video switching between multiple screens, including a first video playback terminal 101, a second video playback terminal 103, and a screen switching server 102. The screen switching The server 102 can communicate bidirectionally with the first video playback terminal 101 and the second video playback terminal 103, wherein,
所述第一视频播放终端101和第二视频播放终端103包括媒体播放器(第一媒体播放器1011、第二媒体播放器1031)和显示器(第一显示器1012、第二显示器1032)，其适用于播放视频文件，并能够对当前正在播放的视频文件进行屏幕切换操作，所述第一视频播放终端101能够将所述视频文件切换至所述第二视频播放终端103继续播放；The first video playback terminal 101 and the second video playback terminal 103 include a media player (the first media player 1011, the second media player 1031) and a display (the first display 1012, the second display 1032), which are suitable for For playing video files, and can perform screen switching operation on the currently playing video file, the first video playback terminal 101 can switch the video file to the second video playback terminal 103 to continue playing;
所述屏幕切换服务器102适用于检测并记录所述第一视频播放终端101和所述第二视频播放终端103的设备信息、所述第一视频播放终端101的屏幕切换操作信息，根据所述设备信息和所述屏幕切换操作信息，确定所述第二视频播放终端103播放所述视频文件的切入帧对应的时间点。The screen switching server 102 is adapted to detect and record the device information of the first video playback terminal 101 and the second video playback terminal 103, the screen switching operation information of the first video playback terminal 101, according to the device Information and the screen switching operation information determine the time point corresponding to the cut-in frame of the video file played by the second video playback terminal 103.
本发明实施例中优选的，所述第一视频播放终端101用来指代初始播放视频文件的用户终端设备，所述第二视频播放终端103用来指代屏幕切换后继续播放同一视频文件的用户终端设备，这里的“第一”和“第二”不是用来表示数量的多少，也不是用来指代顺序，其中，所述第一视频播放终端在另外的场景中可以用作第二视频播放终端，所述第二视频播放终端也可以作为第一视频播放终端，所述第二视频播放终端在另外一次使用过程中，可以将所述第二视频播放终端未播放完毕的视频文件切换至所述第一视频播放终端继续播放。Preferably in the embodiment of the present invention, the first video playback terminal 101 is used to refer to the user terminal device that initially plays the video file, and the second video playback terminal 103 is used to refer to the user terminal device that continues to play the same video file after the screen is switched. For user terminal equipment, the "first" and "second" here are not used to indicate the quantity, nor are they used to refer to the order, wherein the first video playback terminal can be used as the second video playback terminal in other scenarios. The video playback terminal, the second video playback terminal can also be used as the first video playback terminal, and the second video playback terminal can switch the video files that have not been played by the second video playback terminal during another use Go to the first video playback terminal to continue playing.
本发明实施例中优选的，所述第一视频播放终端101和所述第二视频播放终端103可以是移动终端，例如智能手机、平板电脑等；也可以是智能电视，包括机顶盒、小米盒子等；还可以是计算机，例如台式机、笔记本电脑等；还可以是任意可以联网并且能够播放视频的电子设备。所述第一视频播放终端101和所述第二视频播放终端103可以是同一类型的用户终端，例如均为智能手机，将同一视频文件从一智能手机切换至另一智能手机继续播放；也可以是不同类型的用户终端，例如所述第一视频播放终端101为TV端，所述第二视频播放终端103为移动端，将同一视频文件从TV端切换至移动端继续播放。Preferably in the embodiment of the present invention, the first video playback terminal 101 and the second video playback terminal 103 can be mobile terminals, such as smart phones, tablet computers, etc.; they can also be smart TVs, including set-top boxes, millet boxes, etc. ; It can also be a computer, such as a desktop computer, a notebook computer, etc.; it can also be any electronic device that can be connected to the Internet and can play videos. The first video playback terminal 101 and the second video playback terminal 103 can be user terminals of the same type, such as smart phones, and the same video file can be switched from one smart phone to another smart phone to continue playing; are different types of user terminals, for example, the first video playback terminal 101 is a TV terminal, and the second video playback terminal 103 is a mobile terminal, and the same video file is switched from the TV terminal to the mobile terminal to continue playing.
本发明实施例中优选的，所述第一视频播放终端和/或所述第二视频播放终端的媒体播放器或者显示器上具有一个“屏幕切换”按键，通过其可以直接“确认”切换到所述第二视频播放终端。Preferably in the embodiment of the present invention, the media player or display of the first video playback terminal and/or the second video playback terminal has a "screen switch" button, through which the switch to the selected screen can be directly "confirmed". Describe the second video playback terminal.
本发明实施例中优选的，视频切换指令是由用户触发，用户触发视频切换指令的方式有多种，例如，预先在播放当前视频的网页生成供用户触发视频切换指令的触发按键，用户可以通过触摸所述第一视频播放终端的所述触发按键触发所述视频切换指令；或者通过遥控器触发所述视频切换指令；或者通过鼠标点击所述触发按键，触发视频切换指令。Preferably in the embodiment of the present invention, the video switching instruction is triggered by the user. There are many ways for the user to trigger the video switching instruction. Touch the trigger button of the first video playback terminal to trigger the video switching instruction; or trigger the video switching instruction through a remote controller; or click the trigger button with a mouse to trigger the video switching instruction.
本发明实施例中优选的，所述屏幕切换操作包括以下任意一种情况：所述第一视频播放终端向所述屏幕切换服务器发起屏幕切换操作，例如触发所述第一媒体播放器上的“屏幕切换”按键；所述第一视频播放终端直接向所述第二视频播放终端发起屏幕切换操作；所述第二视频播放终端向所述屏幕切换服务器发起屏幕切换操作，例如触发所述第二媒体播放器上的“屏幕切换”按键；所述第二视频播放终端直接向所述第一视频播放终端发起屏幕切换操作；所述屏幕切换服务器实时检测所述第一视频播放终端上的视频播放进度信息，根据对当前正在播放的视频文件的操作信息，自动触发所述屏幕切换操作，例如，当所述屏幕切换服务器检测到所述第一视频播放终端上正在播放的视频文件出现了暂停、退出或者所述第一视频播放终端待机、关机或者所述第一媒体播放器窗口最小化等操作。Preferably in the embodiment of the present invention, the screen switching operation includes any of the following situations: the first video playback terminal initiates a screen switching operation to the screen switching server, for example, triggering the " Screen switching" button; the first video playback terminal directly initiates a screen switching operation to the second video playback terminal; the second video playback terminal initiates a screen switching operation to the screen switching server, such as triggering the second The "screen switching" button on the media player; the second video playback terminal directly initiates a screen switching operation to the first video playback terminal; the screen switching server detects in real time the video playback on the first video playback terminal progress information, according to the operation information on the currently playing video file, automatically trigger the screen switching operation, for example, when the screen switching server detects that the video file being played on the first video playback terminal is paused, Exit or the first video player terminal is on standby, shutting down or minimizing the first media player window and other operations.
本发明实施例中优选的，所述屏幕切换服务器102包括中央服务器、解析器和判决器，所述中央服务器分别与所述第一视频播放终端101、第二视频播放终端103和所述判决器连接，所述解析器分别与所述第一视频播放终端101和所述第二视频播放终端103连接，其中，Preferably in the embodiment of the present invention, the screen switching server 102 includes a central server, a parser and a decision device, and the central server communicates with the first video playback terminal 101, the second video playback terminal 103 and the decision device respectively connected, the parser is respectively connected with the first video playback terminal 101 and the second video playback terminal 103, wherein,
所述中央服务器适用于记录状态信息，所述状态信息至少包括所述视频文件在所述第一视频播放终端101最新执行屏幕切换操作的时间戳信息；The central server is suitable for recording status information, and the status information includes at least the timestamp information of the latest screen switching operation performed by the video file on the first video playback terminal 101;
所述解析器适用于将所述视频文件离线生成对应于所述第一视频播放终端101和所述第二视频播放终端103的时间静态表；The parser is adapted to offline generate the video file corresponding to the first video playback terminal 101 and the second video playback terminal 103 time static table;
所述判决器适用于根据所述时间戳信息和所述时间静态表，获得同一时间戳所述第一视频播放终端101和所述第二视频播放终端103之间的时间偏移量。The determiner is adapted to obtain the time offset between the first video player terminal 101 and the second video player terminal 103 at the same time stamp according to the time stamp information and the time static table.
本发明实施例中优选的，还包括码流器，所述码流器连接所述判决器，其适用于接收所述码流器发送的所述时间偏移量，根据所述时间偏移量推送码流进入所述第二视频播放终端103。Preferably, in the embodiment of the present invention, a streamer is also included, the streamer is connected to the decision unit, and it is suitable for receiving the time offset sent by the streamer, and according to the time offset The code stream is pushed into the second video playback terminal 103.
本发明实施例中优选的，所述中央服务器包括用户信息存储器、设备信息存储器、绑定关系存储器和视频播放信息存储器，其中，Preferably in the embodiment of the present invention, the central server includes a user information storage, a device information storage, a binding relationship storage and a video playback information storage, wherein,
所述用户信息存储器适用于存储用户在所述第一视频播放终端101和/或所述第二视频播放终端103上的注册信息，所述注册信息包括用户账户信息和密码；The user information storage is adapted to store user registration information on the first video playback terminal 101 and/or the second video playback terminal 103, the registration information including user account information and passwords;
所述设备信息存储器适用于存储所述第一视频播放终端101和所述第二视频播放终端103的设备信息，包括设备类型、分辨率和/或码率；The device information storage is suitable for storing device information of the first video playback terminal 101 and the second video playback terminal 103, including device type, resolution and/or code rate;
所述绑定关系存储器适用于存储所述第一视频播放终端101和所述第二视频播放终端103的设备信息与所述注册信息之间的对应关系；The binding relationship memory is suitable for storing the correspondence between the device information of the first video playback terminal 101 and the second video playback terminal 103 and the registration information;
所述视频播放信息存储器适用于存储所述第一视频播放终端101和/或所述第二视频播放终端103的所述屏幕切换操作信息。The video playing information storage is suitable for storing the screen switching operation information of the first video playing terminal 101 and/or the second video playing terminal 103 .
本发明实施例中优选的，所述中央服务器实现对用户多种终端间的绑定，例如，用户甲拥有一个智能手机、一台平板电脑、一个台式机、一台笔记本电脑和一台电视机，用户甲可以通过所述智能手机、平板电脑、台式机、笔记本电脑或者电视机其中任意一种电子设备向所述中央服务器发出注册请求，所述注册请求中包括用户账户ID(或者称为用户ID、用户名)、密码等基本信息，还可以包括个性化设置信息，例如用户的观看视频的偏好、观看模式等。所述中央服务器接收所述注册请求，并将用户甲的注册信息存储在所述用户信息存储器。Preferably in the embodiment of the present invention, the central server implements the binding between various terminals of the user, for example, user A owns a smart phone, a tablet computer, a desktop computer, a laptop computer and a TV set , user A can send a registration request to the central server through any electronic device in the smart phone, tablet computer, desktop computer, notebook computer or television, and the registration request includes the user account ID (or called user Basic information such as ID, user name), password, etc., may also include personalized setting information, such as the user's preference for watching videos, viewing mode, etc. The central server receives the registration request, and stores the registration information of user A in the user information storage.
本发明实施例中优选的，所述视频播放信息存储器还可以进一步跟踪记录同一用户的行为特征，用户可以增加更多的定制服务，例如可以在第一视频播放终端101上自动记录用户信息，在第一视频播放终端101上停止播放后，可以记录到所述中央服务器，这样用户在其他设备上再次播放的时候，可以提醒用户是否继续上次的播放内容，也能为商业广告、个性服务提供数据。Preferably in the embodiment of the present invention, the video playback information storage can also further track and record the behavior characteristics of the same user, and the user can add more customized services, for example, the user information can be automatically recorded on the first video playback terminal 101. After the first video playback terminal 101 stops playing, it can be recorded to the central server, so that when the user plays again on other devices, the user can be reminded whether to continue the last playback content, and it can also provide commercial advertisements and personalized services. data.
本发明实施例中优选的，用户甲使用所述用户ID登录所述中央服务器成功后，可以将其拥有的电子设备的全部或者部分添加至所述中央服务器，例如，用户甲可以将其智能手机、笔记本电脑和电视机添加到所述中央服务器，所述中央服务器将用户甲与其拥有的智能手机、笔记本电脑和电视机进行绑定，并存储在所述绑定关系存储器。Preferably in the embodiment of the present invention, after user A successfully logs in to the central server using the user ID, he can add all or part of his electronic equipment to the central server, for example, user A can add his smart phone , notebook computer and television are added to the central server, and the central server binds user A with his smart phone, notebook computer and television and stores them in the binding relationship memory.
本发明实施例中优选的，用户还可以设置将某一用户终端作为另一用户终端的默认目标设备，例如，可以将所述智能手机执行屏幕切换时的默认第二视频播放终端为所述平板电脑，将所述平板电脑执行屏幕切换时的默认第二视频播放终端为所述笔记本电脑，将所述笔记本电脑执行屏幕切换时的默认第二视频播放终端为所述智能手机，这样，当用户触发屏幕切换操作时，不需要进行手工选择，即可在所述默认目标设备上继续播放同一视频文件。当然，也可以通过下拉选择的方式选定某一用户终端作为所述第二视频播放终端。Preferably in the embodiment of the present invention, the user can also set a certain user terminal as the default target device of another user terminal, for example, the default second video playback terminal when the smart phone performs screen switching can be the tablet computer, the default second video playback terminal when the tablet computer performs screen switching is the notebook computer, and the default second video playback terminal when the notebook computer performs screen switching is the smart phone, so that when the user When the screen switching operation is triggered, the same video file can continue to be played on the default target device without manual selection. Of course, a certain user terminal may also be selected as the second video playback terminal by means of a pull-down selection.
本发明实施例中优选的，所述第一视频播放终端和/或所述第二视频播放终端的媒体播放器包括媒体格式解码器、流媒体协议栈模块和音视频解码器，还包括屏幕切换通信模块和屏幕切换数据缓冲器，所述屏幕切换通信模块用于实现所述第一视频播放终端和所述第二视频播放终端的数据通信功能，所述屏幕切换数据缓冲器用于在所述第一视频播放终端执行屏幕切换操作时，存储当前正在播放的视频的切换数据。Preferably in the embodiment of the present invention, the media player of the first video playback terminal and/or the second video playback terminal includes a media format decoder, a streaming media protocol stack module and an audio and video decoder, and also includes a screen switching communication module and a screen switching data buffer, the screen switching communication module is used to realize the data communication function between the first video playback terminal and the second video playback terminal, and the screen switching data buffer is used in the first When the video playing terminal performs a screen switching operation, it stores the switching data of the currently playing video.
当用户启动所述第一媒体播放器播放媒体文件时，第一媒体播放器首先在所述第一视频播放终端播放视频文件，第一媒体播放器的各模块自动发送相关控制信息给所述屏幕切换数据缓冲器，所述屏幕切换数据缓冲器还缓冲有最近上一帧之后的数据。When the user starts the first media player to play a media file, the first media player first plays the video file on the first video playback terminal, and each module of the first media player automatically sends relevant control information to the screen switch data buffer, and the screen switch data buffer also buffers the data after the last last frame.
当用户点击“屏幕切换”按键进行切换时，所述第一视频播放终端首先与默认目标设备连接，不成功就连接下一个默认目标设备，或连接用户指定的目标设备。一旦连接成功，所述第一视频播放终端中的屏幕切换通信模块就主动从屏幕切换数据缓冲器获取音视频内容切换数据，并按照屏幕切换协议以网络数据形式发送给所述第二视频播放终端，所述音视频内容切换数据包括视频解码需要的所有参数、控制信息及从上一帧开始的视频文件的原始压缩数据流。所述当前播放视频文件解码所需要的参数可包括：当前播放媒体的音频压缩格式、数据采样率、采样数据位、视频压缩格式、视频分辨率、视频帧率、支持的流媒体协议及版本号、文件大小，当前播放相对位置。When the user clicks the "Screen Switch" button to switch, the first video playback terminal first connects to the default target device, and if unsuccessful, connects to the next default target device, or connects to the target device specified by the user. Once the connection is successful, the screen switching communication module in the first video playback terminal will actively obtain audio and video content switching data from the screen switching data buffer, and send it to the second video playback terminal in the form of network data according to the screen switching protocol , the audio and video content switching data includes all parameters needed for video decoding, control information and the original compressed data stream of the video file starting from the previous frame. The parameters required for decoding the currently playing video file may include: audio compression format, data sampling rate, sampling data bits, video compression format, video resolution, video frame rate, supported streaming media protocol and version number of the currently playing media , file size, and the relative position of the current playback.
支持屏幕切换的媒体播放器，一旦进入屏幕切换或同时播放状态，音视频解码器就把其输入的数据同时发送给屏幕切换数据缓冲器，直到停止播放或回到所述第一视频播放终端播放模式。这样，就可以实现所述第一视频播放终端和所述第二视频播放终端之间视频内容的直接推送和切换，不需要再向视频服务器请求发送视频文件，可以在各设备间灵活地、无缝地实现屏幕切换，且占用网络带宽低，为用户提供了方便。A media player that supports screen switching, once it enters the screen switching or simultaneous playing state, the audio and video decoder sends its input data to the screen switching data buffer at the same time, until it stops playing or returns to the first video playback terminal to play model. In this way, the direct pushing and switching of video content between the first video playback terminal and the second video playback terminal can be realized, and there is no need to request the video server to send video files, and it is possible to flexibly and seamlessly switch between devices. Screen switching can be realized seamlessly, and the network bandwidth is low, which provides convenience for users.
本发明实施例中优选的，所述中央服务器可以自动检测用户的终端设备，并将所述设备信息存储到所述设备信息存储器，其中，所述设备信息包括设备ID、设备IP地址、设备类型、分辨率和/或码率等。Preferably in the embodiment of the present invention, the central server can automatically detect the user's terminal device, and store the device information in the device information storage, wherein the device information includes device ID, device IP address, device type , resolution and/or bitrate, etc.
本发明实施例中优选的，所述中央服务器实现对用户多种终端间的绑定，通过HTTP、RTSP等标准通信与传输协议完成用户终端到用户终端间的通信与消息解析，并依据消息信令完成一个用户终端对另一个用户终端的控制，即所述第一视频播放终端将相关控制命令发送至所述中央服务器，所述中央服务器完成对相关协议的解析并生成适合所述第二视频播放终端解析的控制信令，并将控制信令发送至所述第二视频播放终端，完成影片在多个用户终端上的播放，及在播放过程中由一个用户终端无缝切换到另一用户终端的无间断播放及控制。Preferably in the embodiment of the present invention, the central server implements the binding between various terminals of the user, and completes the communication and message analysis between the user terminal and the user terminal through standard communication and transmission protocols such as HTTP and RTSP, and according to the message information order to complete the control of one user terminal on another user terminal, that is, the first video playback terminal sends relevant control commands to the central server, and the central server completes the analysis of the relevant protocols and generates a video file suitable for the second video Play the control signaling analyzed by the terminal, and send the control signaling to the second video playback terminal to complete the playback of the movie on multiple user terminals, and seamlessly switch from one user terminal to another during the playback process Uninterrupted playback and control of the terminal.
本发明实施例中优选的，所述中央服务器既可以接受同一用户同一账户的登录信息，根据该用户的账户登录信息来判断该用户当前使用的用户终端，并根据所述屏幕切换信息，自动将所述第一视频播放终端101最新未播放完毕的视频文件切换至该用户当前正在登录的所述第二视频播放终端；也可以接受不同用户之间的屏幕切换请求，不同用户之间可以通过加好友，将其在所述第一视频播放终端101上正在播放的视频文件切换至所述第二视频播放终端103，从而实现好友之间的视频分享功能。Preferably in the embodiment of the present invention, the central server can accept the login information of the same user and the same account, judge the user terminal currently used by the user according to the account login information of the user, and automatically switch the The latest unfinished video file of the first video player terminal 101 is switched to the second video player terminal that the user is currently logging in; screen switching requests between different users can also be accepted, and different users can be added by adding A friend switches the video file being played on the first video playback terminal 101 to the second video playback terminal 103, so as to realize the video sharing function between friends.
本发明实施例中优选的，还包括视频服务器，所述视频服务器分别与所述解析器、所述第一视频播放终端101和所述第二视频播放终端103连接，其适用于对所有进入系统的媒体内容进行处理，生成针对不同媒体格式的相关索引文件。具体的，所述视频服务器对所有进入系统的媒体内容进行处理，完成对流媒体内容的二次编转码及封装过程，并生成针对不同媒体格式的相关索引文件(XML格式ADI文档)。Preferably in the embodiment of the present invention, also comprise video server, described video server is respectively connected with described parser, described first video playing terminal 101 and described second video playing terminal 103, and it is suitable for all entering system The media content is processed to generate relevant index files for different media formats. Specifically, the video server processes all media content entering the system, completes the secondary encoding, transcoding and encapsulation process of streaming media content, and generates related index files (ADI documents in XML format) for different media formats.
本发明实施例中优选的，所述第一视频播放终端101接收到视频切换指令后，当前视频可以在第一视频播放终端101处继续播放，也可以暂停当前视频在第一视频播放终端101的播放。Preferably in the embodiment of the present invention, after the first video player terminal 101 receives the video switching instruction, the current video can continue to be played at the first video player terminal 101, or the current video can be paused at the first video player terminal 101. play.
如果第一视频播放终端101接收到视频切换指令后，当前视频在第一视频播放终端101处继续播放，则第一视频播放终端101接收到视频切换指令后，所述中央服务器会记录其接收到视频切换指令时当前视频在第一视频播放终端101处的播放进度，并根据记录的播放进度生成播放进度信息；将第一视频播放终端101播放的当前视频切换至第二视频播放终端103播放时，不影响当前视频在第一视频播放终端101处的播放。If the current video continues to play at the first video playback terminal 101 after the first video playback terminal 101 receives the video switching instruction, then after the first video playback terminal 101 receives the video switching instruction, the central server will record that it has received the video switching instruction. The playback progress of the current video at the first video playback terminal 101 during the video switching instruction, and generate playback progress information according to the playback progress recorded; when the current video played by the first video playback terminal 101 is switched to the second video playback terminal 103 when playing , does not affect the playback of the current video at the first video playback terminal 101.
如果第一视频播放终端101接收到视频切换指令后，当前视频在第一视频播放终端101处暂停播放，则所述中央服务器记录当前视频在暂停处的播放进度，并根据当前视频在暂停处的播放进度生成播放进度信息。If after the first video playback terminal 101 receives the video switching instruction, the current video is paused at the first video playback terminal 101, then the central server records the playback progress of the current video at the pause, and according to the current video at the pause Play progress Generate playback progress information.
本发明实施例中优选的，所述屏幕切换操作信息除包括第一视频播放终端接收到所述视频切换指令后记录的所述当前视频的播放进度信息外，还包括当前视频的统一资源定位符地址信息。Preferably in the embodiment of the present invention, the screen switching operation information includes, in addition to the playing progress information of the current video recorded by the first video playback terminal after receiving the video switching instruction, it also includes the uniform resource locator of the current video Address information.
其中，统一资源定位符地址信息是指第一视频播放终端观看的当前视频的网址，是因特网上标准的资源的地址。Wherein, the uniform resource locator address information refers to the URL of the current video watched by the first video playback terminal, which is a standard resource address on the Internet.
因为视频播放信息中包括当前视频的统一资源定位符地址信息时，第二终端可以根据统一资源定位符地址信息，直接切换到当前视频的播放网页。Because the video playing information includes the URL address information of the current video, the second terminal can directly switch to the playing webpage of the current video according to the URL address information.
本发明实施例中优选的，所述用户信息存储器、设备信息存储器、绑定关系存储器和视频播放信息存储器可以是一个服务器数据库，对应所述第一视频播放终端观看的视频，在未观看完的情况下，所述中央服务器主动记录该播放地址、播放位置、终端标识。所述第二视频播放终端解析所述服务器数据库中的数据，将所述视频显示在其终端屏幕上，并根据不同的码率需求向视频服务器请求最优码率。最佳视频码率与网络状况、终端处理能力、视频格式有关。根据网络状况不同、各个终端配置不同、和/或视频格式的不同选择不同的播放码率，从而达到最佳的播放效果。Preferably in the embodiment of the present invention, the user information storage, device information storage, binding relationship storage and video playback information storage may be a server database, corresponding to the video watched by the first video playback terminal, in the unfinished In some cases, the central server actively records the playback address, playback location, and terminal identifier. The second video player terminal analyzes the data in the server database, displays the video on its terminal screen, and requests the video server for an optimal bit rate according to different bit rate requirements. The optimal video bit rate is related to network conditions, terminal processing capabilities, and video formats. Choose different playback bit rates according to different network conditions, different terminal configurations, and/or different video formats, so as to achieve the best playback effect.
本发明实施例公开了一种的实现多屏间视频无缝切换的系统，实现计算机、手机、PAD等多媒体终端在媒体内容播放过程中，媒体内容由一个终端屏幕向另一个终端屏幕的无缝切换，提高了用户访问的便利性，获取内容的灵活性，用户可以随意在多个屏幕上续接多次而完成观看某个视频，跨屏播放实现无缝切换。The embodiment of the present invention discloses a system for realizing seamless video switching between multiple screens, which realizes the seamless switching of media content from one terminal screen to another terminal screen during the media content playback process of multimedia terminals such as computers, mobile phones, and PADs. Switching improves the convenience of user access and the flexibility of content acquisition. Users can continue watching a certain video multiple times on multiple screens at will, and seamless switching is achieved through cross-screen playback.
实施例二、一种实现多屏间视频无缝切换的系统。Embodiment 2. A system for realizing seamless video switching between multiple screens.
图2为本发明实施例二的实现多屏间视频无缝切换的系统结构示意图，本发明实施例将结合图2进行具体说明。FIG. 2 is a schematic structural diagram of a system for realizing seamless video switching between multiple screens according to Embodiment 2 of the present invention. The embodiment of the present invention will be described in detail with reference to FIG. 2 .
如图2所示，本发明实施例提供了一种实现多屏间视频无缝切换的系统，包括：包括中央服务器201、解析器202和判决器203、码流器204、第一视频播放终端101、第二视频播放终端103，所述判决器203分别与所述中央服务器201和所述解析器202、所述码流器204连接，所述中央服务器201和所述解析器202分别与所述第一视频播放终端101和所述第二视频播放终端103连接，其中，As shown in Figure 2, an embodiment of the present invention provides a system for realizing seamless video switching between multiple screens, including: a central server 201, a parser 202, a decision device 203, a streamer 204, and a first video playback terminal 101. The second video playback terminal 103, the decision unit 203 is respectively connected to the central server 201, the parser 202, and the code streamer 204, and the central server 201 and the parser 202 are respectively connected to the The first video playback terminal 101 is connected to the second video playback terminal 103, wherein,
所述中央服务器201用于状态记录，记录信息包括：用户账户信息、设备信息、时间点(同步点)信息及用户对某段视频操作的信息。The central server 201 is used for state recording, and the recording information includes: user account information, device information, time point (synchronization point) information, and information about the user's operation on a certain segment of video.
具体的，包括：提取用户ID；记录用户多台设备的信息，例如设备类型、适合的分辨率或码率；记录最近一次对这段视频操作类型，例如关闭、暂停、关机或者最小化；记录该段视频上次停留所在的时间戳。Specifically, it includes: extracting the user ID; recording the information of the user's multiple devices, such as device type, suitable resolution or bit rate; recording the last operation type on this video, such as closing, pausing, shutting down or minimizing; recording The timestamp where the video was last stopped.
还包括视频服务器(未示出)，所述视频服务器连接所述解析器202，所述解析器202用于将视频离线生成对应于多种设备的时间静态表，例如，可以包括TV端时间静态表、手机端时间静态表和/或PC端时间静态表等。因为同一视频内容，在不同设备播放时的码率不同，且码频多样，因此，在不同设备上相同时间戳对应着不同的时间偏移量。所述时间静态表如表1所示。Also includes a video server (not shown), the video server is connected to the parser 202, and the parser 202 is used to generate a time static table corresponding to various devices offline from the video, for example, it may include a TV end time static table table, static time table on mobile phone and/or static time table on PC, etc. Because the same video content has different bitrates and different bitrates when played on different devices, the same timestamp on different devices corresponds to different time offsets. The time static table is shown in Table 1.
表1时间静态表Table 1 time static table
例如，对同一内容视频，10’时间戳在PC端上最近的切入帧对应的时间戳为9’59”，则PC端的时间偏移量为-1”；而在手机端上最近的切入帧对应的时间戳为10’3”，则手机端的时间偏移量为+3”。For example, for the same content video, the latest cut-in frame with a 10' time stamp on the PC side corresponds to a time stamp of 9'59", and the time offset on the PC side is -1"; while the latest cut-in frame on the mobile phone The corresponding timestamp is 10'3", and the time offset of the mobile terminal is +3".
所述判决器203根据所述中央服务器201中状态记录信息，读出用户账户信息、第一视频播放终端(例如，TV端)的断点时刻、用户对所述第一视频播放终端上播放的视频最后的操作信息及第二视频播放终端(例如，手机端)的设备信息，并通过所述解析器查询所述TV端时间静态表、手机端时间静态表、PC端时间静态表，确定所述TV端的时间偏移量、手机端的时间偏移量、PC端的时间偏移量，获得同一时刻下两者之间的偏移量，将所述偏移量输送到所述码流器204，所述码流器204推送码流进入当前的所述第二视频播放终端。According to the state record information in the central server 201, the decision unit 203 reads out the user account information, the breakpoint moment of the first video playback terminal (for example, TV end), the user's response to the playback on the first video playback terminal. The final operation information of the video and the device information of the second video playback terminal (for example, the mobile phone terminal), and query the TV terminal time static table, the mobile phone terminal time static table, and the PC terminal time static table by the parser to determine the The time offset of the TV end, the time offset of the mobile phone end, and the time offset of the PC end are obtained to obtain the offset between the two at the same time, and the offset is sent to the streamer 204, The code streamer 204 pushes the code stream into the current second video playback terminal.
图3示出了本发明实施例的实现多屏间视频无缝切换的系统中解析器生成时间静态表的示意图。包括：移动端视频文件301、PC端视频文件302和TV端视频文件303、解析器202和时间静态表304，所述移动端视频文件301、PC端视频文件302和TV端视频文件303连接所述解析器202，所述解析器连接所述时间静态表304。Fig. 3 shows a schematic diagram of a temporal static table generated by a parser in a system for realizing seamless switching of videos between multiple screens according to an embodiment of the present invention. Including: mobile terminal video file 301, PC terminal video file 302 and TV terminal video file 303, parser 202 and time static table 304, described mobile terminal video file 301, PC terminal video file 302 and TV terminal video file 303 are connected The parser 202 is connected to the temporal static table 304.
本发明实施例中优选的，为实现向不同终端提供相同内容的流媒体内容服务，所述中央服务器通过机顶盒视频点播平台、计算机视频点播平台和移动终端视频点播平台来实现对不同网络接入类型的不同终端的流媒体内容服务。Preferably in the embodiment of the present invention, in order to realize the streaming media content service that provides the same content to different terminals, the central server implements different network access types through a set-top box video-on-demand platform, a computer video-on-demand platform, and a mobile terminal video-on-demand platform. Streaming media content services for different terminals.
本发明实施例中优选的，所述机顶盒视频点播平台完成面向机顶盒的点播视频流播发与控制，提供TV端视频文件303；所述计算机视频点播平台完成面向计算机终端的点播视频流播发与控制，提供PC端视频文件302；所述移动终端视频点播平台面向多种型号智能手机、PAD等移动终端的视频流播发与控制，提供移动端视频文件301。Preferably in the embodiment of the present invention, the set-top box video-on-demand platform completes broadcasting and control of the video-on-demand stream facing the set-top box, and provides the TV end video file 303; the computer video-on-demand platform completes the broadcasting and control of the video-on-demand stream facing the computer terminal, Provide PC end video file 302; Described mobile terminal video on demand platform provides mobile end video file 301 for the broadcasting and control of video streams of mobile terminals such as various types of smart phones and PADs.
例如，所述机顶盒与机顶盒视频点播平台连接，完成机顶盒上的流媒体视频内容的播放与控制，搜集用户从机顶盒退出时所产生的视频断点信息并上报至中央服务器所述中央服务器；所述计算机与计算机视频点播平台连接，完成计算机上的流媒体视频内容的播放与控制，搜集用户从计算机退出时所产生的视频断点信息并上报至中央服务器；所述智能手机与移动终端视频点播平台连接，完成移动终端上的流媒体视频内容的播放与控制，搜集用户从智能手机退出时所产生的视频断点信息并上报至中央服务器。For example, the set-top box is connected with the set-top box video-on-demand platform, completes the playback and control of the streaming video content on the set-top box, collects the video breakpoint information generated when the user exits from the set-top box and reports to the central server described in the central server; The computer is connected with the computer video-on-demand platform to complete the playback and control of the streaming video content on the computer, collect the video breakpoint information generated when the user exits from the computer and report it to the central server; the smart phone and the mobile terminal video-on-demand platform Connect to complete the playback and control of streaming video content on the mobile terminal, collect video breakpoint information generated when the user exits from the smartphone and report it to the central server.
所有的实时/非实时流媒体内容源导入所述视频服务器，其中，实时内容传输以UDP协议为基础，非实时内容传输以FTP协议为基础。All real-time/non-real-time streaming media content sources are imported into the video server, wherein, real-time content transmission is based on UDP protocol, and non-real-time content transmission is based on FTP protocol.
视频服务器经通信接口分别向机顶盒视频点播平台、计算机视频点播平台、移动终端视频点播平台注入实时和非实时流媒体内容，供机顶盒视频点播平台、计算机视频点播平台、移动终端视频点播平台对外提供流媒体内容点播服务。The video server injects real-time and non-real-time streaming media content into the set-top box video-on-demand platform, computer video-on-demand platform, and mobile terminal video-on-demand platform respectively through the communication interface, and provides streams for the set-top box video-on-demand platform, computer video-on-demand platform, and mobile terminal video-on-demand platform. Media content on-demand service.
机顶盒与机顶盒视频点播平台间通过接口以HTTP.1作为控制信令传输协议，以TSover UDP作为媒体流传输方式。当机顶盒有暂停、退出等操作时，机顶盒通过接口将相关用户暂停、退出信息以XML格式传送给中央服务器。中央服务器记录用户机顶盒用户ID、用户观看的视频内容ID、用户退出时视频内容播放时间戳等相关信息。The interface between the set-top box and the video-on-demand platform of the set-top box uses HTTP.1 as the control signaling transmission protocol, and TSover UDP as the media stream transmission method. When the set-top box performs operations such as suspending or exiting, the set-top box transmits relevant user suspension and exit information to the central server in XML format through the interface. The central server records related information such as the user ID of the user's set-top box, the ID of the video content watched by the user, and the time stamp of the video content when the user exits.
终端设备计算机与计算机视频点播平台间通过接口以HTTP.1作为控制信令传输协议，及媒体流传输方式。当计算机有暂停、退出等操作时，计算机通过接口将相关用户暂停、退出信息以XML格式传送给中央服务器。中央服务器记录用户计算机用户ID、用户观看的视频内容ID、用户退出时视频内容播放时间戳等相关信息。The interface between the terminal equipment computer and the computer video-on-demand platform uses HTTP.1 as the control signaling transmission protocol and media stream transmission mode. When the computer has operations such as suspending or exiting, the computer transmits relevant user suspension and exit information to the central server in XML format through the interface. The central server records relevant information such as the user ID of the user's computer, the ID of the video content watched by the user, and the time stamp of the video content when the user exits.
终端设备智能手机与移动终端视频点播平台间通过接口以HTTP.1作为控制信令传输协议，及媒体流传输方式。当智能手机有暂停、退出等操作时，智能手机通过接口将相关用户暂停、退出信息以XML格式传送给中央服务器。中央服务器记录用户智能手机用户ID、用户观看的视频内容ID、用户退出时视频内容播放时间戳等相关信息。The interface between the terminal device smart phone and the mobile terminal video-on-demand platform uses HTTP.1 as the control signaling transmission protocol and media stream transmission method. When the smart phone has operations such as suspending or exiting, the smart phone transmits the suspension and exit information of the relevant user to the central server in XML format through the interface. The central server records relevant information such as the user ID of the user's smart phone, the ID of the video content watched by the user, and the playback time stamp of the video content when the user exits.
用户终端的机顶盒、计算机、智能手机触发屏幕切换操作时，经外部网络将相关切换指令通过接口发布到中央服务器，接口所携带的信息包含用户登录账号信息、用户当前观看视频信息、用户触发多屏切换时视频的时间戳信息、用户当前所用终端信息、用户继续观看所用终端信息。When the set-top box, computer, or smart phone of the user terminal triggers the screen switching operation, the relevant switching instructions are issued to the central server through the interface through the external network. The time stamp information of the video when switching, the terminal information currently used by the user, and the terminal information used by the user to continue watching.
中央服务器依据接口所携带的信息，通知相关视频点播平台中断使用者当前终端所观看视频流，并将用户继续观看所用终端信息、节目信息、视频时间戳信息发送至视频点播平台，由适合用户继续观看所用终端的视频点播平台向用户继续欣赏视频所使用终端推送的影片节目资源。According to the information carried by the interface, the central server notifies the relevant video-on-demand platform to interrupt the video stream watched by the user's current terminal, and sends the terminal information, program information, and video time stamp information used by the user to continue watching to the video-on-demand platform, and the appropriate user continues The video and program resources pushed by the video-on-demand platform of the terminal used to watch the video to the terminal used by the user to continue to enjoy the video.
本发明实施例公开了一种实现多屏间视频无缝切换的系统，通过建立时间戳及视频文件在不同设备上的偏移量静态映射表，用存储空间换播放时需要的准备时间，使用户能够利用零碎时间，见缝插针地观看录播视频，具有极佳的用户体验，且视频服务器负载降低。The embodiment of the present invention discloses a system for realizing seamless video switching between multiple screens. By establishing a time stamp and a static mapping table of offsets of video files on different devices, the storage space is used to exchange the preparation time required for playback, so that Users can use fragmented time to watch recorded and broadcast videos at every turn, which has an excellent user experience and reduces the load on the video server.
本发明实施例中其它内容参见上述发明实施例中的内容，在此不再赘述。For other content in the embodiments of the present invention, refer to the content in the foregoing embodiments of the invention, and details are not repeated here.
实施例三、一种实现多屏间视频无缝切换的方法。Embodiment 3. A method for realizing seamless video switching between multiple screens.
图4为本发明实施例三的实现多屏间视频无缝切换的方法流程图，本发明实施例将结合图4进行具体说明。FIG. 4 is a flowchart of a method for realizing seamless switching of videos between multiple screens according to Embodiment 3 of the present invention. The embodiment of the present invention will be described in detail with reference to FIG. 4 .
如图4所示，本发明实施例提供了一种实现多屏间视频无缝切换的方法，包括以下步骤：As shown in Figure 4, the embodiment of the present invention provides a method for realizing seamless video switching between multiple screens, including the following steps:
步骤S401：第一视频播放终端播放视频文件；Step S401: the first video player terminal plays the video file;
步骤S402：执行屏幕切换操作；Step S402: Execute screen switching operation;
步骤S403：根据所述第一视频播放终端和所述第二视频播放终端的设备信息和所述屏幕切换操作信息，确定所述第二视频播放终端播放所述视频文件的切入帧对应的时间点；Step S403: According to the device information of the first video player terminal and the second video player terminal and the screen switching operation information, determine the time point corresponding to the cut-in frame of the video file played by the second video player terminal ;
步骤S404：将所述视频文件切换至所述第二视频播放终端继续播放。Step S404: Switch the video file to the second video playback terminal to continue playing.
本发明实施例中优选的，所述根据所述第一视频播放终端和所述第二视频播放终端的设备信息和所述屏幕切换操作信息，确定所述第二视频播放终端播放所述视频文件的切入帧对应的时间点的步骤，具体包括以下步骤：In the embodiment of the present invention, preferably, according to the device information of the first video playback terminal and the second video playback terminal and the screen switching operation information, it is determined that the second video playback terminal plays the video file The step of cutting into the time point corresponding to the frame, specifically includes the following steps:
记录状态信息，所述状态信息至少包括所述视频文件在所述第一视频播放终端最新执行屏幕切换操作的时间戳信息；Recording state information, the state information at least including the time stamp information of the latest screen switching operation performed by the video file on the first video playback terminal;
将所述视频文件离线生成对应于所述第一视频播放终端和所述第二视频播放终端的时间静态表；The video file is generated offline corresponding to the time static table of the first video playback terminal and the second video playback terminal;
根据所述时间戳信息和所述时间静态表，获得同一时间戳所述第一视频播放终端和所述第二视频播放终端之间的时间偏移量。According to the time stamp information and the time static table, the time offset between the first video playback terminal and the second video playback terminal with the same time stamp is obtained.
本发明实施例中优选的，所述将所述视频文件切换至所述第二视频播放终端继续播放的步骤，具体包括以下步骤：Preferably in the embodiment of the present invention, the step of switching the video file to the second video playback terminal to continue playing, specifically includes the following steps:
根据所述时间偏移量推送码流进入所述第二视频播放终端；Pushing code streams into the second video playback terminal according to the time offset;
所述第二视频播放终端继续播放所述视频文件。The second video playing terminal continues to play the video file.
本发明实施例中优选的，所述第一视频播放终端播放视频文件的步骤之前，还包括以下步骤：Preferably in the embodiment of the present invention, before the step of playing the video file by the first video playback terminal, the following steps are further included:
存储用户在所述第一视频播放终端和/或所述第二视频播放终端上的注册信息，所述注册信息包括用户账户信息和密码；storing user registration information on the first video playback terminal and/or the second video playback terminal, the registration information including user account information and passwords;
存储所述第一视频播放终端和所述第二视频播放终端的设备信息，包括设备类型、分辨率和/或码率；storing device information of the first video playback terminal and the second video playback terminal, including device type, resolution and/or code rate;
存储所述第一视频播放终端和所述第二视频播放终端的设备信息与所述注册信息之间的对应关系。storing the correspondence between the device information of the first video playing terminal and the second video playing terminal and the registration information.
本发明实施例中优选的，还包括媒体内容处理步骤，具体包括：Preferably, in the embodiment of the present invention, it also includes a media content processing step, specifically including:
接收所有进入系统的媒体内容；Receive all media content entering the system;
生成针对不同媒体格式的相关索引文件。Generate relevant index files for different media formats.
本发明实施例中，解析器对视频进行解析，获得多种设备的时间静态表，例如，可以包括TV端时间静态表、手机端时间静态表和/或PC端时间静态表等。In the embodiment of the present invention, the parser parses the video to obtain the time static table of various devices, for example, it may include the TV end time table, the mobile phone end time table and/or the PC end time table.
所述中央服务器记录状态信息，提取包括用户账户信息、设备信息、时间点(同步点)信息及用户对某段视频操作的信息。The central server records state information, and extracts information including user account information, device information, time point (synchronization point) information, and user operation on a certain segment of video.
将所述时间静态表和所述状态信息同时输入判决器，获得在当前播放设备上对应的偏移量，确定在当前设备上码流的切入点。The time static table and the state information are simultaneously input into the decision device to obtain the corresponding offset on the current playback device, and determine the entry point of the code stream on the current device.
例如，从TV端转到手机端的过程包括如下操作：For example, the process of transferring from a TV terminal to a mobile terminal includes the following operations:
从所述中央服务器中读出用户账户信息、TV端的断点时刻、用户对TV端视频最后的操作信息，手机的设备信息；Read the user account information, the breakpoint moment of the TV end, the user's last operation information on the TV end video, and the device information of the mobile phone from the central server;
获取手机端时间静态表和TV端时间静态表，得到同时刻下两者之间的偏移量；Obtain the static time table on the mobile phone side and the static time table on the TV side, and obtain the offset between the two at the same time;
将上述偏移量输送给码流器，所述码流器推送码流进入当前播放设备。The above-mentioned offset is sent to the code streamer, and the code streamer pushes the code stream into the current playback device.
本发明实施例提供了一种实现多屏间视频无缝切换的方法，通过建立时间戳及视频文件在不同设备上的偏移量静态映射表，用存储空间换播放时需要的准备时间，用户可以随意在多个屏幕上续接多次而完成观看某个视频，跨屏播放实现无缝切换。The embodiment of the present invention provides a method for realizing seamless switching of videos between multiple screens. By establishing a static mapping table of time stamps and offsets of video files on different devices, the storage space is exchanged for the preparation time required for playback, and the user You can continue to watch a certain video multiple times on multiple screens at will, and play across screens to achieve seamless switching.
本发明实施例中其它内容参见上述发明实施例中的内容，在此不再赘述。For other content in the embodiments of the present invention, refer to the content in the foregoing embodiments of the invention, and details are not repeated here.
本发明可以带来这些有益的技术效果：本发明实施例公开的实现多屏间视频无缝切换的系统及方法，实现计算机、手机、PAD等多媒体终端在媒体内容播放过程中，媒体内容由一个终端屏幕向另一个终端屏幕的无缝切换，提高了用户访问的便利性，获取内容的灵活性，用户可以随意在多个屏幕上续接多次而完成观看某个视频，跨屏播放实现无缝切换。The present invention can bring these beneficial technical effects: the system and method for realizing seamless video switching between multiple screens disclosed in the embodiment of the present invention can realize that during the media content playback process of multimedia terminals such as computers, mobile phones, and PADs, the media content is played by a The seamless switching of terminal screens to another terminal screen improves the convenience of user access and the flexibility of content acquisition. Users can watch a certain video by connecting multiple times on multiple screens at will, and realize seamless playback across screens. seam switching.
本发明提供的各种实施例可根据需要以任意方式相互组合，通过这种组合得到的技术方案，也在本发明的范围内。The various embodiments provided by the present invention can be combined with each other in any manner as required, and the technical solutions obtained through such combinations are also within the scope of the present invention.
显然，本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样，倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内，则本发明也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510716686.9ACN105338425B (en) | 2015-10-29 | 2015-10-29 | A kind of system and method for realizing video seamless switching between multi-screen |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510716686.9ACN105338425B (en) | 2015-10-29 | 2015-10-29 | A kind of system and method for realizing video seamless switching between multi-screen |
| Publication Number | Publication Date |
|---|---|
| CN105338425A CN105338425A (en) | 2016-02-17 |
| CN105338425Btrue CN105338425B (en) | 2018-12-14 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510716686.9AActiveCN105338425B (en) | 2015-10-29 | 2015-10-29 | A kind of system and method for realizing video seamless switching between multi-screen |
| Country | Link |
|---|---|
| CN (1) | CN105338425B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
| US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
| US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
| DE212014000045U1 (en) | 2013-02-07 | 2015-09-24 | Apple Inc. | Voice trigger for a digital assistant |
| US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
| US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
| US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
| US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
| US10460227B2 (en) | 2015-05-15 | 2019-10-29 | Apple Inc. | Virtual assistant in a communication session |
| US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
| US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
| US10331312B2 (en) | 2015-09-08 | 2019-06-25 | Apple Inc. | Intelligent automated assistant in a media environment |
| US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
| CN105939491A (en)* | 2016-05-25 | 2016-09-14 | 乐视控股（北京）有限公司 | Video playing method and device |
| US10586535B2 (en) | 2016-06-10 | 2020-03-10 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
| DK201670540A1 (en) | 2016-06-11 | 2018-01-08 | Apple Inc | Application integration with a digital assistant |
| US12197817B2 (en) | 2016-06-11 | 2025-01-14 | Apple Inc. | Intelligent device arbitration and control |
| CN106303670A (en)* | 2016-08-11 | 2017-01-04 | 北海华源电子有限公司 | Multi-screen interaction systems based on different computers |
| CN106792132A (en)* | 2016-12-29 | 2017-05-31 | 北京奇艺世纪科技有限公司 | A kind of audio and video playing changing method and device |
| US11204787B2 (en) | 2017-01-09 | 2021-12-21 | Apple Inc. | Application integration with a digital assistant |
| CN106993216A (en)* | 2017-03-01 | 2017-07-28 | 咪咕视讯科技有限公司 | A device switching method and device |
| CN107071550B (en)* | 2017-04-01 | 2020-06-26 | 北京奇艺世纪科技有限公司 | Video data sharing method and device |
| CN107105321A (en)* | 2017-04-20 | 2017-08-29 | 北京奇艺世纪科技有限公司 | The moving method and device of a kind of Streaming Media |
| DK179496B1 (en) | 2017-05-12 | 2019-01-15 | Apple Inc. | USER-SPECIFIC Acoustic Models |
| DK201770427A1 (en) | 2017-05-12 | 2018-12-20 | Apple Inc. | Low-latency intelligent automated assistant |
| US10303715B2 (en) | 2017-05-16 | 2019-05-28 | Apple Inc. | Intelligent automated assistant for media exploration |
| CN107547735A (en)* | 2017-08-08 | 2018-01-05 | 北京小米移动软件有限公司 | Control the method and device of terminal |
| CN107707947B (en)* | 2017-09-12 | 2020-09-11 | 西安万像电子科技有限公司 | Picture data control method and system |
| CN107613340A (en)* | 2017-09-27 | 2018-01-19 | 深圳市酷开网络科技有限公司 | A kind of virtual reality device method and system for playing video synchronous with intelligent television |
| CN108024125A (en)* | 2017-11-03 | 2018-05-11 | 青岛海信电器股份有限公司 | A kind of audio, video data playback method and server and client side |
| CN108449638A (en)* | 2018-03-15 | 2018-08-24 | 广州虎牙信息科技有限公司 | A kind of method, apparatus and electronic equipment playing advertisement |
| US10818288B2 (en) | 2018-03-26 | 2020-10-27 | Apple Inc. | Natural assistant interaction |
| US10928918B2 (en) | 2018-05-07 | 2021-02-23 | Apple Inc. | Raise to speak |
| DK201870355A1 (en) | 2018-06-01 | 2019-12-16 | Apple Inc. | Virtual assistant operation in multi-device environments |
| DK180639B1 (en) | 2018-06-01 | 2021-11-04 | Apple Inc | DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT |
| CN108924603B (en)* | 2018-07-31 | 2020-12-22 | 复旦大学 | Multi-terminal streaming media playback system and method based on software-defined WiFi |
| US11462215B2 (en) | 2018-09-28 | 2022-10-04 | Apple Inc. | Multi-modal inputs for voice commands |
| WO2020073536A1 (en)* | 2018-10-09 | 2020-04-16 | 华为技术有限公司 | Voice switching method, electronic device, and system |
| US11348573B2 (en) | 2019-03-18 | 2022-05-31 | Apple Inc. | Multimodality in digital assistant systems |
| DK201970509A1 (en) | 2019-05-06 | 2021-01-15 | Apple Inc | Spoken notifications |
| US11307752B2 (en) | 2019-05-06 | 2022-04-19 | Apple Inc. | User configurable task triggers |
| US11227599B2 (en) | 2019-06-01 | 2022-01-18 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
| CN112839238B (en)* | 2019-11-22 | 2023-03-24 | 腾讯科技（深圳）有限公司 | Screen projection playing method and device and storage medium |
| CN110730373A (en)* | 2019-12-18 | 2020-01-24 | 南京创维信息技术研究院有限公司 | Method and system for pushing videos across screens among devices with screens |
| US11061543B1 (en) | 2020-05-11 | 2021-07-13 | Apple Inc. | Providing relevant data items based on context |
| US12301635B2 (en) | 2020-05-11 | 2025-05-13 | Apple Inc. | Digital assistant hardware abstraction |
| CN111770379B (en)* | 2020-07-10 | 2021-08-24 | 腾讯科技（深圳）有限公司 | Video delivery method, device and equipment |
| US11490204B2 (en) | 2020-07-20 | 2022-11-01 | Apple Inc. | Multi-device audio adjustment coordination |
| US11438683B2 (en) | 2020-07-21 | 2022-09-06 | Apple Inc. | User identification using headphones |
| CN112587919B (en)* | 2020-12-29 | 2023-08-22 | 珠海金山数字网络科技有限公司 | Game instruction processing method and device |
| CN114296668B (en)* | 2021-03-11 | 2024-08-23 | 海信视像科技股份有限公司 | Display equipment |
| CN115390652A (en)* | 2021-05-19 | 2022-11-25 | 华为技术有限公司 | Display method and electronic device |
| CN115442647A (en)* | 2022-07-22 | 2022-12-06 | 北京罗克维尔斯科技有限公司 | Video playing method, device, equipment, medium and vehicle |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248956A (en)* | 2013-05-20 | 2013-08-14 | 浙江传媒学院 | Realizing method and system of intelligent home video business in multi-screen cooperating mode |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102510541B (en)* | 2011-12-30 | 2014-12-17 | Tcl数码科技（深圳）有限责任公司 | Multi-screen interaction video and audio content switching method and media player |
| TWI508538B (en)* | 2012-06-01 | 2015-11-11 | Wistron Corp | Video streams playback method and system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248956A (en)* | 2013-05-20 | 2013-08-14 | 浙江传媒学院 | Realizing method and system of intelligent home video business in multi-screen cooperating mode |
| Publication number | Publication date |
|---|---|
| CN105338425A (en) | 2016-02-17 |
| Publication | Publication Date | Title |
|---|---|---|
| CN105338425B (en) | A kind of system and method for realizing video seamless switching between multi-screen | |
| CN102891886B (en) | Multi-screen interaction method and system based on cloud computing | |
| CN105354002B (en) | A kind of system and method for realizing video seamless switching between multi-screen | |
| KR101762088B1 (en) | Method and device for multi-screen interaction | |
| RU2543568C2 (en) | Smooth, stateless client media streaming | |
| CN101945252B (en) | Cross-platform media system and implementation method thereof | |
| CN107683608B (en) | Receiving apparatus, transmitting apparatus, and data processing method | |
| US9918036B2 (en) | System and method for recording and distributing media content | |
| US20100115575A1 (en) | System and method for recording and distributing media content | |
| US20130135179A1 (en) | Control method and device thereof | |
| US20140139735A1 (en) | Online Media Data Conversion Method, Online Video Playing Method and Corresponding Device | |
| CN102802048A (en) | Multi-screen interaction system and method | |
| CN112752115A (en) | Live broadcast data transmission method, device, equipment and medium | |
| US9942620B2 (en) | Device and method for remotely controlling the rendering of multimedia content | |
| KR20120114016A (en) | Method and apparatus for network adaptive streaming user data in a outer terminal | |
| KR20130005873A (en) | Method and apparatus for receiving contents in broadcast system | |
| WO2016174960A1 (en) | Reception device, transmission device, and data processing method | |
| US20150229986A1 (en) | Rendering time control | |
| CN109756744B (en) | Data processing method, electronic device and computer storage medium | |
| CN205230019U (en) | System for realize video seamless handover between many screens | |
| CN112532719A (en) | Information flow pushing method, device, equipment and computer readable storage medium | |
| CN107534792B (en) | Receiving apparatus, transmitting apparatus, and data processing method | |
| CN205265855U (en) | Realize video seamless handover's between many screens device | |
| TW201145981A (en) | Cloud video and event processing sub-system and source end and player | |
| CN205139894U (en) | Realize video seamless handover's between many screens terminal |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | Effective date of registration:20180201 Address after:100102 floor 2, unit 3, building No. 2, Futong East Street, Chaoyang District, Beijing, 121806 Applicant after:Beijing Yi Yun cloud Technology Co.,Ltd. Address before:518057 Guangdong, Shenzhen, Nanshan District science and technology in the road Software Park, two, 11, two B306 Applicant before:SHENZHEN YUNJUHUI DIGITAL CO.,LTD. | |
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | Effective date of registration:20211119 Address after:Room 1125, 1f, building 9, No. 66, East Tiantan Road, Dongcheng District, Beijing 100010 Patentee after:YINGHUA HIGHTECH Co.,Ltd. Address before:100102 121806, 15 / F, unit 2, building 3, yard 1, Futong East Street, Chaoyang District, Beijing Patentee before:Beijing Yi Yun cloud Technology Co.,Ltd. | |
| TR01 | Transfer of patent right | ||
| CP03 | Change of name, title or address | Address after:Room 2093, South Floor, Building 1, No. 55 Tiantan Road, Dongcheng District, Beijing 100010 Patentee after:YINGHUA HIGHTECH Co.,Ltd. Country or region after:China Address before:Room 1125, 1f, building 9, No. 66, East Tiantan Road, Dongcheng District, Beijing 100010 Patentee before:YINGHUA HIGHTECH Co.,Ltd. Country or region before:China | |
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address | Address after:100000 Room 1204, 12th Floor, No. 67 West Beisihuan Road, Haidian District, Beijing Patentee after:YINGHUA HIGHTECH Co.,Ltd. Country or region after:China Address before:Room 2093, South Floor, Building 1, No. 55 Tiantan Road, Dongcheng District, Beijing 100010 Patentee before:YINGHUA HIGHTECH Co.,Ltd. Country or region before:China | |
| CP03 | Change of name, title or address |