技术领域technical field
本发明涉及通信领域，特别涉及一种视频传输方法及装置。The present invention relates to the communication field, in particular to a video transmission method and device.
背景技术Background technique
Miracast是Wi-FiAlliance(Wi-Fi联盟)于2012年9月19日宣布启动的Wi-FiCERTIFIEDMiracast认证项目。Miracast设备提供简化发现和设置，用户可以迅速在设备间传输视频。该技术与认证项目由Wi-Fi联盟中的移动与消费性电子设备制造商及芯片厂商共同制定。行业分析者预计Miracast认证设备的年产量在未来四年将超过10亿台。Miracast is a Wi-Fi CERTIFIED Miracast certification project announced by Wi-Fi Alliance (Wi-Fi Alliance) on September 19, 2012. Miracast devices provide simplified discovery and setup, and users can quickly transfer video between devices. The technology and certification program is jointly developed by mobile and consumer electronics equipment manufacturers and chip manufacturers in the Wi-Fi Alliance. Industry analysts expect annual production of Miracast-certified devices to exceed 1 billion units in the next four years.
Miracast用户可以尽情在大屏幕电视上浏览智能手机拍下的照片，通过会议室投影仪实时共享笔记本屏幕，或者在平板电脑上收看家庭电视机顶盒的直播节目。Miracast通过Wi-FiCERTIFIEDWi-FiDirect(Wi-Fi认证的Wi-Fi直联)形成连接，因此无需接入任何Wi-Fi网络——Miracast认证设备内部具备连接功能。Miracast users can browse the photos taken by smartphones on the big-screen TV, share the laptop screen in real time through the conference room projector, or watch the live broadcast of the home TV set-top box on the tablet. Miracast connects via Wi-Fi CERTIFIED Wi-Fi Direct (Wi-Fi Certified Wi-Fi Direct), so there is no need to be connected to any Wi-Fi network - Miracast certified devices have connectivity inside.
Miracast1.0协议可以使一个发送端(Source)快速、稳定地将实时视频流传送至接收端(Sink)并以很小的时延播放出来。但该方案存在以下两个问题：1、市面上数以十亿计的只支持网络连接但不支持Miracast的既有设备(如存量手机、平板电脑、机顶盒、笔记本、PC等)无法使用该协议；2、一个Source端只能输出到一个Sink端或一个主接收端(PrimarySink)及一个辅接收端(SecondarySink)，无法满足多媒体教学等应用场景对于一路输入、多路并发输出的需求。以上问题大大限制了Miracast的应用范围。The Miracast 1.0 protocol can enable a sending end (Source) to quickly and stably transmit real-time video streams to the receiving end (Sink) and play them out with a small delay. However, this solution has the following two problems: 1. Billions of existing devices on the market that only support network connections but do not support Miracast (such as stock phones, tablets, set-top boxes, notebooks, PCs, etc.) cannot use this protocol 2. A Source terminal can only output to one Sink terminal or one Primary Sink terminal (PrimarySink) and one Secondary Sink terminal (Secondary Sink), which cannot meet the requirements of multimedia teaching and other application scenarios for one input and multiple concurrent outputs. The above problems greatly limit the scope of application of Miracast.
发明内容Contents of the invention
本发明的目的在于提供一种视频传输方法及装置，解决了不支持Miracast协议的既有设备无法使用该协议且该协议只能满足一路输入对应一路输出的问题，实现了Miracast终端和非Miracast终端之间的传输，扩大应用范围。The purpose of the present invention is to provide a video transmission method and device, which solves the problem that the existing equipment that does not support the Miracast protocol cannot use the protocol and the protocol can only satisfy the problem of one input corresponding to one output, and realizes Miracast terminals and non-Miracast terminals The transmission between them expands the scope of application.
为了达到上述目的，本发明实施例提供一种视频传输方法，用于第一通信终端，所述视频传输方法包括：In order to achieve the above purpose, an embodiment of the present invention provides a video transmission method for a first communication terminal, the video transmission method comprising:
第一接收步骤，通过和第二通信终端之间基于Miracast协议建立的第一连接接收所述第二通信终端发送的实时视频流；The first receiving step is to receive the real-time video stream sent by the second communication terminal through the first connection established based on the Miracast protocol with the second communication terminal;
第一发送步骤，通过和至少一个第三通信终端之间基于Miracast协议之外的其他协议建立的第二连接传输所述实时视频流到所述至少一个第三通信终端。The first sending step is to transmit the real-time video stream to the at least one third communication terminal through a second connection established with the at least one third communication terminal based on a protocol other than the Miracast protocol.
其中，所述第一通信终端和所述至少一个第三通信终端位于同一局域网中，所述视频传输方法还包括：Wherein, the first communication terminal and the at least one third communication terminal are located in the same local area network, and the video transmission method further includes:
广播步骤，在所述局域网内广播携带实时视频流广播端口的广播消息，使得所述至少一个第三通信终端能够通过监控所述实时视频流广播端口接收所述第一通信终端通过所述实时视频流广播端口广播的所述实时视频流。The broadcasting step is broadcasting a broadcast message carrying a real-time video stream broadcast port in the local area network, so that the at least one third communication terminal can receive the real-time video stream sent by the first communication terminal by monitoring the real-time video stream broadcast port. The real-time video stream broadcast by the stream broadcast port.
进一步的，所述第一通信终端和所述至少一个第三通信终端位于同一局域网中，所述视频传输方法还包括：Further, the first communication terminal and the at least one third communication terminal are located in the same local area network, and the video transmission method further includes:
第二接收步骤，接收所述同一局域网内的所述至少一个第三通信终端广播的服务请求消息；The second receiving step is to receive the service request message broadcast by the at least one third communication terminal in the same local area network;
第二发送步骤，向所述至少一个第三通信终端广播返回携带实时视频流广播端口的服务请求响应消息，使得所述至少一个第三通信终端能够通过监控所述实时视频流广播端口接收所述第一通信终端通过所述实时视频流广播端口广播的所述实时视频流。The second sending step is broadcasting and returning a service request response message carrying a real-time video stream broadcast port to the at least one third communication terminal, so that the at least one third communication terminal can receive the real-time video stream broadcast port by monitoring the The first communication terminal broadcasts the real-time video stream through the real-time video stream broadcast port.
其中，所述第一通信终端和所述至少一个第三通信终端位于同一广域网中，所述视频传输方法还包括：Wherein, the first communication terminal and the at least one third communication terminal are located in the same wide area network, and the video transmission method further includes:
第三发送步骤，向广域网中的服务器发送一携带连接信息的注册信息，使得所述至少一个第三通信终端能够从所述服务器获取所述连接信息后，根据所述连接信息和所述第一通信终端交互，建立所述第二连接。The third sending step is to send registration information carrying connection information to a server in the wide area network, so that after the at least one third communication terminal can obtain the connection information from the server, according to the connection information and the first The communication terminals interact to establish the second connection.
进一步的，所述视频传输方法还包括：Further, the video transmission method also includes:
第三接收步骤，接收第三通信终端根据所述连接信息向所述第一通信终端发送的携带第三通信终端的能力信息和地址信息的连接请求；The third receiving step is to receive a connection request carrying capability information and address information of the third communication terminal sent by the third communication terminal to the first communication terminal according to the connection information;
判断步骤，根据所述能力信息和所述第一通信终端的运行状况决定是否接纳所述第三通信终端；A judging step, deciding whether to accept the third communication terminal according to the capability information and the operating status of the first communication terminal;
第四发送步骤，在决定接纳所述第三通信终端后，向所述第三通信终端返回携带用于建立实时视频流传输连接的连接请求响应。In a fourth sending step, after deciding to accept the third communication terminal, return a connection request response carrying a connection request for establishing a real-time video stream transmission connection to the third communication terminal.
本发明实施例还提供一种视频传输装置，用于第一通信终端，所述视频传输装置包括：The embodiment of the present invention also provides a video transmission device, which is used for the first communication terminal, and the video transmission device includes:
第一接收模块，用于通过和第二通信终端之间基于Miracast协议建立的第一连接接收所述第二通信终端发送的实时视频流；The first receiving module is configured to receive the real-time video stream sent by the second communication terminal through the first connection established based on the Miracast protocol with the second communication terminal;
第一发送模块，用于通过和至少一个第三通信终端之间基于Miracast协议之外的其他协议建立的第二连接传输所述实时视频流到所述至少一个第三通信终端。The first sending module is configured to transmit the real-time video stream to the at least one third communication terminal through a second connection established with the at least one third communication terminal based on a protocol other than the Miracast protocol.
其中，所述第一通信终端和所述至少一个第三通信终端位于同一局域网中，所述视频传输装置还包括：Wherein, the first communication terminal and the at least one third communication terminal are located in the same local area network, and the video transmission device further includes:
广播模块，用于在所述局域网内广播携带实时视频流广播端口的广播消息，使得所述至少一个第三通信终端能够通过监控所述实时视频流广播端口接收所述第一通信终端通过所述实时视频流广播端口广播的所述实时视频流。A broadcast module, configured to broadcast a broadcast message carrying a real-time video stream broadcast port in the local area network, so that the at least one third communication terminal can receive the first communication terminal through the real-time video stream broadcast port by monitoring the real-time video stream broadcast port. The real-time video stream broadcast by the real-time video stream broadcasting port.
进一步的，所述第一通信终端和所述至少一个第三通信终端位于同一局域网中，所述视频传输装置还包括：Further, the first communication terminal and the at least one third communication terminal are located in the same local area network, and the video transmission device further includes:
第二接收模块，用于接收所述同一局域网内的所述至少一个第三通信终端广播的服务请求消息；A second receiving module, configured to receive a service request message broadcast by the at least one third communication terminal in the same local area network;
第二发送模块，用于向所述至少一个第三通信终端广播返回携带实时视频流广播端口的服务请求响应消息，使得所述至少一个第三通信终端能够通过监控所述实时视频流广播端口接收所述第一通信终端通过所述实时视频流广播端口广播的所述实时视频流。The second sending module is configured to broadcast and return a service request response message carrying a real-time video stream broadcast port to the at least one third communication terminal, so that the at least one third communication terminal can monitor the real-time video stream broadcast port to receive The real-time video stream broadcast by the first communication terminal through the real-time video stream broadcast port.
其中，所述第一通信终端和所述至少一个第三通信终端位于同一广域网中，所述视频传输装置还包括：Wherein, the first communication terminal and the at least one third communication terminal are located in the same wide area network, and the video transmission device further includes:
第三发送模块，用于向广域网中的服务器发送一携带连接信息的注册信息，使得所述至少一个第三通信终端能够从所述服务器获取所述连接信息后，根据所述连接信息和所述第一通信终端交互，建立所述第二连接。The third sending module is configured to send registration information carrying connection information to a server in the wide area network, so that after the at least one third communication terminal can obtain the connection information from the server, according to the connection information and the The first communication terminal interacts to establish the second connection.
进一步的，所述视频传输装置还包括：Further, the video transmission device also includes:
第三接收模块，用于接收第三通信终端根据所述连接信息向所述第一通信终端发送的携带第三通信终端的能力信息和地址信息的连接请求；A third receiving module, configured to receive a connection request carrying capability information and address information of the third communication terminal sent by the third communication terminal to the first communication terminal according to the connection information;
判断模块，用于根据所述能力信息和所述第一通信终端的运行状况决定是否接纳所述第三通信终端；A judging module, configured to decide whether to admit the third communication terminal according to the capability information and the operating status of the first communication terminal;
第四发送模块，用于在决定接纳所述第三通信终端后，向所述第三通信终端返回携带用于建立实时视频流传输连接的连接请求响应。The fourth sending module is configured to return to the third communication terminal a connection request response carrying a connection for establishing a real-time video stream transmission connection after deciding to accept the third communication terminal.
本发明的上述技术方案至少具有如下有益效果：The technical solution of the present invention has at least the following beneficial effects:
本发明实施例的视频传输方法及装置中，通过第一通信终端基于Miracast协议接收第二通信终端发送的实时视频流，并将该实时视频流传输给至少一个不支持Miracast协议的第三通信终端，使得至少一个第三通信终端能够同步接收第二通信终端的实时视频流，实现了基于Miracast协议的一对多实时视频的传输，扩大了Miracast的应用范围；且该方法部署简单，成本低廉，适用性广。In the video transmission method and device of the embodiment of the present invention, the first communication terminal receives the real-time video stream sent by the second communication terminal based on the Miracast protocol, and transmits the real-time video stream to at least one third communication terminal that does not support the Miracast protocol , so that at least one third communication terminal can synchronously receive the real-time video stream of the second communication terminal, realizing the transmission of one-to-many real-time video based on the Miracast protocol, and expanding the application range of Miracast; and the method is simple to deploy and low in cost, Wide applicability.
附图说明Description of drawings
图1表示本发明实施例的视频传输方法的基本步骤示意图；Fig. 1 shows the schematic diagram of the basic steps of the video transmission method of the embodiment of the present invention;
图2表示场景一下本发明实施例的视频传输方法的网络拓扑图；Fig. 2 shows the network topology diagram of the video transmission method of the embodiment of the present invention in the first scenario;
图3表示场景一下本发明实施例的视频传输方法的运行时序图；Fig. 3 shows the operation sequence diagram of the video transmission method of the embodiment of the present invention in the first scenario;
图4表示场景二下本发明实施例的视频传输方法的网络拓扑图；Fig. 4 shows the network topology diagram of the video transmission method of the embodiment of the present invention under the second scenario;
图5表示场景二下本发明实施例的视频传输方法的运行时序图；FIG. 5 shows an operation sequence diagram of the video transmission method of the embodiment of the present invention in scenario 2;
图6表示本发明实施例的视频传输装置的组成结构图。FIG. 6 shows a structural diagram of a video transmission device according to an embodiment of the present invention.
具体实施方式detailed description
为使本发明要解决的技术问题、技术方案和优点更加清楚，下面将结合附图及具体实施例进行详细描述。In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will describe in detail with reference to the drawings and specific embodiments.
本发明针对现有技术中Miracast协议无法实现一对多视频传输的功能且大量的存量设备无法支持Miracast协议的问题，提供一种视频传输方法及装置，通过第一通信终端基于Miracast协议接收第二通信终端发送的实时视频流，并将该实时视频流传输给至少一个不支持Miracast协议的第三通信终端，使得至少一个第三通信终端能够同步接收第二通信终端的实时视频流，实现了Miracast终端和非Miracast终端之间的传输，扩大应用范围；且该方法部署简单，成本低廉，适用性广。Aiming at the problem that the Miracast protocol in the prior art cannot realize the function of one-to-many video transmission and a large number of storage devices cannot support the Miracast protocol, the present invention provides a video transmission method and device, through which the first communication terminal receives the second video based on the Miracast protocol. The real-time video stream sent by the communication terminal, and the real-time video stream is transmitted to at least one third communication terminal that does not support the Miracast protocol, so that at least one third communication terminal can receive the real-time video stream of the second communication terminal synchronously, realizing Miracast The transmission between the terminal and the non-Miracast terminal expands the scope of application; and the method is simple to deploy, low in cost and wide in applicability.
如图1所示，本发明实施例提供一种视频传输方法，用于第一通信终端，所述视频传输方法包括：As shown in FIG. 1, an embodiment of the present invention provides a video transmission method for a first communication terminal, and the video transmission method includes:
第一接收步骤11，通过和第二通信终端之间基于Miracast协议建立的第一连接接收所述第二通信终端发送的实时视频流；The first receiving step 11 is to receive the real-time video stream sent by the second communication terminal through the first connection established based on the Miracast protocol with the second communication terminal;
第一发送步骤12，通过和至少一个第三通信终端之间基于Miracast协议之外的其他协议建立的第二连接传输所述实时视频流到所述至少一个第三通信终端。The first sending step 12 is to transmit the real-time video stream to the at least one third communication terminal through a second connection established with the at least one third communication terminal based on other protocols than the Miracast protocol.
本发明的上述实施例的视频传输方法中，第一通信终端、第二终端终端以及至少一个只支持网络连接但不支持Miracast协议的第三通信终端组成一个混合网络。具体的，在上述混合网络中，第一通信终端为接收端设备，第二通信终端为发送端设备。第一通信终端接收到第二通信终端通过Miracast协议发送来的实时视频流之后，在基于Miracast协议之外的其他协议将上述实时视频流转发给至少一个第三通信终端；则原本不支持Miracast协议的第三通信终端就可以看到来自第二通信终端的实时视频内容，实现了一路输入对多路输出的效果；能够满足多媒体教学等应用场景，扩大了Miracast协议的应用范围，且无需使用专门的设备，部署简单，成本低廉。In the video transmission method of the above embodiments of the present invention, the first communication terminal, the second terminal and at least one third communication terminal that only supports network connection but does not support the Miracast protocol form a hybrid network. Specifically, in the foregoing hybrid network, the first communication terminal is a receiving end device, and the second communication terminal is a sending end device. After the first communication terminal receives the real-time video stream sent by the second communication terminal through the Miracast protocol, the above-mentioned real-time video stream is forwarded to at least one third communication terminal based on other protocols other than the Miracast protocol; the Miracast protocol is not originally supported The third communication terminal can see the real-time video content from the second communication terminal, realizing the effect of one input to multiple outputs; it can meet the application scenarios such as multimedia teaching, expand the application range of Miracast protocol, and do not need to use special The equipment is easy to deploy and low in cost.
具体的，由于第一通信终端与至少一个第三通信终端支持网络连接，即能够基于Miracast协议之外的其他协议建立第二连接，本发明实施例包含两个场景，场景一：第一通信终端与至少一个第三通信终端处于同一局域网中；场景二：第一通信终端与至少一个第三通信终端处于同一广域网中。下面分别针对场景一和场景二对本发明实施例作具体说明：Specifically, since the first communication terminal and at least one third communication terminal support network connections, that is, the second connection can be established based on other protocols than the Miracast protocol, this embodiment of the present invention includes two scenarios. Scenario 1: the first communication terminal Being in the same local area network as the at least one third communication terminal; Scenario 2: The first communication terminal is in the same wide area network as the at least one third communication terminal. In the following, the embodiments of the present invention will be specifically described for scenario 1 and scenario 2 respectively:
场景一：所述第一通信终端和所述至少一个第三通信终端位于同一局域网中，该场景下，多个第三通信终端获取携带实时视频流广播端口的方法主要包括被动接收和主动获取两种，具体的，所述视频传输方法还包括：Scenario 1: The first communication terminal and the at least one third communication terminal are located in the same local area network. In this scenario, the method for multiple third communication terminals to obtain broadcast ports carrying real-time video streams mainly includes passive reception and active acquisition. One, specifically, the video transmission method also includes:
广播步骤13，在所述局域网内广播携带实时视频流广播端口的广播消息，使得所述至少一个第三通信终端能够通过监控所述实时视频流广播端口接收所述第一通信终端通过所述实时视频流广播端口广播的所述实时视频流。Broadcasting step 13: Broadcast a broadcast message carrying a real-time video stream broadcast port in the local area network, so that the at least one third communication terminal can receive the real-time video stream sent by the first communication terminal by monitoring the real-time video stream broadcast port. The real-time video stream broadcast by the video stream broadcasting port.
或者，所述视频传输方法还包括：Alternatively, the video transmission method also includes:
第二接收步骤14，接收所述同一局域网内的所述至少一个第三通信终端广播的服务请求消息；The second receiving step 14 is to receive the service request message broadcast by the at least one third communication terminal in the same local area network;
第二发送步骤15，向所述至少一个第三通信终端广播返回携带实时视频流广播端口的服务请求响应消息，使得所述至少一个第三通信终端能够通过监控所述实时视频流广播端口接收所述第一通信终端通过所述实时视频流广播端口广播的所述实时视频流。The second sending step 15 is to broadcast and return a service request response message carrying a real-time video stream broadcast port to the at least one third communication terminal, so that the at least one third communication terminal can receive the real-time video stream broadcast port by monitoring the real-time video stream broadcast port The real-time video stream broadcast by the first communication terminal through the real-time video stream broadcast port.
场景一中第一通信终端和至少一个第三通信终端位于同一局域网中的网络拓扑结构图如图2所示。第一通信终端周期性地在局域网内广播携带实时视频流广播端口的广播消息，该广播消息还可包含第一通信终端的协议版本、设备描述、分辨率、流协议类型、编码格式等内容，在此不一一赘述。或者由第三通信终端主动向局域网内的第一通信终端发送查询广播消息，询问第一通信终端的服务信息，第一通信终端在接收到该查询消息时，向相应的第三终端设备发送携带实时视频流广播端口的服务请求响应消息。若第三终端设备可以接受第一终端设备的分辨率、协议类型、编码格式等服务参数，则开始监听实时视频流广播端口，准备接收经第一通信终端广播转发的实时视频流。In scenario 1, a network topology structure diagram in which the first communication terminal and at least one third communication terminal are located in the same local area network is shown in FIG. 2 . The first communication terminal periodically broadcasts a broadcast message carrying a broadcast port of a real-time video stream in the local area network. The broadcast message may also include the protocol version, device description, resolution, stream protocol type, encoding format, etc. of the first communication terminal, I won't go into details here. Alternatively, the third communication terminal actively sends an inquiry broadcast message to the first communication terminal in the local area network to inquire about the service information of the first communication terminal, and when the first communication terminal receives the inquiry message, it sends a broadcast message carrying the information to the corresponding third terminal device. Service request response message for live video streaming broadcast port. If the third terminal device can accept the service parameters such as the resolution, protocol type, and encoding format of the first terminal device, it starts to monitor the real-time video stream broadcast port, and prepares to receive the real-time video stream broadcast and forwarded by the first communication terminal.
在该场景下，第一通信终端与第二通信终端之间遵循标准的Miracast1.0协议，经过设备发现、服务发现、连接建立、能力协商、会话建立等阶段的交互后，如图3所示，实时视频流通过实时流传输协议(RTSP)从第二通信终端传送到第一通信终端。为了满足局域网内多个终端设备同步并行接收第二通信终端视频流的需求，第一通信终端可通过广播机制在整个局域网内转发所接收的第二通信终端的实时视频流。由于只是进行广播转发，所以可以大大降低对网络带宽的占用、第一通信终端自身为此所消耗的CPU、内存等计算资源也降低到最低程度。各通信终端从而能够以较低时延、并发地接收到第二通信终端的发送的实时视频流，并且各第三通信终端的加入、退出导致的局域网网络环境变化对其他通信终端的接收和显示并无任何影响。In this scenario, the first communication terminal and the second communication terminal follow the standard Miracast1.0 protocol, and after the interaction in the stages of device discovery, service discovery, connection establishment, capability negotiation, and session establishment, as shown in Figure 3 , the real-time video stream is transmitted from the second communication terminal to the first communication terminal through a real-time streaming protocol (RTSP). In order to meet the requirement that multiple terminal devices in the local area network receive the video stream of the second communication terminal synchronously and in parallel, the first communication terminal can forward the received real-time video stream of the second communication terminal in the entire local area network through a broadcast mechanism. Since only broadcast forwarding is performed, the occupation of network bandwidth can be greatly reduced, and the computing resources such as CPU and memory consumed by the first communication terminal itself are also reduced to a minimum. Therefore, each communication terminal can receive the real-time video stream sent by the second communication terminal concurrently with a relatively low delay, and the change of the local area network network environment caused by the joining and exit of each third communication terminal can be received and displayed by other communication terminals has no effect.
场景二：所述第一通信终端和所述至少一个第三通信终端位于同一广域网中，所述视频传输方法还包括：Scenario 2: The first communication terminal and the at least one third communication terminal are located in the same wide area network, and the video transmission method further includes:
第三发送步骤16，向广域网中的服务器发送一携带连接信息的注册信息，使得所述至少一个第三通信终端能够从所述服务器获取所述连接信息后，根据所述连接信息和所述第一通信终端交互，建立所述第二连接。The third sending step 16 is to send registration information carrying connection information to a server in the wide area network, so that after the at least one third communication terminal can obtain the connection information from the server, according to the connection information and the first A communication terminal interacts to establish the second connection.
场景二下所述第一通信终端和所述至少一个第三通信终端位于同一广域网中，拓扑结构如图4所示，此处的广域网可以是LTE网络、ADSL、以太网以及光纤等任何基于IP的网络。与场景一相比，场景二下的广域网中设置有一台具有固定域名或IP地址的服务器，该服务器的作用为接收第二通信终端的注册及至少一个第三终端的查询。In scenario two, the first communication terminal and the at least one third communication terminal are located in the same wide area network, and the topology is shown in Figure 4. The wide area network here can be any IP-based network such as LTE network, ADSL, Ethernet, and optical fiber. network of. Compared with Scenario 1, a server with a fixed domain name or IP address is set in the WAN in Scenario 2, and the function of the server is to receive the registration of the second communication terminal and the query of at least one third terminal.
第一通信终端首先向服务器发送注册信息，注册自己的连接信息，注册信息中包括第一通信终端的IP地址、端口、协议版本以及设备描述等内容，服务器会保存其连接信息，完成第一通信终端的注册。当至少一个第三通信终端向服务器发送查询消息时，该查询消息用于询问第一通信终端的连接信息，服务器会向对应的第三通信终端回复当前正在工作的所有第一通信终端的连接信息；则所述视频传输方法还包括：The first communication terminal first sends registration information to the server to register its own connection information. The registration information includes the IP address, port, protocol version, and device description of the first communication terminal, and the server will save its connection information to complete the first communication. Terminal registration. When at least one third communication terminal sends a query message to the server, the query message is used to inquire about the connection information of the first communication terminal, and the server will reply to the corresponding third communication terminal with the connection information of all the first communication terminals currently working ; Then the video transmission method also includes:
第三接收步骤17，接收第三通信终端根据所述连接信息向所述第一通信终端发送的携带第三通信终端的能力信息和地址信息的连接请求；The third receiving step 17 is to receive the connection request carrying the capability information and address information of the third communication terminal sent by the third communication terminal to the first communication terminal according to the connection information;
判断步骤18，根据所述能力信息和所述第一通信终端的运行状况决定是否接纳所述第三通信终端；Judging step 18, deciding whether to accept the third communication terminal according to the capability information and the operating status of the first communication terminal;
第四发送步骤19，在决定接纳所述第三通信终端后，向所述第三通信终端返回携带用于建立实时视频流传输连接的连接请求响应。In the fourth sending step 19, after deciding to accept the third communication terminal, return a connection request response carrying a connection request for establishing a real-time video stream transmission connection to the third communication terminal.
其中，判断步骤18中当第一通信终端可以兼容第三通信终端的分辨率、流协议类型以及编码格式等输出参数，并且当前网络带宽及工作能力允许接收该路视频输出时，决定接纳所述第三通信终端，则向第三通信终端回复视频流接收端口、流协议类型、解码格式等内容的确认信息，至此第三通信终端与第一通信终端之间的网络连接建立成功，第三通信终端能够接收第一通信终端转发的实时视频流；否则第一通信终端发送拒绝连接消息，断开同第三通信终端的连接。较佳的，第一通信终端与第二通信终端之间的信息交互与场景一下的相同，即第一通信终端与第二通信终端之间仍然遵循标准的Miracast1.0协议，经过设备发现、服务发现、连接建立、能力协商、会话建立等阶段的交互后，如图5所示，实时视频流通过RTSP协议从第二通信终端传送到第一通信终端。然后第一通信终端将视频流转发到各终端设备指定的IP地址和端口，这样第三通信终端即可接收并显示源自第二通信终端的实时视频流。Wherein, in judging step 18, when the first communication terminal is compatible with the output parameters such as the resolution, stream protocol type, and encoding format of the third communication terminal, and the current network bandwidth and working capacity allow receiving the video output, it is decided to accept the The third communication terminal replies to the third communication terminal with the confirmation information of the video stream receiving port, stream protocol type, decoding format, etc., so far the network connection between the third communication terminal and the first communication terminal is successfully established, and the third communication terminal The terminal can receive the real-time video stream forwarded by the first communication terminal; otherwise, the first communication terminal sends a connection rejection message to disconnect the connection with the third communication terminal. Preferably, the information interaction between the first communication terminal and the second communication terminal is the same as that in scenario 1, that is, the standard Miracast1.0 protocol is still followed between the first communication terminal and the second communication terminal, after device discovery, service After the interaction in stages of discovery, connection establishment, capability negotiation, and session establishment, as shown in FIG. 5 , the real-time video stream is transmitted from the second communication terminal to the first communication terminal through the RTSP protocol. Then the first communication terminal forwards the video stream to the IP address and port specified by each terminal device, so that the third communication terminal can receive and display the real-time video stream from the second communication terminal.
需要说明的是，无论是局域网拓扑结构还是广域网拓扑结构中，第一通信终端和第二通信终端之间不一定非得通过Miracast协议进行连接，而是可以通过双方约定好的通信协议(如WiDi、Airplay、HDMI等)进行实时视频传输，第三通信终端侧无需做出任何改变，也完全不影响整个系统的运行以及一对多实时视频传输的目标实现。It should be noted that, whether it is a local area network topology or a wide area network topology, the first communication terminal and the second communication terminal do not necessarily have to be connected through the Miracast protocol, but can be connected through a communication protocol agreed upon by both parties (such as WiDi, Airplay, HDMI, etc.) for real-time video transmission, the third communication terminal side does not need to make any changes, and does not affect the operation of the entire system and the realization of the goal of one-to-many real-time video transmission.
综上，第一通信终端跨接在IP网络(LAN、WAN均可)与Wi-Fi直连网络之间。众多不支持Miracast协议的终端设备可以通过第一通信终端的桥接接收到源自第二通信终端的实时视频流；对于第一通信终端侧而言，原本只支持单路输出的一对一功能，通过发明实施例的方法，实现了一对多同屏显示。此外，完全无需修改Miracast协议本身以及相关设备的硬件、固件，纯以软件的方式即可实现功能的扩展，实施成本低廉。To sum up, the first communication terminal is connected between the IP network (LAN, WAN) and the Wi-Fi direct network. Many terminal devices that do not support the Miracast protocol can receive the real-time video stream from the second communication terminal through the bridge of the first communication terminal; for the first communication terminal side, originally only supported the one-to-one function of single output, Through the method of the embodiment of the invention, one-to-many display on the same screen is realized. In addition, there is no need to modify the Miracast protocol itself and the hardware and firmware of related devices, and the function expansion can be realized purely by software, and the implementation cost is low.
为了更好的实现上述目的，如图6所示，本发明实施例还提供一种视频传输装置，用于第一通信终端，所述视频传输装置包括：In order to better achieve the above purpose, as shown in FIG. 6, an embodiment of the present invention also provides a video transmission device for a first communication terminal, the video transmission device includes:
第一接收模块61，用于通过和第二通信终端之间基于Miracast协议建立的第一连接接收所述第二通信终端发送的实时视频流；The first receiving module 61 is configured to receive the real-time video stream sent by the second communication terminal through the first connection established based on the Miracast protocol with the second communication terminal;
第一发送模块62，用于通过和至少一个第三通信终端之间基于Miracast协议之外的其他协议建立的第二连接传输所述实时视频流到所述至少一个第三通信终端。The first sending module 62 is configured to transmit the real-time video stream to the at least one third communication terminal through a second connection established with the at least one third communication terminal based on a protocol other than the Miracast protocol.
具体的，本发明的上述实施例中，所述第一通信终端和所述至少一个第三通信终端位于同一局域网中，所述视频传输装置还包括：Specifically, in the above embodiments of the present invention, the first communication terminal and the at least one third communication terminal are located in the same local area network, and the video transmission device further includes:
广播模块，用于在所述局域网内广播携带实时视频流广播端口的广播消息，使得所述至少一个第三通信终端能够通过监控所述实时视频流广播端口接收所述第一通信终端通过所述实时视频流广播端口广播的所述实时视频流。A broadcast module, configured to broadcast a broadcast message carrying a real-time video stream broadcast port in the local area network, so that the at least one third communication terminal can receive the first communication terminal through the real-time video stream broadcast port by monitoring the real-time video stream broadcast port. The real-time video stream broadcast by the real-time video stream broadcasting port.
具体的，本发明的上述实施例中，所述第一通信终端和所述至少一个第三通信终端位于同一局域网中，所述视频传输装置还包括：Specifically, in the above embodiments of the present invention, the first communication terminal and the at least one third communication terminal are located in the same local area network, and the video transmission device further includes:
第二接收模块，用于接收所述同一局域网内的所述至少一个第三通信终端广播的服务请求消息；A second receiving module, configured to receive a service request message broadcast by the at least one third communication terminal in the same local area network;
第二发送模块，用于向所述至少一个第三通信终端广播返回携带实时视频流广播端口的服务请求响应消息，使得所述至少一个第三通信终端能够通过监控所述实时视频流广播端口接收所述第一通信终端通过所述实时视频流广播端口广播的所述实时视频流。The second sending module is configured to broadcast and return a service request response message carrying a real-time video stream broadcast port to the at least one third communication terminal, so that the at least one third communication terminal can monitor the real-time video stream broadcast port to receive The real-time video stream broadcast by the first communication terminal through the real-time video stream broadcast port.
具体的，本发明的上述实施例中，所述第一通信终端和所述至少一个第三通信终端位于同一广域网中，所述视频传输装置还包括：Specifically, in the above embodiments of the present invention, the first communication terminal and the at least one third communication terminal are located in the same wide area network, and the video transmission device further includes:
第三发送模块，用于向广域网中的服务器发送一携带连接信息的注册信息，使得所述至少一个第三通信终端能够从所述服务器获取所述连接信息后，根据所述连接信息和所述第一通信终端交互，建立所述第二连接。The third sending module is configured to send registration information carrying connection information to a server in the wide area network, so that after the at least one third communication terminal can obtain the connection information from the server, according to the connection information and the The first communication terminal interacts to establish the second connection.
具体的，本发明的上述实施例中，所述视频传输装置还包括：Specifically, in the above-mentioned embodiment of the present invention, the video transmission device further includes:
第三接收模块，用于接收第三通信终端根据所述连接信息向所述第一通信终端发送的携带第三通信终端的能力信息和地址信息的连接请求；A third receiving module, configured to receive a connection request carrying capability information and address information of the third communication terminal sent by the third communication terminal to the first communication terminal according to the connection information;
判断模块，用于根据所述能力信息和所述第一通信终端的运行状况决定是否接纳所述第三通信终端；A judging module, configured to decide whether to admit the third communication terminal according to the capability information and the operating status of the first communication terminal;
第四发送模块，用于在决定接纳所述第三通信终端后，向所述第三通信终端返回携带用于建立实时视频流传输连接的连接请求响应。The fourth sending module is configured to return to the third communication terminal a connection request response carrying a connection for establishing a real-time video stream transmission connection after deciding to accept the third communication terminal.
本发明实施例提供的视频传输装置位于第一网络终端侧，通过第一通信终端基于Miracast协议接收第二通信终端发送的实时视频流，并将该实时视频流传输给至少一个不支持Miracast协议的第三通信终端，使得至少一个第三通信终端能够同步接收第二通信终端的实时视频流，实现了基于Miracast协议的一对多实时视频的传输，扩大了Miracast的应用范围；且该方法部署简单，成本低廉，适用性广。The video transmission device provided by the embodiment of the present invention is located on the side of the first network terminal, receives the real-time video stream sent by the second communication terminal through the first communication terminal based on the Miracast protocol, and transmits the real-time video stream to at least one network terminal that does not support the Miracast protocol. The third communication terminal enables at least one third communication terminal to synchronously receive the real-time video stream of the second communication terminal, realizes the transmission of one-to-many real-time video based on the Miracast protocol, and expands the scope of application of Miracast; and the method is simple to deploy , low cost and wide applicability.
需要说明的是，本发明实施例提供的视频传输装置是应用上述视频传输方法的装置，则上述视频传输方法的所有实施例及其有益效果均适用于该视频传输装置。It should be noted that the video transmission device provided by the embodiment of the present invention is a device applying the above video transmission method, and all the embodiments and beneficial effects of the above video transmission method are applicable to the video transmission device.
以上所述是本发明的优选实施方式，应当指出，对于本技术领域的普通技术人员来说，在不脱离本发明所述原理的前提下，还可以做出若干改进和润饰，这些改进和润饰也应视为本发明的保护范围。The above description is a preferred embodiment of the present invention, it should be pointed out that for those of ordinary skill in the art, without departing from the principle of the present invention, some improvements and modifications can also be made, these improvements and modifications It should also be regarded as the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410837960.3ACN105812909A (en) | 2014-12-29 | 2014-12-29 | Video transmission method and device |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410837960.3ACN105812909A (en) | 2014-12-29 | 2014-12-29 | Video transmission method and device |
| Publication Number | Publication Date |
|---|---|
| CN105812909Atrue CN105812909A (en) | 2016-07-27 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410837960.3APendingCN105812909A (en) | 2014-12-29 | 2014-12-29 | Video transmission method and device |
| Country | Link |
|---|---|
| CN (1) | CN105812909A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017140161A1 (en)* | 2016-02-18 | 2017-08-24 | 中兴通讯股份有限公司 | Method, device and system for sharing audio and video resource, and network gateway |
| WO2018040427A1 (en)* | 2016-08-29 | 2018-03-08 | 广州视睿电子科技有限公司 | Screen interface sharing method and system |
| CN108632560A (en)* | 2018-05-14 | 2018-10-09 | 聚好看科技股份有限公司 | Video call method, device and terminal equipment |
| CN109803110A (en)* | 2019-01-29 | 2019-05-24 | 维沃移动通信有限公司 | A kind of image processing method, terminal device and server |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101052038A (en)* | 2006-05-31 | 2007-10-10 | 华为技术有限公司 | Media stream data processing method and device based on communication protocol |
| CN103136241A (en)* | 2011-11-28 | 2013-06-05 | 联想(北京)有限公司 | Method and electronic device for playing multi-media file |
| CN103414783A (en)* | 2013-08-21 | 2013-11-27 | 乐视致新电子科技（天津）有限公司 | Method and device for data transmission |
| CN103534679A (en)* | 2012-12-12 | 2014-01-22 | 华为终端有限公司 | Media stream sharing method and terminal |
| CN103905409A (en)* | 2012-12-30 | 2014-07-02 | 青岛海尔软件有限公司 | Automatic registration and discovery method based on wide area network devices |
| CN103905511A (en)* | 2012-12-30 | 2014-07-02 | 青岛海尔软件有限公司 | Point-to-point service discovering and calling system and method based on wide area network |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101052038A (en)* | 2006-05-31 | 2007-10-10 | 华为技术有限公司 | Media stream data processing method and device based on communication protocol |
| CN103136241A (en)* | 2011-11-28 | 2013-06-05 | 联想(北京)有限公司 | Method and electronic device for playing multi-media file |
| CN103534679A (en)* | 2012-12-12 | 2014-01-22 | 华为终端有限公司 | Media stream sharing method and terminal |
| CN103905409A (en)* | 2012-12-30 | 2014-07-02 | 青岛海尔软件有限公司 | Automatic registration and discovery method based on wide area network devices |
| CN103905511A (en)* | 2012-12-30 | 2014-07-02 | 青岛海尔软件有限公司 | Point-to-point service discovering and calling system and method based on wide area network |
| CN103414783A (en)* | 2013-08-21 | 2013-11-27 | 乐视致新电子科技（天津）有限公司 | Method and device for data transmission |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017140161A1 (en)* | 2016-02-18 | 2017-08-24 | 中兴通讯股份有限公司 | Method, device and system for sharing audio and video resource, and network gateway |
| WO2018040427A1 (en)* | 2016-08-29 | 2018-03-08 | 广州视睿电子科技有限公司 | Screen interface sharing method and system |
| CN108632560A (en)* | 2018-05-14 | 2018-10-09 | 聚好看科技股份有限公司 | Video call method, device and terminal equipment |
| CN109803110A (en)* | 2019-01-29 | 2019-05-24 | 维沃移动通信有限公司 | A kind of image processing method, terminal device and server |
| CN109803110B (en)* | 2019-01-29 | 2021-02-09 | 维沃移动通信有限公司 | Image processing method, terminal equipment and server |
| Publication | Publication Date | Title |
|---|---|---|
| US9288810B2 (en) | Wireless media sharing from multiple sources to a single sink | |
| KR101841591B1 (en) | Session management and control procedures for supporting multiple groups of sink devices in a peer―to―peer wireless display system | |
| US10354618B2 (en) | Wireless communication system for offline participation in a display session | |
| US10264038B2 (en) | Discovery and management of synchronous audio or video streaming service to multiple sinks in wireless display system | |
| US10200108B2 (en) | Wireless docking system for audio-video relay | |
| CN101626387B (en) | System, method and terminal for treating media business | |
| CN105682182B (en) | A kind of discovery of equipment and equipment connection method, equipment and system | |
| JP2016534458A (en) | Remote wireless screen sharing method, apparatus and system | |
| CN104427354B (en) | A kind of method, streaming media server and node subsystem that live media is shared | |
| US20100027444A1 (en) | Method and system for establishing connections for wireless network devices | |
| CN105812909A (en) | Video transmission method and device | |
| CN111669333A (en) | Data transmission method, apparatus, computing device and storage medium | |
| JP2018521549A (en) | Techniques for managing reverse channel audio sessions | |
| WO2012097560A1 (en) | Method and system for sharing mobile tv service data in wireless local area network | |
| CN117857860A (en) | Screen projection method, screen projection system and computer readable storage medium | |
| CN105791965A (en) | A device connection processing method, system and related equipment in screen sharing | |
| CN105722037B (en) | A method and apparatus for interacting between a WLAN device and a WFD device | |
| BR112021021159B1 (en) | USER TERMINAL EMULATION SERVER, METHOD BY A USER TERMINAL EMULATION SERVER TO PROVIDE COMMUNICATION SERVICES USING ASSEMBLIES OF USER INPUT AND/OR OUTPUT DEVICES, AND COMPUTER READABLE NON-TRANSITORY MEDIA | |
| CN105991957A (en) | Bidirectional video transmission method and device | |
| JP2020088712A (en) | Communication device and control method thereof | |
| KR20120029121A (en) | Apparatus and method for seamless service provision between heterogeneous nodes |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20160727 | |
| RJ01 | Rejection of invention patent application after publication |