Movatterモバイル変換


[0]ホーム

URL:


CN100442846C - A mobile multi-point monitoring method using SMIL technology and mobile streaming media technology - Google Patents

A mobile multi-point monitoring method using SMIL technology and mobile streaming media technology
Download PDF

Info

Publication number
CN100442846C
CN100442846CCNB2006100181661ACN200610018166ACN100442846CCN 100442846 CCN100442846 CCN 100442846CCN B2006100181661 ACNB2006100181661 ACN B2006100181661ACN 200610018166 ACN200610018166 ACN 200610018166ACN 100442846 CCN100442846 CCN 100442846C
Authority
CN
China
Prior art keywords
mobile
streaming media
smil
terminal
media server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2006100181661A
Other languages
Chinese (zh)
Other versions
CN1812571A (en
Inventor
黄治华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Northern Fiberhome Technologies Co Ltd
Original Assignee
Beijing Northern Fiberhome Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Northern Fiberhome Technologies Co LtdfiledCriticalBeijing Northern Fiberhome Technologies Co Ltd
Priority to CNB2006100181661ApriorityCriticalpatent/CN100442846C/en
Publication of CN1812571ApublicationCriticalpatent/CN1812571A/en
Application grantedgrantedCritical
Publication of CN100442846CpublicationCriticalpatent/CN100442846C/en
Expired - Fee Relatedlegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Landscapes

Abstract

Translated fromChinese

一种利用SMIL技术与移动流媒体技术的移动多点监视方法,其特征在于:采集终端采集视频信号,并采用H.264算法对视频进行编码,然后将压缩的码流封装成RTP包发送到移动流媒体服务器,供移动终端使用。采集终端可以灵活部署,多路采集终端可同时向移动流媒体服务器发送RTP包,从而为移动终端的多点监视提供视频源;同时移动终端在SMIL脚本中发起到移动流媒体服务器的多个直播连接,实现在单一屏幕上的多画面显示;根据移动终端的监视需求,管理平台动态生成SMIL脚本,移动终端下载此脚本,并根据SMIL脚本中的描述,发起多个到移动流媒体服务器的直播请求,从而实现移动多点监视。本发明根据无线网络自身特性,采用H.264视频编码算法,利用SMIL可以方便描述各种媒体之间时间同步关系和空间编排关系的特点,借助于移动流媒体服务器,实现了移动多点监视。

A mobile multi-point monitoring method using SMIL technology and mobile streaming media technology, characterized in that: the acquisition terminal collects video signals, and uses the H.264 algorithm to encode the video, and then encapsulates the compressed code stream into an RTP packet and sends it to Mobile streaming server for mobile terminals. The acquisition terminal can be flexibly deployed, and multi-channel acquisition terminals can send RTP packets to the mobile streaming media server at the same time, thus providing video sources for the multi-point monitoring of the mobile terminal; at the same time, the mobile terminal initiates multiple live broadcasts to the mobile streaming media server in the SMIL script Connect to realize multi-screen display on a single screen; according to the monitoring requirements of the mobile terminal, the management platform dynamically generates a SMIL script, the mobile terminal downloads the script, and initiates multiple live broadcasts to the mobile streaming media server according to the description in the SMIL script Request, so as to realize mobile multi-point surveillance. According to the characteristics of the wireless network itself, the present invention adopts the H.264 video encoding algorithm, uses SMIL to conveniently describe the characteristics of the time synchronization relationship and space arrangement relationship between various media, and realizes mobile multi-point monitoring by means of a mobile streaming media server.

Description

Translated fromChinese
一种利用SMIL技术与移动流媒体技术的移动多点监视方法A mobile multi-point monitoring method using SMIL technology and mobile streaming media technology

技术领域technical field

本发明采用移动流媒体技术实现移动多点监视,具体涉及视/音频编解码技术、移动流媒体技术及SMIL技术。The invention adopts mobile streaming media technology to realize mobile multi-point monitoring, and specifically relates to video/audio codec technology, mobile streaming media technology and SMIL technology.

背景技术Background technique

移动流媒体技术mobile streaming technology

移动流媒体技术就是把连续的影像和声音信息经过压缩处理后放到网络服务器上,让移动终端用户能够一边下载一边观看、收听,而不需要等到整个多媒体文件下载完成就可以即时观看的技术。实际上移动流媒体技术是网络音视频技术和移动通讯技术发展到一定阶段的产物,它是融合很多网络技术之后所产生的技术,它会涉及到流媒体数据的采集、压缩、存储、传输以及网络通信等多项技术。Mobile streaming media technology is a technology that compresses continuous video and audio information and puts them on the network server, so that mobile terminal users can watch and listen while downloading, without waiting for the entire multimedia file to be downloaded. In fact, mobile streaming media technology is the product of the development of network audio and video technology and mobile communication technology to a certain stage. It is a technology produced after the integration of many network technologies. It will involve the collection, compression, storage, transmission and Network communication and many other technologies.

支持的网络传输协议为:实时流化协议(RTSP)、实时传输协议(RTP)和实时传输控制协议(RTCP)。支持的视频编码算法:H.263、MPEG4和H.264;支持的音频编码算法:AMR、AAC等。The supported network transport protocols are: Real-time Streaming Protocol (RTSP), Real-time Transport Protocol (RTP) and Real-time Transport Control Protocol (RTCP). Supported video coding algorithms: H.263, MPEG4 and H.264; supported audio coding algorithms: AMR, AAC, etc.

1、视/音频编解码技术1. Video/audio codec technology

目前国际上常用的视频编码算法有H.263、MPEG4和H.264。其中H.264与其它现有的视频编码标准相比,具有如下优势:At present, the commonly used video coding algorithms in the world include H.263, MPEG4 and H.264. Compared with other existing video coding standards, H.264 has the following advantages:

低码流(Low Bit Rate):和MPEG2和MPEG4 ASP等压缩技术相比,在同等图像质量下,采用H.264技术压缩后的数据量只有MPEG2的1/8,MPEG4的1/3。Low Bit Rate: Compared with compression technologies such as MPEG2 and MPEG4 ASP, under the same image quality, the amount of data compressed by H.264 technology is only 1/8 of MPEG2 and 1/3 of MPEG4.

高质量的图像:H.264能提供连续、流畅的高质量图象(DVD质量)。High-quality images: H.264 can provide continuous, smooth high-quality images (DVD quality).

容错能力强:H.264提供了解决在不稳定网络环境下容易发生的丢包等错误的必要工具。Strong fault tolerance: H.264 provides the necessary tools to solve errors such as packet loss that are prone to occur in an unstable network environment.

网络适应性强:H.264提供了网络适应层(Network Adaptation Layer),使得H.264的文件能容易地在不同网络上传输(例如互联网,CDMA,GPRS,WCDMA,CDMA2000等)。Strong network adaptability: H.264 provides a Network Adaptation Layer, which enables H.264 files to be easily transmitted on different networks (such as the Internet, CDMA, GPRS, WCDMA, CDMA2000, etc.).

2、SMIL技术2. SMIL technology

SMIL是同步多媒体集成语言,它是一套已经规定好的而且非常简单的标记。它用来规定多媒体片断(这里多媒体包括的范围有:声音文件、视频文件、动画、图片、文字等)在什么时候、在什么地方、以什么样的方式播放。采用SMIL可以方便地描述各种媒体之间的时间同步关系和空间编排关系,是Internet上用于集成多媒体节目,尤其是流媒体的主要语言工具,它可以实现视频/音频、导航区的标题与电子讲稿三者的同步。SMIL is Synchronous Multimedia Integration Language, which is a set of well-defined and very simple marks. It is used to specify when, where, and in what way the multimedia clips (here, the scope of multimedia includes: sound files, video files, animations, pictures, text, etc.) are played. Using SMIL can conveniently describe the time synchronization relationship and spatial arrangement relationship between various media. It is the main language tool for integrating multimedia programs on the Internet, especially streaming media. It can realize video/audio, navigation area title and Synchronization of the three electronic lecture notes.

具有如下优点:避免使用统一的包容文件格式、同时播放在不同地方(服务器上)的多媒体片断、对整个演示进行布局、多语言选择支持、多带宽选择支持。It has the following advantages: avoiding the use of a unified containment file format, playing multimedia clips in different places (on the server) at the same time, laying out the entire presentation, supporting multiple language selections, and multiple bandwidth selections.

3、视频监视3. Video surveillance

视频监视是运用先进的数字视频、计算机网络通讯技术、多媒体技术、压缩技术,实现图像、声音的远程监视。按照采集的信号的不同可以分为模拟信号监视和数字信号监视。Video surveillance is the use of advanced digital video, computer network communication technology, multimedia technology, and compression technology to realize remote monitoring of images and sounds. According to the different signals collected, it can be divided into analog signal monitoring and digital signal monitoring.

随着移动技术的发展及3G时代的到来,通过无线环境进行移动监视已经成为一种趋势。由于移动环境自身的特殊性,对编码效率、网络自适应等提出新的要求,同时还需要实现分屏显示。目前H.264压缩效率更高,在低码率环境以及网络容错等方面有许多优势,因此移动监视采用H.264视频编码算法;为了实现移动终端的通用性,考虑利用SMIL的分屏控制,任何支持SMIL的播放器都能实现远程多点显示。With the development of mobile technology and the arrival of the 3G era, mobile monitoring through wireless environment has become a trend. Due to the particularity of the mobile environment itself, new requirements are put forward for coding efficiency, network adaptation, etc., and split-screen display is also required. At present, H.264 has higher compression efficiency and has many advantages in low bit rate environment and network fault tolerance, so mobile monitoring adopts H.264 video coding algorithm; in order to realize the versatility of mobile terminals, consider using SMIL split screen control, Any player that supports SMIL can realize remote multi-point display.

目前现有的方法是:各采集终端采集信号并对信号进行视/音频压缩编码,然后将压缩的码流传输到监视中心,在监视中心通过分屏技术显示在终端上。The current existing method is: each collection terminal collects signals and performs video/audio compression coding on the signals, and then transmits the compressed code stream to the monitoring center, where it is displayed on the terminal through split-screen technology.

现有方法的缺点是:Disadvantages of existing methods are:

1、操作人员只能在监视中心进行监视,无法做到任何时间、任何地点的访问,不能对一些突发事件做出快速反应。1. Operators can only monitor in the monitoring center, and cannot visit at any time and any place, and cannot respond quickly to some emergencies.

2、在监控中心需要配置专用的媒体接收、处理服务器,接收采集终端的数据并将数据进行显示。2. A dedicated media receiving and processing server needs to be configured in the monitoring center to receive and display data from the collection terminal.

3、需要实现分屏显示,显示软件是专用的,缺乏通用性和灵活性。3. Split-screen display needs to be realized, and the display software is dedicated, lacking versatility and flexibility.

4、一般采用的编解码技术不适应移动终端和无线环境的传输。4. The commonly used codec technology is not suitable for transmission in mobile terminals and wireless environments.

发明内容Contents of the invention

本发明的目的在于提供一种利用SMIL技术与移动流媒体技术的移动多点监视方法,可以解决监视地点的束缚,任何人在任何时间、任何地点都能通过移动终端进行多点监视。The purpose of the present invention is to provide a mobile multi-point monitoring method utilizing SMIL technology and mobile streaming media technology, which can solve the constraints of monitoring locations, and anyone can perform multi-point monitoring at any time and anywhere by a mobile terminal.

本发明的技术方案是:一种利用SMIL技术与移动流媒体技术的移动多点监视方法,其特征在于:采集终端采集视频信号,并采用H.264算法对视频进行编码,然后将压缩的码流封装成RTP包发送到移动流媒体服务器,供移动终端使用;采集终端可以灵活部署,多路采集终端可同时向移动流媒体服务器发送RTP包,从而为移动终端的多点监视提供视频源;同时移动终端在SMIL脚本中发起到移动流媒体服务器的多个直播连接,实现在单一屏幕上的多画面显示;根据移动终端的监视需求,管理平台动态生成SMIL脚本,移动终端下载此脚本,并根据SMIL脚本中的描述,发起多个到移动流媒体服务器的直播请求,从而实现移动多点监视。The technical solution of the present invention is: a mobile multi-point monitoring method using SMIL technology and mobile streaming media technology, characterized in that: the acquisition terminal collects video signals, and uses the H.264 algorithm to encode the video, and then compresses the code The stream is encapsulated into RTP packets and sent to the mobile streaming media server for use by mobile terminals; the acquisition terminal can be flexibly deployed, and multiple acquisition terminals can simultaneously send RTP packets to the mobile streaming media server, thus providing video sources for multi-point monitoring of mobile terminals; At the same time, the mobile terminal initiates multiple live connections to the mobile streaming media server in the SMIL script to realize multi-screen display on a single screen; according to the monitoring requirements of the mobile terminal, the management platform dynamically generates the SMIL script, and the mobile terminal downloads the script and According to the description in the SMIL script, initiate multiple live broadcast requests to the mobile streaming media server, thereby realizing mobile multi-point monitoring.

如上所述的移动多点监视方法,其特征在于:Mobile multi-point surveillance method as above, characterized in that:

①各采集终端采集信号,并进行压缩编码,视频采用H.264编码算法;然后将编码压缩的码流封装成RTP包发送到移动流媒体服务器;① Each collection terminal collects signals, and compresses and encodes them. The video uses the H.264 encoding algorithm; then encapsulates the encoded and compressed code streams into RTP packets and sends them to the mobile streaming media server;

②各采集终端将采集、直播信息发布到综合管理平台;② Each collection terminal releases the collection and live broadcast information to the comprehensive management platform;

③移动终端访问综合管理平台,选择需要监视的地点,并对显示画面提出需求;③The mobile terminal accesses the comprehensive management platform, selects the location to be monitored, and puts forward requirements for the display screen;

④综合管理平台根据移动终端的需求动态生成SMIL脚本,该脚本包含了到移动流媒体服务器的直播请求,并将SMIL脚本传给移动终端;④The integrated management platform dynamically generates SMIL scripts according to the needs of mobile terminals, which include the live broadcast request to the mobile streaming media server, and transmit the SMIL scripts to the mobile terminals;

⑤移动终端播放SMIL脚本,在移动终端上发起到移动流媒体服务器的直播请求,实现移动多点监视。⑤ The mobile terminal plays the SMIL script, and initiates a live broadcast request to the mobile streaming media server on the mobile terminal to realize mobile multi-point monitoring.

如上所述的移动多点监视方法,其特征在于:Mobile multi-point surveillance method as above, characterized in that:

采集终端采集步骤如下:The collection steps of the collection terminal are as follows:

①、采集终端向移动流媒体服务器发起注册(包含用户名和密码);①. The acquisition terminal initiates registration to the mobile streaming media server (including user name and password);

②、移动流媒体服务器对采集终端进行接入管理,并将结果返回给采集终端;②. The mobile streaming media server performs access management on the collection terminal, and returns the result to the collection terminal;

③、采集终端分析注册响应;若成功,则向移动流媒体服务器发送会话描述文件(SDP信息),其中描述了编码算法、移动流媒体服务器接收RTP包端口等信息;3. Collect terminal analysis registration response; if successful, send session description file (SDP information) to mobile streaming media server, which describes information such as encoding algorithm, mobile streaming media server receiving RTP packet port;

④、移动流媒体服务器根据SDP信息中的端口信息打开接收端口,并向综合管理平台通报在线采集终端信息;④. The mobile streaming media server opens the receiving port according to the port information in the SDP information, and notifies the online collection terminal information to the integrated management platform;

⑤、移动流媒体服务器向采集终端发送操作结果;⑤. The mobile streaming media server sends the operation result to the collection terminal;

⑥、采集终端分析结果,若成功,则启动采集、编码、封包过程,向移动流媒体服务发送RTP包;⑥. Collect the analysis results of the terminal, if successful, start the process of collecting, encoding, and packing, and send RTP packets to the mobile streaming service;

移动终端发起播放步骤如下:The mobile terminal initiates the playback steps as follows:

①、移动终端登录综合管理平台;①, mobile terminal login integrated management platform;

②、从综合管理平台上选择在线采集终端,可以同时选择多个(这样就实现了多点),并对每个在线采集终端指定显示区域;②. Select the online collection terminal from the comprehensive management platform, and you can select multiple at the same time (so that multi-point is realized), and specify the display area for each online collection terminal;

③、综合管理平台根据移动终端选定的信息动态生成SMIL脚本;③. The comprehensive management platform dynamically generates SMIL scripts according to the information selected by the mobile terminal;

④、移动终端从综合管理平台上下载SMIL脚本;④. The mobile terminal downloads the SMIL script from the integrated management platform;

⑤、移动终端启动支持SMIL脚本的播放器进行播放,播放器根据SMIL脚本中的Src信息向移动流媒体服务器发起直播请求,接收RTP包,解码并在指定的区域进行显示。⑤. The mobile terminal starts a player supporting SMIL script to play. The player initiates a live broadcast request to the mobile streaming media server according to the Src information in the SMIL script, receives the RTP packet, decodes it, and displays it in the designated area.

本发明的原理是:Principle of the present invention is:

SMIL技术能够实现多画面显示,移动终端在SMIL脚本中发起到移动流媒体服务器的多个直播连接,实现在单一屏幕上的多画面显示。移动终端在SMIL脚本中可以指定显示画面数以及各画面的相对位置,当播放SMIL脚本时,移动终端上的播放器首先按照脚本中的画面数以及位置参数分割画面,然后根据显示内容属性采用不同方法依次显示。显示的内容可以是视频、音频,也可以是FLASH和文本;显示的内容可以来源于本地文件,也可以来源于移动流媒体服务器。SMIL technology can realize multi-screen display. The mobile terminal initiates multiple live connections to the mobile streaming media server in the SMIL script to realize multi-screen display on a single screen. In the SMIL script, the mobile terminal can specify the number of display screens and the relative position of each screen. When playing the SMIL script, the player on the mobile terminal first divides the screen according to the number of screens and position parameters in the script, and then adopts different display content attributes. The methods are displayed in sequence. The displayed content can be video, audio, or FLASH and text; the displayed content can come from local files or mobile streaming media servers.

SMIL脚本中的内容来源于移动流媒体服务器,通过在SMIL脚本中发起到移动流媒体服务器的直播请求,从而利用SMIL技术和移动流媒体技术实现了移动多点监视。The content in the SMIL script comes from the mobile streaming media server. By initiating a live broadcast request to the mobile streaming media server in the SMIL script, the mobile multi-point monitoring is realized by using the SMIL technology and the mobile streaming media technology.

本发明根据无线网络自身特性,采用了最先进的H.264视频编码算法,利用SMIL可以方便描述各种媒体之间时间同步关系和空间编排关系的特点,借助于移动流媒体服务器,实现移动多点监视。According to the characteristics of the wireless network itself, the present invention adopts the most advanced H.264 video coding algorithm, uses SMIL to conveniently describe the characteristics of the time synchronization relationship and space arrangement relationship between various media, and realizes mobile multi- Click on monitor.

本发明的优点是:The advantages of the present invention are:

1、解决了监视地点的束缚,任何人在任何时间、任何地点都能通过移动终端进行多点监视。1. It solves the constraints of surveillance locations, and anyone can conduct multi-point surveillance through mobile terminals at any time and anywhere.

2、不需要专用媒体接收、处理服务器,可以共用和借用已有的通用流媒体服务器,从而降低成本。2. There is no need for a dedicated media receiving and processing server, and the existing general streaming media server can be shared and borrowed, thereby reducing costs.

3、在移动终端上不需要设计专用分屏显示软件,任何支持SMIL脚本的显示软件都可以。3. There is no need to design special split-screen display software on the mobile terminal, any display software that supports SMIL scripts is fine.

4、视频编码采用H.264编码算法,在无线以及低码率环境下能获得满意的视频质量。4. Video encoding adopts H.264 encoding algorithm, which can obtain satisfactory video quality in wireless and low bit rate environments.

附图说明Description of drawings

图1,是本发明实施例的系统框架图。Fig. 1 is a system frame diagram of an embodiment of the present invention.

图2,是本发明实施例的采集终端与流媒体服务器、综合管理平台交互图。Fig. 2 is an interaction diagram between a collection terminal, a streaming media server, and an integrated management platform according to an embodiment of the present invention.

图3,是本发明实施例的移动终端与流媒体服务器、综合管理平台交互图。Fig. 3 is an interaction diagram between a mobile terminal, a streaming media server and an integrated management platform according to an embodiment of the present invention.

具体实施方式Detailed ways

下面结合附图详细描述本发明的实施例。Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

系统框架如图1所示:整个系统有四部分组成:The system framework is shown in Figure 1: the whole system consists of four parts:

采集终端(101,102等):采集视频信号,并对信号进行压缩编码;将编码的码流封装成RTP包发送到移动流媒体服务器。Acquisition terminals (101, 102, etc.): collect video signals, and compress and encode the signals; encapsulate the coded streams into RTP packets and send them to the mobile streaming media server.

移动流媒体服务器(110):实现RTSP、RTP、RTCP协议;接收采集终端(101,102等)发送的RTP包;接收移动终端(130,131等)的直播请求。Mobile streaming media server (110): realize RTSP, RTP, RTCP agreement; Receive the RTP bag that collection terminal (101,102 etc.) sends; Receive the live broadcast request of mobile terminal (130,131 etc.).

综合管理平台(120):采集终端的接入管理;采集终端信息统计;SMIL脚本的生成。Integrated management platform (120): access management of collection terminals; collection terminal information statistics; generation of SMIL scripts.

移动终端(130,131等):支持SMIL脚本播放;支持RTSP、RTP、RTCP协议;支持H.264视频解码算法。Mobile terminals (130, 131, etc.): support SMIL script playback; support RTSP, RTP, RTCP protocols; support H.264 video decoding algorithm.

采集终端采集过程如图2所示:The acquisition process of the acquisition terminal is shown in Figure 2:

1、采集终端(201)向移动流媒体服务器(210)发起注册(包含用户名和密码)。1. The collection terminal (201) initiates registration (including user name and password) to the mobile streaming media server (210).

2、移动流媒体服务器(210)对采集终端(201)进行接入管理,并将结果返回给采集终端。2. The mobile streaming media server (210) performs access management on the collection terminal (201), and returns the result to the collection terminal.

3、采集终端(201)分析注册响应;若成功,则向移动流媒体服务器(210)发送会话描述文件(SDP信息),其中描述了编码算法、移动流媒体服务器接收RTP包端口等信息。3, collection terminal (201) analyzes registration response; If successful, then send session description file (SDP information) to mobile stream media server (210), wherein described encoding algorithm, mobile stream media server receive information such as RTP packet port.

4、移动流媒体服务器(210)根据SDP信息中的端口信息打开接收端口,并向综合管理平台(220)通报在线采集终端(201)信息。4. The mobile streaming media server (210) opens the receiving port according to the port information in the SDP information, and notifies the integrated management platform (220) of the online collection terminal (201) information.

5、移动流媒体服务器(210)向采集终端(201)发送操作结果。5. The mobile streaming media server (210) sends the operation result to the collection terminal (201).

6、采集终端(201)分析结果,若成功,则启动采集、编码、打包过程,向移动流媒体服务(210)发送RTP包。6. The collection terminal (201) analyzes the result, if successful, starts the collection, encoding, and packaging process, and sends the RTP packet to the mobile streaming service (210).

移动终端(301)发起播放过程如图3所示:The mobile terminal (301) initiates the playback process as shown in Figure 3:

1、移动终端(301)登录综合管理平台(320)。1. The mobile terminal (301) logs into the integrated management platform (320).

2、从综合管理平台(320)上选择在线采集终端,可以同时选择多个(这样就实现了多点),并对每个在线采集终端指定显示区域。2. Select an online collection terminal from the comprehensive management platform (320), and select several at the same time (multiple points are realized in this way), and specify a display area for each online collection terminal.

3、综合管理平台(320)根据移动终端(301)选定的信息动态生成SMIL脚本。3. The integrated management platform (320) dynamically generates SMIL scripts according to the information selected by the mobile terminal (301).

4、移动终端(301)从综合管理平台(320)上下载SMIL脚本。4. The mobile terminal (301) downloads the SMIL script from the integrated management platform (320).

5、移动终端(301)启动支持SMIL脚本的播放器进行播放,播放器根据SMIL脚本中的Src信息向移动流媒体服务器发起直播请求,接收RTP包,解码并在指定的区域进行显示,达到多点监视的目的。5, the mobile terminal (301) starts the player supporting the SMIL script to play, the player initiates a live broadcast request to the mobile streaming media server according to the Src information in the SMIL script, receives the RTP packet, decodes it and displays it in a designated area, reaching multiple Point monitoring purposes.

会话描述文件内容如表1所示:The content of the session description file is shown in Table 1:

表1Table 1

v=0v=0

o=-143397144 2257390873 IN IP4 192.168.3.185o=-143397144 2257390873 IN IP4 192.168.3.185

s=EESs = EES

c=IN IP4 192.168.3.2c=IN IP4 192.168.3.2

t=0 0t=0 0

m=video 5566 RTP/AVP 96m=video 5566 RTP/AVP 96

b=AS:500b=AS:500

a=rtpmap:96H264/90000a=rtpmap:96H264/90000

a=fmtp:96 profile-level-id=674200;a=fmtp:96 profile-level-id=674200;

sprop-parameter-sets=ZOIAFZZmFiZCAAADAAIAAAMAMwg=,aM48gA==;packetization-mode=1sprop-parameter-sets=ZOIAFZZmFiZCAAADAAIAAAMAMwg=, aM48gA==; packetization-mode=1

其中重点信息如下:The key information is as follows:

1、o=-143397144 2257390873 IN IP4 192.168.3.185:标明采集终端的IP地址为192.168.3.185。1. o=-143397144 2257390873 IN IP4 192.168.3.185: indicates that the IP address of the collection terminal is 192.168.3.185.

2、c=IN IP4 192.168.3.2:指定了流媒体服务器的IP地址为192.168.3.2。2. c=IN IP4 192.168.3.2: The IP address of the streaming media server is specified as 192.168.3.2.

3、m=video 5566 RTP/AVP 96:标明流媒体服务器接收采集终端发送的RTP包的端口:5566。3. m=video 5566 RTP/AVP 96: indicates the port of the streaming media server receiving the RTP packet sent by the collection terminal: 5566.

4、a=rtpmap:96 H264/90000:标明了RTP包的格式。4. a=rtpmap: 96 H264/90000: indicates the format of the RTP packet.

5、sprop-parameter-sets=ZOIAFZZmFiZCAAADAAIAAAMAMwg=,aM48gA==;标明了H.264编码参数信息。5. sprop-parameter-sets=ZOIAFZZmFiZCAAADAAIAAAMAMwg=, aM48gA==; indicates H.264 encoding parameter information.

SMIL脚本示例如表2所示:An example of a SMIL script is shown in Table 2:

表2Table 2

<smil><smil>

   <head><head>

      <layout><layout>

        <root-layout height=″480″width=″640″background-color=″black″/><root-layout height=″480″width=″640″background-color=″black″/>

        <region id=″region_01″left=″0″top=″0″height=″144″width=″176″/><region id="region_01"left="0"top="0"height="144"width="176"/>

    <region id=″region_02″left=″353″top=″289″height=″144″width=″176″/><region id="region_02"left="353"top="289"height="144"width="176"/>

      </layout></layout>

   </head></head>

   <body><body>

      <par><par>

        <video src=″rtsp://192.168.3.2/cap1.sdp″region=″region_01″/><video src=″rtsp://192.168.3.2/cap1.sdp″region=″region_01″/>

        <video src=″rtsp://192.168.3.2/cap2.sdp″region=″region_02″/><video src=″rtsp://192.168.3.2/cap2.sdp″region=″region_02″/>

      </par></par>

   </body></body>

</smil></smil>

其中重点信息解释如下:The key information is explained as follows:

1、<root-layout height=″480″width=″640″background-color=″black″/>:,<root-layout>定义了播放器主窗口的大小。1. <root-layout height="480" width="640" background-color="black"/>: <root-layout> defines the size of the main window of the player.

2、<region id=″region_01″left=″0″top=″0″height=″144″width=″176″/>:指定的第一个显示区域的id、位置及尺寸。2. <region id="region_01"left="0"top="0"height="144"width="176"/>: the id, position and size of the first specified display area.

3、<region id=″region_02″left=″353″top=″289″height=″144″width=″176″/>:指定的第二个显示区域的id、位置及尺寸。3. <region id="region_02"left="353"top="289"height="144"width="176"/>: the id, position and size of the specified second display area.

4、<video src=″rtsp://192.168.3.2/cap1.sdp″region=″region_01″/>:指定发起直播连接的URL地址信息,并将直播结果在第一个区域进行显示。4. <video src=″rtsp://192.168.3.2/cap1.sdp″region=″region_01″/>: Specify the URL address information for initiating the live connection, and display the live result in the first area.

5、<video src=″rtsp://192.168.3.2/cap2.sdp″region=″region_02″/>:指定发起直播连接的URL地址信息,并将直播结果在第二个区域进行显示。5. <video src=″rtsp://192.168.3.2/cap2.sdp″region=″region_02″/>: Specify the URL address information for initiating the live broadcast connection, and display the live broadcast results in the second area.

在以上描述中,采集终端可以将封装的RTP包发送到不同的移动流媒体服务器,同时,移动终端也可以在同一SMIL脚本中发起对不同移动流媒体服务器的直播请求,这样可以大大增加移动终端与移动流媒体服务器的灵活性。In the above description, the acquisition terminal can send the encapsulated RTP packets to different mobile streaming media servers. At the same time, the mobile terminal can also initiate live broadcast requests to different mobile streaming media servers in the same SMIL script, which can greatly increase the number of mobile terminals. Flexibility with mobile streaming servers.

Claims (3)

Translated fromChinese
1、一种利用SMIL技术与移动流媒体技术的移动多点监视方法,其特征在于:1, a kind of mobile multi-point monitoring method utilizing SMIL technology and mobile streaming media technology, is characterized in that:各采集终端采集视频信号,并采用H.264算法对信号进行编码,然后将压缩的码流封装成RTP包发送到移动流媒体服务器,供移动终端使用;Each collection terminal collects video signals, and uses the H.264 algorithm to encode the signals, and then encapsulates the compressed code stream into RTP packets and sends them to the mobile streaming media server for use by mobile terminals;移动终端在SMIL脚本中发起到移动流媒体服务器的多个直播连接,实现在单一屏幕上的多画面显示;根据移动终端的监视需求,综合管理平台动态生成SMIL脚本,移动终端下载此脚本,并根据SMIL脚本中的描述,发起多个到移动流媒体服务器的直播请求,从而实现移动多点监视。The mobile terminal initiates multiple live connections to the mobile streaming media server in the SMIL script to realize multi-screen display on a single screen; according to the monitoring requirements of the mobile terminal, the integrated management platform dynamically generates the SMIL script, and the mobile terminal downloads the script, and According to the description in the SMIL script, initiate multiple live broadcast requests to the mobile streaming media server, thereby realizing mobile multi-point monitoring.2、如权利要求1所述的移动多点监视方法,其特征在于:2. The mobile multi-point surveillance method according to claim 1, characterized in that:①各采集终端采集信号,并进行压缩编码,视频采用H.264编码算法;然后将编码压缩的码流封装成RTP包发送到移动流媒体服务器;① Each collection terminal collects signals, and compresses and encodes them. The video adopts H.264 encoding algorithm; then encapsulates the encoded and compressed code stream into RTP packets and sends them to the mobile streaming media server;②各采集终端将采集、直播信息发布到综合管理平台;② Each collection terminal releases the collection and live broadcast information to the comprehensive management platform;③移动终端访问综合管理平台,选择需要监视的地点,并对显示画面提出需求;③The mobile terminal accesses the comprehensive management platform, selects the location to be monitored, and puts forward requirements for the display screen;④综合管理平台根据移动终端的需求动态生成SMIL脚本,该脚本包含了到移动流媒体服务器的直播请求,并将SMIL脚本传给移动终端;④ The integrated management platform dynamically generates SMIL scripts according to the needs of mobile terminals, which include the live broadcast request to the mobile streaming media server, and transmit the SMIL scripts to the mobile terminals;⑤移动终端播放SMIL脚本,在移动终端上发起到移动流媒体服务器的直播请求,实现移动多点监视。⑤ The mobile terminal plays the SMIL script, and initiates a live broadcast request to the mobile streaming media server on the mobile terminal to realize mobile multi-point monitoring.3、如权利要求2所述的移动多点监视方法,其特征在于:3. The mobile multi-point surveillance method according to claim 2, characterized in that:采集终端采集步骤如下:The collection steps of the collection terminal are as follows:①、采集终端向移动流媒体服务器发起注册,包含用户名和密码;①. The acquisition terminal initiates registration with the mobile streaming media server, including user name and password;②、移动流媒体服务器对采集终端进行接入管理,并将结果返回给采集终端;②. The mobile streaming media server performs access management on the collection terminal, and returns the result to the collection terminal;③、采集终端分析注册响应;若成功,则向移动流媒体服务器发送会话描述文件SDP信息,其中描述了编码算法、移动流媒体服务器接收RTP包端口信息;③. Collect terminal analysis registration response; if successful, send session description file SDP information to mobile streaming media server, which describes encoding algorithm, mobile streaming media server receiving RTP packet port information;④、移动流媒体服务器根据SDP信息中的端口信息打开接收端口,并向综合管理平台通报在线采集终端信息;④. The mobile streaming media server opens the receiving port according to the port information in the SDP information, and notifies the online collection terminal information to the integrated management platform;⑤、移动流媒体服务器向采集终端发送操作结果;⑤. The mobile streaming media server sends the operation result to the collection terminal;⑥、采集终端分析结果,若成功,则启动采集、编码、封包过程,向移动流媒体服务发送RTP包;⑥. Collect the analysis results of the terminal, if successful, start the process of collecting, encoding, and packing, and send RTP packets to the mobile streaming service;移动终端发起播放步骤如下:The mobile terminal initiates the playback steps as follows:①、移动终端登录综合管理平台;①, mobile terminal login integrated management platform;②、从综合管理平台上选择在线采集终端,可以同时选择多个,并对每个在线采集终端指定显示区域;②. Select the online collection terminal from the comprehensive management platform, you can select multiple at the same time, and specify the display area for each online collection terminal;③、综合管理平台根据移动终端选定的信息动态生成SMIL脚本;③. The comprehensive management platform dynamically generates SMIL scripts according to the information selected by the mobile terminal;④、移动终端从综合管理平台上下载SMIL脚本;④. The mobile terminal downloads the SMIL script from the integrated management platform;⑤、移动终端启动支持SMIL脚本的播放器进行播放,播放器根据SMIL脚本中的Src信息向移动流媒体服务器发起直播请求,接收RTP包,解码并在指定的区域进行显示。⑤. The mobile terminal starts the player supporting the SMIL script to play. The player initiates a live broadcast request to the mobile streaming media server according to the Src information in the SMIL script, receives the RTP packet, decodes it, and displays it in the designated area.
CNB2006100181661A2006-01-162006-01-16 A mobile multi-point monitoring method using SMIL technology and mobile streaming media technologyExpired - Fee RelatedCN100442846C (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CNB2006100181661ACN100442846C (en)2006-01-162006-01-16 A mobile multi-point monitoring method using SMIL technology and mobile streaming media technology

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CNB2006100181661ACN100442846C (en)2006-01-162006-01-16 A mobile multi-point monitoring method using SMIL technology and mobile streaming media technology

Publications (2)

Publication NumberPublication Date
CN1812571A CN1812571A (en)2006-08-02
CN100442846Ctrue CN100442846C (en)2008-12-10

Family

ID=36845192

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CNB2006100181661AExpired - Fee RelatedCN100442846C (en)2006-01-162006-01-16 A mobile multi-point monitoring method using SMIL technology and mobile streaming media technology

Country Status (1)

CountryLink
CN (1)CN100442846C (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101854529B (en)*2010-04-302012-01-11第一视频通信传媒有限公司Multi-picture network broadcast method for audience segmentation
CN102547875B (en)*2010-12-302015-12-02中国移动通信集团公司A kind of implementation method of business of broadcasting of gathering and editing, equipment and system
CN103139599B (en)*2011-11-292016-08-24人民网股份有限公司Network multi-image live broadcast system
CN103945174A (en)*2013-01-232014-07-23苏州市伏泰信息科技有限公司Environmental sanitation operation stream media network video monitoring system
WO2016127471A1 (en)*2015-02-102016-08-18沈玉将Data stream control system, data stream control device and terminal

Citations (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2003055219A2 (en)*2001-12-112003-07-03Telefonaktiebolaget Lm Ericsson (Publ.)Method of rights management for streaming media
CN1650631A (en)*2002-05-062005-08-03摩托罗拉公司 Image Content Reconstruction for Different Device Capabilities and Its Method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2003055219A2 (en)*2001-12-112003-07-03Telefonaktiebolaget Lm Ericsson (Publ.)Method of rights management for streaming media
CN1620810A (en)*2001-12-112005-05-25艾利森电话股份有限公司 Rights management method for streaming media
CN1650631A (en)*2002-05-062005-08-03摩托罗拉公司 Image Content Reconstruction for Different Device Capabilities and Its Method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SMIL在移动流媒体内容分发网络中的应用. 何孝富,张培君,俞时权.计算机时代,第2003 No.8期. 2003*

Also Published As

Publication numberPublication date
CN1812571A (en)2006-08-02

Similar Documents

PublicationPublication DateTitle
TWI729997B (en)Transporting coded audio data
CN105338425B (en)A kind of system and method for realizing video seamless switching between multi-screen
CN102104762B (en)Media recording method, equipment and system of IMS (Internet Management Specification) video conference
TWI714602B (en)Middleware delivery of dash client qoe metrics
CN100583880C (en)System for broadcasting multimedia content
CN108769616A (en)A kind of real-time video based on RTSP agreements is without plug-in unit method for previewing and system
WO2008061416A1 (en)A method and a system for supporting media data of various coding formats
WO2011004886A1 (en)Delivering system, method, gateway apparatus and program
JP2009147902A (en) Adaptive multimedia system and method for providing multimedia content and codec to user terminal
WO2008028388A1 (en)A method, system and stream media server for supporting multi audio tracks
CN107529073A (en)The device of the signaling information relevant with content bag consumption is received from content providing device
JP4308555B2 (en) Receiving device and information browsing method
TW201909007A (en) Processing media data using a common descriptor for one of the file format logic boxes
WO2014193996A2 (en)Network video streaming with trick play based on separate trick play files
CN104079870A (en)Video monitoring method and system for single-channel video and multiple-channel audio frequency
CN100442846C (en) A mobile multi-point monitoring method using SMIL technology and mobile streaming media technology
WO2015064383A1 (en)Transmission device, transmission method, reception device, and reception method
CN105007465A (en)Cipher-text H264 video live-broadcasting and on-demand platform based on live555 frame and ffmpeg library
CN1977554A (en)Interactive broadcast system
CN105430510A (en)Video on demand method, gateway, smart terminal and video on demand system
CN112953899A (en)Streaming media distribution system and method supporting multi-audio video streaming protocol
JP2005198313A (en)Digital real-time interactive program system
CN101193105A (en)A media stream transmission/switching method
CN100484091C (en)Real-time transmission, storage and reducing device and method for video information on Internet
CN101938633A (en)Interactive set top box (STB) based implementation method of embedded streaming media play module

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
C14Grant of patent or utility model
GR01Patent grant
CF01Termination of patent right due to non-payment of annual fee

Granted publication date:20081210

Termination date:20150116

EXPYTermination of patent right or utility model

[8]ページ先頭

©2009-2025 Movatter.jp