CN1812571A - Moving multi-point monitoring technique utilizing SMIL technique and moving stream media technique - Google Patents

Abstract

A mobile multipoint monitoring technique utilizing SIMIL technique and mobile stream media technique includes launching multiple live-broadcast connection to stream media server in SIMIL script to realize multipicture display on single screen, generating SIMIL script dynamically by management platform according to monitoring requirement of mobile terminal, downloading said script by mobile terminal and launching multiple live-broadcast request to stream media server according to description of SIMIL script for realizing mobile multipoint monitoring .

Description

A kind of mobile multiple spot surveillance technology that utilizes SMIL technology and mobile flow medium technology

Technical field

The present invention adopts the mobile flow medium technology to realize that mobile multiple spot monitors, is specifically related to video/audio encoding and decoding technique, mobile flow medium technology and SMIL technology.

Background technology

The mobile flow medium technology

The mobile flow medium technology is exactly that continuous image and acoustic information are put on the webserver after overcompression is handled, mobile phone users can be watched, listen to while downloading, and do not need whole multimedia file download by the time to finish the technology that just can watch immediately.In fact the mobile flow medium technology is the product that network audio-video technology and mobile communication technology develop into certain phase, it is to merge the technology that is produced after a lot of network technologies, and it can relate to the multinomial technology such as collection, compression, storage, transmission and network service of stream medium data.

The network transmission protocol of supporting is: real-time fluidisation agreement (RTSP), real-time transport protocol (rtp) and RTCP Real-time Transport Control Protocol (RTCP).The video coding algorithm of supporting: H.263, MPEG4 and H.264; The audio coding algorithm of supporting: AMR, AAC etc.

1, video/audio encoding and decoding technique

H.263 video coding algorithm at present commonly used in the world has, MPEG4 and H.264.Wherein H.264 compare, have following advantage with other existing video encoding standard:

Low code stream (Low Bit Rate): compare with compression technology such as MPEG2 and MPEG4 ASP, under equal picture quality, adopt the data volume after the technique compresses H.264 to have only 1/8 of MPEG2,1/3 of MPEG4.

High-quality image: H.264 continuous, smooth high quality image (DVD quality) can be provided.

Fault-tolerant ability is strong: H.264 wrong essential tool such as solving under the unstable network environment incidental packet loss is provided.

Network-adaptive is strong: H.264 network-adaptive layer (Network Adaptation Layer) is provided, has made H.264 file transmission on heterogeneous networks easily (for example the Internet, CDMA, GPRS, WCDMA, CDMA2000 etc.).

2, SMIL technology

SMIL is a synchronous multimedia integrate language, and it is a mark that a cover has provided and very simple.It is used for regulation multimedia segment (scope that comprises of multimedia has here: audio files, video file, animation, picture, literal etc.) when, somewhere, play in which type of mode.Time synchronizing relation and the space layout of adopting SMIL can describe easily between the various medium concern, be to be used for the integrated multimedia program on the Internet, especially the main language tool of Streaming Media, it can realize the title of video/audio, navigation area and electronic script three synchronously.

Have following advantage: avoid using unified containing file format, simultaneously play multimedia segment at different local (on the servers), layout, multilingual selection support, many bandwidth carried out in whole demonstration select to support.

3, video monitor

Video monitoring system is digital video, computer network communication technology, multimedia technology, the compress technique of uses advanced, realizes the telemonitoring of image, sound.Difference according to the signal of gathering can be divided into analog signal supervision and digital signal supervision.

Along with the development and the arrival in 3G epoch of mobile technology, carry out mobile monitoring by wireless environment and become a kind of trend.Because the mobile environment its own particularity proposes new requirement to code efficiency, network self-adapting etc., also needs to realize the split screen Display Technique simultaneously.H.264 compression efficiency is higher at present, at aspects such as low code check environment and network fault tolerances many advantages are arranged, so mobile monitoring adopts H.264 video coding algorithm; In order to realize the distant property used of portable terminal, consider to utilize the split screen control technology of SMIL, the player of any support SMIL can both realize that the far-end multiple spot shows.

Present existing method is: each acquisition terminal acquired signal is also carried out the video/audio encoding compression to signal, then compressed bit stream is transferred to central monitoring position, is being presented on the terminal by the split screen technology on the central monitoring position.

The shortcoming of existing method is:

1, operating personnel can only monitor at central monitoring position, can't accomplish the visit in any time, any place, can not make fast reaction to some accidents.

2, need in Surveillance center that the medium of configure dedicated receive, processing server, receive the data of acquisition terminal and data are shown.

3, need to realize the split screen Display Technique that software for display is special-purpose, lack versatility and flexibility.

4, the general encoding and decoding technique incompatibility portable terminal that adopts and the transmission of wireless environment.

Summary of the invention

The object of the present invention is to provide the mobile multiple spot surveillance technology of a kind of SMIL of utilization technology and mobile flow medium technology, can solve the constraint that monitors the place, anyone can both carry out multiple spot by portable terminal at any time and any place and monitor.

Technical scheme of the present invention is: the mobile multiple spot surveillance technology of a kind of SMIL of utilization technology and mobile flow medium technology is characterized in that: be initiated to a plurality of live connection of streaming media server in the SMIL script, the many pictures that are implemented on the single screen show; According to the supervision demand of portable terminal, management platform dynamically generates the SMIL script, this script of terminal downloads, and, initiate a plurality of live requests to streaming media server according to the description in the SMIL script, thus realize that mobile multiple spot monitors.

Aforesaid mobile multiple spot surveillance technology is characterized in that:

1. each collection terminal acquired signal, and encode, video adopts H.264 encryption algorithm; Code stream after will encoding then is packaged into the RTP bag and sends to streaming media server;

2. each acquisition terminal will be gathered, live information is published to comprehensive management platform;

3. mobile terminal accessing comprehensive management platform need to select the place that monitors, and display frame is proposed demand;

4. comprehensive management platform dynamically generates the SMIL script according to the demand of portable terminal, and this script has comprised the live request to streaming media server, and the SMIL script is passed to portable terminal;

5. mobile terminal playing SMIL script is initiated to the live request of streaming media server on portable terminal, realizes that mobile multiple spot monitors.

Aforesaid mobile multiple spot surveillance technology is characterized in that:

Acquisition step is as follows:

1., collecting device is initiated registration (comprising username and password) to streaming media server;

2., streaming media server carries out access-in management to collecting device, and the result is returned to acquisition terminal;

3., the response of collecting device analysis registration; If success then sends session description file (SDP information) to streaming media server, information such as encryption algorithm, streaming media server reception RTP bag port have been described wherein;

4., streaming media server is opened receiving port according to the port information in the SDP information, and is circulated a notice of the online acquisition facility information to comprehensive management platform;

5., streaming media server is to collecting device transmit operation result;

6., the collecting device analysis result, if success then starts collection, coding, packing process, send the RTP bag to streaming media service;

It is as follows that portable terminal initiates to play step:

1., portable terminal lands comprehensive management platform;

2., select online collecting device, can select a plurality of (so just having realized multiple spot) simultaneously, and each online acquisition equipment is specified the viewing area from comprehensive management platform;

3., comprehensive management platform dynamically generates the SMIL script according to the selected information of portable terminal;

4., portable terminal is downloaded the SMIL script from comprehensive management platform;

5., portable terminal start to support the player of SMIL script to play, player is initiated live request according to the Src information in the SMIL script to streaming media server, receives the RTP bag, decoding also shows in the zone of appointment.

Principle of the present invention is:

The SMIL technology can realize many pictures Display Technique, is initiated to a plurality of live connection of streaming media server in the SMIL script, and the many pictures that are implemented on the single screen show.In the SMIL script, can specify the relative position of display frame number and each picture.When playing the SMIL script, player adopts distinct methods to show successively according to the displaying contents attribute at first according to frame numbers in the script and location parameter divided frame then.Content displayed can be video, audio frequency, also can be FLASH and text; Content displayed can derive from local file, also can derive from streaming media server.

Content in the SMIL script can derive from streaming media server, by being initiated to the live request of streaming media server in the SMIL script, thereby utilizes SMIL technology and mobile flow medium technology to realize that mobile multiple spot monitors.

The present invention is according to the wireless network self-characteristic, adopted state-of-the-art H.264 video coding algorithm, utilize SMIL can conveniently describe the characteristics of time synchronizing relation and space layout relation between each clock medium,, realized that mobile multiple spot monitors by means of the mobile flow medium server technology.

Advantage of the present invention is:

1, solved the constraint that monitors the place, anyone can both carry out multiple spot by portable terminal at any time and any place and monitor.

2, do not need that specialized media receives, processing server, can be shared and use existing general streaming media server, thus reduce cost.

3, do not need design specialized split screen software for display on portable terminal, the software for display of any support SMIL script can.

4, video coding adopts H.264 encryption algorithm, can obtain satisfied video quality under wireless and low code check environment.

Description of drawings

Fig. 1 is the system framework figure of the embodiment of the invention.

Fig. 2 is the acquisition terminal of the embodiment of the invention and streaming media server, comprehensive management platform interaction figure.

Fig. 3 is the portable terminal of the embodiment of the invention and streaming media server, comprehensive management platform interaction figure.

Embodiment

Describe embodiments of the invention in detail below in conjunction with accompanying drawing.

System framework is as shown in Figure 1: whole system is made up of four parts:

Collecting device (101,102 etc.): acquired signal, signal is encoded.Code stream behind the coding is broken into the RTP bag send to streaming media server.

Streaming media server (110): realize RTSP, RTP, rtcp protocol; Receive the RTP bag that collecting device (101,102 etc.) send; The live request of mobile terminal receive (130,131 etc.).

Comprehensive management platform (120): the access-in management of acquisition terminal; The acquisition terminal Information Statistics; The generation of SMIL file;

Portable terminal (130,131 etc.): support the SMIL file to play; Support RTSP, RTP, rtcp protocol; Support common video/audio decoding algorithm.

Gatherer process is as shown in Figure 2:

1, collecting device (201) is initiated registration (comprising username and password) to streaming media server (210).

2, streaming media server (210) carries out access-in management to collecting device (201), and the result is returned to acquisition terminal.

3, collecting device (201) is analyzed the response of registration; If success then sends session description file (SDP information) to streaming media server (210), information such as encryption algorithm, streaming media server reception RTP bag port have been described wherein.

4, streaming media server (210) is opened receiving port according to the port information in the SDP information, and to comprehensive management platform (220) circular online acquisition equipment (201) information.

5, streaming media server (210) is to collecting device (201) transmit operation result.

6, collecting device (201) analysis result if success then starts collection, coding, packing process, sends the RTP bag to streaming media service (210).

Portable terminal (301) is initiated playing process as shown in Figure 3:

1, portable terminal (301) lands comprehensive management platform (320).

2, select online collecting device from comprehensive management platform (320), can select a plurality of (so just having realized multiple spot) simultaneously, and each online acquisition equipment is specified the viewing area.

3, comprehensive management platform (320) dynamically generates the SMIL script according to the selected information of portable terminal (301).

4, portable terminal (301) is downloaded the SMIL script from comprehensive management platform (320).

5, portable terminal (301) startup supports the player of SMIL script to play, player is initiated live request according to the src information in the SMIL script to streaming media server, receive the RTP bag, decoding also shows in the zone of appointment, reaches the purpose that multiple spot monitors.

The session description file content is as shown in table 1:

Table 1

v＝0

o＝-143397144?2257390873?IN?IP4?192.168.3.185

s＝EES

c＝IN?IP4?192.168.3.2

t＝00

m＝vi?deo?5566?RTP/AVP?96

b＝AS：500

a＝rtpmap：96?H264/90000

a＝fmtp：96?profile-level-id＝674200；

sprop-parameter-sets＝ZOIAFZZmFiZCAAADAAIAAAMAMwg＝，aM48gA＝＝；packetization-mode＝1

a＝x-envivio-verid：0001516B

Wherein keynote message is as follows:

1, o=-143397144 2257390873 IN IP4 192.168.3.185: the IP address of indicating acquisition terminal is 192.168.3.185.

2, c=IN IP4 192.168.3.2: the IP address of having specified streaming media server is 192.168.3.2.

3, m=video 5566 RTP/AVP 96: indicate that streaming media server receives the port of the RTP bag of acquisition terminal transmission: 5566.

4, a=rtpmap:96 H264/90000: the form of having indicated the RTP bag.

5, sprop-parameter-sets=ZOIAFZZmFiZCAAADAAIAAAMAMwg=, aM48gA==; Indicated H.264 coding parameter information.

The SMIL script example is as shown in table 2:

Table 2

<smil>

<head>

<layout>

<root-layout?height＝″480″width＝″640″background-color＝″black″/>

<region?id＝″region_01″left＝″0″top＝″0″height＝″144″width＝″176″/>

<region?id＝″region_02″left＝″353″top＝″289″height＝″144″width＝″176″/>

</layout>

</head>

<body>

<par>

<video?src＝″rtsp：//192.168.3.2/capl.sdp″region＝″region_01″/>

<video?src＝″rtsp：//192.168.3.2/cap2.sdp″region＝″region_02″/>

</par>

</body>

</smil>

Wherein keynote message is explained as follows:

1,＜root-layout height=" 480 " width=" 640 " background-color=" black "/:,＜root-layout〉defined the size of player main window.

2,＜region id=" region_01 " left=" 0 " top=" 0 " height=" 144 " width=" 176 "/: the id of first viewing area of appointment, position and size.

3,＜region id=" region_02 " left=" 353 " top=" 289 " height=" 144 " width=" 176 "/: id, position and the size of second viewing area of appointment.

4,＜video src=" rtsp: // 192.168.3.2/cap1.sdp " region=" region_01 "/: specify the URL address information of initiating live connection, and live result is shown in first zone.

5,＜video src=" rtsp: // 192.168.3.2/cap2.sdp " region=" region_02 "/: specify the URL address information of initiating live connection, and live result is shown in second zone.

In the above description, collecting device can send to different streaming media servers with the RTP bag that breaks into, simultaneously, portable terminal also can be initiated the live request to the various flows media server in same SMIL script, can increase the flexibility of portable terminal and streaming media server so greatly.

Claims (3)

1, a kind of mobile multiple spot surveillance technology that utilizes SMIL technology and mobile flow medium technology is characterized in that:

Be initiated to a plurality of live connection of streaming media server in the SMIL script, the many pictures that are implemented on the single screen show; According to the supervision demand of portable terminal, comprehensive management platform dynamically generates the SMIL script, this script of terminal downloads, and, initiate a plurality of live requests to streaming media server according to the description in the SMIL script, thus realize that mobile multiple spot monitors.

2, mobile multiple spot surveillance technology as claimed in claim 1 is characterized in that:

1. each collection terminal acquired signal, and encode, video adopts H.264 encryption algorithm; Code stream after will encoding then is packaged into the RTP bag and sends to streaming media server;

2. each acquisition terminal will be gathered, live information is published to comprehensive management platform;

3. mobile terminal accessing comprehensive management platform need to select the place that monitors, and display frame is proposed demand;

4. comprehensive management platform dynamically generates the SMIL script according to the demand of portable terminal, and this script has comprised the live request to streaming media server, and the SMIL script is passed to portable terminal;

5. mobile terminal playing SMIL script is initiated to the live request of streaming media server on portable terminal, realizes that mobile multiple spot monitors.

3, mobile multiple spot surveillance technology as claimed in claim 2 is characterized in that:

Acquisition step is as follows:

1., collecting device initiates registration to streaming media server, comprises username and password;

2., streaming media server carries out access-in management to collecting device, and the result is returned to acquisition terminal;

3., the response of collecting device analysis registration; If success then sends session description file-SDP information to streaming media server, encryption algorithm, streaming media server reception RTP bag port information have been described wherein;

4., streaming media server is opened receiving port according to the port information in the SDP information, and is circulated a notice of the online acquisition facility information to comprehensive management platform;

5., streaming media server is to collecting device transmit operation result;

6., the collecting device analysis result, if success then starts collection, coding, packing process, send the RTP bag to streaming media service;

It is as follows that portable terminal initiates to play step:

1., portable terminal lands comprehensive management platform;

2., select online collecting device, can select a plurality ofly simultaneously, and each online acquisition equipment be specified the viewing area from comprehensive management platform;

3., comprehensive management platform dynamically generates the SMIL script according to the selected information of portable terminal;

4., portable terminal is downloaded the SMIL script from comprehensive management platform;

5., portable terminal start to support the player of SMIL script to play, player is initiated live request according to the Src information in the SMIL script to streaming media server, receives the RTP bag, decoding also shows in the zone of appointment.

Images