Background technology
The video traffic in 3G (3rd-Generation, 3G (Third Generation) Moblie technology) epoch has a variety of, and video conference is wherein a kind of.Owing to the reasons such as ability of access way, bearing mode, terminal type and terminal place network, cause that the media delivery on each node, all directions, media formats etc. require far from each other in the video conference in the video conference.And, in the whole video conference process, exist because the situation that the network condition of participant terminal changes appears in a variety of causes.
As shown in Figure 1, to a 3G video conference, in a certain period, terminal A and direct-connected with it VIG (Video Interworking Gateway, Video Interworking Gateway) network condition between good (the big and network stabilization of bandwidth), the sound of terminal A, video, Streaming Media coding/decoding capability are general and expressive force terminal A self is general, support limited sound, video, stream media format, only can support CIF (Common Intermediate Format as maximum, a kind of standardized images form, resolution is: the 352*288 pixel) video.
Network condition between terminal B and the direct-connected with it VIG general (bandwidth general and exist network congestion situation), but the sound of terminal B, video, the Streaming Media coding/decoding capability is powerful and the expressive force of terminal B self is good, support multiple sound, video, stream media format, can support 16CIF (16-times Common Intermediate Format as maximum, a kind of standardized images form, resolution is: the 1408*1152 pixel) video.
Compare with preceding two terminals, network condition between terminal C and the direct-connected with it VIG the poorest (network bandwidth is little and fluctuation is big), and the sound of terminal C, video, Streaming Media coding/decoding capability are not strong and expressive force terminal C self is general, only support very limited sound, video, stream media format, only support that as maximum (resolution is QCIF: the 176*144 pixel) video for Quarter Common Intermediate Format, a kind of standardized images form.
Suppose that earlier each terminal direct-connected VIG and the network condition between the MCU (Multi Control Unit, multipoint control unit) are good.Because the initiator of video conference can be any terminal, here supposition terminal A is the initiator earlier, terminal B and C add meeting, before meeting begins, each terminal need with the sound of self, video, Streaming Media coding/decoding capability collection and and separately the network condition between the VIG report MCU.Network condition and ability information that MCU inserts according to terminal for each terminal calculates acceptable complete media capability collection, and are broadcast to the VIG of terminal correspondence with complete media capability collection, and each VIG preserves the complete media capability collection of each self terminal in this locality.For each terminal, there is a current media ability each period of meeting (comprising the initial period), each VIG be exactly by this current media ability to direct-connected terminal carry out operations such as audio frequency and video multiplex/demultiplex, code conversion, the media information of terminal is reported MCU and transmits the media information that MCU comes to terminal.
Carry out in the process in meeting, because the influence of various external conditions, network condition between participant terminal (as portable terminal) and the direct-connected with it VIG can change, as the network condition variation, to cause adopting some to prevent that the smoothing technique of network jitter from can't keep the original video conference quality of terminal (the current media ability drop of terminal), or when network conditions turn good, in the scope that terminal capabilities set is supported, the video conference quality can be risen to higher level (the current media ability of terminal rises), and in present video conference, can't be when the network condition variation, keep an acceptable media quality, when network conditions turn good, can't promote existing media quality.
Summary of the invention
The technical problem to be solved in the present invention provides conversion method, system and the application server of media capability in a kind of video conference, and application server triggers the participant terminal is carried out the conversion of media capability in the time of can changing in the network condition of participant terminal.
For solving the problems of the technologies described above, the conversion method of media capability in a kind of video conference of the present invention comprises:
Application server determines whether the network condition of participant terminal changes, and the current network conditions and the media capability collection of the participant terminal that network condition is changed are notified to multipoint control unit.
Further, described application server is determined whether the network condition of participant terminal changes and is comprised:
When the number of times that described application server changes in the network condition of described participant terminal to report starts threshold value greater than timer, be described participant starting terminal network condition watchdog timer;
Whether described application server judges number of times that the network condition of described participant terminal to report changes greater than monitoring threshold in the timing of described network condition watchdog timer, if greater than, determine that then the network condition of described participant terminal changes.
Further, also comprise:
Described multipoint control unit is according to described current network conditions and media capability collection, determine the complete media capability collection of participant terminal under current network conditions that described network condition changes, described complete media capability collection is notified to the Video Interworking Gateway of the participant terminal correspondence that described network condition changes;
Described Video Interworking Gateway is concentrated the current media ability of selecting renewal from described complete media capability, and carries out the media capability switching with the participant terminal that described network condition changes.
Further, the participant terminal that changes of described Video Interworking Gateway and described network condition is carried out media capability and is switched and comprise:
Described participant terminal stops on the up media channel and sends up Media Stream to described Video Interworking Gateway, and described Video Interworking Gateway stops on the descending media channel to described participant terminal generation downlink media stream;
Described participant terminal is applied for up media channel and descending media channel again to described Video Interworking Gateway;
The up media channel that the described participant terminal of described Video Interworking Gateway is applied for again go into the current media ability that media capability in media parameter is set to described renewal, again Shen Qing descending media channel goes out the current media ability that media capability in media parameter is set to described renewal, again other parameters of Shen Qing up media channel and descending media channel are set to identically with descending media channel with former up media channel, and discharge former up media channel and former descending media channel.
Further, described participant terminal periodically to described application server report and Video Interworking Gateway between network condition.
Further, after described multipoint control unit is notified to the Video Interworking Gateway of the participant terminal correspondence that described network condition changes with described complete media capability collection, also, notify described other participant terminals participant terminal that described network condition changes to carry out medium and switch by the Video Interworking Gateway of other participant terminal correspondence in the video session.
Further, a kind of application server comprises: network condition determining unit and information transmitting unit, wherein:
Described network condition determining unit is used for determining whether the network condition of participant terminal changes;
Described information transmitting unit, the current network conditions and the media capability collection that are used for participant terminal that network condition is changed are notified to multipoint control unit.
Further, also comprise network information receiving element, wherein:
Described network information receiving element is used to receive the network condition of participant terminal to report;
Described network condition determining unit comprises: timer control sub unit and network state change judgment sub-unit;
Described timer control sub unit when being used for number of times that the network condition at described participant terminal to report changes and starting threshold value greater than timer, is described participant starting terminal network condition watchdog timer;
Described network state changes judgment sub-unit, be used in the timing of described network condition watchdog timer, whether judge number of times that the network condition of described participant terminal to report changes greater than monitoring threshold, if greater than, determine that then the network condition of described participant terminal changes.
Further, the converting system of media capability in a kind of video conference comprises: application server, wherein:
Described application server is used for determining whether the network condition of participant terminal changes, and the current network conditions and the media capability collection of the participant terminal that network condition is changed are notified to multipoint control unit.
Further, also comprise: multipoint control unit and Video Interworking Gateway, wherein:
Described multipoint control unit, be used for according to described current network conditions and media capability collection, determine the complete media capability collection of participant terminal under current network conditions that described network condition changes, described complete media capability collection is notified to the Video Interworking Gateway of the participant terminal correspondence that described network condition changes;
Described Video Interworking Gateway is used for concentrating the current media ability of selecting renewal from described complete media capability, and carries out the media capability switching with the participant terminal that described network condition changes.
In sum, the present invention is in multipart video-meeting, whether the network condition terminal of determining the participant terminal by application server changes, thereby realize adjusting the current media ability according to participant terminal current network condition and media capability collection, carrying out smoothly of assurance video conference that can be effective and real-time farthest guarantees user's experience simultaneously.
Embodiment
VIG and MCU are under the control of application server (AppServer) in the present embodiment, according to the network condition between the media capability of each terminal and each terminal and the direct-connected with it VIG, the media capability that uses between decision VIG and the terminal carries out the transmitted in both directions of medium.When the network condition between terminal and the direct-connected with it VIG descended, the media capability by between timely adjustment VIG and the terminal guaranteed professional normally carrying out and user experience; When the network condition between terminal and the direct-connected with it VIG rises,, improve user's experience by adjusting the media capability between VIG and the terminal.
Each participant terminal needs dynamically to report and the network condition between the VIG separately to application server every certain time length in the present embodiment, corresponding each terminal of application server is set a network condition and is reported timer, in the timing of this timer, change if determine the network condition between participant terminal and the direct-connected with it VIG, the network condition between terminal and the VIG is issued to MCU by Application Control Server.
Each participant terminal logically directly links to each other with a VIG, and VIG is subjected to the control of MCU, and MCU is subjected to the control of application server.The Media Stream that the VIG receiving terminal sends also is forwarded to MCU, and the medium that forwarding is come from MCU flow to terminal.Simultaneously, in transmission course, according to requirements of service carry out necessary media conversion, wherein, comprise the conversion of one or more aspects such as sound, video media form, code check and resolution sizes.
At the video conference initial phase, each participant terminal need report separately and network condition between the VIG to MCU by application server, and the media capability collection that comprises all sounds that terminal self supported, video, Streaming Media coding/decoding capability.MCU issues the complete media capability collection of the network condition of each terminal and the terminal that process calculates to corresponding VIG, and VIG preserves in this locality.Each VIG concentrates the current media ability of selecting from complete media capability, the current media ability is the current media capability that is using between participant terminal and the VIG, in the video conference process, any one period, each VIG has a current media ability with corresponding participant terminal, and the current media ability comprises that all properties of the Media Stream on the uplink and downlink direction describes.Media capability comprises media formats, code check and the resolution dimensions of terminal to report to VIG, mails to media formats, code check and the resolution dimensions etc. of terminal from VIG.
Above-mentioned complete media capability collection is meant, MCU is according to the network condition between participant terminal and the VIG, the media capability of all sounds of being supported from the participant terminal, video, Streaming Media coding/decoding capability is concentrated, calculate under current network conditions, the set of the media capability that the participant terminal can be used.
In the process of video conference, the also possible deviation that may improve of the network condition between participant terminal and the direct-connected VIG is that example describes with network conditions turn good and variation respectively below.
Suppose that in the video conference process network condition between terminal A and the direct-connected with it VIG1 is variation for a certain reason, cause terminal A to descend to the media quality that VIG1 sends, it is discontinuous etc. flower screen, sound to occur as image.
As shown in Figure 2, the conversion method of media capability in the video conference of present embodiment comprises:
Step 201: terminal A is periodically to application server report network situation;
Step 202: when the number of times of terminal A report network variation started threshold value greater than timer, application server started a network condition watchdog timer for terminal A;
Step 203: application server is in the timer timing, judge that the normal number of times of network condition that terminal A reports is lower than when monitoring threshold values, when the timer timing arrives, application server sends switching controls message, the media capability collection of carried terminal A and terminal A and the direct-connected with it current network condition information of VIG in message to MCU;
Step 204:MCU calculates the complete media capability collection under the current network conditions according to the media capability collection of terminal A and current network condition information (variation), and should complete media capability collection and relevant information be handed down to VIG1;
Step 205:VIG1 concentrates the current media ability of selecting renewal from the complete media capability under the current network conditions, and carries out the media capability switching with terminal A.
VIG1 and terminal A carry out the step that media capability switches and comprise in step 205:
A) terminal A stops at up media channel and sends up Media Stream to VIG1, but VIG1 does not discharge corresponding up media channel resource;
B) VIG1 stops at descending media channel and sends downlink media stream to terminal A, but does not discharge corresponding descending media channel resource;
C) terminal A is to the required up media channel of the new application of VIG1, for up media channel, go into to media parameter other parameter except that media capability to remain unchanged, go into the current media ability after the media capability of media parameter is set to upgrade, go out to media parameter and former passage to remain unchanged;
D) terminal A is to the required descending media channel of the new application of VIG1, for descending media conversion passage, go into to media parameter and former passage to remain unchanged, go out to media parameter other parameter except that media capability to remain unchanged, go out the current media ability after the media capability of media parameter is set to upgrade;
The descending media channel of new application directly continue the terminal B that comes from MCU and the Media Stream of terminal C; Media Stream to terminal B and terminal C is changed by the media capability after upgrading, and the Media Stream after the conversion outputs to terminal A by raw parameter.
E) VIG1 discharges the resource of former uplink and downlink media channel;
F) VIG1 and terminal A begin the transmission and the conversion of Media Stream at new uplink and downlink media channel.
MCU is after issuing complete media capability collection to VIG1, also by VIG2 and VIG3 notice terminal B and terminal C, terminal A is pointed out the user by terminal B and C because the network condition variation need be carried out the medium switching.
Whole handoff procedure is finished, and the media capability after the renewal becomes the current media ability between terminal A and the VIG1.The two-way media of terminal A temporary transient interruption that fail to be convened for lack of a quorum in the handoff procedure, the Media Stream that terminal B and terminal C go up counterpart terminal A also can temporarily interrupt, and it is unaffected that terminal B goes up the Media Stream of counterpart terminal C, and it is also unaffected that terminal C goes up the Media Stream of counterpart terminal B.Concerning all affected terminals, whole handoff procedure was controlled in one second.
As shown in Figure 3, in the video conference process, the network condition between terminal C and the direct-connected with it VIG3 improves for a certain reason, and in terminal C media capability collection scope, there is the space of rising in media quality between VIG3 and the terminal C.
With reference to figure 3, the conversion method of media capability in the video conference of present embodiment comprises:
Step 301: terminal C is periodically to application server report network situation;
Step 302: application server is received the network condition message that terminal C regularly reports, when the number of times of receiving the network conditions turn good that terminal C reports starts threshold value greater than timer, for terminal C starts a network condition watchdog timer;
Step 303: application server is in the timing length scope of timer, be higher than monitoring threshold if receive the number of times of the network conditions turn good that terminal C reports, when the timer timing reaches, issue switching controls message and give MCU, the media capability of carried terminal C set current network conditions information in the message;
Step 304:MCU calculates the complete media capability collection under the present network condition according to media capability collection and the current network conditions of terminal C, and should complete media capability collection and relevant information be handed down to VIG3;
Step 305:VIG3 concentrates the current media ability of selecting renewal from the complete media capability under the current network conditions, and carries out the media capability switching with terminal C.
VIG3 and terminal C carry out the step that media capability switches and comprise in step 305:
A) terminal C stops at up media channel and sends up Media Stream to VIG3, but VIG3 does not discharge corresponding up media channel resource;
B) VIG3 stops at descending media channel and sends downlink media stream to terminal C, but does not discharge corresponding descending media channel resource;
C) terminal C is to the required up media channel of the new application of VIG3, for up media channel, go into to media parameter other parameter except that media capability to remain unchanged, go into the current media ability after the media capability of media parameter is set to upgrade, go out to media parameter and former passage to remain unchanged;
D) terminal C is to the required descending media channel of the new application of VIG3, for descending media conversion passage, go into to media parameter and former passage to remain unchanged, go out to media parameter other parameter except that media capability to remain unchanged, go out the current media ability after the media capability of media parameter is set to upgrade;
New descending media channel directly continue former terminal A that comes from MCU and the Media Stream of terminal B; Media Stream to terminal A and terminal B is changed by the current media ability of upgrading, and the Media Stream after the conversion is pressed the raw parameter output medium to next jumping or far-end.
E) VIG3 discharges the resource of former uplink and downlink media channel;
F) VIG3 and terminal C begin the transmission and the conversion of Media Stream at new uplink and downlink media channel.
MCU is after issuing complete media capability collection to VIG3, also by VIG1 and VIG2 notice terminal A and terminal B, terminal C is because network conditions turn good need be carried out the medium switching.
The two-way media of terminal C fails to be convened for lack of a quorum and temporarily interrupts in the handoff procedure, and the Media Stream of terminal A and the last counterpart terminal C of terminal B also can temporarily interrupt, the Media Stream of the last counterpart terminal B of terminal A is unaffected, the Media Stream of the last counterpart terminal A of terminal B is also unaffected, concerning all affected terminals, whole handoff procedure was controlled in one second.
Please refer to Fig. 1, the system of present embodiment comprises: application server, Video Interworking Gateway and multipoint control unit, wherein:
Application server is used for determining whether the network condition of participant terminal changes, and the current network conditions and the media capability collection of the participant terminal that network condition is changed are notified to multipoint control unit.
As shown in Figure 4, application server comprises: network information receiving element, network condition determining unit and information transmitting unit:
Network information receiving element is used to receive the network condition of participant terminal to report;
The network condition determining unit is used for determining whether the network condition of participant terminal changes;
Information transmitting unit, the current network conditions and the media capability collection that are used for participant terminal that network condition is changed are notified to multipoint control unit.
The network condition determining unit comprises: timer control sub unit and network state change judgment sub-unit; The timer control sub unit when being used for number of times that the network condition at the participant terminal to report changes and starting threshold value greater than timer, is participant starting terminal network condition watchdog timer;
Network state changes judgment sub-unit, be used in the timing of network condition watchdog timer, whether judge number of times that the network condition of participant terminal to report changes greater than monitoring threshold, if greater than, determine that then the network condition of participant terminal changes.
Multipoint control unit, be used for according to current network conditions and media capability collection, determine the complete media capability collection of participant terminal under current network conditions that network condition changes, complete media capability collection is notified to the Video Interworking Gateway of the participant terminal correspondence that network condition changes; Also, notify other participant terminals that participant terminal network situation changes to carry out medium and switch by the Video Interworking Gateway of other participant terminal correspondence in the video session.
Video Interworking Gateway is used for concentrating the current media ability of selecting renewal from complete media capability, and carries out the media capability switching with the participant terminal that network condition changes.
The participant terminal that Video Interworking Gateway and network condition change is carried out the media capability switching and is comprised:
The participant terminal stops on the up media channel and sends up Media Stream to Video Interworking Gateway, and Video Interworking Gateway stops on the descending media channel to participant terminal generation downlink media stream;
The participant terminal is applied for up media channel and descending media channel again to Video Interworking Gateway;
The up media channel that Video Interworking Gateway participant terminal is applied for again go into the current media ability that the media capability in media parameter is set to upgrade, again Shen Qing descending media channel goes out the current media ability that the media capability in media parameter is set to upgrade, again other parameters of Shen Qing up media channel and descending media channel are set to identically with descending media channel with former descending media channel, and discharge former up media channel and former descending media channel.
Obviously, those skilled in the art should be understood that, above-mentioned each module of the present invention, each step can realize with the general calculation device, they can concentrate on the single calculation element, perhaps be distributed on the network that a plurality of calculation element forms, alternatively, they can be realized with the executable program code of calculation element, thereby, they can be stored in the storage device and carry out by calculation element, perhaps they are made into each integrated circuit modules respectively, perhaps a plurality of modules or the step with them is made into the single integrated circuit module and realizes.Like this, the present invention is not restricted to any specific hardware and software combination.
The above is embodiments of the invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.Within the spirit and principles in the present invention all, any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.