CN102893603B - Processing method, device and communication system for a video conference - Google Patents
Processing method, device and communication system for a video conferenceDownload PDFInfo
- Publication number
- CN102893603B CN102893603BCN201180003293.3ACN201180003293ACN102893603BCN 102893603 BCN102893603 BCN 102893603BCN 201180003293 ACN201180003293 ACN 201180003293ACN 102893603 BCN102893603 BCN 102893603B
- Authority
- CN
- China
- Prior art keywords
- terminal
- conference
- video
- media
- list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
- H04L65/4038—Arrangements for multi-party communication, e.g. for conferences with floor control
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
Translated fromChineseDescription
Translated fromChinese技术领域technical field
本发明涉及通信技术领域，具体涉及一种视频会议的处理方法、装置和通信系统。The present invention relates to the technical field of communication, in particular to a video conference processing method, device and communication system.
背景技术Background technique
在全球经济迅猛发展，视频会议系统已经日渐成为企业和个人日常工作的基本工具。With the rapid development of the global economy, the video conferencing system has gradually become a basic tool for the daily work of enterprises and individuals.
视频会议系统通过媒体资源服务器(MRS，Media Resource Server)和每个与会终端的音视频互通，并对所有与会者的音视频媒体进行处理，例如多方混音、编解码转换等。同一个会议中，当接收媒体流的终端与发送媒体流的对端终端采用了不同速率，或采用不同的视频协议时，MRS需要进行媒体流的转换，首先对发送方发送的媒体流进行解码，再按接收方的协议和速率对解码后的媒体流重新编码后发送给接收方，此过程称为速率或协议的适配。每适配一类终端将会消耗一路适配资源，所以，如果终端类型越多，消耗的适配资源也就越多。The video conferencing system communicates with the audio and video of each participant terminal through the media resource server (MRS, Media Resource Server), and processes the audio and video media of all participants, such as multi-party audio mixing, codec conversion, etc. In the same conference, when the terminal receiving the media stream and the peer terminal sending the media stream adopt different rates, or use different video protocols, MRS needs to convert the media stream, and first decode the media stream sent by the sender , and then re-encode the decoded media stream according to the protocol and rate of the receiver and send it to the receiver. This process is called rate or protocol adaptation. Each adaptation type of terminal will consume one channel of adaptation resources, so if there are more terminal types, more adaptation resources will be consumed.
为了节省适配资源，现有技术中常常对与会终端的类型和媒体能力进行限制，但是，随着经济和科技的发展，终端类型和媒体能力的也越来越多样化，对终端类型和媒体能力进行限制，显然会大大降低用户体验，以及不利于扩大视频会议系统的适用性，如何让更多不同类型的终端以及支持不同类型媒体能力的终端接入同一个视频会议中的同时，尽可能节省适配资源，已经成了一个备受关注的问题。In order to save adaptation resources, the existing technology often restricts the types and media capabilities of participating terminals. However, with the development of economy and technology, terminal types and media capabilities are becoming more and more diverse. Limiting the capabilities will obviously greatly reduce the user experience, and it is not conducive to expanding the applicability of the video conferencing system. How to allow more terminals of different types and terminals that support different types of media capabilities to access the same video conference, as much as possible Saving adaptation resources has become a concern.
发明内容Contents of the invention
本发明实施例提供一种视频会议的处理方法、装置和通信系统，可以在不限制终端类型和媒体能力的同时，减少媒体流的适配转换，以节省适配资源。Embodiments of the present invention provide a video conference processing method, device, and communication system, which can reduce adaptation conversion of media streams without restricting terminal types and media capabilities, so as to save adaptation resources.
一种视频会议的处理方法，包括：A method for processing a video conference, comprising:
接收会议发起者发送的会议发起请求；Receive the meeting initiation request sent by the meeting initiator;
根据所述会议发起请求创建会议，并确定终端档次列表，所述终端档次列表包括一个或多个终端档次，每个终端档次对应一组用于定义音视频通话的媒体格式的音视频参数；Create a meeting according to the meeting initiation request, and determine a terminal profile list, the terminal profile list includes one or more terminal profiles, each terminal profile corresponds to a group of audio and video parameters used to define the media format of the audio and video call;
获取与会终端的媒体格式集；Obtain the media format set of the participating terminals;
根据所述终端档次列表和媒体格式集进行音视频参数协商，以确定终端档次；Negotiating audio and video parameters according to the terminal profile list and media format set to determine the terminal profile;
根据确定的终端档次与与会终端建立会议通话。Establish a conference call with the participating terminals according to the determined terminal grade.
可选的，该视频会议的处理方法还可以包括：Optionally, the video conference processing method may also include:
根据所述终端档次列表预留适配资源；reserving adaptation resources according to the terminal class list;
在会议通话的过程中，利用预留的适配资源为不同终端档次之间的互通进行媒体适配转换。During the conference call, the reserved adaptation resources are used to perform media adaptation conversion for intercommunication between different terminal levels.
一种视频会议的处理设备，包括：A processing device for a video conference, comprising:
接收单元，用于接收会议发起者发送的会议发起请求；a receiving unit, configured to receive a conference initiation request sent by a conference initiator;
处理单元，用于根据接收单元接收到的会议发起请求创建会议，并确定终端档次列表，所述终端档次列表包括一个或多个终端档次，每个终端档次对应一组用于定义音视频通话的媒体格式的音视频参数；The processing unit is configured to create a conference according to the conference initiation request received by the receiving unit, and determine a terminal profile list, the terminal profile list includes one or more terminal profiles, and each terminal profile corresponds to a set of audio and video calls. Audio and video parameters of the media format;
获取单元，用于获取与会终端的媒体格式集；an acquisition unit, configured to acquire the media format set of the participating terminals;
协商单元，用于根据处理单元确定的终端档次列表和获取单元获取到的媒体格式集进行音视频参数协商，以确定终端档次；A negotiating unit, configured to negotiate audio and video parameters according to the terminal class list determined by the processing unit and the media format set acquired by the acquisition unit, so as to determine the terminal class;
建立单元，用于根据协商单元确定的终端档次与与会终端建立会议通话。The establishing unit is configured to establish a conference call with the participating terminals according to the terminal class determined by the negotiating unit.
此外，可选的，该视频会议的处理设备还可以包括预留单元和适配单元；In addition, optionally, the video conference processing device may also include a reservation unit and an adaptation unit;
预留单元，用于根据处理单元确定的终端档次列表预留适配资源；a reservation unit, configured to reserve adaptation resources according to the terminal profile list determined by the processing unit;
适配单元，用于在会议通话的过程中，利用预留单元预留的适配资源为不同终端档次之间的互通进行媒体适配转换。The adaptation unit is configured to use the adaptation resources reserved by the reservation unit to perform media adaptation conversion for intercommunication between different terminal levels during the conference call.
一种视频会议系统，包括本发明实施例提供的任一种视频会议的处理设备。A video conference system includes any video conference processing device provided by the embodiments of the present invention.
本发明实施例采用为每一种媒体格式设定对应的终端档次，然后根据终端档次列表和媒体格式集进行音视频参数协商来确定终端档次，从而要求与会终端采用某一种媒体格式，以减少媒体流的适配转换，而对于无法采用同一种媒体格式的与会终端，才进行媒体适配转换，从而从整体上减少了适配资源的消耗。也就是说，采用该方案，可以在保证各种终端类型和媒体能力的与会终端都能接入到同一个会议中的同时，节省媒体适配资源。In the embodiment of the present invention, a corresponding terminal class is set for each media format, and then the terminal class is determined by negotiating audio and video parameters according to the terminal class list and the media format set, thereby requiring the participating terminals to adopt a certain media format to reduce The adaptation conversion of the media stream, and the media adaptation conversion is only performed for the participating terminals that cannot adopt the same media format, thereby reducing the consumption of adaptation resources as a whole. That is to say, by adopting this solution, media adaptation resources can be saved while ensuring that participating terminals of various terminal types and media capabilities can access the same conference.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without creative work.
图1是本发明实施例提供的视频会议的处理方法的流程图；FIG. 1 is a flowchart of a video conference processing method provided by an embodiment of the present invention;
图2a是本发明实施例提供的视频会议的处理方法的场景示意图；FIG. 2a is a schematic diagram of a scene of a video conference processing method provided by an embodiment of the present invention;
图2b是本发明实施例提供的视频会议的处理方法的另一流程图；Fig. 2b is another flow chart of the video conference processing method provided by the embodiment of the present invention;
图3是本发明实施例提供的视频会议的处理方法的又一流程图；Fig. 3 is another flow chart of the video conference processing method provided by the embodiment of the present invention;
图4a是本发明实施例提供的视频会议的处理设备的结构示意图；FIG. 4a is a schematic structural diagram of a video conference processing device provided by an embodiment of the present invention;
图4b是本发明实施例提供的视频会议的处理设备的结构示意图。Fig. 4b is a schematic structural diagram of a video conference processing device provided by an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present invention.
本发明实施例提供一种视频会议的处理方法、装置和通信系统。以下分别进行详细说明。Embodiments of the present invention provide a video conference processing method, device and communication system. Each will be described in detail below.
实施例一、Embodiment one,
本实施例将从视频会议的处理设备的角度进行描述，其中，该视频会议的处理设备可以包括应用服务器(AS，Application Server)和媒体资源服务器(MRS，Media Resource Server)。This embodiment will be described from the perspective of a video conference processing device, where the video conference processing device may include an application server (AS, Application Server) and a media resource server (MRS, Media Resource Server).
一种视频会议的处理方法，包括：接收会议发起者发送的会议发起请求；根据该会议发起请求创建会议，并确定终端档次列表，其中，终端档次列表包括终端档次，每个终端档次对应一组用于定义音视频通话的媒体格式的音视频参数；获取与会终端的媒体格式集；根据该确定的终端档次列表和获取到的媒体格式集进行音视频参数协商，以确定终端档次；根据确定的终端档次与与会终端建立会议通话。A method for processing a video conference, comprising: receiving a conference initiation request sent by a conference initiator; creating a conference according to the conference initiation request, and determining a terminal grade list, wherein the terminal grade list includes terminal grades, and each terminal grade corresponds to a group The audio and video parameters used to define the media format of the audio and video call; obtain the media format set of the participating terminals; perform audio and video parameter negotiation according to the determined terminal grade list and the obtained media format set to determine the terminal grade; according to the determined The terminal class establishes a conference call with the participating terminals.
参见图1，具体流程可以如下：Referring to Figure 1, the specific process can be as follows:
101、接收会议发起者发送的会议发起请求；101. Receive a meeting initiation request sent by a meeting initiator;
例如，具体可以接收会议发起者发送的预定会议发起请求或立即会议发起请求。其中，会议发起者具体可以为终端或视频会议的处理设备中的会议发起模块。For example, it may specifically receive a scheduled meeting initiation request or an immediate meeting initiation request sent by the meeting initiator. Wherein, the conference initiator may specifically be a terminal or a conference initiation module in a video conference processing device.
其中，该会议发起请求可以指定本次会议使用的终端档次列表，或者，也可以指定参加本次会议的与会终端列表，即步骤101具体可以采用如下任意一种方式：Wherein, the meeting initiation request can specify the list of terminal grades used in this meeting, or can also specify the list of participating terminals participating in this meeting, that is,
(1)接收会议发起者发送的携带第一指示信息的会议发起请求，其中，第一指示信息指示本次会议使用的终端档次列表；(1) receiving a conference initiation request carrying first indication information sent by the conference initiator, wherein the first indication information indicates a list of terminal grades used in this conference;
其中，终端档次列表包括至少一个(即一个或多个)终端档次，每个终端档次对应一组音视频参数，比如语音编解码、视频编解码、分辨率和带宽等参数，这些参数可以精确地定义音视频通话的媒体格式，也就是说，每个终端档次对应一组用于定义音视频通话的媒体格式的音视频参数。Wherein, the terminal profile list includes at least one (that is, one or more) terminal profiles, and each terminal profile corresponds to a set of audio and video parameters, such as voice codec, video codec, resolution and bandwidth parameters, and these parameters can be accurately Define the media format of the audio and video call, that is, each terminal class corresponds to a set of audio and video parameters used to define the media format of the audio and video call.
需说明的是，该第一指示信息可以包括终端档次列表的具体内容，也可以只包括一个第一标识。如果只包括一个第一标识的话，则视频会议的处理设备接收到该第一标识后，根据该第一标识查找预置的第一对应表，从而获得相应的终端档次列表；其中，第一对应表中保存着第一标识和终端档次列表的对应关系。It should be noted that the first indication information may include specific content of the terminal profile list, or may only include a first identifier. If only one first identification is included, after receiving the first identification, the processing device of the video conference searches the preset first correspondence table according to the first identification, so as to obtain the corresponding list of terminal grades; wherein, the first correspondence The corresponding relationship between the first identifier and the terminal grade list is stored in the table.
(2)接收会议发起者发送的携带第二指示信息的会议发起请求，其中，第二指示信息指示参加本次会议的与会终端列表，即第二指示信息指示参与本次会议的终端有哪些终端。(2) Receive a conference initiation request carrying second indication information sent by the conference initiator, wherein the second indication information indicates a list of participating terminals participating in the meeting, that is, the second indication information indicates which terminals are the terminals participating in the meeting .
当然，除了以上所列举的两种方式之外，终端档次列表还可以通过其他方式来指定，在此不再赘述。Of course, in addition to the two methods listed above, the terminal class list can also be specified in other ways, which will not be repeated here.
此外，由于视频会议可以有两路视频流，一路是主视频流，用于显示与会者的，另一路是辅视频流，用来共享桌面，例如进行幻灯片共享等等，所以，终端档次列表也可以分别针对主视频流和辅视频流进行指定，例如，可以定义一到多个终端的主视频流终端档次列表，与此同时，还可以定义一到多个终端的辅视频流终端档次列表；或者，也可以定义某个终端档次列表同时适用于主视频流和辅视频流，在此不再赘述。In addition, since a video conference can have two video streams, one is the main video stream, which is used to display the participants, and the other is the auxiliary video stream, which is used to share the desktop, such as slide sharing, etc. Therefore, the list of terminal grades It can also be specified for the main video stream and auxiliary video stream respectively. For example, one or more terminal grade lists of the main video stream can be defined. At the same time, one or more terminal grade lists of the secondary video stream can also be defined. ; Alternatively, it is also possible to define a terminal profile list applicable to both the primary video stream and the secondary video stream, which will not be repeated here.
102、根据步骤101中接收到的会议发起请求创建会议，并确定终端档次列表；例如，具体可以如下：102. Create a conference according to the conference initiation request received in
(1)如果在步骤101中接收到的是携带第一指示信息的会议发起请求，则此时，根据会议发起请求创建会议，并确定终端档次列表具体可以为：根据该会议发起请求创建会议，并根据第一指示信息确定终端档次列表。(1) If the meeting initiation request carrying the first indication information is received in
比如，如果第一指示信息包括了终端档次列表的具体内容，则直接将该终端档次列表的具体内容作为确定的终端档次列表；如果第一指示信息只包括第一标识，则视频会议的处理设备接收到该第一标识后，根据该第一标识查找预置的第一对应表，从而获得相应的终端档次列表；其中，第一对应表中保存着第一标识和终端档次列表的对应关系。For example, if the first indication information includes the specific content of the terminal profile list, then directly use the specific content of the terminal profile list as the determined terminal profile list; if the first indication information only includes the first identification, the video conference processing device After receiving the first identification, look up the preset first correspondence table according to the first identification to obtain the corresponding terminal profile list; wherein, the first correspondence table stores the correspondence between the first identification and the terminal profile list.
(2)如果在步骤101中接收到的是携带第二指示信息的会议发起请求，则根据会议发起请求创建会议，并确定终端档次列表具体可以为：根据该会议发起请求创建会议，并根据第二指示信息与预保存的与会终端的媒体能力计算出终端档次列表。(2) If in step 101 a conference initiation request carrying the second indication information is received, then create a conference according to the conference initiation request, and determine the terminal grade list. Specifically, it may be: create a conference according to the conference initiation request, and create a conference according to the first conference initiation request. 2. Computing the terminal class list with the indication information and the pre-saved media capabilities of the participating terminals.
比如，可以在视频会议的处理设备中预先保存视频会议系统中所有视频终端的媒体能力，然后，在接收到携带第二指示信息的会议发起请求后，根据第二指示信息与预保存的与会终端的媒体能力自动算出终端档次列表。For example, the media capabilities of all video terminals in the video conference system can be pre-stored in the video conference processing device, and then, after receiving the conference initiation request carrying the second indication information, according to the second indication information and the pre-saved conference terminal The media capability automatically calculates the terminal grade list.
103、根据步骤102中确定的终端档次列表预留适配资源，步骤103可选；103. Reserve adaptation resources according to the terminal class list determined in
其中，预留适配资源的方法可参见现有技术，在此不再赘述。比如，如果终端档次列表存在两个终端档次，则此时只需预留一路适配资源即可，如果终端档次列表存在三个终端档次，则此时需要预留二路适配资源，以此类推，等等，当然，如果终端档次列表只存在一个终端档次，那就表明所有终端所采用的媒体格式相同，此时可以不需要预留适配资源，即预留的适配资源为0。Wherein, the method for reserving the adaptation resources may refer to the prior art, which will not be repeated here. For example, if there are two terminal classes in the terminal class list, you only need to reserve one channel of adaptation resources at this time; if there are three terminal profiles in the terminal class list, you need to reserve two channels of adaptation resources at this time By analogy, etc. Of course, if there is only one terminal profile in the terminal profile list, it means that all terminals adopt the same media format, and at this time, there is no need to reserve adaptation resources, that is, the reserved adaptation resources are 0.
104、获取与会终端的媒体格式集；104. Obtain the media format set of the participating terminals;
例如，具体可以接收与会终端发起的参加会议的呼叫请求，其中，该参加会议的呼叫请求中携带与会终端的媒体格式集。或者，For example, it may specifically receive a conference call request initiated by a conference terminal, where the conference call request carries a media format set of the conference terminal. or,
如果终端是被邀请入会的，则视频会议的处理设备可以向终端发送邀请参加会议的呼叫请求，终端在接收到该邀请参加会议的呼叫请求后，返回相应的响应消息，响应消息中可以携带终端的媒体格式集。If the terminal is invited to join the conference, the video conference processing device can send a call request to the terminal to invite to participate in the conference. After receiving the call request to invite to participate in the conference, the terminal returns a corresponding response message. The response message can carry the terminal set of media formats.
其中，媒体格式集指的是终端所能支持的媒体格式的集合，该媒体格式集可以反映终端的媒体能力。The media format set refers to a set of media formats supported by the terminal, and the media format set can reflect the media capability of the terminal.
105、根据步骤102中确定的终端档次列表和步骤104中获取到的媒体格式集进行音视频参数协商，以确定终端档次；例如，具体可以如下：105. Carry out audio and video parameter negotiation according to the terminal grade list determined in
将终端档次列表和媒体格式集的音视频参数进行匹配，若能匹配，则根据预置策略从匹配到的终端档次中选择合适的终端档次，比如，可以选择能够提供最高的音视频参数的终端档次(即最佳媒体效果的终端档次)作为确定的终端档次；若不能匹配，则返回错误提示信息，这样，终端在接收到该错误提示信息后，就可以根据该错误提示信息对用户进行提示，以便用户及时进行处理。Match the terminal profile list with the audio and video parameters of the media format set. If they match, select the appropriate terminal profile from the matched terminal profiles according to the preset strategy. For example, you can choose the terminal that can provide the highest audio and video parameters. The grade (that is, the terminal grade with the best media effect) is used as the determined terminal grade; if it cannot match, an error message will be returned, so that after receiving the error message, the terminal can prompt the user according to the error message , so that users can process it in a timely manner.
需说明的是，如果与会终端和该视频会议的处理设备之间仅仅是视频能力协商失败，该视频会议的处理设备可以允许视频终端以纯语音方式入会，当然，在具体实施时也可以将纯语音方法作为其中的一个终端档次，直接选择该终端档次即可。It should be noted that if only the video capability negotiation between the participating terminals and the video conference processing device fails, the video conference processing device can allow the video terminal to join the conference in pure voice mode. Method is one of the terminal grades, just select the terminal grade directly.
如果确定的终端档次列表和获取到的媒体格式集不能匹配，即如果有终端的媒体格式集无法匹配本次会议中的任意一个终端档次，则该视频会议的处理设备可以为该会议临时增加一个新的终端档次，并为该新的终端档次增加相应的适配资源，从而支持该终端加入该会议。即该视频会议的处理方法还可以包括：If the determined terminal grade list does not match the obtained media format set, that is, if the media format set of a terminal cannot match any terminal grade in this conference, the processing device of the video conference can temporarily add a a new terminal class, and add corresponding adaptation resources for the new terminal class, so as to support the terminal to join the conference. That is, the method for processing the video conference may also include:
根据媒体格式集在终端档次列表中新增终端档次，以及为新增的终端档次增加适配资源。According to the media format set, a terminal profile is added in the terminal profile list, and adaptation resources are added for the newly added terminal profile.
此外，如果在会议的过程中，该会议支持的终端档次列表中存在不被使用到的终端档次(即实际参与会议的终端都不和这些终端档次匹配)，则该视频会议的处理设备也可以临时删除该终端档次，并释放对应的适配资源，从而可以节省适配资源的占用。即该视频会议的处理方法还可以包括：In addition, if there are unused terminal grades in the terminal grade list supported by the conference during the conference (that is, the terminals actually participating in the conference do not match these terminal grades), the video conference processing device can also Temporarily delete the terminal profile and release the corresponding adaptation resources, so that the occupation of adaptation resources can be saved. That is, the method for processing the video conference may also include:
删除终端档次列表中没有被使用到的终端档次，并释放与该删除的终端档次对应的适配资源。Delete unused terminal profiles in the terminal profile list, and release adaptation resources corresponding to the deleted terminal profiles.
106、根据确定的终端档次与与会终端建立会议通话；例如，具体可以如下：106. Establish a conference call with the participating terminals according to the determined terminal class; for example, the details may be as follows:
由于每个终端档次都对应一组音视频参数，比如语音编解码、视频编解码、分辨率和带宽等参数，这些参数可以精确地定义音视频通话的媒体格式，所以，只要根据相应的音视频参数与与会终端建立会议通话即可。Since each terminal class corresponds to a set of audio and video parameters, such as voice codec, video codec, resolution, and bandwidth, these parameters can precisely define the media format of audio and video calls. Therefore, as long as the corresponding audio and video parameter to establish a conference call with the participating terminals.
如果此前已经根据确定的终端档次列表预留了适配资源(即步骤103)，则可选的，在会议通话的过程中，还可以利用预留的适配资源为不同终端档次之间的互通进行媒体适配转换。即该方法还可以包括步骤107；If the adaptation resources have been reserved according to the determined terminal class list before (that is, step 103), then optionally, during the conference call, the reserved adaptation resources can also be used for intercommunication between different terminal classes. Perform media adaptation conversion. That is, the method may also include
107、在会议通话的过程中，利用预留的适配资源为不同终端档次之间的互通进行媒体适配转换。107. During the conference call, use the reserved adaptation resources to perform media adaptation conversion for intercommunication between different terminal levels.
由于每个终端档次都对应一组用于定义音视频通话的媒体格式的音视频参数，所以，如果终端档次不同，也就意味着音视频通话的媒体格式不同，所以，对于不同终端档次之间的互通需要进行媒体适配转换，其中，媒体适配转换的方法具体可参见现有技术，在此不再赘述。Since each terminal class corresponds to a group of audio and video parameters used to define the media format of the audio and video call, if the terminal class is different, it means that the media format of the audio and video call is different. Therefore, for different terminal classes The intercommunication of the media needs to perform media adaptation and conversion. For the method of media adaptation and conversion, reference may be made to the prior art, and details will not be repeated here.
由上可知，本实施例采用为每一种媒体格式设定对应的终端档次，然后根据终端档次列表和媒体格式集进行音视频参数协商来确定终端档次，从而要求与会终端采用某一种媒体格式，以减少媒体流的适配转换，而对于无法采用同一种媒体格式的与会终端，才进行媒体适配转换，从而从整体上减少了适配资源的消耗。也就是说，采用该方案，可以在保证各种终端类型和媒体能力的与会终端都能接入到同一个会议中的同时，节省适配资源。As can be seen from the above, in this embodiment, a corresponding terminal class is set for each media format, and then the terminal class is determined by negotiating audio and video parameters according to the terminal class list and the media format set, thereby requiring the participating terminals to adopt a certain media format , to reduce the adaptation and conversion of media streams, and only perform media adaptation and conversion for the participating terminals that cannot adopt the same media format, thereby reducing the consumption of adaptation resources as a whole. That is to say, adopting this solution can save adaptation resources while ensuring that participating terminals of various terminal types and media capabilities can access the same conference.
根据实施例一所描述的方法，以下将以视频会议的处理设备具体包括应用服务器和媒体资源服务器为例，在实施例二和实施例三中进行详细说明。According to the method described in the first embodiment, the video conference processing device specifically includes an application server and a media resource server as an example, and will be described in detail in the second and third embodiments.
实施例二、Embodiment two,
在本实施例中，将以会议发起者发送的会议发起请求中携带第一指示信息为例进行说明。其中，第一指示信息指示本次会议使用的终端档次列表。In this embodiment, description will be made by taking the first indication information carried in the conference initiation request sent by the conference initiator as an example. Wherein, the first indication information indicates a list of terminal grades used in this meeting.
如图2a所示，该图为视频会议系统的场景示意图。在该场景图中，视频会议系统包括视频会议的处理设备和终端，其中，视频会议的处理设备具体可以包括应用服务器和媒体资源服务器，而终端可以有多个，比如参见图2a，可以包括终端A、终端B、终端C、终端D和终端E，各个终端的媒体能力具体可以如表一所示。As shown in FIG. 2a, the figure is a schematic diagram of a scene of a video conferencing system. In this scenario diagram, the video conference system includes a video conference processing device and a terminal, wherein the video conference processing device may specifically include an application server and a media resource server, and there may be multiple terminals, for example, referring to Figure 2a, which may include a terminal A, terminal B, terminal C, terminal D, and terminal E, the media capabilities of each terminal can be specifically shown in Table 1.
表一：Table I:
其中，终端A和终端B属于高清终端，终端C和终端D属于标清终端，终端E属于软终端。需说明的是，在编码相同的前提下，终端自身都是支持向下适配的，比如，以终端支持H.264为例，如果终端支持“H.264，1080p，8M”，则意味着终端还可以支持“H.264，1080p，4M”、“H.264，720p，2M”和“H.264，720p，1M”等。因此，一般的，在表示一个终端的媒体能力时，仅仅只需写出同一编码的最高支持的媒体能力即可，应当理解的是，表一之所以把多数媒体能力列出来，仅仅只是为了描述得更清楚而已。Among them, terminal A and terminal B are high-definition terminals, terminal C and terminal D are standard-definition terminals, and terminal E is a soft terminal. It should be noted that under the premise of the same encoding, the terminal itself supports downward adaptation. For example, taking the terminal supporting H.264 as an example, if the terminal supports "H.264, 1080p, 8M", it means The terminal can also support "H.264, 1080p, 4M", "H.264, 720p, 2M" and "H.264, 720p, 1M", etc. Therefore, generally, when expressing the media capability of a terminal, it is only necessary to write the highest supported media capability of the same encoding. It should be understood that the reason why most media capabilities are listed in Table 1 is only for description Just be clearer.
该视频会议系统中的各个设备的具体功能可以如下：The specific functions of each device in the video conferencing system can be as follows:
(1)用户：视频会议系统的注册用户，包括视频会议系统的各级管理员以及会议发起者。管理员可以定义和维护系统级、企业级以及用户级的终端档次列表；会议发起者可以定义和维护本用户的终端档次列表。其中，会议发起者可以通过终端或视频会议的处理设备中的会议发起模块发送会议发起请求。(1) User: Registered users of the video conferencing system, including administrators at all levels of the video conferencing system and conference initiators. Administrators can define and maintain system-level, enterprise-level, and user-level terminal profile lists; conference initiators can define and maintain terminal profile lists for their own users. Wherein, the conference initiator may send a conference initiation request through a terminal or a conference initiation module in a video conference processing device.
(2)与会终端：参加会议的终端，可以是各种类型的语音终端或者视频终端，通常可以支持多种媒体格式，并支持在呼叫过程中通过信令和对端进行媒体协商，根据媒体协商结果和对端建立通话。本发明实施例可以不需要对现有的与会终端进行改动。比如，图2a中的终端A、终端B、终端C、终端D和终端E即为与会终端。(2) Participating terminals: The terminals participating in the conference can be various types of voice terminals or video terminals, usually can support multiple media formats, and support media negotiation with the peer end through signaling during the call process, according to the media negotiation As a result, a call is established with the peer. The embodiment of the present invention may not need to modify the existing conference participants. For example, terminal A, terminal B, terminal C, terminal D, and terminal E in FIG. 2a are the participating terminals.
(3)应用服务器(AS，Application Server)：视频会议系统的应用服务器，可以提供用户管理、会议管理、资源调度和会议控制等功能，并控制媒体资源服务器提供媒体处理功能；应用服务器还可以对每个与会者(包括与会终端和媒体资源服务器)进行会话控制，管理与会终端和媒体资源服务器之间的会议通话。在本发明实施例中，应用服务器增加终端档次的管理功能，存储用户定义的终端档次列表，控制媒体资源服务器按指定的终端档次将与会终端接入会议。(3) Application Server (AS, Application Server): the application server of the video conferencing system, which can provide functions such as user management, conference management, resource scheduling and conference control, and control the media resource server to provide media processing functions; the application server can also provide Each participant (including the participant terminal and the media resource server) controls the session, and manages the conference call between the participant terminal and the media resource server. In the embodiment of the present invention, the application server adds a terminal class management function, stores a list of user-defined terminal classes, and controls the media resource server to connect participating terminals to the conference according to the specified terminal class.
(4)媒体资源服务器(MRS，Media Resource Server)：视频会议系统的媒体资源服务器，在应用服务器控制下提供媒体处理功能，支持多种媒体格式之间的适配转换，通过信令和与会终端进行媒体协商，根据协商结果和与会终端建立会议通话并将终端接入到会议中。本发明实施例中，媒体资源服务器需要增加终端档次的处理功能，在收到应用服务器下发的终端档次列表之后，按照终端档次列表预留会议的适配资源，并按照终端档次列表和与会终端进行媒体协商，将与会终端以某个终端档次(即一种媒体格式)接入会议。(4) Media Resource Server (MRS, Media Resource Server): The media resource server of the video conferencing system provides media processing functions under the control of the application server, supports adaptation and conversion between multiple media formats, and communicates with conference terminals through signaling Carry out media negotiation, establish a conference call with the participating terminals according to the negotiation result and connect the terminal to the conference. In the embodiment of the present invention, the media resource server needs to increase the processing function of the terminal grade. After receiving the terminal grade list issued by the application server, it reserves the adaptation resources of the conference according to the terminal grade list, and according to the terminal grade list and the terminal Media negotiation is performed, and the terminals participating in the conference will access the conference with a certain terminal level (ie, a media format).
以下以用户通过终端A发送会议发起请求，即将终端A作为会议发起者为例，对上述应用场景中的视频会议的处理方法进行说明。如图2b所示，具体流程可以如下：The method for processing the video conference in the above application scenario will be described below by taking a user sending a conference initiation request through terminal A, that is, using terminal A as the conference initiator, as an example. As shown in Figure 2b, the specific process can be as follows:
201、会议发起者通过终端A发送会议发起请求给应用服务器，以预定会议或者发起立即会议，其中，该会议发起请求可以携带第一指示信息，以指定该会议使用的终端档次列表。201. The conference initiator sends a conference initiation request to the application server through terminal A to reserve a conference or initiate an immediate conference, wherein the conference initiation request may carry first indication information to specify a list of terminal grades used in the conference.
其中，终端档次列表包括至少一个终端档次，每个终端档次对应一组音视频参数，比如语音编解码、视频编解码、分辨率和带宽等参数，这些参数可以精确地定义音视频通话的媒体格式，也就是说，每个终端档次对应一组用于定义音视频通话的媒体格式的音视频参数。Among them, the list of terminal grades includes at least one terminal grade, and each terminal grade corresponds to a set of audio and video parameters, such as voice codec, video codec, resolution and bandwidth, etc. These parameters can precisely define the media format of audio and video calls , that is to say, each terminal class corresponds to a group of audio and video parameters used to define the media format of the audio and video call.
202、应用服务器调用媒体资源服务器创建会议，并将会议发起者指定的终端档次列表下发给媒体资源服务器。202. The application server invokes the media resource server to create a conference, and sends the terminal class list specified by the conference initiator to the media resource server.
203、媒体资源服务器创建会议，并可以根据该指定的终端档次列表(也即会议中允许的媒体格式列表)预留本次会议的适配资源。203. The media resource server creates a conference, and may reserve adaptation resources for this conference according to the specified terminal profile list (that is, the list of media formats allowed in the conference).
步骤201～步骤203为发起会议步骤。Steps 201 to 203 are the steps of initiating a conference.
204、与会终端向应用服务器发起的参加会议的呼叫请求，其中，该参加会议的呼叫请求中携带与会终端的媒体格式集。204. The conference terminal initiates a call request for joining the conference to the application server, wherein the call request for joining the conference carries the media format set of the conference terminal.
其中，媒体格式集指的是终端所能支持的媒体格式的集合，可以包括一种或多种媒体格式，该媒体格式集可以反映终端的媒体能力。The media format set refers to a set of media formats supported by the terminal, which may include one or more media formats, and the media format set may reflect the media capabilities of the terminal.
例如，终端B、终端C、终端D和终端E可以分别发送参加会议的呼叫请求给应用服务器，并在这些参加会议的呼叫请求中携带各自的媒体格式集，即终端A所发送的参加会议的呼叫请求中携带终端A的媒体格式集，终端B所发送的参加会议的呼叫请求中携带终端B的媒体格式集，终端C所发送的参加会议的呼叫请求中携带终端C的媒体格式集，终端D所发送的参加会议的呼叫请求中携带终端D的媒体格式集，终端E所发送的参加会议的呼叫请求中携带终端E的媒体格式集，以此类推，等等。其中，终端A、终端B、终端C、终端D和终端E的媒体能力可参见表一。For example, terminal B, terminal C, terminal D, and terminal E can respectively send conference call requests to the application server, and carry their own media format sets in these conference call requests, that is, the conference call information sent by terminal A The call request carries the media format set of terminal A, the call request sent by terminal B to join the conference carries the media format set of terminal B, the call request sent by terminal C to join the conference carries the media format set of terminal C, and the terminal The call request for joining the conference sent by D carries the media format set of terminal D, the call request for joining the conference sent by terminal E carries the media format set of terminal E, and so on. Wherein, the media capabilities of terminal A, terminal B, terminal C, terminal D and terminal E can be referred to Table 1.
205、应用服务器从该参加会议的呼叫请求中获取与会终端的媒体格式集，并向媒体资源服务器发起参加会议的呼叫请求，并将终端的媒体格式集透传给媒体资源服务器。205. The application server obtains the media format set of the participating terminal from the call request for joining the conference, initiates a call request for joining the conference to the media resource server, and transparently transmits the media format set of the terminal to the media resource server.
206、参加会议的呼叫请求到达媒体资源服务器后，媒体资源服务器从参加会议的呼叫请求中获取终端的媒体格式集，根据获取到的媒体格式集和本会议支持的终端档次列表进行媒体协商，得到媒体协商结果，例如，具体可以如下：206. After the call request for joining the conference arrives at the media resource server, the media resource server acquires the media format set of the terminal from the call request for joining the conference, performs media negotiation according to the acquired media format set and the list of terminal grades supported by the conference, and obtains Media consultation results, for example, may be as follows:
媒体资源服务器将获取到的媒体格式集和本会议支持的终端档次列表进行音视频参数匹配，以确定终端档次，若终端的媒体格式集可以匹配，比如可以匹配到多个终端档次，则媒体资源服务器根据预置策略从匹配到的终端档次中选择合适的终端档次，比如，可以优先选择其中能够提供最高的音视频参数的终端档次(即最佳媒体效果的终端档次)作为确定的终端档次；若不能匹配，则返回错误提示信息，这样，终端在接收到该错误提示信息后，就可以根据该错误提示信息对用户进行提示，以便用户及时进行处理。The media resource server matches the acquired media format set with the list of terminal profiles supported by this conference for audio and video parameters to determine the terminal profile. The server selects an appropriate terminal grade from the matched terminal grades according to a preset strategy. For example, the terminal grade that can provide the highest audio and video parameters (that is, the terminal grade with the best media effect) can be preferentially selected as the determined terminal grade; If it cannot be matched, an error prompt message is returned. In this way, after receiving the error prompt message, the terminal can prompt the user according to the error prompt message, so that the user can handle it in time.
比如，将终端档次分为“高清终端”、“标清终端”和“软终端”三种，且对这三种终端档次的媒体能力定义如下：For example, the terminal grades are divided into three types: "HD terminal", "SD terminal" and "soft terminal", and the media capabilities of these three terminal grades are defined as follows:
(1)高清终端：可以支持“H.264，1080p，8M”、“H.264，1080p，4M”、“H.264，1080p，2M”和“H.264，1080p，8M”四种媒体格式；(1) High-definition terminal: can support "H.264, 1080p, 8M", "H.264, 1080p, 4M", "H.264, 1080p, 2M" and "H.264, 1080p, 8M" four kinds of media Format;
(2)标清终端：可以支持“H.264，4CIF，768K”、“H.264，CIF，512K”和“H.264，CIF，384K”三种媒体格式；(2) SD terminal: it can support three media formats: "H.264, 4CIF, 768K", "H.264, CIF, 512K" and "H.264, CIF, 384K";
(3)软终端：可以支持“H.264，CIF，512K”、“H.264，CIF，384K”和“H.264，QCIF，128K”三种媒体格式。(3) Soft terminal: It can support three media formats: "H.264, CIF, 512K", "H.264, CIF, 384K" and "H.264, QCIF, 128K".
以终端C为例，由表一可知，终端C可支持“H.264，4CIF，768K”、“H.264，CIF，512K”和“H.264，CIF，384K”三种媒体格式，根据上述的终端格式划分可知，其中的“H.264，CIF，512K”和“H.264，CIF，384K”既与“标清终端”匹配，也和“软终端”匹配，因此，可以确定与终端C匹配的终端档次有“标清终端”和“软终端”，由于“标清终端”的媒体效果较“软终端”好，因此，可以为终端C选择“标清终端”作为其终端档次。Taking terminal C as an example, it can be seen from Table 1 that terminal C can support three media formats: "H.264, 4CIF, 768K", "H.264, CIF, 512K" and "H.264, CIF, 384K". It can be seen from the above terminal format division that "H.264, CIF, 512K" and "H.264, CIF, 384K" match both "standard definition terminal" and "soft terminal". The terminal grades matched by C include "standard definition terminal" and "soft terminal". Since the media effect of "standard definition terminal" is better than that of "soft terminal", "standard definition terminal" can be selected as the terminal grade for terminal C.
同理，对于其他与会终端也可以如此，在此不再赘述。Similarly, the same can be done for other participating terminals, which will not be repeated here.
207、媒体资源服务器将媒体协商结果返回给应用服务器。其中，该媒体协商结果可能是确定的终端档次，定义了终端和媒体资源服务器共同支持的某种媒体格式，该协商结果也可能是错误提示信息，表明终端的媒体格式集无法匹配会议支持的任意一个终端档次。207. The media resource server returns the media negotiation result to the application server. Among them, the media negotiation result may be a certain terminal grade, which defines a certain media format supported by the terminal and the media resource server. The negotiation result may also be an error message indicating that the media format set of the terminal cannot match any A terminal grade.
208、应用服务器接收媒体资源服务器返回的媒体协商结果，并将该媒体协商结果透传给与会终端。208. The application server receives the media negotiation result returned by the media resource server, and transparently transmits the media negotiation result to the participating terminals.
209、与会终端接收到应用服务器返回的媒体协商结果之后，根据该媒体协商结果进行后续操作，比如，可以如下：209. After receiving the media negotiation result returned by the application server, the participating terminals perform subsequent operations according to the media negotiation result, for example, as follows:
如果媒体协商结果中指定了某个终端档次，则按照该指定的终端档次建立会议通话，即该与会终端加入到该会议中。If a certain terminal class is specified in the media negotiation result, a conference call is established according to the specified terminal class, that is, the participating terminal joins the conference.
如果会议系统返回的媒体协商结果中包含了错误信息，则终端向用户进行提示，以便用户进行后续的操作，比如重新发起参加会议的呼叫请求，等等。If the media negotiation result returned by the conferencing system contains error information, the terminal will prompt the user so that the user can perform subsequent operations, such as re-initiating a call request to join the conference, and so on.
步骤204～步骤209为参加发起会议步骤。Steps 204 to 209 are the steps of joining and initiating a meeting.
210、在会议通话的过程中，媒体资源服务器只需要利用预留的适配资源为不同终端档次之间的互通进行媒体适配转换。210. During the conference call, the media resource server only needs to use reserved adaptation resources to perform media adaptation conversion for intercommunication between different terminal levels.
需说明的是，在会议的过程中，会议发起者也可以增加或删除会议中的终端档次，终端档次被增加或删除后，应用服务器将该增加或删除的终端档次下发给媒体资源服务器，由媒体资源服务器为该增加或删除的终端档次增加或删除对应的媒体适配资源。It should be noted that during the conference, the conference initiator can also add or delete the terminal class in the conference. After the terminal class is added or deleted, the application server sends the added or deleted terminal class to the media resource server. The media resource server adds or deletes corresponding media adaptation resources for the added or deleted terminal profile.
由上可知，本实施例采用为每一种媒体格式设定对应的终端档次，当会议发起者发起会议时指定会议使用的终端档次列表，然后根据终端档次列表和媒体格式集进行音视频参数协商来确定终端档次，从而要求与会终端采用某一种媒体格式，以减少媒体流的适配转换，而对于无法采用同一种媒体格式的与会终端，才进行媒体适配转换，从而从整体上减少了适配资源的消耗。也就是说，采用该方案，对于各种不同类型的终端，只要其媒体能力相同或者重叠，都可以按照相同的媒体格式加入同一个会议，从而可以有效的控制会议中的媒体格式类型，减少适配资源的消耗。As can be seen from the above, in this embodiment, a corresponding terminal profile is set for each media format, and when the conference initiator initiates a conference, the terminal profile list used for the conference is specified, and then audio and video parameters are negotiated according to the terminal profile list and the media format set To determine the grade of the terminal, so that the participating terminals are required to adopt a certain media format to reduce the adaptation and conversion of media streams, and for the participating terminals that cannot use the same media format, media adaptation and conversion are performed, thereby reducing overall Adapt resource consumption. That is to say, with this scheme, as long as the media capabilities of different types of terminals are the same or overlap, they can all join the same conference according to the same media format, so that the media format type in the conference can be effectively controlled and the adaptation allocation resource consumption.
实施例三、Embodiment three,
在实施例二中，终端档次主要由会议发起者指定，可选的，终端档次也可以通过其他方式来指定，比如由视频会议的处理设备根据第二指示信息与预保存的与会终端的媒体能力计算得到，等等。In Embodiment 2, the terminal class is mainly specified by the conference initiator. Optionally, the terminal class can also be specified in other ways, such as by the video conference processing device according to the second instruction information and the pre-saved media capabilities of the participating terminals. Calculated, and so on.
在本实施例中，将以视频会议的处理设备根据第二指示信息与预保存的与会终端的媒体能力计算出终端档次为例，对实施二中的应用场景中的视频会议的处理方法进行说明。In this embodiment, the processing method of the video conference in the application scenario in the second implementation will be described by taking the video conference processing device to calculate the terminal grade according to the second indication information and the pre-saved media capabilities of the participating terminals as an example. .
参见图3，具体流程可以如下：Referring to Figure 3, the specific process can be as follows:
301、会议发起者通过终端A发送会议发起请求给应用服务器，以预定会议或者发起立即会议。其中，会议发起请求中携带第二指示信息，该指示参加本次会议的与会终端列表，即第二指示信息指示参与本次会议的终端有哪些终端。301. The conference initiator sends a conference initiation request to the application server through terminal A, so as to reserve a conference or initiate an immediate conference. Wherein, the conference initiation request carries the second indication information, which indicates the list of participating terminals participating in the current conference, that is, the second indication information indicates which terminals are the terminals participating in the current conference.
302、应用服务器调用媒体资源服务器创建会议，根据第二指示信息与预保存的与会终端的媒体能力计算出终端档次列表，并将会议发起者指定的终端档次列表下发给媒体资源服务器。302. The application server invokes the media resource server to create a conference, calculates a terminal class list according to the second indication information and pre-saved media capabilities of participating terminals, and sends the terminal class list specified by the conference initiator to the media resource server.
其中，应用服务器中记录有该视频会议系统中所有视频终端的媒体能力，比如保存有如表一(参见实施例二中的表一)所示的信息，等等。这样，当应用服务器获知参与此次会议的终端时，就可以通过查找出相应终端的媒体能力，从而根据媒体能力和终端档次的对应关系得到相应的终端档次列表。Wherein, the media capabilities of all video terminals in the video conferencing system are recorded in the application server, for example, the information shown in Table 1 (see Table 1 in Embodiment 2) is stored, and so on. In this way, when the application server knows the terminals participating in the conference, it can find out the media capabilities of the corresponding terminals, and thus obtain the corresponding terminal grade list according to the correspondence between the media capabilities and the terminal grades.
其中，终端档次列表包括至少一个(即一个或多个)终端档次，每个终端档次对应一组音视频参数，比如语音编解码、视频编解码、分辨率和带宽等参数，这些参数可以精确地定义音视频通话的媒体格式，也就是说，每个终端档次对应一组用于定义音视频通话的媒体格式的音视频参数。Wherein, the terminal profile list includes at least one (that is, one or more) terminal profiles, and each terminal profile corresponds to a set of audio and video parameters, such as voice codec, video codec, resolution and bandwidth parameters, and these parameters can be accurately Define the media format of the audio and video call, that is, each terminal class corresponds to a set of audio and video parameters used to define the media format of the audio and video call.
需说明的是，在本实施例中，可以由系统管理员或其他各级管理员预先定义并维护终端档次，当会议发起者发起会议时，视频会议系统自动调用该预先设置的终端档次设置信息。It should be noted that, in this embodiment, the system administrator or other administrators at all levels can pre-define and maintain the terminal profile. When the conference initiator initiates the conference, the video conferencing system automatically invokes the preset terminal profile setting information .
303、媒体资源服务器创建会议，并根据该指定的终端档次列表(也即会议中允许的媒体格式列表)预留本次会议的适配资源。303. The media resource server creates a conference, and reserves adaptation resources for this conference according to the specified terminal profile list (that is, the list of media formats allowed in the conference).
步骤301～步骤303为发起会议步骤。Steps 301 to 303 are the steps of initiating a conference.
304、与会终端向应用服务器发起的参加会议的呼叫请求，其中，该参加会议的呼叫请求中携带与会终端的媒体格式集。304. The conference terminal initiates a call request for joining the conference to the application server, wherein the call request for joining the conference carries the media format set of the conference terminal.
其中，媒体格式集指的是终端所能支持的媒体格式的集合，可以包括一种或多种媒体格式，该媒体格式集可以反映终端的媒体能力。The media format set refers to a set of media formats supported by the terminal, which may include one or more media formats, and the media format set may reflect the media capabilities of the terminal.
例如，终端B、终端C、终端D和终端E可以分别发送参加会议的呼叫请求给应用服务器，并在这些参加会议的呼叫请求中携带各自的媒体格式集，即终端A所发送的参加会议的呼叫请求中携带终端A的媒体格式集，终端B所发送的参加会议的呼叫请求中携带终端B的媒体格式集，终端C所发送的参加会议的呼叫请求中携带终端C的媒体格式集，终端D所发送的参加会议的呼叫请求中携带终端D的媒体格式集，终端E所发送的参加会议的呼叫请求中携带终端E的媒体格式集，以此类推，等等。其中，终端A、终端B、终端C、终端D和终端E的媒体能力可参见表一(即实施例二中的表一)。For example, terminal B, terminal C, terminal D, and terminal E can respectively send conference call requests to the application server, and carry their own media format sets in these conference call requests, that is, the conference call information sent by terminal A The call request carries the media format set of terminal A, the call request sent by terminal B to join the conference carries the media format set of terminal B, the call request sent by terminal C to join the conference carries the media format set of terminal C, and the terminal The call request for joining the conference sent by D carries the media format set of terminal D, the call request for joining the conference sent by terminal E carries the media format set of terminal E, and so on. For the media capabilities of terminal A, terminal B, terminal C, terminal D, and terminal E, refer to Table 1 (that is, Table 1 in Embodiment 2).
305、应用服务器从该参加会议的呼叫请求中获取与会终端的媒体格式集，并向媒体资源服务器发起参加会议的呼叫请求，并将终端的媒体格式集透传给媒体资源服务器。305. The application server obtains the media format set of the participating terminal from the call request for joining the conference, initiates a call request for joining the conference to the media resource server, and transparently transmits the media format set of the terminal to the media resource server.
306、参加会议的呼叫请求达到媒体资源服务器后，媒体资源服务器从参加会议的呼叫请求中获取终端的媒体格式集，根据获取到的媒体格式集和本会议支持的终端档次列表进行媒体协商(即音视频参数协商)，得到媒体协商结果，例如，具体可以如下：306. After the call request to participate in the conference reaches the media resource server, the media resource server obtains the media format set of the terminal from the call request to participate in the conference, and performs media negotiation according to the obtained media format set and the list of terminal grades supported by the conference (i.e. Audio and video parameter negotiation) to obtain the media negotiation result, for example, the details can be as follows:
媒体资源服务器将获取到的媒体格式集和本会议支持的终端档次列表进行音视频参数匹配，以确定终端档次，若终端的媒体格式集可以匹配，比如可以匹配到多个终端档次，则媒体资源服务器根据预置策略(该预置策略可根据实际应用的需求进行设置)从匹配到的终端档次中选择合适的终端档次，比如，可以优先选择其中能够提供最高的音视频参数的终端档次(即最佳媒体效果的终端档次)作为确定的终端档次；如果不能匹配，则返回错误提示信息，这样，终端在接收到该错误提示信息后，就可以根据该错误提示信息对用户进行提示，以便用户及时进行处理。The media resource server matches the acquired media format set with the list of terminal profiles supported by this conference for audio and video parameters to determine the terminal profile. The server selects an appropriate terminal grade from the matched terminal grades according to a preset strategy (the preset strategy can be set according to actual application requirements), for example, the terminal grade that can provide the highest audio and video parameters can be preferentially selected (ie The terminal grade with the best media effect) is used as the determined terminal grade; if it cannot match, an error message will be returned. In this way, after receiving the error message, the terminal can prompt the user according to the error message, so that the user Deal with it in a timely manner.
比如，将终端档次分为“高清终端”、“标清终端”和“软终端”三种，且对这三种终端档次的媒体能力定义如下：For example, the terminal grades are divided into three types: "HD terminal", "SD terminal" and "soft terminal", and the media capabilities of these three terminal grades are defined as follows:
(1)高清终端：可以支持“H.264，1080p，8M”、“H.264，1080p，4M”、“H.264，1080p，2M”和“H.264，1080p，8M”四种媒体格式；(1) High-definition terminal: can support "H.264, 1080p, 8M", "H.264, 1080p, 4M", "H.264, 1080p, 2M" and "H.264, 1080p, 8M" four kinds of media Format;
(2)标清终端：可以支持“H.264，4CIF，768K”、“H.264，CIF，512K”和“H.264，CIF，384K”三种媒体格式；(2) SD terminal: it can support three media formats: "H.264, 4CIF, 768K", "H.264, CIF, 512K" and "H.264, CIF, 384K";
(3)软终端：可以支持“H.264，CIF，512K”、“H.264，CIF，384K”和“H.264，QCIF，128K”三种媒体格式。(3) Soft terminal: It can support three media formats: "H.264, CIF, 512K", "H.264, CIF, 384K" and "H.264, QCIF, 128K".
以终端C为例，由表一可知，终端C可支持“H.264，4CIF，768K”、“H.264，CIF，512K”和“H.264，CIF，384K”三种媒体格式，根据上述的终端格式划分可知，其中的“H.264，CIF，512K”和“H.264，CIF，384K”既与“标清终端”匹配，也和“软终端”匹配，因此，可以确定与终端C匹配的终端档次有“标清终端”和“软终端”，由于“标清终端”的媒体效果较“软终端”好，因此，可以为终端C选择“标清终端”作为其终端档次。Taking terminal C as an example, it can be seen from Table 1 that terminal C can support three media formats: "H.264, 4CIF, 768K", "H.264, CIF, 512K" and "H.264, CIF, 384K". It can be seen from the above terminal format division that "H.264, CIF, 512K" and "H.264, CIF, 384K" match both "standard definition terminal" and "soft terminal". The terminal grades matched by C include "standard definition terminal" and "soft terminal". Since the media effect of "standard definition terminal" is better than that of "soft terminal", "standard definition terminal" can be selected as the terminal grade for terminal C.
同理，对于其他与会终端也如此，在此不再赘述。The same applies to other terminals participating in the conference, which will not be repeated here.
307、媒体资源服务器将媒体协商结果返回给应用服务器。其中，该媒体协商结果可能是确定的终端档次，定义了终端和媒体资源服务器共同支持的某种媒体格式，该协商结果也可能是错误提示信息，表明终端的媒体格式集无法匹配会议支持的任意一个终端档次。307. The media resource server returns the media negotiation result to the application server. Among them, the media negotiation result may be a certain terminal grade, which defines a certain media format supported by the terminal and the media resource server. The negotiation result may also be an error message indicating that the media format set of the terminal cannot match any A terminal grade.
308、应用服务器接收媒体资源服务器返回的媒体协商结果，并将该媒体协商结果透传给与会终端。308. The application server receives the media negotiation result returned by the media resource server, and transparently transmits the media negotiation result to the participating terminals.
309、与会终端接收到应用服务器返回的媒体协商结果之后，根据该媒体协商结果进行后续操作，比如，可以如下：309. After receiving the media negotiation result returned by the application server, the participating terminals perform subsequent operations according to the media negotiation result, for example, as follows:
如果媒体协商结果中指定了某个终端档次，则按照该指定的终端档次建立会议通话，即该与会终端加入到该会议中。If a certain terminal class is specified in the media negotiation result, a conference call is established according to the specified terminal class, that is, the participating terminal joins the conference.
如果会议系统返回的媒体协商结果包含了错误信息，则终端向用户进行提示。If the media negotiation result returned by the conferencing system contains error information, the terminal prompts the user.
步骤304～步骤309为参加会议步骤。Steps 304 to 309 are the steps of joining a meeting.
310、在会议通话的过程中，媒体资源服务器只需要利用预留的适配资源为不同终端档次之间的互通进行媒体适配转换。310. During the conference call, the media resource server only needs to use reserved adaptation resources to perform media adaptation conversion for intercommunication between different terminal levels.
需说明的是，在会议的过程中，会议发起者也可以增加或删除会议中的终端档次，终端档次被增加或删除后，应用服务器将该增加或删除的终端档次下发给媒体资源服务器，由媒体资源服务器为该增加或删除的终端档次增加或删除对应的媒体适配资源。It should be noted that during the conference, the conference initiator can also add or delete the terminal class in the conference. After the terminal class is added or deleted, the application server sends the added or deleted terminal class to the media resource server. The media resource server adds or deletes corresponding media adaptation resources for the added or deleted terminal profile.
由上可知，本实施例采用为每一种媒体格式设定对应的终端档次，当会议发起者发起会议时指定会议使用的终端，由应用服务器根据该指定的终端和预存的终端的媒体能力计算出终端档次列表，然后由媒体资源服务器根据终端档次列表和媒体格式集进行音视频参数协商来确定终端档次，从而要求与会终端采用某一种媒体格式，以减少媒体流的适配转换，而对于无法采用同一种媒体格式的与会终端，才进行媒体适配转换，从而从整体上减少了适配资源的消耗。也就是说，采用该方案，对于各种不同类型的终端，只要其媒体能力相同或者重叠，都可以按照相同的媒体格式加入同一个会议，从而可以有效的控制会议中的媒体格式类型，减少适配资源的消耗。As can be seen from the above, in this embodiment, a corresponding terminal level is set for each media format. When the conference initiator initiates a conference, the terminal used for the conference is designated, and the application server calculates the media capability of the designated terminal and the pre-stored terminal. Then the media resource server negotiates the audio and video parameters according to the terminal class list and the media format set to determine the terminal class, thus requiring the participating terminals to adopt a certain media format to reduce the adaptation and conversion of media streams. Only the conference terminals that cannot use the same media format will perform media adaptation and conversion, thereby reducing the consumption of adaptation resources as a whole. That is to say, with this scheme, as long as the media capabilities of different types of terminals are the same or overlap, they can all join the same conference according to the same media format, so that the media format type in the conference can be effectively controlled and the adaptation allocation resource consumption.
实施例四、Embodiment four,
为了更好地实施以上方法，本发明实施例还相应地提供一种视频会议的处理设备，如图4a所示，该视频会议的处理设备可以包括接收单元401、处理单元402、获取单元404、协商单元405和建立单元406。In order to better implement the above method, the embodiment of the present invention also provides a video conference processing device correspondingly. As shown in FIG.
接收单元401，用于接收会议发起者发送的会议发起请求；a receiving
例如，接收单元401具体可以接收会议发起者发送的预定会议发起请求或立即会议发起请求。其中，接收会议发起者具体可以为终端或视频会议的处理设备中的会议发起模块。For example, the receiving
处理单元402，用于根据接收单元401接收到的会议发起请求创建会议，并确定终端档次列表；其中，终端档次列表包括一个或多个(即至少一个)终端档次，每个终端档次对应一组用于定义音视频通话的媒体格式的音视频参数，比如语音编解码、视频编解码、分辨率和带宽等参数；The
获取单元404，用于获取与会终端的媒体格式集；An
例如，获取单元404具体可以接收与会终端发起的参加会议的呼叫请求，其中，该呼叫请求中携带与会终端的媒体格式集；或者，向与会终端发送邀请参加会议的呼叫请求，接收与会终端返回的响应消息，其中，该响应消息中携带与会终端的媒体格式集；For example, the acquiring
其中，媒体格式集指的是终端所能支持的媒体格式的集合，该媒体格式集可以反映终端的媒体能力。The media format set refers to a set of media formats supported by the terminal, and the media format set can reflect the media capability of the terminal.
协商单元405，用于根据处理单元402确定的终端档次列表和获取单元404获取到的媒体格式集进行音视频参数协商，以确定终端档次；The
例如，协商单元405具体可以将终端档次列表和媒体格式集的音视频参数进行匹配；如果能匹配，则根据预置策略从匹配到的终端档次中选择合适的终端档次，比如，从匹配到的终端档次中选择能够提供最高的音视频参数的终端档次(即最佳媒体效果的终端档次)；如果不能匹配，则返回错误提示信息。For example, the
需说明的是，如果与会终端和该视频会议的处理设备之间仅仅是视频能力协商失败，该视频会议的处理设备可以允许视频终端以纯语音方式入会，当然，在具体实施时也可以将纯语音方法作为其中的一个终端档次，然后协商单元405直接选择该终端档次即可。It should be noted that if only the video capability negotiation between the participating terminals and the video conference processing device fails, the video conference processing device can allow the video terminal to join the conference in pure voice mode. The method is used as one of the terminal grades, and then the
建立单元406，用于根据协商单元405确定的终端档次与与会终端建立会议通话。The establishing
由于每个终端档次都对应一组音视频参数，比如语音编解码、视频编解码、分辨率和带宽等参数，这些参数可以精确地定义音视频通话的媒体格式，所以，只要根据相应的音视频参数与会终端建立会议通话即可。Since each terminal class corresponds to a set of audio and video parameters, such as voice codec, video codec, resolution, and bandwidth, these parameters can precisely define the media format of audio and video calls. Therefore, as long as the corresponding audio and video parameter and the conference terminal to establish a conference call.
可选的，如图4b所示，该视频会议的处理设备还可以包括预留单元403和适配单元407；Optionally, as shown in FIG. 4b, the video conference processing device may further include a
预留单元403，用于根据处理单元402确定的终端档次列表预留适配资源；A
其中，预留适配资源的方法可参见现有技术，在此不再赘述。比如，如果终端档次列表存在两个终端档次，则此时只需预留一路适配资源即可，如果终端档次列表存在三个终端档次，则此时需要预留三路适配资源，以此类推，等等，当然，如果终端档次列表只存在一个终端档次，那就表明所有终端所采用的媒体格式相同，此时可以不需要预留适配资源，即预留的适配资源为0。Wherein, the method for reserving the adaptation resources may refer to the prior art, which will not be repeated here. For example, if there are two terminal classes in the terminal class list, you only need to reserve one adaptation resource at this time; if there are three terminal classes in the terminal class list, you need to reserve three adaptation resources at this time, so that By analogy, etc. Of course, if there is only one terminal profile in the terminal profile list, it means that all terminals adopt the same media format, and at this time, there is no need to reserve adaptation resources, that is, the reserved adaptation resources are 0.
适配单元407，用于在会议通话的过程中，利用预留单元403预留的适配资源为不同终端档次之间的互通进行媒体适配转换。The
由于每个终端档次都对应一组用于定义音视频通话的媒体格式的音视频参数，所以，如果终端档次不同，也就意味着音视频通话的媒体格式不同，所以，对于不同终端档次之间的互通需要进行媒体适配转换，其中，媒体适配转换的方法具体可参见现有技术，在此不再赘述。Since each terminal class corresponds to a group of audio and video parameters used to define the media format of the audio and video call, if the terminal class is different, it means that the media format of the audio and video call is different. Therefore, for different terminal classes The intercommunication of the media needs to perform media adaptation and conversion. For the method of media adaptation and conversion, reference may be made to the prior art, and details will not be repeated here.
其中，可选的，终端档次列表可以由会议发起者在会议发起请求中进行指定，即：Wherein, optionally, the terminal grade list can be specified by the conference initiator in the conference initiation request, namely:
接收单元401，具体用于接收会议发起者发送的携带第一指示信息的会议发起请求，其中，第一指示信息指示本次会议使用的终端档次列表；The receiving
则此时，处理单元402，具体用于根据接收单元401接收到的会议发起请求创建会议，并根据第一指示信息确定终端档次列表。At this time, the
需说明的是，该第一指示信息可以包括终端档次列表的具体内容，也可以只包括一个第一标识。如果只包括一个第一标识的话，则视频会议的处理设备接收到该第一标识后，根据该第一标识查找预置的第一对应表，从而获得相应的终端档次列表；其中，第一对应表中保存着第一标识和终端档次列表的对应关系。It should be noted that the first indication information may include specific content of the terminal profile list, or may only include a first identifier. If only one first identification is included, after receiving the first identification, the processing device of the video conference searches the preset first correspondence table according to the first identification, so as to obtain the corresponding list of terminal grades; wherein, the first correspondence The corresponding relationship between the first identifier and the terminal grade list is stored in the table.
或者，除了上述所说的终端档次列表可以由会议发起者直接指定之外，终端档次列表也可以通过其他方式来指定，比如由会议发起者指定参加本次会议的与会终端列表，然后由视频会议的处理设备根据该与会终端列表和预存的终端的媒体能力计算出终端档次列表，即：Or, in addition to the above-mentioned list of terminal grades that can be directly specified by the conference initiator, the terminal grade list can also be specified in other ways, for example, the conference initiator specifies the list of participating terminals to participate in this meeting, and then the video conference The processing device calculates the terminal class list according to the terminal list of participants and the media capabilities of the pre-stored terminals, namely:
接收单元401，具体用于接收会议发起者发送的携带第二指示信息的会议发起请求，其中，第二指示信息指示参加本次会议的与会终端列表；The receiving
则此时，处理单元402，具体用于根据接收单元401接收到的会议发起请求创建会议，并根据第二指示信息与预保存的与会终端的媒体能力计算出终端档次列表。At this time, the
当然，除了以上所列举的两种方式之外，终端档次列表还可以通过其他方式来指定，在此不再赘述。Of course, in addition to the two methods listed above, the terminal class list can also be specified in other ways, which will not be repeated here.
此外，由于视频会议可以有两路视频流，一路是主视频流，用于显示与会者的，另一路是辅视频流，用来共享桌面，例如进行幻灯片共享等等，所以，终端档次列表也可以分别针对主视频流和辅视频流进行指定，例如，可以定义一到多个终端的主视频流终端档次列表，与此同时，还可以定义一到多个终端的辅视频流终端档次列表；或者，也可以定义某个终端档次列表同时适用于主视频流和辅视频流，在此不再赘述。In addition, since a video conference can have two video streams, one is the main video stream, which is used to display the participants, and the other is the auxiliary video stream, which is used to share the desktop, such as slide sharing, etc. Therefore, the list of terminal grades It can also be specified for the main video stream and auxiliary video stream respectively. For example, one or more terminal grade lists of the main video stream can be defined. At the same time, one or more terminal grade lists of the secondary video stream can also be defined. ; Alternatively, it is also possible to define a terminal profile list applicable to both the primary video stream and the secondary video stream, which will not be repeated here.
此外，如果确定的终端档次列表和获取到的媒体格式集不能匹配，即如果有终端的媒体格式集无法匹配本次会议中的任意一个终端档次，则该视频会议的处理设备可以为该会议临时增加一个新的终端档次，并为该新的终端档次增加相应的适配资源，从而支持该终端加入该会议。即该视频会议的处理设备还可以包括增加单元；In addition, if the determined terminal grade list does not match the obtained media format set, that is, if the media format set of a terminal cannot match any terminal grade in this conference, the video conference processing device can temporarily A new terminal class is added, and corresponding adaptation resources are added for the new terminal class, so as to support the terminal to join the conference. That is, the video conference processing device may also include an adding unit;
增加单元，用于根据所述媒体格式集在终端档次列表中新增终端档次，以及为新增的终端档次增加适配资源。An adding unit, configured to add a new terminal profile in the terminal profile list according to the media format set, and add adaptation resources for the newly added terminal profile.
同理，如果在会议的过程中，该会议支持的终端档次列表中存在不被使用到的终端档次(即实际参与会议的终端都不和这些终端档次匹配)，则该视频会议的处理设备也可以临时删除该终端档次，并释放对应的适配资源，从而可以节省适配资源的占用。即该视频会议的处理设备还可以包括删除单元；Similarly, if during the meeting, there are unused terminal grades in the terminal grade list supported by the conference (that is, the terminals actually participating in the conference do not match these terminal grades), then the video conference processing equipment will also The terminal profile can be temporarily deleted, and the corresponding adaptation resources can be released, so that the occupation of adaptation resources can be saved. That is, the video conference processing device may also include a deletion unit;
删除单元，用于删除终端档次列表中没有被使用到的终端档次，并释放与该删除的终端档次对应的适配资源。The deleting unit is configured to delete unused terminal profiles in the terminal profile list, and release adaptation resources corresponding to the deleted terminal profiles.
需说明的是，在具体实施时，以上各个单元可以作为独立的实体来实现，也可以进行任意组合，作为同一或若干个实体来实现，比如，该视频会议的处理设备具体可以包括应用服务器(AS，Application Server)和媒体资源服务器(MRS，Media Resource Server)。以上各个单元的实施具体可参见前面的实施例，在此不再赘述。It should be noted that, during specific implementation, each of the above units may be implemented as an independent entity, or may be combined arbitrarily as the same or several entities. For example, the video conference processing device may specifically include an application server ( AS, Application Server) and Media Resource Server (MRS, Media Resource Server). For the specific implementation of each of the above units, reference may be made to the foregoing embodiments, and details are not repeated here.
由上可知，本实施例的视频会议的处理设备采用为每一种媒体格式设定对应的终端档次，然后由协商单元405根据终端档次列表和媒体格式集进行音视频参数协商来确定终端档次，从而要求与会终端采用某一种媒体格式，以减少媒体流的适配转换，而对于无法采用同一种媒体格式的与会终端，才由适配单元407进行媒体适配转换，从而从整体上减少了适配资源的消耗。也就是说，采用该方案，对于各种不同类型的终端，只要其媒体能力相同或者重叠，都可以按照相同的媒体格式加入同一个会议，从而可以有效的控制会议中的媒体格式类型，减少适配资源的消耗。As can be seen from the above, the video conferencing processing device of this embodiment adopts setting a corresponding terminal grade for each media format, and then the
实施例五、Embodiment five,
相应的，本发明实施例还提供一种视频会议系统，包括本发明实施例所提供的任一种视频会议的处理设备，其中，该视频会议的处理设备具体可参见实施例四，在此不再赘述。Correspondingly, an embodiment of the present invention also provides a video conference system, including any video conference processing device provided in the embodiments of the present invention, wherein, for the video conference processing device, please refer to Embodiment 4 for details, and it is not described here Let me repeat.
此外，该视频会议系统还可以包括终端；In addition, the video conferencing system may also include a terminal;
终端，用于发送参加会议的呼叫请求给视频会议的处理设备，并接收视频会议的处理设备发送的终端档次，根据该终端档次与视频会议的处理设备建立会议通话。The terminal is configured to send a call request for joining the conference to the video conference processing device, receive the terminal profile sent by the video conference processing device, and establish a conference call with the video conference processing device according to the terminal profile.
其中，终端发送给视频会议的处理设备的参加会议的呼叫请求中可以携带与会终端的媒体格式集，当然，如果视频会议的处理设备中已经保存了视频会议系统中各个终端的媒体格式集的话，则此时也可以不用携带与会终端的媒体格式集，而是由视频会议的处理设备直接根据与会终端在预存的媒体格式集中获取相应的媒体格式集即可。Wherein, the call request for joining the meeting sent by the terminal to the video conference processing device may carry the media format set of the participating terminals. Of course, if the video conference processing device has already saved the media format set of each terminal in the video conference system, At this time, it is not necessary to carry the media format set of the participating terminals, but the video conference processing device can directly obtain the corresponding media format set according to the pre-stored media format set of the participating terminals.
以上各个设备的具体实施可参加前面的实施例，在此不再赘述。The specific implementation of each of the above devices can refer to the previous embodiments, and will not be repeated here.
由上可知，本实施例的视频会议系统采用为每一种媒体格式设定对应的终端档次，然后根据终端档次列表和媒体格式集进行音视频参数协商来确定终端档次，从而要求与会终端采用某一种媒体格式，以减少媒体流的适配转换，而对于无法采用同一种媒体格式的与会终端，才进行媒体适配转换，从而从整体上减少了适配资源的消耗。也就是说，采用该方案，可以在保证各种终端类型和媒体能力的与会终端都能接入到同一个会议中的同时，节省媒体适配资源。As can be seen from the above, the video conferencing system in this embodiment adopts setting a corresponding terminal profile for each media format, and then performs audio and video parameter negotiation according to the terminal profile list and media format set to determine the terminal profile, thereby requiring the participating terminals to use a certain A media format is used to reduce the adaptation and conversion of media streams, and media adaptation and conversion is performed only for the participating terminals that cannot adopt the same media format, thereby reducing the consumption of adaptation resources as a whole. That is to say, by adopting this solution, media adaptation resources can be saved while ensuring that participating terminals of various terminal types and media capabilities can access the same conference.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读存储介质中，存储介质可以包括：只读存储器(ROM，Read Only Memory)、随机存取记忆体(RAM，Random Access Memory)、磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: Read Only Memory (ROM, Read Only Memory), Random Access Memory (RAM, Random Access Memory), disk or CD, etc.
以上对本发明实施例所提供的一种视频会议的处理方法、装置和通信系统进行了详细介绍，本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想；同时，对于本领域的技术人员，依据本发明的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本发明的限制。The processing method, device and communication system for a video conference provided by the embodiment of the present invention have been described above in detail. In this paper, specific examples are used to illustrate the principle and implementation of the present invention. The description of the above embodiment is only used To help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation and scope of application. In summary, the content of this specification It should not be construed as limiting the invention.
Claims (16)
Translated fromChineseApplications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2011/085112WO2012163075A1 (en) | 2011-12-31 | 2011-12-31 | Video conferencing processing method, apparatus and communication system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102893603A CN102893603A (en) | 2013-01-23 |
| CN102893603Btrue CN102893603B (en) | 2014-05-21 |
Family
ID=47258342
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180003293.3AActiveCN102893603B (en) | 2011-12-31 | 2011-12-31 | Processing method, device and communication system for a video conference |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102893603B (en) |
| WO (1) | WO2012163075A1 (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104427296B (en)* | 2013-09-05 | 2019-03-01 | 华为终端（东莞）有限公司 | The transmission method and device of Media Stream in video conference |
| CN103702063B (en)* | 2013-12-24 | 2018-01-16 | 北京佳讯飞鸿电气股份有限公司 | A kind of method that dynamic media negotiation is realized in video conferencing system |
| CN106612410B (en)* | 2015-10-26 | 2019-06-25 | 大唐移动通信设备有限公司 | A kind of method and device of video monitoring |
| CN107659415B (en)* | 2016-07-25 | 2021-05-18 | 中兴通讯股份有限公司 | Media resource management method and device for cloud conference |
| CN108933675B (en)* | 2017-05-25 | 2022-03-04 | 中兴通讯股份有限公司 | Conference resource allocation method, device and storage medium |
| CN109217980B (en) | 2017-07-03 | 2020-11-06 | 腾讯科技（深圳）有限公司 | Codec capability configuration method, device and computer storage medium |
| CN109587433B (en)* | 2018-10-29 | 2020-05-22 | 视联动力信息技术股份有限公司 | Point adjusting method and point adjusting device |
| CN110248140A (en)* | 2019-05-21 | 2019-09-17 | 武汉兴图新科电子股份有限公司 | A kind of video conference control device and method having mobile phone control |
| CN111447391A (en)* | 2020-02-20 | 2020-07-24 | 平安科技（深圳）有限公司 | Conference data synchronization method and device, computer equipment and storage medium |
| CN115168710A (en)* | 2022-06-30 | 2022-10-11 | 上海掌门科技有限公司 | Hosting device recommendation method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101345776A (en)* | 2008-08-14 | 2009-01-14 | 中兴通讯股份有限公司 | Content adapting implementing method and content adapting server |
| CN101621658A (en)* | 2009-08-06 | 2010-01-06 | 中兴通讯股份有限公司 | Terminal, and method and system for terminal to realize wireless video conference |
| CN101697549A (en)* | 2009-10-23 | 2010-04-21 | 中兴通讯股份有限公司 | Method and system for displaying stream media and stream media management server |
| CN101710962A (en)* | 2009-12-22 | 2010-05-19 | 中兴通讯股份有限公司 | Method and device for distributing video conference resources |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003098929A1 (en)* | 2002-05-20 | 2003-11-27 | Sony Corporation | Video signal processing apparatus and method |
| CN1553676A (en)* | 2003-06-06 | 2004-12-08 | 华为技术有限公司 | Method for Multiple Protocol Terminals to Conduct Same Audio-Video Conference |
| JP2007318556A (en)* | 2006-05-26 | 2007-12-06 | Hitachi Communication Technologies Ltd | Multi-point video conference system in communication network |
| TWI381733B (en)* | 2007-06-11 | 2013-01-01 | Quanta Comp Inc | High definition video conference system |
| CN102299921A (en)* | 2011-08-09 | 2011-12-28 | 深圳市万兴软件有限公司 | Conversion method of video file adapted to mobile terminal and system thereof |
- 2011
- 2011-12-31CNCN201180003293.3Apatent/CN102893603B/enactiveActive
- 2011-12-31WOPCT/CN2011/085112patent/WO2012163075A1/enactiveApplication Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101345776A (en)* | 2008-08-14 | 2009-01-14 | 中兴通讯股份有限公司 | Content adapting implementing method and content adapting server |
| CN101621658A (en)* | 2009-08-06 | 2010-01-06 | 中兴通讯股份有限公司 | Terminal, and method and system for terminal to realize wireless video conference |
| CN101697549A (en)* | 2009-10-23 | 2010-04-21 | 中兴通讯股份有限公司 | Method and system for displaying stream media and stream media management server |
| CN101710962A (en)* | 2009-12-22 | 2010-05-19 | 中兴通讯股份有限公司 | Method and device for distributing video conference resources |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2012163075A1 (en) | 2012-12-06 |
| CN102893603A (en) | 2013-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102893603B (en) | Processing method, device and communication system for a video conference | |
| US8112480B2 (en) | Signaling support for sharer switching in application sharing | |
| US20020033880A1 (en) | Method for performing multipoint video conference in video conferencing system | |
| CN101227584B (en) | Method for managing media processor in videoconference system | |
| CN103299596B (en) | For the method and system that the synchronization bandwidth of real time communication is reserved | |
| CN105704426A (en) | Method, device and system for video conferencing | |
| WO2016019775A1 (en) | Conference migration method, device and system | |
| CN104902111A (en) | Web RTC-based method, equipment and system for establishing multi party call | |
| WO2015127813A1 (en) | Recording control method, sip server, and recording servers | |
| WO2015003532A1 (en) | Multimedia conferencing establishment method, device and system | |
| CN104580275A (en) | Cross-system data sharing method, auxiliary stream gateway, conference server and controller | |
| US11290685B2 (en) | Call processing method and gateway | |
| CN102238196A (en) | SIP (Session Initiation Protocol) session auxiliary flow control method based on INFO message | |
| CN104158673A (en) | Conference mode selection method and server | |
| CN101052073B (en) | A method of creating multi-party conference based on H.248 protocol | |
| CN107666396A (en) | A kind of multiple terminals meeting processing method and processing device | |
| WO2025107819A1 (en) | Ims-session media renegotiation method and apparatus, and communication device and storage medium | |
| CN100574232C (en) | A kind of implementation method of parallel calls function of multimedia call | |
| CN101287094A (en) | Method and system for realizing multimedia conference media operation | |
| CN105516065B (en) | A kind of media control method and equipment | |
| US20200120366A1 (en) | Video interaction management method and system, and computer-readable storage medium | |
| CN102045315B (en) | Method, system, controller and replica distributor for carrying out internet conference | |
| CN102546995B (en) | Data distribution processing method and device | |
| WO2015131533A1 (en) | Recording method, call control server and recording system | |
| CN118509423B (en) | A method for transmitting audio and video in fusion communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |