技术领域technical field
本发明涉及多媒体处理技术领域，尤其涉及一种媒体资源控制方法及装置。The present invention relates to the technical field of multimedia processing, in particular to a media resource control method and device.
背景技术Background technique
目前业界媒体产品均针对某一特定领域，使用某一种多媒体处理器件处理，如图1所示，在主流渲染场景下，使用中央处理器(Central Processing Unit，CPU)实现逻辑控制功能，在图像处理器(Graphic Processing Unit，GPU)中实现编解码、图像渲染等媒体处理功能；如图2所示，在主流的编解码处理场景下，同样使用CPU实现逻辑控制功能，使用数字信号处理器(Digital Signal Processing，DSP)实现编码、解码等媒体处理功能；各多媒体处理器件处理业务比较单一，融合能力较差。At present, media products in the industry are all aimed at a specific field, using a certain multimedia processing device for processing, as shown in Figure 1, in the mainstream rendering scenario, the central processing unit (Central Processing Unit, CPU) Media processing functions such as encoding and decoding and image rendering are implemented in a Graphic Processing Unit (GPU); as shown in Figure 2, in the mainstream encoding and decoding processing scenarios, the CPU is also used to implement logic control functions, and a digital signal processor ( Digital Signal Processing (DSP) implements media processing functions such as encoding and decoding; each multimedia processing device processes a single business and has poor integration capabilities.
但目前媒体业务不断融合，进行渲染、编解码、会议混音、视频等多媒体处理任务的处理，需要具有强大能力的融合的多媒体处理系统。However, at present, media services are constantly merging, and multimedia processing tasks such as rendering, codec, conference audio mixing, and video processing require an integrated multimedia processing system with powerful capabilities.
综上所述，如何更好地提高具有媒体处理资源的装置的多媒体处理资源的利用率已成为业界迫切需要解决的问题。To sum up, how to better improve the utilization rate of multimedia processing resources of devices having media processing resources has become an urgent problem to be solved in the industry.
发明内容Contents of the invention
有鉴于此，本发明实施例提供了一种媒体资源控制方法及装置，用于解决现有技术存在着的无法很好地提高具有媒体处理资源的装置的多媒体处理资源的利用率的问题。In view of this, the embodiments of the present invention provide a media resource control method and device, which are used to solve the problem in the prior art that the utilization rate of multimedia processing resources of devices with media processing resources cannot be well improved.
第一方面，提供了一种媒体资源控制方法，包括：In the first aspect, a media resource control method is provided, including:
接收到多媒体处理任务时，媒体资源控制装置分析处理所述多媒体处理任务所需要的媒体处理资源；When receiving a multimedia processing task, the media resource control device analyzes and processes the media processing resources required by the multimedia processing task;
获取所述媒体资源控制装置的当前空闲的媒体处理资源和与所述媒体资源控制装置相连接的至少一个多媒体处理装置的当前空闲的媒体处理资源；Acquiring the currently idle media processing resources of the media resource control device and the currently idle media processing resources of at least one multimedia processing device connected to the media resource control device;
根据获取的所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源，将所述多媒体处理任务分配给所述媒体资源控制装置和/或至少所述一个多媒体处理装置进行处理。According to the obtained currently idle media processing resources of the media resource control device and the at least one multimedia processing device, assign the multimedia processing task to the media resource control device and/or at least the one multimedia processing device for processing deal with.
在第一种可能的实现方式中，所述接收到多媒体处理任务时，媒体资源控制装置分析处理所述多媒体处理任务所需要的媒体处理资源之前，所述方法还包括：In a first possible implementation manner, when the multimedia processing task is received, before the media resource control device analyzes and processes the media processing resources required by the multimedia processing task, the method further includes:
获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小；Obtaining the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device;
根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，构建媒体处理资源池，并在所述媒体处理资源池中记录所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。Construct a media processing resource pool according to the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device, and record the media resource control device and the media processing resource pool in the media processing resource pool Type and size of currently idle media processing resources of the at least one multimedia processing device.
结合第一方面的第一种可能的实现方式，在第二种可能的实现方式中，所述构建媒体处理资源池之后，所述方法还包括：With reference to the first possible implementation of the first aspect, in a second possible implementation, after the construction of the media processing resource pool, the method further includes:
周期性地获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小；Periodically acquire the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device;
根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。According to the types and sizes of currently idle media processing resources of the media resource control device and the at least one multimedia processing device, respectively update the sizes of corresponding types of idle media processing resources recorded in the media processing resource pool.
结合第一方面的第一种可能的实现方式，在第三种可能的实现方式中，所述构建媒体处理资源池之后，所述方法还包括：With reference to the first possible implementation of the first aspect, in a third possible implementation, after the construction of the media processing resource pool, the method further includes:
当所述媒体处理任务占用或释放所述媒体处理资源池中的媒体处理资源时，获取占用或释放的所述媒体处理资源的类型和大小；When the media processing task occupies or releases a media processing resource in the media processing resource pool, acquire the type and size of the occupied or released media processing resource;
根据占用或释放的所述媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。According to the type and size of the occupied or released media processing resource, respectively update the size of the corresponding type of idle media processing resource recorded in the media processing resource pool.
结合第一方面的第一种可能的实现方式或第一方面的第二种可能的实现方式或第一方面的第三种可能的实现方式，在第四种可能的实现方式中，所述获取所述媒体资源控制装置的当前空闲的媒体处理资源和连接所述媒体资源控制装置的至少一个多媒体处理装置的当前空闲的媒体处理资源，包括：In combination with the first possible implementation of the first aspect or the second possible implementation of the first aspect or the third possible implementation of the first aspect, in a fourth possible implementation, the obtaining The currently idle media processing resources of the media resource control device and the currently idle media processing resources of at least one multimedia processing device connected to the media resource control device include:
根据分析得到的处理所述多媒体处理任务所需要的媒体处理资源的类型和大小，从所述媒体处理资源池中获取处理所述多媒体处理任务所需要的媒体处理资源。Acquire the media processing resources required for processing the multimedia processing task from the media processing resource pool according to the type and size of the media processing resources required for processing the multimedia processing task obtained through analysis.
结合第一方面的第一种可能的实现方式或第一方面的第二种可能的实现方式或第一方面的第三种可能的实现方式或第一方面的第四种可能的实现方式，在第五种可能的实现方式中，所述根据获取的所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源，将所述多媒体处理任务分配给所述媒体资源控制装置和/或所述至少一个多媒体处理装置进行处理，包括：In combination with the first possible implementation of the first aspect or the second possible implementation of the first aspect or the third possible implementation of the first aspect or the fourth possible implementation of the first aspect, in In a fifth possible implementation manner, allocating the multimedia processing task to the media resource control device according to the obtained currently idle media processing resources of the media resource control device and the at least one multimedia processing device And/or the at least one multimedia processing device performs processing, including:
获取所述媒体资源控制装置和所述至少一个多媒体处理装置在所述媒体处理资源池中的当前空闲的媒体处理资源分别占所述媒体处理资源池中的总的当前空闲的媒体处理资源的比例；Obtaining the ratios of the currently idle media processing resources in the media processing resource pool of the media resource control device and the at least one multimedia processing device to the total currently idle media processing resources in the media processing resource pool ;
按照所述比例，分别将所述多媒体处理任务分配给所述媒体资源控制装置和至少一个多媒体处理装置进行处理。According to the proportion, the multimedia processing task is respectively assigned to the media resource control device and at least one multimedia processing device for processing.
结合第一方面的第一种可能的实现方式或第一方面的第二种可能的实现方式或第一方面的第三种可能的实现方式或第一方面的第四种可能的实现方式，在第六种可能的实现方式中，所述根据获取的所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源，将所述多媒体处理任务分配给所述媒体资源控制装置和/或所述至少一个多媒体处理装置进行处理，包括：In combination with the first possible implementation of the first aspect or the second possible implementation of the first aspect or the third possible implementation of the first aspect or the fourth possible implementation of the first aspect, in In a sixth possible implementation manner, allocating the multimedia processing task to the media resource control device according to the obtained currently idle media processing resources of the media resource control device and the at least one multimedia processing device And/or the at least one multimedia processing device performs processing, including:
当所述媒体处理资源池中处理所述多媒体处理任务的第一类型的媒体处理资源少于处理所述多媒体处理任务所需要的媒体处理资源时，将所述多媒体处理任务分配给第一类型的媒体处理资源进行处理；When the media processing resources of the first type for processing the multimedia processing task in the media processing resource pool are less than the media processing resources required for processing the multimedia processing task, allocating the multimedia processing task to the first type of media processing resources media processing resources for processing;
将所述多媒体处理任务中除所述第一类型的媒体处理资源处理的任务之外的剩余的任务，分配给所述媒体处理资源池中其它类型对应的所述媒体资源控制装置或多媒体处理装置进行处理。Allocating the remaining tasks in the multimedia processing tasks except the tasks processed by the first type of media processing resources to the media resource control device or multimedia processing device corresponding to other types in the media processing resource pool to process.
第二方面，本发明提供了一种媒体资源控制装置，包括：In a second aspect, the present invention provides a media resource control device, including:
分析单元，用于接收到多媒体处理任务时，分析处理所述多媒体处理任务所需要的媒体处理资源；The analysis unit is configured to analyze and process the media processing resources required by the multimedia processing task when receiving the multimedia processing task;
第一获取单元，用于获取媒体资源控制装置的当前空闲的媒体处理资源和与所述媒体资源控制装置相连接的至少一个多媒体处理装置的当前空闲的媒体处理资源；A first acquiring unit, configured to acquire the currently idle media processing resources of the media resource control device and the currently idle media processing resources of at least one multimedia processing device connected to the media resource control device;
第一分配单元，用于根据获取的所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源，将所述多媒体处理任务分配给所述媒体资源控制装置和/或至少所述一个多媒体处理装置进行处理。A first allocating unit, configured to allocate the multimedia processing task to the media resource control device and/or at least The one multimedia processing device performs processing.
在第一种可能的实现方式中，所述装置还包括：In a first possible implementation manner, the device further includes:
第二获取单元，用于获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小；A second obtaining unit, configured to obtain the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device;
构建单元，用于根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，构建媒体处理资源池；A construction unit, configured to construct a media processing resource pool according to the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device;
记录单元，用于在所述媒体处理资源池中记录所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。A recording unit, configured to record the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device in the media processing resource pool.
结合第二方面的第一种可能的实现方式，在第二种可能的实现方式中，所述装置还包括：With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner, the device further includes:
第三获取单元，用于周期性地获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小；A third acquiring unit, configured to periodically acquire the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device;
第一更新单元，用于根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。A first update unit, configured to update the corresponding types of idle media processing resources recorded in the media processing resource pool according to the type and size of the currently idle media processing resources of the media resource control device and the at least one multimedia processing device The size of the media processing resource.
结合第二方面的第一种可能的实现方式，在第三种可能的实现方式中，所述装置还包括：With reference to the first possible implementation manner of the second aspect, in a third possible implementation manner, the device further includes:
第四获取单元，用于当所述媒体处理任务占用或释放所述媒体处理资源池中的媒体处理资源时，获取占用或释放的所述媒体处理资源的类型和大小；A fourth acquiring unit, configured to acquire the type and size of the occupied or released media processing resource when the media processing task occupies or releases the media processing resource in the media processing resource pool;
第二更新单元，用于根据占用或释放的所述媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。The second updating unit is configured to respectively update the size of the corresponding type of idle media processing resource recorded in the media processing resource pool according to the type and size of the occupied or released media processing resource.
结合第二方面的第一种可能的实现方式或第二方面的第二种可能的实现方式或第二方面的第三种可能的实现方式，在第四种可能的实现方式中，所述第一获取单元包括：In combination with the first possible implementation of the second aspect or the second possible implementation of the second aspect or the third possible implementation of the second aspect, in a fourth possible implementation, the first An acquisition unit includes:
第五获取单元，用于根据分析得到的处理所述多媒体处理任务所需要的媒体处理资源的类型和大小，从所述媒体处理资源池中获取处理所述多媒体处理任务所需要的媒体处理资源。The fifth obtaining unit is configured to obtain the media processing resources required for processing the multimedia processing task from the media processing resource pool according to the analyzed type and size of the media processing resources required for processing the multimedia processing task.
结合第二方面的第一种可能的实现方式或第二方面的第二种可能的实现方式或第二方面的第三种可能的实现方式或第二方面的第四种可能的实现方式，在第五种可能的实现方式中，所述第一分配单元包括：In combination with the first possible implementation of the second aspect or the second possible implementation of the second aspect or the third possible implementation of the second aspect or the fourth possible implementation of the second aspect, in In a fifth possible implementation manner, the first allocating unit includes:
第六获取单元，用于获取所述媒体资源控制装置和所述至少一个多媒体处理装置在所述媒体处理资源池中的的当前空闲的媒体处理资源分别占所述媒体处理资源池中的总的当前空闲的媒体处理资源的比例；The sixth obtaining unit is configured to obtain the total number of currently idle media processing resources in the media processing resource pool of the media resource control device and the at least one multimedia processing device in the media processing resource pool respectively. The proportion of currently idle media processing resources;
第二分配单元，用于按照所述比例，分别将所述多媒体处理任务分配给所述媒体资源控制装置和至少一个多媒体处理装置进行处理。The second allocating unit is configured to respectively allocate the multimedia processing task to the media resource control device and at least one multimedia processing device for processing according to the ratio.
结合第二方面的第一种可能的实现方式或第二方面的第二种可能的实现方式或第二方面的第三种可能的实现方式或第二方面的第四种可能的实现方式，在第六种可能的实现方式中，所述第一分配单元包括：In combination with the first possible implementation of the second aspect or the second possible implementation of the second aspect or the third possible implementation of the second aspect or the fourth possible implementation of the second aspect, in In a sixth possible implementation manner, the first allocating unit includes:
第三分配单元，用于当所述媒体处理资源池中处理所述多媒体处理任务的第一类型的媒体处理资源少于处理所述多媒体处理任务所需要的媒体处理资源时，将所述多媒体处理任务分配给第一类型的媒体处理资源进行处理；The third allocating unit is configured to assign the multimedia processing resources to the multimedia processing resource pool when the media processing resources of the first type for processing the multimedia processing tasks in the media processing resource pool are less than the media processing resources required for processing the multimedia processing tasks. The task is allocated to the first type of media processing resource for processing;
第四分配单元，用于将所述多媒体处理任务中除所述第一类型的媒体处理资源处理的任务之外的剩余的任务，分配给所述媒体处理资源池中其它类型对应的所述媒体资源控制装置或多媒体处理装置进行处理。A fourth allocating unit, configured to allocate the remaining tasks in the multimedia processing tasks except the tasks processed by the first type of media processing resources to the media corresponding to other types in the media processing resource pool The resource control device or the multimedia processing device performs processing.
采用本发明提供的一种媒体资源控制方法及装置的技术方案，可以利用媒体处理系统中具有空闲的媒体处理资源的任意装置处理多媒体处理任务，提高了媒体处理资源的利用率。By adopting the technical scheme of the media resource control method and device provided by the present invention, any device with idle media processing resources in the media processing system can be used to process multimedia processing tasks, and the utilization rate of media processing resources is improved.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1为现有技术中一种应用场景下中央处理器CPU和图像处理器GPU的功能示意图；FIG. 1 is a functional schematic diagram of a central processing unit CPU and an image processing unit GPU in an application scenario in the prior art;
图2为现有技术中另一种应用场景下CPU和多个数字信号处理器DSP的功能示意图；FIG. 2 is a functional schematic diagram of a CPU and multiple digital signal processors DSPs in another application scenario in the prior art;
图3为本发明一种媒体资源控制方法的一个实施例的流程图；FIG. 3 is a flowchart of an embodiment of a media resource control method of the present invention;
图4为本发明一种媒体资源控制方法的另一个实施例的流程图；FIG. 4 is a flowchart of another embodiment of a media resource control method of the present invention;
图5为一种应用场景下媒体处理资源的汇聚示意图；FIG. 5 is a schematic diagram of aggregation of media processing resources in an application scenario;
图6为本发明一种媒体资源控制方法的又一个实施例的流程图；FIG. 6 is a flowchart of another embodiment of a media resource control method according to the present invention;
图7为本发明又一种应用场景下多媒体处理任务的分配示意图；FIG. 7 is a schematic diagram of allocation of multimedia processing tasks in another application scenario of the present invention;
图8为本发明再一种应用场景下多媒体处理任务的分配示意图；FIG. 8 is a schematic diagram of allocation of multimedia processing tasks in another application scenario of the present invention;
图9为一种媒体资源控制装置的一个实施例的结构示意图；FIG. 9 is a schematic structural diagram of an embodiment of a media resource control device;
图10为一种媒体资源控制装置的另一个实施例的结构示意图；FIG. 10 is a schematic structural diagram of another embodiment of a media resource control device;
图11为一种媒体资源控制装置的又一个实施例的结构示意图。Fig. 11 is a schematic structural diagram of another embodiment of a media resource control device.
具体实施方式detailed description
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
图3为本发明一种媒体资源控制方法的一个实施例的流程图。如图3所示，该方法包括：Fig. 3 is a flowchart of an embodiment of a media resource control method of the present invention. As shown in Figure 3, the method includes:
步骤S101，接收到多媒体处理任务时，媒体资源控制装置分析处理所述多媒体处理任务所需要的媒体处理资源。Step S101, when receiving a multimedia processing task, the media resource control device analyzes and processes the media processing resources required by the multimedia processing task.
由于目前媒体业务不断融合，进行渲染、编解码、会议混音、视频等多媒体任务处理的处理，需要具有强大能力的融合的多媒体处理系统。在本发明实施例中，多媒体处理系统包括多媒体任务接收装置、媒体资源控制装置和一个或多个多媒体处理装置。该多媒体任务接收装置从多媒体设备接收到多媒体处理任务时，将多媒体处理任务发送给媒体资源控制装置。该媒体资源控制装置对多媒体任务接收装置和多媒体处理装置进行任务的协同分配和控制，但该媒体资源控制装置除具有逻辑控制功能外，兼具了多媒体处理功能，例如，随着CPU能力的逐渐增强，目前CPU完全兼具了逻辑控制、媒体处理的能力，按目前的设计，CPU只完成逻辑控制功能，会出现CPU性能大量浪费的情况；同时，多媒体处理系统中还有一个或多个多媒体处理装置与该媒体资源控制装置相连，这些多媒体处理装置也具有多媒体处理功能。Due to the continuous integration of media services at present, the processing of multimedia tasks such as rendering, codec, conference audio mixing, and video requires an integrated multimedia processing system with powerful capabilities. In the embodiment of the present invention, the multimedia processing system includes a multimedia task receiving device, a media resource control device and one or more multimedia processing devices. When the multimedia task receiving means receives the multimedia processing task from the multimedia equipment, it sends the multimedia processing task to the media resource control means. The media resource control device performs task cooperative assignment and control on the multimedia task receiving device and the multimedia processing device, but the media resource control device not only has a logic control function, but also has a multimedia processing function. For example, as the CPU capability gradually Enhancement, the current CPU fully has the ability of logic control and media processing. According to the current design, the CPU only completes the logic control function, and there will be a lot of waste of CPU performance; at the same time, there are one or more multimedia processing systems in the multimedia processing system. The processing devices are connected to the media resource control device, and these multimedia processing devices also have multimedia processing functions.
处理一项多媒体处理任务需要一定的媒体处理资源，该媒体处理资源可以量化，例如，多媒体处理任务为需要创建50路会议通道，那么可以认为50路会议通道即为处理该多媒体处理任务所需要的媒体处理资源。媒体资源控制装置统一对接收到的多媒体处理任务进行分析，得到其所需要的媒体处理资源。Processing a multimedia processing task requires a certain amount of media processing resources, which can be quantified. For example, if a multimedia processing task needs to create 50 conference channels, then it can be considered that 50 conference channels are required for processing the multimedia processing task. Media processing resources. The media resource control device uniformly analyzes the received multimedia processing tasks to obtain the required media processing resources.
步骤S102，获取所述媒体资源控制装置的当前空闲的媒体处理资源和与所述媒体资源控制装置相连接的至少一个多媒体处理装置的当前空闲的媒体处理资源。Step S102, acquiring the currently idle media processing resources of the media resource control device and the currently idle media processing resources of at least one multimedia processing device connected to the media resource control device.
如果媒体资源控制装置和多媒体处理装置都具有空闲的媒体处理资源，这些媒体处理资源都可以用来处理当前的多媒体处理任务，这样可以使得媒体资源控制装置和多媒体处理装置的当前空闲的媒体处理资源得到合理利用。If both the media resource control device and the multimedia processing device have idle media processing resources, these media processing resources can be used to process the current multimedia processing task, so that the currently idle media processing resources of the media resource control device and the multimedia processing device can be be used reasonably.
步骤S103，根据获取的所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源，将所述多媒体处理任务分配给所述媒体资源控制装置和/或至少所述一个多媒体处理装置进行处理。Step S103, assigning the multimedia processing task to the media resource control device and/or the at least one multimedia processing device according to the acquired currently idle media processing resources of the media resource control device and the at least one multimedia processing device Processing device for processing.
媒体资源控制装置获取到媒体资源控制装置和一个或多个多媒体处理装置的的当前空闲的媒体处理资源后，可以将多媒体处理任务分配给该媒体资源控制装置和/或一个或多个多媒体处理装置进行处理。其分配方式多样，不作限制，可以是：按照各装置具有的当前媒体处理资源占媒体资源控制装置获取的总的当前媒体处理资源的比例进行多媒体任务的分配；或将多媒体处理任务主要分配给一专门的多媒体处理装置进行处理，该专门的多媒体处理装置的媒体处理资源不够处理该多媒体任务所需的媒体处理资源时，将剩余的多媒体处理任务交给其它装置处理；或将多媒体处理任务随机分配给当前空闲的媒体处理资源进行处理等等。After the media resource control device acquires the currently idle media processing resources of the media resource control device and one or more multimedia processing devices, it can allocate multimedia processing tasks to the media resource control device and/or one or more multimedia processing devices to process. The allocation methods are various and not limited, and may be: allocate multimedia tasks according to the ratio of the current media processing resources of each device to the total current media processing resources obtained by the media resource control device; or allocate multimedia processing tasks to a A dedicated multimedia processing device performs processing. When the media processing resources of the specialized multimedia processing device are not enough to handle the media processing resources required for the multimedia task, the remaining multimedia processing tasks are handed over to other devices for processing; or the multimedia processing tasks are randomly assigned Process the currently idle media processing resources and so on.
现有的媒体资源控制装置如多核处理器，一般兼具逻辑控制和多媒体处理能力，如果媒体资源控制装置仅完成逻辑控制功能，会出现性能大量浪费的情况，本发明充分挖掘了媒体资源控制装置的媒体处理资源，提高了媒体资源控制装置的媒体处理资源的利用率。具体地，可以使用主机媒体处理(Host Media Processing，HMP)技术，将多核处理器实现逻辑控制功能外的剩余硬件资源(如空闲CPU核)构建媒体处理能力。Existing media resource control devices, such as multi-core processors, generally have both logic control and multimedia processing capabilities. If the media resource control device only completes the logic control function, a large amount of performance will be wasted. The present invention fully exploits the media resource control device. media processing resources, improving the utilization rate of the media processing resources of the media resource control device. Specifically, a host media processing (Host Media Processing, HMP) technology may be used to construct a media processing capability by using the remaining hardware resources (such as idle CPU cores) outside the logic control function implemented by the multi-core processor.
同时，由于多媒体处理装置如DSP、GPU等均能够处理录放音、会议混音、音视频转码等应用，通过本发明将多媒体处理任务分配给媒体处理系统中的一个或多个多媒体处理装置进行处理，可以提高多媒体处理装置的媒体处理资源的利用率，并能够处理单独的多媒体处理装置无法处理的大型多媒体处理任务。At the same time, since multimedia processing devices such as DSP and GPU can handle applications such as recording and playback, conference audio mixing, and audio and video transcoding, multimedia processing tasks are assigned to one or more multimedia processing devices in the media processing system through the present invention. The processing can improve the utilization rate of media processing resources of the multimedia processing device, and can handle large-scale multimedia processing tasks that cannot be handled by a single multimedia processing device.
根据本发明实施例提供的一种媒体资源控制方法，可以利用媒体处理系统中具有空闲的媒体处理资源的任意装置处理多媒体处理任务，提高了媒体处理资源的利用率。According to a media resource control method provided by an embodiment of the present invention, any device with idle media processing resources in a media processing system can be used to process multimedia processing tasks, thereby improving the utilization rate of media processing resources.
图4为本发明一种媒体资源控制方法的另一个实施例的流程图。如图4所示，该方法包括：Fig. 4 is a flow chart of another embodiment of a media resource control method according to the present invention. As shown in Figure 4, the method includes:
步骤S201，获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。Step S201, acquiring the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
步骤S202，根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，构建媒体处理资源池。Step S202, constructing a media processing resource pool according to the types and sizes of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
步骤S203，在所述媒体处理资源池中记录所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。Step S203, recording the type and size of the currently idle media processing resources of the media resource control device and the at least one multimedia processing device in the media processing resource pool.
步骤S201至步骤S203为建立媒体处理资源池的过程。将媒体资源控制装置和多媒体处理系统中的所有多媒体处理装置的媒体处理资源进行汇聚，构建成一个统一的媒体处理资源池，由媒体资源控制装置对该媒体处理资源池的媒体处理资源进行统一调度处理。在该媒体处理资源池中，按照媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，构建该媒体处理资源池，在该媒体处理资源池中记录这些媒体处理资源的类型和大小。Step S201 to step S203 are the process of establishing a media processing resource pool. Converge the media processing resources of all multimedia processing devices in the media resource control device and the multimedia processing system to form a unified media processing resource pool, and the media resource control device performs unified scheduling on the media processing resources in the media processing resource pool deal with. In the media processing resource pool, construct the media processing resource pool according to the type and size of the currently idle media processing resources of the media resource control device and each multimedia processing device, and record the information of these media processing resources in the media processing resource pool type and size.
如图5所示，该图中的媒体资源控制装置为CPU，该CPU中的媒体资源控制(MediaResource Control，MRC)模块对所有媒体处理资源进行控制，该CPU还包括编码和解码模块；图5中的多媒体处理装置包括多个GPU和DSP，每个DSP具有专有的编码和解码功能，每个GPU具有专有的渲染功能；但同时，CPU、GPU和DSP也具有其它多媒体任务处理功能。但MRC将CPU、GPU和DSP按照各自的专有的处理功能进行媒体处理资源的类型划分依据，根据该类型，分别记录媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源的大小，构建统一的媒体处理资源池，由MRC进行统一调度。As shown in Figure 5, the media resource control device in this figure is a CPU, and the Media Resource Control (MediaResource Control, MRC) module in the CPU controls all media processing resources, and the CPU also includes encoding and decoding modules; Figure 5 The multimedia processing device in the system includes a plurality of GPUs and DSPs, each DSP has a dedicated encoding and decoding function, and each GPU has a dedicated rendering function; but at the same time, the CPU, GPU and DSP also have other multimedia task processing functions. However, MRC divides CPU, GPU, and DSP according to their respective proprietary processing functions as the basis for the type of media processing resources. According to this type, the size of the currently idle media processing resources of the media resource control device and each multimedia processing device is respectively recorded. Construct a unified media processing resource pool, and the MRC will conduct unified scheduling.
步骤S204，周期性地获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。Step S204, periodically acquire the types and sizes of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
步骤S205，根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。Step S205, according to the type and size of the currently idle media processing resources of the media resource control device and the at least one multimedia processing device, respectively update the corresponding types of idle media processing resources recorded in the media processing resource pool size.
由于进行多媒体任务的处理需要占用媒体处理资源池中的媒体处理资源，以及完成多媒体任务的处理后，又要释放占用的媒体处理资源，但为了媒体处理资源池中媒体处理资源更新的简便，可以以设定的周期周期性地获取媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，对媒体处理资源池中记录的对应的类型的媒体处理资源进行大小的更新，以使得后续处理多媒体处理任务时，可以准确地调用媒体处理资源池中的媒体处理资源。Since the processing of multimedia tasks needs to occupy the media processing resources in the media processing resource pool, and after the processing of multimedia tasks is completed, the occupied media processing resources must be released, but for the convenience of updating the media processing resources in the media processing resource pool, you can Periodically acquire the type and size of the currently idle media processing resources of the media resource control device and each multimedia processing device at a set period, and update the size of the corresponding type of media processing resources recorded in the media processing resource pool, So that the media processing resources in the media processing resource pool can be accurately invoked when the multimedia processing task is subsequently processed.
步骤S206，接收到多媒体处理任务时，媒体资源控制装置分析处理所述多媒体处理任务所需要的媒体处理资源。Step S206, when receiving a multimedia processing task, the media resource control device analyzes and processes the media processing resources required by the multimedia processing task.
处理一项某一类型的多媒体处理任务需要一定大小的媒体处理资源，由媒体处理系统中的媒体资源控制装置统一对接收到的多媒体处理任务进行分析，得到其所需要的媒体处理资源的类型和大小。Processing a certain type of multimedia processing task requires a certain size of media processing resources, and the media resource control device in the media processing system uniformly analyzes the received multimedia processing tasks to obtain the type and size of the media processing resources it needs. size.
步骤S207，根据分析得到的处理所述多媒体处理任务所需要的媒体处理资源的类型和大小，从所述媒体处理资源池中获取处理所述多媒体处理任务所需要的媒体处理资源。Step S207, according to the type and size of the media processing resource required for processing the multimedia processing task obtained through analysis, acquire the media processing resource required for processing the multimedia processing task from the media processing resource pool.
由于媒体处理资源池中按照类型分别记录了媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源的大小，所以，根据分析得到的处理所述多媒体处理任务所需要的媒体处理资源的类型和大小，可以直接从媒体处理资源池中获取处理该多媒体处理任务所需要的媒体处理资源，但是，该获取的媒体处理资源的类型不一定要完全与多媒体处理任务的类型完全对应，媒体资源控制装置和各个多媒体处理装置均具有处理任何多媒体处理任务的能力。Since the size of the currently idle media processing resources of the media resource control device and each multimedia processing device is respectively recorded according to the type in the media processing resource pool, the type of the media processing resources required to process the multimedia processing task obtained according to the analysis and size, the media processing resources needed to process the multimedia processing task can be obtained directly from the media processing resource pool, but the type of the obtained media processing resource does not necessarily have to completely correspond to the type of the multimedia processing task, the media resource control The device and each multimedia processing device are capable of handling any multimedia processing task.
步骤S208，获取所述媒体资源控制装置和所述至少一个多媒体处理装置在所述媒体处理资源池中的当前空闲的媒体处理资源分别占所述媒体处理资源池中的总的当前空闲的媒体处理资源的比例；Step S208, obtaining the currently idle media processing resources in the media processing resource pool of the media resource control device and the at least one multimedia processing device respectively accounting for the total currently idle media processing resources in the media processing resource pool proportion of resources;
步骤S209，按照所述比例，分别将所述多媒体处理任务分配给所述媒体资源控制装置和至少一个多媒体处理装置进行处理。Step S209, according to the ratio, respectively assign the multimedia processing task to the media resource control device and at least one multimedia processing device for processing.
当进行多媒体处理任务的分配时，获取媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源占媒体处理资源池中的总的当前空闲的媒体处理资源的比例，按照该比例将多媒体处理任务分配给媒体资源控制装置和各个多媒体处理装置进行处理。例如，当接收到多媒体处理任务时，计算获得媒体资源控制装置的当前空闲的媒体处理资源占媒体处理资源池中的总的当前空闲的媒体处理资源的比例为20%，一个GPU的当前空闲的媒体处理资源占媒体处理资源池中的总的当前空闲的媒体处理资源的比例为30%，一个DSP的当前空闲的媒体处理资源占媒体处理资源池中的总的当前空闲的媒体处理资源的比例为50%，则分别按照20%、30%和50%的比例将该多媒体处理任务分配给媒体资源控制装置、GPU和DSP处理。按照比例进行分配，使各个装置恰当地分担多媒体处理任务，而不是将多媒体处理任务全部分给某一个装置进行处理，不至于使某个装置负荷过重。When allocating multimedia processing tasks, the ratio of the currently idle media processing resources of the media resource control device and each multimedia processing device to the total currently idle media processing resources in the media processing resource pool is acquired, and the multimedia processing resources are allocated according to this ratio The task is distributed to the media resource control device and each multimedia processing device for processing. For example, when a multimedia processing task is received, the calculation obtains that the currently idle media processing resources of the media resource control device account for 20% of the total currently idle media processing resources in the media processing resource pool, and the currently idle media processing resources of a GPU The ratio of media processing resources to the total currently idle media processing resources in the media processing resource pool is 30%, and the ratio of the currently idle media processing resources of a DSP to the total currently idle media processing resources in the media processing resource pool is 50%, the multimedia processing task is assigned to the media resource control device, GPU and DSP according to the proportions of 20%, 30% and 50% respectively. The allocation is carried out in proportion, so that each device can appropriately share the multimedia processing tasks, instead of assigning all the multimedia processing tasks to a certain device for processing, so as not to overload a certain device.
根据本发明实施例提供的一种媒体资源控制方法，通过构建媒体处理资源池，将媒体处理系统中任意装置的具有空闲的媒体处理资源进行汇聚，由媒体资源控制装置统一调度媒体处理资源池中的空闲的媒体处理资源进行多媒体处理任务的处理，提高了媒体处理资源的利用率，且按比例进行多媒体任务的分配，可以使媒体资源控制装置和各个多媒体处理装置恰当地分担多媒体处理任务。According to a media resource control method provided by an embodiment of the present invention, by constructing a media processing resource pool, the idle media processing resources of any device in the media processing system are aggregated, and the media resource control device uniformly schedules the media processing resource pool The idle media processing resources are used to process the multimedia processing tasks, which improves the utilization rate of the media processing resources, and distributes the multimedia tasks in proportion, so that the media resource control device and each multimedia processing device can properly share the multimedia processing tasks.
图6为本发明一种媒体资源控制方法的又一个实施例的流程图。如图6所示，该方法包括：Fig. 6 is a flow chart of another embodiment of a media resource control method according to the present invention. As shown in Figure 6, the method includes:
步骤S301，获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。Step S301, acquiring the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
步骤S302，根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，构建媒体处理资源池。Step S302, constructing a media processing resource pool according to the types and sizes of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
步骤S303，在所述媒体处理资源池中记录所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。Step S303, recording the type and size of the currently idle media processing resources of the media resource control device and the at least one multimedia processing device in the media processing resource pool.
步骤S301至步骤S303为构建媒体处理资源池的过程，与前述实施例的构建媒体处理资源池的步骤一致，在此不再赘述。Steps S301 to S303 are the process of constructing the media processing resource pool, which is consistent with the steps of constructing the media processing resource pool in the foregoing embodiment, and will not be repeated here.
步骤S304，接收到多媒体处理任务时，媒体资源控制装置分析处理所述多媒体处理任务所需要的媒体处理资源。Step S304, when a multimedia processing task is received, the media resource control device analyzes and processes the media processing resources required by the multimedia processing task.
步骤S305，根据分析得到的处理所述多媒体处理任务所需要的媒体处理资源的类型和大小，从所述媒体处理资源池中获取处理所述多媒体处理任务所需要的媒体处理资源。Step S305, according to the type and size of the media processing resource required for processing the multimedia processing task obtained through analysis, acquire the media processing resource required for processing the multimedia processing task from the media processing resource pool.
步骤S306，当所述媒体处理资源池中处理所述多媒体处理任务的第一类型的媒体处理资源少于处理所述多媒体处理任务所需要的媒体处理资源时，将所述多媒体处理任务分配给第一类型的媒体处理资源进行处理。Step S306, when the media processing resources of the first type for processing the multimedia processing task in the media processing resource pool are less than the media processing resources required for processing the multimedia processing task, allocating the multimedia processing task to the second A type of media processing resource for processing.
步骤S307，将所述多媒体处理任务中除所述第一类型的媒体处理资源处理的任务之外的剩余的任务，分配给所述媒体处理资源池中其它类型对应的所述媒体资源控制装置或多媒体处理装置进行处理。Step S307, allocating the remaining tasks of the multimedia processing tasks except the tasks processed by the first type of media processing resource to the media resource control device or other corresponding types in the media processing resource pool The multimedia processing device performs processing.
步骤S304至步骤S307为接收到多媒体处理任务时，从媒体处理资源池中获取媒体处理资源进行多媒体处理任务的处理过程，与前述实施例的不同之处在于，本实施例中，媒体资源控制装置将某一类型的多媒体处理任务首先分配给具有对应该类型的专门的媒体处理资源的媒体资源控制装置或多媒体处理装置进行处理，但当该装置的媒体处理资源不足以处理该多媒体处理任务时，需要根据从媒体处理资源池中获取的各个装置的当前空闲的媒体处理资源的类型和大小，按照各个装置的当前空闲的媒体处理资源占媒体处理资源池中的媒体处理资源的比例，将不能处理的多媒体处理任务按该比例分别给媒体资源控制装置和各个多媒体处理装置进行处理，或者随机地将剩余多媒体处理任务分配给几个或全部媒体资源控制装置和各个多媒体处理装置进行处理。Steps S304 to S307 are the process of obtaining media processing resources from the media processing resource pool to perform multimedia processing tasks when a multimedia processing task is received. The difference from the previous embodiment is that in this embodiment, the media resource control device A certain type of multimedia processing task is first assigned to a media resource control device or a multimedia processing device with dedicated media processing resources corresponding to the type for processing, but when the media processing resources of the device are not enough to process the multimedia processing task, According to the type and size of the currently idle media processing resources of each device obtained from the media processing resource pool, and according to the proportion of the currently idle media processing resources of each device to the media processing resources in the media processing resource pool, it will not be able to process The multimedia processing tasks are respectively processed by the media resource control device and each multimedia processing device according to the ratio, or the remaining multimedia processing tasks are randomly assigned to several or all media resource control devices and each multimedia processing device for processing.
下面通过两个应用场景进行详细阐述。The following describes in detail through two application scenarios.
如图7所示，多媒体处理系统接收到创建50路会议通道的请求。GPU具有专门的会议处理功能，但MRC从媒体处理资源池中获悉当前GPU无会议资源，同时DSP只有40路会议资源，无法满足业务请求，而CPU的媒体处理单元仍然有10路的会议资源；此时MRC按照DSP和CPU的媒体处理单元具有的当前空闲的会议资源的比例，分配10路会议请求到CPU的媒体处理单元，并分配40路到DSP的媒体处理单元。通过CPU媒体处理单元与DSP媒体处理单元的协同处理，提供50路会议通道。As shown in FIG. 7 , the multimedia processing system receives a request for creating 50 conference channels. The GPU has special conference processing functions, but MRC learns from the media processing resource pool that the current GPU has no conference resources, and at the same time, the DSP only has 40 conference resources, which cannot meet business requests, and the CPU's media processing unit still has 10 conference resources; At this time, the MRC allocates 10 conference requests to the CPU media processing unit and 40 conference requests to the DSP media processing unit according to the ratio of the currently idle conference resources of the DSP and the CPU media processing unit. Through the cooperative processing of the CPU media processing unit and the DSP media processing unit, 50 conference channels are provided.
如图8所示，多媒体处理系统接收到创建1080P图像渲染请求。GPU具有专门的渲染功能，MRC首先从媒体处理资源池获悉当前GPU的渲染资源不足，同时获悉DSP和CPU的媒体处理单元具有空闲的渲染资源；此时MRC对1080P图像进行切割，首先，充分利用GPU的渲染资源，将部分图像渲染任务分配给GPU，然后，随机分配部分图像渲染到CPU的媒体处理单元，并分配另外一部分图像渲染到DSP；通过GPU、DSP与CPU的媒体处理单元的协同处理，完成1080P图像渲染的处理。As shown in FIG. 8 , the multimedia processing system receives a request to create a 1080P image rendering. GPU has a special rendering function. MRC first learns from the media processing resource pool that the current rendering resources of the GPU are insufficient, and at the same time learns that the media processing units of the DSP and CPU have idle rendering resources; at this time, the MRC cuts the 1080P image. First, make full use of The rendering resources of the GPU, assign part of the image rendering tasks to the GPU, and then randomly assign part of the image rendering to the CPU media processing unit, and assign the other part of the image rendering to the DSP; through the cooperative processing of the GPU, DSP and CPU media processing unit , complete the processing of 1080P image rendering.
步骤S308，当所述媒体处理任务占用所述媒体处理资源池中的媒体处理资源时，获取占用的所述媒体处理资源的类型和大小，并根据占用的所述媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。Step S308, when the media processing task occupies a media processing resource in the media processing resource pool, obtain the type and size of the occupied media processing resource, and according to the type and size of the occupied media processing resource, Respectively update the sizes of corresponding types of idle media processing resources recorded in the media processing resource pool.
步骤S309，当所述媒体处理任务释放所述媒体处理资源池中的媒体处理资源时，获取释放的所述媒体处理资源的类型和大小，并根据释放的所述媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。Step S309, when the media processing task releases the media processing resource in the media processing resource pool, obtain the type and size of the released media processing resource, and according to the type and size of the released media processing resource, Respectively update the sizes of corresponding types of idle media processing resources recorded in the media processing resource pool.
处理多媒体处理任务时，会从媒体处理资源池中占用一部分空闲的媒体处理资源，为了同时处理其它多媒体处理任务时，能准确地从媒体处理资源池中调用空闲的媒体处理资源，当媒体处理资源池的某一类型的媒体处理资源被当前的多媒体处理任务占用时，需要更新媒体处理资源池中该类型的媒体处理资源的大小，减去被占用的媒体处理资源的大小。When processing multimedia processing tasks, a part of idle media processing resources will be occupied from the media processing resource pool. In order to process other multimedia processing tasks at the same time, idle media processing resources can be accurately called from the media processing resource pool. When a certain type of media processing resource in the pool is occupied by the current multimedia processing task, it is necessary to update the size of the type of media processing resource in the media processing resource pool and subtract the size of the occupied media processing resource.
当前多媒体处理任务完成时，会释放所占用的媒体处理资源，该部分空闲的媒体处理资源需要记录至媒体处理资源池，以备后续多媒体处理任务时调用。按照释放的媒体处理资源的类型，在媒体处理资源池中该类型的媒体处理资源中增加释放的媒体处理资源的大小。When the current multimedia processing task is completed, the occupied media processing resources will be released, and the idle media processing resources need to be recorded in the media processing resource pool, so as to be called in subsequent multimedia processing tasks. According to the type of the released media processing resource, the size of the released media processing resource is added to the type of media processing resource in the media processing resource pool.
根据本发明实施例提供的一种媒体资源控制方法，通过构建媒体处理资源池，将媒体处理系统中任意装置的具有空闲的媒体处理资源进行汇聚，由媒体资源控制装置统一调度媒体处理资源池中的空闲的媒体处理资源进行多媒体处理任务的处理，提高了媒体处理资源的利用率，且将多媒体处理任务优先采用媒体处理资源池中相应类型的媒体处理资源进行处理，有利于高效利用媒体处理资源。According to a media resource control method provided by an embodiment of the present invention, by constructing a media processing resource pool, the idle media processing resources of any device in the media processing system are aggregated, and the media resource control device uniformly schedules the media processing resource pool The idle media processing resources are used to process multimedia processing tasks, which improves the utilization rate of media processing resources, and the multimedia processing tasks are preferentially processed by the corresponding types of media processing resources in the media processing resource pool, which is conducive to the efficient use of media processing resources .
图9为一种媒体资源控制装置的一个实施例的结构示意图。如图9所示，该装置1000包括：Fig. 9 is a schematic structural diagram of an embodiment of a media resource control device. As shown in Figure 9, the device 1000 includes:
分析单元11，用于接收到多媒体处理任务时，媒体资源控制装置分析处理所述多媒体处理任务所需要的媒体处理资源。The analysis unit 11 is configured to, when receiving a multimedia processing task, the media resource control device analyze and process the media processing resources required by the multimedia processing task.
处理一项多媒体处理任务需要一定的媒体处理资源，该媒体处理资源可以量化，例如，多媒体处理任务为需要创建50路会议通道，那么可以认为50路会议通道即为处理该多媒体处理任务所需要的媒体处理资源。由媒体处理系统中的媒体资源控制装置，具体由分析单元11统一对接收到的多媒体处理任务进行分析，得到其所需要的媒体处理资源。Processing a multimedia processing task requires a certain amount of media processing resources, which can be quantified. For example, if a multimedia processing task needs to create 50 conference channels, then it can be considered that 50 conference channels are required for processing the multimedia processing task. Media processing resources. The media resource control device in the media processing system, specifically, the analysis unit 11 uniformly analyzes the received multimedia processing tasks to obtain the required media processing resources.
第一获取单元12，用于获取媒体资源控制装置的当前空闲的媒体处理资源和与所述媒体资源控制装置相连接的至少一个多媒体处理装置的当前空闲的媒体处理资源。The first acquiring unit 12 is configured to acquire the currently idle media processing resources of the media resource control device and the currently idle media processing resources of at least one multimedia processing device connected to the media resource control device.
如果媒体资源控制装置和多媒体处理装置都具有空闲的媒体处理资源，这些媒体处理资源都可以用来处理当前的多媒体处理任务，这样可以使得媒体资源控制装置和多媒体处理装置的当前空闲的媒体处理资源得到合理利用。If both the media resource control device and the multimedia processing device have idle media processing resources, these media processing resources can be used to process the current multimedia processing task, so that the currently idle media processing resources of the media resource control device and the multimedia processing device can be be used reasonably.
第一分配单元13，用于根据获取的所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源，将所述多媒体处理任务分配给所述媒体资源控制装置和/或至少所述一个多媒体处理装置进行处理。The first allocating unit 13 is configured to allocate the multimedia processing task to the media resource control device and/or according to the acquired currently idle media processing resources of the media resource control device and the at least one multimedia processing device At least the one multimedia processing device performs processing.
第一获取单元12获取到媒体资源控制装置和一个或多个多媒体处理装置的的当前空闲的媒体处理资源后，第一分配单元13可以将多媒体处理任务分配给该媒体资源控制装置和/或一个或多个多媒体处理装置进行处理。其分配方式多样，不作限制，可以是：按照各装置具有的当前媒体处理资源占媒体资源控制装置获取的总的当前媒体处理资源的比例进行多媒体任务的分配；或将多媒体处理任务主要分配给一专门的多媒体处理装置进行处理，该专门的多媒体处理装置的媒体处理资源不够处理该多媒体任务所需的媒体处理资源时，将剩余的多媒体处理任务交给其它装置处理；或将多媒体处理任务随机分配给当前空闲的媒体处理资源进行处理等等。After the first acquisition unit 12 acquires the currently idle media processing resources of the media resource control device and one or more multimedia processing devices, the first allocation unit 13 may allocate multimedia processing tasks to the media resource control device and/or one or multiple multimedia processing devices for processing. The allocation methods are various and not limited, and may be: allocate multimedia tasks according to the ratio of the current media processing resources of each device to the total current media processing resources obtained by the media resource control device; or allocate multimedia processing tasks to a A dedicated multimedia processing device performs processing. When the media processing resources of the specialized multimedia processing device are not enough to handle the media processing resources required for the multimedia task, the remaining multimedia processing tasks are handed over to other devices for processing; or the multimedia processing tasks are randomly assigned Process the currently idle media processing resources and so on.
现有的媒体资源控制装置如多核处理器，一般兼具逻辑控制和多媒体处理能力，如果媒体资源控制装置仅完成逻辑控制功能，会出现性能大量浪费的情况，本发明充分挖掘了媒体资源控制装置的媒体处理资源，提高了媒体资源控制装置的媒体处理资源的利用率。具体地，可以使用主机媒体处理(Host Media Processing，HMP)技术，将多核处理器实现逻辑控制功能外的剩余硬件资源(如空闲CPU核)构建媒体处理能力。Existing media resource control devices, such as multi-core processors, generally have both logic control and multimedia processing capabilities. If the media resource control device only completes the logic control function, a large amount of performance will be wasted. The present invention fully exploits the media resource control device. media processing resources, improving the utilization rate of the media processing resources of the media resource control device. Specifically, a host media processing (Host Media Processing, HMP) technology may be used to construct a media processing capability by using the remaining hardware resources (such as idle CPU cores) outside the logic control function implemented by the multi-core processor.
同时，由于多媒体处理装置如DSP、GPU等均能够处理录放音、会议混音、音视频转码等应用，通过本发明将多媒体处理任务分配给媒体处理系统中的一个或多个多媒体处理装置进行处理，可以提高多媒体处理装置的媒体处理资源的利用率，并能够处理单独的多媒体处理装置无法处理的大型多媒体处理任务。At the same time, since multimedia processing devices such as DSP and GPU can handle applications such as recording and playback, conference audio mixing, and audio and video transcoding, multimedia processing tasks are assigned to one or more multimedia processing devices in the media processing system through the present invention. The processing can improve the utilization rate of media processing resources of the multimedia processing device, and can handle large-scale multimedia processing tasks that cannot be handled by a single multimedia processing device.
根据本发明实施例提供的一种媒体资源控制装置，可以利用媒体处理系统中具有空闲的媒体处理资源的任意装置处理多媒体处理任务，提高了媒体处理资源的利用率。According to a media resource control device provided in an embodiment of the present invention, any device with idle media processing resources in a media processing system can be used to process multimedia processing tasks, thereby improving the utilization rate of media processing resources.
图10为一种媒体资源控制装置的另一个实施例的结构示意图。如图10所示，该装置2000包括：Fig. 10 is a schematic structural diagram of another embodiment of a media resource control device. As shown in Figure 10, the device 2000 includes:
第二获取单元21，用于获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。The second obtaining unit 21 is configured to obtain the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
构建单元22，用于根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，构建媒体处理资源池。The construction unit 22 is configured to construct a media processing resource pool according to the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
记录单元23，用于在所述媒体处理资源池中记录所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。The recording unit 23 is configured to record the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device in the media processing resource pool.
第二获取单元21、构建单元22和记录单元23的功能为建立媒体处理资源池。将媒体资源控制装置和多媒体处理系统中的所有多媒体处理装置的媒体处理资源进行汇聚，构建成一个统一的媒体处理资源池，由媒体资源控制装置对该媒体处理资源池的媒体处理资源进行统一调度处理。在该媒体处理资源池中，按照媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，构建该媒体处理资源池，在该媒体处理资源池中记录这些媒体处理资源的类型和大小。The functions of the second acquisition unit 21 , the construction unit 22 and the recording unit 23 are to establish a media processing resource pool. Converge the media processing resources of all multimedia processing devices in the media resource control device and the multimedia processing system to form a unified media processing resource pool, and the media resource control device performs unified scheduling on the media processing resources in the media processing resource pool deal with. In the media processing resource pool, construct the media processing resource pool according to the type and size of the currently idle media processing resources of the media resource control device and each multimedia processing device, and record the information of these media processing resources in the media processing resource pool type and size.
第三获取单元24，用于周期性地获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。The third obtaining unit 24 is configured to periodically obtain the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
第一更新单元25，用于根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。The first update unit 25 is configured to respectively update the corresponding types of free media processing resources recorded in the media processing resource pool according to the type and size of the currently idle media processing resources of the media resource control device and the at least one multimedia processing device The size of the media processing resource.
由于进行多媒体任务的处理需要占用媒体处理资源池中的媒体处理资源，以及完成多媒体任务的处理后，又要释放占用的媒体处理资源，但为了媒体处理资源池中媒体处理资源更新的简便，可以以设定的周期，第三获取单元24周期性地获取媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，第一更新单元25对媒体处理资源池中记录的对应的类型的媒体处理资源进行大小的更新，以使得后续处理多媒体处理任务时，可以准确地调用媒体处理资源池中的媒体处理资源。Since the processing of multimedia tasks needs to occupy the media processing resources in the media processing resource pool, and after the processing of multimedia tasks is completed, the occupied media processing resources must be released, but for the convenience of updating the media processing resources in the media processing resource pool, you can With a set period, the third obtaining unit 24 periodically obtains the type and size of the currently idle media processing resources of the media resource control device and each multimedia processing device, and the first updating unit 25 corresponds to the corresponding information recorded in the media processing resource pool. The size of the media processing resources of different types is updated, so that the media processing resources in the media processing resource pool can be accurately called when the multimedia processing tasks are subsequently processed.
分析单元26，用于接收到多媒体处理任务时，分析处理所述多媒体处理任务所需要的媒体处理资源。The analysis unit 26 is configured to analyze and process the media processing resources required by the multimedia processing task when receiving the multimedia processing task.
处理一项某一类型的多媒体处理任务需要一定大小的媒体处理资源，由分析单元26统一对接收到的多媒体处理任务进行分析，得到其所需要的媒体处理资源的类型和大小。Processing a certain type of multimedia processing task requires a certain size of media processing resources, and the analysis unit 26 uniformly analyzes the received multimedia processing tasks to obtain the type and size of the required media processing resources.
第一获取单元27，用于获取媒体资源控制装置的当前空闲的媒体处理资源和与所述媒体资源控制装置相连接的至少一个多媒体处理装置的当前空闲的媒体处理资源。The first acquiring unit 27 is configured to acquire the currently idle media processing resources of the media resource control device and the currently idle media processing resources of at least one multimedia processing device connected to the media resource control device.
在本实施例中，第一获取单元27包括第五获取单元271。In this embodiment, the first obtaining unit 27 includes a fifth obtaining unit 271 .
第五获取单元271，用于根据分析得到的处理所述多媒体处理任务所需要的媒体处理资源的类型和大小，从所述媒体处理资源池中获取处理所述多媒体处理任务所需要的媒体处理资源。The fifth obtaining unit 271 is configured to obtain the media processing resources required for processing the multimedia processing task from the media processing resource pool according to the analyzed type and size of the media processing resources required for processing the multimedia processing task .
由于媒体处理资源池中按照类型分别记录了媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源的大小，所以，第五获取单元271根据分析得到的处理所述多媒体处理任务所需要的媒体处理资源的类型和大小，可以直接从媒体处理资源池中获取处理该多媒体处理任务所需要的媒体处理资源，但是，该获取的媒体处理资源的类型不一定要完全与多媒体处理任务的类型完全对应，媒体资源控制装置和各个多媒体处理装置均具有处理任何多媒体处理任务的能力。Since the size of the currently idle media processing resources of the media resource control device and each multimedia processing device is respectively recorded in the media processing resource pool according to the type, the fifth acquisition unit 271 obtains according to the The type and size of the media processing resources can directly obtain the media processing resources required for processing the multimedia processing task from the media processing resource pool, but the type of the obtained media processing resources does not have to be exactly the same as the type of the multimedia processing task Correspondingly, both the media resource control device and each multimedia processing device are capable of processing any multimedia processing task.
第一分配单元28，用于根据获取的所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源，将所述多媒体处理任务分配给所述媒体资源控制装置和/或至少所述一个多媒体处理装置进行处理。The first allocating unit 28 is configured to allocate the multimedia processing task to the media resource control device and/or according to the acquired currently idle media processing resources of the media resource control device and the at least one multimedia processing device At least the one multimedia processing device performs processing.
在本实施例中，第一分配单元28包括第六获取单元281和第二分配单元282。In this embodiment, the first allocation unit 28 includes a sixth acquisition unit 281 and a second allocation unit 282 .
第六获取单元281，用于获取所述媒体资源控制装置和所述至少一个多媒体处理装置在所述媒体处理资源池中的当前空闲的媒体处理资源分别占所述媒体处理资源池中的总的当前空闲的媒体处理资源的比例；The sixth obtaining unit 281 is configured to obtain the total number of currently idle media processing resources in the media processing resource pool of the media resource control device and the at least one multimedia processing device in the media processing resource pool respectively. The proportion of currently idle media processing resources;
第二分配单元282，用于按照所述比例，分别将所述多媒体处理任务分配给所述媒体资源控制装置和至少一个多媒体处理装置进行处理。The second allocating unit 282 is configured to respectively allocate the multimedia processing task to the media resource control device and at least one multimedia processing device for processing according to the ratio.
当进行多媒体处理任务的分配时，第六获取单元281获取媒体资源控制装置和各个多媒体处理装置的当前空闲的媒体处理资源占媒体处理资源池中的总的当前空闲的媒体处理资源的比例，第二分配单元282按照该比例将多媒体处理任务分配给媒体资源控制装置和各个多媒体处理装置进行处理。按照比例进行分配，使各个装置恰当地分担多媒体处理任务，而不是将多媒体处理任务全部分给某一个装置进行处理，不至于使某个装置负荷过重。When allocating multimedia processing tasks, the sixth obtaining unit 281 obtains the ratio of the currently idle media processing resources of the media resource control device and each multimedia processing device to the total currently idle media processing resources in the media processing resource pool. The second allocating unit 282 allocates the multimedia processing task to the media resource control device and each multimedia processing device for processing according to the ratio. The allocation is carried out in proportion, so that each device can appropriately share the multimedia processing tasks, instead of assigning all the multimedia processing tasks to a certain device for processing, so as not to overload a certain device.
根据本发明实施例提供的一种媒体资源控制装置，通过构建媒体处理资源池，将媒体处理系统中任意装置的具有空闲的媒体处理资源进行汇聚，由媒体资源控制装置统一调度媒体处理资源池中的空闲的媒体处理资源进行多媒体处理任务的处理，提高了媒体处理资源的利用率，且按比例进行多媒体任务的分配，可以使媒体资源控制装置和各个多媒体处理装置恰当地分担多媒体处理任务。According to a media resource control device provided in an embodiment of the present invention, by constructing a media processing resource pool, the idle media processing resources of any device in the media processing system are aggregated, and the media resource control device uniformly schedules the media processing resource pool The idle media processing resources are used to process the multimedia processing tasks, which improves the utilization rate of the media processing resources, and distributes the multimedia tasks in proportion, so that the media resource control device and each multimedia processing device can properly share the multimedia processing tasks.
图11为一种媒体资源控制装置的又一个实施例的结构示意图。如图11所示，该装置3000包括：Fig. 11 is a schematic structural diagram of another embodiment of a media resource control device. As shown in Figure 11, the device 3000 includes:
第二获取单元31，用于获取所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。The second obtaining unit 31 is configured to obtain the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
构建单元32，用于根据所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小，构建媒体处理资源池。The construction unit 32 is configured to construct a media processing resource pool according to the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device.
记录单元33，用于在所述媒体处理资源池中记录所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源的类型和大小。The recording unit 33 is configured to record the type and size of currently idle media processing resources of the media resource control device and the at least one multimedia processing device in the media processing resource pool.
第二获取单元31、构建单元32和记录单元33的功能为建立媒体处理资源池，其功能分别与前述实施例的第二获取单元21、构建单元22和记录单元23的功能相同，在此不再赘述。The functions of the second acquiring unit 31, the constructing unit 32 and the recording unit 33 are to set up a media processing resource pool, and their functions are respectively the same as those of the second acquiring unit 21, the constructing unit 22 and the recording unit 23 of the foregoing embodiment, and are not described herein. Let me repeat.
分析单元34，用于接收到多媒体处理任务时，分析处理所述多媒体处理任务所需要的媒体处理资源。The analysis unit 34 is configured to analyze and process the media processing resources required by the multimedia processing task when receiving the multimedia processing task.
第一获取单元35，用于获取媒体资源控制装置的当前空闲的媒体处理资源和与所述媒体资源控制装置相连接的至少一个多媒体处理装置的当前空闲的媒体处理资源。The first acquiring unit 35 is configured to acquire the currently idle media processing resources of the media resource control device and the currently idle media processing resources of at least one multimedia processing device connected to the media resource control device.
在本实施例中，第一获取单元35包括第五获取单元351。In this embodiment, the first obtaining unit 35 includes a fifth obtaining unit 351 .
第五获取单元351，用于根据分析得到的处理所述多媒体处理任务所需要的媒体处理资源的类型和大小，从所述媒体处理资源池中获取处理所述多媒体处理任务所需要的媒体处理资源。The fifth obtaining unit 351 is configured to obtain the media processing resources required for processing the multimedia processing task from the media processing resource pool according to the analyzed type and size of the media processing resources required for processing the multimedia processing task .
第一分配单元36，用于根据获取的所述媒体资源控制装置和所述至少一个多媒体处理装置的当前空闲的媒体处理资源，将所述多媒体处理任务分配给所述媒体资源控制装置和/或至少所述一个多媒体处理装置进行处理。The first allocating unit 36 is configured to allocate the multimedia processing task to the media resource control device and/or according to the acquired currently idle media processing resources of the media resource control device and the at least one multimedia processing device At least the one multimedia processing device performs processing.
在本实施例中，第一分配单元36包括第三分配单元361和第四分配单元362。In this embodiment, the first allocation unit 36 includes a third allocation unit 361 and a fourth allocation unit 362 .
第三分配单元361，用于当所述媒体处理资源池中处理所述多媒体处理任务的第一类型的媒体处理资源少于处理所述多媒体处理任务所需要的媒体处理资源时，将所述多媒体处理任务分配给第一类型的媒体处理资源进行处理。The third allocating unit 361 is configured to allocate the multimedia processing resources when the media processing resources of the first type for processing the multimedia processing tasks in the media processing resource pool are less than the media processing resources required for processing the multimedia processing tasks The processing tasks are assigned to the first type of media processing resources for processing.
第四分配单元362，用于将所述多媒体处理任务中除所述第一类型的媒体处理资源处理的任务之外的额外的任务，分配给所述媒体处理资源池中其它类型对应的所述媒体资源控制装置或多媒体处理装置进行处理。The fourth allocation unit 362 is configured to allocate additional tasks in the multimedia processing tasks other than the tasks processed by the media processing resources of the first type to the corresponding tasks of other types in the media processing resource pool. The media resource control device or the multimedia processing device performs processing.
接收到多媒体处理任务时，从媒体处理资源池中获取媒体处理资源进行多媒体处理任务的处理，与前述实施例的不同之处在于，本实施例中，第三分配单元361将某一类型的多媒体处理任务首先分配给具有对应该类型的专门的媒体处理资源的媒体资源控制装置或多媒体处理装置进行处理，但当该装置的媒体处理资源不足以处理该多媒体处理任务时，第四分配单元362需要根据从媒体处理资源池中获取的各个装置的当前空闲的媒体处理资源的类型和大小，按照各个装置的当前空闲的媒体处理资源占媒体处理资源池中的媒体处理资源的比例，将不能处理的多媒体处理任务按该比例分别给媒体资源控制装置和各个多媒体处理装置进行处理，或者随机地将剩余多媒体处理任务分配给几个或全部媒体资源控制装置和各个多媒体处理装置进行处理。When a multimedia processing task is received, the media processing resource is obtained from the media processing resource pool to process the multimedia processing task. The difference from the previous embodiment is that in this embodiment, the third allocating unit 361 allocates a certain type of multimedia The processing task is first allocated to a media resource control device or a multimedia processing device having a dedicated media processing resource corresponding to the type for processing, but when the media processing resource of the device is not enough to handle the multimedia processing task, the fourth allocation unit 362 needs to According to the type and size of the currently idle media processing resources of each device obtained from the media processing resource pool, and according to the ratio of the currently idle media processing resources of each device to the media processing resources in the media processing resource pool, it will not be able to process The multimedia processing tasks are respectively processed by the media resource control device and each multimedia processing device according to the ratio, or the remaining multimedia processing tasks are randomly assigned to several or all media resource control devices and each multimedia processing device for processing.
第四获取单元37，用于当所述媒体处理任务占用或释放所述媒体处理资源池中的媒体处理资源时，获取占用或释放的所述媒体处理资源的类型和大小。The fourth acquiring unit 37 is configured to acquire the type and size of the occupied or released media processing resource when the media processing task occupies or releases the media processing resource in the media processing resource pool.
第二更新单元38，用于根据占用或释放的所述媒体处理资源的类型和大小，分别更新所述媒体处理资源池中记录的对应类型的空闲的媒体处理资源的大小。The second updating unit 38 is configured to respectively update the size of the corresponding type of idle media processing resource recorded in the media processing resource pool according to the type and size of the occupied or released media processing resource.
处理多媒体处理任务时，会从媒体处理资源池中占用一部分空闲的媒体处理资源，为了同时处理其它多媒体处理任务时，能准确地从媒体处理资源池中调用空闲的媒体处理资源，当媒体处理资源池的某一类型的媒体处理资源被当前的多媒体处理任务占用时，需要更新媒体处理资源池中该类型的媒体处理资源的大小，减去被占用的媒体处理资源的大小。When processing multimedia processing tasks, a part of idle media processing resources will be occupied from the media processing resource pool. In order to process other multimedia processing tasks at the same time, idle media processing resources can be accurately called from the media processing resource pool. When a certain type of media processing resource in the pool is occupied by the current multimedia processing task, it is necessary to update the size of the type of media processing resource in the media processing resource pool and subtract the size of the occupied media processing resource.
当前多媒体处理任务完成时，会释放所占用的媒体处理资源，该部分空闲的媒体处理资源需要记录至媒体处理资源池，以备后续多媒体处理任务时调用。按照释放的媒体处理资源的类型，在媒体处理资源池中该类型的媒体处理资源中增加释放的媒体处理资源的大小。When the current multimedia processing task is completed, the occupied media processing resources will be released, and the idle media processing resources need to be recorded in the media processing resource pool, so as to be called in subsequent multimedia processing tasks. According to the type of the released media processing resource, the size of the released media processing resource is added to the type of media processing resource in the media processing resource pool.
根据本发明实施例提供的一种媒体资源控制装置，通过构建媒体处理资源池，将媒体处理系统中任意装置的具有空闲的媒体处理资源进行汇聚，由媒体资源控制装置统一调度媒体处理资源池中的空闲的媒体处理资源进行多媒体处理任务的处理，提高了媒体处理资源的利用率，且将多媒体处理任务优先采用媒体处理资源池中相应类型的媒体处理资源进行处理，有利于高效利用媒体处理资源。According to a media resource control device provided in an embodiment of the present invention, by constructing a media processing resource pool, the idle media processing resources of any device in the media processing system are aggregated, and the media resource control device uniformly schedules the media processing resource pool The idle media processing resources are used to process multimedia processing tasks, which improves the utilization rate of media processing resources, and the multimedia processing tasks are preferentially processed by the corresponding types of media processing resources in the media processing resource pool, which is conducive to the efficient use of media processing resources .
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的设备和模块的具体工作过程，可以参考前述方法实施例中的对应过程描述，在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the foregoing method embodiments, and details are not repeated here.
在本申请所提供的几个实施例中，应该理解到，所揭露的设备和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个模块或组件可以结合或者可以集成到另一个设备中，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些通信接口，装置或模块的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components can be combined or May be integrated into another device, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some communication interfaces, and the indirect coupling or communication connection of devices or modules may be in electrical, mechanical or other forms.
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的，作为模块显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部，模块来实现本实施例方案的目的。The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外，在本发明各个实施例中的各功能模块可以集成在一个处理模块中，也可以是各个模块单独物理存在，也可以两个或两个以上模块集成在一个模块中。In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, each module may exist separately physically, or two or more modules may be integrated into one module.
最后应说明的是：以上各实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310270335.0ACN104253807B (en) | 2013-06-28 | 2013-06-28 | A kind of media resource control method and device |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310270335.0ACN104253807B (en) | 2013-06-28 | 2013-06-28 | A kind of media resource control method and device |
| Publication Number | Publication Date |
|---|---|
| CN104253807A CN104253807A (en) | 2014-12-31 |
| CN104253807Btrue CN104253807B (en) | 2017-12-15 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310270335.0AExpired - Fee RelatedCN104253807B (en) | 2013-06-28 | 2013-06-28 | A kind of media resource control method and device |
| Country | Link |
|---|---|
| CN (1) | CN104253807B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105554433A (en)* | 2015-12-10 | 2016-05-04 | 阔地教育科技有限公司 | Data processing control device, image processing device, and live and record broadcast interaction system |
| CN106254947B (en)* | 2016-08-05 | 2019-09-17 | 青岛海信电器股份有限公司 | The extended method and device of process resource |
| CN111629233B (en)* | 2020-05-29 | 2022-03-25 | 北京华夏电通科技股份有限公司 | Audio and video transcoding method and device |
| CN112153411A (en)* | 2020-08-18 | 2020-12-29 | 南斗六星系统集成有限公司 | Method and system for improving performance of chat room streaming media server |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101403982A (en)* | 2008-11-03 | 2009-04-08 | 华为技术有限公司 | Task distribution method, system and equipment for multi-core processor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1996881A (en)* | 2006-12-19 | 2007-07-11 | 华为技术有限公司 | Method, device and system for media resource allocation |
| GB2462860B (en)* | 2008-08-22 | 2012-05-16 | Advanced Risc Mach Ltd | Apparatus and method for communicating between a central processing unit and a graphics processing unit |
| CN101488977B (en)* | 2009-03-09 | 2011-06-01 | 杭州华三通信技术有限公司 | Multi-point processor resource scheduling method and multi-point control unit |
| CN102104694B (en)* | 2009-12-16 | 2014-01-08 | 华为技术有限公司 | A venue resource processing method, device and system |
| CN102316117A (en)* | 2011-09-29 | 2012-01-11 | 中兴通讯股份有限公司南京分公司 | Resource processing method and device |
| CN102682741B (en)* | 2012-05-30 | 2014-12-03 | 华为技术有限公司 | Multi-display control system and implementation method of multi-display control system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101403982A (en)* | 2008-11-03 | 2009-04-08 | 华为技术有限公司 | Task distribution method, system and equipment for multi-core processor |
| Publication number | Publication date |
|---|---|
| CN104253807A (en) | 2014-12-31 |
| Publication | Publication Date | Title |
|---|---|---|
| CN110769278B (en) | Distributed video transcoding method and system | |
| CN107241281B (en) | Data processing method and device | |
| CN114020470B (en) | Resource allocation method and device, readable medium and electronic equipment | |
| WO2021008290A1 (en) | Video stream decoding method and apparatus, terminal device and storage medium | |
| CN113419846B (en) | Resource allocation method and device, electronic equipment and computer readable storage medium | |
| CN106878736A (en) | Method and device for video encoding and decoding | |
| CN112835695B (en) | Method for communication between Pod and distributed computing system | |
| WO2018223786A1 (en) | Cloud desktop system, and image sequence compression and encoding method, and medium therefor | |
| CN104794194A (en) | Distributed heterogeneous parallel computing system facing large-scale multimedia retrieval | |
| CN104253807B (en) | A kind of media resource control method and device | |
| CN101652750A (en) | Data processing device, distributed processing system, data processing method, and data processing program | |
| CN111580974B (en) | GPU instance allocation method, device, electronic equipment and computer readable medium | |
| JP2021518955A (en) | Processor core scheduling method, equipment, terminals and storage media | |
| CN114116092B (en) | Cloud desktop system processing method, cloud desktop system control method and related equipment | |
| CN103634336A (en) | File cooperative downloading system, device and method | |
| CN106940662A (en) | A kind of multi-task planning method of mobile terminal | |
| CN103685540A (en) | Task decomposition and composition method based on cloud computing | |
| CN114489978A (en) | Resource scheduling method, device, equipment and storage medium | |
| CN108667864B (en) | Method and device for scheduling resources | |
| CN104461706A (en) | Method and multiprocessing unit for sharing shared global variables | |
| CN105051689A (en) | Method, apparatus and system for scheduling resource pool in multi-core system | |
| CN117453386A (en) | Memory bandwidth allocation in multi-entity systems | |
| CN105607955A (en) | Calculation task distribution method and apparatus | |
| CN115378937B (en) | Distributed concurrency method, device, equipment and readable storage medium for tasks | |
| CN107634916B (en) | Data communication method and device |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20171215 | |
| CF01 | Termination of patent right due to non-payment of annual fee |