CN109089174B - Method and device for processing multimedia data stream, and computer storage medium - Google Patents

Abstract

Translated fromChinese

本发明公开了一种多媒体数据流的处理方法，该方法包括：接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分；其中，所述属性信息用于指示所述目标多媒体数据流是否进行了切分；若确定所述目标多媒体数据流未进行切分，则确定读取时长；其中，所述读取时长用于表征待生成的传输流TS文件的时长；基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；将得到的TS文件分别传输至客户端。本发明的实施例同时公开了一种多媒体数据流的处理装置和计算机存储介质。

The invention discloses a method for processing a multimedia data stream. The method includes: receiving a request message sent by a client; wherein, the request message is used to request a target multimedia data stream from a server; attribute information, to determine whether the target multimedia data stream has been split; wherein, the attribute information is used to indicate whether the target multimedia data stream has been split; if it is determined that the target multimedia data stream has not been split, Then determine the read duration; wherein, the read duration is used to characterize the duration of the transport stream TS file to be generated; based on the read duration, sequentially read the data of the corresponding duration from the target multimedia data stream, according to The read data obtains the corresponding TS file; the obtained TS file is transmitted to the client respectively. The embodiment of the present invention simultaneously discloses a multimedia data stream processing device and a computer storage medium.

Description

Translated fromChinese

一种多媒体数据流的处理方法及装置、计算机存储介质Method and device for processing multimedia data stream, and computer storage medium

技术领域technical field

本发明涉及流媒体技术领域，尤其涉及一种多媒体数据流的处理方法及装置、计算机存储介质。The present invention relates to the technical field of streaming media, and in particular, to a method and device for processing multimedia data streams, and a computer storage medium.

背景技术Background technique

目前，在使用动态多媒体传输(HTTP Live Streaming，HLS)协议进行多媒体数据流传输时，服务器端可以将整个多媒体数据流进行切分，形成一个个小的基于HTTP的传输流(Transport Stream，TS)文件进行存储；然后，服务器端根据客户端发送的请求消息将存储的TS文件依次传输至客户端。At present, when using the HTTP Live Streaming (HLS) protocol for multimedia data stream transmission, the server side can segment the entire multimedia data stream to form small HTTP-based transport streams (Transport Stream, TS) The file is stored; then, the server transmits the stored TS files to the client in turn according to the request message sent by the client.

一般情况下，服务器端在读取多媒体数据流的长度达到固定的切分时长后才进行切分，形成TS文件并传输至客户端；因此，客户端进行播放时会造成一定的延时。在实际应用中，不同的业务场景对数据延时的要求不同；因此，服务器端可以根据不同的业务场景，对多媒体数据流切分为不同时长的TS文件；这样，同一多媒体流可能会产生多份不同时长的TS文件，并且当服务器端存储的多媒体数据流较多时，大量的TS文件会占用服务器端大部分的存储资源以及处理资源。In general, the server does not split the multimedia data stream until the length of the read multimedia data stream reaches a fixed split duration, and forms a TS file and transmits it to the client; therefore, the client will cause a certain delay when playing. In practical applications, different business scenarios have different requirements for data delay; therefore, the server can divide the multimedia data stream into TS files of different durations according to different business scenarios; in this way, the same multimedia stream may generate multiple TS files. TS files of different durations, and when there are many multimedia data streams stored on the server side, a large number of TS files will occupy most of the storage resources and processing resources of the server side.

发明内容SUMMARY OF THE INVENTION

有鉴于此，本发明实施例提供一种多媒体数据流的处理方法及装置、计算机存储介质，解决了现有技术中占用大量存储资源和处理资源的问题。In view of this, embodiments of the present invention provide a method and device for processing a multimedia data stream, and a computer storage medium, which solve the problem of occupying a large amount of storage resources and processing resources in the prior art.

为达到上述目的，本发明的技术方案是这样实现的：In order to achieve the above object, the technical scheme of the present invention is achieved in this way:

第一方面，提供一种多媒体数据流的处理方法，所述方法包括：A first aspect provides a method for processing a multimedia data stream, the method comprising:

接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；Receive a request message sent by the client; wherein, the request message is used to request a target multimedia data stream from the server;

基于所述目标多媒体数据流的属性信息，确定所述目标多媒体数据流是否进行了切分；其中，所述属性信息用于指示所述目标多媒体数据流是否进行了切分；Based on attribute information of the target multimedia data stream, determine whether the target multimedia data stream has been split; wherein, the attribute information is used to indicate whether the target multimedia data stream has been split;

若确定所述目标多媒体数据流未进行切分，则确定读取时长；其中，所述读取时长用于表征待生成的传输流TS文件的时长；If it is determined that the target multimedia data stream is not segmented, the read duration is determined; wherein, the read duration is used to represent the duration of the transport stream TS file to be generated;

基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；Based on the read duration, sequentially read the data of the corresponding duration from the target multimedia data stream, and obtain the corresponding TS file according to the read data;

将得到的TS文件分别传输至客户端。Transfer the obtained TS files to the client respectively.

第二方面，提供了一种多媒体数据流的处理装置，所述装置包括：In a second aspect, an apparatus for processing a multimedia data stream is provided, the apparatus comprising:

接收单元，用于接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；a receiving unit, configured to receive a request message sent by the client; wherein the request message is used to request a target multimedia data stream from the server;

确定单元，用于基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分；其中，所述属性信息用于指示所述目标多媒体数据流是否进行了切分；若确定所述目标多媒体数据流未进行切分，则确定读取时长；其中，所述读取时长用于表征待生成的传输流TS文件的时长；a determining unit, configured to determine whether the target multimedia data stream has been split based on attribute information corresponding to the target multimedia data stream; wherein the attribute information is used to indicate whether the target multimedia data stream has been split If it is determined that the target multimedia data stream is not segmented, then determine the reading duration; wherein, the reading duration is used to characterize the duration of the transport stream TS file to be generated;

处理单元，用于基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；将得到的TS文件分别传输至客户端。The processing unit is configured to sequentially read data of corresponding duration from the target multimedia data stream based on the read duration, obtain corresponding TS files according to the read data, and transmit the obtained TS files to the client respectively.

第三方面，提供一种多媒体数据流的处理装置，所述装置包括：处理器和配置为存储能够在处理器上运行的计算机程序的存储器，In a third aspect, there is provided an apparatus for processing a multimedia data stream, the apparatus comprising: a processor and a memory configured to store a computer program that can be executed on the processor,

其中，所述处理器配置为运行所述计算机程序时，执行第一方面所述多媒体数据流的处理方法的步骤。Wherein, the processor is configured to execute the steps of the multimedia data stream processing method of the first aspect when running the computer program.

第四方面，提供一种计算机可读存储介质，其特征在于，所述计算机可读存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现如第一方面所述的多媒体数据流的处理方法的步骤。In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to The steps of implementing the method for processing a multimedia data stream according to the first aspect.

本发明的实施例所提供的多媒体数据流的处理方法及装置、计算机可读存储介质，首先，接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；接着，基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分；若确定所述目标多媒体数据流未进行切分，则确定读取时长；基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；最后，将得到的TS文件分别传输至客户端；这样，服务器可以根据规定时长读取目标多媒体数据流中的数据，每次读取对应时长的多媒体数据流则形成一个TS文件，直至多媒体数据流的数据被读取完；如此，在传输数据的过程中，服务器端可以直接读取以及发送对应时长的对媒体数据流，不再需要对多媒体数据流进行切分，因此，并不会产生大量的需要存储的TS文件，降低了服务器端的负载，提高处理速度和性能。In the method and device for processing a multimedia data stream, and a computer-readable storage medium provided by the embodiments of the present invention, first, a request message sent by a client is received; wherein, the request message is used to request a target multimedia data stream from a server; then , based on the attribute information corresponding to the target multimedia data stream, determine whether the target multimedia data stream has been segmented; if it is determined that the target multimedia data stream has not been segmented, then determine the reading duration; based on the read Duration, sequentially read the data of the corresponding duration from the described target multimedia data stream, and obtain the corresponding TS file according to the read data; Finally, the obtained TS file is transmitted to the client respectively; In this way, the server can read according to the specified duration Take the data in the target multimedia data stream, and each time the multimedia data stream of the corresponding duration is read, a TS file is formed until the data of the multimedia data stream is read; in this way, in the process of data transmission, the server can directly read Fetching and sending a pair of media data streams with corresponding durations does not need to split the multimedia data streams. Therefore, it does not generate a large number of TS files that need to be stored, which reduces the load on the server and improves processing speed and performance.

附图说明Description of drawings

在附图(其不一定是按比例绘制的)中，相似的附图标记可在不同的视图中描述相似的部件。附图以示例而非限制的方式大体示出了本文中所讨论的各个实施例。In the drawings, which are not necessarily to scale, like reference numerals may describe like parts in the different views. The accompanying drawings generally illustrate, by way of example and not limitation, the various embodiments discussed herein.

图1为本发明实施例提供的一种多媒体数据流的处理方法的流程示意图；1 is a schematic flowchart of a method for processing a multimedia data stream according to an embodiment of the present invention;

图2为本发明实施例提供的另一种多媒体数据流的处理方法的流程示意图；2 is a schematic flowchart of another method for processing a multimedia data stream provided by an embodiment of the present invention;

图3为本发明实施例提供的多媒体数据流的处理装置的结构组成示意图；FIG. 3 is a schematic structural diagram of an apparatus for processing a multimedia data stream provided by an embodiment of the present invention;

图4为本发明实施例提供的多媒体数据流的处理装置的硬件结构组成示意图。FIG. 4 is a schematic diagram of a hardware structure of an apparatus for processing a multimedia data stream provided by an embodiment of the present invention.

具体实施方式Detailed ways

为了能够更加详尽地了解本申请实施例的特点与技术内容，下面结合附图对本申请实施例的实现进行详细阐述，所附附图仅供参考说明之用，并非用来限定本发明实施例。In order to have a more detailed understanding of the features and technical contents of the embodiments of the present application, the implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

现有技术中，在基于HLS协议进行多媒体数据流传输时，服务器端首先会根据切分时长预先对多媒体流进行切分，得到多个对应时长的TS文件；然后，将上述多个TS文件依次传输至客户端。由于服务器端是在读取多媒体数据流的长度达到切分时长后才进行切分，并一一传输至客户端，因此，客户端接收到TS文件并对所述TS文件解码播放时势必会造成一定的延时，而该延时的大小与服务端切分多媒体流时的切分时长直接相关；可以理解为，切分时长越长，对应的时延也就越大。In the prior art, when carrying out multimedia data stream transmission based on the HLS protocol, the server will first split the multimedia stream in advance according to the split duration to obtain a plurality of TS files corresponding to the duration; then, the above-mentioned multiple TS files are sequentially transmitted to the client. Since the server does not split the multimedia data stream until the length of reading the multimedia data stream reaches the split duration, and transmits them to the client one by one, therefore, when the client receives the TS file and decodes and plays the TS file, it is bound to cause problems. A certain delay, and the size of the delay is directly related to the splitting duration when the server splits the multimedia stream; it can be understood that the longer the splitting duration, the greater the corresponding delay.

由于不同的业务场景对延时的要求不同，因此，服务端在不同业务场景下的对应的切分时长也不相同。例如，服务器端为客户端A以及客户端B提供多媒体服务，其中，客户端A对应的用户为VIP用户，客户端B对应的用户为普通用户；则该服务器端在接收到多媒体数据流时，可以分别以3秒时长为单位和以10秒时长为单位对该多媒体数据流进行切分；若多媒体数据流对应的总时长为3分钟，则该服务器端切分后得到60个3秒时长的TS文件，以及18个10秒时长的TS文件，此时，服务端需要对得到的78个TS文件进行存储，并在接收到客户端A或客户端B的播放请求后，从存储的78个TS文件中获取对应的TS文件，并将获取的TS文件发送至客户端A或客户端B。Since different business scenarios have different requirements for delay, the corresponding segmentation time of the server in different business scenarios is also different. For example, the server provides multimedia services for client A and client B, wherein the user corresponding to client A is a VIP user, and the user corresponding to client B is a common user; then when the server receives the multimedia data stream, The multimedia data stream can be segmented in units of 3 seconds and 10 seconds respectively; if the total duration corresponding to the multimedia data stream is 3 minutes, the server-side segmentation will obtain 60 3-second data streams. TS files, and 18 TS files with a duration of 10 seconds. At this time, the server needs to store the obtained 78 TS files, and after receiving the playback request from client A or client B, from the stored 78 TS files Obtain the corresponding TS file from the TS file, and send the obtained TS file to client A or client B.

因此，当切分时长不同时，同一多媒体流会产生多份不同的TS文件。当服务端存储的多媒体流较多时，不同切分时长产生的大量TS文件，必然会占用服务器端大量的存储资源以及处理资源。Therefore, when the split durations are different, the same multimedia stream will generate multiple different TS files. When there are many multimedia streams stored on the server side, a large number of TS files generated by different segmentation durations will inevitably occupy a large amount of storage resources and processing resources on the server side.

为解决上述问题，本发明实施例提供了一种多媒体数据流的处理方法，如图1所示，所述多媒体数据流的处理方法包括以下步骤：To solve the above problem, an embodiment of the present invention provides a method for processing a multimedia data stream. As shown in FIG. 1 , the method for processing a multimedia data stream includes the following steps:

步骤101、接收客户端发送的请求消息。Step 101: Receive a request message sent by a client.

其中，所述请求消息用于向服务器请求目标多媒体数据流。Wherein, the request message is used to request the target multimedia data stream from the server.

这里，步骤101接收客户端发送的请求消息可以由服务器来实现；其中，所述服务器可以是任意类型的提供多媒体数据流的电子设备。其中，所述多媒体数据流是指采用流式传输的方式在网络中播放的音频、视频或多媒体文件，为了便于说明，本发明均以视频为例进行描述，其它格式的应用场景相互参照即可。Here, receiving the request message sent by the client instep 101 may be implemented by a server; wherein, the server may be any type of electronic device that provides multimedia data streams. Wherein, the multimedia data stream refers to the audio, video or multimedia files played in the network by means of streaming transmission. For the convenience of description, the present invention is described by taking video as an example, and application scenarios of other formats can be referred to each other. .

在本发明的其他实施例中，请求消息由客户端进行发送，目标多媒体数据流为客户端请求的多媒体数据流。In other embodiments of the present invention, the request message is sent by the client, and the target multimedia data stream is the multimedia data stream requested by the client.

步骤102、基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分。Step 102: Determine whether the target multimedia data stream is segmented based on attribute information corresponding to the target multimedia data stream.

其中，所述属性信息用于指示所述目标多媒体数据流是否进行了切分。Wherein, the attribute information is used to indicate whether the target multimedia data stream is segmented.

在本发明的其他实施例中，步骤102基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分可以由服务器来实现。其中，多媒体数据流对应的属性信息可以包括多媒体数据流的数据类型、存储位置、支持读取的最大时长等信息。In other embodiments of the present invention,step 102 may be implemented by a server to determine whether the target multimedia data stream is segmented based on attribute information corresponding to the target multimedia data stream. The attribute information corresponding to the multimedia data stream may include information such as the data type of the multimedia data stream, the storage location, the maximum duration supported for reading, and the like.

具体地，服务器在接收到客户端的请求之后，首先需要判断客户端请求的目标多媒体数据流是否已经进行了切分；这里，切分指的是物理上的切分，即目标多媒体数据流是由切分后形成的多个独立的TS文件形成。若请求的数据已经进行了切分，则服务器将请求的目标多媒体数据流对应的多个独立的TS切分文件依次传输至客户端；若请求的数据并未进行切分，可以认为客户端请求的数据仍然是一个完整的多媒体数据流。Specifically, after receiving the request from the client, the server first needs to determine whether the target multimedia data stream requested by the client has been segmented; here, segmentation refers to physical segmentation, that is, the target multimedia data stream is divided by Multiple independent TS files formed after segmentation are formed. If the requested data has been segmented, the server transmits multiple independent TS segment files corresponding to the requested target multimedia data stream to the client in turn; if the requested data has not been segmented, it can be considered that the client requests The data is still a complete multimedia data stream.

步骤103、若确定所述目标多媒体数据流未进行切分，则确定读取时长。Step 103: If it is determined that the target multimedia data stream is not segmented, determine the reading duration.

其中，所述读取时长用于表征待生成的传输流TS文件的时长。The read duration is used to represent the duration of the transport stream TS file to be generated.

这里，步骤103若确定所述目标多媒体数据流未进行切分，则确定读取时长可以由服务器实现。Here, instep 103, if it is determined that the target multimedia data stream is not segmented, the determination of the reading duration may be implemented by the server.

在本发明的其他实施例中，读取时长是指读取目标多媒体数据流的时间单位；根据该读取时长读取目标多媒体数据流后，可以形成对应时长的TS文件。也就是说，读取时长可以理解为是待生成的传输流TS文件的时长；这里，TS文件是指使用TS封装格式封装后的文件，其特点是每个TS文件都是可以独立解码。In other embodiments of the present invention, the reading duration refers to the time unit for reading the target multimedia data stream; after reading the target multimedia data stream according to the reading duration, a TS file of the corresponding duration can be formed. That is to say, the read duration can be understood as the duration of the transport stream TS file to be generated; here, the TS file refers to the file encapsulated in the TS encapsulation format, which is characterized in that each TS file can be decoded independently.

在本实施例中，读取时长可以理解为是“虚拟”切分时长，也就是说在服务器对多媒体数据流不进行实际的切分的情况下得到TS文件的时长。这里，服务器并不对多媒体数据流切分后进行保存，而是保存整个多媒体数据流，这样，服务器在接收到客户端的请求之后，直接根据读取时长对多媒体数据流进行读取。In this embodiment, the read duration can be understood as a "virtual" split duration, that is, the duration of the TS file is obtained without actually splitting the multimedia data stream by the server. Here, the server does not cut and save the multimedia data stream, but saves the entire multimedia data stream. In this way, after receiving the request from the client, the server directly reads the multimedia data stream according to the reading duration.

步骤104、基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件。Step 104: Based on the read duration, sequentially read data of corresponding duration from the target multimedia data stream, and obtain a corresponding TS file according to the read data.

步骤105、将得到的TS文件分别传输至客户端。Step 105: Transfer the obtained TS files to the client respectively.

这里，步骤104基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件，以及步骤105将得到的TS文件分别传输至客户端可以由服务器来实现。Here, step 104 sequentially reads data of corresponding duration from the target multimedia data stream based on the read duration, obtains the corresponding TS file according to the read data, and transmits the obtained TS file to the client instep 105 The client can be implemented by the server.

在本发明的其他实施例中，在确定了读取时长，即“虚拟”切分时长之后，服务器可以根据确定的“虚拟”切分时长来读取对应时长的请求数据；具体地，服务器根据读取时长，依次读取对应时长的目标多媒体数据流；这里，每次读取对应时长的目标多媒体数据流后，都会得到一个TS文件；这样，服务器依次读取对应时长的多媒体数据流，就会形成对应的TS文件。其中，全部的TS文件构成所述目标多媒体数据流；也就是说，服务器分依次读取多媒体数据流之后，能够将所述多媒体数据流中的数据全部读取完。In other embodiments of the present invention, after determining the reading duration, that is, the "virtual" split duration, the server may read the request data of the corresponding duration according to the determined "virtual" split duration; Read the duration, and sequentially read the target multimedia data stream of the corresponding duration; here, each time the target multimedia data stream of the corresponding duration is read, a TS file will be obtained; in this way, the server reads the multimedia data stream of the corresponding duration in turn, then A corresponding TS file will be formed. Wherein, all the TS files constitute the target multimedia data stream; that is, after the server reads the multimedia data stream in sequence, it can read all the data in the multimedia data stream.

优选地，服务器在每次读取多媒体数据流之后，将形成的对应时长的TS文件发送至客户端。Preferably, after each reading of the multimedia data stream, the server sends the formed TS file of the corresponding duration to the client.

在本发明的其他实施例中，服务器并不对上述至少TS文件进行存储，而是直接发送至客户端，以使得客户端播放所述多个TS文件。In other embodiments of the present invention, the server does not store the above-mentioned at least TS files, but directly sends them to the client, so that the client plays the multiple TS files.

例如，服务器根据请求消息确定的“虚拟”切分时长为3秒，服务器可以每次读取3秒时长的多媒体数据流，得到多个3秒时长的TS文件，然后，将得到的3秒时长的TS文件直接传输至客户端。For example, the "virtual" split duration determined by the server according to the request message is 3 seconds. The server can read a 3-second multimedia data stream each time, and obtain multiple TS files with a duration of 3 seconds. TS files are directly transferred to the client.

本发明的实施例所提供的多媒体数据流的处理方法，首先，接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；接着基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分；若确定所述目标多媒体数据流未进行切分，则确定读取时长；基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；最后，将得到的TS文件分别传输至客户端；这样，服务器可以根据规定的时长依次读取规定时长的目标多媒体数据流，每次读取对应时长的多媒体数据流则形成一个TS文件，直至多媒体数据流的数据被读取完；如此，在传输数据的过程中，服务器端可以直接读取以及发送对应时长的对媒体数据流，不再需要对多媒体数据流进行切分，因此，并不会产生大量的需要存储的TS文件，降低了服务器端的负载，提高处理速度和性能。In the method for processing a multimedia data stream provided by an embodiment of the present invention, first, a request message sent by a client is received; wherein, the request message is used to request a target multimedia data stream from a server; then, based on the target multimedia data stream corresponding attribute information, determine whether the target multimedia data stream has been segmented; if it is determined that the target multimedia data stream has not been segmented, then determine the reading duration; based on the reading duration, sequentially from the target multimedia data The data corresponding to the duration is read in the stream, and the corresponding TS file is obtained according to the read data; finally, the obtained TS files are transmitted to the client respectively; in this way, the server can sequentially read the target multimedia data of the specified duration according to the specified duration Each time the multimedia data stream of the corresponding duration is read, a TS file is formed until the data of the multimedia data stream is read; in this way, in the process of data transmission, the server can directly read and send the corresponding duration of the data stream. For the media data stream, it is no longer necessary to divide the multimedia data stream. Therefore, a large number of TS files that need to be stored are not generated, the load on the server side is reduced, and the processing speed and performance are improved.

基于前述实施例，本发明实施例提供一种多媒体数据流的处理方法，如图2所示，所述多媒体数据流的处理方法包括以下步骤：Based on the foregoing embodiments, an embodiment of the present invention provides a method for processing a multimedia data stream. As shown in FIG. 2 , the method for processing a multimedia data stream includes the following steps:

步骤201、服务器在目标多媒体数据流对应的属性信息中增加切分参数。Step 201: The server adds a segmentation parameter to the attribute information corresponding to the target multimedia data stream.

其中，所述切分参数用于指示是否对所述目标多媒体数据流进行切分。The segmentation parameter is used to indicate whether to segment the target multimedia data stream.

实际应用中，服务器可以利用HLS协议进行多媒体数据流的传输；具体地，服务器接收请求消息后，根据请求消息查找请求数据对应的索引文件，该索引文件中包含请求消息的所有属性信息。服务器根据请求数据对应的索引文件，按照索引文件中的规则读取目标多媒体数据流。In practical applications, the server can use the HLS protocol to transmit multimedia data streams; specifically, after receiving the request message, the server searches for an index file corresponding to the request data according to the request message, and the index file contains all attribute information of the request message. According to the index file corresponding to the request data, the server reads the target multimedia data stream according to the rules in the index file.

在本实施例中，服务器可以对预先对HLS协议进行修改，以使得服务器在基于HLS协议传输多媒体数据流时，可以不对多媒体数据流进行数据流切分，也就是物理上的实际切分。In this embodiment, the server may modify the HLS protocol in advance, so that when the server transmits the multimedia data stream based on the HLS protocol, the server may not perform data stream segmentation, that is, physical actual segmentation.

在本发明的其他实施例中，服务器可以索引文件中目标多媒体数据流的属性信息进行修改，增加切分参数，该参数用于指示是否对所述目标多媒体数据流进行切分。这里，索引文件优选M3U8格式的文件。In other embodiments of the present invention, the server may modify the attribute information of the target multimedia data stream in the index file, and add a segmentation parameter, which is used to indicate whether to segment the target multimedia data stream. Here, the index file is preferably a file in M3U8 format.

一般情况下，未修改的M3U8索引文件示例如下：In general, an example of an unmodified M3U8 index file is as follows:

#EXTM3U#EXTM3U

#EXT-X-MEDIA-SEQUENCE：0#EXT-X-MEDIA-SEQUENCE: 0

#EXT-X-TARGETDURATION：10#EXT-X-TARGETDURATION: 10

#EXT-X-ALLOW-CACHE#EXT-X-ALLOW-CACHE

#EXTINF：10，#EXTINF: 10,

#EXT-X-ENDLIST#EXT-X-ENDLIST

其中，标签“#EXTM3U”为文件头，用于标识该M3U8索引文件；标签“#EXT-X-MEDIA-SEQUENCE”指定M3U8索引文件中第一个TS文件的序号，这里，每个TS文件在M3U8索引文件中都有唯一固定的序号；在上述示例中，0表示第一个TS文件的序号为0；标签“#EXT-X-TARGETDURATION”指定每个TS文件的最大的时长，在上述实例中，10表示每个TS文件最大持续时间为10秒；标签“#EXT-X-ALLOW-CACHE”用于指示客户端是否可以缓存多媒体数据流的内容；标签“#EXTINF”指定后续的TS文件的时长信息；标签“#EXT-X-ENDLIST”为M3U8索引文件的结束符。Among them, the label "#EXTM3U" is the file header, which is used to identify the M3U8 index file; the label "#EXT-X-MEDIA-SEQUENCE" specifies the serial number of the first TS file in the M3U8 index file. Here, each TS file is in The M3U8 index file has a unique and fixed serial number; in the above example, 0 means the serial number of the first TS file is 0; the tag "#EXT-X-TARGETDURATION" specifies the maximum duration of each TS file, in the above example , 10 indicates that the maximum duration of each TS file is 10 seconds; the tag "#EXT-X-ALLOW-CACHE" is used to indicate whether the client can cache the content of the multimedia data stream; the tag "#EXTINF" specifies subsequent TS files duration information; the label "#EXT-X-ENDLIST" is the terminator of the M3U8 index file.

在本实施例中，服务器可以在标签“#EXT-X-TARGETDURATION”与标签“#EXT-X-ALLOW-CACHE”之间增加一个新的标签，用于保存切分参数；优选地，可以用“#EXT-X-VIRTUALSLICE”来表示；该新增加的标签通过保存的切分参数来对切分的方式进行标识，即该标签可以用于指示在多媒体数据流传输的过程中是否对该多媒体数据流进行物理上的实际切分。In this embodiment, the server can add a new label between the label "#EXT-X-TARGETDURATION" and the label "#EXT-X-ALLOW-CACHE" to save the segmentation parameters; "#EXT-X-VIRTUALSLICE"; the newly added tag identifies the segmentation method through the saved segmentation parameters, that is, the tag can be used to indicate whether the multimedia data stream is transmitted during the transmission of the multimedia data. The actual segmentation of the data stream is performed physically.

例如，当新增标签“#EXT-X-VIRTUALSLICE”取值为0，或者取值为空时，可以确定服务器对请求的多媒体数据流不进行数据流切分；而当该新增字段取其他值时，可以确定为服务器需要对请求多媒体数据流进行数据流切分，即物理上的实际切分。For example, when the value of the newly added tag "#EXT-X-VIRTUALSLICE" is 0, or the value is empty, it can be determined that the server does not perform data stream segmentation on the requested multimedia data stream; When the value is set, it can be determined that the server needs to perform data stream segmentation on the requested multimedia data stream, that is, the actual physical segmentation.

需要说明的是，新增标签“#EXT-X-VIRTUALSLICE”的取值可以是人工预先设置好的，以确定服务器在基于HLS协议传输多媒体数据流时，对该多媒体数据流的切分方式。It should be noted that the value of the newly added tag "#EXT-X-VIRTUALSLICE" may be preset manually to determine the way the server divides the multimedia data stream when transmitting the multimedia data stream based on the HLS protocol.

在本发明的其他实施例中，服务器可以根据修改后M3U8索引文件的标签“#EXT-X-VIRTUALSLICE”的取值，确定对请求数据的切分方式。In other embodiments of the present invention, the server may determine the method of dividing the request data according to the value of the tag "#EXT-X-VIRTUALSLICE" of the modified M3U8 index file.

具体地，当新增标签“#EXT-X-VIRTUALSLICE”的取值为确定切分方式为需要进行数据流切分，即对多媒体数据流进行物理上的实际切分时，服务器可以根据预设的切分时长对获取的多媒体数据流进行切分，并得到多个独立的TS切分文件，然后，服务器对上述多个TS切分文件进行存储。这里，预设的切分时长可以为预先设置的时长，也可以为M3U8索引文件中默认的时长，本实施例对此不做限制。Specifically, when the value of the newly added tag "#EXT-X-VIRTUALSLICE" determines that the segmentation method is to perform data stream segmentation, that is, when the multimedia data stream is physically segmented, the server can The obtained multimedia data stream is segmented according to the segment duration, and multiple independent TS segment files are obtained. Then, the server stores the above-mentioned multiple TS segment files. Here, the preset segmentation duration may be a preset duration, or may be a default duration in the M3U8 index file, which is not limited in this embodiment.

另外，当新增标签“#EXT-X-VIRTUALSLICE”的取值为确定切分方式为不进行数据流切分时，服务端可以不对获取的多媒体数据流进行切分，此时，服务端可以仅对获取的多媒体流进行存储。In addition, when the value of the newly added tag "#EXT-X-VIRTUALSLICE" determines that the segmentation method is not to perform data stream segmentation, the server may not perform segmentation of the acquired multimedia data stream. At this time, the server may Only the acquired multimedia stream is stored.

步骤202、服务器接收客户端发送的请求消息。Step 202: The server receives the request message sent by the client.

其中，所述请求消息用于向服务器请求目标多媒体数据流。Wherein, the request message is used to request the target multimedia data stream from the server.

步骤203、服务器基于目标多媒体数据流属性信息中的切分参数，确定所述目标多媒体数据流是否进行了切分。Step 203: The server determines whether the target multimedia data stream is segmented based on the segmentation parameter in the attribute information of the target multimedia data stream.

具体地，服务器可以基于M3U8索引文件中的新增标签中保存的切分参数，判断目标多媒体数据流是否进行了切分。Specifically, the server may determine whether the target multimedia data stream is segmented based on the segmentation parameters stored in the newly added tags in the M3U8 index file.

示例性的，若所述切分功能标签“#EXT-X-VIRTUALSLICE”对应的切分参数为0，或者取值为空时，可以判断服务器对目标多媒体数据流没有进行切分；而当该新增字段取值为其他时，可以判断服务器对目标多媒体数据流进行了切分，即物理上的实际切分。Exemplarily, if the segmentation parameter corresponding to the segmentation function tag "#EXT-X-VIRTUALSLICE" is 0, or the value is empty, it can be determined that the server does not segment the target multimedia data stream; When the value of the newly added field is Other, it can be judged that the server has segmented the target multimedia data stream, that is, the actual segmentation physically.

若判断结果为服务器对请求的多媒体数据流进行了数据流切分，则服务器将请求的多媒体数据流对应的多个独立的TS切分文件依次传输至客户端。若判断结果为服务器对请求的多媒体数据流没有进行数据流切分，则执行步骤204。If the judgment result is that the server has performed data stream segmentation on the requested multimedia data stream, the server sequentially transmits multiple independent TS segmentation files corresponding to the requested multimedia data stream to the client. If the judgment result is that the server does not perform data stream segmentation on the requested multimedia data stream,step 204 is executed.

步骤204、若服务器确定所述目标多媒体数据流未进行切分，则确定读取时长。Step 204: If the server determines that the target multimedia data stream is not segmented, determine the read duration.

其中，所述读取时长用于表征待生成的传输流TS文件的时长。在本实施例中，读取时长可以理解为是“虚拟”切分时长，也就是说在服务器对多媒体数据流不进行实际的切分的情况下得到TS文件的时长。The read duration is used to represent the duration of the transport stream TS file to be generated. In this embodiment, the read duration can be understood as a "virtual" split duration, that is, the duration of the TS file is obtained without actually splitting the multimedia data stream by the server.

具体地，服务器基于请求的多媒体数据流对应的属性信息，判断所述读取时长类型；在本实施例中，所述属性信息还包括持续时间参数；所述持续时间参数用于指示所述待生成的TS文件的时长是否为固定时长。Specifically, the server determines the type of the read duration based on attribute information corresponding to the requested multimedia data stream; in this embodiment, the attribute information further includes a duration parameter; the duration parameter is used to indicate the waiting time Whether the duration of the generated TS file is a fixed duration.

进一步，当根据所述持续时间参数确定所述待生成的TS文件的时长为固定时长时，根据所述请求消息确定读取时长，和\或根据当前的网络传输质量确定读取时长。当根据所述持续时间参数确定所述待生成的TS文件的时长不为固定时长时，根据初始读取时长、已生成的TS文件的总时长以及预设时间阈值确定所述读取时长。Further, when it is determined that the duration of the TS file to be generated is a fixed duration according to the duration parameter, the reading duration is determined according to the request message, and/or the reading duration is determined according to the current network transmission quality. When it is determined according to the duration parameter that the duration of the TS file to be generated is not a fixed duration, the reading duration is determined according to the initial reading duration, the total duration of the generated TS files and a preset time threshold.

优选地，服务器可以根据目标多媒体数据流对应索引文件中的允许读取时长的属性信息来判断读取时长的类型；具体地，服务器可以根据M3U8索引文件中“#EXT-X-TARGETDURATION”标签的取值来确定所述读取时长类型是否为固定的时长；当该标签的取值不为0时，可以确定所述读取时长类型是固定的时长，此时，服务器可以根据所述请求消息确定读取时长，和\或根据当前的网络传输质量确定读取时长；而当该字段的取值为0时，可以确定该读取时长类型是非固定的时长，此时，服务器可以根据初始读取时长、已生成的TS文件的总时长以及预设时间阈值确定所述读取时长。Preferably, the server can judge the type of the read duration according to the attribute information of the allowable reading duration in the index file corresponding to the target multimedia data stream; value to determine whether the read duration type is a fixed duration; when the value of the tag is not 0, it can be determined that the read duration type is a fixed duration, at this time, the server can according to the request message Determine the reading duration, and\or determine the reading duration according to the current network transmission quality; and when the value of this field is 0, it can be determined that the reading duration type is a non-fixed duration. The read duration is determined by taking the duration, the total duration of the generated TS files and a preset time threshold.

这里，读取时长的大小决定了时延的长短，这是因为，服务器在读取规定时长的多媒体数据流之后，才能够形成TS文件，传输至客户端；可以理解为，读取的时长越小，造成的时延就越短。因此，可以根据客户端对时延的要求，确定读取时长。Here, the length of the reading time determines the length of the delay. This is because the server can form a TS file and transmit it to the client after reading the multimedia data stream of the specified length; it can be understood that the longer the reading time, the longer Smaller, the shorter the delay is caused. Therefore, the read duration can be determined according to the client's requirement for latency.

在本发明的其他实施例中，当根据所述持续时间参数确定所述待生成的TS文件的时长为固定时长时，根据所述请求消息确定读取时长，和\或根据当前的网络传输质量确定读取时长。这里，所述请求消息至少包括以下之一：In other embodiments of the present invention, when the duration of the to-be-generated TS file is determined to be a fixed duration according to the duration parameter, the read duration is determined according to the request message, and/or according to the current network transmission quality Determine the read time. Here, the request message includes at least one of the following:

用于标识所述客户端当前所处的业务模式的第一参数，所述客户端当前所处的业务模式为点播模式或直播模式；用于标识所述客户端对应的用户是否为首次访问所述服务器的用户的第二参数。The first parameter used to identify the current business mode of the client, where the current business mode of the client is the on-demand mode or the live mode; used to identify whether the user corresponding to the client is the first access to the The second parameter of the user of the server.

也就是说，服务器可以根据客户端当前所处的业务模式来确定读取时长，这里的业务模式包括点播模式和直播模式，当客户端请求的数据为直播模式的数据时，可以设置1秒至3秒之间的较小的读取时长；当确定客户端当前处于点播模式时，可以设置10秒至20秒之间的较大的读取时长。That is to say, the server can determine the reading time according to the current business mode of the client. The business mode here includes the on-demand mode and the live mode. When the data requested by the client is the data of the live mode, it can be set from 1 second to The smaller reading duration is between 3 seconds; when it is determined that the client is currently in the on-demand mode, the larger reading duration between 10 seconds and 20 seconds can be set.

其次，服务器还可以判断客户端对应的用户是否为首次发送多媒体数据流请求的新用户；当客户端对应的用户为新用户时，为了减少新用户的等待时间，提升该新用户的体验，服务器可以设置较小的读取时长。Secondly, the server can also determine whether the user corresponding to the client is a new user who sends the multimedia data stream request for the first time; when the user corresponding to the client is a new user, in order to reduce the waiting time of the new user and improve the experience of the new user, the server A smaller read duration can be set.

进一步，服务器还可以根据网络传输环境确定所述读取时长；这里，若网络传输质量较高且多媒体数据流对应的码率较低，则可以设置较大的读取时长；若网络传输质量较差且对应的码率较高，则可以设置较小的读取时长。Further, the server can also determine the reading duration according to the network transmission environment; here, if the network transmission quality is high and the code rate corresponding to the multimedia data stream is low, a larger reading duration can be set; if the network transmission quality is relatively high If it is poor and the corresponding bit rate is high, you can set a shorter reading duration.

在本发明的其他实施例中，服务器还可以根据客户端请求的数据类型来确定读取时长；这里，数据类型可以分为对实时性要求较高的数据类型和对实时性要求为正常的数据类型；例如，对实时性要求较高的数据类型可以是“球赛”类型的数据。In other embodiments of the present invention, the server can also determine the reading duration according to the data type requested by the client; here, the data type can be divided into data types with high real-time requirements and data with normal real-time requirements Type; for example, the data type that requires high real-time performance can be "ball game" type data.

在本发明的其他实施例中，当根据所述持续时间参数确定所述待生成的TS文件的时长不为固定时长时，根据初始读取时长、已生成的TS文件的总时长以及预设时间阈值确定所述读取时长。In other embodiments of the present invention, when it is determined according to the duration parameter that the duration of the TS file to be generated is not a fixed duration, the duration of the initial reading, the total duration of the generated TS files and the preset duration A threshold determines the read duration.

这里，这里，已生成的TS文件是指，已经读但还未发送至客户端的TS文件。另外，预设时间阈值可以是服务器预先设置好的时长。初始读取时长可以是预先设置好的时长，也可以是根据所述请求消息确定读取时长，和\或根据当前的网络传输质量来确定初始读取时长；这里根据所述请求消息确定读取时长，和\或根据当前的网络传输质量来确定初始读取时长的方式与上文中的描述相同，这里不再赘述。Here, the generated TS file refers to a TS file that has been read but not yet sent to the client. In addition, the preset time threshold may be a time period preset by the server. The initial read duration can be a preset duration, or can be determined according to the request message, and/or according to the current network transmission quality to determine the initial read duration; here, the read duration is determined according to the request message The duration, and/or the manner of determining the initial reading duration according to the current network transmission quality is the same as that described above, and will not be repeated here.

具体地，服务器根据初始读取时长读取目标多媒体数据流，当已生成的TS文件的总时长大于所述预设时间阈值时，增大所述初始读取时长，并将增大后的初始读取时长确定为所述读取时长；当已生成的TS文件的总时长不大于所述预设时间阈值时，保持所述读取时长不变，或者减小所述初始读取时长，并将减小后的初始读取时长确定为所述读取时长。Specifically, the server reads the target multimedia data stream according to the initial reading duration, and when the total duration of the generated TS files is greater than the preset time threshold, the initial reading duration is increased, and the increased initial reading duration The reading duration is determined as the reading duration; when the total duration of the generated TS files is not greater than the preset time threshold, keep the reading duration unchanged, or reduce the initial reading duration, and The reduced initial read duration is determined as the read duration.

例如，在直播场景中，服务器会将实时下载的多媒体数据流通过TS文件的方式发送至客户端，其中，将当前下载的多媒体数据流通过TS文件发送至客户端时，服务器会同时下载后续的多媒体数据流。若预设阈值为10秒，当前读取时长为1秒，当服务器检测到后续下载的多媒体数据流的总时长大于10秒时，可以将当前的读取时长从1秒调整至5秒。For example, in a live broadcast scenario, the server will send the real-time downloaded multimedia data stream to the client through a TS file. When sending the currently downloaded multimedia data stream to the client through a TS file, the server will simultaneously download subsequent Multimedia data stream. If the preset threshold is 10 seconds and the current reading time is 1 second, when the server detects that the total duration of the subsequent downloaded multimedia data stream is greater than 10 seconds, the current reading time can be adjusted from 1 second to 5 seconds.

步骤205、服务器基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件。Step 205: Based on the read duration, the server sequentially reads data of a corresponding duration from the target multimedia data stream, and obtains a corresponding TS file according to the read data.

步骤206、服务器将得到的TS文件分别传输至客户端。Step 206: The server transmits the obtained TS files to the client respectively.

本发明的实施例所提供的多媒体数据流的处理方法，首先，接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；接着，基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分；若确定所述目标多媒体数据流未进行切分，则确定读取时长；基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；最后，将得到的TS文件分别传输至客户端；这样，分多次读取规定时长的多媒体数据流，每次读取对应时长的多媒体数据流则形成一个TS文件，直至多媒体数据流的数据被读取完；如此，在传输数据的过程中，服务器端可以直接读取以及发送对应时长的对媒体数据流，不再需要对多媒体数据流进行切分，因此，并不会产生大量的需要存储的TS文件，降低了服务器端的负载，提高处理速度和性能。In the method for processing a multimedia data stream provided by an embodiment of the present invention, first, a request message sent by a client is received; wherein, the request message is used to request a target multimedia data stream from a server; then, based on the target multimedia data stream Corresponding attribute information, determine whether the target multimedia data stream is segmented; if it is determined that the target multimedia data stream is not segmented, then determine the reading duration; based on the reading duration, sequentially from the target multimedia data stream. The data of the corresponding duration is read in the data stream, and the corresponding TS file is obtained according to the read data; finally, the obtained TS file is transmitted to the client respectively; in this way, the multimedia data stream of the specified duration is read multiple times, each time Reading the multimedia data stream of the corresponding duration forms a TS file until the data of the multimedia data stream is read; in this way, in the process of data transmission, the server can directly read and send the corresponding duration of the media data stream, It is no longer necessary to segment the multimedia data stream, therefore, a large number of TS files that need to be stored are not generated, the load on the server side is reduced, and the processing speed and performance are improved.

为实现本发明实施例的方法，本发明实施例还提供了一种多媒体数据流的处理装置，如图3所示，所述装置包括：In order to implement the method of the embodiment of the present invention, the embodiment of the present invention further provides an apparatus for processing a multimedia data stream. As shown in FIG. 3 , the apparatus includes:

接收单元31，用于接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；a receivingunit 31, configured to receive a request message sent by a client; wherein, the request message is used to request a target multimedia data stream from a server;

确定单元32，用于基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分；其中，所述属性信息用于指示所述目标多媒体数据流是否进行了切分；若确定所述目标多媒体数据流未进行切分，则确定读取时长；其中，所述读取时长用于表征待生成的传输流TS文件的时长；A determiningunit 32, configured to determine whether the target multimedia data stream is segmented based on attribute information corresponding to the target multimedia data stream; wherein the attribute information is used to indicate whether the target multimedia data stream is segmented If it is determined that the target multimedia data stream is not segmented, then the read duration is determined; wherein, the read duration is used to represent the duration of the transport stream TS file to be generated;

处理单元33，用于基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；将得到的TS文件分别传输至客户端。Theprocessing unit 33 is configured to sequentially read the data of the corresponding duration from the target multimedia data stream based on the read duration, and obtain the corresponding TS file according to the read data; transmit the obtained TS file to the client respectively .

在本发明的其他实施例中，In other embodiments of the present invention,

所述处理单元33，还用于在目标多媒体数据流对应的属性信息中增加切分参数；其中，所述切分参数用于指示是否对所述目标多媒体数据流进行切分；Theprocessing unit 33 is further configured to add a segmentation parameter to the attribute information corresponding to the target multimedia data stream; wherein, the segmentation parameter is used to indicate whether to segment the target multimedia data stream;

所述确定单元32，具体用于基于所述属性信息中的切分参数，确定所述目标多媒体数据流是否进行了切分。The determiningunit 32 is specifically configured to determine whether the target multimedia data stream is segmented based on the segmentation parameter in the attribute information.

在本发明的其他实施例中，所述属性信息还包括持续时间参数，所述持续时间参数用于指示所述待生成的TS文件的时长是否为固定时长；In other embodiments of the present invention, the attribute information further includes a duration parameter, and the duration parameter is used to indicate whether the duration of the to-be-generated TS file is a fixed duration;

所述确定单元32，具体用于当根据所述持续时间参数确定所述待生成的TS文件的时长为固定时长时，根据所述请求消息确定读取时长，和\或根据当前的网络传输质量确定读取时长；当根据所述持续时间参数确定所述待生成的TS文件的时长不为固定时长时，根据初始读取时长、已生成的TS文件的总时长以及预设时间阈值确定读取时长。The determiningunit 32 is specifically configured to determine the reading duration according to the request message when the duration of the TS file to be generated is determined to be a fixed duration according to the duration parameter, and/or according to the current network transmission quality Determine the reading duration; when determining that the duration of the TS file to be generated is not a fixed duration according to the duration parameter, determine the reading duration according to the initial reading duration, the total duration of the generated TS file and the preset time threshold duration.

在发明的其他实施例中，所述请求消息至少包括以下之一：In other embodiments of the invention, the request message includes at least one of the following:

用于标识所述客户端当前所处的业务模式的第一参数，所述客户端当前所处的业务模式为点播模式或直播模式；a first parameter used to identify the current business mode of the client, where the current business mode of the client is an on-demand mode or a live mode;

用于标识所述客户端对应的用户是否为首次访问所述服务器的用户的第二参数。The second parameter used to identify whether the user corresponding to the client is a user accessing the server for the first time.

在本发明的其他实施例中，所述处理单元33，还用于判断当已生成的TS文件的总时长大于所述预设时间阈值时，增大所述初始读取时长，并将增大后的初始读取时长确定为所述；当已生成的TS文件的总时长不大于所述预设时间阈值时，保持所述读取时长不变，或者减小所述初始读取时长，并将减小后的初始读取时长确定为所述读取时长。In other embodiments of the present invention, theprocessing unit 33 is further configured to determine that when the total duration of the generated TS files is greater than the preset time threshold, increase the initial reading duration, and will increase The subsequent initial reading duration is determined as described; when the total duration of the generated TS files is not greater than the preset time threshold, keep the reading duration unchanged, or reduce the initial reading duration, and The reduced initial read duration is determined as the read duration.

基于上述车牌精确定位装置中各单元的硬件实现，为了实现本发明实施例提供的多媒体数据流的处理方法，本发明实施例还提供了一种多媒体数据流的处理装置，如图4所示，所述多媒体数据流的处理装置40包括：处理器41和配置为存储能够在处理器上运行的计算机程序的存储器42，Based on the hardware implementation of each unit in the above-mentioned apparatus for precise positioning of license plates, in order to implement the method for processing a multimedia data stream provided by an embodiment of the present invention, an embodiment of the present invention further provides an apparatus for processing a multimedia data stream, as shown in FIG. 4 , Theprocessing device 40 of the multimedia data stream includes: aprocessor 41 and amemory 42 configured to store a computer program that can be executed on the processor,

其中，所述处理器41配置为运行所述计算机程序时，执行前述实施例中的多媒体数据流的处理方法步骤。Wherein, theprocessor 41 is configured to execute the steps of the method for processing multimedia data streams in the foregoing embodiments when running the computer program.

当然，实际应用时，如图4所示，该装置40中的各个组件通过总线系统43耦合在一起。可理解，总线系统43用于实现这些组件之间的连接通信。总线系统43除包括数据总线之外，还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见，在图4中将各种总线都标为总线系统43。Of course, in practical application, as shown in FIG. 4 , various components in thedevice 40 are coupled together through abus system 43 . It is understood that thebus system 43 is used to implement the connection communication between these components. In addition to the data bus, thebus system 43 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the various buses are labeled asbus system 43 in FIG. 4 .

在示例性实施例中，本发明实施例还提供了一种计算机可读存储介质，例如包括计算机程序的存储器42，上述计算机程序可由车牌精确定位装置40的处理器41执行，以完成前述方法所述步骤。计算机可读存储介质可以是磁性随机存取存储器(FRAM，ferromagnetic random access memory)、只读存储器(ROM，Read Only Memory)、可编程只读存储器(PROM，Programmable Read-Only Memory)、可擦除可编程只读存储器(EPROM，Erasable Programmable Read-Only Memory)、电可擦除可编程只读存储器(EEPROM，Electrically Erasable Programmable Read-Only Memory)、快闪存储器(FlashMemory)、磁表面存储器、光盘、或只读光盘(CD-ROM，Compact Disc Read-Only Memory)等存储器。In an exemplary embodiment, the embodiment of the present invention further provides a computer-readable storage medium, such as amemory 42 including a computer program, and the computer program can be executed by theprocessor 41 of theapparatus 40 for precise positioning of the license plate, so as to complete the above-mentioned method. the steps described above. The computer-readable storage medium can be magnetic random access memory (FRAM, ferromagnetic random access memory), read only memory (ROM, Read Only Memory), programmable read only memory (PROM, Programmable Read-Only Memory), erasable Programmable Read-Only Memory (EPROM, Erasable Programmable Read-Only Memory), Electrically Erasable Programmable Read-Only Memory (EEPROM, Electrically Erasable Programmable Read-Only Memory), Flash Memory (FlashMemory), Magnetic Surface Memory, Optical Disc, Or memory such as CD-ROM (Compact Disc Read-Only Memory).

本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present invention, or directly or indirectly applied in other related technical fields , are similarly included in the scope of patent protection of the present invention.

Claims (10)

Translated fromChinese

1.一种多媒体数据流的处理方法，其特征在于，所述方法包括：1. a processing method of multimedia data stream, is characterized in that, described method comprises:接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；Receive a request message sent by the client; wherein, the request message is used to request a target multimedia data stream from the server;基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分；其中，所述属性信息用于指示所述目标多媒体数据流是否进行了切分；Based on attribute information corresponding to the target multimedia data stream, determine whether the target multimedia data stream has been segmented; wherein, the attribute information is used to indicate whether the target multimedia data stream has been segmented;若确定所述目标多媒体数据流未进行切分，则确定读取时长；其中，所述读取时长用于表征待生成的传输流TS文件的时长；If it is determined that the target multimedia data stream is not segmented, the read duration is determined; wherein, the read duration is used to represent the duration of the transport stream TS file to be generated;基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；Based on the read duration, sequentially read the data of the corresponding duration from the target multimedia data stream, and obtain the corresponding TS file according to the read data;将得到的TS文件分别传输至客户端。Transfer the obtained TS files to the client respectively.2.根据权利要求1所述的方法，其特征在于，所述接收客户端发送的请求消息之前，所述方法还包括：2. The method according to claim 1, wherein before the receiving the request message sent by the client, the method further comprises:在目标多媒体数据流对应的属性信息中增加切分参数；其中，所述切分参数用于指示是否对所述目标多媒体数据流进行切分；A segmentation parameter is added to the attribute information corresponding to the target multimedia data stream; wherein, the segmentation parameter is used to indicate whether to segment the target multimedia data stream;所述基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分，包括：The determining whether the target multimedia data stream is segmented based on the attribute information corresponding to the target multimedia data stream includes:基于所述属性信息中的切分参数，确定所述目标多媒体数据流是否进行了切分。Based on the segmentation parameter in the attribute information, it is determined whether the target multimedia data stream is segmented.3.根据权利要求1所述的方法，其特征在于，所述属性信息还包括持续时间参数，所述持续时间参数用于指示所述待生成的TS文件的时长是否为固定时长，所述确定读取时长，包括：3. The method according to claim 1, wherein the attribute information further comprises a duration parameter, and the duration parameter is used to indicate whether the duration of the TS file to be generated is a fixed duration, and the determining Read time, including:当根据所述持续时间参数确定所述待生成的TS文件的时长为固定时长时，根据所述请求消息确定读取时长，和/或根据当前的网络传输质量确定读取时长；When it is determined that the duration of the TS file to be generated is a fixed duration according to the duration parameter, the reading duration is determined according to the request message, and/or the reading duration is determined according to the current network transmission quality;当根据所述持续时间参数确定所述待生成的TS文件的时长不为固定时长时，根据初始读取时长、已生成的TS文件的总时长以及预设时间阈值确定所述读取时长。When it is determined according to the duration parameter that the duration of the TS file to be generated is not a fixed duration, the reading duration is determined according to the initial reading duration, the total duration of the generated TS files, and a preset time threshold.4.根据权利要求3所述的方法，其特征在于，所述请求消息至少包括以下之一：4. The method according to claim 3, wherein the request message comprises at least one of the following:用于标识所述客户端当前所处的业务模式的第一参数，所述客户端当前所处的业务模式为点播模式或直播模式；a first parameter used to identify the current business mode of the client, where the current business mode of the client is an on-demand mode or a live mode;用于标识所述客户端对应的用户是否为首次访问所述服务器的用户的第二参数。The second parameter used to identify whether the user corresponding to the client is a user accessing the server for the first time.5.根据权利要求3所述的方法，其特征在于，所述根据初始读取时长、已生成的TS文件的总时长以及预设时间阈值确定所述读取时长，包括：5. The method according to claim 3, characterized in that, determining the read duration according to the initial read duration, the total duration of the generated TS file and a preset time threshold, comprising:当已生成的TS文件的总时长大于所述预设时间阈值时，增大所述初始读取时长，并将增大后的初始读取时长确定为所述读取时长；When the total duration of the generated TS files is greater than the preset time threshold, increase the initial reading duration, and determine the increased initial reading duration as the reading duration;当已生成的TS文件的总时长不大于所述预设时间阈值时，保持所述读取时长不变，或者减小所述初始读取时长，并将减小后的初始读取时长确定为所述读取时长。When the total duration of the generated TS files is not greater than the preset time threshold, keep the reading duration unchanged, or reduce the initial reading duration, and determine the reduced initial reading duration as the read duration.6.一种多媒体数据流的处理装置，其特征在于，所述装置包括：6. A device for processing multimedia data streams, wherein the device comprises:接收单元，用于接收客户端发送的请求消息；其中，所述请求消息用于向服务器请求目标多媒体数据流；a receiving unit, configured to receive a request message sent by the client; wherein the request message is used to request a target multimedia data stream from the server;确定单元，用于基于所述目标多媒体数据流对应的属性信息，确定所述目标多媒体数据流是否进行了切分；其中，所述属性信息用于指示所述目标多媒体数据流是否进行了切分；若确定所述目标多媒体数据流未进行切分，则确定读取时长；其中，所述读取时长用于表征待生成的传输流TS文件的时长；a determining unit, configured to determine whether the target multimedia data stream has been split based on attribute information corresponding to the target multimedia data stream; wherein the attribute information is used to indicate whether the target multimedia data stream has been split ; If it is determined that the target multimedia data stream is not segmented, then determine the reading duration; wherein, the reading duration is used to characterize the duration of the transport stream TS file to be generated;处理单元，用于基于所述读取时长，依次从所述目标多媒体数据流中读取对应时长的数据，根据读取的数据得到对应的TS文件；将得到的TS文件分别传输至客户端。The processing unit is configured to sequentially read data of corresponding duration from the target multimedia data stream based on the read duration, obtain corresponding TS files according to the read data, and transmit the obtained TS files to the client respectively.7.根据权利要求6所述的装置，其特征在于：7. The device according to claim 6, wherein:所述处理单元，还用于在目标多媒体数据流对应的属性信息中增加切分参数；其中，所述切分参数用于指示是否对所述目标多媒体数据流进行切分；The processing unit is further configured to add a segmentation parameter to the attribute information corresponding to the target multimedia data stream; wherein, the segmentation parameter is used to indicate whether to segment the target multimedia data stream;所述确定单元，具体用于基于所述属性信息中的切分参数，确定所述目标多媒体数据流是否进行了切分。The determining unit is specifically configured to determine whether the target multimedia data stream is segmented based on the segmentation parameter in the attribute information.8.根据权利要求6所述的装置，其特征在于，所述属性信息还包括持续时间参数，所述持续时间参数用于指示所述待生成的TS文件的时长是否为固定时长；8. The apparatus according to claim 6, wherein the attribute information further comprises a duration parameter, and the duration parameter is used to indicate whether the duration of the TS file to be generated is a fixed duration;所述确定单元，具体用于当根据所述持续时间参数确定所述待生成的TS文件的时长为固定时长时，根据所述请求消息确定读取时长，和\或根据当前的网络传输质量确定读取时长；当根据所述持续时间参数确定所述待生成的TS文件的时长不为固定时长时，根据初始读取时长、已生成的TS文件的总时长与预设时间阈值之间的关系确定读取时长。The determining unit is specifically configured to determine the reading duration according to the request message when the duration of the TS file to be generated is determined to be a fixed duration according to the duration parameter, and/or determine according to the current network transmission quality Reading duration; when determining that the duration of the TS file to be generated is not a fixed duration according to the duration parameter, according to the relationship between the initial reading duration, the total duration of the generated TS file and the preset time threshold Determine the read time.9.一种多媒体数据流的处理装置，其特征在于，所述装置包括：处理器和配置为存储能够在处理器上运行的计算机程序的存储器，9. A device for processing a multimedia data stream, wherein the device comprises: a processor and a memory configured to store a computer program that can be run on the processor,其中，所述处理器配置为运行所述计算机程序时，执行权利要求1至5任一项所述多媒体数据流的处理方法的步骤。Wherein, the processor is configured to execute the steps of the method for processing a multimedia data stream according to any one of claims 1 to 5 when running the computer program.10.一种计算机可读存储介质，其特征在于，所述计算机可读存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现如权利要求1至5中任一项所述的多媒体数据流的处理方法的步骤。10. A computer-readable storage medium, characterized in that, the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to realize the claim The steps of the method for processing a multimedia data stream according to any one of requirements 1 to 5 are required.

Images