CN101547369A

Movatterモバイル変換

Info

Publication number: CN101547369A
Application number: CN200810043195A
Authority: CN
Inventors: 王宇; 李海良; 陈明灿
Original assignee: Shanda Computer Shanghai Co Ltd
Current assignee: Shanda Computer Shanghai Co Ltd
Priority date: 2008-03-26
Filing date: 2008-03-26
Publication date: 2009-09-30
Anticipated expiration: 2028-03-26
Also published as: CN101547369B

Abstract

The invention discloses a fault tolerance method for removing a mosaic phenomenon in playing network video, which comprises the following steps: 1, detecting that a data frame in a buffering region of a client playing end has an error; 2, judging the error kind of the data frame and making corresponding measures; 3, judging whether a subsequent data frame contains a synchronous sign, and if so, judging whether the subsequent data frame is an IDR frame; and 4, if the subsequent data frame is the IDR frame, clearing up the data frame in the buffering region of the client playing end, removing the needed synchronous sign and carrying out the normal playing flow; and if the subsequent data frame is not the IDR frame, discharging the data frame, reading the next data frame, judging whether the next data frame is the IDR frame and repeating the step four. The method carries out detection on the data in the buffering region of the client playing end, when a wrong frame or a lost frame is detected, and a subsequent non-IDR frame is discarded to effectively remove the mosaic phenomenon.

Description

Remove the fault-tolerance approach of mosaic phenomenon in playing network video

Technical field

The present invention relates to the video playback fault-toleranr technique of Computer Multimedia Technology, particularly a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video.

Background technology

The network program request is a technological means commonly used in the network, can cause all mistakes but the programme content of network program request is subjected to the influence of network environment, thereby it is unclear that user side is shown, occurs mosaic phenomenon especially easily.For example, program request impacts to network for data packet loss that may exist in the Network Transmission and time-delay arrival meeting, the user drags progress bar and also can cause link down in on-demand process, the display device of player is lost, and the Frame of decoder decode failure and player is made mistakes and can be influenced the video effect of network program request.

According to the definition of MPEG, frame is divided into the IDR frame, B frame and P frame.Wherein, the IDR frame is a key frame, adopts the reference frame pattern, and compression in the frame only is provided, and when promptly two field picture being compressed to the IDR frame, has only considered the image in the frame.The compression of IDR frame can not be removed interframe redundancy.Compression is based on discrete cosine transform in the frame, is similar to JPEG and the compression standard of use discrete cosine transform in the image H.261.The compression of IDR frame can obtain the 6:1 ratio and not produce any noticeable blooming.The B frame is two-way interframe encode.It extracts data from the IDR frame of front and back or P frame.The B frame compresses based on the difference between present frame and former frame and back one two field picture.B frame compression can reach the 200:1 compression ratio, and its document size is generally 15% of IDR frame reduced size, less than half of P frame reduced size.The P frame has adopted forward prediction, and promptly the P frame is to get according to the P frame of front or the prediction of I frame.The P frame adopts predictive coding, utilizes the general statistical information of consecutive frame to predict.That is to say that it considers kinetic characteristic, and interframe encode is provided.The IDR frame that P frame prediction present frame and front are nearest or the difference of P frame.

When video be with H.264 the coding the ASF file format time, owing to H.264 have flexible macro-block order, by being set, macro-block order shine upon at random the assignment macro block to different sheet groups, but this flexible macro-block order pattern has been upset former macro block order, reduced code efficiency, increase time-delay, but strengthened the performance of anti-error code.When the loss of data of a sheet group, can carry out error concealment with the data of another sheet group.Although the encoder that has is exactly a sheet as the frame of X264, it still can make error concealment with consecutive frame. using the topmost discomfort of fault-toleranr technique of error concealment is to cause mosaic phenomenon, and this can the very big user experience that influences.

Summary of the invention

Technical problem to be solved by this invention provides a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video, can realize the filtering of optimization in the video decode reduction, avoids blank screen and mosaic phenomenon, satisfies user's demand for experience preferably.

For solving the problems of the technologies described above, a kind of technical scheme of removing the fault-tolerance approach of mosaic phenomenon in playing network video of the present invention is may further comprise the steps:

The first step, the Frame that detects in the buffering area of client playing end is wrong;

In second step, judgment data frame error kind if the reconstruction filter link mistake of link down appears then in Frame, and is provided with and needs synchronous mark, if Frame the mistake of the asynchronous or decoding failure of data occurs then directly be provided with needing synchronous mark;

The 3rd step, judge whether subsequent data frame comprises synchronous mark, if do not comprise synchronous mark, then carry out normal playing flow, if comprise synchronous mark, judge that then subsequent data frame is the IDR frame;

The 4th step, if subsequent data frame is the IDR frame, then empty the Frame in the buffering area of client playing end, removing needs synchronous mark, and carries out normal playing flow, if subsequent data frame is not the IDR frame, then abandon this Frame, read next Frame, and judge that this next one Frame is the IDR frame, and repeated for the 4th step.

The present invention is by to the detection of client playing end buffer data, when having detected when makeing mistakes frame or lost frames, abandons follow-up non-IDR frame, up to new IDR frame, so effective removal mosaic phenomenon occurring.

Description of drawings

The present invention is further detailed explanation below in conjunction with drawings and Examples:

Fig. 1 is a schematic flow sheet of the present invention;

Fig. 2 is a client playing end buffer data schematic diagram of the present invention.

Embodiment

As shown in Figure 1, adopt based on DirectShow (DirectShow be Microsoft provide one be enclosed within and carry out the kit that Streaming Media is handled on the windows platform, its supports the seizure and the playback of media stream.) mechanism the player plays Internet video time, need carry out judgment processing to Frame, whether the Frame that at first detects in the buffering area of client playing end is wrong, if there is not mistake, then carry out normal playing program, if the Frame that detects in the buffering area of client playing end is wrong, and judges its error kind.

When the judgment data frame is made mistakes classification, generally be divided into following three kinds of error category: a, the link down mistake appears in Frame; B, the decoder decode failure; C, the data of Frame are asynchronous.When the user dragged progress bar or packet loss occurs, the link down mistake appearred in Frame, needed the reconstruction filter link, and was provided with on the played data frame and needs synchronous mark; When decoder decode failure wrong occurring, mean that data may make mistakes, this is this Frame need be abandoned, and needs directly be provided with on Frame to need synchronous mark; When the nonsynchronous mistake of the data that Frame occurs, then being provided with on Frame needs synchronous mark.If when the Frame mistake not occurring, then not being provided with on Frame needs synchronous mark.

Whether need synchronous mark, if if do not comprise synchronous mark, then carry out normal playing flow, if comprise synchronous mark, judge that then subsequent data frame is the IDR frame if detecting to be provided with on the Frame.In the present invention, IDR is set to 50 to 100 frames coding once, and an IDR frame refresh sequence also can be got 80 frames among the present invention.

In the present invention, the buffering area of client playing end has 20 seconds played data at least, and as shown in Figure 2, the data of the buffering area of client playing end comprise IDR frame and P frame.Wherein, the I frame of IDR frame for refreshing immediately, the image after the IDR frame can be not reference with the image before the IDR frame more, it adopts the reference frame pattern, and compression in the frame only is provided, and the P frame is a forward reference frame, next for referencial use with the frame of front when encoding and decoding, it considers kinetic characteristic, and interframe encode is provided.P1 frame among Fig. 2, P2 frame and P3 frame are frame or the lost frames of makeing mistakes, if play these frames, can cause mosaic phenomenon, and therefore, the present invention abandons this frame, judge that subsequent data frame is the IDR frame.

If subsequent data frame is the IDR frame, then empty the Frame in the buffering area of client playing end, removal needs synchronous mark, and carry out normal playing flow, if subsequent data frame is not the IDR frame, then abandon this Frame, read next Frame, and judge that this next one Frame is the IDR frame, and repeated for the 4th step.

The present invention detects by the data to the client playing end buffering area, in time find the mistake of Frame, and the various mistakes that Frame occurs are done corresponding processing, and abandon follow-up non-IDR frame and play new IDR frame, realize removing the technical goal of Internet video mosaic phenomenon.

Claims

1. a fault-tolerance approach of removing mosaic phenomenon in playing network video is characterized in that, may further comprise the steps:

2. a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video according to claim 1 is characterized in that the buffering area of client playing end has 20 seconds played data at least.

3. a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video according to claim 1 is characterized in that the data of the buffering area of client playing end comprise IDR frame and P frame.

4. a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video according to claim 1 is characterized in that, described IDR is set to 50 to 100 frames coding once.

5. a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video according to claim 4 is characterized in that, described IDR is set to 80 frames coding once.