Embodiment
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouchedThe specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that, in order toBe easy to description, illustrate only in accompanying drawing to about the related part of invention.
It should be noted that in the case where not conflicting, the feature in embodiment and embodiment in the application can phaseMutually combination.Describe the application in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Fig. 1 is shown can be using the application for adjusting the method for net cast front cover or for adjusting net castThe exemplary system architecture 100 of the embodiment of the device of front cover.
As shown in figure 1, system architecture 100 can include terminal device 101,102,103,107,108,109, network 104,106 and server 105.Network 104 between terminal device 101,102,103 and server 105 to provide transmission linkMedium, medium of the network 106 to provide transmission link between terminal device 107,108,109 and server 105.Network104th, 106 can include various connection types, such as wired, wireless transmission link or fiber optic cables etc..
User can be interacted with using terminal equipment 101,102,103 by network 104 with server 105, to receive or send outSend message etc..Various applications can be installed on terminal device 101,102,103, for example, the application of net cast class, informationClass application, social class application, can with recorded video, and by main broadcaster's client for being mounted thereon by the video of recording it is real-time onReach server 105.Terminal device 101,102,103 includes but is not limited to smart mobile phone, tablet personal computer, portable calculating on kneeMachine and desktop computer etc..
User can be interacted with using terminal equipment 107,108,109 by network 106 with server 105, to receive or send outSend message etc..Various applications can be installed on terminal device 101,102,103, for example, the application of net cast class, informationClass application, social class application, can be by the subscription client of the net cast being mounted thereon, the live row provided a userTable, and get user selection it is live after, the live link sent by server 105 is played out.Terminal device107th, 108,109 include but is not limited to smart mobile phone, tablet personal computer, pocket computer on knee and desktop computer etc..NeedIt is noted that main broadcaster's client and the function of subscription client can be also integrated into a net cast application.
Server 105 can provide support to the application run on terminal device 101,102,103,107,108,109Server, server 105 can obtain the live video that main broadcaster's client for being installed on terminal device 101,102,103 is uploadedFragment, image is extracted from live video fragment, and point of extracted image is determined according to the characteristic information of the image extractedNumber；It is more than the fraction of current cover image in response to fraction, current cover image is replaced with to extracted image.Live videoShown in the subscription client that front cover can be installed on terminal device 107,108,109 in live list.
It should be noted that the method for being used to adjust net cast front cover that the embodiment of the present application is provided can be by servicingDevice 105 is performed, correspondingly, and the device for adjusting net cast front cover can be arranged in server 105.
It should be understood that the number of the terminal device, network and server in Fig. 1 is only schematical.According to realizing needWill, can have any number of terminal device, network and server.
With continued reference to Fig. 2, one embodiment for being used to adjust the method for net cast front cover according to the application is shownFlow 200.This is used for the method for adjusting net cast front cover, comprises the following steps：
Step 201, live video fragment is obtained.
In the present embodiment, for adjusting electronic equipment (such as Fig. 1 institutes of the method operation of net cast front cover thereonThe server shown) live video fragment can be obtained first, live video fragment is the video segment that server is got in real time,Generated by main broadcaster's client real-time recording.The difference according to its service object is applied in net cast, can be divided into main broadcaster clientEnd and subscription client, main broadcaster's client provide service to record live main broadcaster, and subscription client is the live spectators of viewingService is provided.Equally the function of main broadcaster's client and subscription client can be also integrated into same net cast application.
In the net cast list that subscription client is provided a user, or other summary infos for showing live videosThe page, generally can all show net cast front cover, and net cast front cover includes cover image, for example, what main broadcaster's client was uploadedThe image of image or system default.The information such as net cast title and some live times can also be included.Main broadcaster's clientThe transmission to live video fragment can be realized based on various communications protocols between server, for example, RTMP (Real TimeMessaging Protocol, real-time messages host-host protocol), based on HTTP (HyperText Transfer Protocol, surpassText transfer protocol) stream media protocol.So that the streaming protocol HTTP-FLV (Flash that existing HTTP distributes resource can be multiplexedVideo, stream media format) exemplified by, live video fragment can be regarding for the video data composition in one or more FLV filesFrequency fragment.The duration of live video fragment can be set according to actual needs, can be by suitably reducing live video fragmentDuration improves the renewal frequency of front cover.
Step 202, image is extracted from live video fragment.
In the present embodiment, extraction figure in the live video fragment that above-mentioned electronic equipment can be got from step 201Picture.The frame of video extracted in live video fragment can be spaced to schedule, by the whole for the frame of video being drawn into or portionSplit screen is used as the picture extracted.
In some optional implementations of the present embodiment, image is extracted from live video fragment, including：Regarded from liveKey frame is extracted in frequency fragment；Obtain the corresponding picture of key frame and be used as the image extracted.
In this implementation, key frame can also be referred to as I frames (I frame), and Intra pictures can be referred to as again(Intra Picture), key frame is typically each GOP (Group of Picture, frame group) first frame, by appropriatenessGround compresses, and as the reference point of random access, can also be treated as image.The corresponding picture of key frame can be the picture of key frameThe entirety or a part in face, for example, the main part in frame out can be recognized first, are cut according to main part to pictureTake.This extraction mode further increases the quality of the picture extracted.
Step 203, the fraction of extracted image is determined according to the characteristic information of the image extracted.
In the present embodiment, above-mentioned electronic equipment can be determined according to the characteristic information of the image extracted in step 202The fraction of the image extracted.Characteristic information can embody picture feature or the information of picture quality, for example, clearlySpend, whether include portrait.Fraction can be specific numerical value or other information that can be compared, for example, excellent,It is good, in, it is poor, it is high, medium and low etc..Can be previously provided with above-mentioned electronic equipment characteristic information be converted into fraction rule withAnd the corresponding weight of each characteristic information, the fraction of extracted image can be then determined according to above-mentioned rule and weight.
In some optional implementations of the present embodiment, characteristic information includes at least one of following：The definition of image,The portrait that image includes or portrait or the definition of face that integrity degree, the image of face include, image includeThe identification degree of article, the definition of article has been recognized in image.
In this implementation, the definition of image refers to the readability on each thin portion shadow line and its border on image, canDefinition to determine image by index of image border rate of gray level.The portrait that includes to image or face it is completeThe determination of degree, portrait in image or face can be identified first by image recognition technology or human face detection tech, thenContrasted with the same person picture that is identified in other frames in the live video or face, can also be according to whether detectingFace or other key point is pre-set to determine integrity degree.In portrait or the definition i.e. image of face that image includesThe definition of the image of portrait or facial zone.The determination of features described above information is on the books in the prior art, herein no longerRepeat.Characteristic information can also be that other can embody the information of picture quality, for example, the aesthetics of picture, aestheticsIt is determined that composition that can be from image, color in terms of, by machine learning method, extract the characteristic information of image, according toCharacteristic information and the training sample marked in advance, train the model for determining picture aesthetics.
Step 204, the fraction of current cover image is more than in response to fraction, current cover image is replaced with what is extractedImage.
In the present embodiment, above-mentioned electronic equipment can be more than current surface plot in response to the fraction determined in step 203The fraction of picture, current cover image is replaced with extracted image.Replacement to cover image, can include replacing serverThe front cover of the net cast of middle storage, and the front cover after replacement is pushed into subscription client, so that subscription client is at itShown in net cast list.If fraction is not more than the fraction of current cover image, current cover image can be continuing with.The attenuation coefficient of the fraction of front cover image can also be pre-set, for example, decay 5% in every 5 minutes, cover image is avoided with thisUpdate not in time.
In some optional implementations of the present embodiment, by current cover image replace with extracted image itAfterwards, method also includes：The corresponding live temporal information of frame of video where obtaining extracted image, the front cover after image is replacedThe middle live temporal information of addition.
In this implementation, live temporal information can be at the beginning of the net cast between, have been carried out how longOr apart from terminate to also have how long or reproduction time of the current cover image in net cast or how long preceding broadcasting,For example, 10：Picture before 59 picture, or 1 minute.
With continued reference to Fig. 3, Fig. 3 is the application scenarios for being used to adjust the method for net cast front cover according to the present embodimentOne schematic diagram.In Fig. 3 application scenarios, server obtains the live video fragment of each main broadcaster's client recording in real time,And image is extracted from live video fragment, point of extracted image is then determined according to the characteristic information of the image extractedNumber, is finally more than the fraction of current cover image in response to fraction, and the net cast that the subscription client shown in Fig. 3 is shown is arrangedCurrent cover image replaces with extracted image in table, can also be added such as the front cover in net cast 1 in front cover for sayingThe information of the reproduction time of bright cover image, directly can recognize live real content, so as to select with this user according to front coverIts is selected interested live to be watched.
The method that above-described embodiment of the application is provided is carried by obtaining live video fragment, and from live video fragmentImage is taken, the fraction of extracted image is then determined according to the characteristic information of the image extracted, it is finally big in response to fractionIn the fraction of current cover image, current cover image is replaced with to extracted image, the reality of net cast front cover is improvedShi Xing.
Fig. 4 is refer to, Fig. 4 is another embodiment for being used to adjust the method for net cast front cover according to the present embodimentSchematic flow sheet.
In Fig. 4, the flow 400 for being used to adjust the method for net cast front cover, comprises the following steps：
Step 401, the image that initial live video fragment and main broadcaster's client are uploaded is obtained.
In the present embodiment, for adjusting electronic equipment (such as Fig. 1 institutes of the method operation of net cast front cover thereonThe server shown) image that initial live video fragment and main broadcaster's client are uploaded can be obtained.Initial live video fragment canTo start the one or more live video fragments for most starting to upload after this is live including main broadcaster's client.
Step 402, image main broadcaster's client uploaded is defined as initial cover image.
In the present embodiment, the image that above-mentioned electronic equipment can upload the main broadcaster's client obtained in step 401 is trueIt is set to initial cover image.If same main broadcaster does not upload image, default image can also be used as initial cover image, write from memoryRecognize the default setting that image can be system.
In some optional implementations of the present embodiment, it can also be defined as in the image for uploading main broadcaster's client justAfter beginning cover image, step 403 is not performed to step 404, one fraction, this fraction need to be first directly set for initial cover imageIt can be determined according to the average mark of live middle image, then into step 405.
Step 403, initial pictures are obtained from initial live video fragment.
In the present embodiment, obtained in the initial live video fragment that above-mentioned electronic equipment can be obtained from step 401Initial pictures.The frame of video extracted in initial live video fragment can be spaced to schedule, by the frame of video being drawn intoAll or part of picture be used as the picture got；Key frame can also be extracted, all or part of picture of key frame is madeFor the picture got, specific method is referred to step 202.
Step 404, regarded in response to the timestamp of frame of video where initial pictures with first in initial live video fragmentThe difference of the timestamp of frequency frame is more than predetermined threshold value, and initial pictures are defined as into initial cover image, and according to initial picturesCharacteristic information determines the fraction of initial pictures.
In the present embodiment, above-mentioned electronic equipment can be in response to frame of video where the initial pictures that are obtained in step 403Timestamp and step 401 in the initial live video fragment that obtains the difference of the timestamp of first frame of video be more than it is defaultInitial pictures are defined as initial cover image by threshold value, and determine according to the characteristic information of initial pictures the fraction of initial pictures.Fraction can be specific numerical value or other information that can be compared.Characteristic information can embody figureThe information of piece feature or quality, for example, in portrait or the integrity degree of face that the definition of image, image include, imageIncluding portrait or the definition of face, the identification degree of the article that includes of image, image in recognized the clear of articleDegree, the aesthetics of picture, aesthetics.Specific determination method can refer to step 203.
In some optional implementations of the present embodiment, frame of video where can also determining initial pictures is this videoWhich frame of video in live, is more than predetermined threshold value in response to the numeral determined, initial pictures is defined as into initial surface plotPicture.Passage time stab or other conditions of similarities limitation, it is to avoid live content is also unstable when, it is impossible to fine bodyThe image of existing live content is used as cover image.
Step 405, live video fragment is obtained.
In the present embodiment, above-mentioned electronic equipment can obtain live video fragment first.Live video fragment can beLive video fragment after initial live video fragment.Initial live video live for primary video, being obtained in step 401Fragment can be with only one of which, and the live video fragment in this step can have several, i.e. step 401 is to step 404 executionAfterwards, with the progress of net cast, above-mentioned electronic equipment constantly gets the live video fragment of main broadcaster's client real-time recording,Step 405 can be performed to step 408 often to get a live video fragment.
Step 406, image is extracted from live video fragment.
In the present embodiment, extraction figure in the live video fragment that above-mentioned electronic equipment can be got from step 405Picture.The frame of video extracted in live video fragment can be spaced to schedule, by the whole for the frame of video being drawn into or portionSplit screen is used as the picture extracted.
Step 407, the fraction of extracted image is determined according to the characteristic information of the image extracted.
In the present embodiment, above-mentioned electronic equipment can be determined according to the characteristic information of the image extracted in step 406The fraction of the image extracted.
Step 408, the fraction of current cover image is more than in response to fraction, current cover image is replaced with what is extractedImage.
In the present embodiment, above-mentioned electronic equipment can be more than current surface plot in response to the fraction determined in step 407The fraction of picture, current cover image is replaced with extracted image.If the live video fragment obtained in step 405 is liveFirst video segment after video segment, then current cover image is the initial cover image that step 405 is determined.
Figure 4, it is seen that compared with the corresponding embodiments of Fig. 2, being used in the present embodiment adjusts net cast envelopeThe step of flow 400 of the method in face highlights determination initial cover image.Thus, the scheme of the present embodiment description is avoidedWhen live content is also unstable, it is impossible to embody the image of live content very well as cover image, improve surface plotThe accuracy of picture.
With further reference to Fig. 5, as the realization to the above method, it is used to adjust net cast envelope this application provides one kindOne embodiment of the device in face, the device embodiment is corresponding with the embodiment of the method shown in Fig. 2, and the device can specifically be answeredFor in various electronic equipments.
As shown in figure 5, the device 500 for being used to adjust net cast front cover of the present embodiment includes：First acquisition unit501, extraction unit 502, the first determining unit 503, replacement unit 504, wherein, first acquisition unit 501 is live for obtainingVideo segment, live video fragment is generated by main broadcaster's client real-time recording；Extraction unit 502, for from live video pieceImage is extracted in section；First determining unit 503, for determining extracted image according to the characteristic information of the image extractedFraction；Replacement unit 504, the fraction for being more than current cover image in response to fraction, institute is replaced with by current cover imageThe image of extraction.
In the present embodiment, first acquisition unit 501, extraction unit 502, the first determining unit 503, replacement unit 504Specific processing may be referred to Fig. 2 correspondences embodiment step 201, step 202, step 203, the detailed description of step 204, hereinRepeat no more.
In some optional implementations of the present embodiment, it is characterised in that device also includes：Second acquisition unit (figureNot shown in), for obtaining the image that initial live video fragment and main broadcaster's client are uploaded；Second determining unit is (in figure notShow), the image for main broadcaster's client to be uploaded is defined as initial cover image；3rd acquiring unit (not shown),For obtaining initial pictures from initial live video fragment；3rd determining unit (not shown), in response to initialThe difference of the timestamp of frame of video where image and the timestamp of first frame of video in initial live video fragment is more than defaultInitial pictures are defined as initial cover image by threshold value, and determine according to the characteristic information of initial pictures the fraction of initial pictures.
In some optional implementations of the present embodiment, characteristic information includes at least one of following：The definition of image,The portrait that image includes or portrait or the definition of face that integrity degree, the image of face include, image includeThe identification degree of article, the definition of article has been recognized in image.
In some optional implementations of the present embodiment, extraction unit 502, including：Subelement is extracted (in figure not showGo out), for extracting key frame from live video fragment；Subelement (not shown) is obtained, for obtaining key frame correspondencePicture be used as the image extracted.
In some optional implementations of the present embodiment, device also includes：Adding device (not shown), for obtainingThe corresponding live temporal information of frame of video where taking extracted image, adds live time letter in the front cover after replacing imageBreath.
From figure 5 it can be seen that being used for the device 500 for adjusting net cast front cover in the present embodiment by obtaining live regardFrequency fragment, live video fragment is generated by main broadcaster's client real-time recording；Image is extracted from live video fragment；According to instituteThe characteristic information of the image of extraction determines the fraction of extracted image；It is more than the fraction of current cover image in response to fraction,Current cover image is replaced with to extracted image, the real-time of net cast front cover is improved.
Below with reference to Fig. 6, it illustrates suitable for the computer system 600 for the server of realizing the embodiment of the present applicationStructural representation.Server shown in Fig. 6 is only an example, to the function of the embodiment of the present application and should not use range bandCarry out any limitation.
As shown in fig. 6, computer system 600 includes CPU (CPU) 601, it can be read-only according to being stored inProgram in memory (ROM) 602 or be loaded into program in random access storage device (RAM) 603 from storage part 608 andPerform various appropriate actions and processing.In RAM 603, the system that is also stored with 600 operates required various programs and data.CPU 601, ROM 602 and RAM 603 are connected with each other by bus 604.Input/output (I/O) interface 605 is also connected to alwaysLine 604.
I/O interfaces 605 are connected to lower component：Importation 606 including keyboard, mouse etc.；Penetrated including such as negative electrodeThe output par, c 607 of spool (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.；Storage part 608 including hard disk etc.；And the communications portion 609 of the NIC including LAN card, modem etc..Communications portion 609 via such as becauseThe network of spy's net performs communication process.Driver 610 is also according to needing to be connected to I/O interfaces 606.Detachable media 611, such asDisk, CD, magneto-optic disk, semiconductor memory etc., are arranged on driver 610, in order to read from it as neededComputer program be mounted into as needed storage part 608.
Especially, in accordance with an embodiment of the present disclosure, the process described above with reference to flow chart may be implemented as computerSoftware program.For example, embodiment of the disclosure includes a kind of computer program product, it includes being carried on computer-readable mediumOn computer program, the computer program include be used for execution flow chart shown in method program code.In such realityApply in example, the computer program can be downloaded and installed by communications portion 609 from network, and/or from detachable media611 are mounted.When the computer program is performed by CPU (CPU) 601, perform what is limited in the present processesAbove-mentioned functions.It should be noted that computer-readable medium described herein can be computer-readable signal media orComputer-readable recording medium either the two any combination.Computer-readable recording medium for example can be --- butBe not limited to --- electricity, magnetic, optical, electromagnetic, system, device or the device of infrared ray or semiconductor, or it is any more than combination.The more specifically example of computer-readable recording medium can include but is not limited to：Electrical connection with one or more wires,Portable computer diskette, hard disk, random access storage device (RAM), read-only storage (ROM), erasable type may be programmed read-only depositReservoir (EPROM or flash memory), optical fiber, portable compact disc read-only storage (CD-ROM), light storage device, magnetic memoryPart or above-mentioned any appropriate combination.In this application, computer-readable recording medium can any be included or storeThe tangible medium of program, the program can be commanded execution system, device or device and use or in connection.AndIn the application, computer-readable signal media can include believing in a base band or as the data of carrier wave part propagationNumber, wherein carrying computer-readable program code.The data-signal of this propagation can take various forms, including but notIt is limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computerAny computer-readable medium beyond readable storage medium storing program for executing, the computer-readable medium can send, propagate or transmit useIn by the use of instruction execution system, device or device or program in connection.Included on computer-readable mediumProgram code any appropriate medium can be used to transmit, include but is not limited to：Wirelessly, electric wire, optical cable, RF etc., Huo ZheshangAny appropriate combination stated.
Flow chart and block diagram in accompanying drawing, it is illustrated that according to the system of the various embodiments of the application, method and computer journeyArchitectural framework in the cards, function and the operation of sequence product.At this point, each square frame in flow chart or block diagram can generationThe part of one unit of table, program segment or code, a part for the unit, program segment or code is comprising one or moreExecutable instruction for realizing defined logic function.It should also be noted that in some realizations as replacement, institute in square frameThe function of mark can also be with different from the order marked in accompanying drawing generation.For example, two square frames succeedingly represented are actualOn can perform substantially in parallel, they can also be performed in the opposite order sometimes, and this is depending on involved function.AlsoIt is noted that the combination of each square frame in block diagram and/or flow chart and the square frame in block diagram and/or flow chart, Ke YiyongPerform the special hardware based system of defined function or operation to realize, or can be referred to specialized hardware with computerThe combination of order is realized.
Being described in unit involved in the embodiment of the present application can be realized by way of software, can also be by hardThe mode of part is realized.Described unit can also be set within a processor, for example, can be described as：A kind of processor bagInclude first acquisition unit, extraction unit, the first determining unit, replacement unit.Wherein, the title of these units is under certain conditionsThe restriction in itself to the unit is not constituted, for example, first acquisition unit is also described as " obtaining live video fragmentUnit ".
As on the other hand, present invention also provides a kind of nonvolatile computer storage media, the non-volatile calculatingMachine storage medium can be the nonvolatile computer storage media included in device described in above-described embodiment；Can also beIndividualism, without the nonvolatile computer storage media in supplying server.Above-mentioned nonvolatile computer storage mediaBe stored with one or more program, when one or more of programs are performed by an equipment so that the equipment：ObtainCut-off broadcasts video segment, and live video fragment is generated by main broadcaster's client real-time recording；Figure is extracted from live video fragmentPicture；The fraction of extracted image is determined according to the characteristic information of the image extracted；It is more than current surface plot in response to fractionThe fraction of picture, current cover image is replaced with extracted image.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.People in the artMember should be appreciated that invention scope involved in the application, however it is not limited to the technology of the particular combination of above-mentioned technical characteristicScheme, while should also cover in the case where not departing from the inventive concept, is carried out by above-mentioned technical characteristic or its equivalent featureOther technical schemes formed by any combination.Such as features described above has similar work(with (but not limited to) disclosed hereinThe technical characteristic of energy carries out technical scheme formed by replacement mutually.