CN110769275B - Method, device and system for processing live data stream - Google Patents
Method, device and system for processing live data streamDownload PDFInfo
- Publication number
- CN110769275B CN110769275BCN201910954026.2ACN201910954026ACN110769275BCN 110769275 BCN110769275 BCN 110769275BCN 201910954026 ACN201910954026 ACN 201910954026ACN 110769275 BCN110769275 BCN 110769275B
- Authority
- CN
- China
- Prior art keywords
- live
- data stream
- updated
- address
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545processingMethods0.000titleclaimsabstractdescription59
- 238000000034methodMethods0.000titleclaimsabstractdescription50
- 238000004590computer programMethods0.000claimsdescription14
- 230000008859changeEffects0.000claimsdescription9
- 230000000903blocking effectEffects0.000claimsdescription7
- 238000012508change requestMethods0.000claimsdescription7
- 238000001514detection methodMethods0.000claims1
- 238000010586diagramMethods0.000description16
- 238000004891communicationMethods0.000description10
- 238000005516engineering processMethods0.000description9
- 238000003672processing methodMethods0.000description8
- 230000003287optical effectEffects0.000description5
- 230000005236sound signalEffects0.000description4
- 230000003993interactionEffects0.000description3
- 238000007726management methodMethods0.000description3
- 230000001133accelerationEffects0.000description2
- 230000009471actionEffects0.000description2
- 238000013500data storageMethods0.000description2
- 230000008569processEffects0.000description2
- 230000006978adaptationEffects0.000description1
- 238000003491arrayMethods0.000description1
- 230000009286beneficial effectEffects0.000description1
- 238000011161developmentMethods0.000description1
- 230000006870functionEffects0.000description1
- 238000003384imaging methodMethods0.000description1
- 230000002452interceptive effectEffects0.000description1
- 239000004973liquid crystal related substanceSubstances0.000description1
- 238000012986modificationMethods0.000description1
- 230000004048modificationEffects0.000description1
- 230000002093peripheral effectEffects0.000description1
- 230000003068static effectEffects0.000description1
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Technical Field
The present disclosure relates to the field of live broadcast technologies, and in particular, to a method, an apparatus, and a system for processing a live broadcast data stream, a storage medium, a server, and a viewer client.
Background
With the development of the internet of things technology, the live broadcast industry (such as live game broadcast and live shopping broadcast) is rapidly developed, and meanwhile, the innovation of the live broadcast technology is promoted.
In the existing live broadcast technology, a main broadcast client acquires a live broadcast data stream in real time and pushes the live broadcast data stream to a Content Delivery Network (CDN) so as to be delivered to audience clients by the CDN. The anchor may add some information (e.g., violation information) that is not allowed by the live platform locally in the live data stream, so the live platform needs to block this information.
Disclosure of Invention
The disclosure provides a method, a device and a system for processing a live data stream, a storage medium, a server and a spectator client, which are used for shielding information which is not allowed by a live platform in the live data stream. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, a method for processing a live data stream is provided, where the method is applied to a server, and the method includes:
when detecting that the live data stream has content to be shielded, determining shielding information;
shielding the content to be shielded in the live broadcast data stream according to the shielding information to obtain a shielded updated live broadcast data stream;
determining an updated live stream address corresponding to the updated live stream data;
and issuing the updated live streaming address to a spectator client of a spectator in the live broadcasting room.
In a possible implementation manner, the occlusion information includes: position information of the content to be shielded and style information of the shielding layer.
In a possible implementation manner, the blocking a content to be blocked in the live broadcast data stream according to the blocking information to obtain a blocked updated live broadcast data stream includes:
generating a shielding layer according to the pattern information of the shielding layer;
and adding the shielding layer into the live broadcast data stream according to the position information, and shielding the content at the corresponding position in the live broadcast data stream through the shielding layer to obtain the shielded updated live broadcast data stream.
In a possible implementation manner, the issuing the updated live streaming address to the audience client of the audience in the live broadcast room, where the audience in the live broadcast room is an existing audience, includes:
issuing address change information to a first audience client of an existing audience in a live broadcast room;
receiving a request for changing an address sent by a first viewer client;
and sending the updated live streaming address to the first viewer client according to the address change request.
In a possible implementation manner, the issuing the updated live streaming address to the audience client of the audience in the live broadcast room, where the audience in the live broadcast room is an existing audience, includes:
and issuing an address changing instruction to a first audience client of an existing audience in the live broadcast room, wherein the address changing instruction carries the updated live broadcast stream address.
In a possible implementation manner, the issuing, by the viewer client of the viewer in the live broadcast room, the updated live broadcast stream address to the viewer client of the viewer in the live broadcast room, where the viewer in the live broadcast room is a viewer newly entering the live broadcast room, includes:
receiving an address acquisition request sent by a second audience client of an audience newly entering the live broadcast room;
and sending the updated live streaming address to the second viewer client according to the address acquisition request.
In a possible implementation, before determining occlusion information, the method further includes:
acquiring a live broadcast screen shot of the live broadcast data stream;
detecting whether content to be shielded exists in the live screen shot;
and if the content to be shielded exists in the live broadcast screenshot, determining that the content to be shielded exists in the live broadcast data stream.
According to a second aspect of the embodiments of the present disclosure, there is provided a method for processing a live data stream, the method being applied to a viewer client, the method including:
receiving an updated live streaming address sent by a server, wherein the updated live streaming address corresponds to an updated live streaming, and the updated live streaming is obtained after the server shields the content to be shielded in the live streaming according to shielding information;
and acquiring the updated live broadcast data stream from the server according to the updated live broadcast stream address.
According to a third aspect of the embodiments of the present disclosure, there is provided a device for processing a live data stream, where the device is applied to a server and includes a module configured to execute the method for processing the live data stream in the first aspect or any possible implementation manner of the first aspect.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a device for processing a live data stream, the device being applied to a viewer client, and including a module configured to perform the method for processing a live data stream in the second aspect or any possible implementation manner of the second aspect.
According to a fifth aspect of embodiments of the present disclosure, there is provided a storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of a method of processing a live data stream in any possible implementation of the present disclosure.
According to a sixth aspect of the embodiments of the present disclosure, there is provided a server, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the steps of the method for processing a live data stream in the first aspect or any possible implementation manner of the first aspect when executing the program.
According to a seventh aspect of embodiments of the present disclosure, there is provided an audience client comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method for processing a live data stream in the second aspect or any possible implementation manner of the second aspect when executing the program.
According to an eighth aspect of embodiments of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the steps of a method for processing a live data stream in any possible implementation manner of the present disclosure.
According to a ninth aspect of the embodiments of the present disclosure, there is provided a live data stream processing system, including: the system comprises a main broadcasting client, a server provided by any embodiment of the disclosure and at least one audience client provided by any embodiment of the disclosure, wherein the server is connected with the main broadcasting client and the at least one audience client.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
the server generates an updated live broadcast data stream with the content to be shielded being shielded, and sends an updated live broadcast stream address corresponding to the updated live broadcast data stream to the audience client, so that the audience client acquires the updated live broadcast data stream from the server according to the updated live broadcast stream address, and the content to be shielded in the live broadcast data stream pulled by the audience client is shielded, so that the information which is not allowed by a live broadcast platform in the live broadcast data stream can be shielded.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
FIG. 1 is a block diagram illustrating a processing system for live streaming in accordance with an exemplary embodiment;
FIG. 2 is a flow diagram illustrating a method of processing a live data stream on a server side in accordance with an exemplary embodiment;
FIG. 3 is a flow diagram illustrating a method of processing a live data stream at a viewer client side in accordance with an exemplary embodiment;
FIG. 4 is an interaction diagram illustrating a method of processing a live data stream in accordance with an exemplary embodiment;
FIG. 5 is a live screenshot shown in accordance with an exemplary embodiment;
FIG. 6 is a live occluded screenshot shown in accordance with an exemplary embodiment;
fig. 7 is a first structural diagram of a processing device of a live data stream on a server side according to an exemplary embodiment;
fig. 8 is a diagram illustrating a second structure of a processing apparatus for server-side live data stream according to an exemplary embodiment;
fig. 9 is a schematic diagram illustrating a third structure of a processing apparatus for server-side live data stream according to an exemplary embodiment;
FIG. 10 is a block diagram illustrating an arrangement of a viewer client-side live data stream processing device in accordance with an illustrative embodiment;
FIG. 11 is a schematic diagram illustrating the structure of a viewer client, according to an exemplary embodiment;
fig. 12 is a schematic diagram illustrating a configuration of a server according to an example embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
First, a network architecture of an application scenario of the technical solution provided by the embodiment of the present disclosure is introduced.
Fig. 1 is a schematic structural diagram of a live data stream processing system according to an exemplary embodiment, and as shown in fig. 1, a live data stream processing system provided by an embodiment of the present disclosure includes: amain client 10, a Content Delivery Network (CDN)20, aserver 30, and at least oneviewer client 40, theserver 30 being connected to themain client 10, the CDN20, and the at least oneviewer client 40.
Theanchor client 10 is configured to collect live data streams and push the live data streams to theserver 30.
A CDN20 configured to screenshot the live data stream, obtain the live screenshot, store the live screenshot, send a screenshot message to theserver 30, and distribute the live data stream to theviewer client 40.
In the embodiment of the present disclosure, the screen capture message may include: screen capture address, screen capture time, screen capture ID, screen capture size, live broadcast room ID, and live broadcast room anchor ID.
Theserver 30 is configured to determine shielding information when detecting that the live broadcast data stream has content to be shielded, shield the content to be shielded in the live broadcast data stream according to the shielding information, obtain an updated live broadcast data stream after shielding, determine an updated live broadcast stream address corresponding to the updated live broadcast data stream, and issue the updated live broadcast stream address to audience clients of audiences in a live broadcast room. Theserver 30 may include a live source server for storing a live source and a web server for issuing a live streaming address and performing some service logic.
And theviewer client 40 is configured to obtain the updated live data stream from theserver 30 according to the updated live stream address after receiving the updated live stream address sent by theserver 30. Theviewer client 40 may include: afirst viewer client 401 of an existing viewer in the live room and asecond viewer client 402 of a viewer newly entering the live room.
The processing method of the live data stream provided by the embodiment of the disclosure can be applied to application scenes such as game live broadcast, shopping live broadcast and the like, and the processing methods of the live data streams at the server side and the spectator client side are respectively introduced below.
Fig. 2 is a flowchart illustrating a processing method of a live data stream according to an exemplary embodiment, and as shown in fig. 2, on a server side, the present disclosure provides a processing method of a live data stream, where the method includes the following steps:
s101, when the live data stream is detected to have content to be shielded, shielding information is determined;
in the embodiment of the disclosure, the content to be blocked is information that is not allowed to be played by the live platform, for example, business sensitive information of other platforms, two-dimensional code advertisements, and the like.
In the embodiment of the present disclosure, the occlusion information may include: position information of the content to be shielded and style information of the shielding layer. The style information can be a shielding layer or a parameter of the shielding layer, and the anchor client needs to generate the shielding layer according to the parameter of the shielding layer. The pattern of the occlusion layer includes, but is not limited to, a mosaic, different pictures, or various forms of occlusion layers such as semi-transparent, etc., the pattern of the occlusion layer may be a pattern notified by the server, or may be a pattern given by the server for indication, and the style determined by the anchor client according to the indication.
S102, shielding the content to be shielded in the live broadcast data stream according to the shielding information to obtain a shielded updated live broadcast data stream;
in some embodiments, in step S102, blocking, according to the blocking information, the content to be blocked in the live broadcast data stream to obtain a blocked updated live broadcast data stream includes:
generating a shielding layer according to the pattern information of the shielding layer;
and adding the shielding layer into the live broadcast data stream according to the position information, and shielding the content at the corresponding position in the live broadcast data stream through the shielding layer to obtain the shielded updated live broadcast data stream.
S103, determining an updated live broadcast stream address corresponding to the updated live broadcast data stream;
and S104, issuing the updated live streaming address to a spectator client of a spectator in the live broadcasting room.
In a possible implementation manner, the step S104 of issuing the updated live streaming address to the audience client of the audience in the live broadcast room includes:
issuing address change information to a first audience client of an existing audience in a live broadcast room;
receiving a request for changing an address sent by a first viewer client;
and sending the updated live streaming address to the first viewer client according to the address change request.
In another possible implementation manner, the step S104 of issuing the updated live streaming address to the viewer client of the viewer in the live broadcast room includes:
and issuing an address changing instruction to a first audience client of an existing audience in the live broadcast room, wherein the address changing instruction carries the updated live broadcast stream address.
In a possible implementation manner, the issuing, by the step S104, the new live streaming address to the viewer client of the viewer in the live broadcast room, where the viewer in the live broadcast room is a viewer newly entering the live broadcast room, may include:
receiving an address acquisition request sent by a second audience client of an audience newly entering the live broadcast room;
and sending the updated live streaming address to the second viewer client according to the address acquisition request.
In a possible implementation, before determining occlusion information, the method further includes:
acquiring a live broadcast screen shot of the live broadcast data stream;
detecting whether content to be shielded exists in the live screen shot;
and if the content to be shielded exists in the live broadcast screenshot, determining that the content to be shielded exists in the live broadcast data stream.
In some embodiments, the acquiring a live screenshot of a live data stream may include:
receiving a screen capture message sent by the CDN; the screen capture message comprises a screen capture address of a live screen capture of the live data stream;
and acquiring a live screenshot of a live data stream from the CDN based on the screenshot message.
In the embodiment of the present disclosure, the screen capture message may include: screen capture address, screen capture time, screen capture ID, screen capture size, live broadcast room ID, and live broadcast room anchor ID.
Fig. 3 is a flowchart illustrating a method for processing a live data stream according to an exemplary embodiment, and as shown in fig. 3, on a viewer client side, the embodiment of the present disclosure provides a method for processing a live data stream, which includes the following steps:
s201, receiving an updated live streaming address sent by a server, wherein the updated live streaming address corresponds to an updated live streaming, and the updated live streaming is obtained after the server shields to-be-shielded content in the live streaming according to shielding information;
s202, the updated live broadcast data stream is obtained from the server according to the updated live broadcast stream address.
The following takes live game as an example, and an overall flow of processing of live data stream provided by the embodiment of the present disclosure is described with reference to an interactive diagram, as shown in fig. 4.
S301, the CDN captures a live broadcast data stream of the game live broadcast to obtain a live broadcast screenshot, and stores the live broadcast screenshot;
as an example, a live screenshot is shown in fig. 5.
S302, the CDN sends a screen capture message to a server;
wherein the screen capture message may include: screen capture address, screen capture time, screen capture ID, screen capture size, live broadcast room ID, and live broadcast room anchor ID.
For example, the CDN sends a screenshot message to the kafka message queue, and the server then consumes the screenshot message.
S303, the server acquires a live screen shot of a live data stream from the CDN based on the screen shot message;
s304, the server detects whether the content to be shielded exists in the live screen shot, and if the content to be shielded exists in the live screen shot, the content to be shielded exists in the live data stream;
s305, the server determines shielding information;
wherein the occlusion information may include: position information of the content to be shielded and style information of the shielding layer.
S306, the server shields the content to be shielded in the live broadcast data stream according to the shielding information, obtains a shielded updated live broadcast data stream, and determines an updated live broadcast stream address corresponding to the updated live broadcast data stream;
as an example, adding an occlusion layer on a live screenshot results in an occluded live screenshot as shown in FIG. 6.
S307, the server sends an address change message to a first audience client of an existing audience in the live broadcast room;
s308, when receiving the address change message sent by the server, the first audience client sends an address change request to the server;
s309, the server sends the updated live streaming address to the first viewer client according to the address change request;
s310, the first audience client acquires the updated live broadcast data stream from the server according to the updated live broadcast stream address;
s311, a second audience client of the audience newly entering the live broadcast room sends an address acquisition request to a server;
s312, the server sends the updated live streaming address to the second viewer client according to the address acquisition request;
and S313, the second viewer client acquires the updated live broadcast data stream from the server according to the updated live broadcast stream address.
It should be noted that, in the live broadcast data stream processing method provided by the embodiment of the present disclosure, the server generates the updated live broadcast data stream in which the content to be blocked is blocked, and then the updated live broadcast data stream is forwarded to the audience client by the CDN, which does not relate to the version of the audience client, so that the low-version audience client or the illegal audience client can be prevented from bypassing the shielding policy (i.e., shielding the information that is not allowed by the live broadcast platform).
Based on the same inventive concept, the disclosed embodiment further provides a processing apparatus of a live data stream, the apparatus is applied to a server, fig. 7 is a block diagram of a processing apparatus of a live data stream on a server side according to an exemplary embodiment, and referring to fig. 7, the live data stream processing apparatus includes: the device comprises an occlusioninformation determining module 11, aprocessing module 12, a live stream address determiningmodule 13 and a sendingmodule 14.
The occlusioninformation determining module 11 is configured to determine occlusion information when it is detected that there is content to be occluded in the live data stream;
theprocessing module 12 is configured to perform occlusion on content to be occluded in the live broadcast data stream according to the occlusion information, and obtain an occluded updated live broadcast data stream;
a live streaming address determiningmodule 13 configured to determine an updated live streaming address corresponding to the updated live streaming;
a sendingmodule 14 configured to issue the updated live stream address to a viewer client of a viewer in the live room.
As an example, the occlusion information includes: position information of the content to be shielded and style information of the shielding layer.
In one possible implementation, theprocessing module 12 is configured to:
generating a shielding layer according to the pattern information of the shielding layer;
and adding the shielding layer into the live broadcast data stream according to the position information, and shielding the content at the corresponding position in the live broadcast data stream through the shielding layer to obtain the shielded updated live broadcast data stream.
In a possible implementation manner, the audience in the live broadcast room is an existing audience, as shown in fig. 8, the apparatus further includes: a receivingmodule 15;
the sendingmodule 14 is further configured to: issuing address change information to a first audience client of an existing audience in a live broadcast room;
the receivingmodule 15 is configured to: receiving a request for changing an address sent by a first viewer client;
the sendingmodule 14 is configured to: and sending the updated live streaming address to the first viewer client according to the address change request.
In one possible implementation, the viewer in the live broadcast room is an existing viewer, and the transmittingmodule 14 is configured to:
and issuing an address changing instruction to a first audience client of an existing audience in the live broadcast room, wherein the address changing instruction carries the updated live broadcast stream address.
In a possible implementation manner, the viewer in the live broadcast room is a viewer newly entering the live broadcast room, as shown in fig. 8, the apparatus further includes: a receivingmodule 15;
the receivingmodule 15 is configured to: receiving an address acquisition request sent by a second audience client of an audience newly entering the live broadcast room;
the sendingmodule 14 is configured to: and sending the updated live streaming address to the second viewer client according to the address acquisition request.
In a possible implementation manner, as shown in fig. 9, the apparatus further includes:
a livescreenshot obtaining module 16 configured to obtain a live screenshot of the live data stream;
the detectingmodule 17 is configured to detect whether the content to be blocked exists in the live screenshot, and if the content to be blocked exists in the live screenshot, determine that the content to be blocked exists in the live data stream.
Based on the same inventive concept, the disclosed embodiment further provides a processing apparatus of a live data stream, the apparatus is applied to a viewer client, fig. 10 is a block diagram of a processing apparatus of a live data stream at a viewer client according to an exemplary embodiment, and referring to fig. 10, the processing apparatus of a live data stream includes: a receivingmodule 21 and a live datastream acquiring module 22.
The receivingmodule 21 is configured to receive an updated live streaming address sent by a server, where the updated live streaming address corresponds to an updated live streaming, and the updated live streaming is obtained after the server blocks content to be blocked in the live streaming according to blocking information;
a live datastream obtaining module 22 configured to obtain the updated live data stream from the server according to the updated live stream address.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.
Based on the same inventive concept, the disclosed embodiments further provide a storage medium on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the processing method for live data stream in any of the above-mentioned possible implementations.
Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Based on the same inventive concept, the embodiments of the present disclosure further provide a computer program product, which includes a computer program, and when the program is executed by a processor, the steps of the processing method for live data stream in any possible implementation manner described above are implemented.
Based on the same inventive concept, the embodiment of the present disclosure further provides an audience client, including: a memory, a processor, and a computer program stored on the memory and executable on the processor;
wherein the processor is configured to:
receiving an updated live streaming address sent by a server, wherein the updated live streaming address corresponds to an updated live streaming, and the updated live streaming is obtained after the server shields the content to be shielded in the live streaming according to shielding information;
and acquiring the updated live broadcast data stream from the server according to the updated live broadcast stream address.
As shown in fig. 11, fig. 11 is a schematic structural diagram of anaudience client 1700 shown in accordance with an exemplary embodiment of the present disclosure. For example,spectator client 1700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, etc., with routing capabilities.
Referring to fig. 11, theviewer client 1700 may include one or more of the following components:processing component 1702,memory 1704,power component 1706,multimedia component 1708,audio component 1710, input/output (I/O)interface 1712,sensor component 1714, andcommunications component 1716.
Theprocessing component 1702 generally controls the overall operation of theviewer client 1700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.Processing component 1702 may include one ormore processors 1720 to execute instructions to perform all or a portion of the steps of the above-described method. Further,processing component 1702 may include one or more modules that facilitate interaction betweenprocessing component 1702 and other components. For example,processing component 1702 may include a multimedia module to facilitate interaction betweenmultimedia component 1708 andprocessing component 1702.
Thepower component 1706 provides power to the various components of thespectator client 1700. Thepower components 1706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for thespectator client 1700.
Themultimedia component 1708 includes a screen providing an output interface between theviewer client 1700 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, themultimedia component 1708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when theviewer client 1700 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The I/O interface 1712 provides an interface between theprocessing component 1702 and peripheral interface modules, such as a keyboard, click wheel, buttons, and the like. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
Thesensor component 1714 includes one or more sensors for providing theviewer client 1700 with status assessments of various aspects. For example, thesensor component 1714 may detect the on/off status of thespectator client 1700, the relative positioning of the components, such as the display and keypad of thespectator client 1700, thesensor component 1714 may also detect a change in the position of thespectator client 1700 or one of the components of thespectator client 1700, the presence or absence of user contact with thespectator client 1700, the orientation or acceleration/deceleration of thespectator client 1700, and a change in the temperature of thespectator client 1700. Thesensor assembly 1714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Thesensor assembly 1714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, thesensor assembly 1714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, a microwave sensor, or a temperature sensor.
Thecommunication component 1716 is configured to facilitate communications between theviewer client 1700 and other devices in a wired or wireless manner. Theviewer client 1700 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, thecommunication component 1716 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, thecommunication component 1716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, theviewer client 1700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the processing method of the live data stream as shown in fig. 3.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided that includes instructions, such as thememory 1704 that are executable by theprocessor 1720 of theviewer client 1700 to perform the above-described method. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Based on the same inventive concept, the embodiment of the present disclosure further provides a server, including: a memory, a processor, and a computer program stored on the memory and executable on the processor;
wherein the processor is configured to:
acquiring a live broadcast screen shot;
when detecting that the live data stream has content to be shielded, determining shielding information;
shielding the content to be shielded in the live broadcast data stream according to the shielding information to obtain a shielded updated live broadcast data stream;
determining an updated live stream address corresponding to the updated live stream data;
and issuing the updated live streaming address to a spectator client of a spectator in the live broadcasting room.
As shown in fig. 12, fig. 12 is a schematic diagram illustrating a structure of aserver 1800 according to an exemplary embodiment. Referring to FIG. 12, theserver 1800 includes aprocessing component 1802 that further includes one or more processors and memory resources, represented bymemory 1804, for storing instructions, such as application programs, that are executable by theprocessing component 1802. The application programs stored inmemory 1804 may include one or more modules that each correspond to a set of instructions. Further, theprocessing component 1802 is configured to execute instructions to perform a method of processing a live data stream as shown in fig. 2.
Theserver 1800 may also include apower component 1806 configured to perform power management for theserver 1800, a wired orwireless network interface 1808 configured to connect theserver 1800 to a network, and an input/output (I/O)interface 1810. Theserver 1800 may operate based on an operating system stored inmemory 1804, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (18)
1. A method for processing a live data stream, the method being applied to a server, the method comprising:
acquiring a live broadcast screen shot of a live broadcast data stream; the live data stream is sent to a Content Delivery Network (CDN) by a server and then forwarded to a spectator client by the CDN; the CDN is used for capturing a screen of the live broadcast data stream, obtaining and storing a live broadcast screen capture, and sending a screen capture message to the server, so that the server can obtain the live broadcast screen capture from the CDN based on the screen capture message;
detecting whether content to be shielded exists in the live screen shot;
if the content to be shielded exists in the live broadcast screenshot, determining that the content to be shielded exists in the live broadcast data stream, and determining shielding information;
shielding the content to be shielded in the live broadcast data stream according to the shielding information to obtain a shielded updated live broadcast data stream;
determining an updated live stream address corresponding to the updated live stream data;
and issuing the updated live streaming address to a spectator client of a spectator in the live broadcasting room.
2. The method of claim 1, wherein the occlusion information comprises: position information of the content to be shielded and style information of the shielding layer.
3. The method according to claim 2, wherein the step of blocking the content to be blocked in the live data stream according to the blocking information to obtain a blocked updated live data stream includes:
generating a shielding layer according to the pattern information of the shielding layer;
and adding the shielding layer into the live broadcast data stream according to the position information, and shielding the content at the corresponding position in the live broadcast data stream through the shielding layer to obtain the shielded updated live broadcast data stream.
4. The method of claim 1, wherein the viewer in the live room is an existing viewer, and wherein issuing the updated live stream address to a viewer client of the viewer in the live room comprises:
issuing address change information to a first audience client of an existing audience in a live broadcast room;
receiving a request for changing an address sent by a first viewer client;
and sending the updated live streaming address to the first viewer client according to the address change request.
5. The method of claim 1, wherein the viewer in the live room is an existing viewer, and wherein issuing the updated live stream address to a viewer client of the viewer in the live room comprises:
and issuing an address changing instruction to a first audience client of an existing audience in the live broadcast room, wherein the address changing instruction carries the updated live broadcast stream address.
6. The method of claim 1, wherein the issuing of the updated live stream address to the viewer client of the viewer in the live room for the viewer newly entering the live room comprises:
receiving an address acquisition request sent by a second audience client of an audience newly entering the live broadcast room;
and sending the updated live streaming address to the second viewer client according to the address acquisition request.
7. A method for processing a live data stream, the method being applied to a viewer client, the method comprising:
receiving an updated live streaming address sent by a server, wherein the updated live streaming address corresponds to an updated live streaming, and the updated live streaming is obtained after the server shields the content to be shielded in the live streaming according to shielding information;
acquiring the updated live broadcast data stream from the server according to the updated live broadcast stream address; the updated live data stream is sent to a Content Delivery Network (CDN) by the server and then forwarded to a spectator client by the CDN; the CDN is used for capturing a screen of the live data stream, obtaining and storing a live screen capture, and sending a screen capture message to the server, so that the server can obtain the live screen capture from the CDN based on the screen capture message, detect whether the content to be shielded exists in the live screen capture, and determine that the content to be shielded exists in the live data stream and determine shielding information if the content to be shielded exists in the live screen capture.
8. A device for processing a live data stream, the device being applied to a server, the device comprising:
a live screenshot obtaining module configured to obtain a live screenshot of the live data stream; the live data stream is sent to a Content Delivery Network (CDN) by a server and then forwarded to a spectator client by the CDN; the CDN is used for capturing a screen of the live broadcast data stream, obtaining and storing a live broadcast screen capture, and sending a screen capture message to the server, so that the server can obtain the live broadcast screen capture from the CDN based on the screen capture message;
the detection module is configured to detect whether the content to be shielded exists in the live screen shot, and if the content to be shielded exists in the live screen shot, the live data stream is determined to have the content to be shielded;
the occlusion information determining module is configured to determine occlusion information when detecting that the live data stream has content to be occluded;
the processing module is configured to shield the content to be shielded in the live broadcast data stream according to the shielding information to obtain a shielded updated live broadcast data stream;
a live streaming address determining module configured to determine an updated live streaming address corresponding to the updated live streaming;
and the sending module is configured to issue the updated live streaming address to a viewer client of a viewer in the live broadcasting room.
9. The apparatus of claim 8, wherein the occlusion information comprises: position information of the content to be shielded and style information of the shielding layer.
10. The apparatus of claim 9, wherein the processing module is configured to:
generating a shielding layer according to the pattern information of the shielding layer;
and adding the shielding layer into the live broadcast data stream according to the position information, and shielding the content at the corresponding position in the live broadcast data stream through the shielding layer to obtain the shielded updated live broadcast data stream.
11. The apparatus of claim 8, wherein the viewer in the live room is an existing viewer, the apparatus further comprising: a receiving module;
the sending module is further configured to: issuing address change information to a first audience client of an existing audience in a live broadcast room;
the receiving module is configured to: receiving a request for changing an address sent by a first viewer client;
the sending module is configured to: and sending the updated live streaming address to the first viewer client according to the address change request.
12. The apparatus of claim 8, wherein the viewer in the live room is an existing viewer, and wherein the transmitting module is configured to:
and issuing an address changing instruction to a first audience client of an existing audience in the live broadcast room, wherein the address changing instruction carries the updated live broadcast stream address.
13. The apparatus of claim 8, wherein the viewer in the live room is a viewer newly entering the live room, the apparatus further comprising: a receiving module;
the receiving module is configured to: receiving an address acquisition request sent by a second audience client of an audience newly entering the live broadcast room;
the sending module is configured to: and sending the updated live streaming address to the second viewer client according to the address acquisition request.
14. A device for processing a live data stream, the device being applied to a viewer client, the device comprising:
the receiving module is configured to receive an updated live streaming address sent by a server, wherein the updated live streaming address corresponds to an updated live streaming, and the updated live streaming is obtained after the server shields the content to be shielded in the live streaming according to shielding information;
a live broadcast data stream acquisition module configured to acquire the updated live broadcast data stream from the server according to the updated live broadcast stream address; the updated live data stream is sent to a Content Delivery Network (CDN) by the server and then forwarded to a spectator client by the CDN; the CDN is used for capturing a screen of the live data stream, obtaining and storing a live screen capture, and sending a screen capture message to the server, so that the server can obtain the live screen capture from the CDN based on the screen capture message, detect whether the content to be shielded exists in the live screen capture, and determine that the content to be shielded exists in the live data stream and determine shielding information if the content to be shielded exists in the live screen capture.
15. A storage medium having a computer program stored thereon, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
16. A server comprising a memory, a processor and a computer program stored on said memory and executable on said processor, characterized in that said processor implements the steps of the method according to any of claims 1-6 when executing said program.
17. An audience client comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method of claim 7 are performed when the program is executed by the processor.
18. A live data stream processing system, comprising: a anchor client, a server as claimed in claim 16 and at least one viewer client as claimed in claim 17, the server being connected to the anchor client and the at least one viewer client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910954026.2ACN110769275B (en) | 2019-10-09 | 2019-10-09 | Method, device and system for processing live data stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910954026.2ACN110769275B (en) | 2019-10-09 | 2019-10-09 | Method, device and system for processing live data stream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110769275A CN110769275A (en) | 2020-02-07 |
| CN110769275Btrue CN110769275B (en) | 2022-04-08 |
Family
ID=69330912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910954026.2AActiveCN110769275B (en) | 2019-10-09 | 2019-10-09 | Method, device and system for processing live data stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110769275B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112788359B (en)* | 2020-12-30 | 2023-05-09 | 北京达佳互联信息技术有限公司 | Live broadcast processing method and device, electronic equipment and storage medium |
| CN113297513B (en)* | 2021-07-28 | 2023-01-17 | 北京健康之家科技有限公司 | Sensitive information coding method, device and storage medium based on cloud mobile phone |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104954894A (en)* | 2015-06-26 | 2015-09-30 | 网宿科技股份有限公司 | A video traffic guidance method, device and electronic equipment |
| CN108540816A (en)* | 2018-03-28 | 2018-09-14 | 腾讯科技（深圳）有限公司 | A kind of live video acquisition methods, device and storage medium |
| CN109040824A (en)* | 2018-08-28 | 2018-12-18 | 百度在线网络技术（北京）有限公司 | Method for processing video frequency, device, electronic equipment and readable storage medium storing program for executing |
| CN109639635A (en)* | 2018-11-05 | 2019-04-16 | 北京达佳互联信息技术有限公司 | CDN agency draws stream method, server, CDN and client |
| CN109756757A (en)* | 2019-03-21 | 2019-05-14 | 北京数码视讯软件技术发展有限公司 | Live data processing method and processing device, live broadcasting method and device and direct broadcast server |
| CN109819285A (en)* | 2017-11-21 | 2019-05-28 | 乐蜜有限公司 | A kind of live broadcasting method, device, electronic equipment and storage medium |
| CN110267053A (en)* | 2019-06-27 | 2019-09-20 | 广州酷狗计算机科技有限公司 | Live broadcasting method, apparatus and system |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9338515B2 (en)* | 2009-09-03 | 2016-05-10 | At&T Intellectual Property I, L.P. | Real-time and secured picture/video upload via a content delivery network |
| US9143840B2 (en)* | 2013-05-20 | 2015-09-22 | Veenome, Inc. | Systems and methods for evaluating online videos |
| CN104702976A (en)* | 2015-02-10 | 2015-06-10 | 深圳创维数字技术有限公司 | Video playing method and equipment |
| CN106210753B (en)* | 2016-05-24 | 2018-03-27 | 北京畅游天下网络技术有限公司 | A kind of net cast method and device |
| US9723372B1 (en)* | 2016-06-30 | 2017-08-01 | SnifferCat, Inc. | Systems and methods for stitching advertisements in streaming content |
| JP7330891B2 (en)* | 2017-02-22 | 2023-08-22 | オプセック・オンライン・リミテッド | System and method for direct in-browser markup of elements in Internet content |
| CN108235054A (en)* | 2017-12-15 | 2018-06-29 | 北京奇虎科技有限公司 | A kind for the treatment of method and apparatus of live video data |
| CN109254851A (en)* | 2018-09-30 | 2019-01-22 | 武汉斗鱼网络科技有限公司 | A kind of method and relevant apparatus for dispatching GPU |
| CN109120965A (en)* | 2018-09-30 | 2019-01-01 | 武汉斗鱼网络科技有限公司 | Net cast switching method, device, computer equipment and storage medium |
| CN110121076B (en)* | 2019-04-22 | 2021-11-09 | 山西共致科技有限公司 | Live photo broadcasting system and method |
| CN110290393A (en)* | 2019-07-23 | 2019-09-27 | 北京达佳互联信息技术有限公司 | File acquisition method and device, server and storage medium |
- 2019
- 2019-10-09CNCN201910954026.2Apatent/CN110769275B/enactiveActive
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104954894A (en)* | 2015-06-26 | 2015-09-30 | 网宿科技股份有限公司 | A video traffic guidance method, device and electronic equipment |
| CN109819285A (en)* | 2017-11-21 | 2019-05-28 | 乐蜜有限公司 | A kind of live broadcasting method, device, electronic equipment and storage medium |
| CN108540816A (en)* | 2018-03-28 | 2018-09-14 | 腾讯科技（深圳）有限公司 | A kind of live video acquisition methods, device and storage medium |
| CN109040824A (en)* | 2018-08-28 | 2018-12-18 | 百度在线网络技术（北京）有限公司 | Method for processing video frequency, device, electronic equipment and readable storage medium storing program for executing |
| CN109639635A (en)* | 2018-11-05 | 2019-04-16 | 北京达佳互联信息技术有限公司 | CDN agency draws stream method, server, CDN and client |
| CN109756757A (en)* | 2019-03-21 | 2019-05-14 | 北京数码视讯软件技术发展有限公司 | Live data processing method and processing device, live broadcasting method and device and direct broadcast server |
| CN110267053A (en)* | 2019-06-27 | 2019-09-20 | 广州酷狗计算机科技有限公司 | Live broadcasting method, apparatus and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110769275A (en) | 2020-02-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111970533B (en) | Interaction method and device for live broadcast room and electronic equipment | |
| CN106028166B (en) | Live broadcast room switching method and device in live broadcast process | |
| KR101777693B1 (en) | Screen projection method, apparatus, system, program and recording medium | |
| EP3276976A1 (en) | Method, apparatus, host terminal, server and system for processing live broadcasting information | |
| CN111182318B (en) | Contribution score generation method and device in live broadcast, electronic equipment and storage medium | |
| CN107888965B (en) | Image gift display method and device, terminal, system and storage medium | |
| EP2978234A1 (en) | Method and apparatus for sharing video information | |
| CN109274510B (en) | Message processing method, device, client, server and storage medium | |
| CN113573092B (en) | Live broadcast data processing method and device, electronic equipment and storage medium | |
| CN106664433B (en) | Multimedia messages playback method and system, standardized server, live streaming terminal | |
| CN108495168B (en) | Bullet screen information display method and device | |
| CN111212306A (en) | Wheat connecting method and device, electronic equipment and storage medium | |
| CN110113256B (en) | Information interaction method and device, server, user terminal and readable storage medium | |
| US20210029209A1 (en) | Method, device, terminal, server, system and storage medium for displaying information | |
| CN108289229B (en) | Interaction method and device for multimedia resources | |
| CN111182328B (en) | Video editing method, device, server, terminal and storage medium | |
| CN112291631A (en) | Information acquisition method, device, terminal and storage medium | |
| CN114025180A (en) | Game operation synchronization system, method, device, equipment and storage medium | |
| CN109413157B (en) | Message shielding method and device | |
| CN108335135B (en) | Multimedia content sharing method and device | |
| CN110769275B (en) | Method, device and system for processing live data stream | |
| CN111147882B (en) | Video processing method and device, terminal equipment and storage medium | |
| CN110690979B (en) | Group message processing method, device, server, client and storage medium | |
| CN108521579B (en) | Bullet screen information display method and device | |
| CN114339320B (en) | Virtual resource processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |