Disclosure of Invention
The present disclosure provides a live data processing method, apparatus, electronic device, and storage medium, to at least solve the problem of low utilization rate of live resources in the related art. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, a live data processing method is provided, including:
displaying a live broadcast initiating entry in a real-time live broadcast interface in a state that the first user account enters a live broadcast room;
responding to the trigger operation of the live broadcast initiating entrance, and sending an opening request to a server; the broadcasting request is used for indicating the server to stop issuing first direct broadcasting stream data to the client of the first user account; the first direct-current streaming data comprises audio and video streaming data provided by a client where a second user account is located; the second user account is a main broadcasting account of the live broadcasting room;
responding to a stream pushing instruction of the server, and pushing second live stream data to the server; the second live streaming data comprises audio and video streaming data provided by a client where the first user account is located.
In one possible implementation manner, after the step of sending an opening request to a server in response to the triggering operation on the live initiation portal, the method further includes:
responding to a live broadcast verification instruction issued by the server, and verifying whether the client side where the first user account is located has a function of pushing the second live broadcast stream data to the server;
if the client side where the first user account is located has the function, sending a verification passing message to the server; and the check passing message is used for indicating the server to issue the stream pushing instruction.
In one possible implementation, the pushing the second live streaming data to the server includes:
responding to the live special effect obtaining operation of the first user account, and obtaining a target live special effect; the target live special effect comprises a live special effect applied by the second user account in the live room;
and rendering the audio and video data stream collected by the client side where the first user account is located by adopting the target live broadcast special effect to obtain second live broadcast stream data.
In one possible implementation manner, the obtaining a target live special effect in response to a live special effect obtaining operation of the first user account includes:
responding to the live broadcast special effect obtaining operation, and determining the selected target live broadcast special effect from candidate live broadcast special effects; the candidate live effects comprise a live effect and a recommended effect currently applied by the first live broadcast room; and the similarity between the recommended special effect and the currently applied live special effect of the first live broadcast room is smaller than a preset threshold value.
In one possible implementation manner, the determining, in response to the live special effect obtaining operation, the selected target live special effect from candidate live special effects includes:
displaying a live special effect acquisition entry in the real-time live broadcast picture;
responding to the trigger operation of the live special effect acquisition entrance, and displaying a preview icon corresponding to the candidate live special effect;
and responding to the trigger operation of the target preview icon, and taking the candidate live broadcast special effect corresponding to the target preview icon as the target live broadcast special effect.
In one possible implementation, after the step of obtaining the target live special effect, the method further includes:
responding to a special effect preview operation of the target live special effect, and displaying a special effect preview picture; the special effect preview picture comprises a picture obtained by rendering an audio-video data stream acquired by a client side where the first user account is located by adopting the target live broadcast special effect.
According to a second aspect of the embodiments of the present disclosure, there is provided a live data processing apparatus including:
the display unit is configured to display a live broadcast initiating entrance in a real-time live broadcast interface in a state that the first user account enters a live broadcast room;
a response unit configured to execute a trigger operation in response to the live broadcast initiation entry, and send an opening request to a server; the broadcast request is used for indicating the server to stop issuing first direct-current data to the client where the first user account is located; the first direct-current streaming data comprise audio and video streaming data provided by a client where a second user account is located; the second user account is a main broadcasting account of the live broadcasting room;
the pushing unit is configured to execute a stream pushing instruction responding to the server and push second live stream data to the server; the second live streaming data comprises audio and video streaming data provided by a client where the first user account is located.
In one possible implementation, the apparatus further includes: the verification unit is configured to execute a live broadcast verification instruction sent by the server, and verify whether the client side where the first user account is located has a function of pushing the second live broadcast stream data to the server; the sending unit is configured to execute sending a verification passing message to the server if the client of the first user account has the function; and the check passing message is used for indicating the server to issue the stream pushing instruction.
In one possible implementation manner, the pushing unit is specifically configured to execute a live special effect obtaining operation in response to the first user account, and obtain a target live special effect; the target live special effect comprises a live special effect applied by the second user account in the live room; and rendering the audio and video data stream collected by the client side where the first user account is located by adopting the target live broadcast special effect to obtain second live broadcast stream data.
In one possible implementation, the pushing unit is specifically configured to perform, in response to the live special effect obtaining operation, determining the selected target live special effect from candidate live special effects; the candidate live effects comprise a live effect and a recommended effect currently applied by the first live broadcast room; and the similarity between the recommended special effect and the currently applied live special effect of the first live broadcast room is smaller than a preset threshold value.
In one possible implementation, the pushing unit is specifically configured to perform displaying a live special effect acquisition entry in the live broadcast screen; responding to the trigger operation of the live special effect acquisition entry, and displaying a preview icon corresponding to the candidate live special effect; responding to the trigger operation of the target preview icon, and taking the candidate live broadcast special effect corresponding to the target preview icon as the target live broadcast special effect.
In one possible implementation, the apparatus further includes: a display unit configured to perform a special effect preview operation in response to the target live special effect, and display a special effect preview screen; the special effect preview picture comprises a picture obtained by rendering an audio-video data stream acquired by a client side where the first user account is located by adopting the target live broadcast special effect.
According to a third aspect of embodiments of the present disclosure, an electronic device is provided, which includes a memory and a processor, where the memory stores a computer program, and the processor implements the live data processing method according to the first aspect or any one of the possible implementation manners of the first aspect when executing the computer program.
According to a fourth aspect of embodiments of the present disclosure, there is provided a storage medium having stored thereon a computer program which, when executed by a processor, implements a live data processing method as set forth in the first aspect or any one of the possible implementations of the first aspect.
According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product, the program product comprising a computer program, the computer program being stored in a readable storage medium, from which at least one processor of a device reads and executes the computer program, so that the device performs the live data processing method of any one of the possible implementations of the first aspect.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects: displaying a live broadcast initiating entrance in a real-time live broadcast interface in a state that a first user account enters a live broadcast room; sending a broadcast request to a server by responding to the trigger operation of the broadcast initiating entry; the broadcasting request is used for indicating the server to stop issuing the first direct-broadcast stream data to the client side where the first user account is located; the first direct-current streaming data comprises audio and video streaming data provided by a client where the second user account is located; the second user account is a main broadcasting account of the live broadcasting room; responding to a stream pushing instruction of the server, and pushing second live stream data to the server; the second live streaming data comprises audio and video streaming data provided by a client where the first user account is located; therefore, when a user watches other anchor broadcasters to use an interesting and playful live broadcast, the user can be interested to immediately start a new live broadcast room as the live broadcast after seeing the live broadcast, the experience and the experience of the new live broadcast are rapidly changed from audience identity to anchor identity, the willingness of the user to start the live broadcast is improved, and the live broadcast resource utilization rate of the live broadcast room is further improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure.
First, terms related to embodiments of the present disclosure are introduced:
and (4) live broadcast: the method refers to that a user watches videos on different live broadcast platforms in real time through a network, and the video content of the videos is generated or uploaded by a main broadcast in real time. The user can communicate with the anchor in real time by sending the information such as barrage, comments and the like, and the method is a novel social network mode.
Live broadcast is an emerging social networking mode, and users can watch different types of live broadcast through different live broadcast platforms (namely live broadcast application programs) on a terminal. Types of live broadcasts include, but are not limited to, the following: talent performance, dating love, outdoor activities, games, events, exhibitions, announcements, animations, quadratic elements, drawings, gourmet meals, movies, voice, radio stations and the like, and the type of live broadcast is not limited by the disclosure. An input box exists on an interface of a live broadcast application program, a user inputs information such as characters, numbers or expressions into the input box to send a barrage or a comment to a main broadcast, and the main broadcast communicates with the user watching the live broadcast in real time by reading the barrage or the comment. Audience users can also perform reward operation on the anchor broadcast, the reward operation is in a form of giving cash or virtual gifts representing a certain amount of cash to the anchor broadcast, each anchor broadcast corresponds to a contribution list, the contribution list comprises a contribution value of the user watching the live broadcast to the anchor broadcast, and the contribution value is a numerical value obtained by converting the virtual gifts rewarded by the user to the anchor broadcast generally; the anchor may also send a virtual gift (e.g., a red envelope carrying a monetary amount, a gift certificate, a lottery, etc.) in response to the user watching the live broadcast.
The live data processing method provided by the present disclosure may be applied to an application environment as shown in fig. 1. Wherein theclient 110 with the first user account and theclient 120 with the second user account interact with theserver 130 through the network. When the first user account enters the live broadcasting room, theclient 110 where the first user account is located displays a live broadcasting initiating entrance in a real-time live broadcasting interface; theclient 110 where the first user account is located sends an opening request to theserver 130 in response to the trigger operation of the live initiating entry; the broadcast request is used to instruct theserver 130 to stop issuing the first direct broadcast stream data to theclient 110 where the first user account is located; the first direct-current streaming data comprises audio and video streaming data provided by theclient 120 where the second user account is located; the second user account is a main broadcasting account of the live broadcasting room; responding to a stream pushing instruction of the server, and pushing second live stream data to the server; the second live streaming data includes audio-visual data streams provided by theclient 110 with the first user account. In practical applications, theclient 110 where the first user account is located and theclient 120 where the second user account is located may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and theserver 130 may be implemented by an independent server or a server cluster formed by a plurality of servers.
Fig. 2 is a flowchart illustrating a live data processing method according to an exemplary embodiment, which is used in theclient 110 where the first user account of fig. 1 is located, as shown in fig. 2, and includes the following steps.
In step S210, in a state where the first user account enters the live broadcast room, a live broadcast initiation entry is displayed in the real-time live broadcast interface.
In a specific implementation, a live client is installed and operated on theclient 110 where the first user account is located, and the live client may be a client of a live application, a client of a shopping application, a client of a video application (including a short video application), a client of a game application, and the like, which is not limited in this disclosure. The first user account may refer to a user account using the live client.
The first user account can use the live client to enter the live broadcast room, and then the live broadcast content provided by the main broadcast account (namely the second user account) of the live broadcast room can be watched as the audience account. Specifically, a client where the second user account is located collects audio and video data streams, and uploads the audio and video data streams to a server as first direct-current data streams; and the server receives the first direct-current streaming data and issues the first direct-current streaming data to the client of the first user account. And the client of the first user account displays the first direct broadcast stream data through a real-time direct broadcast interface, and simultaneously displays a direct broadcast initiation entrance in the real-time direct broadcast interface.
In step S220, in response to a trigger operation on the broadcast initiation entry, sending an broadcast request to the server; the broadcast request is used for indicating the server to stop issuing the first direct-broadcast stream data to the client where the first user account is located.
The first direct-current streaming data comprises audio and video streaming data provided by a client where the second user account is located; the second user account is a main broadcasting account of the live broadcasting room.
In a specific implementation, a client where a second user account is located may display a live broadcast initiation entry (e.g., a broadcast button) in a live broadcast screen, and when a first user account performs a trigger operation on the live broadcast initiation entry (e.g., clicks the broadcast button), the client where the second user account is located receives the trigger operation on the live broadcast initiation entry, and then determines that the live broadcast initiation operation is received, and at this time, the client where the second user account is located sends a request (i.e., a broadcast initiation request) for opening a live broadcast room to a server in response to the trigger operation on the live broadcast initiation entry. After the server receives the broadcast request sent by the client where the first user account is located, the server stops issuing audio and video data streams (namely, first direct broadcast stream data) provided by the client where the second user account is located to the client where the first user account is located.
In step S220, in response to a stream pushing instruction of the server, pushing the second live stream data to the server; the first direct-current streaming data comprises audio and video streaming data provided by a client where the first user account is located.
In specific implementation, after the server stops issuing the audio-video data stream (i.e., the first direct-current data stream) provided by the client where the second user account is located to the client where the first user account is located, the server sends a stream pushing instruction to the client where the first user account is located. And the client side of the first user account receives and responds to the stream pushing instruction, and the audio and video data stream acquired by the client side of the first user account is taken as first direct broadcast stream data and is pushed to the server, so that the audience identity is quickly converted into the anchor identity to open another direct broadcast room.
In the live broadcast data processing method, a live broadcast initiating entrance is displayed in a real-time live broadcast interface in a state that a first user account enters a live broadcast room; sending a broadcast request to a server by responding to the trigger operation of the broadcast initiating entry; the broadcasting request is used for indicating the server to stop issuing the first direct broadcasting stream data to the client of the first user account; the first direct-current streaming data is audio-video streaming data provided by a client where the second user account is located; the second user account is a main broadcasting account of the live broadcasting room; responding to a stream pushing instruction of the server, and pushing second live stream data to the server; the first direct-current streaming data is audio-video streaming data provided by a client where the first user account is located; therefore, when a user watches other anchor broadcasters to use an interesting and playful live broadcast, the user can be interested to immediately start a new live broadcast room as the live broadcast after seeing the live broadcast, the experience and the experience of the new live broadcast are rapidly changed from audience identity to anchor identity, the willingness of the user to start the live broadcast is improved, and the live broadcast resource utilization rate of the live broadcast room is further improved.
In an exemplary embodiment, after the step of sending the broadcast request to the server in response to the triggering operation for the broadcast initiation portal, the method further comprises: responding to a live broadcast verification instruction issued by a server, and verifying whether a client side where a first user account is located has a function of pushing second live broadcast stream data to the server; if the client side of the first user account has the function, sending a verification passing message to the server; and the check passing message is used for indicating the server to issue the stream pushing instruction.
In a specific implementation, after the client where the first user account is located responds to the trigger operation of the live broadcast initiation entry and sends the broadcast request to the server, the server may also send a live broadcast check instruction to the client where the first user account is located. And the client side of the first user account responds to the live broadcast verification instruction issued by the server to verify whether the client side of the first user account has the function of pushing the second live broadcast stream data to the server.
For example, the service end marks all service capability interfaces of the client where the first user account is located as invalid (for example, the client is connected with the anchor and the microphone is automatically disconnected), then, the service end issues a signaling for checking the basic capability of the anchor to the client where the first user account is located, checks whether the first user account is in a broadcasting state or not, and includes the audio and video stream acquisition capability and the local storage authority of the equipment of the first user account, and the authority check does not mistakenly count down for X seconds in a live broadcasting room, automatically starts equipment acquisition and codes a closing plate to push the stream to a server, so that the audience identity is quickly changed into the anchor identity to start another live broadcasting room. Wherein X is greater than 0.
According to the technical scheme, whether the client side where the first user account is located has the function of pushing second live streaming data to the server is timely verified through responding to the live broadcast verification instruction sent by the server, when the client side where the first user account is located has the function, the client side where the first user account is located sends a verification passing message to the server to inform the server to send the stream pushing instruction, a live broadcast room with the first user account as a main broadcast of the live broadcast room is started, the server is prevented from sending the stream pushing instruction to the client side without the live broadcast function, and processing resources of the server are prevented from being wasted.
In an exemplary embodiment, pushing the second live streaming data to the server includes: responding to the live special effect obtaining operation of the first user account, and obtaining a target live special effect; the target live special effect comprises a live special effect applied by a second user account in the live broadcast room; and rendering the audio and video data stream collected by the client side where the first user account is located by adopting the target live broadcast special effect to obtain second live broadcast stream data.
The live special effect may refer to a live special effect in a live process. In practical applications, the live broadcast effects may include, but are not limited to, various magic expressions (magic watch), filters, makeup effects, and beauty functions.
The method comprises the steps of obtaining a live broadcast picture, wherein the step of rendering the live broadcast picture comprises the step of rendering an audio-video data stream collected by a client side where a first user account is located by adopting a target live broadcast special effect.
The respective business logics of the anchor terminal and the audience terminal are relatively complex and are not coupled; in addition to ensuring a uniform stream decoding and playing experience, the service logic at the audience is based on complex services on the stream, such as various interaction relationships between the anchor and the audience (the anchor initiates an interaction invitation to the audience, the audience initiates an interaction invitation to the anchor, and the anchor and the audience are in interaction). Similarly, the anchor has more complex business logic coupling besides the basic streaming capability.
In practical applications, the anchor account has 3 levels of definition and encapsulation in technical capabilities, including: anchor basic capability: device acquisition-encoding encapsulation-plug flow capability; the anchor expansion capability: the anchor information interface is encapsulated, and the anchor information contains anchor nicknames, head portraits and other information which can identify and position the personal identity of the anchor; anchor service capability: based on the complex services of the above two capabilities, for example, the video connection between the anchor and other anchors is a complex service capability.
The audience account has 3 levels of definition and packaging in technical capabilities, including: audience basic capability: decoding capability-streaming capability; audience expansion capacity: the anchor information decoding display capability; audience service capability: such as the ability for the audience side to present gifts and for the audience to comment on interactions, etc.
In addition to the most basic capability, the anchor account side has two other levels of capabilities, each individual service interface adds a new originating tag field to distinguish where the anchor account is originating.
In specific implementation, in the process that the client side where the first user account is located pushes the second live streaming data to the server, the client side where the first user account is located can respond to the live special effect obtaining operation of the first user account to obtain a target live special effect; the target live special effect comprises a live special effect applied by a second user account in the live broadcast room; and then, rendering the audio and video data stream acquired by the client side where the first user account is located by adopting a target live broadcast special effect to the client side where the first user account is located, so as to obtain second live broadcast stream data.
According to the technical scheme of the embodiment, the target live broadcast special effect is obtained by responding to the live broadcast special effect obtaining operation of the first user account; the target live special effect comprises a live special effect applied by a second user account in the live broadcast room; the target live broadcast special effect is adopted to render the audio and video data stream acquired by the client side where the first user account is located to obtain second live broadcast stream data, so that when a user watches other anchor broadcasts and uses an interesting and playful live broadcast special effect in a live broadcast mode, the user can immediately open a live broadcast room with the live broadcast special effect after seeing the interest, the audience identity is quickly changed into the anchor broadcast identity to experience and feel the novel live broadcast special effect, the desire of the user to open the live broadcast is improved, and the live broadcast resource utilization rate of the live broadcast room is further improved.
In an exemplary embodiment, in response to a live effect obtaining operation of a first user account, obtaining a target live effect includes: responding to the live special effect acquisition operation, and determining the selected target live special effect from the candidate live special effects; the candidate live effects include a live effect and a recommended effect currently applied by the first live room.
And the similarity between the recommended special effect and the live broadcast special effect currently applied in the live broadcast room is smaller than a preset threshold value. The recommended special effect may refer to a live special effect related to a live special effect currently applied in a live broadcast room. For example, when magic expression a is currently applied to the live broadcast, the recommended effects may then be magic expressions B, C and D that are the same subject or category as magic expression a.
In specific implementation, in the process that the client where the first user account is located responds to the live special effect obtaining operation of the first user account to obtain the target live special effect, the client where the first user account is located can respond to the live special effect obtaining operation to obtain the candidate live special effect. The candidate live special effects comprise live special effects and recommended special effects which are currently applied in a live room. Then, the client where the first user account is located can determine the selected target live special effect from the candidate live special effects in response to the selection operation of the first user account on the candidate live special effects.
According to the technical scheme of the embodiment, candidate live broadcast effects including the currently applied live broadcast effect and the recommended effect in the live broadcast room are obtained by responding to the effect obtaining operation, and the first user account can select the interested live broadcast effect.
In an exemplary embodiment, determining the selected target live effect from candidate live effects in response to the live effect obtaining operation includes: displaying a live special effect acquisition entry in a real-time live frame; responding to a trigger operation of a live special effect acquisition inlet, and displaying a preview icon corresponding to the candidate live special effect; and responding to the trigger operation of the target preview icon, and taking the candidate live special effect corresponding to the target preview icon as the target live special effect.
The live special effect obtaining entry may be a trigger entry for receiving a live special effect obtaining operation. In practical application, the live broadcast special effect acquisition entry may be a magic expression button in a real-time live broadcast picture.
The preview icon may refer to an icon including preview information of a candidate live special effect.
In a specific implementation, in the process that a client where a first user account is located responds to a special effect obtaining operation and determines a selected target live broadcast special effect from candidate live broadcast special effects, the client where the first user account is located can display magic expression buttons in a real-time live broadcast picture; a user can input a trigger operation of a live broadcast special effect acquisition entrance to a client where a first user account is located by performing a trigger operation (such as clicking operation) on the magic expression button, and after the client where the first user account is located receives the trigger operation of the live broadcast special effect acquisition entrance, the client where the first user account is located responds to the trigger operation of the live broadcast special effect acquisition entrance and displays preview icons (such as icon corresponding to each candidate magic expression)); then, the user can click any one of the preview icons, and then the triggering operation of the target preview icon is input to the client side where the first user account is located. And after the client side where the first user account is located receives the trigger operation of the target preview icon, taking the candidate live broadcast special effect corresponding to the target preview icon as the target live broadcast special effect.
According to the technical scheme, the live broadcast special effect obtaining entry is displayed in the real-time live broadcast picture, so that a user can quickly input the live broadcast special effect obtaining operation to the client side where the first user account is located, and the preview icon corresponding to the candidate live broadcast special effect is displayed, so that the user can conveniently and visually know the characteristics of each candidate live broadcast special effect, the user can conveniently and quickly select from a plurality of candidate live broadcast special effects, and the target live broadcast special effect is determined.
In an exemplary embodiment, after the step of obtaining the target live special effect, the method further includes: responding to a special effect preview operation of a target live special effect, and displaying a special effect preview picture; the special effect preview picture comprises a picture obtained by rendering an audio-video data stream collected by a client side where the first user account is located by adopting a target live broadcast special effect.
In a specific implementation, after the client where the first user account is located obtains the target live broadcast special effect, the first user account may input a special effect preview operation for the target live broadcast special effect to the client where the first user account is located. Specifically, the first user account may open a live broadcast special effect preview page and apply the target live broadcast special effect to implement an operation of inputting a special effect preview of the target live broadcast special effect to a client where the first user account is located. After a client side where the first user account is located receives a special effect preview operation on a target live special effect, the client side where the first user account is located responds to the special effect preview operation, and a special effect preview picture is obtained by rendering an audio and video data stream collected by the client side where the first user account is located through the target live special effect; the audio and video data stream collected by the client where the first user account is located may be a user image video collected by a live client in real time, or may be a video uploaded by the first user account. And finally, the client side where the first user account is located can display the special effect preview picture in the live special effect preview page.
According to the technical scheme, after the target live broadcast special effect is obtained, the special effect preview operation of the target live broadcast special effect is responded in time, and a special effect preview picture obtained by rendering an audio and video data stream collected by a client where the first user account is located by the target live broadcast special effect is displayed, so that the live broadcast effect of the target live broadcast special effect can be previewed by a user in advance.
Fig. 3 is a flowchart illustrating another live data processing method according to an exemplary embodiment, which is used in theclient 110 where the first user account is located in fig. 1, and includes the following steps, as shown in fig. 3.
In step S310, in a state where the first user account enters the live broadcast room, a live broadcast initiation entry is displayed in the real-time live broadcast interface.
In step S320, in response to a trigger operation on the live broadcast initiation entry, sending an opening request to a server; the broadcast request is used for indicating the server to stop issuing first direct-current data to the client where the first user account is located; the first direct-current streaming data comprises audio and video streaming data provided by a client where a second user account is located; the second user account is a main broadcasting account of the live broadcasting room.
In step S330, in response to a live broadcast verification instruction issued by the server, it is verified whether the client where the first user account is located has a function of pushing the second live broadcast stream data to the server.
In step S340, if the client where the first user account is located has the function, sending a verification passing message to the server; and the check passing message is used for indicating the server to issue a stream pushing instruction.
In step S350, after receiving the stream pushing instruction of the server, obtaining a target live special effect in response to a live special effect obtaining operation of the first user account; the target live special effect comprises a live special effect applied by the second user account in the live room.
In step S360, the target live broadcast special effect is adopted to render the audio and video data stream collected by the client where the first user account is located, so as to obtain second live broadcast stream data.
In step S370, pushing the second live streaming data to the server; the second live streaming data comprises audio and video streaming data provided by a client where the first user account is located.
It should be noted that, for the specific limitations of the above steps, reference may be made to the specific limitations of the live data processing method, and details are not described herein again.
To facilitate understanding of those skilled in the art, fig. 4 provides an application scenario diagram of a live data processing method; after the anchor a opens the first live broadcast room, the anchor a may apply the target live broadcast special effect in the first live broadcast room, for example, successfully wear the magic expression M. After the audience enters the first live broadcast room, the server detects that the target live broadcast special effect is being applied in the first live broadcast room, and then the server issues an information instruction of the target live broadcast special effect being applied in the first live broadcast room to the live broadcast client of the audience, so that the live broadcast client of the audience displays a live broadcast special effect entrance (for example, icon of magic watch M) in a real-time live broadcast picture; and clicking the live broadcast special effect display entrance by the user, displaying the magic watch panel comprising the preview icons corresponding to the candidate magic watches by the live broadcast client, so that the user can click any one target preview icon in the preview icons, and further realizing the triggering operation of inputting the target preview icon to the client where the first user account is located. And after the client side where the first user account is located receives the trigger operation of the target preview icon, taking the candidate live broadcast special effect corresponding to the target preview icon as the target live broadcast special effect. The user can open a live broadcast special effect preview page and apply the target live broadcast special effect to input special effect preview operation on the target live broadcast special effect to the client side where the first user account is located. After a client side where the first user account is located receives a special effect preview operation on a target live special effect, the client side where the first user account is located responds to the special effect preview operation, and an audio and video data stream collected by the client side where the first user account is located is rendered by the target live special effect to obtain a special effect preview picture; the audio and video data stream collected by the client where the first user account is located may be a user image video collected by a live client in real time, or may be a video uploaded by the first user account. And finally, the client side where the first user account is located can display the special effect preview picture in the live special effect preview page. The client side where the first user account is located can respond to the creation operation of the live broadcast room of the user, and the magic watch M is used for starting the second live broadcast room, so that the client side where the first user account is located displays a rendering live broadcast picture in a real-time live broadcast picture.
It should be understood that although the steps in the flowcharts of fig. 2, 3 and 4 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2, 3 and 4 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least some of the other steps.
Fig. 5 is a block diagram illustrating a live data processing apparatus according to an example embodiment. Referring to fig. 5, the apparatus includes:
adisplay unit 510 configured to display a live initiating entry in a live interface in a state where the first user account enters a live room;
aresponse unit 520 configured to perform a trigger operation in response to the live initiating entry, and send an opening request to a server; the broadcasting request is used for indicating the server to stop issuing first direct broadcasting stream data to the client of the first user account; the first direct-current streaming data comprises audio and video streaming data provided by a client where a second user account is located; the second user account is a main broadcasting account of the live broadcasting room;
a pushingunit 530 configured to execute a stream pushing instruction in response to the server, to push the second live stream data to the server; the second live streaming data comprises audio and video streaming data provided by a client where the first user account is located.
In an exemplary embodiment, the apparatus further comprises: the verification unit is configured to execute a live broadcast verification instruction sent by the server and verify whether the client side where the first user account is located has a function of pushing the second live broadcast stream data to the server; the sending unit is configured to execute sending a verification passing message to the server if the client of the first user account has the function; and the check passing message is used for indicating the server to issue the stream pushing instruction.
In an exemplary embodiment, the method is specifically configured to execute a live special effect obtaining operation in response to the first user account, and obtain a target live special effect; the target live special effect comprises a live special effect applied by the second user account in the live room; and rendering the audio and video data stream collected by the client side where the first user account is located by adopting the target live broadcast special effect to obtain second live broadcast stream data.
In an exemplary embodiment, the live effect obtaining unit is specifically configured to perform, in response to the live effect obtaining operation, determining the selected target live effect from candidate live effects; the candidate live effects comprise a live effect and a recommended effect currently applied by the first live room; and the similarity between the recommended special effect and the currently applied live special effect of the first live broadcast room is smaller than a preset threshold value.
In an exemplary embodiment, the display unit is specifically configured to display a live special effect acquisition entry in the live broadcast screen; responding to the trigger operation of the live special effect acquisition entrance, and displaying a preview icon corresponding to the candidate live special effect; responding to the trigger operation of the target preview icon, and taking the candidate live broadcast special effect corresponding to the target preview icon as the target live broadcast special effect.
In an exemplary embodiment, the apparatus further comprises: a display unit configured to perform a special effect preview operation in response to the target live special effect, and display a special effect preview screen; the special effect preview picture comprises a picture obtained by rendering an audio-video data stream acquired by a client side where the first user account is located by adopting the target live broadcast special effect.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 6 is a block diagram illustrating anapparatus 600 for performing the above-described live data processing method according to an exemplary embodiment. For example, thedevice 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and so forth.
Referring to fig. 6,device 600 may include one or more of the following components: aprocessing component 602, amemory 604, apower component 606, amultimedia component 608, anaudio component 610, an interface to input/output (I/O) 612, asensor component 614, and acommunication component 616.
Theprocessing component 602 generally controls the overall operation of thedevice 600, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Theprocessing component 602 may include one ormore processors 620 to execute instructions to perform all or a portion of the steps of the methods described above. Further, theprocessing component 602 can include one or more modules that facilitate interaction between theprocessing component 602 and other components. For example, theprocessing component 602 can include a multimedia module to facilitate interaction between themultimedia component 608 and theprocessing component 602.
Thememory 604 is configured to store various types of data to support operation at thedevice 600. Examples of such data include instructions for any application or method operating ondevice 600, contact data, phonebook data, messages, pictures, videos, and so forth. Thememory 604 may be implemented by any type or combination of volatile or non-volatile storage devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
Apower supply component 606 provides power to the various components of thedevice 600. Thepower components 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for thedevice 600.
Themultimedia component 608 includes a screen that provides an output interface between thedevice 600 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, themultimedia component 608 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when thedevice 600 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
Theaudio component 610 is configured to output and/or input audio signals. For example, theaudio component 610 includes a Microphone (MIC) configured to receive external audio signals when thedevice 600 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in thememory 604 or transmitted via thecommunication component 616. In some embodiments,audio component 610 further includes a speaker for outputting audio signals.
The I/O interface 612 provides an interface between theprocessing component 602 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
Thesensor component 614 includes one or more sensors for providing status assessment of various aspects of thedevice 600. For example, thesensor component 614 may detect the open/closed status of thedevice 600, the relative positioning of components, such as a display and keypad of thedevice 600, thesensor component 614 may also detect a change in position of thedevice 600 or a component of thedevice 600, the presence or absence of user contact with thedevice 600, orientation or acceleration/deceleration of thedevice 600, and a change in temperature of thedevice 600. Thesensor assembly 614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. Thesensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, thesensor assembly 614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
Thecommunication component 616 is configured to facilitate communications between thedevice 600 and other devices in a wired or wireless manner. Thedevice 600 may access a wireless network based on a communication standard, such as WiFi, an operator network (such as 2G, 3G, 4G, or 5G), or a combination thereof. In an exemplary embodiment, thecommunication component 616 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, thecommunication component 616 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, thedevice 600 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a computer-readable storage medium comprising instructions, such as thememory 604 comprising instructions, executable by theprocessor 620 of theelectronic device 600 to perform the above-described method is also provided. Alternatively, the computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In an exemplary embodiment, a computer program product is also provided, comprising a computer program stored in a computer readable storage medium, the computer program being executable by aprocessor 620 of anelectronic device 600 to perform the above-mentioned method.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice in the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.