CN113395535B - Live broadcast processing method, device and system, storage medium and electronic equipment - Google Patents

Abstract

The embodiment of the invention discloses a live broadcast processing method, a live broadcast processing device, a live broadcast processing system, a storage medium and electronic equipment. The method comprises the following steps: acquiring live broadcast data streams sent by live broadcast terminals, and detecting the live broadcast grade of each live broadcast data stream; receiving a recall request sent by a user side, determining a live broadcast grade matched with the viewing grade based on the viewing grade corresponding to the recall request, determining a recommended live broadcast in a live broadcast data stream corresponding to the matched live broadcast grade, and sending a live broadcast identifier of the recommended live broadcast to the user side so that the user side can display the live broadcast identifier of the recommended live broadcast. Based on the matching of the watching level of the user and the live broadcast level of the live broadcast data stream, the live broadcast matched with the watching level is recommended, the request of recommending the live broadcast data stream with the high watching level to the user with the low watching level is avoided, and the accuracy of live broadcast recommendation is improved.

Description

Live broadcast processing method, device and system, storage medium and electronic equipment

Technical Field

The embodiment of the invention relates to the technical field of live broadcast, in particular to a live broadcast processing method, a live broadcast processing device, a live broadcast processing system, a storage medium and electronic equipment.

Background

With the development of internet technology and the improvement of social civilization, the direct broadcast industry is mature day by day.

However, in the process of implementing the present invention, the inventors found that at least the following technical problems exist in the prior art: because the content of the live video is relatively uncertain, the live broadcast platform can be conveniently registered and played, and the harmfulness to the minors is very large for watching users with weak resolving power, especially for games or pornographic boundary ball cut-in which the minors are easy to indulge in.

Disclosure of Invention

The embodiment of the invention provides a live broadcast processing method, a device, a system, a storage medium and electronic equipment, which aim to recommend live broadcast data of different levels to different users.

In a first aspect, an embodiment of the present invention provides a live broadcast processing method, including:

acquiring live broadcast data streams sent by live broadcast terminals, and detecting the live broadcast grades of the live broadcast data streams;

receiving a recall request sent by a user side, determining a live broadcast grade matched with the viewing grade based on the viewing grade corresponding to the recall request, determining a recommended live broadcast in a live broadcast data stream corresponding to the matched live broadcast grade, and sending a live broadcast identifier of the recommended live broadcast to the user side so that the user side can display the live broadcast identifier of the recommended live broadcast.

In a second aspect, an embodiment of the present invention further provides a live broadcast processing method, including:

the method comprises the steps of obtaining information of a login user and/or biological characteristics of a watching user, generating a recall request based on the information of the login user and/or the biological characteristics of the watching user, and sending the recall request to a live broadcast platform, wherein the live broadcast platform is used for determining recommended live broadcast matched with a watching grade based on the watching grade corresponding to the recall request and the live broadcast grade of each live broadcast data stream;

receiving a live broadcast identification which is fed back by the live broadcast platform and recommends live broadcast, and requesting a live broadcast data stream from the live broadcast platform based on the selected live broadcast identification;

and in the display process of the live broadcast data stream sent by the live broadcast platform, periodically acquiring the biological characteristics of the watching user, and verifying whether the live broadcast data stream is continuously displayed or not based on the changed biological characteristics when the biological characteristics of the watching user are changed.

In a third aspect, an embodiment of the present invention further provides a live broadcast processing apparatus, including:

the live broadcast watching grade detection module is used for acquiring live broadcast data streams sent by all live broadcast ends and detecting the live broadcast grade of all the live broadcast data streams;

and the live broadcast recommendation module is used for receiving a recall request sent by a user side, determining a live broadcast grade matched with the viewing grade based on the viewing grade corresponding to the recall request, determining a recommended live broadcast in a live broadcast data stream corresponding to the matched live broadcast grade, and sending a live broadcast identifier of the recommended live broadcast to the user side so that the user side can display the live broadcast identifier of the recommended live broadcast.

In a fourth aspect, an embodiment of the present invention further provides a live broadcast processing apparatus, including:

the system comprises a first request module, a live broadcast platform and a second request module, wherein the first request module is used for acquiring login user information and/or biological characteristics of a watching user, generating a recall request based on the login user information and/or the biological characteristics of the watching user, and sending the recall request to the live broadcast platform, and the live broadcast platform is used for determining recommended live broadcast matched with a watching grade based on the watching grade corresponding to the recall request and the live broadcast grade of each live broadcast data stream;

the second request module is used for receiving a live broadcast identifier which is fed back by the live broadcast platform and recommends live broadcast, and requesting a live broadcast data stream from the live broadcast platform based on the selected live broadcast identifier;

and the live broadcast display module is used for periodically acquiring the biological characteristics of the watching user in the display process of the live broadcast data stream sent by the live broadcast platform, and verifying whether the live broadcast data stream continues to be displayed or not based on the changed biological characteristics when the biological characteristics of the watching user are changed.

In a fifth aspect, an embodiment of the present invention further provides a live broadcast system, including:

the live broadcast end is used for generating a live broadcast data stream and sending the live broadcast data stream to the live broadcast platform;

the system comprises a user side, a live broadcast platform and a client side, wherein the user side is used for acquiring login user information and/or biological characteristics of a watching user, generating a recall request based on the login user information and/or the biological characteristics of the watching user, and sending the recall request to the live broadcast platform;

and the live broadcast platform is used for acquiring the live broadcast data streams, detecting the live broadcast grades of the live broadcast data streams, receiving a recall request sent by the user side, determining the live broadcast grade matched with the watching grade based on the watching grade corresponding to the recall request, determining the recommended live broadcast in the live broadcast data streams corresponding to the matched live broadcast grade, and sending the live broadcast identification of the recommended live broadcast to the user side so as to enable the user side to display the live broadcast identification of the recommended live broadcast.

In a sixth aspect, an embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement a live broadcast processing method according to any embodiment of the present invention.

In a seventh aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the live broadcast processing method according to any embodiment of the present invention is implemented.

According to the technical scheme provided by the embodiment of the invention, the live broadcast data streams are graded by setting the live broadcast grade for each live broadcast data stream, and when a recall request is received, live broadcast matched with the watching grade is recommended based on the watching grade of a user, so that the request of recommending the live broadcast data stream with a high watching grade to the user with a low watching grade is avoided, and the accuracy of live broadcast recommendation is improved.

Drawings

Fig. 1 is a schematic flowchart of a live broadcast processing method according to an embodiment of the present invention;

fig. 2 is a schematic process diagram of a live broadcast end generating a live broadcast data stream according to an embodiment of the present invention;

fig. 3 is a schematic flowchart of a live broadcast processing method according to a second embodiment of the present invention;

fig. 4 is a schematic flowchart of a live broadcast processing method according to a second embodiment of the present invention;

fig. 5 is a schematic structural diagram of a live broadcast processing apparatus according to a fourth embodiment of the present invention;

fig. 6 is a schematic structural diagram of a live broadcast processing apparatus according to a fifth embodiment of the present invention;

fig. 7 is a schematic structural diagram of a live broadcast system according to a sixth embodiment of the present invention;

fig. 8 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.

Example one

Fig. 1 is a flowchart of a live broadcast processing method according to an embodiment of the present invention, where this embodiment is applicable to a case of performing targeted live broadcast recommendation according to a viewing level of a viewing user, and the method may be executed by a anchor processing apparatus provided in an embodiment of the present invention, where the anchor processing apparatus may be implemented by software and/or hardware, and the anchor processing apparatus may be configured on an electronic computing device such as a server and a computer, and specifically includes the following steps:

s110, acquiring live broadcast data streams sent by live broadcast terminals, and detecting live broadcast grades of the live broadcast data streams.

S120, receiving a recall request sent by a user side, determining a live broadcast grade matched with the watching grade based on the watching grade corresponding to the recall request, determining a recommended live broadcast in a live broadcast data stream corresponding to the matched live broadcast grade, and sending a live broadcast identifier of the recommended live broadcast to the user side so that the user side can display the live broadcast identifier of the recommended live broadcast.

The live broadcast end and the client end are respectively in communication connection with the live broadcast platform, and in some embodiments, the live broadcast end and the client end can be two respective ends, namely two different electronic devices; in other embodiments, the live broadcast end and the user end may be the same electronic device, and the different user permissions may be distinguished through different display interfaces, or distinguished by logging in different APPs, or areas may be distinguished by verifying different role identities. The live broadcast end and the client can be terminal equipment such as a mobile phone, a tablet personal computer and the like, and have different authorities respectively, the live broadcast end is used for providing live broadcast data and has live broadcast background management authority and live broadcast object setting authority. The client can watch live broadcast and only has live broadcast watching permission and transaction permission for live broadcast objects in the live broadcast.

The live broadcast end needs to be registered, the live broadcast platform is provided with a registration module, receives a registration request and user information of a user, registers the live broadcast identity of the user, and has corresponding authority after the registration is successful. When any equipment initiates a request to a live broadcast platform, whether the equipment logs in is judged, and after the login is successful, the authority of the equipment is determined, namely the equipment is determined to be one of a live broadcast end and a client. The live broadcast can be started at the live broadcast end, live broadcast objects (such as introduced articles or games) are set, live broadcast data streams are generated, the generated live broadcast data streams are transmitted to the live broadcast platform in real time, and the client can conveniently acquire the live broadcast data streams from the live broadcast platform.

Referring to fig. 2, fig. 2 is a schematic diagram of a process of generating a live data stream by a live end according to an embodiment of the present invention. The live broadcast end comprises local live broadcast acquisition equipment, for example, the live broadcast acquisition equipment comprises terminal equipment such as but not limited to a camera, a microphone and a mobile phone. The method comprises the steps of calling local live broadcast acquisition equipment to acquire audio and video data through live broadcast application on terminal equipment to form live broadcast data streams, and sending the live broadcast data streams to a live broadcast platform (such as a live broadcast server) through the live broadcast application on the terminal equipment. The live broadcast platform carries out authority identification on the information of the live broadcast end, if the live broadcast end has live broadcast authority, the live broadcast data stream is received and stored, an anchor service layer is packaged on the outer layer and used for external service, and the live broadcast data stream is conveniently sent to the user end to be displayed when a request of the live broadcast data stream sent by the user end is received.

The live broadcast platform sets a live broadcast level for the received live broadcast data stream, wherein the live broadcast level can be a level that the live broadcast data stream can face users, and illustratively, the live broadcast level at least comprises two levels, such as an adult level and a minor level, a display object of the live broadcast data stream at the adult level is an adult, and a display object of the live broadcast data stream at the minor level can comprise an adult and a minor. In some alternative embodiments, the live rating may be three ratings including yes, normal, and no, where the presentation objects of the live data stream of normal and no rating are adults and the presentation objects of the live data stream of yes rating are adults and minors. The setting manner of the live broadcast level is only an example, and in other embodiments, a plurality of live broadcast levels (without limitation to three levels) may be set according to requirements, for example, one level, two levels, three levels, four levels, and the like.

In some optional embodiments, the live data stream may be subjected to a grading process through a preset live grading model, so as to obtain a live grade of the live data stream. The video segments to be classified may be determined based on a preset time interval, or the video segments to be classified may be determined based on a random time interval, and the determined video segments are used as input information and input to a live broadcast classification model to obtain a current live broadcast grade of a live broadcast data stream.

In some optional embodiments, the video frames in the live broadcast data stream may be continuously classified, and the live broadcast level is updated in real time based on the classification result of each video frame, for example, the current live broadcast level of the live broadcast data stream may be determined based on the classification result of the current video frame in the live broadcast data stream, and different classification results respectively correspond to a live broadcast level; for example, the classification results of the video frames may be accumulated to determine the current live broadcast level of the live broadcast data stream, for example, the highest live broadcast level in the detected video frames is determined as the current live broadcast level. Specifically, the video frame may be processed based on the image recognition model to obtain a classification result of the video frame. The image recognition model can be obtained based on a sample image and the classification identification training of the sample image, the image recognition model has the function of recognizing pornography/soft pornography, and correspondingly, the sample image can be obtained from a preset sample database and is only used for training the image recognition model.

In some optional embodiments, detecting a live rating of each live data stream includes: for any live broadcast data stream, extracting a video frame detected in the live broadcast data stream, and determining a viewing index of the video frame; and determining the live broadcast grade of the corresponding live broadcast data stream based on the viewing index of each video frame. In this embodiment, the video frames to be detected may be extracted based on a preset time interval, where the preset time interval may be set according to requirements, and may be, for example, 3s to 5s. Each video frame in the live data stream is configured with a time stamp, and the video frame to be detected can be determined according to the time stamp and a preset time interval. The local video frames to be detected are determined through the preset time interval, and the problem that the live broadcast quality is influenced due to overlarge calculated amount caused by detecting the full-scale video frames of the live broadcast data stream is avoided.

In this embodiment, for a video frame to be detected, a viewing index of the video frame is determined, where the viewing index is used to represent an image scale of the video frame, and the smaller the viewing index is, the smaller the image scale is, the larger the viewing index is, and the larger the image scale is. By converting the image content of the video frame into a quantifiable viewing index, a fast determination of the viewing scale of the video frame is facilitated. Optionally, an index threshold may be set for performing scale division on the video frame, for example, if the viewing index is greater than or equal to the index threshold, the corresponding video frame is not suitable for the minor, and if the viewing index is less than the index threshold, the corresponding video frame is suitable for the minor. Illustratively, the video frame with the viewing index as the index threshold value is in a state that people are worn neatly, the size of the upper garment and the lower garment is normal, and no hollow is formed.

Alternatively, the viewing index of each video frame may be determined by the viewing index identification module, that is, the video frame is input into the viewing index identification module, and the viewing index identification module outputs the viewing index of the video frame. The viewing index recognition module may be trained based on the sample image and a standard viewing index of the sample image, and the specific form of the viewing index recognition module is not limited.

Optionally, determining the viewing index of the video frame includes: classifying the video frames based on a preset classification model to obtain probability values of the video frames corresponding to each classification; and determining the viewing index of the video frame based on the probability value of the video frame corresponding to each classification and the grading coefficient of each classification. The preset classification model may be a Neural Network model, such as a CNN (Convolutional Neural Network) model, for classifying the video frames. For any input video frame, a probability value that the video frame belongs to each classification is output. In this embodiment, the categories to which the video frame belongs may include sexy, pron, hentai, neutral, and draw. Wherein the sum of the probabilities of the classes is 1.

In some embodiments, the classification with the highest probability value may be determined as the classification of the video frame, each classification may correspond to a viewing index, or each classification may correspond to a viewing index range, the viewing index of the video frame is within the viewing index range of the corresponding classification, and the viewing index is positively correlated with the classification probability of the corresponding type. In some embodiments, the viewing index of the video frame may be calculated based on the ranking coefficients (e.g., weights) of the respective classifications and the probabilities of the corresponding classifications. The calculation method of the viewing index may be weighted calculation, or may be determined based on a preset calculation rule, which is not limited herein.

For example, the viewing coefficient may be calculated in the following manner:

wherein, score_image Score for the viewing index of the video frame under inspection_sexy Probability value for classifying sexy，score_porn Score, probability value for classifying pron_hentai Socre, a probability value for classifying hentai_neutral Score, probability value for classifying neutral_drawing For the probability value drawing for classifying drawing, the ranking coefficient for classifying sexy, neutral and drawing is 1, the ranking coefficient for classifying hentai is y, and the ranking coefficient for classifying pron is x, where x and y can be set as desired, and in some embodiments, x can be 3 and y can be 2.

The detected video frames in each live data stream are continuously processed based on the above manner, and the viewing index is determined. And recording and storing the watching coefficient of each video frame based on the live broadcast identification of the live broadcast data stream, so that the processing result of the video frame in each live broadcast data stream can be conveniently inquired.

In some embodiments, determining a live rating for a corresponding live data stream based on the viewing index for each video frame comprises: and determining the maximum viewing index of the detected video frame, and determining the current live broadcast grade of the live broadcast data stream based on the maximum viewing index and the viewing index range corresponding to each live broadcast grade. Among the stored viewing indices of the respective video frames, a maximum viewing index is determined. And each live broadcast grade corresponds to different viewing index ranges, and the live broadcast grade corresponding to the viewing index range in which the maximum viewing index is positioned is determined and used as the current live broadcast grade of the live broadcast data stream. And if the viewing index of the latest video frame is larger than the maximum viewing index of the detected video frame, updating the maximum viewing index of the latest video frame and re-determining the current live broadcast level, and if the viewing index of the latest video frame is smaller than or equal to the maximum viewing index of the detected video frame, keeping the determined live broadcast level. For the live broadcast levels { yes, normal and no } of any live broadcast data stream, the corresponding viewing index ranges are sequentially increased, that is, the minimum value of the viewing index range corresponding to the live broadcast level normal is equal to the maximum value of the viewing index range corresponding to the live broadcast level yes, and the minimum value of the viewing index range corresponding to the live broadcast level no is equal to the maximum value of the viewing index range corresponding to the live broadcast level normal.

In some embodiments, determining a live rating for a corresponding live data stream based on the viewing index for each video frame comprises: accumulating and determining the number of the watching indexes of all the video frames in the same live data stream exceeding an index threshold; and determining the current live broadcast level of the live broadcast data stream based on the accumulated number and the number range corresponding to each watching level. Specifically, the processing result of the video frames in the live data stream may be stored based on a data structure { liveId-maxscale-count }, where liveId is a live identifier of the live data stream, maxscale is a maximum viewing index of each video frame in the live data stream, and count is a number of viewing indexes exceeding an index threshold. And comparing the viewing index of each video frame with an index threshold, if the viewing index is more than or equal to the index threshold, adding 1 to the count, and if the viewing index is less than the index threshold, keeping the count unchanged. Illustratively, taking an index threshold of 1 as an example, if the live broadcast (liveId: 1) is detected for the first time for viewing index of 0.75 minutes, the data {1-0.75-0} is initialized, the viewing index detected for the second time is 1.2 minutes, the viewing index is greater than the recorded viewing index and greater than the index threshold, the maxsore is updated, and count is incremented by one, and correspondingly, the modified data is {1-1.2-1}, and the viewing index detected for the third time is 0.7 minutes, the viewing index is less than the recorded viewing index, and the data maxsore and count are maintained if the viewing index is less than the index threshold, and correspondingly, the recorded data is maintained for {1-1.2-1}.

After each video frame is processed, determining the current live broadcast grade based on the cumulative quantity count, wherein different live broadcast grades can correspond to different cumulative quantity ranges, determining the cumulative quantity range to which the cumulative quantity count belongs, and determining the live broadcast grade corresponding to the cumulative quantity range as the current live broadcast grade. Optionally, if the cumulative number count is not changed after processing of each video frame is completed, it may be determined that the live broadcast level of the live broadcast data stream is not changed, and the amount of calculation caused by the matching process of the cumulative number count is reduced. In this embodiment, for the live broadcast levels { yes, normal, no } of any live broadcast data stream, the corresponding accumulated quantity ranges are sequentially increased, that is, the minimum value of the accumulated quantity range corresponding to the live broadcast level normal is greater than the maximum value of the accumulated quantity range corresponding to the live broadcast level yes, and the minimum value of the accumulated quantity range corresponding to the live broadcast level no is greater than the maximum value of the accumulated quantity range corresponding to the live broadcast level normal. For example, the live level yes may correspond to a cumulative amount range of [0,3], the live level normal may correspond to a cumulative amount range of [4,10], and the live level no may correspond to a cumulative amount range of [11, ∞ ].

In some embodiments, the current live broadcast level may be determined based on the maximum viewing index and the number of viewing indexes exceeding the index threshold, the corresponding live broadcast levels are determined based on the maximum viewing index and the number of viewing indexes exceeding the index threshold, respectively, and the determined highest live broadcast level is determined as the current live broadcast level. For example, the live rating determined based on the maximum viewing index is yes, the live rating determined based on the number of viewing indices exceeding the index threshold is no, and the current live rating is no.

In this embodiment, the levels of the live broadcast levels yes, normal and no are sequentially increased, and the live broadcast level is changed from yes to normal or no, or from normal to no, but is not changed reversely.

In the process of detecting the live broadcast level of each live broadcast data stream, the method further comprises the following steps: storing the live broadcast identification and the live broadcast grade of each live broadcast data volume to form a data structure of live broadcast grade-live broadcast identification; and when the live broadcast grade of any live broadcast data stream is changed, updating the data structure of the live broadcast grade-live broadcast identification based on the live broadcast identification of the live broadcast data stream and the changed watching grade. The data structure of the live broadcast level-live broadcast identifier may be a set structure, where key is a live broadcast level, for example, one of yes, normal, and no, and value is a set of live broadcast identifiers (for example, live broadcast IDs) corresponding to the live broadcast level. Exemplary, { "yes":1,4,7}, { "normal":2,5,8}, and { "no":3,6,9}, wherein 1,4,7,2,5,8, and 3,6,9 are live broadcast identifiers, respectively. If the live level of any live data stream 4 is changed from yes to no, the live identification 4 is added into the data set of the live level no and deleted from the data set of the live level yes, namely the updated data structure is { "yes":1,7} { "normal":2,5,8} { "no":3,4,6,9}.

In some embodiments, a string structure may also store live broadcast levels of live broadcast data streams, for example, key is a live broadcast identifier liveld, value is a live broadcast level (yes/normal/no) of the live broadcast, and it is convenient to quickly query the corresponding live broadcast level according to the live broadcast identifier. Correspondingly, when the live broadcast grade changes, the string structure is updated based on the updated live broadcast grade.

The live broadcast platform may receive a recall request sent by the user side in the processes of acquiring the live broadcast data stream and determining the live broadcast level of the live broadcast data stream. The recall request may be triggered when the user side is logged in successfully or when the user side detects a refresh operation. The recall request of the user end includes the user identifier of the user end, which may be, for example, a user end ID or an identifier of an operation user of the user end.

In some embodiments, the recall request also includes a viewing rating of the user. The viewing level of the user may be determined by the user side according to the user information, for example, the viewing level may be determined based on the age of the user, for example, the viewing level of the minor is yes, the viewing level of the live broadcast is yes, the viewing level of the adult is no, and the viewing level of the live broadcast is yes, normal, no. In some embodiments, the user viewing level in the recall request may also be manually input by the user, for example, when the viewing user is an adult, the user viewing level may be selected from the selectable viewing levels yes, normal, and no, for example, when the user selection is detected as normal, a recall request including the user viewing level normal is generated. Wherein the user can only select among the allowed viewing levels, e.g. minor only includes yes, an alternative viewing level, and cannot select among normal, no.

In some embodiments, the recall request further includes viewing user information, and the corresponding live platform maintains a user identity library for recording the viewing level (or age information) of the user and corresponding user identity information, wherein the user identity information may be one or more items of biometric information of the user, such as face information, iris information, and the like. Correspondingly, after receiving a recall request sent by a user side, the live broadcast platform determines the watching level of the user based on the age information in the watching user information, determines that the user is an adult or a minor through the age information, and further determines the watching level.

And if the record matched with the watching user information does not exist in the user identity library, sending prompt information of user registration to the user side, displaying a user registration interface on the user side, and receiving the user registration information sent by the user side to update the user identity library.

In some embodiments, it may also be possible to identify a category of the viewing user information through a user category model, that is, determine a user category based on a user biometric feature in the viewing user information, and determine a viewing level of a user corresponding to the user category, where the user category includes at least minor and adult. The viewing level is determined based on the recognition result of the user classification model.

And for any recall request, determining a recommendation range corresponding to the recall request based on the viewing level corresponding to the recall request and the live broadcast level of each live broadcast data stream, and determining the recommendation live broadcast corresponding to the recall request in the recommendation range. And the recommendation range corresponding to the recall request comprises the live broadcast data stream corresponding to the live broadcast grade matched with the watching grade. A live rating matching the viewing rating, including a live rating equal to the viewing rating, and a live rating lower than the viewing rating, e.g. the viewing rating is yes, then a live rating matching the viewing rating includes a live rating yes; the viewing level is no, and the live broadcast levels matched with the viewing level comprise live broadcast levels yes, normal and no.

Taking the data structures { "yes":1,4,7}, { "normal":2,5,8}, { "no":3,6,9} as an example, the viewing level is yes, then the recommendation range includes live data streams with live identification of 1,4,7, and the viewing level is no, then the recommendation range includes live data streams with live identification of 1,4,7,2,5,8 and 3,6, 9.

And in the recommendation range, determining to recommend live broadcast based on one or more items of search terms in the recall request, recommendation indexes of all live broadcast data streams, attention fields corresponding to user identifications and the like, sending the live broadcast identification of the recommended live broadcast to a user side, and displaying the live broadcast identification of the recommended live broadcast on the user side, so that the user can select the required live broadcast data stream in the recommended live broadcast.

According to the technical scheme, live broadcast grades are set for all live broadcast data streams, the live broadcast data streams are graded, when a recall request is received, based on the fact that the watching grade of a user is matched with the live broadcast grade of the live broadcast data streams, live broadcasts matched with the watching grade are recommended to the user, the request that the user with a low watching grade recommends the live broadcast data streams with a high watching grade is avoided, particularly the situation that the minor recommends the live broadcasts with a large pornographic scale is recommended, and the accuracy of live broadcast recommendation is improved.

Example two

Fig. 3 is a flowchart illustrating a live broadcast processing method according to a second embodiment of the present invention, where the second embodiment of the present invention may be combined with various alternatives in the foregoing embodiments. In the embodiment of the present invention, optionally, the method further includes: receiving a live broadcast data stream request sent by a user side based on the live broadcast identification, and sending a live broadcast data stream corresponding to the live broadcast identification to the user side; in the display of the live data stream, periodically acquiring the current watching level of a watching user, wherein the current watching level is the lowest watching level of at least one watching user; and if the current watching level is not matched with the live broadcast level of the displayed live broadcast data stream, stopping sending the live broadcast data stream to the user side.

As shown in fig. 3, the method of the embodiment of the present invention specifically includes the following steps:

s210, acquiring the live broadcast data streams sent by the live broadcast terminals, and detecting the live broadcast grades of the live broadcast data streams.

S220, receiving a recall request sent by a user side, determining a live broadcast grade matched with the watching grade based on the watching grade corresponding to the recall request, determining a recommended live broadcast in a live broadcast data stream corresponding to the matched live broadcast grade, and sending a live broadcast identification of the recommended live broadcast to the user side so that the user side can display the live broadcast identification of the recommended live broadcast.

And S230, receiving a live broadcast data stream request sent by the user side based on the live broadcast identification, and sending a live broadcast data stream corresponding to the live broadcast identification to the user side.

S240, in the display of the live data stream, periodically obtaining the current watching level of the watching users, wherein the current watching level is the lowest watching level of at least one watching user.

And S250, if the current watching level is not matched with the live broadcast level of the displayed live broadcast data stream, stopping sending the live broadcast data stream to the user side.

In this embodiment, in the display of the live data stream, whether the watching user changes is monitored in real time, and when the watching user changes inversely, whether the watching level of the changed watching user matches with the live level of the live data stream being displayed is determined. The user side can acquire the face image of the watching user through the camera, or acquire the iris information of the watching user through the iris acquisition equipment and the like. The user side determines the current watching level of the watching user through the collected biological characteristics and sends the current watching level to the live broadcast platform, or the collected biological characteristics are sent to the live broadcast platform, and the live broadcast platform determines the current watching level of the user based on the received biological characteristics.

In some embodiments, the biometric characteristic of the user may be acquired based on a fixed time interval. The number of the watching users is at least one, and the user side collects the biological characteristics of each watching user in the shooting range. The current viewing level is determined based on the biometric characteristics of the respective viewing user. The current viewing level is the lowest viewing level of at least one viewing user, for example, the viewing level of the viewing user a is yes, the viewing level of the viewing user a is no, and the current viewing level is yes.

Comparing the current watching level with the live broadcast level of the displayed live broadcast data stream, if the current watching level is matched with the live broadcast level of the displayed live broadcast data stream, continuing to send the live broadcast data stream to the user side, and if the current watching level is not matched with the live broadcast level of the displayed live broadcast data stream, stopping sending the live broadcast data stream to the user side, prompting the user side to quit a display interface, and avoiding the condition that a user is not suitable for watching or a minor logs in through guardian information in the live broadcast data stream display process. Optionally, if the current viewing level of the user is not changed, the current viewing level does not need to be compared with the live broadcast level of the displayed live broadcast data stream, so that the situation of increasing the calculation amount is avoided.

In some embodiments, if the live broadcast level of the live broadcast data stream is the lowest level, the current viewing level of the viewing user does not need to be acquired, so that invalid calculation amount caused by the process of determining the current viewing level is avoided, and if the live broadcast level of the live broadcast data stream is not the lowest level, the step of acquiring the current viewing level of the viewing user is executed.

According to the technical scheme, whether the watching user changes or not is monitored regularly or in real time in the process that the user side requests the live data stream to be displayed, when the watching user changes, the watching user is compared with the live data stream based on the current watching grade, when the watching user and the live data stream are not matched, the live data stream is stopped being sent to the user side, the situation that the watching user is not suitable for watching or a minor logs in through guardian information in the live data stream display process is avoided, and civilization display of the live data stream is achieved.

On the basis of the above embodiment, in the display of the live data stream, if the live level of the live data stream changes, the live data stream is stopped from being sent to the client whose viewing level does not match the changed viewing level. For any live broadcast data stream, the live broadcast level changes with the increase of the number of detected video frames, for example, yes is changed into normal or no, for a user with the watching level of yes, when the live broadcast level changes, the live broadcast video stream is no longer suitable for the user to watch, therefore, when the live broadcast level of the live broadcast video stream changes, the current watching level of the user side displaying the live broadcast data stream is obtained, and for the user side with the current watching level not matched with the changed live broadcast level, the live broadcast data stream is stopped being sent, and the user side is prompted to quit the display interface. The situation that users with unmatched entering levels exist in the live video stream display process is avoided, and live civilization display is achieved.

EXAMPLE III

Fig. 4 is a schematic flow diagram of a live broadcast processing method according to a second embodiment of the present invention, where this embodiment is applicable to a situation where a user requests live broadcast data from a live broadcast platform and displays the live broadcast data, and the method may be executed by a live broadcast processing apparatus according to the second embodiment of the present invention, where the live broadcast processing apparatus may be implemented by software and/or hardware, and the live broadcast processing apparatus may be configured on an electronic computing device with a live broadcast data display function, such as a mobile phone and a tablet computer, and specifically includes the following steps:

s310, obtaining information of a login user and/or biological characteristics of a watching user, generating a recall request based on the information of the login user and/or the biological characteristics of the watching user, and sending the recall request to a live broadcast platform, wherein the live broadcast platform is used for determining recommended live broadcast matched with a watching grade based on the watching grade corresponding to the recall request and the live broadcast grade of each live broadcast data stream.

And S320, receiving the live broadcast identification which is fed back by the live broadcast platform and recommends live broadcast, and requesting a live broadcast data stream from the live broadcast platform based on the selected live broadcast identification.

S330, in the display process of the live broadcast data stream sent by the live broadcast platform, the biological characteristics of the watching user are periodically acquired, and when the biological characteristics of the watching user are changed, whether the live broadcast data stream is continuously displayed or not is verified based on the changed biological characteristics.

After the user end finishes logging in, a recall request can be generated based on user identity information in the login information, or a recall request can be generated based on biological characteristics of the collected user, or a recall request can be generated based on a viewing grade determined by the login information or the biological characteristics. And sending the recall request to the live broadcast platform so that the live broadcast platform feeds back recommended live broadcasts matched with the watching grades.

And the user side displays the recommended live broadcasts, wherein the display sequence of the recommended live broadcasts can be determined based on the recommendation sequence of the live broadcast platform to the recommended live broadcasts. Optionally, the live broadcast recommendation displayed by the user side may be a cover image and description information for displaying the live broadcast recommendation, where the cover image may include a main broadcast and/or a live broadcast object, and may also be a fixed cover preset in a live broadcast room. The description information may include description information of the anchor and/or description information of the live object, so that the user can know the related information of the recommended live through the display content.

The user side detects a selection operation of the user on displaying each recommended live broadcast, which may be, for example, a click operation of detecting each recommended live broadcast, such as a touch click operation or a click operation input through a mouse or a keyboard. And generating a live broadcast data request based on a live broadcast identifier which is corresponding to the click operation and recommends live broadcast, and sending the live broadcast data request to a live broadcast platform, wherein the live broadcast data request comprises a live broadcast identifier and a user identifier. The live broadcast platform receives a live broadcast data request, matches a corresponding live broadcast data stream based on a live broadcast identifier, sends the matched live broadcast data stream to a user side, and the user side enters a live broadcast display interface after detecting selection operation of any displayed recommended live broadcast, receives the live broadcast data stream fed back by the live broadcast platform, and displays the live broadcast data stream on the live broadcast display interface.

And in the display process of the live data stream, acquiring the biological characteristics of the watching user in real time or at regular time to determine whether the watching user changes. Optionally, the user side may locally store the identity information of the common user and the corresponding biological characteristics, where the identity information includes the age information of the user, and the collected biological characteristics are locally matched to determine whether the viewing user changes or whether the viewing level changes. Optionally, the user side sends the collected biometric features to the live broadcast platform, so that the live broadcast platform determines whether the watching user changes or whether the watching level changes.

In some embodiments, verifying whether to continue presentation of the live data stream based on the changed biometric comprises: and determining the current watching level of the watching user based on the changed biological feature verification, if the current watching level is not matched with the live broadcasting level of the live broadcasting data stream, sending a playing stopping signal to the live broadcasting platform, and quitting the display interface of the live broadcasting data stream. The user side determines the current watching level, so that the dependence on the live broadcasting platform can be reduced, and meanwhile, the calculation pressure of the live broadcasting platform is reduced.

In some embodiments, verifying whether to continue presentation of the live data stream based on the changed biometric comprises: sending the changed biological characteristics to the live broadcast platform so that the live broadcast platform determines the current watching level of the watching user, and when the current watching level is not matched with the live broadcast level of the live broadcast data stream, stopping sending the live broadcast data stream and generating a display stopping signal; and receiving a display stopping signal sent by the live broadcast platform, and quitting the display interface of the live broadcast data stream.

According to the technical scheme provided by the embodiment, the recall request is generated based on the information of the login user and/or the biological characteristics of the watching user, the watching level is included in the recall request or can be determined by the recall request, and the live broadcast platform can determine and feed back the recommended live broadcast matched with the watching level conveniently. Meanwhile, in the display process of the live broadcast data stream, the watching user is verified based on the biological characteristics acquired in real time or at regular time, and when the current watching level is not matched with the live broadcast level, the display of the live broadcast data stream is stopped, so that the condition that the watching user is improper or the user watches by virtue of the identity of other people in the display process is avoided, and live broadcast civilization display is realized.

Example four

Fig. 5 is a schematic structural diagram of a live broadcast processing apparatus according to a fourth embodiment of the present invention, where the live broadcast processing apparatus may be integrated in a live broadcast platform. The device includes:

a live viewinglevel detection module 410, configured to acquire live data streams sent by live terminals, and detect live levels of the live data streams;

and the livebroadcast recommendation module 420 is configured to receive a recall request sent by a user side, determine a live broadcast level matched with the viewing level based on the viewing level corresponding to the recall request, determine a recommended live broadcast in a live broadcast data stream corresponding to the matched live broadcast level, and send a live broadcast identifier of the recommended live broadcast to the user side, so that the user side displays the live broadcast identifier of the recommended live broadcast.

On the basis of the above embodiment, the live viewinglevel detection module 410 includes:

the system comprises a watching index determining unit, a judging unit and a judging unit, wherein the watching index determining unit is used for extracting a video frame detected in any live data stream and determining the watching index of the video frame;

and the watching level determining unit is used for determining the live broadcasting level of the corresponding live broadcasting data stream based on the watching index of each video frame.

On the basis of the above embodiment, the viewing index determination unit is configured to:

classifying the video frames based on a preset classification model to obtain probability values of the video frames corresponding to each classification;

and determining the viewing index of the video frame based on the probability value of the video frame corresponding to each classification and the grading coefficient of each classification.

On the basis of the above-described embodiment, the viewing level determination unit is configured to:

determining the maximum viewing index of the detected video frame, and determining the current live broadcast grade of the live broadcast data stream based on the maximum viewing index and the viewing index range corresponding to each live broadcast grade; or,

accumulating and determining the number of the watching indexes of all the video frames in the same live data stream exceeding an index threshold; and determining the current live broadcast level of the live broadcast data stream based on the accumulated number and the number range corresponding to each watching level.

On the basis of the above embodiment, the apparatus further includes:

the data storage module is used for storing the live broadcast identification and the live broadcast grade of each live broadcast data volume to form a data structure of live broadcast grade-live broadcast identification;

and the data storage updating module is used for updating a data structure of the live broadcast grade-live broadcast identification based on the live broadcast identification of the live broadcast data stream and the changed watching grade when the live broadcast grade of any live broadcast data stream is changed.

On the basis of the above embodiment, the recall request includes the viewing level of the user or viewing user information.

The device also includes:

the system comprises a viewing grade determining module of a first user, a recall processing module and a display module, wherein the viewing grade determining module is used for determining the viewing grade of the user based on age information in viewing user information after receiving a recall request sent by a user side; or,

and the viewing grade determining module of the second user is used for determining a user classification based on the user biological characteristics in the viewing user information and determining the viewing grade of the user corresponding to the user classification, wherein the user classification at least comprises a minor age and an adult age.

On the basis of the above embodiment, the apparatus further includes:

the live broadcast data stream sending module is used for receiving a live broadcast data stream request sent by a user side based on the live broadcast identification and sending a live broadcast data stream corresponding to the live broadcast identification to the user side;

a current watching grade updating module, configured to periodically obtain a current watching grade of a watching user during presentation of the live data stream, where the current watching grade is a lowest watching grade of at least one watching user;

and the first live data stream processing module is used for stopping sending the live data stream to the user side if the current watching level is not matched with the live data stream of the displayed live data stream.

On the basis of the above embodiment, the apparatus further includes:

and the second live data stream processing module stops sending the live data stream to the client side of which the watching grade is not matched with the changed watching grade if the live grade of the live data stream is changed in the display of the live data stream.

The live broadcast processing device provided by the embodiment of the invention can execute the live broadcast processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

EXAMPLE five

Fig. 6 is a schematic structural diagram of a live broadcast processing apparatus according to a fifth embodiment of the present invention, where the live broadcast processing apparatus may be integrated in an electronic device such as a mobile phone, a tablet computer, and the like, and the apparatus includes:

afirst request module 510, configured to obtain information of a login user and/or a biometric feature of a viewing user, generate a recall request based on the information of the login user and/or the biometric feature of the viewing user, and send the recall request to a live broadcast platform, where the live broadcast platform is configured to determine, based on a viewing level corresponding to the recall request and a live broadcast level of each live broadcast data stream, a recommended live broadcast whose viewing level is matched with each other;

asecond request module 520, configured to receive a live broadcast identifier, which is fed back by the live broadcast platform and recommends a live broadcast, and request a live broadcast data stream from the live broadcast platform based on the selected live broadcast identifier;

and the livebroadcast display module 530 is configured to periodically acquire the biological characteristics of the watching user during the display process of the live broadcast data stream sent by the live broadcast platform, and verify whether the live broadcast data stream continues to be displayed based on the changed biological characteristics when the biological characteristics of the watching user are changed.

On the basis of the above embodiment, thelive presentation module 530 is configured to:

determining the current watching level of the watching user based on the changed biological feature verification, if the current watching level is not matched with the live broadcasting level of the live broadcasting data stream, sending a playing stopping signal to the live broadcasting platform, and exiting from a display interface of the live broadcasting data stream;

or,

sending the changed biological characteristics to the live broadcast platform so that the live broadcast platform determines the current watching level of the watching user, and when the current watching level is not matched with the live broadcast level of the live broadcast data stream, stopping sending the live broadcast data stream and generating a display stopping signal;

and receiving a display stopping signal sent by the live broadcast platform, and quitting the display interface of the live broadcast data stream.

The live broadcast processing device provided by the embodiment of the invention can execute the live broadcast processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example six

Referring to fig. 7, fig. 7 is a schematic structural diagram of a live broadcasting system according to a sixth embodiment of the present invention, where the live broadcasting system includes:

thelive broadcast terminal 610 is configured to generate a live broadcast data stream and send the live broadcast data stream to the live broadcast platform;

theclient 630 is configured to obtain information of a login user and/or a biological feature of a viewing user, generate a recall request based on the information of the login user and/or the biological feature of the viewing user, and send the recall request to the live broadcast platform;

and thelive broadcast platform 620 is used for acquiring the live broadcast data streams, detecting the live broadcast grades of the live broadcast data streams, receiving a recall request sent by a user side, determining the live broadcast grade matched with the watching grade based on the watching grade corresponding to the recall request, determining a recommended live broadcast in the live broadcast data streams corresponding to the matched live broadcast grade, and sending the live broadcast identification of the recommended live broadcast to the user side so as to enable the user side to display the live broadcast identification of the recommended live broadcast.

According to the technical scheme, the user side generates the recall request based on the information of the logged-in user and/or the biological characteristics of the watching user, the recall request comprises the watching level or the recall request can determine the watching level, the live broadcast platform sets the live broadcast level for each live broadcast data stream, the live broadcast data streams are graded, when the recall request is received, the live broadcast data streams are matched with the live broadcast level of the live broadcast data streams based on the watching level of the user, live broadcasts matched with the watching level are recommended to the user with low watching level, the request of the live broadcast data streams with high watching level is avoided being recommended to the user with low watching level, especially the situation that the live broadcasts with large erotic scale are recommended to minors, and the live broadcast recommendation accuracy is improved.

EXAMPLE seven

Fig. 8 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention. FIG. 8 illustrates a block diagram of anelectronic device 12 suitable for use in implementing embodiments of the present invention. Theelectronic device 12 shown in fig. 8 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiment of the present invention. Thedevice 12 is typically an electronic device that undertakes image classification functions.

As shown in FIG. 8,electronic device 12 is embodied in the form of a general purpose computing device. The components ofelectronic device 12 may include, but are not limited to: one ormore processors 16, amemory device 28, and abus 18 that connects the various system components (including thememory device 28 and the processors 16).

Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, such architectures can include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

Electronic device 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible byelectronic device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

Storage 28 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 30 and/orcache Memory 32. Theelectronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only,storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 8, and commonly referred to as a "hard drive"). Although not shown in FIG. 8, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk-Read Only Memory (CD-ROM), digital Video disk (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected tobus 18 by one or more data media interfaces.Storage 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

Aprogram 36 having a set (at least one) ofprogram modules 26 may be stored, for example, instorage 28,such program modules 26 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may include an implementation of a gateway environment.Program modules 26 generally perform the functions and/or methodologies of the described embodiments of the invention.

Electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, camera,display 24, etc.), with one or more devices that enable a user to interact withelectronic device 12, and/or with any devices (e.g., network card, modem, etc.) that enableelectronic device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O)interface 22. Also,electronic device 12 may communicate with one or more gateways (e.g., local Area Network (LAN), wide Area Network (WAN), etc.) and/or a public gateway, such as the internet, viagateway adapter 20. As shown, thegateway adapter 20 communicates with other modules of theelectronic device 12 over thebus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction withelectronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive Arrays, disk array (RAID) systems, tape drives, and data backup storage systems, to name a few.

Theprocessor 16 executes various functional applications and data processing by executing programs stored in thestorage device 28, for example, to implement the live broadcast processing method provided by the above-described embodiment of the present invention.

Example eight

An eighth embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a live broadcast processing method as provided in the embodiment of the present invention.

Of course, the computer program stored on the computer-readable storage medium provided in the embodiments of the present invention is not limited to the method operations described above, and may also execute the live broadcast processing method provided in any embodiment of the present invention.

Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable source code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Source code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer source code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The source code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of gateway, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will appreciate that the present invention is not limited to the particular embodiments described herein, and that various obvious changes, rearrangements and substitutions will now be apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (11)

1. A live broadcast processing method is characterized by comprising the following steps:

acquiring live broadcast data streams sent by live broadcast terminals, and detecting the live broadcast grades of the live broadcast data streams;

receiving a recall request sent by a user side, determining a live broadcast grade matched with the viewing grade based on the viewing grade corresponding to the recall request, determining a recommended live broadcast in a live broadcast data stream corresponding to the matched live broadcast grade, and sending a live broadcast identifier of the recommended live broadcast to the user side so that the user side can display the live broadcast identifier of the recommended live broadcast;

the live broadcast processing method further comprises the following steps: receiving a live broadcast data stream request sent by a user side based on the live broadcast identification, and sending a live broadcast data stream corresponding to the live broadcast identification to the user side;

in the display of the live data stream, periodically acquiring the current watching level of a watching user, wherein the current watching level is the lowest watching level of at least one watching user;

if the current watching level is not matched with the live broadcast level of the displayed live broadcast data stream, stopping sending the live broadcast data stream to the user side;

detecting a live broadcast level of each live broadcast data stream, including:

for any live data stream, extracting a video frame detected in the live data stream, determining a viewing index of the video frame, wherein each video frame in the live data stream is provided with a timestamp, and determining the video frame to be detected according to the timestamp and a preset time interval;

determining a live broadcast grade of a corresponding live broadcast data stream based on the viewing index of each video frame;

the determining a viewing index for the video frame comprises:

classifying the video frames based on a preset classification model to obtain probability values of the video frames corresponding to each classification;

and determining the viewing index of the video frame based on the probability value of each category corresponding to the video frame and the grading coefficient of each category, wherein the viewing index is calculated in a weighting mode.

2. The method of claim 1, wherein determining a live rating for a corresponding live data stream based on the viewing index for each video frame comprises:

determining the maximum viewing index of the detected video frame, and determining the current live broadcast grade of the live broadcast data stream based on the maximum viewing index and the viewing index range corresponding to each live broadcast grade; or,

accumulatively determining the number of the watching indexes of all the video frames in the same live data stream exceeding an index threshold; and determining the current live broadcast level of the live broadcast data stream based on the accumulated number and the number range corresponding to each watching level.

3. The method of claim 1 or 2, wherein in detecting the live rating of each live data stream, further comprising:

storing the live broadcast identification and the live broadcast grade of each live broadcast data volume to form a data structure of live broadcast grade-live broadcast identification;

and when the live broadcast grade of any live broadcast data stream is changed, updating the data structure of the live broadcast grade-live broadcast identification based on the live broadcast identification of the live broadcast data stream and the changed watching grade.

4. The method of claim 1, wherein the recall request includes a viewing level of a user or viewing user information;

after receiving the recall request sent by the user terminal, the method further comprises the following steps:

determining a viewing grade of a user based on age information in the viewing user information; or,

determining a user classification based on the user biological characteristics in the viewing user information, and determining a viewing grade of a user corresponding to the user classification, wherein the user classification at least comprises a minor age and an adult age.

5. The method as claimed in claim 1, wherein in the displaying of the live data stream, if a live level of the live data stream changes, sending of the live data stream to a client whose viewing level does not match the changed viewing level is stopped.

6. A live broadcast processing method is characterized by comprising the following steps:

the method comprises the steps of obtaining information of a login user and/or biological characteristics of a watching user, generating a recall request based on the information of the login user and/or the biological characteristics of the watching user, and sending the recall request to a live broadcast platform, wherein the live broadcast platform is used for determining recommended live broadcast matched with a watching grade based on the watching grade corresponding to the recall request and the live broadcast grade of each live broadcast data stream;

receiving a live broadcast identification which is fed back by the live broadcast platform and recommends live broadcast, and requesting a live broadcast data stream from the live broadcast platform based on the selected live broadcast identification;

in the display process of the live broadcast data stream sent by the live broadcast platform, periodically acquiring the biological characteristics of a watching user, and verifying whether the live broadcast data stream continues to be displayed or not based on the changed biological characteristics when the biological characteristics of the watching user are changed;

the verifying whether the live data stream continues to be displayed based on the changed biological characteristics comprises:

determining the current watching level of the watching user based on the changed biological feature verification, if the current watching level is not matched with the live broadcasting level of the live broadcasting data stream, sending a playing stopping signal to the live broadcasting platform, and exiting from a display interface of the live broadcasting data stream;

or,

sending the changed biological characteristics to the live broadcast platform so that the live broadcast platform determines the current watching level of the watching user, and when the current watching level is not matched with the live broadcast level of the live broadcast data stream, stopping sending the live broadcast data stream and generating a display stopping signal;

receiving a display stopping signal sent by the live broadcast platform, and quitting a display interface of the live broadcast data stream;

the determining of the live broadcast grade of each live broadcast data stream comprises the following steps:

for any live data stream, extracting a video frame detected in the live data stream, and determining a viewing index of the video frame, wherein each video frame in the live data stream is configured with a timestamp, and the video frame detected is determined according to the timestamp and a preset time interval;

determining a live broadcast grade of a corresponding live broadcast data stream based on the viewing index of each video frame;

the determining a viewing index for the video frame comprises:

classifying the video frames based on a preset classification model to obtain probability values of the video frames corresponding to each classification;

and determining the viewing index of the video frame based on the probability value of each category corresponding to the video frame and the grading coefficient of each category, wherein the viewing index is calculated in a weighting manner.

7. A live broadcast processing apparatus, comprising:

the live broadcast watching grade detection module is used for acquiring live broadcast data streams sent by all live broadcast ends and detecting the live broadcast grade of all the live broadcast data streams;

the live broadcast recommendation module is used for receiving a recall request sent by a user side, determining a live broadcast grade matched with the viewing grade based on the viewing grade corresponding to the recall request, determining a recommended live broadcast in a live broadcast data stream corresponding to the matched live broadcast grade, and sending a live broadcast identifier of the recommended live broadcast to the user side so that the user side can display the live broadcast identifier of the recommended live broadcast;

the live broadcast data stream sending module is used for receiving a live broadcast data stream request sent by a user side based on the live broadcast identification and sending a live broadcast data stream corresponding to the live broadcast identification to the user side;

a current watching grade updating module, configured to periodically obtain a current watching grade of a watching user during presentation of the live data stream, where the current watching grade is a lowest watching grade of at least one watching user;

the first live data stream processing module is used for stopping sending the live data stream to the user side if the current watching level is not matched with the live level of the displayed live data stream;

the live viewing level detection module comprises:

the system comprises a watching index determining unit, a judging unit and a judging unit, wherein the watching index determining unit is used for extracting video frames detected in any live data stream, determining the watching index of the video frames, each video frame in the live data stream is provided with a time stamp, and determining the video frames detected according to the time stamps and a preset time interval;

a viewing grade determining unit for determining a live broadcast grade of the corresponding live broadcast data stream based on the viewing index of each video frame;

the watching index determining unit is also used for classifying the video frames based on a preset classification model to obtain probability values of the video frames corresponding to each classification; and determining the viewing index of the video frame based on the probability value of each category corresponding to the video frame and the grading coefficient of each category, wherein the viewing index is calculated in a weighting mode.

8. A live broadcast processing apparatus, comprising:

the system comprises a first request module, a live broadcast platform and a second request module, wherein the first request module is used for acquiring login user information and/or biological characteristics of a watching user, generating a recall request based on the login user information and/or the biological characteristics of the watching user, and sending the recall request to the live broadcast platform, and the live broadcast platform is used for determining recommended live broadcast matched with a watching grade based on the watching grade corresponding to the recall request and the live broadcast grade of each live broadcast data stream;

the second request module is used for receiving a live broadcast identifier which is fed back by the live broadcast platform and recommends live broadcast, and requesting a live broadcast data stream from the live broadcast platform based on the selected live broadcast identifier;

the live broadcast display module is used for periodically acquiring the biological characteristics of a watching user in the display process of the live broadcast data stream sent by the live broadcast platform, and verifying whether the live broadcast data stream is continuously displayed or not based on the changed biological characteristics when the biological characteristics of the watching user are changed;

the live broadcast display module is further configured to determine a current viewing level of the viewing user based on the changed biometric feature verification, and send a play stop signal to the live broadcast platform and exit a display interface of the live broadcast data stream if the current viewing level is not matched with the live broadcast level of the live broadcast data stream;

or,

sending the changed biological features to the live broadcast platform so that the live broadcast platform determines the current watching level of the watching user, and when the current watching level is not matched with the live broadcast level of the live broadcast data stream, stopping sending the live broadcast data stream and generating a display stopping signal;

receiving a display stopping signal sent by the live broadcast platform, and quitting a display interface of the live broadcast data stream;

the determination of the live rating of each live data stream comprises

For any live data stream, extracting a video frame detected in the live data stream, determining a viewing index of the video frame, wherein each video frame in the live data stream is provided with a timestamp, and determining the video frame to be detected according to the timestamp and a preset time interval;

determining a live broadcast grade of a corresponding live broadcast data stream based on the viewing index of each video frame;

the determining the viewing index of the video frame comprises:

classifying the video frames based on a preset classification model to obtain probability values of the video frames corresponding to each classification;

and determining the viewing index of the video frame based on the probability value of each category corresponding to the video frame and the grading coefficient of each category, wherein the viewing index is calculated in a weighting mode.

9. A live broadcast system, comprising:

the live broadcast end is used for generating a live broadcast data stream and sending the live broadcast data stream to a live broadcast platform;

the system comprises a user side, a live broadcast platform and a client side, wherein the user side is used for acquiring login user information and/or biological characteristics of a watching user, generating a recall request based on the login user information and/or the biological characteristics of the watching user, and sending the recall request to the live broadcast platform;

the live broadcast platform is used for acquiring the live broadcast data streams, detecting the live broadcast grades of the live broadcast data streams, receiving a recall request sent by a user side, determining a live broadcast grade matched with the viewing grade based on the viewing grade corresponding to the recall request, determining a recommended live broadcast in the live broadcast data streams corresponding to the matched live broadcast grade, and sending a live broadcast identifier of the recommended live broadcast to the user side so that the user side can display the live broadcast identifier of the recommended live broadcast;

the live broadcast platform is also used for receiving a live broadcast data stream request sent by a user side based on the live broadcast identification and sending a live broadcast data stream corresponding to the live broadcast identification to the user side;

the user side is further configured to periodically acquire a biological feature of a watching user in a display process of a live data stream sent by the live platform, determine a current watching level of the watching user based on changed biological feature verification when the biological feature of the watching user changes, send a play stop signal to the live platform if the current watching level is not matched with the live level of the live data stream, and quit a display interface of the live data stream; or sending the changed biological features to the live broadcast platform so that the live broadcast platform determines the current watching level of the watching user, and when the current watching level is not matched with the live broadcast level of the live broadcast data stream, stopping sending the live broadcast data stream and generating a display stopping signal; receiving a display stopping signal sent by the live broadcast platform, and quitting a display interface of the live broadcast data stream;

detecting a live rating of each live data stream, including:

for any live data stream, extracting a video frame detected in the live data stream, determining a viewing index of the video frame, wherein each video frame in the live data stream is provided with a timestamp, and determining the video frame to be detected according to the timestamp and a preset time interval;

determining a live broadcast grade of a corresponding live broadcast data stream based on the viewing index of each video frame;

the determining the viewing index of the video frame comprises:

classifying the video frames based on a preset classification model to obtain probability values of the video frames corresponding to each classification;

and determining the viewing index of the video frame based on the probability value of each category corresponding to the video frame and the grading coefficient of each category, wherein the viewing index is calculated in a weighting mode.

10. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements a live processing method as claimed in any one of claims 1-5 or a live processing method as claimed in any one of claim 6 when executing the program.

11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a live processing method according to any one of claims 1 to 5, or a live processing method according to any one of claim 6.

Images