Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the application may be practiced otherwise than as specifically illustrated or described herein. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
The video recommendation method and device provided by the embodiment of the application are described in detail through specific embodiments and application scenes thereof with reference to the accompanying drawings.
Referring to fig. 1, a flowchart of a video recommendation method according to an embodiment of the present application is provided. The method can be applied to electronic equipment, and the electronic equipment can be a mobile phone, a tablet personal computer, a notebook personal computer and the like. The method can also be applied to a server, and the server comprises a plurality of modules for executing the video recommendation method provided by the embodiment.
As shown in fig. 1, a video recommendation method provided in this embodiment may include steps S1100-S1400, which are described in detail below.
S1100, collecting target monitoring data.
In this embodiment, the device for collecting the target monitoring data may be a camera, may be a fingerprint identification device, may be a microphone, may be a device for collecting data, such as a vibration sensor, mounted on an electronic device.
The target monitoring data can be video data collected by a camera, fingerprint information identified by electronic equipment, search information input by a user, chat information and the like.
The detection data may be used to create a representation of the user when the user is first using the electronic device, the target monitoring data may be used to update the representation of the user when the user is not first using the electronic device, and the target monitoring data is used to recommend video to the user according to the method provided by the present embodiment.
Therefore, the target monitoring data of the present embodiment includes at least face image data of the user and/or sound data of the user.
In one possible example, when a user uses the electronic device for the first time, the electronic device generates an initial user image by capturing facial images or sound information or fingerprint information of the user captured by the user during unlocking or interacting with the electronic device, establishes a corresponding user portrait for each user using the electronic device, and stores the user portrait. When the user uses the electronic equipment again, the electronic equipment identifies the user identity through the collected information such as facial images, sounds or fingerprints in the target monitoring data, so as to acquire the user identity.
In one possible example, the target monitoring data may also include web page information that a user browses during use of the electronic device, or interactive information via a voice assistant of the electronic device, or the like.
S1200, determining target state information of a first user of the electronic equipment according to the target monitoring data.
In this embodiment, the first user is a user who is currently using the electronic device. The target state information reflects a current emotion of the first user, for example, a mood in which the first user is happy, angry, peace, and the like. Specifically, the facial expression or the mood of the first user can be obtained through the target monitoring data, so that the current emotion of the first user can be calculated.
In this embodiment, the target monitoring data at least includes face image data of the first user and/or sound data of the first user. To match the first user in the initial user representation with information such as facial images or fingerprints to verify the identity of the first user.
S1300, video retrieval is carried out according to the target state information of the first user so as to determine target videos.
And searching the video according to the target state information of the first user to determine a target video, namely pushing the video for the first user according to the mood of the first user when the mood of the user is reached.
For example, when the first user is depressed, some cure-like videos are recommended to help the user improve the mood, and when the first user is tired, some easy-to-go videos are recommended.
S1400, recommending the target video to the first user.
In this embodiment, referring to fig. 2, fig. 2 shows a display manner of the desktop assembly on a mobile phone screen, and provides a desktop assembly, where the desktop assembly can be suspended above a desktop background, and a recommended target video is played through the desktop assembly, so that a user can quickly browse a video of interest without opening a mobile phone application.
According to the embodiment, the video can be pushed more intelligently according to the current emotion state of the user, and the user experience can be greatly improved.
In an alternative example, in order to make the target video more close to the preference of the first user, when determining the target video in step S1300, the embodiment further includes obtaining identity information of the first user according to the target monitoring data, searching for a user portrait of the first user from the portraits of the plurality of users stored in the electronic device according to the identity information of the first user, and/or extracting video retrieval information of the first user in response to the first user based on the first input of the electronic device.
The identity information of the first user refers to the corresponding identity of the first user in the initial user portrait, and the user portrait of the first user can be extracted through the identity information, wherein the user portrait is obtained based on the historical data of the first user, that is, the initial user portrait of the first user is obtained according to the historical browsing video or actively input data of the first user in the electronic equipment.
The target video of the embodiment may be a video recommended simply according to the emotional state of the first user, or may be a video recommended together according to the emotional state of the first user and the user portrait of the first user in the initial user portrait.
For example, when the first user is currently in an exhausted state and the first user likes a dog in the initial user portrait of the first user, the target video is a dog fun class video.
In this embodiment, the first input of the first user based on the electronic device may be that the user actively clicks a link during the process of browsing the web page, for example, the first user clicks a propaganda article of a movie work, and then the system records the name of the corresponding movie work.
The first user may gather a movie program based on a first input of the electronic device, which may be chat content of the user with friends in a chat application, for example, when the first user has chat a movie program in chat.
The first user may learn a certain knowledge online based on the first input of the electronic device, and the recommendation system may record keywords corresponding to the knowledge.
The first user may also be an operation of sharing information in an application interface to the desktop component in an interface of any application by the user based on the first input of the electronic device.
In this embodiment, the extracted video retrieval information may be any one of text, picture or combination of text and picture.
In one possible embodiment, the video retrieval information may also be a popular keyword or the like at the video website.
The target video of the embodiment can be a video simply recommended according to the emotional state of the first user, can be a video commonly recommended according to the emotional state of the first user and the user portrait of the first user in the initial user portrait, and can also be a video commonly recommended according to the emotional state of the first user, the user portrait of the first user and video retrieval information.
For example, where the first user is currently in an exhausted state, an initial user representation of the first user indicates that the first user likes dogs, and the video retrieval information indicates that the first user is learning science popularization knowledge, the target video may be an "animal science popularization funneling" video.
In an alternative example, since the retrieved target video may have different video durations, if the user finds that the user is not interested after watching a long video, but has spent time to affect the user experience, in order to further improve the user experience, referring to fig. 3, step S1300 of this embodiment further includes the following steps S1301 and S1302:
S1301, video retrieval is carried out according to target state information of a first user, user portraits and/or video retrieval information, and at least one candidate video is obtained;
In this embodiment, video searching may be performed according to any one of the target state information, the user image, and the video searching information of the first user, video searching may be performed according to any two of the target state information, the user image, and the video searching information of the first user, or video searching may be performed simultaneously according to the target state information, the user image, and the video searching information of the first user, to obtain at least one candidate video.
S1302, according to the video duration of the candidate video, determining the candidate video with the video duration within a preset range as a target video.
Consider that the user cannot accurately grasp whether the video is worth viewing or is attracted to the preview picture, looking at a video that is not of interest. Therefore, the target video in this embodiment is a short video, the preset range of the short video may be 1 minute, 2 minutes or 3 minutes, and after the candidate video is obtained, the candidate video is further screened according to the preset range, so as to obtain the target video. So that the user can browse the short video on the desktop video-audio assembly.
S1303, when the video duration of all the candidate videos exceeds a preset range, editing the candidate videos to obtain editing videos with video durations within the preset range as target videos.
If the video duration of all the candidate videos exceeds the preset range, that is, all the retrieved candidate videos are long videos, in order to obtain short videos, in this embodiment, the candidate videos are clipped, so that a clipped video with the video duration within the preset range is obtained as a target video.
In this embodiment, the candidate video may be clipped automatically by a station, or may be clipped according to a time period of playing heat in a video website, or may be clipped according to a time period of changing background music and picture elements in the video, so as to obtain the target video.
In this embodiment, the video search is not limited to the name of the video, but includes the video plate labels of the video in each website and application, such as "social sciences", "education", "fun", "creation", "variety", and the like. And using keywords in the 'theme' and the 'brief introduction', and carrying out similar retrieval by combining with the 'tag', wherein under the condition that the similar retrieval is not carried out, the tag classification condition is reduced to carry out the retrieval until similar videos are retrieved.
It will be appreciated that after obtaining the plurality of target videos, the target videos need to be sequentially recommended to the first user, that is, the target videos are ordered, and then S1400, the target videos are recommended to the first user, and further includes ordering the target videos according to the preset priority playing information, and sequentially recommending the target videos according to the ordering.
In this embodiment, the priority playing information includes target state information, video search information, and preset weights of user portraits, and matching degrees of the target video and the target state information, the video search information, and the user portraits.
In this embodiment, the preset weights of the target state information, the video search information and the user portrait may be weights set by user definition, or may be weights default by a system, for example, the weight of the target state information is greater than the weight of the video search information, and the weight of the video search information is greater than the weight of the user portrait. For example, if the target video contains three target videos related to the target state information, the video search information and the user portrait at the same time, the target video related to the target state information is recommended preferentially. And finally recommending the target video related to the user portrait.
It will be appreciated that the number of target videos retrieved may be substantial, and that each type of target video may need to be ranked, and at this time, the ranking is based on the matching of the target video to the target state information, the video retrieval information, and the user representation. For example, the target state information of the first user is frustrated, and the retrieved target video contains 5 cure videos, so that the 5 cure videos can be ranked according to the cure degrees of the 5 cure videos, and the video with the highest cure degree is played preferentially. The cure degree can be obtained according to the content of the video or comments of other users.
According to the method and the device for recommending the video, the target videos are ordered, so that the video which is most fit with the user requirement can be recommended to the user preferentially, and the user experience is further improved.
In consideration of the fact that in the process that a user views a short video through a desktop component, if the video is interested in comparison, a requirement for viewing a long video corresponding to the short video exists, therefore, after determining a target video, the method further comprises the steps that in the process that the target video is displayed through the desktop component of the electronic device, in response to second input of a first user based on the desktop component, candidate videos with first duration corresponding to the target video are obtained, and the first duration is longer than the video duration of the target video.
Referring to fig. 2, the second input of the first user based on the desktop component may be that the user double-clicks the desktop component, or that the first user clicks a full-screen key in the desktop component, so that the target video may be played full-screen. After the electronic device receives the second input of the first user, the candidate video of the first duration corresponding to the short video may be retrieved.
Next, the present embodiment is further described with reference to fig. 4 by taking target monitoring data of the electronic device as a scenario that the first user shares the target monitoring data to the desktop component through the video application, and the steps S410 to S480 are as follows:
s410, entering a video application.
The first user may choose to open any one of the video applications.
S420, playing the video.
The video of interest to the user is selected in the video application. And playing the video.
S430, sharing the current video to the desktop component.
When the first user wants to search for videos related to the current video being watched, the first user only needs to share the currently played video in the video application into the desktop component.
S440, the desktop component determines whether the received current shared video is a short video.
If the current shared video is a short video, step S450 is performed, and if the current shared video is a long video, step S460 is performed.
S450, searching more short videos and long videos aiming at the short videos which are currently shared.
Here, the search for more short videos is to make the user see more desired videos, and the search for long videos is to meet the requirement that the user want to click on the desktop component to watch long videos after watching short videos.
S460, searching related short videos aiming at the short videos shared currently, and judging whether the short videos are detected or not.
If the short video is retrieved, step S480 is executed, and if the short video is not retrieved, step S470 is executed.
And S470, editing the retrieved long video to generate a short video.
And S480, displaying the short video through the desktop component.
The embodiment can meet the requirement of users for further expansion related to sharing video content. Meanwhile, the content displayed in the long video can be known in advance through a recommendation system of the video component, whether the content is to be watched further is primarily identified, and user experience is further improved.
It should be noted that, in the video recommendation method provided in the embodiment of the present application, the execution body may be a video recommendation device, or a control module in the video recommendation device for executing the video recommendation method. In the embodiment of the application, a video recommendation method for loading video by a video recommendation device is taken as an example, and the video recommendation method provided by the embodiment of the application is described.
Referring to fig. 5, the present embodiment provides a video recommendation apparatus 500, including:
a data acquisition module 510, configured to acquire target monitoring data;
a data processing module 520, configured to determine target state information of a first user of the electronic device according to the target monitoring data;
a video retrieval module 530, configured to perform video retrieval according to the target state information of the first user, so as to determine a target video;
and a recommending module 540, configured to recommend the target video to the first user.
In a possible example, the data processing module is further configured to obtain the identity information of the first user according to the target monitoring data, find a user portrait of the first user from a plurality of user portraits stored in the electronic device according to the identity information of the first user, and/or,
In response to the first user extracting video retrieval information for the first user based on a first input of an electronic device.
In a possible example, the video retrieval module is further configured to perform video retrieval according to the target state information, the user portrait, and/or the video retrieval information of the first user to obtain at least one candidate video;
And determining the candidate video with the video duration within a preset range as a target video according to the video duration of the candidate video.
In one possible example, the video retrieval module is further configured to clip the candidate videos to obtain a clipped video with a video duration within a preset range as the target video when the video duration of all the candidate videos exceeds the preset range.
In a possible example, the recommendation module is further configured to sort the target video according to preset priority playing information, where the priority playing information includes the target state information, the video retrieval information, and weights of the user portraits, and a matching degree of the target video with the target state information, the video retrieval information, and the user portraits;
The recommending the target video to the first user comprises recommending the target video in sequence according to the sorting.
In one possible example, the recommendation module is further configured to present the target video through a desktop component of the electronic device;
In the display process, responding to second input of the first user based on a desktop component, and acquiring candidate videos with first time length corresponding to the target video, wherein the first time length is longer than the video time length of the target video.
The video pushing method and device can push videos more intelligently according to the current emotional state of the user, the user portrait and the input of the user, can recommend videos which are the most fit with the user demands to the user preferentially by sequencing target videos, can meet the requirements of the user on further expansion of the content of the shared videos, and further improves user experience.
The video recommending apparatus in the embodiment of the application can be an apparatus, and can also be a component, an integrated circuit or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc., and the non-mobile electronic device may be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a Television (TV), a teller machine, a self-service machine, etc., and the embodiments of the present application are not limited in particular.
The video recommendation device in the embodiment of the application can be a device with an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, and the embodiment of the present application is not limited specifically.
The video recommending apparatus provided by the embodiment of the present application can implement each process implemented by the video recommending apparatus in the method embodiment provided by the embodiment, and in order to avoid repetition, a description is omitted here.
Optionally, the embodiment of the present application further provides an electronic device 600, including a processor 601, a memory 602, and a program or an instruction stored in the memory 602 and capable of running on the processor 601, where the program or the instruction implements each process of the embodiment of the video recommendation method when executed by the processor 601, and the process can achieve the same technical effect, so that repetition is avoided and redundant description is omitted.
It should be noted that, the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 7 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 1000 includes, but is not limited to, a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.
Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 1010 by a power management system to perform functions such as managing charge, discharge, and power consumption by the power management system. The electronic device structure shown in fig. 7 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.
The processor 1010 is configured to collect target monitoring data, determine target state information of a first user of the electronic device according to the target monitoring data, perform video retrieval according to the target state information of the first user to determine a target video, and recommend the target video to the first user.
In a possible example, the processor 1010 is further configured to obtain the identity information of the first user according to the target monitoring data, find a user portrait of the first user from a plurality of user portraits stored in the electronic device according to the identity information of the first user, and/or extract video retrieval information of the first user in response to the first user based on a first input of the electronic device.
In a possible example, the processor 1010 is further configured to perform video search according to the target state information, the user portrait and/or the video search information of the first user to obtain at least one candidate video, determine, according to the video duration of the candidate video, that the candidate video with the video duration within a preset range is the target video, or clip the candidate video to obtain a clip video with the video duration within the preset range as the target video if the video duration of all the candidate videos exceeds the preset range.
In a possible example, the processor 1010 is further configured to sort the target video according to priority playing information, where the priority playing information includes preset weights of the target state information, the video search information, and the user portrait, and a matching degree of the target video with the target state information, the video search information, and the user portrait, and sequentially recommend the target video according to the sorting.
In one possible example, the processor 1010 is further configured to display the target video through a desktop component of the electronic device, and in the display process, respond to a second input of the first user based on the desktop component, and obtain candidate videos with a first duration corresponding to the target video, where the first duration is longer than a video duration of the target video.
It should be appreciated that in embodiments of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, where the graphics processor 10041 processes image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also referred to as a touch screen. The touch panel 10071 can include two portions, a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein. Memory 1009 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 1010 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 1010.
The embodiment of the application also provides a readable storage medium, on which a program or an instruction is stored, which when executed by a processor, implements each process of the video recommendation method embodiment described above, and can achieve the same technical effects, and in order to avoid repetition, the description is omitted here.
Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.