CN112784074A

Movatterモバイル変換

Info

Publication number: CN112784074A
Application number: CN202110162945.3A
Authority: CN
Inventors: 贾皓翔
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-02-05
Filing date: 2021-02-05
Publication date: 2021-05-11
Anticipated expiration: 2041-02-05
Also published as: CN112784074B

Abstract

The embodiment of the application discloses a multimedia data processing method, a computer and a readable storage medium, which can be applied to vehicle-mounted equipment, handheld equipment, desktop equipment, wearable equipment and the like, wherein the method comprises the following steps: acquiring a target object operation aiming at the multimedia application; based on the target object operation, determining predicted multimedia data corresponding to the target object operation, and determining a first identifier list corresponding to the predicted multimedia data as a target preloading identifier list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise predicted multimedia data, and N is a positive integer; the method comprises the steps of conducting pre-loading processing on N target multimedia data, updating a current list displayed in a list display area according to a list corresponding to the N target multimedia data to obtain a first updated list, and displaying the first updated list in the list display area. By the aid of the method and the device, data loading efficiency can be improved.

Description

Multimedia data processing method, computer and readable storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a multimedia data processing method, a computer, and a readable storage medium.

Background

In the network access process, a large amount of data is sometimes required to be acquired from the internet, and the acquisition of the large amount of data brings a large load to data downloading, task processing and the like, so that in some occasions, the data is loaded in batches to reduce the load.

For example, in a network audio/video playing scene, one album has multiple songs, and batch loading may be performed to reduce task load, save traffic, and the like, for example: the method comprises the steps that 20 songs are loaded in batches as one page, the current list displays the loaded 1 st to 20 th songs, but other songs are not loaded, when a user triggers and plays any one of the 21 st to 100 th songs, the user client needs to load the triggered and played song, the process can consume a certain time, in addition, when the user client loads data, the situation of unstable network can occur, so that the network transmission delay is caused, the data loading efficiency is low, and the user experience is influenced.

Disclosure of Invention

The embodiment of the application provides a multimedia data processing method, a computer and a readable storage medium, which can improve the efficiency of data loading.

An embodiment of the present application provides a multimedia data processing method, including:

acquiring user operation;

based on user operation, determining predicted multimedia data corresponding to the user operation, and determining a first identifier list corresponding to the predicted multimedia data as a target preloading identifier list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise predicted multimedia data, and N is a positive integer;

the method comprises the steps of conducting pre-loading processing on N target multimedia data, updating a current list displayed in a list display area according to a list corresponding to the N target multimedia data to obtain a first updated list, and displaying the first updated list in the list display area.

An embodiment of the present application provides a multimedia data processing apparatus, where the apparatus includes:

the operation acquisition module is used for acquiring user operation;

the behavior prediction module is used for determining predicted multimedia data corresponding to user operation based on the user operation and determining a first identifier list corresponding to the predicted multimedia data as a target preloading identifier list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise predicted multimedia data, and N is a positive integer;

the first data loading module is used for preloading N target multimedia data;

and the first list updating module is used for updating the current list displayed in the list display area according to the lists corresponding to the N target multimedia data to obtain a first updating list and displaying the first updating list in the list display area.

Wherein, in determining predicted multimedia data corresponding to a user operation based on the user operation, the behavior prediction module comprises:

the operation analysis unit is used for analyzing user operation, wherein the user operation is the operation aiming at the multimedia application;

the sliding obtaining unit is used for obtaining the sliding stopping position where the current list stays after sliding based on the sliding operation if the user operation is the sliding operation aiming at the current list in the multimedia application;

and the data prediction unit is used for taking the multimedia data which is not displayed in the current list and is adjacent to the multimedia data positioned at the list boundary as the predicted multimedia data corresponding to the user operation when the sliding stopping position is positioned at the list boundary of the current list.

the operation analysis unit is also used for analyzing user operation, wherein the user operation is the operation aiming at the multimedia application;

the component triggering unit is used for determining historical triggering operation aiming at the data switching component and the triggering times of the historical triggering operation in a statistical time period if the user operation is the triggering operation aiming at the data switching component in the multimedia application;

the data prediction unit is further configured to, when the number of triggers is greater than or equal to the continuous trigger threshold, take the multimedia data corresponding to the next trigger operation of the data switching component as the predicted multimedia data corresponding to the user operation.

and the data triggering unit is used for taking the multimedia data which is not displayed in the current list and is adjacent to the boundary multimedia data as the predicted multimedia data corresponding to the user operation if the user operation is the triggering operation aiming at the boundary multimedia data at the head of the list or the tail of the list of the current list in the multimedia application.

the model prediction unit is used for inputting the user operation into an intention prediction model, predicting the user operation based on the intention prediction model and obtaining a user behavior intention, wherein the user operation is the operation aiming at the multimedia application;

and the behavior prediction unit is used for acquiring data prediction switching behaviors corresponding to the user behavior intentions, and determining the predicted multimedia data corresponding to the user behavior intentions based on the current list and the data prediction switching behaviors.

Wherein, the device still includes:

the system comprises a sample acquisition module, a data processing module and a data processing module, wherein the sample acquisition module is used for acquiring at least two historical user operations and historical user behavior intents respectively associated with each historical user operation; the at least two historical user operations comprise a historical user operation i; the historical user operation i comprises a historical behavior track i and an operation time interval i, wherein i is a positive integer;

the sample prediction module is used for predicting the historical behavior track i and the operation time interval i based on the initial intention prediction model to obtain an intention label and an intention prediction probability corresponding to the intention label;

the model training module is used for generating a loss function according to the historical user behavior intention associated with the historical user operation i and the intention prediction probability corresponding to the intention label, and carrying out parameter adjustment on the initial intention prediction model based on the loss function;

and the model generation module is used for determining the initial intention prediction model after the parameters are adjusted as the intention prediction model when the model parameters of the initial intention prediction model after the parameters are adjusted are converged.

Wherein, the device still includes:

the cache obtaining module is used for obtaining cache multimedia data stored in the data cache, and if the cache multimedia data does not comprise the predicted multimedia data, the step of determining a first identifier list corresponding to the predicted multimedia data as a target preloading identifier list is executed;

the second list updating module is further configured to update the current list displayed in the list display area based on the predicted multimedia data to generate a second updated list and display the second updated list in the list display area if the cached multimedia data includes the predicted multimedia data.

Wherein, the device still includes:

the device comprises a quantity acquisition module, a display module and a display module, wherein the quantity acquisition module is used for acquiring the total number of multimedia data in a multimedia data set and the maximum display number of display labels which can be displayed in a list display area, the multimedia data set comprises at least one piece of multimedia data, and the display labels are generated according to data display information of the corresponding multimedia data;

the list dividing module is used for dividing data identifications corresponding to the multimedia data in the multimedia data set into K identification lists according to the total number of the multimedia data and the maximum display number of the display labels; k is a positive integer;

in terms of determining a first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list, the behavior prediction module is specifically configured to:

acquiring data identifiers of the predicted multimedia data, searching the data identifiers of the predicted multimedia data from K identifier lists, and determining a first identifier list corresponding to the data identifiers of the predicted multimedia data as a target preloading identifier list; the first list of identities belongs to K lists of identities.

The current list comprises M display labels respectively corresponding to the display multimedia data; m is a positive integer;

in terms of updating a current list displayed in a list display area according to a list of N target multimedia data to obtain a first updated list, the first list updating module includes:

the relation acquisition unit is used for acquiring the identifier distribution state between the data identifiers of the N target multimedia data and the data identifiers of the M display multimedia data in the current list displayed in the list display area;

a list determining unit, configured to determine the current list as a first updated list if the identifier distribution state is an identifier discontinuous state;

a tag generating unit, configured to generate target display tags corresponding to N target multimedia data, respectively, based on data display information corresponding to the N target multimedia data, if the identifier distribution state is an identifier continuous state and the current list does not include display tags of the N target multimedia data;

and the list generating unit is used for adding the target display labels respectively corresponding to the N target multimedia data into the current list to obtain a first updating list.

Wherein, the device still includes:

the trigger response module is used for responding to the display trigger operation aiming at the first multimedia data corresponding to the first data identifier and acquiring a second data identifier associated with the first data identifier;

the identification list determining module is used for determining a second identification list corresponding to the second data identification as a first preloading identification list;

the second data loading module is used for pre-loading second multimedia data corresponding to the first pre-loading identification list and adding the second multimedia data obtained through pre-loading into the data cache;

and the third list updating module is used for updating the current list displayed in the list display area according to the list corresponding to the second multimedia data to obtain a third updated list and displaying the third updated list in the list display area.

Wherein, the device still includes:

the function acquisition module is used for responding to the display triggering operation aiming at the third multimedia data in the first updating list, acquiring the data display mode of the multimedia application and acquiring the random switching function corresponding to the data display mode;

the function prediction module is used for predicting the third multimedia data based on the random switching function and determining a third data identifier associated with the third multimedia data;

the identifier list determining module is further configured to determine a third identifier list corresponding to the third data identifier as a second preloaded identifier list;

the third data loading module is used for performing preloading processing on fourth multimedia data corresponding to the second preloading identification list and adding the fourth multimedia data obtained through the preloading processing into the data cache;

and the fourth list updating module is used for updating the current list displayed in the list display area according to the list corresponding to the fourth multimedia data to obtain a fourth updated list, and displaying the fourth updated list in the list display area.

Wherein, the device still includes:

the data caching module is used for adding the N target multimedia data into a data cache, counting the caching number of the cached multimedia data in the data cache, and if the caching number is the same as the total number of the multimedia data, sequencing the cached multimedia data based on the caching data identification of the cached multimedia data to obtain the sequenced cached multimedia data;

and the fifth list updating module is used for generating a fifth updating list according to the display tags corresponding to the sorted cached multimedia data and displaying the fifth updating list in the list display area.

Wherein the user operation is an operation for a multimedia application; the device also includes:

the structure reorganization module is used for acquiring data identifications corresponding to at least two pieces of multimedia data respectively, and performing structure reorganization on the association structures between the data identifications corresponding to the at least two pieces of multimedia data respectively to generate an identification circulation list;

in determining predicted multimedia data corresponding to a user operation based on the user operation, the behavior prediction module includes:

the position acquisition unit is used for acquiring a trigger data identifier of multimedia data triggered by the multimedia application based on user operation and acquiring identifier position information of the trigger data identifier in an identifier circular list;

and the position determining unit is used for determining target position information based on the user operation and the identification position information, and determining the multimedia data corresponding to the data identification positioned at the target position information in the identification circular list as the predicted multimedia data corresponding to the user operation.

One aspect of the embodiments of the present application provides a computer device, including a processor, a memory, and an input/output interface;

the processor is respectively connected with the memory and the input/output interface, wherein the input/output interface is used for receiving data and outputting data, the memory is used for storing a computer program, and the processor is used for calling the computer program so as to enable the computer device comprising the processor to execute the multimedia data processing method in one aspect of the embodiment of the application.

An aspect of the embodiments of the present application provides a computer-readable storage medium, which stores a computer program, where the computer program is adapted to be loaded and executed by a processor, so as to enable a computer device having the processor to execute the multimedia data processing method in the aspect of the embodiments of the present application.

An aspect of an embodiment of the present application provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternatives in one aspect of the embodiments of the application.

The embodiment of the application has the following beneficial effects:

in the embodiment of the application, a user client can obtain user operation, determine predicted multimedia data corresponding to the user operation based on the user operation, and determine a first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise predicted multimedia data, and N is a positive integer; the method comprises the steps of conducting pre-loading processing on N target multimedia data, updating a current list displayed in a list display area according to a list corresponding to the N target multimedia data to obtain a first updated list, and displaying the first updated list in the list display area. Through the process, the user client can predict the behavior operation which is possibly triggered by the user aiming at the multimedia application in the follow-up process based on the user operation generated by the user, and the computer equipment can pre-load the N target multimedia data including the predicted multimedia data based on the user operation, so that the computer equipment can directly acquire the triggered multimedia data when any one multimedia data in the N target multimedia data is triggered, the time consumed during the switching of the multimedia data is reduced, and the multimedia data loading efficiency is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a network interaction architecture diagram for multimedia data processing according to an embodiment of the present application;

fig. 2 is a schematic view of a multimedia data loading display scene according to an embodiment of the present application;

fig. 3 is a flowchart of a method for processing multimedia data according to an embodiment of the present application;

fig. 4 is a schematic diagram of a multimedia data preloading scene according to an embodiment of the present application;

fig. 5 is a schematic diagram of a text format data loading scene provided in an embodiment of the present application;

fig. 6 is a schematic diagram of a data preloading scenario based on trigger times according to an embodiment of the present application;

fig. 7 is a schematic diagram of a multimedia data preloading scene based on a trigger operation according to an embodiment of the present application;

fig. 8 is a schematic diagram of an update list generation scenario provided in an embodiment of the present application;

fig. 9 is a schematic flowchart of a multimedia data processing method according to an embodiment of the present application;

FIG. 10 is a flowchart of an initial loading scenario interaction provided by an embodiment of the present application;

FIG. 11 is a flowchart of a data operation scenario interaction provided by an embodiment of the present application;

FIG. 12a is a schematic diagram of a component switching scenario provided by an embodiment of the present application;

FIG. 12b is a schematic diagram of another component switching scenario provided by an embodiment of the present application;

fig. 13 is a schematic view of a sliding scene interaction flow provided in an embodiment of the present application;

FIG. 14 is a diagram illustrating a random output scenario provided by an embodiment of the present application;

fig. 15a to fig. 15b are flowcharts illustrating a conventional scene interaction in playing according to an embodiment of the present application;

FIG. 16 is a diagram of a multimedia data processing apparatus according to an embodiment of the present application;

fig. 17 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Referring to fig. 1, fig. 1 is a network interactive architecture diagram of multimedia data processing according to one or more embodiments of the present application, which may be implemented by a user client in one or more embodiments. The computer device can perform data interaction with a user client, wherein the user client is a device where a user who can use the service provided by the computer device is located. As shown in fig. 1, thecomputer device 101 may perform data interaction with user clients (e.g., auser client 102a, auser client 102b, auser client 102c, etc.), and the user clients may obtain multimedia data from the computer device and perform preloading processing on the multimedia data. Specifically, taking theuser client 102a as an example, theuser client 102a may obtain a user operation for a multimedia application, predict a behavior operation that may be triggered by a user associated with theuser client 102a based on the user operation, that is, predict a user behavior intention of the user, and theuser client 102a may determine predicted multimedia data corresponding to the user operation based on the behavior operation that may be triggered by the user, perform pre-loading processing on N target multimedia data based on the predicted multimedia data, so as to update a current list displayed in a list display area based on the target multimedia data obtained by the pre-loading, where N is a positive integer. Similarly, other user clients (e.g., theuser client 102b or theuser client 102c) may also preload the multimedia data based on the above-described process. Through the process, the user client can predict the operation which is possibly triggered by the user next time in advance so as to pre-load the predicted multimedia data and the like, and the user client can directly acquire and display the pre-loaded multimedia data when triggering the predicted multimedia data, so that the user client only needs to consume less time when switching the displayed multimedia data, and the data loading efficiency is improved.

The user client may be a mobile phone (e.g., theuser client 102c) or a notebook computer (e.g., theuser client 102b), or may be a playing client in a vehicle (e.g., theuser client 102a), and the like, which is not limited herein. Theuser client 102a may be considered as a playing client in thevehicle 103, and the runningmultimedia data 1021 currently being displayed by the user client may be displayed in theuser client 102a, and may include adata switching component 1022 and the like. The user client in fig. 1 is only an exemplary partial client, and in the present application, the user client is not limited to the client illustrated in fig. 1.

Wherein, the at least two mentioned in the present application are two or more, for example, the at least two multimedia data are two or more multimedia data.

Fig. 2 is a schematic view of a multimedia data loading display scene according to one or more embodiments of the present application. As shown in fig. 2, theuser client 201 may obtain a user operation for themultimedia application 2011, determine, based on the user operation, predicted multimedia data corresponding to the user operation, determine a first identifier list corresponding to the predicted multimedia data as a target preloading identifier list, perform preloading processing on N target multimedia data corresponding to the target preloading identifier list from thecomputer device 202, and, theuser client 201 can select a target multimedia data according to the list corresponding to the N target multimedia data, updates the current list displayed in the list display area to obtain a first updated list, displays the first updated list in thelist display area 2012, thelist display area 2012 can be independently displayed on the data display page of themultimedia application 2011 or can be displayed on the data display page of themultimedia application 2011, which is not limited herein. Through the process, the user client can directly output the pre-loaded multimedia data when the user triggers the pre-loaded multimedia data subsequently or the user client automatically triggers the pre-loaded multimedia data without loading, so that the data switching efficiency is improved, and the data switching fluency is improved. Especially, when the user client is located at a position with a poor network signal, for example, the user client is a playing client in a vehicle (such as a vehicle-mounted device or a handheld terminal in a vehicle-mounted scene, or a terminal device in a scene such as a train, a ship, or a flight), if the user client loads triggered multimedia data when triggering the multimedia data, more time is consumed, so that a longer blank output time exists during data switching, which results in unsmooth data switching and lower data loading efficiency.

It is understood that the user client or computer device mentioned in the embodiments of the present application may include, but is not limited to, a terminal device or a server. In other words, the computer device may be a server or a terminal device, or may be a system composed of a server and a terminal device; the user client can be a server or a terminal device, and can also be a system consisting of the server and the terminal device. The above-mentioned terminal device may be an electronic device, including but not limited to a mobile phone, a tablet computer, a desktop computer, a notebook computer, a palm computer, a vehicle-mounted device, an Augmented Reality/Virtual Reality (AR/VR) device, a helmet display, a wearable device, a smart speaker, a digital camera, a camera, and other Mobile Internet Devices (MID) with network access capability, or a terminal device in a scene such as a train, a ship, or a flight. The above-mentioned server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as cloud service, a cloud database, cloud computing, a cloud function, cloud storage, Network service, cloud communication, middleware service, domain name service, security service, vehicle-road cooperation, a Content Delivery Network (CDN), a big data and artificial intelligence platform, and the like.

The data referred to in one or more embodiments of the present application may be stored in a computer device, or may be stored based on cloud storage technology, which is not limited herein. For example, if the data is stored in the computer device, the user client may perform preloading processing on the multimedia data from the computer device; if the data is stored based on the cloud storage technology, the user client can perform preloading processing and the like on the multimedia data from the cloud storage space. The computer device refers to a device for managing related data of the multimedia application, such as a server of the multimedia data.

Referring to fig. 3, fig. 3 is a flowchart illustrating a method for processing multimedia data according to one or more embodiments of the present application. As shown in fig. 3, which is described by taking a user as an example, in the embodiment of the method described in fig. 3, the multimedia data processing procedure includes the following steps:

in step S301, a user operation is acquired.

When there are at least two multimedia data, that is, H is a positive integer greater than or equal to 2, the H multimedia data may be divided into K data groups, each data group corresponds to an identification list, the identification list includes data identifications of the multimedia data in the corresponding data group, and K is a positive integer.

In one or more embodiments, the multimedia data may include data in an audio format, a user client needs to load an album, where the album includes H pieces of multimedia data and corresponds to data identifiers 1 to H, respectively, and it is assumed that the multimedia data is a song, that is, multimedia data 1 corresponds to data identifier 1 and represents a first song in the album; the multimedia data 2 corresponds to a data identifier 2 and represents a second song in the album; the multimedia data 3 corresponds to a data identifier 3 and represents a third song in the album; …, respectively; the multimedia data H corresponds to the data id H and represents the H-th song (i.e., the last song) in the album. Since there may be many contents in an album, that is, an album may include H multimedia data, when the value of H is large, if the user client requests to load H multimedia data at a time, the user may need a long time to wait for the completion of the loading process or consume too much traffic, and therefore, a batch loading manner is adopted, for example, the album is divided into a plurality of pages, that is, the H multimedia data are divided into K data groups, each data group includes only part of contents, and all data groups may constitute the album. When a user client requests, only one data group needs to be requested to be loaded at one time, so that the paging loading of H multimedia data is realized. The album refers to a set of one or more playable elements (such as songs, broadcast programs, radio programs, or audio books), and one album may include any one element, or may include at least two elements, such as any two or more elements of songs, broadcast programs, radio programs, or audio books, in other words, one album may include only one element (such as only songs, or only broadcast programs), that is, the types of the elements of the multimedia data included in the album are the same, or may include two or more elements (such as including songs and broadcast programs), that is, the types of the elements of the multimedia data included in the album are not necessarily the same, and this is not a limitation. Optionally, the album may also include other kinds of elements, and is not limited to the above-mentioned songs, broadcast programs, radio programs, audio books, and the like, and is not limited herein.

In one or more embodiments, the multimedia data may include text format data, such as novels, documents, or news information, for example, H multimedia data may be loaded by the user client, and the H multimedia data may be H novels, H documents, or H news information; or, the multimedia data may also be chapter content in a novel, that is, a novel includes H chapter contents, and the H chapter contents are H multimedia data that the user client needs to load.

In one or more embodiments, a user client needs to load H multimedia data, which may include video format data. For example, there is one piece of movie and television data, the movie and television data includes at least two movie and television videos, the at least two movie and television videos are determined as H pieces of multimedia data, and the number of the movie and television videos included in the at least two movie and television videos is H.

In other words, in one or more embodiments of the present application, there is no limitation on the data type and data content of the multimedia data that the user client needs to load.

Step S302, based on the user operation, determining the predicted multimedia data corresponding to the user operation, and determining a first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list.

In one or more embodiments of the present application, a user client may predict a user behavior intention based on a user operation for a multimedia application, and determine predicted multimedia data corresponding to the user operation based on the user behavior intention, where the user behavior intention is used to represent an operation that may be triggered next for the multimedia application in the user client.

In one or more embodiments, a user client may obtain a user operation for a multimedia application, predict a user behavior intention based on the user operation, determine predicted multimedia data corresponding to the user operation based on the user behavior intention, and determine a first identifier list corresponding to the predicted multimedia data as a target preloading identifier list, where the target preloading identifier list corresponds to N target multimedia data, where the N target multimedia data include the predicted multimedia data, and N is a positive integer. The user behavior is intended to represent the display purpose that the user may wish to achieve for the multimedia data, that is, in the user client, the operation that the user client may trigger next for the multimedia application, and the multimedia data that is triggered next for the operation that the multimedia application may trigger (i.e., the predicted multimedia data). For example, if the user client currently outputs a fifth multimedia data, and it is determined that the user behavior intention is to trigger a first data switching component, where the first data switching component is a component that is switched to a previous multimedia data of the currently output multimedia data, it may be determined that the predicted multimedia data corresponding to the user operation is a fourth multimedia data based on the user behavior intention, obtain a first identifier list corresponding to the fourth multimedia data, and determine the first identifier list as a target preloaded identifier list.

In one or more embodiments, a user client may parse a user operation that is an operation for a multimedia application. If the user operation is a sliding operation aiming at a current list in the multimedia application, acquiring a sliding stop position where the current list stops after sliding based on the sliding operation; when the sliding stopping position is positioned at the list boundary of the current list, taking the multimedia data which is not displayed in the current list and is adjacent to the multimedia data positioned at the list boundary as the predicted multimedia data corresponding to the user operation; specifically, the user client may predict the user behavior intention as a list update intention based on the sliding operation, and use, as the predicted multimedia data corresponding to the user operation, multimedia data that is not displayed in the current list and is adjacent to the multimedia data located at the list boundary corresponding to the sliding stop position based on the list update intention. The list is composed of multimedia data currently displayed in a list display area, for example, H multimedia data are H songs, when a user client obtains a user operation for a multimedia application, display tags corresponding to 1 st song to 20 th song (i.e., first multimedia data to 20 th multimedia data) are displayed in the list display area, and the current list is composed of the display tags corresponding to the 1 st song to 20 th song.

In one or more embodiments, the list boundary may include an upper list boundary and a lower list boundary, the upper list boundary being used to indicate a boundary corresponding to the boundary multimedia data located at the head of the list in the current list, and the lower list boundary being used to indicate a boundary corresponding to the boundary multimedia data located at the end of the list in the current list. When the sliding stopping position is located at the upper border of the list of the current list, the user may want to trigger the last multimedia data of the border multimedia data located at the head of the list of the current list, namely the predicted user behavior intention is a list updating intention based on the upper border of the list, and the predicted multimedia data corresponding to the user operation is determined to be the last multimedia data of the border multimedia data located at the head of the list of the current list; when the slide stop position is located at the lower list boundary of the current list, the next multimedia data of the boundary multimedia data located at the end of the list of the current list is triggered, namely the predicted user behavior intention is a list updating intention based on the lower list boundary, and the predicted multimedia data corresponding to the user operation is determined to be the next multimedia data of the boundary multimedia data located at the end of the list of the current list.

Fig. 4 is a schematic diagram of a multimedia data preloading scene according to one or more embodiments of the present application. As shown in fig. 4, the multimedia data currently being output by theuser client 401 is recorded as the running multimedia data, theuser client 401 may display the running multimedia data in the runningarea 4011, such as the data content and the data display information of the running multimedia data, and may display the display tags of the multimedia data in the data group in which the running multimedia data is located in thelist display area 4012, where the display tags are generated based on the data display information of the corresponding multimedia data, and record the multimedia data displayed in thelist display area 4012 as the display multimedia data. In one or more embodiments, the user client displays display tags of the respective display multimedia data, such as display tag 1 for displaying multimedia data 1, display tag 2 for displaying multimedia data 2, and display tag M for displaying multimedia data M, in thelist display area 4012. Thelist display area 4012 may be independently displayed in theoperation area 4011, or thelist display area 4012 and theoperation area 4011 may be displayed on the same page, which is not limited herein.

In one or more embodiments, theuser client 401 obtains a user operation for the multimedia application, and if the user operation is a sliding operation for a current list in the multimedia application, obtains a slidingstop position 4013 where the current list stays after the sliding operation is performed, and assuming that the sliding operation is an operation of sliding along a display tag corresponding to the display multimedia data 1 to a display tag corresponding to the display multimedia data M, theuser client 401 may obtain that the slidingstop position 4013 is an operation located at a lower boundary of the list of the current list, and predict a user behavior intention as a list update intention. Based on the list update intention, theuser client 401 uses the multimedia data that is not displayed in the current list and is adjacent to the multimedia data located at the lower boundary of the list (i.e., the display multimedia data M) as the predicted multimedia data corresponding to the user operation, wherein it can be considered that the position of the predicted multimedia data in the H multimedia data is behind the position of the display multimedia data M, for example, the display multimedia data M is the 20 th multimedia data of the H multimedia data, and the predicted multimedia data is the 21 st multimedia data of the H multimedia data. The method comprises the steps of obtaining a first identification list corresponding to predicted multimedia data, determining the first identification list as a target preloading identification list, wherein a target preloading data set corresponding to the target preloading identification list comprises N target multimedia data, and the N target multimedia data comprise the predicted multimedia data.

Fig. 5 is a schematic diagram of a text format data loading scene according to one or more embodiments of the present application, if a user client needs to load a novel, the novel includes H pieces of multimedia data, the multimedia data is chapter content, theuser client 501 displays running multimedia data in arunning area 5011, the running multimedia data is multimedia data currently being output by theuser client 501, and in response to a trigger operation on alist display component 5012, alist display area 5013 is displayed, thelist display area 5013 displays a current list, the current list includes M pieces of display multimedia data, and the M pieces of display multimedia data belong to the H pieces of multimedia data, where thelist display area 5013 can be displayed in the runningarea 5011 independently or in the same page as the runningarea 5011, which is not limited herein. Assume that the M pieces of display multimedia data include chapter contents of chapter i, chapter ii, chapter …, and chapter M of the novel.

In one or more embodiments, theuser client 501 may display, in thelist display area 5013, display tags corresponding to the M display multimedia data, respectively, which may be generated according to data display information of the corresponding display multimedia data. In one or more embodiments, when the display multimedia data is chapter content, the data display information corresponding to the display multimedia data may include, but is not limited to, a chapter identifier, a chapter name, and the like of the display multimedia data. Theuser client 501 obtains a user operation for the multimedia application, and if the user operation is a sliding operation for a current list in the multimedia application, obtains a slidingstop position 5014 where the current list stays after sliding based on the sliding operation, and if the sliding operation is an operation of sliding along the display multimedia data M to the display multimedia data 1 (that is, an operation of sliding along a display label corresponding to chapter content of chapter M to a display label corresponding to chapter content of chapter M), theuser client 501 may obtain that the slidingstop position 5014 is an operation located at an upper boundary of the list of the current list, and predict that a user action intention is a list update intention. Based on the list update intention, theuser client 501 uses, as predicted multimedia data corresponding to the user behavior intention, multimedia data that is not displayed in the current list and is adjacent to the multimedia data located at the upper boundary of the list (i.e., the displayed multimedia data 1, or the chapter content of the first chapter), where it can be considered that the position of the predicted multimedia data in H multimedia data is before the position of the displayed multimedia data 1, for example, where the displayed multimedia data 1 is the first multimedia data (i.e., the chapter content of the first chapter) of the H multimedia data, the predicted multimedia data is the H-th multimedia data (i.e., the last multimedia data) of the H multimedia data. The method comprises the steps of obtaining a first identification list corresponding to predicted multimedia data, determining the first identification list as a target preloading identification list, wherein a target preloading data set corresponding to the target preloading identification list comprises N target multimedia data, and the N target multimedia data comprise the predicted multimedia data.

Referring to fig. 7, fig. 7 is a schematic diagram of a multimedia data preloading scenario based on a trigger operation according to an embodiment of the present application. As shown in fig. 7, the multimedia data currently being output by theuser client 701 is recorded as the running multimedia data, theuser client 701 may display the running multimedia data in the runningarea 7011, for example, data content and data display information of the running multimedia data, may display a display tag corresponding to each multimedia data in a data group in which the running multimedia data is located in thelist display area 7012, and record the multimedia data corresponding to the current list displayed in thelist display area 7012 as the display multimedia data.

In one or more embodiments, the user client may display various display tags for displaying multimedia data, such as display tag 1 for displaying multimedia data 1, display tags 2 and … for displaying multimedia data 2, display tag M for displaying multimedia data M, and the like, in thelist display area 7012. Thelist display area 7012 may be independently displayed in therun area 7011, or thelist display area 7012 and therun area 7011 may be displayed in the same page, which is not limited herein.

In one or more embodiments, a user client may obtain a user operation for a multimedia application, input the user operation into an intention prediction model, and predict the user operation based on the intention prediction model to obtain a user behavior intention; and acquiring data prediction switching behaviors corresponding to the user behavior intentions, and determining the prediction multimedia data corresponding to the user behavior intentions based on the current list and the data prediction switching behaviors. The intention prediction model may be a model trained in advance, and optionally, the intention prediction model may be subjected to model optimization adjustment in the use process.

In one or more embodiments, the user client may obtain cached multimedia data stored in the data cache, and if the cached multimedia data does not include the predicted multimedia data, perform the step of determining the first identifier list corresponding to the predicted multimedia data as the target preloaded identifier list. If the cached multimedia data includes the predicted multimedia data, updating the current list displayed in the list display area based on the predicted multimedia data to generate a second updated list, and displaying the second updated list in the list display area.

In one or more embodiments, the user client may obtain data identifiers corresponding to at least two pieces of multimedia data, and perform structural reorganization on association structures between the data identifiers corresponding to the at least two pieces of multimedia data, to generate an identifier cyclic list. The user client can acquire a trigger data identifier aiming at multimedia data triggered by the multimedia application based on the user operation, and acquire identifier position information of the trigger data identifier in an identifier circular list, wherein the multimedia data triggered by the multimedia application is the mentioned running multimedia data; and determining target position information based on the user operation and the identification position information, and determining the multimedia data corresponding to the data identification positioned at the target position information in the identification circular list as the predicted multimedia data corresponding to the user operation.

Step S303, performing preloading processing on N target multimedia data corresponding to the target preloading identification list, updating the current list displayed in the list display area according to the list corresponding to the N target multimedia data to obtain a first updated list, and displaying the first updated list in the list display area.

In one or more embodiments, the user client may generate a display tag for the multimedia data according to the data display information of the multimedia data. In one or more embodiments, the user client may directly compose all parameters in the data display information into a display tag of the multimedia data; any parameter in the data display information can also be determined as the display label of the multimedia data; or f parameters may be selected from the data display information, the selected f parameters form a display tag of the multimedia data, where f is a positive integer and is smaller than the number of parameters included in the data display information, and the user client may select the f parameters from the data display information based on a default parameter type or randomly select the f parameters from the data display information. Similarly, the above-mentioned display labels can be obtained by this process.

In one or more embodiments, a user client may obtain a user operation for a multimedia application, predict a user behavior intention based on the user operation, obtain predicted multimedia data corresponding to the user behavior intention, and determine a first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise predicted multimedia data, and N is a positive integer; the method comprises the steps of conducting pre-loading processing on N target multimedia data, updating a current list displayed in a list display area according to a list corresponding to the N target multimedia data to obtain a first updated list, and displaying the first updated list in the list display area. Through the process, the computer equipment can predict the subsequent user behavior intention of the user based on the user operation generated by the user, the user behavior intention can represent the behavior operation which can be triggered by the user aiming at the multimedia application, and the computer equipment can pre-load N target multimedia data including the predicted multimedia data based on the user behavior intention, so that if any one of the N target multimedia data is triggered, the computer equipment can directly acquire the triggered multimedia data, the time consumed during the switching of the multimedia data is reduced, and the multimedia data loading efficiency is improved.

In one or more embodiments, the user client may pre-determine the user behavior intention in advance, and pre-load the multimedia data based on the pre-determined user behavior intention, so that when the user triggers the pre-loaded multimedia data, the user client may output the multimedia data requested by the user without loading the multimedia data requested by the user, so that the user client may smoothly switch the multimedia data, reduce the waiting time of the user, and improve the fluency of outputting the multimedia data.

Optionally, the process of performing the preloading processing on the N target multimedia data by the user client, and the process of updating the current list displayed in the list display area according to the list corresponding to the N target multimedia data to obtain the first updated list, and displaying the first updated list in the list display area may be performed synchronously or asynchronously, where an execution sequence between the processes is not limited. The N target multimedia data are pre-loaded, namely the data of the N target multimedia data are pre-loaded, the current list displayed in the list display area is updated according to the list corresponding to the N target multimedia data to obtain the first update list, the current list displayed in the list display area is updated based on the display labels generated by the data display information corresponding to the N target multimedia data respectively, and the first update list is obtained, so that the execution sequence between the pre-loading processing process and the current list updating process is not limited.

In one or more embodiments, the user client may output multimedia data that is not in the current list when outputting the first display multimedia data or the last display multimedia data (i.e., boundary multimedia data) of the current list displayed in the list display area, and thus, may preload the multimedia data; when the user slides up or down to the list boundary of the current list, multimedia data which is not in the current list can be triggered, so that the multimedia data can be preloaded; when the user continuously triggers the data switching component, it can be predicted that the user may also continue to trigger the data switching component, and thus, the multimedia data can be preloaded, etc., based on the intention of the triggering data switching component. The predicted multimedia data is determined through the prediction of the user behavior intention, and when the user client outputs the multimedia data of the current list which is not displayed in the list display area, the predicted multimedia data is probably output, so that the accuracy of preloading the multimedia data is improved.

Referring to fig. 9, fig. 9 is a schematic flowchart illustrating a multimedia data processing method according to one or more embodiments of the present disclosure. As shown in fig. 9, the process includes the steps of:

step S901 obtains a user operation for the multimedia application, and obtains predicted multimedia data corresponding to the user operation based on the user operation.

In one or more embodiments, a user client may obtain a user operation for a multimedia application, perform a prediction based on the user operation, determine a user behavior intention, and obtain predicted multimedia data corresponding to the user behavior intention. The process may refer to the specific description shown in step S301 in fig. 3, and is not described herein again.

Step S902, detecting whether the predicted multimedia data is in the data buffer.

Step S903, determining the first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list.

In one or more embodiments, the user client may obtain the data identifier of the predicted multimedia data, search the data identifier of the predicted multimedia data from the K identifier lists, and determine a first identifier list corresponding to the data identifier of the predicted multimedia data as a target preloaded identifier list, where the first identifier list belongs to the K identifier lists. In one or more embodiments, the user client may obtain a total number of multimedia data in a multimedia data set and a maximum display number of display tags that can be displayed in a list display area, where the multimedia data set includes at least one multimedia data, the total number of multimedia data in the multimedia data set is H, and the display tags are generated according to data display information of the corresponding multimedia data. And dividing data identifications corresponding to the multimedia data in the multimedia data set into K identification lists according to the total number of the multimedia data and the maximum display number of the display labels, wherein K is a positive integer. For example, 100 songs are included in the multimedia data set, i.e., H is 100, the maximum display number of display tags that can be displayed in the list display area is 20, the user client may divide the data identifiers corresponding to the multimedia data in the multimedia data set into 5 identifier lists based on the total number of the multimedia data and the maximum display number of the display tags, that is, K at this time is 5, and the 5 identification lists are respectively an identification list composed of data identifications corresponding to the first song to the 20 th song, an identification list composed of data identifications corresponding to the 21 st song to the 40 th song, an identification list composed of data identifications corresponding to the 41 th song to the 60 th song, an identification list composed of data identifications corresponding to the 61 st song to the 80 th song, and an identification list composed of data identifications corresponding to the 81 th song to the 100 th song. Assuming that the user client determines that the predicted multimedia data is a 23 rd song, the user client may obtain a first identifier list corresponding to the 23 rd song, that is, an identifier list composed of data identifiers corresponding to the 21 st song to the 40 th song, and determine the first identifier list as a target preloaded identifier list.

Step S904, performing preloading processing on N target multimedia data corresponding to the target preloading identity list.

In one or more embodiments, the user client may obtain, from the server, N pieces of target multimedia data corresponding to the target preloading identifier list, perform preloading processing on the N pieces of target multimedia data, and add the N pieces of target multimedia data to the data cache, which is specifically described in step S302 in fig. 3 and is not described herein again.

Step S905 acquires N target multimedia data and the identifier distribution states of M display multimedia data in the current list displayed in the list display area.

In one or more embodiments, the user client may obtain an identifier distribution state between data identifiers corresponding to N target multimedia data and data identifiers corresponding to M display multimedia data in a current list displayed in the list display area, and if the identifier distribution state is an identifier discontinuous state, execute step S906, and determine the current list as a first update list; if the flag distribution status is the flag continuation status, step S907 is executed.

Step S906, the current list is taken as a first updated list.

In one or more embodiments, the user client may determine the current list as the first updated list, performing step S908.

Step S907 adds the list of N target multimedia data to the current list, generating a first updated list.

In one or more embodiments, the user client may detect whether the N target multimedia data are displayed in the current list, obtain data display information corresponding to the N target multimedia data, respectively, if the N target multimedia data are not displayed in the current list, and generate display tags corresponding to the N target multimedia data, respectively, based on the data display information corresponding to the N target multimedia data, respectively; and adding the display labels corresponding to the N target multimedia data into the current list to obtain a first updating list. Specifically, see step S303 in fig. 3.

In step S908, the first update list is displayed in the list display area.

In one or more embodiments, the user client can display the first updated list in the list display area.

In one or more embodiments, the user client may further obtain, in response to a display trigger operation for the first multimedia data corresponding to the first data identifier, a second data identifier associated with the first data identifier; and according to the list corresponding to the second multimedia data, updating the current list displayed in the list display area to obtain a third updated list, and displaying the third updated list in the list display area. In one or more embodiments, the amount of the first multimedia data is less than or equal to the maximum number of displays of the display tag. The process is used for pre-loading the multimedia data based on the identification association relationship, namely, the user client responds to the trigger operation aiming at the first multimedia data corresponding to the first data identification, and acquires the second data identification associated with the first data identification based on the identification association relationship. Optionally, after obtaining the second data identifier associated with the first data identifier, the user client may detect whether multimedia data corresponding to the second data identifier exists in the data cache, and if multimedia data corresponding to the second data identifier does not exist in the data cache, execute the step of obtaining the second identifier list corresponding to the second data identifier.

In one or more embodiments, the identification association may be determined based on historical play data. For example, if the number of "5 th multimedia data" > 13 th multimedia data "included in the history playing data is greater than the identifier association threshold, that is, the number of times that the 13 th multimedia data is output by the user client after the 5 th multimedia data is output is greater than the identifier association threshold, it indicates that the probability that the next output multimedia data is the 13 th multimedia data is very high when the 5 th multimedia data is output by the user, and the identifier association relationship of" 5 th multimedia data "> 13 th multimedia data" may be established. The user client responds to the triggering operation aiming at the 5 th multimedia data (namely the first multimedia data) corresponding to the first data identification, acquires a second data identification '13' associated with the first data identification of the 5 th multimedia data, and carries out preloading processing on the multimedia data based on the second data identification. Alternatively, the identification association relationship may be determined based on a default association relationship, for example, for at least two multimedia data, if the last multimedia data of the 1 st multimedia data is the last multimedia data and the next multimedia data of the last multimedia data is the 1 st multimedia data, the identification association relationship of "the 1 st multimedia data- > the last multimedia data" and "the last multimedia data- > the 1 st multimedia data" may be established. Alternatively, the identification association relationship may be determined based on the historical playing data and a default association relationship, which is not limited herein.

In one or more embodiments, a user client may add N target multimedia data to a data cache, count the number of caches of the cached multimedia data included in the data cache, and if the number of caches is the same as the total number of the multimedia data, indicate that the user client has already loaded at least two multimedia data, the user client may obtain a cache data identifier of the cached multimedia data, and perform sorting processing on the cached multimedia data based on the cache data identifier of the cached multimedia data to obtain sorted cached multimedia data; and generating a fifth updating list according to the display tag corresponding to the sorted cached multimedia data, and displaying the fifth updating list in the list display area.

In one or more embodiments, the process of preloading multimedia data may be as shown in fig. 10 to 15b, and fig. 10 to 15b respectively describe an interactive process of preloading multimedia data under different scenes, where in fig. 10 to 15b, an example is illustrated where a multimedia data set includes 100 multimedia data, that is, H is 100, and a maximum display number of display tags that can be displayed in a list display area is 20, that is, in one or more embodiments of the present application, multimedia data in the multimedia data set is divided based on the maximum display number "20" of the display tags to obtain 5 data groups, which are respectively a first data group "1 st multimedia data to 20 th multimedia data", a second data group "21 st multimedia data to 40 th multimedia data", a third data group "41 st multimedia data to 60 th multimedia data ″ The fourth data set "61 st multimedia data to 80 th multimedia data" and the fifth data set "81 st multimedia data to 100 th multimedia data".

As shown in fig. 10, fig. 10 is a flowchart of an initial loading scenario interaction provided by one or more embodiments of the present application, where the process includes the following steps:

in step S1001, the user client requests a first data group from the server.

In one or more embodiments, the user client displays a default loading page of the multimedia application in response to a trigger operation for the multimedia application, and sends an acquisition request for the first data group to the server.

Step S1002, the server returns the first data group to the user client.

In one or more embodiments, the server sends, to the user client, a data response message based on the acquisition request for the first data group, where the data response message includes multimedia data included in the first data group, that is, the 1 st multimedia data to the 20 th multimedia data, and optionally, the data response message may further include, but is not limited to, a general information description of at least two multimedia data, a total number of multimedia data, description information of the first data group, and the like. For example, if the multimedia data is a song in an album, the data response message may include the total number of multimedia data (i.e., the number of songs) in the album, the description of the total information (i.e., the album information), and the description information of the first data set.

Step S1003, the user client adds the first data group to the data cache.

In one or more embodiments, the user client adds the multimedia data in the first data group to the data cache, where the cached multimedia data stored in the data cache is the 1 st multimedia data to the 20 th multimedia data, and the 1 st multimedia data to the 20 th multimedia data may be stored in a list form.

Step S1004, the user client invokes the user interface function, and sends a display data update instruction to the user interface function.

In one or more embodiments, a User client invokes a User Interface (UI) function and sends a display data update request to the UI function.

In step S1005, the first data group is obtained from the data cache based on the user interface function.

In one or more embodiments, the first data set is retrieved from the data cache based on a user interface function.

In step S1006, the data cache returns the first data set to the user interface function.

Step S1007, a display tab of the first data group is displayed based on the user interface function.

In one or more embodiments, the display tags of the multimedia data included in the first data group, such as the display tag of the 1 st multimedia data to the display tag of the 20 th multimedia data, are displayed in the list display area based on the user interface function, i.e., the current interface display "1- >2 … - > 20", and the number in the current interface display represents the display tag of the corresponding multimedia data.

In one or more embodiments, the user client responds to a trigger operation for the multimedia application, displays a default loading page of the multimedia application, acquires application start loading data, acquires a data group where the application start loading data is located, and loads, stores and displays the data group where the application start loading data is located. The application start loading data may be multimedia data that is being output by the user client when the multimedia application is closed last time, and if the multimedia data that is being output by the user client when the multimedia application is closed is the 4 th multimedia data after the user client starts the multimedia application for the 5 th time, the user client determines that the application start loading data is the 4 th multimedia data when the user client starts the multimedia application for the 6 th time; alternatively, the application launch load data may be default load data.

As shown in fig. 11, fig. 11 is a flowchart of a data operation scenario interaction provided in one or more embodiments of the present application, where the process includes the following steps:

in step S1101, the user triggers the 1 st multimedia data.

Step S1102, the user client outputs the 1 st multimedia data.

In one or more embodiments, the user client may output the 1 st multimedia data, specifically, the user client may run the 1 st multimedia data, display a data name of the 1 st multimedia data, and the like, for example, if the 1 st multimedia data is a song, the user client may play the 1 st multimedia data, and display an album icon of an album where the 1 st multimedia data is located, a song name of the 1 st multimedia data, singing singer information, and the like.

In step S1103, the user client triggers a preloading procedure.

In one or more embodiments, the user client triggers the preloading procedure to obtain the second data identifier associated with the 1 st multimedia data, and may determine that the second data identifier is H, that is, the data identifier of the last multimedia data of the at least two multimedia data, where H is 100 in this embodiment of the present application. The user client pre-loads the first multimedia data corresponding to the second identifier list based on the second identifier list corresponding to the second data identifier, where in this example, the second identifier list is the last identifier list, that is, corresponds to the last data group.

In step S1104, the user client requests the last data group from the server.

Step S1105, the server returns the last data set to the user client.

In one or more embodiments, the server returns multimedia data included in the last data group, such as 81 th multimedia data to 100 th multimedia data, to the user client.

In step S1106, the user client adds the last data group to the data cache.

In one or more embodiments, the user client adds the last data group to the data cache, wherein if the steps in fig. 11 are implemented on the basis of fig. 10, at this time, the cached multimedia data stored in the data cache is from 81 st multimedia data to 100 th multimedia data and from 1 st multimedia data to 20 th multimedia data, and the current list structure in the data cache is "81- > 100- > 1- >2. - > 20", where the number represents the corresponding multimedia data.

As shown in fig. 12a, fig. 12a is a schematic diagram of a component switching scenario provided in one or more embodiments of the present application. As shown in fig. 12a, on the basis of fig. 11, the user client currently outputs the 1 st multimedia data (which may also be written as the first multimedia data), the current list structure in the data cache is "81- > - > 100- > 1- > 2- > 20", and the current interface obtained by the user client based on the user interface function is displayed as "1- > 2- > 20". At this time, the process includes the steps of:

in step S1201, the user triggers the first data switching component.

In one or more embodiments, the user client currently outputs the 1 st multimedia data, when the user triggers the first data switching component, the first data switching component refers to a component that switches to the last multimedia data of the currently output multimedia data, the user client switches the output 1 st multimedia data to the last multimedia data of the 1 st multimedia data in response to the triggering operation for the first data switching component, where the last multimedia data of the 1 st multimedia data is the last multimedia data, that is, the user client outputs the last multimedia data. For example, the multimedia data is songs, and the user client closes the first song to be played and plays the last song from the album.

In step S1202, the user client sends a display data update instruction to the user interface function.

In one or more embodiments, the user client sends a display data update instruction to the user interface function, the display data update instruction being indicative of the user interface function updating the current list displayed in the list display area. Wherein, the last multimedia data of the 1 st multimedia data is the last multimedia data, and the display data update instruction is used for instructing the user interface function to output the data group where the last multimedia data is located in the list display area, namely the last data group.

In step S1203, the last data group is obtained from the data cache based on the user interface function.

In step S1204, the data cache sends the last data group to the user interface function.

In step S1205, the display tab of the first data group is deleted based on the user interface function, and the display tab of the last data group is displayed.

In one or more embodiments, the display tags of the multimedia data in the first data group displayed in the list display area are deleted based on the user interface function, and the display tags of the multimedia data in the last data group are output, including the display tag of the 81 th multimedia data to the display tag of the 100 th multimedia data, at this time, the current interface of the list display area is displayed as "81- > - > 100".

In one or more embodiments, please refer to fig. 12b, and fig. 12b is a schematic diagram of another component switching scenario provided in one or more embodiments of the present application. As shown in fig. 12b, on the basis of fig. 12a, the user client currently outputs the last multimedia data, the current list structure in the data buffer is "81- > - > 100- > 1- > 2- > 20", and the current interface obtained by the user client based on the user interface function is displayed as "81- > 100". At this time, the process includes the steps of:

in step S1206, the user triggers the second data switching component.

In one or more embodiments, the user client currently outputs the last multimedia data, when the user triggers the second data switching component, the second data switching component is a component for switching to the next multimedia data of the currently output multimedia data, the user client switches the output last multimedia data to the next multimedia data of the last multimedia data in response to the triggering operation for the second data switching component, and the next multimedia data of the last multimedia data is the 1 st multimedia data, that is, the user client outputs the 1 st multimedia data. For example, the multimedia data is songs, and the user client closes the last song to be played and plays the first song from the album.

Step S1207, the user client sends a display data update instruction to the user interface function.

In one or more embodiments, the user client sends a display data update instruction to the user interface function, the display data update instruction being indicative of the user interface function updating the current list displayed in the list display area. Wherein, the next multimedia data of the last multimedia data is the 1 st multimedia data, and the display data update instruction is used for instructing the user interface function to output the data group where the 1 st multimedia data is located in the list display area, namely the first data group.

In step S1208, a first data set is obtained from the data cache based on the user interface function.

Step S1209, the data cache sends the first data set to the user interface function.

In step S1210, the display tag of the last data group is deleted based on the user interface function, and the display tag of the first data group is displayed.

In one or more embodiments, the display tags of the multimedia data in the last data group displayed in the list display area are deleted based on the user interface function, and the display tags of the multimedia data in the first data group are displayed, including the display tag of the 1 st multimedia data to the display tag of the 20 th multimedia data, at this time, the current interface of the list display area is displayed as "1- > 2- > 20".

As shown in fig. 13, fig. 13 is a schematic view of a sliding scene interaction flow provided in one or more embodiments of the present application. As shown in fig. 13, assuming the current list structure in the data cache is "1- > 2- > 20", the current interface resulting from the user client based on the user interface functionality is displayed as "1- > 2- > 20". At this time, the process includes the steps of:

in step S1301, the user slides to the list boundary.

In one or more embodiments, the user may obtain, for a sliding operation of a current list displayed in a list display area of the multimedia application, a sliding-stop position where the current list stops after sliding based on the sliding operation, and if the sliding-stop position is located at a list boundary of the current list, the user client may predict, based on the sliding operation, that the user behavior intention is a list update intention, obtain predicted multimedia data corresponding to the list update intention, where the predicted multimedia data is adjacent to multimedia data located at the list boundary, and perform step S1302.

In step S1302, the user client determines a target preloading identity list corresponding to the predicted multimedia data.

In one or more embodiments, the user client may determine a first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list, where the target preloaded identifier list corresponds to a target data set.

Step S1303, the user client requests the server for N target multimedia data corresponding to the target preloading identifier list.

In step S1304, the server returns N pieces of target multimedia data to the user client.

The above steps S1301 to S1304 may refer to the detailed description shown in step S301 in fig. 3, and specifically refer to fig. 4 and fig. 5, which are not described again here.

In step S1305, the user client adds N target multimedia data to the data cache.

In one or more embodiments, the user client may add N pieces of target multimedia data to the data cache, and implement preloading of the N pieces of target multimedia data, so as to obtain N pieces of target multimedia data. Wherein, assuming that the slide-stop position is located at the lower border of the current list, the predicted multimedia data can be determined as the next multimedia data of the border multimedia data located at the end of the list of the current list. For the example shown in fig. 13, the predicted multimedia data is the 21 st multimedia data, the user client acquires N target multimedia data in a target data group where the 21 st multimedia data is located, including the 21 st multimedia data to the 40 th multimedia data, and adds the N target multimedia data to a data cache, where a current list structure in the data cache is "1- > 2- > 20- > 21- > 40".

In step S1306, the user client sends a display data update instruction to the user interface function.

In one or more embodiments, the user client sends a display data update instruction to the user interface function, and the user client obtains an identifier distribution state between data identifiers of N target multimedia data and data identifiers of M display multimedia data in a current list displayed in the list display area, where the identifier distribution state is an identifier continuous state.

In step S1307, the target data set is obtained from the data cache based on the user interface function.

In one or more embodiments, since the identification distribution state is the identification continuous state, the N target multimedia data included in the target data group are obtained from the data cache based on the user interface function.

Step S1308, the data cache sends the target data group to the user interface function.

In step S1309, a display tab of the target data group is displayed based on the user interface function.

In one or more embodiments, display tags corresponding to N pieces of target multimedia data are added to a current list based on a user interface function to obtain a first update list, and the first update list is displayed in a list display area, where the first update list includes display tags corresponding to the N pieces of target multimedia data, and display tags corresponding to M pieces of display multimedia data displayed in the current list before update. At this point, the current interface is shown as "1- > 2- > 20- > 21- > 40".

As shown in fig. 14, fig. 14 is a schematic diagram of a random output scene provided in one or more embodiments of the present application. As shown in fig. 14, assuming that the user client currently outputs the 1 st multimedia data, the current list structure in the data cache is "1- > 2- > 20- > 21- > 40", and the current interface resulting from the user client based on the user interface function is displayed as "1- > 2- > 20- > 21- > 40". At this time, the process includes the steps of:

in step S1401, the user triggers a random output mode.

In one or more embodiments, the random output mode refers to a mode of randomly outputting the multimedia data of the current list displayed in the list display area, and the random output mode is a data display mode.

In step S1402, the user client determines a third identification list.

In one or more embodiments, the user client may obtain a random switching function corresponding to the data display manner, predict third multimedia data (that is, the 1 st multimedia data currently output by the user client) based on the random switching function, determine a third data identifier associated with the third multimedia data, and obtain a third identifier list corresponding to the third data identifier.

Step S1403, the user client requests the server for a third data group corresponding to the third identifier list.

In step S1404, the server returns the third data group corresponding to the third identifier list to the user client.

Step S1405, the user client adds the third data group to the data cache.

In one or more embodiments, assuming that the third data is identified as 63, the third data set includes 61 st multimedia data to 80 th multimedia data, and the 61 st multimedia data to 80 th multimedia data are added to a data buffer, at which time, the current list structure in the data buffer is "1- > 2- > 20- > 21- > 40- > 61- > 80".

In step S1406, the user triggers the second data switching component.

In one or more embodiments, the second data switching component refers to a component that switches to the next multimedia data of the currently output multimedia data. The user client responds to the triggering operation aiming at the second data switching component, and acquires the multimedia data triggered by the triggering operation aiming at the second data switching component.

Step S1407, the user client sends a display data update instruction to the user interface function.

In one or more embodiments, the display data update instruction includes a third data group where the third data identifier is located, and the display data update instruction is used to instruct the user interface function to update the current list displayed in the list display area to a list corresponding to the third data group.

In step S1408, the third data group is obtained from the data cache based on the user interface function.

Step S1409, the data cache sends the third data set to the user interface function.

Step S1410, a display tab of the third data group is displayed based on the user interface function.

In one or more embodiments, the display tags of the multimedia data in the third data set are displayed based on the user interface function, for example, at this time, since the identification distribution state of the current list "1- > 2- > 20- > 21- > 40" displayed in the list display area is the identification discontinuity state with the third data set "61- > 80", the current interface of the list display area is displayed as "61- > 80". Wherein, the current list "1- > 2- > 20- > 21- > 40" means that the current list displayed in the list display area includes display labels corresponding to the 1 st multimedia data to the 40 th multimedia data respectively; the third data set "61. - > 80" means that the third data set includes 61 st multimedia data to 80 th multimedia data.

As shown in fig. 15a to 15b, fig. 15a to 15b are flowcharts illustrating a conventional playback scene interaction according to one or more embodiments of the present application. Assuming the current list structure in this data cache is "1- > 2- > 20", the current interface resulting from the user client based on the user interface functionality is displayed as "1- > 2- > 20". As shown in fig. 15a, the process includes:

in step S1501, the user triggers the 1 st multimedia data.

In step S1502, the user ue outputs the 1 st multimedia data.

In step S1503, the user client triggers a preloading procedure.

In step S1504, the user client requests the last data group from the server.

In step S1505, the server returns the last data group to the user client.

In step S1506, the user client adds the last data group to the data cache.

In one or more embodiments, at this time, the buffered multimedia data stored in the data buffer is from 81 th multimedia data to 100 th multimedia data and from 1 st multimedia data to 20 th multimedia data, and the current list structure in the data buffer is "81- > - > 100- > 1- > 2- > 20", where the numbers represent the corresponding multimedia data; the current interface of the list display area is displayed as "1- > 2- > 20".

For each step in fig. 15a, reference may be made to the detailed description shown in fig. 11, which is not repeated herein.

As shown in fig. 15b, on the basis of fig. 15a, the process further includes:

in step S1507, the user client automatically triggers the second multimedia data.

In one or more embodiments, taking the data display mode as an example of a sequential output mode, when the first multimedia data is completely output, the user client automatically triggers the second multimedia data, i.e., displays the second multimedia data. Similarly, the user client sequentially outputs the current list in the list display area until the 19 th multimedia data output is completed (i.e. the multimedia data located at the second last position of the current list is completely output), and then step S1508 is executed.

In step S1508, the user client automatically triggers the 20 th multimedia data.

In one or more embodiments, the user client automatically triggers the 20 th multimedia data, i.e., outputs the 20 th multimedia data. Here, since the 20 th multimedia data is the boundary multimedia data located at the end of the list of the current list, step S1509 is performed.

In step S1509, the user client triggers a preloading procedure.

In one or more embodiments, the user client triggers the preloading procedure, which may be shown in step S301 in fig. 3, or may be shown in fig. 7, and is not described herein again. In the embodiment of fig. 15a to 15b, the identifier list corresponding to the predicted multimedia data is a second identifier list, and the predicted multimedia data belongs to a second data group.

In step S1510, the user client requests a second data set from the server.

Step S1511, the server returns the second data set to the user client.

In step S1512, the user client adds the second data set to the data cache.

In one or more embodiments, the user client adds the second data set to the data cache, i.e., 21 st multimedia data to 40 th multimedia data to the data cache, at which time the current list structure of the data cache is "81- > 100- > 1- > 2- > 20- > 21- > 40".

Step S1513, the user client sends a display data update instruction to the user interface function.

In step S1514, a second data set is retrieved from the data cache based on the user interface function.

Step S1515, the data cache sends the second data set to the user interface function.

Step S1516, displaying the display label of the second data group based on the user interface function.

In one or more embodiments, the current list displayed in the list display area is "1- > 2- > 20", the second data group includes 21 st multimedia data to 40 th multimedia data, and it may be determined that the distribution status of the identifiers of the multimedia data in the current list in the list display area and the multimedia data in the second data group is an identifier continuous status, then display tags corresponding to the 21 st multimedia data to the 40 th multimedia data, respectively, are added to the current list, and the updated current list is output in the list display area, at this time, the current interface of the list display area is displayed as "1- > 2- > 20- > 21- > 40", which represents the display tags corresponding to the 1 st multimedia data to the 40 th multimedia data, respectively.

In one or more embodiments, when the total number of the multimedia data of the at least two multimedia data and the maximum display number of the display tags are other values, referring to fig. 10 to 15b, the loading and outputting of the multimedia data may be implemented.

Referring to fig. 16, fig. 16 is a schematic diagram of a multimedia data processing apparatus according to one or more embodiments of the present application. The multimedia data processing apparatus may be a computer program (including program code, etc.) running in a computer device, for example, the multimedia data processing apparatus may be an application software; the apparatus may be configured to perform the corresponding steps in the methods provided by one or more embodiments of the present application. As shown in fig. 16, the multimediadata processing apparatus 1600 may be used in the user client in the embodiment corresponding to fig. 3, and specifically, the apparatus may include: the system comprises anoperation acquisition module 11, abehavior prediction module 12, a firstdata loading module 13 and a firstlist updating module 14.

Anoperation obtaining module 11, configured to obtain a user operation;

thebehavior prediction module 12 is configured to determine, based on a user operation, predicted multimedia data corresponding to the user operation, and determine a first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise predicted multimedia data, and N is a positive integer;

the firstdata loading module 13 is configured to perform preloading processing on the N target multimedia data;

the firstlist updating module 14 is configured to update the current list displayed in the list display area according to the lists corresponding to the N target multimedia data to obtain a first updated list, and display the first updated list in the list display area.

In one or more embodiments, in determining predicted multimedia data corresponding to a user operation based on the user operation, thebehavior prediction module 12 includes:

anoperation parsing unit 121 configured to parse a user operation, where the user operation is an operation for a multimedia application;

a sliding obtainingunit 122, configured to, if the user operation is a sliding operation for a current list in the multimedia application, obtain a sliding stop position where the current list stops after sliding based on the sliding operation;

and adata prediction unit 123, configured to, when the slide stop position is located at the list boundary of the current list, use multimedia data that is not displayed in the current list and is adjacent to the multimedia data located at the list boundary as predicted multimedia data corresponding to the user operation.

theoperation parsing unit 121 is further configured to parse a user operation, where the user operation is an operation for a multimedia application;

acomponent triggering unit 124, configured to determine a historical triggering operation for a data switching component and a triggering number of the historical triggering operation within a statistical time period if a user operation is a triggering operation for the data switching component in a multimedia application;

thedata prediction unit 123 is further configured to, when the number of triggering times is greater than or equal to the continuous triggering threshold, take the multimedia data corresponding to the next triggering operation of the data switching component as the predicted multimedia data corresponding to the user operation.

and adata triggering unit 125, configured to, if the user operation is a triggering operation for boundary multimedia data located at the head of the list or at the end of the list of the current list in the multimedia application, use multimedia data that is not displayed in the current list and is adjacent to the boundary multimedia data as predicted multimedia data corresponding to the user operation.

themodel prediction unit 126 is used for inputting the user operation into an intention prediction model, predicting the user operation based on the intention prediction model and obtaining a user behavior intention, wherein the user operation is an operation aiming at the multimedia application;

and abehavior prediction unit 127, configured to obtain data prediction switching behaviors corresponding to the user behavior intentions, and determine predicted multimedia data corresponding to the user behavior intentions based on the current list and the data prediction switching behaviors.

In one or more embodiments, theapparatus 1600 further comprises:

thesample acquisition module 15 is configured to acquire at least two historical user operations and historical user behavior intents respectively associated with each historical user operation; the at least two historical user operations comprise a historical user operation i; the historical user operation i comprises a historical behavior track i and an operation time interval i, wherein i is a positive integer;

thesample prediction module 16 is configured to predict the historical behavior trajectory i and the operation time interval i based on the initial intention prediction model, and obtain an intention label and an intention prediction probability corresponding to the intention label;

themodel training module 17 is configured to generate a loss function according to the historical user behavior intention associated with the historical user operation i and the intention prediction probability corresponding to the intention label, and perform parameter adjustment on the initial intention prediction model based on the loss function;

and amodel generation module 18, configured to determine the parameter-adjusted initial intent prediction model as the intent prediction model when the model parameters of the parameter-adjusted initial intent prediction model converge.

In one or more embodiments, theapparatus 1600 further comprises:

acache obtaining module 19, configured to obtain cache multimedia data stored in the data cache, and if the cache multimedia data does not include predicted multimedia data, perform a step of determining a first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list;

the secondlist updating module 20 is further configured to update the current list displayed in the list display area based on the predicted multimedia data to generate a second updated list if the cached multimedia data includes the predicted multimedia data, and display the second updated list in the list display area.

In one or more embodiments, theapparatus 1600 further comprises:

aquantity obtaining module 21, configured to obtain a total number of multimedia data in a multimedia data set and a maximum display number of display tags that can be displayed in a list display area, where the multimedia data set includes at least one piece of multimedia data, and the display tags are generated according to data display information of the corresponding piece of multimedia data;

thelist dividing module 22 is configured to divide the data identifiers corresponding to the multimedia data in the multimedia data set into K identifier lists according to the total number of the multimedia data and the maximum display number of the display tags; k is a positive integer;

in terms of determining the first identifier list corresponding to the predicted multimedia data as the target preloaded identifier list, thebehavior prediction module 12 is specifically configured to:

In one or more embodiments, the current list includes display tags corresponding to M display multimedia data, respectively; m is a positive integer;

in terms of updating the current list displayed in the list display area according to the N lists of target multimedia data to obtain a first updated list, the firstlist updating module 14 includes:

arelation obtaining unit 141, configured to obtain identifier distribution states between data identifiers of N target multimedia data and data identifiers of M display multimedia data in a current list displayed in the list display area;

alist determining unit 142, configured to determine the current list as a first updated list if the identifier distribution state is an identifier discontinuous state;

atag generating unit 143, configured to generate target display tags corresponding to N target multimedia data, based on data display information corresponding to the N target multimedia data, if the identifier distribution state is an identifier continuous state and the current list does not include display tags of the N target multimedia data;

thelist generating unit 144 is configured to add target display tags corresponding to the N target multimedia data to the current list, so as to obtain a first updated list.

In one or more embodiments, theapparatus 1600 further comprises:

atrigger response module 23, configured to respond to a display trigger operation for first multimedia data corresponding to the first data identifier, and acquire a second data identifier associated with the first data identifier;

an identifierlist determining module 24, configured to determine a second identifier list corresponding to the obtained second data identifier as a first preloaded identifier list;

the seconddata loading module 25 is configured to perform preloading processing on second multimedia data corresponding to the first preloading identifier list, and add the second multimedia data obtained through the preloading processing to the data cache;

and a thirdlist updating module 26, configured to update the current list displayed in the list display area according to the list corresponding to the second multimedia data, so as to obtain a third updated list, and display the third updated list in the list display area.

In one or more embodiments, the apparatus further comprises:

afunction obtaining module 27, configured to respond to a display trigger operation for the third multimedia data in the first update list, obtain a data display mode of the multimedia application, and obtain a random switching function corresponding to the data display mode;

afunction predicting module 28, configured to predict third multimedia data based on a random switching function, and determine a third data identifier associated with the third multimedia data;

the identifierlist determining module 24 is further configured to determine a third identifier list corresponding to the third data identifier as a second preloaded identifier list;

the thirddata loading module 29 is configured to perform preloading processing on fourth multimedia data corresponding to the second preloading identifier list, and add the fourth multimedia data obtained through the preloading processing to the data cache;

the fourthlist updating module 30 is configured to update the current list displayed in the list display area according to the list corresponding to the fourth multimedia data to obtain a fourth updated list, and display the fourth updated list in the list display area.

In one or more embodiments, theapparatus 1600 further comprises:

thedata caching module 31 is configured to add N pieces of target multimedia data to a data cache, count the number of caches of the cached multimedia data included in the data cache, and if the number of caches is the same as the total number of the multimedia data, sort the cached multimedia data based on the cached data identifier of the cached multimedia data to obtain sorted cached multimedia data;

and a fifthlist updating module 32, configured to generate a fifth updated list according to the display tag corresponding to the sorted cached multimedia data, and display the fifth updated list in the list display area.

In one or more embodiments, the user operation is an operation for a multimedia application; theapparatus 1600 further comprises:

astructure restructuring module 33, configured to obtain data identifiers corresponding to at least two pieces of multimedia data, and perform structure restructuring on association structures between the data identifiers corresponding to the at least two pieces of multimedia data, to generate an identifier circular list;

in determining predicted multimedia data corresponding to a user operation based on the user operation, thebehavior prediction module 12 includes:

alocation obtaining unit 128, configured to obtain, based on a user operation, a trigger data identifier of multimedia data triggered by the multimedia application, and obtain identifier location information of the trigger data identifier in the identifier circular list;

and aposition determining unit 129, configured to determine target position information based on the user operation and the identification position information, and determine multimedia data corresponding to the data identification located at the target position information in the identification circular list as predicted multimedia data corresponding to the user operation.

One or more embodiments of the present application provide a multimedia data processing apparatus, which may be run in a user client, obtain a user operation, determine, based on the user operation, predicted multimedia data corresponding to the user operation, and determine a first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise predicted multimedia data, and N is a positive integer; the method comprises the steps of conducting pre-loading processing on N target multimedia data, updating a current list displayed in a list display area according to a list corresponding to the N target multimedia data to obtain a first updated list, and displaying the first updated list in the list display area. Through the process, the user client can predict the behavior operation which is possibly triggered by the user aiming at the multimedia application in the follow-up process based on the user operation generated by the user, and the computer equipment can pre-load the N target multimedia data including the predicted multimedia data based on the user operation, so that the computer equipment can directly acquire the triggered multimedia data when any one multimedia data in the N target multimedia data is triggered, the time consumed during the switching of the multimedia data is reduced, and the multimedia data loading efficiency is improved.

Referring to fig. 17, fig. 17 is a schematic structural diagram of a computer device according to one or more embodiments of the present application. As shown in fig. 17, the computer device in the embodiment of the present application may include: one ormore processors 1701, amemory 1702, and an input-output interface 1703. Theprocessor 1701, thememory 1702, and the input/output interface 1703 are connected by abus 1704. Thememory 1702 is used for storing a computer program, which includes program instructions, and the input/output interface 1703 is used for receiving data and outputting data, for example, for data interaction between the user client and the server, or for data interaction between modules of the user client; theprocessor 1701 is used to execute program instructions stored in thememory 1702.

Theprocessor 1701 may perform the following operations:

acquiring user operation;

In one or more embodiments, theprocessor 1701 may be a Central Processing Unit (CPU), or other general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

Thememory 1702 may include both read-only memory and random-access memory, and provides instructions and data to theprocessor 1701 and the input/output interface 1703. A portion of thememory 1702 may also include non-volatile random access memory. For example, thememory 1702 may also store device type information.

In one or more embodiments, the computer device may execute, through built-in functional modules thereof, the implementation manners provided in the steps in fig. 3 or fig. 9, which may specifically refer to the implementation manners provided in the steps in fig. 3 or fig. 9, and are not described herein again.

One or more embodiments of the present application provide a computer device, including: the system comprises a processor, an input/output interface and a memory, wherein the processor acquires a computer program in the memory, executes each step of the method shown in the figure 3 and carries out multimedia data processing operation. The method and the device for predicting the multimedia data have the advantages that the user operation is obtained, the predicted multimedia data corresponding to the user operation is determined based on the user operation, and the first identification list corresponding to the predicted multimedia data is determined as the target preloading identification list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise predicted multimedia data, and N is a positive integer; the method comprises the steps of conducting pre-loading processing on N target multimedia data, updating a current list displayed in a list display area according to a list corresponding to the N target multimedia data to obtain a first updated list, and displaying the first updated list in the list display area. Through the process, the user client can predict the behavior operation which is possibly triggered by the user aiming at the multimedia application in the follow-up process based on the user operation generated by the user, and the computer equipment can pre-load the N target multimedia data including the predicted multimedia data based on the user operation, so that the computer equipment can directly acquire the triggered multimedia data when any one multimedia data in the N target multimedia data is triggered, the time consumed during the switching of the multimedia data is reduced, and the multimedia data loading efficiency is improved.

One or more embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored, where the computer program is suitable for being loaded by the processor and executing the multimedia data processing method provided in each step in fig. 3, and for details, reference may be made to implementation manners provided in each step in fig. 3, and details are not repeated here. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in embodiments of the computer-readable storage medium referred to in the present application, reference is made to the description of embodiments of the method of the present application. By way of example, a computer program can be deployed to be executed on one computer device or on multiple computer devices at one site or distributed across multiple sites and interconnected by a communication network.

The computer readable storage medium may be the multimedia data processing apparatus provided in any of the foregoing embodiments or an internal storage unit of the computer device, such as a hard disk or a memory of the computer device. The computer readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Memory Card (SMC), a Secure Digital (SD) card, a flash card (flash card), and the like, provided on the computer device. Further, the computer-readable storage medium may also include both an internal storage unit and an external storage device of the computer device. The computer-readable storage medium is used for storing the computer program and other programs and data required by the computer device. The computer readable storage medium may also be used to temporarily store data that has been output or is to be output.

One or more embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, the processor executes the computer instructions, causing the computer device to perform the method provided in the various alternatives of fig. 3, enables prediction of a user's subsequent user behavior intent based on user actions generated by the user, the user behavior intention may represent a behavior operation that the user may subsequently trigger for the multimedia application, the computer device may pre-load N target multimedia data including the predicted multimedia data based on the user behavior intention, therefore, if any one of the N pieces of target multimedia data is triggered, the computer equipment can directly acquire the triggered multimedia data, the time consumed during multimedia data switching is reduced, and the multimedia data loading efficiency is improved.

The terms "first," "second," and the like in the description and claims and the drawings of one or more embodiments of the present application are used for distinguishing between different objects and not necessarily for describing a particular order, but rather for describing a particular order. Furthermore, the terms "comprises" and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or apparatus that comprises a list of steps or elements is not limited to the listed steps or modules, but may alternatively include other steps or modules not listed or inherent to such process, method, apparatus, product, or apparatus.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the specification for the purpose of clearly illustrating the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The method and the related apparatus provided by the embodiments of the present application are described with reference to the flowchart and/or the structural diagram of the method provided by the embodiments of the present application, and each flow and/or block of the flowchart and/or the structural diagram of the method, and the combination of the flow and/or block in the flowchart and/or the block diagram can be specifically implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block or blocks of the block diagram. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block or blocks of the block diagram. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block or blocks.

It should be noted that, for simplicity of description, the above-mentioned embodiments of the method are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the order of acts described, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.

The modules in the device can be merged, divided and deleted according to actual needs.

The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and is not to be construed as limiting the scope of the present application, so that the present application is not limited thereto, and all equivalent variations and modifications can be made to the present application.

Claims

1. A method of multimedia data processing, the method comprising:

acquiring user operation;

based on the user operation, determining predicted multimedia data corresponding to the user operation, and determining a first identifier list corresponding to the predicted multimedia data as a target preloading identifier list; the target preloading identification list corresponds to N target multimedia data, the N target multimedia data comprise the predicted multimedia data, and N is a positive integer;

and pre-loading the N target multimedia data, updating a current list displayed in a list display area according to a list corresponding to the N target multimedia data to obtain a first updated list, and displaying the first updated list in the list display area.

2. The method of claim 1, wherein the determining the predicted multimedia data corresponding to the user operation based on the user operation comprises:

analyzing the user operation, wherein the user operation is an operation for a multimedia application;

if the user operation is a sliding operation for the current list in the multimedia application, acquiring a sliding stop position where the current list stops after sliding based on the sliding operation;

and when the sliding stopping position is positioned at the list boundary of the current list, taking the multimedia data which is not displayed in the current list and is adjacent to the multimedia data positioned at the list boundary as the predicted multimedia data corresponding to the user operation.

3. The method of claim 1, wherein the determining the predicted multimedia data corresponding to the user operation based on the user operation comprises:

if the user operation is the trigger operation aiming at the data switching component in the multimedia application, determining the historical trigger operation aiming at the data switching component and the trigger times of the historical trigger operation in a statistical time period;

and when the triggering times are larger than or equal to the continuous triggering threshold, taking the multimedia data corresponding to the next triggering operation of the data switching component as the predicted multimedia data corresponding to the user operation.

4. The method of claim 1, wherein the determining the predicted multimedia data corresponding to the user operation based on the user operation comprises:

and if the user operation is a trigger operation aiming at boundary multimedia data at the head of the list or the tail of the list of the current list in the multimedia application, using the multimedia data which is not displayed in the current list and is adjacent to the boundary multimedia data as the predicted multimedia data corresponding to the user operation.

5. The method of claim 1, wherein the determining the predicted multimedia data corresponding to the user operation based on the user operation comprises:

inputting the user operation into an intention prediction model, predicting the user operation based on the intention prediction model to obtain a user behavior intention, wherein the user operation is an operation aiming at a multimedia application;

and acquiring data prediction switching behaviors corresponding to the user behavior intentions, and determining the predicted multimedia data corresponding to the user behavior intentions based on the current list and the data prediction switching behaviors.

6. The method of claim 5, wherein the method further comprises:

acquiring at least two historical user operations and historical user behavior intents respectively associated with each historical user operation; the at least two historical user operations comprise a historical user operation i; the historical user operation i comprises a historical behavior track i and an operation time interval i, wherein i is a positive integer;

predicting the historical behavior track i and the operation time interval i based on an initial intention prediction model to obtain an intention label and an intention prediction probability corresponding to the intention label;

generating a loss function according to the historical user behavior intention associated with the historical user operation i and the intention prediction probability corresponding to the intention label, and performing parameter adjustment on the initial intention prediction model based on the loss function;

and when the model parameters of the initial parameter-adjusted intention prediction model are converged, determining the initial parameter-adjusted intention prediction model as the intention prediction model.

7. The method of claim 1, wherein the method further comprises:

obtaining cache multimedia data stored in a data cache, and if the cache multimedia data does not include the predicted multimedia data, executing the step of determining a first identifier list corresponding to the predicted multimedia data as a target preloading identifier list;

if the cache multimedia data comprises the predicted multimedia data, updating the current list displayed in the list display area based on the predicted multimedia data to generate a second updated list, and displaying the second updated list in the list display area.

8. The method of claim 1, wherein the method further comprises:

acquiring the total number of multimedia data in a multimedia data set and the maximum display number of display labels which can be displayed in the list display area, wherein the multimedia data set comprises at least one piece of multimedia data, and the display labels are generated according to the data display information of the corresponding multimedia data;

dividing data identifications corresponding to the multimedia data in the multimedia data set into K identification lists according to the total number of the multimedia data and the maximum display number of the display labels; k is a positive integer;

the determining the first identifier list corresponding to the predicted multimedia data as a target preloaded identifier list includes:

acquiring data identifiers of the predicted multimedia data, searching the data identifiers of the predicted multimedia data from the K identifier lists, and determining a first identifier list corresponding to the data identifiers of the predicted multimedia data as a target preloading identifier list; the first identification list belongs to the K identification lists.

9. The method of claim 1, wherein the current list comprises M display tags respectively corresponding to the display multimedia data; m is a positive integer;

the updating the current list displayed in the list display area according to the list corresponding to the N target multimedia data to obtain a first updated list includes:

acquiring identifier distribution states between the data identifiers of the N target multimedia data and the data identifiers of the M display multimedia data in the current list displayed in the list display area;

if the identifier distribution state is an identifier discontinuous state, determining the current list as a first updating list;

if the identifier distribution state is an identifier continuous state and the current list does not contain the display tags of the N target multimedia data, generating target display tags respectively corresponding to the N target multimedia data based on data display information respectively corresponding to the N target multimedia data;

and adding target display labels respectively corresponding to the N target multimedia data into the current list to obtain the first updating list.

10. The method of claim 1, wherein the method further comprises:

responding to a display trigger operation aiming at first multimedia data corresponding to a first data identifier, and acquiring a second data identifier associated with the first data identifier;

determining a second identification list corresponding to the second data identification as a first preloading identification list;

and according to the list corresponding to the second multimedia data, updating the current list displayed in the list display area to obtain a third updated list, and displaying the third updated list in the list display area.

11. The method of claim 1, wherein the method further comprises:

responding to a display triggering operation aiming at third multimedia data in the first updating list, acquiring a data display mode of a multimedia application, and acquiring a random switching function corresponding to the data display mode;

predicting the third multimedia data based on the random switching function, and determining a third data identifier associated with the third multimedia data;

determining a third identification list corresponding to the third data identification as a second preloading identification list;

and according to the list corresponding to the fourth multimedia data, updating the current list displayed in the list display area to obtain a fourth updated list, and displaying the fourth updated list in the list display area.

12. The method of claim 1, wherein the method further comprises:

adding the N target multimedia data into a data cache, counting the cache number of the cache multimedia data in the data cache, and if the cache number is the same as the total number of the multimedia data, sequencing the cache multimedia data based on the cache data identification of the cache multimedia data to obtain the sequenced cache multimedia data;

and generating a fifth updating list according to the display tag corresponding to the sorted cached multimedia data, and displaying the fifth updating list in the list display area.

13. The method of claim 1, wherein the user operation is an operation for a multimedia application; the method further comprises the following steps:

acquiring data identifications corresponding to at least two multimedia data respectively, and performing structural reorganization on an association structure between the data identifications corresponding to the at least two multimedia data respectively to generate an identification circulation list;

the determining the predicted multimedia data corresponding to the user operation based on the user operation includes:

acquiring a trigger data identifier of multimedia data triggered by the multimedia application based on the user operation, and acquiring identifier position information of the trigger data identifier in the identifier circular list;

and determining target position information based on the user operation and the identification position information, and determining the multimedia data corresponding to the data identification positioned at the target position information in the identification circular list as the predicted multimedia data corresponding to the user operation.

14. A computer device comprising a processor, a memory, an input output interface;

the processor is connected to the memory and the input/output interface, respectively, wherein the input/output interface is configured to receive data and output data, the memory is configured to store a computer program, and the processor is configured to call the computer program to enable the computer device to perform the method according to any one of claims 1 to 13.

15. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any of claims 1-13.