CN112788374B

Movatterモバイル変換

Info

Publication number: CN112788374B
Application number: CN201911070599.5A
Authority: CN
Inventors: 程俊彰
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-11-05
Filing date: 2019-11-05
Publication date: 2023-02-28
Anticipated expiration: 2039-11-05
Also published as: CN112788374A

Abstract

The application provides an information processing method, an information processing device, information processing equipment and a storage medium, wherein the method comprises the following steps: receiving a playing request of target multimedia information sent by a first client, wherein the playing request carries first display attribute information of image information corresponding to the target multimedia information; acquiring audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information; and sending the audio information and the first target image information to the first client so that the first client can synchronously play the audio information and the first target image information. The method and the device have the advantages that the multiple image information with different display attribute information can share single audio information, the system burden caused by decoding performance overhead is reduced, the stealing broadcast cost is improved, and smooth broadcast and smooth switching of the front-end image information are ensured.

Description

Information processing method, device, equipment and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to an information processing method, apparatus, device, and storage medium.

Background

In the prior art, because the multimedia information needs to be re-sampled and transcoded in real time, the decoding performance overhead is large, and the system burden is increased; moreover, because the transmission capacity of multimedia information including complete image information and audio information is large, the defect that the front-end client cannot smoothly play or smoothly switch the multimedia information due to the influence of factors such as network transmission rate and the like exists; in addition, in the prior art, multimedia information containing complete image information and audio information can be simultaneously acquired during front-end playing, and the stealing playing cost is low.

Disclosure of Invention

In order to realize that a plurality of image information of different display attribute information share single audio information, thereby reducing decoding performance overhead, improving pirate cost, and ensuring smooth playing or smooth switching of front-end multimedia information, the application provides an information processing method, an information processing device, information processing equipment and a storage medium.

In one aspect, the present application provides an information processing method, including:

receiving a playing request of target multimedia information sent by a first client, wherein the playing request carries first display attribute information of image information corresponding to the target multimedia information;

acquiring audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information;

and sending the audio information and the first target image information to the first client so that the first client can synchronously play the audio information and the first target image information.

In another aspect, the present application provides an information processing method, including:

sending a playing request of target multimedia information to a server, wherein the playing request carries first display attribute information of image information corresponding to the target multimedia information;

receiving audio information of the target multimedia information and first target image information corresponding to the first display attribute information, wherein the audio information of the target multimedia information and the first target image information are obtained from an audio image file of the target multimedia information, and the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information;

and synchronously playing the audio information and the first target image information.

In another aspect, the present application provides an information processing apparatus, including:

the system comprises a playing request receiving module, a playing request receiving module and a playing request sending module, wherein the playing request receiving module is used for receiving a playing request of target multimedia information sent by a first client, and the playing request carries first display attribute information of image information corresponding to the target multimedia information;

the audio information and first target image information acquisition module is used for acquiring the audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information;

and the audio information and first target image information sending module is used for sending the audio information and the first target image information to the first client so that the first client can synchronously play the audio information and the first target image information.

In another aspect, the present application provides an information processing apparatus, the apparatus including:

the system comprises a playing request sending module, a playing request sending module and a playing module, wherein the playing request sending module is used for sending a playing request of target multimedia information to a server, and the playing request carries first display attribute information of image information corresponding to the target multimedia information;

an audio information and first target image information receiving module, configured to receive audio information of the target multimedia information and first target image information corresponding to the first display attribute information, where the audio information and first target image information are sent by the server and obtained from an audio image file of the target multimedia information, and the audio image file includes the audio information of the target multimedia information and multiple pieces of image information of different display attribute information;

and the synchronous playing module is used for synchronously playing the audio information and the first target image information.

In another aspect, the present application provides an apparatus comprising: a processor and a memory, said memory having stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by said processor to implement the information processing method as described above.

In another aspect, the present application proposes a computer-readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement the information processing method as described above.

According to the information processing method, the device, the equipment and the storage medium, audio information of target multimedia information and a plurality of image information of different display attribute information are stored in an audio image file of the target multimedia information, the audio information of the target multimedia information and image information corresponding to first display attribute information carried in a playing request are obtained according to the playing request of the target multimedia information sent by a first client, and then the obtained audio information and the image information corresponding to the first display attribute information are sent to the first client, so that the first client can synchronously play the audio information and the image information. The audio information of the target multimedia information and the image information of different display attribute information are stored in the audio image file of the server in advance, so that the audio information of the target multimedia information and the image information corresponding to a certain resolution ratio can be directly obtained from the audio image file when the server receives a target multimedia information playing request containing the resolution ratio, the decoding performance expense of the server is avoided, the system burden is effectively reduced, moreover, only the single audio information and the image information corresponding to the display attribute information carried in the playing request need to be obtained when the front end plays, the information transmission capacity is small, the network flow consumption is small, the influence of factors such as the network transmission rate is small, smooth playing or smooth switching of the front end multimedia information is ensured, in addition, the playing cost is high because the complete multimedia information of the video and the audio information cannot be simultaneously obtained during the front end playing, and the probability of stealing playing of the multimedia information is effectively reduced.

Drawings

In order to more clearly illustrate the technical solutions and advantages of the embodiments of the present application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is a schematic diagram of an implementation environment of an information processing method according to an embodiment of the present application.

Fig. 2 is a schematic flowchart of an information processing method according to an embodiment of the present application.

Fig. 3 is a logic block diagram that a server performs background storage on target multimedia information uploaded by a second client in a scenario according to an embodiment of the present application.

Fig. 4 is another schematic flow chart of an information processing method according to an embodiment of the present application.

Fig. 5 is a logic block diagram of a scenario in which a first client plays multimedia information according to an embodiment of the present application.

Fig. 6 is another schematic flow chart of an information processing method according to an embodiment of the present application.

Fig. 7 is a schematic structural diagram illustrating switching of presentation attribute information of image information in a scene according to an embodiment of the present application.

Fig. 8 is another schematic flow chart of an information processing method according to an embodiment of the present application.

Fig. 9 is another schematic flowchart of an information processing method according to an embodiment of the present application.

Fig. 10 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present application.

Fig. 11 is a schematic diagram of another structure of an information processing apparatus according to an embodiment of the present application.

Fig. 12 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

Artificial Intelligence (AI) is a theory, method, technique and application system that uses a digital computer or a machine controlled by a digital computer to simulate, extend and expand human Intelligence, perceive the environment, acquire knowledge and use the knowledge to obtain the best results. AI is a comprehensive subject, and relates to the field extensively, and the technique of existing hardware level also has the technique of software level. The artificial intelligence infrastructure generally includes technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and the like.

Computer Vision technology (CV) Computer Vision is a science for researching how to make a machine "see", and further, it refers to that a camera and a Computer are used to replace human eyes to perform machine Vision such as identification, tracking and measurement on a target, and further perform graphic processing, so that the Computer processing becomes an image more suitable for human eyes to observe or to transmit to an instrument to detect. The CV generally includes technologies such as image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content/behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, synchronous positioning, map construction, and the like, and also includes common biometric technologies such as face recognition, fingerprint recognition, and the like.

In particular, the scheme provided by the embodiment of the invention relates to image processing and video processing technology in CV.

Specifically, the technical solutions provided by the embodiments of the present invention are illustrated by the following embodiments.

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort shall fall within the protection scope of the present application.

It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Fig. 1 is a schematic diagram of an implementation environment of an information processing method according to an embodiment of the present application. As shown in fig. 1, the implementation environment may include at least afirst client 01, asecond client 02, and aserver 03. Thefirst client 01 and thesecond client 02 are connected with theserver 03 in a wired or wireless mode, so that data transmission with theserver 03 is realized through the network. For example, the data transmitted between theserver 03 and thefirst client 02 may include target multimedia information, and the data transmitted between theserver 03 and thefirst client 01 may include a target multimedia information playing request, audio information of the target multimedia information, and image information of specific presentation attribute information.

Specifically, thefirst client 01 and thesecond client 02 may each include a smart phone, a desktop computer, a tablet computer, a notebook computer, a digital assistant, a smart wearable device, a vehicle, a sound box, a television, a robot, and the like.

Specifically, theserver 03 may include a server running independently, or a distributed server, or a server cluster composed of a plurality of servers. Theserver 03 may comprise a network communication unit, a processor, a memory, etc. Theserver 03 may provide background services for thefirst client 01 and thesecond client 02.

It should be noted that fig. 1 is only an example.

Fig. 2 is a schematic flow chart of an information processing method provided in an embodiment of the present application, and the present specification provides the method operation steps as described in the embodiment or the flowchart, but more or less operation steps may be included based on conventional or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. In actual system or server product execution, sequential execution or parallel execution (e.g., parallel processor or multithreaded processing environments) may occur according to the embodiments or methods shown in the figures. Specifically, as shown in fig. 2, the method may include:

s101, a first client sends a playing request of target multimedia information to a server, wherein the playing request carries first display attribute information of image information corresponding to the target multimedia information.

In this embodiment of the application, before the first client sends the play request of the target multimedia information to the server, the method further includes:

and the second client sends the target multimedia information to the server.

And the server decodes the target multimedia information to obtain original audio information and original image information.

And the server transcodes the original audio information to obtain the audio information, and transcodes the original image information to obtain a plurality of image information of different display attribute information.

The server stores the audio information and the plurality of image information of the different presentation attribute information in the audio image file.

In this embodiment of the present application, the second client may be a background client, and fig. 3 is a logic block diagram illustrating that in one scenario, the server performs background storage on the target multimedia information uploaded by the second client. The scene may be a scene showing that the attribute information is an image resolution, as shown in fig. 3, when the second client sends a single 1080P target multimedia message to the server, the server may first decode the single 1080P target multimedia message to obtain original audio information and original image information included in the single 1080P target multimedia message, then transcode the original audio information to obtain a single complete audio information not including image information, transcode and expand the original image information to obtain a plurality of image information not including audio information with different resolutions, for example, image information not including audio information with a resolution of 270P, image information not including audio information with a resolution of 480P, image information not including audio information with a resolution of 720P, and image information not including audio information with a resolution of 1080P may be obtained.

After the server obtains the audio information and the image information with different display attribute information, the audio information and the image information with different display attribute information can be stored in an audio image file, and one audio information is shared by the image information with different display attribute information, so that the audio information of the target multimedia information and the image information with different display attribute information can be stored in the audio image file of the server in advance.

In this embodiment of the application, the first client may be a front-end playing client, and when the first client needs to watch an audio image of certain display attribute information of the target multimedia information, the first display attribute information of the image information corresponding to the target multimedia information may be sent to the server. Taking the presentation attribute information as an example of the resolution, if the user of the first client wants to view an audio image with the resolution of 480P, a play request carrying image information of 480P may be sent to the server.

In one possible embodiment, the presentation attribute information may further include a frame rate, a length-width ratio, and the like. The frame rate may be the number of still pictures played per second, and the aspect ratio may be a ratio describing the ratio of video pictures to picture elements.

In a possible embodiment, in order to improve the security of information transmission, the play request may further carry first authentication information, where the first authentication information is authentication information of the first client and the play request, and as shown in fig. 4, before S103, the method may further include:

s102, the server authenticates the identity validity of the first client side and the validity of the playing request based on the first authentication information, if the identity of the first client side is legal and the playing request is legal, the authentication is successful, S103 is executed, otherwise, the authentication is failed, and the multimedia information request playing process is ended.

In a possible embodiment, the first authentication information may be generated by the first client using its own private key, for example, the first client encrypts the first client itself and the play request using its own private key to obtain the first authentication information. Accordingly, in S102, the server may decrypt the first authentication information using the public key of the first client, and if the server is able to decrypt the first authentication information using the public key of the first client, the authentication is successful, otherwise, the authentication fails.

In another possible embodiment, the first authentication information may be further encrypted by the first client according to Advanced Encryption Standard (AES). Accordingly, in S102, the server may decrypt the first authentication information using a decryption rule related to AES, and if the decryption passes, the authentication is successful, otherwise, the authentication fails.

In another possible embodiment, the first authentication information may be further encrypted by the first client through a Secure Hash Algorithm (SHA). Accordingly, in S102, the server may decrypt the first authentication information using the decryption rule associated with the SHA, and if the decryption passes, the authentication is successful, otherwise, the authentication fails.

In practical applications, the first authentication information may also be the authentication information of the first client alone, or the authentication information of the play request alone.

S103, the server acquires audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information.

Fig. 5 is a logic diagram illustrating a scenario in which a first client performs front-end playing on multimedia information. The scene may be a scene in which the presentation attribute information is an image resolution, as shown in fig. 5, when the first presentation attribute information is 480P, after the server receives the play request sent by the first client, because the audio information and the image information of different attribute information are already stored in the audio image file, the server may read a single piece of complete audio information not containing image information and 480P image information not containing audio information from the audio image file, without real-time decoding, thereby reducing a system load caused by decoding performance overhead.

Continuing with fig. 4, to further improve the security of information transmission, before S105, the method may further include:

and S104, the server generates second authentication information corresponding to the audio information and generates third authentication information corresponding to the first target image information.

In practical application, if the server can obtain the audio information of the target multimedia information and the first target image information corresponding to the first display attribute information from the audio image file of the target multimedia information, indicating that the audio information and the first target image information exist, the process goes to S104, otherwise, the audio information and the first target image information do not exist, and the multimedia information request playing process is ended.

In a possible embodiment, the second authentication information may be obtained by encrypting the audio information by using a private key of the server, and the third authentication information may be obtained by encrypting the first target image information by using a private key of the server.

In another possible embodiment, the second authentication information and the third authentication information may be further encrypted by the second server through AES.

In another possible embodiment, the second authentication information and the third authentication information may also be obtained by encrypting by the server through SHA.

And S105, the server sends the audio information and the first target image information to the first client.

In this embodiment of the application, S105 may specifically include: the server sends the audio information, the first target image information, the second authentication information and the third authentication information to the first client.

Continuing with fig. 4, to further improve the security of information transmission, before S107, the method may further include:

s106, the first client authenticates the legality of the audio information based on the second authentication information, authenticates the legality of the first target image information based on the third authentication information, if the audio information is legal and the first target image information is legal, S107 is executed, and if not, the multimedia information request playing process is ended.

In a possible embodiment, if the second authentication information is obtained by encrypting the audio information by the server using its own private key, and the third authentication information is obtained by encrypting the first target image information by the server using its own private key, the first client may decrypt the second authentication information and the third authentication information by using a public key corresponding to the server, if the first client can decrypt the second authentication information and the third authentication information by using a public key corresponding to the server, the authentication is passed, otherwise, the authentication is failed.

In another possible embodiment, if the second authentication information and the third authentication information are obtained by the second server through AES encryption, the first client may decrypt the second authentication information and the third authentication information using a decryption rule related to AES, if decryption is possible, the authentication is passed, otherwise, the authentication is not passed.

In another possible embodiment, if the second authentication information and the third authentication information are obtained by the server through SHA encryption, the first client may decrypt the second authentication information and the third authentication information using a decryption rule associated with SHA, and if decryption is possible, the authentication is passed, otherwise, the authentication is not passed.

And S107, the first client synchronously plays the audio information and the first target image information.

In this embodiment, S107 may specifically include:

s1071, the first client side obtains first image time stamp information in the first target image information and obtains audio time stamp information in the audio information.

S1073, the first client side carries out first alignment processing on the audio information and the first target image information according to the first image timestamp information and the audio timestamp information.

S1075, the first client plays the audio information after the first alignment processing by using a first playing device, and plays the first target image information after the first alignment processing by using a second playing device.

Continuing with fig. 5, after the client receives a single complete audio message without image information and 480P image messages without audio information, the client may obtain timestamps in the first target image message and the first target audio message, align the first target image message and the first target audio message according to the timestamp information, and then play the first target image message and the first target audio message using different players.

In a possible embodiment, S1073 may specifically include:

calculating the time difference of audio image playing according to the first image time stamp information and the audio time stamp information;

acquiring an adjusting rate according to the time difference of audio image playing;

and adjusting the playing speed of the first target image information or controlling the audio information to stop playing according to the adjusting speed so as to align the audio information with the first target image information.

In the embodiment of the present application, when a user of a first client plays image information of certain display attribute information, if a display attribute information switching request triggered by the user is not received, the image information of certain display attribute information continues to be played, and if a display attribute information switching request triggered by the user is received, the display attribute information of image information corresponding to currently played multimedia information may be switched according to a user requirement, as shown in fig. 6, where a specific switching method is as follows:

s201, the first client sends a switching request of target multimedia information to the server at the first time, wherein the switching request carries fourth authentication information and second display attribute information of image information corresponding to the target multimedia information.

Fig. 7 is a schematic structural diagram illustrating switching of presentation attribute information of image information in a scene. The scene may show a scene with attribute information of image resolution, as shown in fig. 7, a resolution of image information currently viewed by a first client is 1080P, and if a user wants to switch to image information with a resolution of 480P for viewing at the first time, a resolution switching button or icon in a current display interface may be clicked to trigger a resolution switching request, so as to send a switching request carrying a resolution of 480P to a server.

In a possible embodiment, the handover request may further include fourth authentication information of the first client and the handover request. The fourth authentication information may be obtained by the first client encrypting the first client itself and the handover request by using its own private key.

In another possible embodiment, the fourth authentication information may be further encrypted by the first client through AES.

In another possible embodiment, the fourth authentication information may also be obtained by encrypting the first client through SHA.

And S203, the server authenticates the identity legality of the first client and the legality of the switching request based on the fourth authentication information.

In order to improve the security of information transmission, in a possible embodiment, if the fourth authentication information is obtained by the first client using its own private key for encryption, the server may decrypt the fourth authentication information using the public key of the first client, if the server can decrypt the fourth authentication information using the public key of the first client, the authentication is passed, otherwise, the authentication is not passed.

In another possible embodiment, if the fourth authentication information is obtained by the first client through AES encryption, the server may decrypt the fourth authentication information using a decryption rule related to AES, if decryption is passed, the authentication is passed, otherwise, the authentication is not passed.

In another possible embodiment, if the fourth authentication information is obtained by the first client through SHA encryption, the server may decrypt the fourth authentication information using a decryption rule associated with SHA, and if the decryption passes, the authentication passes, otherwise, the authentication does not pass.

S205, if the identity of the first client side is legal and the switching request is legal, the server acquires second target image information corresponding to the second display attribute information from the audio image file.

In practical application, if the server can obtain the second target image information corresponding to the second display attribute information from the audio image file, it indicates that the second target image information exists, and then S207 is entered, otherwise, the second target image information does not exist, and the image information of a certain display attribute information is continuously played.

And S207, the server generates fifth authentication information corresponding to the second target image information, and sends the second target image information and the fifth authentication information to the first client at a second time.

In this embodiment of the application, if the first client and the switching request pass the authentication, the server may read the second target image information corresponding to the second display attribute information, generate fifth authentication information corresponding to the second target image information by using an encryption method such as a private key of the first client, AES encryption, and send the second target image information and the fifth authentication information to the first terminal at the second time.

S209, the first client authenticates the legality of the second target image information based on the fifth authentication information.

In this embodiment of the application, the first client may decrypt the five pieces of authentication information using the public key of the server, the decryption rule related to the AES, and the decryption rule related to the SHA, and if decryption is possible, the second target image information is legal, otherwise, the second target image information is illegal, and the image information of a certain piece of display attribute information is continuously played.

And S2011, if the second target image information is legal, the first client synchronously plays the audio information and the second target image information after the second time.

The first time is a first preset time after the first client synchronously plays the audio information and the first target image information, the second time is a second preset time after the first time, and the first client continues to synchronously play the audio information and the first target image information between the first time and the second time.

In a possible embodiment, the synchronized playing of the audio information and the second target image information by the first client after the second time may include:

s201101, the first client acquires second image timestamp information in the second target image information.

And S201103, the first client performs second alignment processing on the audio information and the second target image information according to the second image timestamp information and the audio timestamp information.

And S201105, the first client plays the audio information after the second alignment processing by using the first playing device after the second time, and plays the second target image information after the second alignment processing by using the second playing device.

The process of the synchronized playing in S2011 may refer to S107, and is not described herein again.

In the embodiment of the application, in the process of switching the resolution, the first client continues to play the audio information and the first target image information, meanwhile, the second target image information corresponding to the second display attribute information is downloaded, and after the second target image information is downloaded, the second target image information and the audio information are played synchronously, so that the user experience is not blocked when the resolution is switched.

By adopting the information processing method provided by the embodiment of the application, on one hand, as the audio information of the target multimedia information and the plurality of image information of different display attribute information are stored in the audio image file of the server in advance, when the server receives a target multimedia information playing request containing a certain resolution, the audio information of the target multimedia information and the image information corresponding to the resolution can be directly obtained from the audio image file, and the image information corresponding to the resolution does not need to be obtained by decoding the multimedia information every time, so that the decoding performance overhead of the server or a front-end playing client during the playing of the multimedia information or the switching of the resolution is avoided, and the system burden is reduced; on the other hand, in the process of switching the resolution, the audio information and the first target image information are continuously played, and after the second target image information is prepared, the second target image information and the audio information are synchronously played, so that the network flow consumption during resolution switching is reduced, and the front-end video switching is ensured to be smoothly carried out; on the other hand, the pirate resource can not simultaneously acquire multimedia information containing complete audio information and image information, thereby increasing the pirate cost and being beneficial to the intellectual property protection of network works.

An information processing method in the embodiment of the present application is described below with a server as an execution subject, and as shown in fig. 8, the method may include:

s301, receiving a playing request of target multimedia information sent by a first client, wherein the playing request carries first display attribute information of image information corresponding to the target multimedia information.

S303, acquiring the audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information.

S305, sending the audio information and the first target image information to the first client so that the first client can synchronously play the audio information and the first target image information.

In a possible embodiment, before the receiving the request for playing the target multimedia information sent by the first client, the method may further include:

and receiving the target multimedia information sent by the second client.

And decoding the target multimedia information to obtain original audio information and original image information.

Transcoding the original audio information to obtain the audio information, and transcoding the original image information to obtain a plurality of image information of different display attribute information.

Storing the audio information and the plurality of image information of the different presentation attribute information in the audio image file.

In a feasible embodiment, if the play request further carries first authentication information, before the acquiring the audio information of the target multimedia information and the first target image information corresponding to the first presentation attribute information from the audio image file of the target multimedia information, the method further includes:

authenticating the identity validity of the first client and the validity of the playing request based on the first authentication information;

and if the identity of the first client is legal and the playing request is legal, executing a step of acquiring the audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information.

Accordingly, prior to the sending of the audio information and the first target image information to the first client, the method further comprises:

generating second authentication information corresponding to the audio information, and generating third authentication information corresponding to the first target image information;

correspondingly, the sending the audio information and the first target image information to the first client to enable the first client to synchronously play the audio information and the first target image information includes:

sending the audio information, the first target image information, the second authentication information and the third authentication information to the first client, so that the first client authenticates the legality of the audio information based on the second authentication information and authenticates the legality of the first target image information based on the third authentication information; and when the audio information is legal and the first target image information is legal, synchronously playing the audio information and the first target image information.

An information processing method in the embodiment of the present application is described below with a first client as an execution subject, and as shown in fig. 9, the method may include:

s401, sending a playing request of target multimedia information to a server, wherein the playing request carries first display attribute information of image information corresponding to the target multimedia information.

S403, receiving audio information of the target multimedia information and first target image information corresponding to the first display attribute information, which are sent by the server and acquired from an audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information.

S405, the audio information and the first target image information are synchronously played.

In a possible embodiment, the playing the audio information and the first target image information synchronously may include:

and acquiring first image time stamp information in the first target image information, and acquiring audio time stamp information in the audio information.

And performing first alignment processing on the audio information and the first target image information according to the first image time stamp information and the audio time stamp information.

And playing the audio information after the first alignment processing by using a first local playing device, and playing the first target image information after the first alignment processing by using a second local playing device.

In a possible embodiment, after the synchronously playing the audio information and the first target image information, the method may further include:

sending a switching request of target multimedia information to the server at a first time, wherein the switching request carries fourth authentication information and second display attribute information of image information corresponding to the target multimedia information, so that the server authenticates the identity validity of the first client and the validity of the switching request based on the fourth authentication information, acquires second target image information corresponding to the second display attribute information from the audio image file when the identity of the first client is legal and the switching request is legal, and generates fifth authentication information corresponding to the second target image information.

And receiving the second target image information and the fifth authentication information sent by the server at a second time.

And authenticating the legality of the second target image information based on the fifth authentication information.

And if the second target image information is legal, synchronously playing the audio information and the second target image information after the second time.

And continuing to synchronously play the audio information and the first target image information between the first time and the second time, wherein the first time is a first preset time after the audio information and the first target image information are synchronously played, and the second time is a second preset time after the first time.

In a possible embodiment, the synchronously playing the audio information and the second target image information after the second time may include:

and acquiring second image time stamp information in the second target image information.

And performing second alignment processing on the audio information and the second target image information according to the second image time stamp information and the audio time stamp information.

And after the second time, the first local playing device is used for playing the audio information after the second alignment processing, and the second local playing device is used for playing the second target image information after the second alignment processing.

As shown in fig. 10, an embodiment of the present application provides an information processing apparatus, which may include:

a playing request receiving module 501, configured to receive a playing request of target multimedia information sent by a first client, where the playing request carries first display attribute information of image information corresponding to the target multimedia information.

An audio information and first target image information obtaining module 503, configured to obtain, from an audio image file of the target multimedia information, the audio information of the target multimedia information and first target image information corresponding to the first display attribute information, where the audio image file includes the audio information of the target multimedia information and multiple pieces of image information of different display attribute information.

An audio information and first target image information sending module 505, configured to send the audio information and the first target image information to the first client, so that the first client synchronously plays the audio information and the first target image information.

As shown in fig. 11, an embodiment of the present application provides an information processing apparatus, which may include:

the playing request sending module 601 is configured to send a playing request of target multimedia information to a server, where the playing request carries first display attribute information of image information corresponding to the target multimedia information.

An audio information and first target image information receiving module 603, configured to receive the audio information of the target multimedia information and the first target image information corresponding to the first display attribute information, where the audio information and first target image information are sent by the server and obtained from an audio image file of the target multimedia information, and the audio image file includes the audio information of the target multimedia information and multiple pieces of image information of different display attribute information.

A synchronous playing module 605, configured to play the audio information and the first target image information synchronously.

An embodiment of the present application further provides an information processing system, where the system may include a first client and a server:

the first client is used for sending a playing request of target multimedia information to a server, wherein the playing request carries first display attribute information of image information corresponding to the target multimedia information; the audio image file is used for receiving the audio information of the target multimedia information and the first target image information corresponding to the first display attribute information, which are sent by the server and acquired from the audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information; and the audio information and the first target image information are synchronously played.

The server is used for receiving a playing request of the target multimedia information sent by the first client; the audio image file is used for acquiring the audio information of the target multimedia information and the first target image information corresponding to the first display attribute information; and for sending the audio information and the first target image information to the first client.

An embodiment of the present application further provides an information processing apparatus, which includes a processor and a memory, where the memory stores at least one instruction, at least one program, a set of codes, or a set of instructions, and the at least one instruction, the at least one program, the set of codes, or the set of instructions is loaded and executed by the processor to implement the information processing method provided in the foregoing method embodiment.

Embodiments of the present application further provide a storage medium, which may be disposed in a terminal to store at least one instruction, at least one program, a code set, or a set of instructions related to implementing an information processing method in the method embodiments, where the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by the processor to implement the information processing method provided in the method embodiments.

Alternatively, in the present specification embodiment, the storage medium may be located in at least one network server of a plurality of network servers of a computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.

The memory according to the embodiments of the present disclosure may be used to store software programs and modules, and the processor may execute various functional applications and data processing by operating the software programs and modules stored in the memory. The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs needed by functions and the like; the storage data area may store data created according to use of the apparatus, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory may also include a memory controller to provide the processor access to the memory.

The embodiment of the information processing method provided by the embodiment of the application can be executed in a mobile terminal, a computer terminal, a server or a similar operation device. Taking an example of the server running on the server, fig. 12 is a hardware structure block diagram of the server of an information processing method provided in the embodiment of the present application. As shown in fig. 12, theserver 700 may have a relatively large difference due to different configurations or performances, and may include one or more Central Processing Units (CPUs) 710 (theprocessor 710 may include but is not limited to a Processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.), amemory 730 for storing data, and one or more storage media 720 (e.g., one or more mass storage devices) for storingapplications 723 ordata 722.Memory 730 andstorage medium 720 may be, among other things, transient storage or persistent storage. The program stored in thestorage medium 720 may include one or more modules, each of which may include a series of instruction operations for a server. Still further,central processor 710 may be configured to communicate withstorage medium 720 to execute a sequence of instruction operations instorage medium 720 onserver 700. Theserver 700 may also include one ormore power supplies 760, one or more wired or wireless network interfaces 750, one or more input-output interfaces 740, and/or one ormore operating systems 721, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, etc.

The input/output interface 740 may be used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of theserver 700. In one example, the input/output Interface 740 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the input/output interface 740 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.

It will be understood by those skilled in the art that the structure shown in fig. 12 is only an illustration and is not intended to limit the structure of the electronic device. For example,server 700 may also include more or fewer components than shown in FIG. 12, or have a different configuration than shown in FIG. 12.

It should be noted that: the sequence of the embodiments of the present application is only for description, and does not represent the advantages and disadvantages of the embodiments. And that specific embodiments have been described above. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the device and server embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to the partial description of the method embodiments for relevant points.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only a preferred embodiment of the present application and should not be taken as limiting the present application, and any modifications, equivalents, improvements and the like that are made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. An information processing method, characterized in that the method comprises: receiving a playing request of target multimedia information sent by a first client, wherein the playing request carries first display attribute information of image information corresponding to the target multimedia information;

acquiring audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information; the plurality of image information and the audio information of different display attribute information are mutually independently stored in the audio image file; the audio information is shared by the image information with different display attribute information, and the shared image information and the audio information which are used for representing the different display attribute information are mutually independent, sent to the first client side and synchronously played at the first client side; the audio information is obtained by transcoding original audio information, the image information with different display attribute information is obtained by transcoding the original image information, and the original audio information and the original image information are obtained by decoding the target multimedia information;

sending the audio information and the first target image information to the first client so that the first client can synchronously play the audio information and the first target image information;

receiving a switching request of target multimedia information sent by the first client at a first time, wherein the switching request carries second display attribute information of image information corresponding to the target multimedia information; acquiring second target image information corresponding to the second display attribute information from the audio image file;

sending the second target image information to the first client at a second time so that the first client synchronously plays the audio information and the second target image information after the second time; and continuing to synchronously play the audio information and the first target image information between the first time and the second time, wherein the first time is a first preset time after the audio information and the first target image information are synchronously played, and the second time is a second preset time after the first time.

2. The method according to claim 1, wherein before said receiving the request for playing the target multimedia information sent by the first client, the method further comprises: receiving the target multimedia information sent by a second client;

decoding the target multimedia information to obtain the original audio information and the original image information;

transcoding the original audio information to obtain the audio information, and transcoding the original image information to obtain a plurality of image information of different display attribute information;

3. The method according to claim 1, wherein the playback request further carries first authentication information, and before the obtaining the audio information of the target multimedia information and the first target image information corresponding to the first presentation attribute information from the audio image file of the target multimedia information, the method further comprises:

if the identity of the first client is legal and the playing request is legal, executing a step of acquiring the audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information;

accordingly, prior to the sending of the audio information and the first target image information to the first client, the method further comprises: generating second authentication information corresponding to the audio information and generating third authentication information corresponding to the first target image information;

4. An information processing method, characterized in that the method comprises:

receiving audio information of the target multimedia information and first target image information corresponding to the first display attribute information, which are sent by the server and acquired from an audio image file of the target multimedia information, wherein the audio image file comprises the audio information of the target multimedia information and a plurality of image information of different display attribute information; the plurality of image information and the audio information of different display attribute information are mutually independently stored in the audio image file; the audio information is shared by the image information with different display attribute information, and the shared image information and the audio information which are used for representing the different display attribute information are mutually independent, sent to a local client and synchronously played at the local client; the audio information is obtained by transcoding original audio information, the image information with different display attribute information is obtained by transcoding the original image information, and the original audio information and the original image information are obtained by decoding the target multimedia information;

synchronously playing the audio information and the first target image information;

sending a switching request of target multimedia information to the server at a first time, wherein the switching request carries second display attribute information of image information corresponding to the target multimedia information, so that the server acquires the second target image information corresponding to the second display attribute information from the audio image file;

receiving second target image information sent by the server at a second time, and synchronously playing the audio information and the second target image information after the second time; and continuing to synchronously play the audio information and the first target image information between the first time and the second time, wherein the first time is a first preset time after the audio information and the first target image information are synchronously played, and the second time is a second preset time after the first time.

5. The method of claim 4, wherein said playing the audio information and the first target image information synchronously comprises:

acquiring first image timestamp information in the first target image information, and acquiring audio timestamp information in the audio information;

performing first alignment processing on the audio information and the first target image information according to the first image timestamp information and the audio timestamp information;

6. The method according to claim 5, wherein the sending a request for switching target multimedia information to the server at the first time, where the request for switching carries second presentation attribute information of image information corresponding to the target multimedia information, so that the server obtains second target image information corresponding to the second presentation attribute information from the audio image file, comprises:

sending a switching request of target multimedia information to the server at a first time, wherein the switching request carries fourth authentication information and second display attribute information of image information corresponding to the target multimedia information, so that the server authenticates the identity legality of the local client and the legality of the switching request based on the fourth authentication information; when the identity of the local client is legal and the switching request is legal, acquiring second target image information corresponding to the second display attribute information from the audio image file; generating fifth authentication information corresponding to the second target image information;

the receiving the second target image information sent by the server at a second time, and synchronously playing the audio information and the second target image information after the second time includes:

receiving the second target image information and the fifth authentication information sent by the server at a second time;

authenticating the legality of the second target image information based on the fifth authentication information;

7. The method of claim 6, wherein said playing the audio information and the second target image information synchronously after the second time comprises:

acquiring second image timestamp information in the second target image information;

according to the second image time stamp information and the audio time stamp information, second alignment processing is carried out on the audio information and the second target image information;

8. An information processing apparatus, characterized in that the apparatus comprises:

the system comprises a playing request receiving module, a playing request sending module and a playing request sending module, wherein the playing request is used for receiving a playing request of target multimedia information sent by a first client, and the playing request carries first display attribute information of image information corresponding to the target multimedia information;

an audio information and first target image information obtaining module, configured to obtain audio information of the target multimedia information and first target image information corresponding to the first display attribute information from an audio image file of the target multimedia information, where the audio image file includes the audio information of the target multimedia information and multiple pieces of image information of different display attribute information; the image information and the audio information of different display attribute information are mutually independently stored in the audio image file; the audio information is shared by the image information with different display attribute information, and the shared image information and the audio information which are used for representing the different display attribute information are mutually independent, sent to the first client side and synchronously played at the first client side; the audio information is obtained by transcoding original audio information, the image information with different display attribute information is obtained by transcoding the original image information, and the original audio information and the original image information are obtained by decoding the target multimedia information;

the audio information and first target image information sending module is used for sending the audio information and the first target image information to the first client so that the first client can synchronously play the audio information and the first target image information;

a switching request receiving module, configured to receive a switching request of target multimedia information sent by the first client at a first time, where the switching request carries second display attribute information of image information corresponding to the target multimedia information; acquiring second target image information corresponding to the second display attribute information from the audio image file;

a second target image information sending module, configured to send the second target image information to the first client at a second time, so that the first client synchronously plays the audio information and the second target image information after the second time; and continuing to synchronously play the audio information and the first target image information between the first time and the second time, wherein the first time is a first preset time after the audio information and the first target image information are synchronously played, and the second time is a second preset time after the first time.

9. An information processing apparatus characterized in that the apparatus comprises:

an audio information and first target image information receiving module, configured to receive audio information of the target multimedia information and first target image information corresponding to the first display attribute information, where the audio information and first target image information receiving module is sent by the server and is acquired from an audio image file of the target multimedia information, and the audio image file includes the audio information of the target multimedia information and multiple pieces of image information of different display attribute information; the plurality of image information and the audio information of different display attribute information are mutually independently stored in the audio image file; the audio information is shared by the image information with different display attribute information, and the shared image information and the audio information which are used for representing the different display attribute information are mutually independently sent to a local client and synchronously played at the local client; the audio information is obtained by transcoding original audio information, the image information with different display attribute information is obtained by transcoding the original image information, and the original audio information and the original image information are obtained by decoding the target multimedia information;

the synchronous playing module is used for synchronously playing the audio information and the first target image information;

a switching request sending module, configured to send a switching request of target multimedia information to the server at a first time, where the switching request carries second display attribute information of image information corresponding to the target multimedia information, so that the server obtains, from the audio image file, second target image information corresponding to the second display attribute information;

the second target image information receiving module is used for receiving the second target image information sent by the server at a second time, and synchronously playing the audio information and the second target image information after the second time; and continuing to synchronously play the audio information and the first target image information between the first time and the second time, wherein the first time is a first preset time after the audio information and the first target image information are synchronously played, and the second time is a second preset time after the first time.

10. A computer readable storage medium, having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement the information processing method according to any one of claims 1 to 7.

11. An electronic device for information processing, characterized in that the electronic device comprises: a processor and a memory, the memory having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by the processor to implement the information processing method according to any one of claims 1 to 7.