通讯类应用也称为即时通讯(英文：Instant Messenger；简称：IM)软件，是一种基于互联网的即时交流信息的业务软件，例如QQ、微信等。随着通讯技术的发展，越来越多的通讯类应用支持多媒体通讯，即音频或视频通讯。The communication application is also called Instant Messenger (English: Instant Messenger; abbreviation: IM) software, which is a business software based on the Internet for instant communication of information, such as QQ and WeChat. With the development of communication technology, more and more communication applications support multimedia communication, that is, audio or video communication.

相关技术中，音频聊天通常是通过麦克风将聊天用户双方的语音内容进行交互；视频聊天是通过摄像头和麦克风同时将聊天用户双方的语音内容和视频内容进行交互。在即时通讯音视频会话的过程中，用户在通过即时通讯界面通讯的同时，也可以通过聊天对话框输入文字、表情、截图等聊天内容。In related technologies, audio chat usually uses a microphone to interact voice content of both chat users; video chat uses a camera and a microphone to simultaneously interact voice content and video content of both chat users. During the instant messaging audio and video session, users can also input text, emoticons, screenshots and other chat content through the chat dialog box while communicating through the instant messaging interface.

但是，在即时通讯的过程中，在不影响聊天用户双方的音视频通讯的前提下，仅仅能同时输入文字、表情、截图等简单的聊天内容，即时通讯的通讯场景单一。However, in the process of instant messaging, under the premise of not affecting the audio and video communication between the chatting users, only simple chat content such as text, emoticons, and screenshots can be input at the same time, and the communication scene of instant messaging is single.

发明内容Contents of the invention

为了解决即时通讯的通讯场景单一的问题，本发明实施例提供了一种即时通讯方法、装置及系统。所述技术方案如下：In order to solve the problem of single communication scenarios of instant messaging, embodiments of the present invention provide an instant messaging method, device and system. Described technical scheme is as follows:

第一方面，提供一种即时通讯方法，所述方法包括：In the first aspect, an instant messaging method is provided, and the method includes:

在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令；During the instant messaging audio and video session, the local client receives audio playback instructions through the music plug-in entry set on the instant messaging interface;

所述本地客户端获取所述音频播放指令指示的音频；The local client acquires the audio indicated by the audio playback instruction;

所述本地客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放；The local client plays the audio indicated by the audio playback instruction as the background music of the audio-video session;

所述本地客户端将所述音频播放指令指示的音频传输至对端客户端，以使得所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放，所述对端客户端为所述用户的聊天对象所使用的客户端。The local client transmits the audio indicated by the audio play instruction to the peer client, so that the peer client plays the audio indicated by the audio play instruction as the background music of the audio-video session, the The peer client is the client used by the user's chat partner.

第二方面，提供一种即时通讯方法，所述方法包括：In a second aspect, an instant messaging method is provided, the method comprising:

在即时通讯音视频会话过程中，对端客户端接收本地客户端传输的音频播放指令指示的音频，所述音频播放指令是所述本地客户端通过设置在即时通讯界面的音乐插件入口接收的，所述对端客户端为所述用户的聊天对象所使用的客户端；During the instant messaging audio and video session, the peer client receives the audio indicated by the audio playback instruction transmitted by the local client, and the audio playback instruction is received by the local client through the music plug-in entrance provided on the instant messaging interface, The opposite client is a client used by the user's chat partner;

所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The peer client plays the audio indicated by the audio playing instruction as the background music of the audio-video session.

第三方面，提供一种即时通讯装置，用于本地客户端，所述装置包括：In a third aspect, an instant messaging device is provided for a local client, the device comprising:

第一接收模块，用于在即时通讯音视频会话过程中，通过设置在即时通讯界面的音乐插件入口接收音频播放指令；The first receiving module is used to receive audio playback instructions through the music plug-in entry set on the instant messaging interface during the instant messaging audio and video session;

获取模块，用于获取所述音频播放指令指示的音频；An acquisition module, configured to acquire the audio indicated by the audio playback instruction;

播放模块，用于将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放；A playback module, configured to play the audio indicated by the audio playback instruction as the background music of the audio-video session;

发送模块，用于将所述音频播放指令指示的音频传输至对端客户端，以使得所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放，所述对端客户端为所述用户的聊天对象所使用的客户端。A sending module, configured to transmit the audio indicated by the audio play instruction to the peer client, so that the peer client plays the audio indicated by the audio play instruction as the background music of the audio-video session, the The peer client is the client used by the user's chat partner.

第四方面，提供一种即时通讯装置，用于对端客户端，所述对端客户端为用户的聊天对象所使用的客户端，所述装置包括：In a fourth aspect, an instant messaging device is provided for a peer client, the peer client is a client used by a user's chat partner, and the device includes:

接收模块，用于在即时通讯音视频会话过程中，接收本地客户端传输的音频播放指令指示的音频，所述音频播放指令是所述本地客户端通过设置在即时通讯界面的音乐插件入口接收的；The receiving module is used to receive the audio indicated by the audio playback instruction transmitted by the local client during the instant messaging audio and video session, and the audio playback instruction is received by the local client through the music plug-in entrance set on the instant messaging interface ;

播放模块，用于将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The playing module is used to play the audio indicated by the audio playing instruction as the background music of the audio-video session.

第五方面，提供一种即时通讯系统，包括：In the fifth aspect, an instant messaging system is provided, including:

第三方面任一所述的即时通讯装置；The instant messaging device described in any one of the third aspect;

以及，第四方面任一所述的即时通讯装置。And, the instant messaging device described in any one of the fourth aspect.

本发明实施例提供的技术方案带来的有益效果是：The beneficial effects brought by the technical solution provided by the embodiments of the present invention are:

本发明提供的一种即时通讯方法、装置及系统，在即时通讯音视频会话过程中，由于客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户双方的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。In the instant messaging method, device and system provided by the present invention, during the instant messaging audio and video session, since the client can obtain the music plug-in as audio through the music plug-in entrance set on the instant messaging interface while the user communicates through the instant messaging interface The audio of the background music of the video conversation, and play the audio, so that on the premise of not affecting the audio and video communication between the two users, in addition to inputting simple chat content such as text, emoticons, and screenshots at the same time, the background music can also be played. Therefore, The communication scenarios of instant messaging are enriched.

附图说明Description of drawings

为了更清楚地说明本发明实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without creative effort.

图1是本发明实施例提供的一种即时通讯方法的应用场景图；FIG. 1 is an application scene diagram of an instant messaging method provided by an embodiment of the present invention;

图2是本发明实施例提供的一种即时通讯方法的流程图；Fig. 2 is a flow chart of an instant messaging method provided by an embodiment of the present invention;

图3是本发明实施例提供的另一种即时通讯方法的流程图；Fig. 3 is a flowchart of another instant messaging method provided by an embodiment of the present invention;

图4是本发明实施例提供的又一种即时通讯方法的流程图；Fig. 4 is a flowchart of another instant messaging method provided by an embodiment of the present invention;

图5是本发明实施例提供的一种即时通讯方法的场景示意图；Fig. 5 is a schematic diagram of a scenario of an instant messaging method provided by an embodiment of the present invention;

图6是本发明实施例提供的另一种即时通讯方法的场景示意图；FIG. 6 is a schematic diagram of another instant messaging method provided by an embodiment of the present invention;

图7是本发明实施例提供的一种接收音频播放方法的流程图；FIG. 7 is a flow chart of a method for receiving audio playback provided by an embodiment of the present invention;

图8是本发明实施例提供的一种QQ聊天界面的本地表情的示意图；Fig. 8 is a schematic diagram of a local emoticon of a QQ chat interface provided by an embodiment of the present invention;

图9是本发明实施例提供的一种音频列表的示意图；Fig. 9 is a schematic diagram of an audio list provided by an embodiment of the present invention;

图10为图9对应的详细示意图；FIG. 10 is a detailed schematic diagram corresponding to FIG. 9;

图11是本发明实施例提供的一种歌曲列表所在界面的搜索框使用方法的示意图；Fig. 11 is a schematic diagram of a method for using the search box of the interface where the song list is provided by an embodiment of the present invention;

图12是本发明实施例提供的一种本地客户端获取音频播放指令指示的音频方法的流程图；12 is a flow chart of an audio method for a local client to obtain an audio playback instruction instruction provided by an embodiment of the present invention;

图13是本发明实施例提供的一种本地客户端将音频播放指令指示的音频传输至对端客户端方法的流程图；13 is a flowchart of a method for a local client to transmit audio indicated by an audio playback instruction to a peer client according to an embodiment of the present invention;

图14是本发明实施例提供的一种即时通讯装置的结构示意图；Fig. 14 is a schematic structural diagram of an instant messaging device provided by an embodiment of the present invention;

图15是本发明实施例提供的另一种即时通讯装置的结构示意图；Fig. 15 is a schematic structural diagram of another instant messaging device provided by an embodiment of the present invention;

图16是本发明实施例提供的又一种即时通讯装置的结构示意图；Fig. 16 is a schematic structural diagram of another instant messaging device provided by an embodiment of the present invention;

图17是本发明实施例提供的一种终端的结构示意图。FIG. 17 is a schematic structural diagram of a terminal provided by an embodiment of the present invention.

具体实施方式detailed description

为使本发明的目的、技术方案和优点更加清楚，下面将结合附图对本发明实施方式作进一步地详细描述。In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

图1是本发明实施例提供的一种即时通讯方法的应用场景图。参见图1，用户在用户设备(图1以电脑为例)上通过即时通讯软件(如QQ)进行即时通讯音视频会话(如语音通话，即音频聊天)时，可以通过麦克风将用户双方的语音内容进行交互。示例的，图1中，使用QQ聊天的用户的用户名分别为“张三”和“李四”，具体的语音内容可以为：Fig. 1 is an application scene diagram of an instant messaging method provided by an embodiment of the present invention. Referring to Fig. 1, when a user conducts an instant messaging audio and video conversation (such as a voice call, i.e. audio chat) through an instant messaging software (such as QQ) on a user device (Fig. content to interact with. For example, in Figure 1, the user names of users using QQ chat are "Zhang San" and "Li Si" respectively, and the specific voice content can be:

“张三：老李，新春快乐！"Zhang San: Old Li, happy Chinese New Year!

李四：老张，同乐同乐！Li Si: Old Zhang, let's have fun together!

张三：祝你在新的一年里心想事成，财源滚滚，哈哈哈哈～。Zhang San: I wish you all wishes come true in the new year, and your wealth will be abundant, hahahaha~.

李四：祝你在新的一年里身体健康，工作顺利。”Li Si: I wish you good health and smooth work in the new year. "

在上述音频通讯过程中，为了营造浓厚的节日氛围，正在聊天的用户双方除了交互语音内容之外，任一用户可以选定一个适宜的背景音乐进行播放，在如图1的场景中可以选定一首新年贺岁歌曲作为聊天的背景音乐，这样，更能让双方真切感受到浓厚的节日氛围以及节日里亲朋好友的温暖。In the above audio communication process, in order to create a strong festive atmosphere, in addition to the interactive voice content between the users who are chatting, any user can select a suitable background music to play. In the scene shown in Figure 1, you can select A New Year's song is used as the background music for chatting, so that both parties can truly feel the strong festive atmosphere and the warmth of relatives and friends during the festival.

图2是本发明实施例提供的一种即时通讯方法的流程图，应用于本地客户端，该本地客户端可以安装于用户设备，该用户设备可以为手机、电脑和平板电脑等，参见图2，该即时通讯方法可以包括：Fig. 2 is a flow chart of an instant messaging method provided by an embodiment of the present invention, which is applied to a local client, and the local client can be installed on a user device, which can be a mobile phone, a computer, a tablet computer, etc., see Fig. 2 , the instant method can include:

步骤201、在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令。Step 201. During an instant messaging audio and video session, the local client receives an audio playback instruction through a music plug-in entry set on the instant messaging interface.

步骤202、本地客户端获取音频播放指令指示的音频。Step 202, the local client acquires the audio indicated by the audio playback instruction.

步骤203、本地客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。Step 203, the local client plays the audio indicated by the audio playing instruction as the background music of the audio-video session.

步骤204、本地客户端将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，该对端客户端为用户的聊天对象所使用的客户端。Step 204, the local client transmits the audio indicated by the audio playback instruction to the peer client, so that the peer client plays the audio indicated by the audio playback instruction as the background music of the audio-video session, and the peer client is the user The client used by the chat partner.

综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于本地客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。To sum up, in the instant messaging method provided by the embodiment of the present invention, during the instant messaging audio and video session, since the local client can obtain the music plug-in through the music plug-in entrance set on the instant messaging interface while the user communicates through the instant messaging interface As the audio of the background music of the audio and video conversation, and play the audio, so that on the premise of not affecting the user's audio and video communication, in addition to inputting simple chat content such as text, emoticons, screenshots, etc., the background music can also be played, so , which enriches the communication scenarios of instant messaging.

可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：Optionally, the local client transmits the audio indicated by the audio playback instruction to the peer client, including:

本地客户端通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频；The local client collects the audio generated by the user's call through the microphone and the audio played as the background music of the audio and video session;

本地客户端对麦克风采集的音频进行降噪处理；The local client performs noise reduction processing on the audio collected by the microphone;

本地客户端将经过降噪处理的麦克风采集的音频传输至对端客户端。The local client transmits the audio collected by the noise-reduced microphone to the peer client.

本地客户端将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件同时下发给本地客户端和对端客户端。The local client transmits the audio file indicated by the audio play instruction to the network server, so that the network server simultaneously sends the audio file indicated by the audio play instruction to the local client and the peer client.

本地客户端将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件下发给对端客户端。The local client transmits the audio file indicated by the audio play instruction to the network server, so that the network server sends the audio file indicated by the audio play instruction to the peer client.

本地客户端将音频播放指令指示的音频的统一资源定位符(英文：Uniform Resource Locator；简称：URL)传输至对端客户端，以使得对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The local client transmits the Uniform Resource Locator (English: Uniform Resource Locator; URL) of the audio indicated by the audio playback instruction to the opposite client, so that the opposite client downloads the audio indicated by the audio playback instruction according to the URL, and Play the audio indicated by the audio playing instruction as the background music of the audio-video session.

可选的，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令，包括：Optionally, the local client receives audio playback instructions through the music plug-in entry set on the instant messaging interface, including:

本地客户端通过设置在即时通讯界面的音乐插件入口接收音频列表显示指令；The local client receives the audio list display instruction through the music plug-in entrance set on the instant messaging interface;

本地客户端根据音频列表显示指令，在即时通讯界面显示音频列表，音频列表记录有至少一条音频；The local client displays the audio list on the instant messaging interface according to the audio list display instruction, and the audio list records at least one audio;

本地客户端接收音频播放指令，音频播放指令指示的音频为在音频列表中被选择的音频。The local client receives the audio play instruction, and the audio indicated by the audio play instruction is the audio selected in the audio list.

可选的，音频列表包括歌曲列表，在本地客户端接收音频播放指令之前，该方法还包括：Optionally, the audio list includes a song list, and before the local client receives the audio playback instruction, the method further includes:

本地客户端通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令；The local client receives song addition instructions through the search box set on the interface where the song list is located;

本地客户端根据歌曲添加指令在网络获取歌曲添加指令指示的歌曲对应的链接；The local client obtains the link corresponding to the song indicated by the song addition instruction on the network according to the song addition instruction;

本地客户端将歌曲添加指令指示的歌曲的信息记录在歌曲列表中，歌曲的信息为歌曲添加指令指示的歌曲对应的链接，或者根据链接下载的歌曲文件。The local client records the song information indicated by the song adding instruction in the song list, and the song information is a link corresponding to the song indicated by the song adding instruction, or a song file downloaded according to the link.

可选的，音频列表还包括短音频列表，短音频列表中记录的每个短音频存储在本地客户端，短音频为占用的存储空间小于预设空间阈值的预设音频。Optionally, the audio list further includes a short audio list, and each short audio recorded in the short audio list is stored on the local client, and the short audio is a preset audio whose storage space is smaller than a preset space threshold.

可选的，本地客户端获取音频播放指令指示的音频，包括：Optionally, the local client obtains the audio indicated by the audio playback instruction, including:

本地客户端检测用户是否拥有预设权限，预设权限是服务器根据用户是否付费或者用户的等级授予的；The local client detects whether the user has preset permissions, which are granted by the server according to whether the user pays or the user's level;

如果用户拥有预设权限，本地客户端获取音频播放指令指示的音频。If the user has preset permissions, the local client obtains the audio indicated by the audio playback instruction.

综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于本地客户端在用户通过即时通讯界面通讯的同时，能够通过设置在多即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。To sum up, in the instant messaging method provided by the embodiment of the present invention, during the instant messaging audio and video session, the local client can pass through the music plug-in entrance set on the multi-instant messaging interface while the user communicates through the instant messaging interface. Obtain the audio as the background music of the audio and video conversation, and play the audio, so that without affecting the user's audio and video communication, in addition to inputting simple chat content such as text, emoticons, screenshots, etc., you can also play the background music. Therefore, the communication scenarios of instant messaging are enriched.

图3是本发明实施例提供的另一种即时通讯方法的流程图，应用于对端客户端，该对端客户端可以安装于用户设备，该用户设备可以为手机、电脑和平板电脑等，参见图3，该即时通讯方法可以包括：3 is a flow chart of another instant messaging method provided by an embodiment of the present invention, which is applied to a peer client. The peer client can be installed on a user device, and the user device can be a mobile phone, a computer, a tablet computer, etc. Referring to Figure 3, the instant messaging method may include:

步骤301、在即时通讯音视频会话过程中，对端客户端接收本地客户端传输的音频播放指令指示的音频，该音频播放指令是本地客户端通过设置在即时通讯界面的音乐插件入口接收的，对端客户端为用户的聊天对象所使用的客户端。Step 301. During the instant messaging audio and video session, the peer client receives the audio indicated by the audio playback instruction transmitted by the local client. The audio playback instruction is received by the local client through the music plug-in entry set on the instant messaging interface. The peer client is the client used by the user's chat partner.

步骤302、对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。Step 302, the peer client plays the audio indicated by the audio playing instruction as the background music of the audio-video session.

综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于对端客户端在用户的聊天对象通过即时通讯界面通讯的同时，能够接收本地客户端传输的音频并作为背景音乐播放，在不影响该用户的聊天对象的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。In summary, in the instant messaging method provided by the embodiment of the present invention, during the instant messaging audio and video session, since the peer client can receive the audio transmitted by the local client while the user's chat partner communicates through the instant messaging interface And play it as background music, without affecting the audio and video communication of the user's chat partner, in addition to inputting simple chat content such as text, emoticons, screenshots, etc. at the same time, background music can also be played, thus enriching the instant messaging experience communication scene.

可选的，对端客户端接收本地客户端传输的音频播放指令指示的音频，包括：Optionally, the peer client receives the audio indicated by the audio playback instruction transmitted by the local client, including:

对端客户端接收网络服务器下发的音频播放指令指示的音频的文件，该音频播放指令指示的音频的文件是本地客户端上传至网络服务器的；The opposite end client receives the audio file indicated by the audio play instruction issued by the network server, and the audio file indicated by the audio play instruction is uploaded to the network server by the local client;

对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，包括：The peer client plays the audio indicated by the audio playback instruction as the background music of the audio-video session, including:

对端客户端在缓存音频播放指令指示的音频的文件的同时，播放音频的文件。The peer client plays the audio file while buffering the audio file indicated by the audio play instruction.

对端客户端接收本地客户端传输的音频播放指令指示的音频的URL；The peer client receives the URL of the audio indicated by the audio playback instruction transmitted by the local client;

对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The peer client downloads the audio indicated by the audio playing instruction according to the URL, and plays the audio indicated by the audio playing instruction as the background music of the audio-video session.

图4是本发明实施例提供的又一种即时通讯方法的流程图，参见图4，该即时通讯方法可以包括：Fig. 4 is a flowchart of another instant messaging method provided by an embodiment of the present invention. Referring to Fig. 4, the instant messaging method may include:

步骤401、在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令。Step 401. During the instant messaging audio and video session, the local client receives an audio playback instruction through the music plug-in entry set on the instant messaging interface.

本地客户端为用户所使用的客户端，即时通讯音视频会话包括音频通讯或视频通讯，音频通讯或视频通讯都是基于互联网的即时通讯软件的通讯方式，即时通讯软件有很多种，如MSN、QQ、微信、陌陌、CECISEIM、UC等。The local client is the client used by the user. Instant messaging audio and video sessions include audio communication or video communication. Both audio communication and video communication are communication methods based on Internet-based instant messaging software. There are many types of instant messaging software, such as MSN, QQ, WeChat, Momo, CECISEIM, UC, etc.

其中，以QQ为例，用户双方可以通过麦克风进行语音内容的交互，即语音通话，也可以同时通过摄像头和麦克风进行语音内容和视频内容的交互，即视频通话(视频聊天)。如图5所示，当用户双方进行语音通话时，用于本地客户端(QQ聊天的用户“张三”所使用的客户端)接收音频播放指令的音乐插件入口图标50可以设置在当前QQ语音通话界面上的麦克风图标的左侧；如图6所示，当用户双方进行视频通话时，用于本地客户端(通过QQ聊天的用户“张三”所使用的客户端)接收音频播放指令的音乐插件入口图标50可以设置在当前QQ视频通话界面上的摄像头图标的右侧。Among them, taking QQ as an example, both users can interact with voice content through a microphone, that is, a voice call, and can also perform voice and video content interactions through a camera and a microphone at the same time, that is, a video call (video chat). As shown in Figure 5, when both users have a voice call, the music plug-in entry icon 50 for the local client (the client used by the user "Zhang San" of QQ chat) to receive the audio playback instruction can be set in the current QQ voice The left side of the microphone icon on the call interface; as shown in Figure 6, when both users are conducting a video call, it is used for the local client (the client used by the user "Zhang San" chatting through QQ) to receive the audio playback instruction The music plug-in entry icon 50 can be set on the right side of the camera icon on the current QQ video call interface.

步骤402、本地客户端获取音频播放指令指示的音频。Step 402, the local client acquires the audio indicated by the audio playback instruction.

步骤403、本地客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。Step 403, the local client plays the audio indicated by the audio playing instruction as the background music of the audio-video session.

步骤404、本地客户端将音频播放指令指示的音频传输至对端客户端。Step 404, the local client transmits the audio indicated by the audio playback instruction to the peer client.

本地客户端将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，该对端客户端为用户的聊天对象所使用的客户端。The local client transmits the audio indicated by the audio playback instruction to the peer client, so that the peer client plays the audio indicated by the audio playback instruction as the background music of the audio-video session, and the peer client is the chat partner of the user The client used.

本地客户端将音频播放指令指示的音频传输至对端客户端的过程也就是数字信号处理的过程，本地客户端(发送端)执行的步骤主要分为四步：①模数转换，将模拟信号(即麦克风采集到的音频)数字化，该步骤包含三小步：抽样-量化-编码，该过程也可以称作信源编码和压缩信息；②对数字化的信源信号进行加密，防止被第三者识别；③对加密后的信号进行信道编码，以保证数据的可靠性；④数字调制，即把基带信号的频谱搬移到高频处，以使该信号适合信道中的传输。对端客户端(接收端)执行的步骤与本地客户端对称，依次逆序进行降噪，数字解调，信道解码，解密，信源译码等步骤，最终得原始模拟信号。The process that the local client transmits the audio indicated by the audio playback instruction to the peer client is also the process of digital signal processing. The steps performed by the local client (sending end) are mainly divided into four steps: ① Analog-to-digital conversion, converting the analog signal ( That is, the audio collected by the microphone) is digitized. This step includes three small steps: sampling-quantization-coding. This process can also be called source coding and compression information; ②encrypt the digitized source signal to prevent it from being Identification; ③Channel coding is performed on the encrypted signal to ensure the reliability of the data; ④Digital modulation, that is, to move the spectrum of the baseband signal to a high frequency, so that the signal is suitable for transmission in the channel. The steps performed by the peer client (receiving end) are symmetrical to those of the local client, and the steps of noise reduction, digital demodulation, channel decoding, decryption, and source decoding are performed in reverse order, and finally the original analog signal is obtained.

步骤405、对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。Step 405, the peer client plays the audio indicated by the audio playing instruction as the background music of the audio-video session.

进一步的，如图7所示，步骤401具体可以包括：Further, as shown in FIG. 7, step 401 may specifically include:

步骤4011、本地客户端通过设置在即时通讯界面的音乐插件入口接收音频列表显示指令。Step 4011, the local client receives the audio list display instruction through the music plug-in entry set on the instant messaging interface.

示例的，如图5所示，本地客户端(通过QQ聊天的用户“张三”所使用的客户端)通过设置在当前QQ语音通话界面的音乐插件入口接收音频列表显示指令，以便在即时通讯界面显示音频列表。参见图5，张三点击当前QQ语音通话界面的音乐插件入口图标50，则触发音频列表显示指令的生成，张三所使用的客户端准备接收用于指示音频列表的音频列表显示指令。参见图6，张三可以点击当前QQ视频通话界面的音乐插件入口图标50，则触发音频列表显示指令的生成，张三所使用的客户端准备接收用于指示音频列表的音频列表显示指令。Exemplarily, as shown in Figure 5, the local client (the client used by the user "Zhang San" chatting through QQ) receives the audio list display instruction through the music plug-in entry set in the current QQ voice call interface, so that the instant messaging The interface displays the audio list. Referring to FIG. 5 , Zhang San clicks the music plug-in entry icon 50 on the current QQ voice call interface, which triggers the generation of an audio list display instruction, and the client used by Zhang San is ready to receive the audio list display instruction for indicating the audio list. Referring to FIG. 6 , Zhang San can click the music plug-in entry icon 50 of the current QQ video call interface to trigger the generation of an audio list display instruction, and the client used by Zhang San is ready to receive the audio list display instruction for indicating the audio list.

步骤4012、本地客户端根据音频列表显示指令，在即时通讯界面显示音频列表。Step 4012, the local client terminal displays the audio list on the instant messaging interface according to the audio list display instruction.

本发明实施例中，音频列表可以记录有至少一条音频。需要说明的是，音频列表除了可以包括歌曲列表之外，还可以包括短音频列表。其中，歌曲列表的显示形式可以为任一音乐播放器显示的歌曲列表。短音频列表中记录的每个短音频存储在本地客户端，短音频为占用的存储空间小于预设空间阈值的预设音频。短音频列表中记录的每个短音频的触发接口的形式可以有多种，可选的，触发接口可以为每个短音频的名称，如“兴高采烈”、“伤心哭泣”，每个短音频的名称对应一种短音频，如用户点击“兴高采烈”，播放出的音频为“哈哈哈哈”，用户点击“伤心哭泣”，播放出的音频为“呜呜呜呜”；如图10所示，触发接口也可以为以文字形式记录每个短音频的内容，如“哈哈哈哈”、“呜呜呜呜”、“爱你”、“帅呆了”等等，用户点击“爱你”，播放出的音频为“爱你”；特别的，触发接口也可以如同QQ聊天界面的本地表情一样，图8是QQ聊天界面的本地表情的示意图，同样的，本发明实施例提供的短音频列表中的每个短音频的触发接口也可以为图8中的显示形式，不同的是，如图11所示，每一个表情图标对应一个短音频，当用户点击表情图标时，则触发相应的短音频进行播放，示例的，兴高采烈的表情图标对应的短音频可以为“哈哈哈哈”。如图5中，张三和李四在进行语音通话时，张三说完“财源滚滚”之后，可以选择一个短音频列表中兴高采烈的表情图标对应的短音频，这样，李四便可以听到。以图5为例，张三点击当前QQ语音通话界面的音乐插件入口图标50，然后张三所使用的客户端接收音频列表显示指令，再根据音频列表显示指令，在当前QQ语音通话界面显示音频列表90，如图9所示。需要说明的是，音频列表可以显示在当前QQ语音通话界面上，也可以不在当前QQ语音通话界面上显示，而是单独作为一个界面来显示，本发明实施例对此不作限定。In the embodiment of the present invention, the audio list may record at least one audio. It should be noted that, in addition to the song list, the audio list may also include a short audio list. Wherein, the display form of the song list may be a song list displayed by any music player. Each short audio recorded in the short audio list is stored in the local client, and the short audio is a preset audio whose storage space is less than a preset space threshold. The trigger interface of each short audio recorded in the short audio list can have multiple forms. Optionally, the trigger interface can be the name of each short audio, such as "joyful", "sad crying", and the name of each short audio. The name corresponds to a short audio. For example, when the user clicks "Joyful", the audio will be played as "Hahahaha", and when the user clicks "Sad and Crying", the audio will be played as "Wooooooohoo"; as shown in Figure 10, the trigger The interface can also record the content of each short audio in text form, such as "hahahaha", "wuwuwuwu", "love you", "you are so handsome", etc., and the user clicks "love you", and the audio will be played. The audio is "I love you"; in particular, the trigger interface can also be the same as the local emoticons of the QQ chat interface. Figure 8 is a schematic diagram of the local emoticons of the QQ chat interface. The trigger interface of each short audio can also be the display form in Figure 8. The difference is that, as shown in Figure 11, each emoticon corresponds to a short audio. When the user clicks on the emoticon, the corresponding short audio is triggered Play, for example, the short audio corresponding to the cheerful emoticon may be "hahahaha". As shown in Figure 5, when Zhang San and Li Si are making a voice call, after Zhang San has finished saying "money is rolling", he can choose a short audio corresponding to the elated emoticon icon in the short audio list, so that Li Si can hear . Taking Figure 5 as an example, Zhang San clicks the music plugin entry icon 50 on the current QQ voice call interface, and then the client used by Zhang San receives an audio list display command, and then displays the audio on the current QQ voice call interface according to the audio list display command. List 90, as shown in FIG. 9 . It should be noted that the audio list may be displayed on the current QQ voice call interface, or may not be displayed on the current QQ voice call interface, but displayed as a separate interface, which is not limited in the embodiment of the present invention.

示例的，图9是本发明实施例提供的一种音频列表的示意图，参见图9，该音频列表90中，左侧显示的是歌曲列表901，右侧显示的是短音频列表902。由于本地客户端未添加任何歌曲信息，因此，显示出来的歌曲列表901是一个空列表。具体的，图10为图9对应的详细示意图，在此不再赘述。As an example, FIG. 9 is a schematic diagram of an audio list provided by an embodiment of the present invention. Referring to FIG. 9 , in the audio list 90 , a song list 901 is displayed on the left, and a short audio list 902 is displayed on the right. Since the local client does not add any song information, the displayed song list 901 is an empty list. Specifically, FIG. 10 is a detailed schematic diagram corresponding to FIG. 9 , which will not be repeated here.

步骤4013、本地客户端通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令。Step 4013, the local client receives a song adding instruction through the search box set on the interface where the song list is located.

本地客户端可以通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令。示例的，参见图10，本地客户端可以通过设置在歌曲列表所在界面的搜索框101接收歌曲添加指令。搜索框101的输入格式可以为任一音乐播放器的搜索框的输入格式，如歌曲/歌手/专辑。字符“/”表示前后关联对象是一种“或”的关系。以图9为例，张三想以一首《恭喜发财》作为和李四语音通话的背景音乐，则在当前QQ语音通话界面的搜索框内可以直接输入“恭喜发财”，也可以直接输入“刘德华”，或者可以同时输入“恭喜发财刘德华”，张三根据显示出来的所有结果选择第一首歌曲时，张三所使用的客户端接收歌曲添加指令。图11为张三在当前QQ语音通话界面的搜索框内输入“恭喜发财”之后，显示出来的结果的示意图。The local client can receive song addition instructions through the search box set on the interface where the song list is located. For example, referring to FIG. 10 , the local client may receive a song adding instruction through the search box 101 provided on the interface where the song list is located. The input format of the search box 101 can be the input format of the search box of any music player, such as song/artist/album. The character "/" indicates that the associated objects before and after are an "or" relationship. Taking Figure 9 as an example, Zhang San wants to use the song "Gong Xi Fa Cai" as the background music for his voice call with Li Si, so he can directly input "Gong Xi Fa Cai" or " Andy Lau", or you can input "Gong Xi Fa Cai Andy Lau" at the same time, when Zhang San selects the first song according to all the displayed results, the client used by Zhang San receives the song addition instruction. Fig. 11 is a schematic diagram of the results displayed after Zhang San enters "Gong Xi Fa Cai" in the search box of the current QQ voice call interface.

步骤4014、本地客户端根据歌曲添加指令在网络获取歌曲添加指令指示的歌曲对应的链接。Step 4014, the local client obtains the link corresponding to the song indicated by the song addition instruction from the network according to the song addition instruction.

在4013的基础上，参见图9，张三所使用的客户端根据歌曲添加指令在网络上获取歌曲添加指令指示的歌曲(即新年贺岁歌曲)对应的链接。当本地客户端获取到歌曲添加指令指示的歌曲对应的链接后，便可以通过下载的方式获取该首歌曲。On the basis of 4013, referring to FIG. 9 , the client used by Zhang San acquires the link corresponding to the song indicated by the song addition instruction (that is, the New Year's Eve song) on the network according to the song addition instruction. After the local client obtains the link corresponding to the song indicated by the song adding instruction, the song can be obtained by downloading.

步骤4015、本地客户端将歌曲添加指令指示的歌曲的信息记录在歌曲列表中。Step 4015, the local client records the information of the song indicated by the song adding instruction in the song list.

歌曲添加指令指示的歌曲的信息可以为歌曲添加指令指示的歌曲对应的链接，也可以为根据链接下载的歌曲文件。The song information indicated by the song adding instruction may be a link corresponding to the song indicated by the song adding instruction, or may be a song file downloaded according to the link.

需要补充说明的是，本地客户端除了通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令，在网络获取歌曲添加指令指示的歌曲对应的链接外，还可以由用户选择本地的歌曲文件，那么步骤4014则具体可以包括：本地客户端根据歌曲添加指令在该本地客户端所安装的用户设备上获取添加指令(歌曲名称)指示的歌曲对应的文件夹。而步骤4015则具体可以包括：本地客户端将歌曲添加指令指示的本地歌曲文件记录在歌曲列表中。It needs to be added that, in addition to receiving the song addition instruction through the search box set on the interface where the song list is located on the local client, and obtaining the link corresponding to the song indicated by the song addition instruction on the network, the user can also select a local song file, then Step 4014 may specifically include: the local client obtains, according to the song adding instruction, the folder corresponding to the song indicated by the adding instruction (song name) on the user device installed on the local client. Step 4015 may specifically include: the local client records the local song file indicated by the song adding instruction in the song list.

步骤4016、本地客户端接收音频播放指令。Step 4016, the local client receives the audio playback instruction.

该音频播放指令指示的音频为在音频列表中被选择的音频。参见图9，张三所使用的客户端接收音频播放指令，音频播放指令指示的音频为图11中的音频列表包括的歌曲列表901中被选择的音频(如01-恭喜发财-刘德华)。或者，音频播放指令指示的音频为图11中的音频列表包括的短音频列表902中被选择的短音频(兴高采烈的表情图标对应的“哈哈哈哈”)。The audio indicated by the audio playing instruction is the audio selected in the audio list. Referring to FIG. 9, the client used by Zhang San receives an audio play instruction, and the audio indicated by the audio play instruction is the audio selected in the song list 901 included in the audio list in FIG. 11 (such as 01-Gong Xi Fa Cai-Andy Lau). Alternatively, the audio indicated by the audio play instruction is the short audio selected in the short audio list 902 included in the audio list in FIG. 11 ("hahahaha" corresponding to the elated emoticon icon).

在步骤402中，本地客户端获取音频播放指令指示的音频。参见图9，张三所使用的客户端获取新年贺岁歌曲音频，或者，获取兴高采烈的表情图标对应的“哈哈哈哈”音频。In step 402, the local client acquires the audio indicated by the audio playing instruction. Referring to FIG. 9 , the client used by Zhang San obtains the audio of the New Year's greeting song, or obtains the "hahahaha" audio corresponding to the elated emoticon.

上述歌曲列表中记录的音频可以包括付费音频。因此，本地客户端还可以检测音频播放指令指示的音频是否为付费音频。如果音频播放指令指示的音频为付费音频，本地客户端在获取音频播放指令指示的音频之前，还需要对用户进行权限验证，如果该用户通过了权限验证，那么该用户所使用的客户端才能获取音频播放指令指示的音频。如果该用户没有未通过权限验证，需要完成付费后，本地客户端再获取音频播放指令指示的音频。The audio recorded in the above song list may include premium audio. Therefore, the local client can also detect whether the audio indicated by the audio playing instruction is paid audio. If the audio indicated by the audio playback instruction is paid audio, the local client needs to verify the user's authority before obtaining the audio indicated by the audio playback instruction. If the user passes the authority authentication, then the client used by the user can obtain The audio indicated by the audio play command. If the user has not passed the authorization verification, the local client needs to obtain the audio indicated by the audio playback instruction after the payment is completed.

如果音频播放指令指示的音频是付费音频，则步骤402如图12所示，具体可以包括：If the audio indicated by the audio playback instruction is paid audio, then step 402, as shown in Figure 12, may specifically include:

步骤4021、本地客户端检测用户是否拥有预设权限。Step 4021, the local client checks whether the user has preset permissions.

该预设权限是服务器根据用户是否付费或者用户的等级授予的。示例的，服务器可以根据用户是否为选定的音频付费，如果用户已付费，则可以判断该用户拥有播放音频播放指令指示的音频的权限；如果用户未付费，则可以判断该用户没有播放音频播放指令指示的音频的权限。付费的方式很多，例如可以通过Q币进行付费，也可以通过在线银行进行付费。此外，还可以根据用户的等级进行权限判断，如果用户的等级为星星、月亮或太阳，则可以判断用户没有播放音频播放指令指示的音频的权限；如果用户的等级为皇冠，则可以判断用户有播放音频播放指令指示的音频的权限。The preset authority is granted by the server according to whether the user pays or not or the level of the user. For example, the server can determine whether the user has paid for the selected audio, if the user has paid, it can be determined that the user has the right to play the audio indicated by the audio playback instruction; if the user has not paid, it can be determined that the user has not played the audio playback Permissions for the audio indicated by the directive. There are many ways to pay, for example, payment can be made through Q coins, or through online banking. In addition, authority judgment can also be made according to the user's level. If the user's level is star, moon or sun, it can be judged that the user does not have the right to play the audio indicated by the audio playback instruction; if the user's level is crown, it can be judged that the user has Permission to play the audio indicated by the audio play command.

步骤4022、如果用户拥有预设权限，本地客户端获取音频播放指令指示的音频。Step 4022, if the user has the preset authority, the local client acquires the audio indicated by the audio playback instruction.

根据步骤4021的判断结果，决定本地客户端是否可以获取音频播放指令指示的音频。示例的，参见图9，张三当前的QQ等级为皇冠，则张三所使用的客户端可以获取新年贺岁歌曲音频，或者，获取兴高采烈的表情图标对应的“哈哈哈哈”音频。According to the judgment result of step 4021, it is determined whether the local client can obtain the audio indicated by the audio playback instruction. As an example, see Figure 9. Zhang San's current QQ level is Crown, so the client used by Zhang San can obtain the audio of the New Year's song, or obtain the audio of "hahahaha" corresponding to the elated emoticon.

需要说明的是，如果音频播放指令指示的音频不是付费音频，步骤402还可以包括：本地客户端检测用户是否为预设级别用户，预设级别用户拥有使用该音频列表的权利；如果用户为预设级别用户，本地客户端获取音频播放指令指示的音频。示例的，预设级别用户可以为黄钻用户或者绿钻用户，也可以为VIP用户等。It should be noted that, if the audio indicated by the audio playback instruction is not paid audio, step 402 may also include: the local client detects whether the user is a preset level user, and the preset level user has the right to use the audio list; Set level user, the local client obtains the audio indicated by the audio playback instruction. For example, the preset level user may be a yellow diamond user or a green diamond user, or may be a VIP user or the like.

在步骤403中，如果本地客户端的用户通过了权限验证，或者该用户为预设级别用户，该用户所使用的客户端可以获取音频播放指令指示的音频，接着，本地客户端便可以将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。In step 403, if the user of the local client has passed the authority verification, or the user is a preset level user, the client used by the user can obtain the audio indicated by the audio playback instruction, and then the local client can play the audio The audio indicated by the command is played as the background music of the audio-video session.

示例的，参见图9，张三通过了权限验证，张三所使用的客户端获取到了新年贺岁歌曲，或者，兴高采烈的表情图标对应的“哈哈哈哈”音频，便可以将这两个音频作为与李四语音通话的背景音乐进行播放。For example, see Figure 9. Zhang San has passed the authority verification, and the client used by Zhang San has obtained the New Year’s song, or the "hahahahaha" audio corresponding to the happy emoticon icon, and these two audios can be used as the corresponding The background music of Li Si's voice call is played.

在步骤404中，本发明实施例中，本地客户端将音频播放指令指示的音频传输至对端客户端的方法可以有多种，示例的，可以包括如下四种方法：In step 404, in the embodiment of the present invention, there may be multiple methods for the local client to transmit the audio indicated by the audio playback instruction to the peer client. For example, the following four methods may be included:

第一种方法，本地客户端通过麦克风采集音频并传输至对端客户端。如图13所示，具体可以包括：In the first method, the local client collects audio through the microphone and transmits it to the peer client. As shown in Figure 13, it may specifically include:

步骤4041、本地客户端通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频。Step 4041, the local client uses a microphone to collect the audio generated by the user's call and the audio played as the background music of the audio-video session.

示例的，参见图9，张三所使用的客户端通过麦克风采集张三与李四进行语音通话的过程中产生的音频，也就是图1中所涉及到的语音内容，以及作为语音通话背景音乐播放的新年贺岁歌曲音频。For example, see Figure 9. The client used by Zhang San collects the audio generated during the voice call between Zhang San and Li Si through a microphone, that is, the voice content involved in Figure 1, and serves as the background music of the voice call Play the audio of New Year's greeting songs.

步骤4042、本地客户端对麦克风采集的音频进行降噪处理。Step 4042, the local client performs noise reduction processing on the audio collected by the microphone.

本地客户端通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频时，由于操作不当或者周边环境吵杂，容易使语音信号在采集过程中受到噪声干扰，如果不对麦克风采集到的音频进行降噪处理，传输至对端客户端的音频将会发生变化，甚至变质。语音降噪是针对噪声处理的一种有效的处理技术，降噪的目的就是为了消除噪声的影响，提高音频清晰度、改善音频的质量。示例的，本地客户端可以采用两级维纳滤波方法分别对麦克风采集的用户通话产生的音频以及作为音视频会话的背景音乐播放的音频进行降噪处理，达到音频和噪声的最大可能分离的目的。音频降噪的方法很多，可以根据实际需求来选择合适的音频降噪方法，本发明实施例对此不作限定。When the local client uses the microphone to collect the audio generated by the user's call and the audio played as the background music of the audio and video conversation, due to improper operation or the surrounding environment is noisy, the voice signal is likely to be interfered by noise during the collection process. If the microphone is not collected If the audio is denoised, the audio transmitted to the peer client will change or even deteriorate. Speech noise reduction is an effective processing technology for noise processing. The purpose of noise reduction is to eliminate the influence of noise, improve audio clarity, and improve audio quality. For example, the local client can use the two-stage Wiener filtering method to respectively perform noise reduction processing on the audio generated by the user's call collected by the microphone and the audio played as the background music of the audio and video conversation, so as to achieve the maximum possible separation of audio and noise . There are many audio noise reduction methods, and an appropriate audio noise reduction method can be selected according to actual needs, which is not limited in this embodiment of the present invention.

步骤4043、本地客户端将经过降噪处理的麦克风采集的音频传输至对端客户端。Step 4043, the local client transmits the audio collected by the microphone that has undergone noise reduction processing to the peer client.

第二种方法，本地客户端通过网络服务器将音频播放指令指示的音频的文件同时下发给本地客户端和对端客户端。In the second method, the local client sends the audio file indicated by the audio playback instruction to the local client and the peer client at the same time through the network server.

以图9为例，张三所使用的客户端将新年贺岁歌曲的音频文件传输至网络服务器，该音频文件可以是从网络下载的，也可以是从本地上传的，这样，网络服务器可以将新年贺岁歌曲再同时下发给张三所使用的客户端和李四所使用的客户端，从而使得张三和李四在进行语音通话时，双方听到的作为背景音乐的音频是被同步播放的。Taking Figure 9 as an example, the client used by Zhang San transmits the audio file of the New Year's greetings song to the network server. The audio file can be downloaded from the network or uploaded locally. The New Year's song is sent to the client used by Zhang San and the client used by Li Si at the same time, so that when Zhang San and Li Si are making a voice call, the audio that both parties hear as background music is played synchronously .

第三种方法，本地客户端通过网络服务器将音频播放指令指示的音频的文件下发给对端客户端。In the third method, the local client sends the audio file indicated by the audio playback instruction to the peer client through the network server.

以图9为例，张三所使用的客户端将新年贺岁歌曲传输至网络服务器，这样，网络服务器可以将新年贺岁歌曲下发给李四所使用的客户端，李四所使用的客户端可以在缓存新年贺岁歌曲的文件的同时，播放新年贺岁歌曲的文件，即边下载边播放，这样可以保证张三和李四在进行语音通话时，双方听到的作为背景音乐的音频尽可能同步。Taking Figure 9 as an example, the client used by Zhang San transmits the New Year’s Eve songs to the network server, so that the network server can send the New Year’s Eve songs to the client used by Li Si, and the client used by Li Si can While caching the file of the New Year's greeting song, play the file of the New Year's greeting song, that is, play while downloading, so that when Zhang San and Li Si are making a voice call, the audio that both parties hear as background music is synchronized as much as possible.

第四种方法，本地客户端将音频播放指令指示的音频的URL传输至对端客户端。In a fourth method, the local client transmits the URL of the audio indicated by the audio playback instruction to the peer client.

本地客户端将音频播放指令指示的音频的URL(即歌曲添加指令指示的歌曲对应的链接)传输至对端客户端，对端客户端可以根据该URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The local client transmits the URL of the audio indicated by the audio play instruction (i.e. the link corresponding to the song indicated by the song addition instruction) to the peer client, and the peer client can download the audio indicated by the audio play instruction according to the URL, and send the audio The audio indicated by the play instruction is played as the background music of the audio-video session.

以图9为例，张三所使用的客户端并没有将新年贺岁歌曲传输至网络服务器，而是将这首歌曲的URL直接传输至李四所使用的客户端。此时，李四所使用的客户端需要根据张三发送的URL下载新年贺岁歌曲，在下载之后进行播放。Taking Fig. 9 as an example, the client used by Zhang San does not transmit the New Year's Eve song to the web server, but directly transmits the URL of this song to the client used by Li Si. At this time, the client used by Li Si needs to download the New Year's Eve song according to the URL sent by Zhang San, and play it after downloading.

在步骤405中，本地客户端可以通过网络服务器将音频播放指令指示的音频的文件下发给对端客户端，也可以将音频播放指令指示的音频的URL传输至对端客户端，因此，一方面，对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放可以包括：对端客户端在缓存音频播放指令指示的音频的文件的同时，播放音频的文件；另一方面，对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放可以包括：对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。In step 405, the local client can send the file of the audio indicated by the audio playback instruction to the opposite client through the network server, or transmit the URL of the audio indicated by the audio playback instruction to the opposite client. Therefore, a On the one hand, playing the audio indicated by the audio playback instruction by the peer client as the background music of the audio-video session may include: the peer client plays the audio file while buffering the audio file indicated by the audio playback instruction; on the other hand , the peer client playing the audio indicated by the audio play instruction as the background music of the audio-video session may include: the peer client downloads the audio indicated by the audio play instruction according to the URL, and uses the audio indicated by the audio play instruction as the audio-video session background music to play.

以图9为例，张三所使用的客户端将新年贺岁歌曲传输至网络服务器，网络服务器将新年贺岁歌曲同时下发给张三所使用的客户端和李四所使用的客户端，或者只下发给李四所使用的客户端，则李四所使用的客户端可以在缓存新年贺岁歌曲的同时对其进行播放，实现边缓存边播放的效果。Taking Figure 9 as an example, the client used by Zhang San transmits the New Year’s Eve songs to the network server, and the network server sends the New Year’s Eve songs to the client used by Zhang San and the client used by Li Si at the same time, or only Send it to the client used by Li Si, then the client used by Li Si can play the New Year's Eve songs while caching them, realizing the effect of caching and playing them at the same time.

同样以图9为例，张三所使用的客户端将新年贺岁歌曲的URL传输至李四所使用的客户端。李四所使用的客户端根据张三发送的URL下载新年贺岁歌曲，并将该歌曲作为与张三语音通话的背景音乐进行播放。Also taking Fig. 9 as an example, the client used by Zhang San transmits the URL of the New Year song to the client used by Li Si. The client used by Li Si downloads the New Year's Eve song according to the URL sent by Zhang San, and plays the song as the background music for the voice call with Zhang San.

本发明实施例提供的即时通讯方法易用性较高，该方法实现的功能可以作为增值功能，示例的，可以供黄钻或者VIP用户使用，或者功能列表内特定音乐付费使用。该方法在实现的过程中，如QQ软件，如果现有的开发环境无法支持同时播放作为背景音乐的音频与语音通话的音频，可以采取折中方案：向用户发送歌曲请求，用户收到提示框：“是否播放该首歌曲”，如果同意播放该首歌曲，则中断语音通话过程，开始播放歌曲，播放完毕后，可以再弹出对话框：“歌曲播放已完成，请继续进行语音通话”，此时，用户双方可继续进行语音通话。The instant messaging method provided by the embodiment of the present invention has high usability, and the functions realized by the method can be used as value-added functions, for example, can be used by yellow diamond or VIP users, or paid for specific music in the function list. In the process of realizing this method, such as QQ software, if the existing development environment cannot support playing the audio of the background music and the audio of the voice call at the same time, a compromise solution can be adopted: send a song request to the user, and the user receives a prompt box : "Whether to play the song", if you agree to play the song, the voice call process will be interrupted, and the song will start to play. , both users can continue to make voice calls.

需要说明的是，本发明实施例提供的即时通讯方法步骤的先后顺序可以进行适当调整，步骤也可以根据情况进行相应增减，如步骤403与步骤404的先后顺序可以调换，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化的方法，都应涵盖在本发明的保护范围之内，因此不再赘述。It should be noted that the order of the steps of the instant messaging method provided by the embodiment of the present invention can be appropriately adjusted, and the steps can also be increased or decreased according to the situation. For example, the order of steps 403 and 404 can be exchanged. Anyone familiar with the technical field Within the technical scope disclosed in the present invention, those skilled in the art can easily think of changing methods, all of which should be covered within the protection scope of the present invention, and thus will not be repeated here.

综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户双方的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。To sum up, in the instant messaging method provided by the embodiment of the present invention, during the instant messaging audio and video session, since the client can obtain the music plug-in entry set on the instant messaging interface as The audio of the background music of the audio and video conversation, and play the audio, so that on the premise of not affecting the audio and video communication between the two users, in addition to inputting simple chat content such as text, emoticons, screenshots, etc., the background music can also be played, so , which enriches the communication scenarios of instant messaging.

图14是本发明实施例提供的一种即时通讯装置70的结构示意图，该即时通讯装置70用于本地客户端，本地客户端为用户所使用的客户端，参见图14，即时通讯装置70可以包括：FIG. 14 is a schematic structural diagram of an instant messaging device 70 provided by an embodiment of the present invention. The instant messaging device 70 is used for a local client, and the local client is a client used by a user. Referring to FIG. 14 , the instant messaging device 70 can be include:

第一接收模块701，用于在即时通讯音视频会话过程中，通过设置在即时通讯界面的音乐插件入口接收音频播放指令；The first receiving module 701 is used to receive audio playback instructions through the music plug-in entry set on the instant messaging interface during the instant messaging audio and video session;

获取模块702，用于获取音频播放指令指示的音频；An acquisition module 702, configured to acquire the audio indicated by the audio playback instruction;

播放模块703，用于将音频播放指令指示的音频作为音视频会话的背景音乐进行播放；The playback module 703 is used to play the audio indicated by the audio playback instruction as the background music of the audio-video session;

发送模块704，用于将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，对端客户端为用户的聊天对象所使用的客户端。The sending module 704 is used to transmit the audio indicated by the audio play instruction to the peer client, so that the peer client plays the audio indicated by the audio play instruction as the background music of the audio-video session, and the peer client is the user's The client used by the chat partner.

综上所述，本发明实施例提供的即时通讯装置，在即时通讯音视频会话过程中，由于本地客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。To sum up, in the instant messaging device provided by the embodiment of the present invention, during the instant messaging audio and video session, since the local client communicates through the instant messaging interface, the local client can obtain the As the audio of the background music of the audio and video conversation, and play the audio, so that on the premise of not affecting the user's audio and video communication, in addition to inputting simple chat content such as text, emoticons, screenshots, etc., the background music can also be played, so , which enriches the communication scenarios of instant messaging.

图15是本发明实施例提供的另一种即时通讯装置70的结构示意图，该即时通讯装置70用于本地客户端，本地客户端为用户所使用的客户端，参见图15，该即时通讯装置70可以包括：FIG. 15 is a schematic structural diagram of another instant messaging device 70 provided by an embodiment of the present invention. The instant messaging device 70 is used for a local client, and the local client is a client used by a user. Referring to FIG. 15 , the instant messaging device 70 can include:

播放模块703，用于将音频播放指令指示的音频作为音视频会话的背景音乐进行播放；Playing module 703, is used for playing the audio frequency indicated by audio playing instruction as the background music of audio-video conversation;

可选的，上述发送模块704，用于：Optionally, the above sending module 704 is configured to:

通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频；Collect the audio generated by the user's call through the microphone and the audio played as the background music of the audio and video session;

对麦克风采集的音频进行降噪处理；Perform noise reduction processing on the audio collected by the microphone;

将经过降噪处理的麦克风采集的音频传输至对端客户端。Transmit the audio collected by the noise-reduced microphone to the peer client.

将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件同时下发给本地客户端和对端客户端。The audio file indicated by the audio play instruction is transmitted to the network server, so that the network server sends the audio file indicated by the audio play instruction to the local client and the peer client at the same time.

将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件下发给对端客户端。The audio file indicated by the audio play instruction is transmitted to the network server, so that the network server sends the audio file indicated by the audio play instruction to the peer client.

将音频播放指令指示的音频的URL传输至对端客户端，以使得对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The URL of the audio indicated by the audio play instruction is transmitted to the peer client, so that the peer client downloads the audio indicated by the audio play instruction according to the URL, and plays the audio indicated by the audio play instruction as the background music of the audio-video session.

可选的，上述第一接收模块701，用于：Optionally, the above-mentioned first receiving module 701 is configured to:

通过设置在即时通讯界面的音乐插件入口接收音频列表显示指令；Receive audio list display instructions through the music plug-in entry set on the instant messaging interface;

根据音频列表显示指令，在即时通讯界面显示音频列表，音频列表记录有至少一条音频；According to the audio list display instruction, the audio list is displayed on the instant messaging interface, and the audio list records at least one audio;

接收音频播放指令，音频播放指令指示的音频为在音频列表中被选择的音频。An audio play instruction is received, and the audio indicated by the audio play instruction is the audio selected in the audio list.

可选的，音频列表包括歌曲列表。参见图15，该即时通讯装置70还可以包括：Optionally, the audio list includes a song list. Referring to Figure 15, the instant messaging device 70 may also include:

第二接收模块705，用于通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令；The second receiving module 705 is used to receive song addition instructions through the search box provided on the interface where the song list is located;

添加模块706，用于根据歌曲添加指令在网络获取歌曲添加指令指示的歌曲对应的链接；Adding module 706, is used for according to song adding instruction acquisition song corresponding link of song adding instruction indication in network;

记录模块707，用于将歌曲添加指令指示的歌曲的信息记录在歌曲列表中，歌曲的信息为歌曲添加指令指示的歌曲对应的链接，或者根据链接下载的歌曲文件。The recording module 707 is configured to record information of the song indicated by the song adding instruction in the song list, where the information of the song is a link corresponding to the song indicated by the song adding instruction, or a song file downloaded according to the link.

可选的，上述获取模块702，用于：Optionally, the above acquisition module 702 is used for:

检测用户是否拥有预设权限，预设权限是服务器根据用户是否付费或者用户的等级授予的；Detect whether the user has preset permissions, which are granted by the server according to whether the user pays or the user's level;

如果用户拥有预设权限，获取音频播放指令指示的音频。If the user has preset permissions, get the audio indicated by the audio playback command.

图16是本发明实施例提供的又一种即时通讯装置70的结构示意图，该即时通讯装置70用于对端客户端，对端客户端为用户的聊天对象所使用的客户端，参见图16，该即时通讯装置70可以包括：FIG. 16 is a schematic structural diagram of another instant messaging device 70 provided by an embodiment of the present invention. The instant messaging device 70 is used for a peer client, and the peer client is a client used by a user's chat partner. See FIG. 16 , the instant messaging device 70 may include:

接收模块708，用于在即时通讯音视频会话过程中，接收本地客户端传输的音频播放指令指示的音频，音频播放指令是本地客户端通过设置在即时通讯界面的音乐插件入口接收的；The receiving module 708 is used to receive the audio indicated by the audio playback instruction transmitted by the local client during the instant messaging audio and video session, and the audio playback instruction is received by the local client through the music plug-in entrance provided on the instant messaging interface;

播放模块709，用于将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The playing module 709 is configured to play the audio indicated by the audio playing instruction as the background music of the audio-video session.

综上所述，本发明实施例提供的即时通讯装置，在即时通讯音视频会话过程中，由于对端客户端在用户的聊天对象通过即时通讯界面通讯的同时，能够接收本地客户端传输的音频并作为背景音乐播放，在不影响该用户的聊天对象的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。In summary, in the instant messaging device provided by the embodiment of the present invention, during the instant messaging audio and video session, since the peer client can receive the audio transmitted by the local client while the user's chat partner communicates through the instant messaging interface And play it as background music, without affecting the audio and video communication of the user's chat partner, in addition to inputting simple chat content such as text, emoticons, screenshots, etc. at the same time, background music can also be played, thus enriching the instant messaging experience communication scene.

可选的，上述接收模块708，用于：Optionally, the above receiving module 708 is configured to:

接收网络服务器下发的音频播放指令指示的音频的文件，音频播放指令指示的音频的文件是本地客户端上传至网络服务器的；Receive the audio file indicated by the audio play instruction issued by the network server, and the audio file indicated by the audio play instruction is uploaded to the network server by the local client;

上述播放模块709，用于：The above playing module 709 is used for:

在缓存音频播放指令指示的音频的文件的同时，播放音频的文件。The audio file is played while buffering the audio file indicated by the audio play instruction.

接收本地客户端传输的音频播放指令指示的音频的URL；Receive the URL of the audio indicated by the audio playback instruction transmitted by the local client;

上述播放模块709，用于：The above playing module 709 is used for:

根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。Download the audio indicated by the audio playing instruction according to the URL, and play the audio indicated by the audio playing instruction as the background music of the audio-video session.

本发明实施例提供了一种即时通讯系统，包括图14、图15或图16所示的即时通讯装置。An embodiment of the present invention provides an instant messaging system, including the instant messaging device shown in FIG. 14 , FIG. 15 or FIG. 16 .

所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

图17是本发明实施例提供的一种终端500的结构示意图。该终端500可以为上述实施例中的用户设备。参见图17，终端500可以包括通信单元510、包括有一个或一个以上计算机可读存储介质的存储器520、输入单元530、显示单元540、传感器550、音频电路560、WIFI(Wireless Fidelity，无线保真)模块570、包括有一个或者一个以上处理核心的处理器580、以及电源590等部件。本领域技术人员可以理解，图17中示出的终端结构并不构成对终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。其中：FIG. 17 is a schematic structural diagram of a terminal 500 provided by an embodiment of the present invention. The terminal 500 may be the user equipment in the foregoing embodiments. 17, the terminal 500 may include a communication unit 510, a memory 520 including one or more computer-readable storage media, an input unit 530, a display unit 540, a sensor 550, an audio circuit 560, a WIFI (Wireless Fidelity, wireless fidelity ) module 570, a processor 580 including one or more processing cores, and a power supply 590 and other components. Those skilled in the art can understand that the terminal structure shown in FIG. 17 does not constitute a limitation on the terminal, and may include more or less components than shown in the figure, or combine some components, or arrange different components. in:

通信单元510可用于收发信息或通话过程中，信号的接收和发送，该通信单元510可以为RF(Radio Frequency，射频)电路、路由器、调制解调器、等网络通信设备。特别地，当通信单元510为RF电路时，将基站的下行信息接收后，交由一个或者一个以上处理器580处理；另外，将涉及上行的数据发送给基站。通常，作为通信单元的RF电路包括但不限于天线、至少一个放大器、调谐器、一个或多个振荡器、用户身份模块(SIM)卡、收发信机、耦合器、LNA(Low Noise Amplifier，低噪声放大器)、双工器等。此外，通信单元510还可以通过无线通信与网络和其他设备通信。无线通信可以使用任一通信标准或协议，包括但不限于GSM(Global System of Mobile communication，全球移动通讯系统)、GPRS(General Packet Radio Service，通用分组无线服务)、CDMA(Code Division Multiple Access，码分多址)、WCDMA(Wideband Code Division Multiple Access，宽带码分多址)、LTE(Long Term Evolution，长期演进)、电子邮件、SMS(Short Messaging Service，短消息服务)等。存储器520可用于存储软件程序以及模块，处理器580通过运行存储在存储器520的软件程序以及模块，从而执行各种功能应用以及数据处理。存储器520可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据终端500的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器520可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。相应地，存储器520还可以包括存储器控制器，以提供处理器580和输入单元530对存储器520的访问。The communication unit 510 can be used for sending and receiving information or receiving and sending signals during a call. The communication unit 510 can be an RF (Radio Frequency, radio frequency) circuit, router, modem, and other network communication equipment. In particular, when the communication unit 510 is an RF circuit, after receiving the downlink information of the base station, it is processed by one or more processors 580; in addition, the uplink data is sent to the base station. Typically, an RF circuit as a communication unit includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier, Low noise amplifier), duplexer, etc. In addition, the communication unit 510 can also communicate with a network and other devices through wireless communication. Wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code Division Multiple Access, code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), LTE (Long Term Evolution, Long Term Evolution), email, SMS (Short Messaging Service, Short Message Service), etc. The memory 520 can be used to store software programs and modules, and the processor 580 executes various functional applications and data processing by running the software programs and modules stored in the memory 520 . The memory 520 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created using the terminal 500 (such as audio data, phone book, etc.) and the like. In addition, the memory 520 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 520 may further include a memory controller to provide access to the memory 520 by the processor 580 and the input unit 530 .

输入单元530可用于接收输入的数字或字符信息，以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。优选地，输入单元530可包括触敏表面531以及其他输入设备532。触敏表面531，也称为触摸显示屏或者触控板，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触敏表面531上或在触敏表面531附近的操作)，并根据预先设定的程式驱动相应的连接装置。可选地，触敏表面531可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器580，并能接收处理器580发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触敏表面531。除了触敏表面531，输入单元530还可以包括其他输入设备532。优选地，其他输入设备532可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。The input unit 530 can be used to receive input numbers or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Preferably, the input unit 530 may include a touch-sensitive surface 531 and other input devices 532 . The touch-sensitive surface 531, also referred to as a touch screen or a touchpad, can collect user touch operations on or near it (for example, the user uses any suitable object or accessory such as a finger, a stylus, etc. on the touch-sensitive surface 531 or on The operation near the touch-sensitive surface 531), and drive the corresponding connection device according to the preset program. Optionally, the touch-sensitive surface 531 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 580, and can receive and execute commands sent by the processor 580. In addition, the touch-sensitive surface 531 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 531 , the input unit 530 may also include other input devices 532 . Preferably, other input devices 532 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, and the like.

显示单元540可用于显示由用户输入的信息或提供给用户的信息以及终端500的各种图形用户接口，这些图形用户接口可以由图形、文本、图标、视频和其任意组合来构成。显示单元540可包括显示面板541，可选地，可以采用LCD(Liquid Crystal Display，液晶显示器)、OLED(Organic Light-Emitting Diode，有机发光二极管)等形式来配置显示面板541。进一步的，触敏表面531可覆盖显示面板541，当触敏表面531检测到在其上或附近的触摸操作后，传送给处理器580以确定触摸事件的类型，随后处理器580根据触摸事件的类型在显示面板541上提供相应的视觉输出。虽然在图17中，触敏表面531与显示面板541是作为两个独立的部件来实现输入和输入功能，但是在某些实施例中，可以将触敏表面531与显示面板541集成而实现输入和输出功能。The display unit 540 can be used to display information input by or provided to the user and various graphical user interfaces of the terminal 500. These graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. The display unit 540 may include a display panel 541. Optionally, the display panel 541 may be configured in the form of LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light-emitting diode), and the like. Further, the touch-sensitive surface 531 may cover the display panel 541, and when the touch-sensitive surface 531 detects a touch operation on or near it, it is sent to the processor 580 to determine the type of the touch event, and then the processor 580 determines the type of the touch event according to the touch event. The type provides a corresponding visual output on the display panel 541 . Although in FIG. 17 , the touch-sensitive surface 531 and the display panel 541 are used as two independent components to realize input and input functions, in some embodiments, the touch-sensitive surface 531 and the display panel 541 can be integrated to realize input. and output functions.

终端500还可包括至少一种传感器550，比如光传感器、运动传感器以及其他传感器。光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板541的亮度，接近传感器可在终端500移动到耳边时，关闭显示面板541和/或背光。作为运动传感器的一种，重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；至于终端500还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。The terminal 500 may also include at least one sensor 550, such as a light sensor, a motion sensor, and other sensors. The light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 541 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 541 and/or the backlight when the terminal 500 moves to the ear . As a kind of motion sensor, the gravitational acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the attitude of mobile phones (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition-related functions (such as pedometer, tap), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. Let me repeat.

音频电路560、扬声器561，传声器562可提供用户与终端500之间的音频接口。音频电路560可将接收到的音频数据转换后的电信号，传输到扬声器561，由扬声器561转换为声音信号输出；另一方面，传声器562将收集的声音信号转换为电信号，由音频电路560接收后转换为音频数据，再将音频数据输出处理器580处理后，经通信单元510以发送给比如另一终端，或者将音频数据输出至存储器520以便进一步处理。音频电路560还可能包括耳塞插孔，以提供外设耳机与终端500的通信。The audio circuit 560 , the speaker 561 and the microphone 562 can provide an audio interface between the user and the terminal 500 . The audio circuit 560 can transmit the electrical signal converted from the received audio data to the loudspeaker 561, and the loudspeaker 561 converts it into an audio signal output; After being received, it is converted into audio data, and then the audio data is processed by the output processor 580, and then sent to, for example, another terminal through the communication unit 510, or the audio data is output to the memory 520 for further processing. The audio circuit 560 may also include an earplug jack to provide communication between an external earphone and the terminal 500.

为了实现无线通信，该终端上可以配置有无线通信单元570，该无线通信单元570可以为WIFI模块。WIFI属于短距离无线传输技术，终端500通过无线通信单元570可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图中示出了无线通信单元570，但是可以理解的是，其并不属于终端500的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。In order to realize wireless communication, a wireless communication unit 570 may be configured on the terminal, and the wireless communication unit 570 may be a WIFI module. WIFI is a short-distance wireless transmission technology. The terminal 500 can help users send and receive emails, browse web pages, and access streaming media through the wireless communication unit 570. It provides users with wireless broadband Internet access. Although the wireless communication unit 570 is shown in the figure, it can be understood that it is not an essential component of the terminal 500, and can be completely omitted as required without changing the essence of the invention.

处理器580是终端500的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器520内的软件程序和/或模块，以及调用存储在存储器520内的数据，执行终端500的各种功能和处理数据，从而对手机进行整体监控。可选地，处理器580可包括一个或多个处理核心；优选的，处理器580可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器580中。The processor 580 is the control center of the terminal 500, and uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and/or modules stored in the memory 520, and calling data stored in the memory 520, Execute various functions and process data of the terminal 500, so as to monitor the mobile phone as a whole. Optionally, the processor 580 may include one or more processing cores; preferably, the processor 580 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 580 .

终端500还包括给各个部件供电的电源590(比如电池)，优选的，电源可以通过电源管理系统与处理器580逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。电源560还可以包括一个或一个以上的直流或交流电源、再充电系统、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。The terminal 500 also includes a power supply 590 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 580 through the power management system, so that functions such as charging, discharging, and power consumption management can be implemented through the power management system. The power supply 560 may also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.

尽管未示出，终端500还可以包括摄像头、蓝牙模块等，在此不再赘述。Although not shown, the terminal 500 may also include a camera, a Bluetooth module, etc., which will not be repeated here.

在本实施例中，终端还包括有一个或者一个以上的程序，这一个或者一个以上程序存储于存储器中，且经配置以由一个或者一个以上处理器执行，一方面，一个或者一个以上程序包含用于进行本发明实施例提供的如下的即时通讯方法的指令：In this embodiment, the terminal further includes one or more programs, which are stored in the memory and configured to be executed by one or more processors. On the one hand, the one or more programs include Instructions for performing the following instant messaging method provided by the embodiment of the present invention:

在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令。During the instant messaging audio and video session, the local client receives the audio playback instruction through the music plug-in entry set on the instant messaging interface.

本地客户端获取音频播放指令指示的音频。The local client obtains the audio indicated by the audio playback instruction.

本地客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The local client plays the audio indicated by the audio playing instruction as the background music of the audio-video session.

本地客户端将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，对端客户端为用户的聊天对象所使用的客户端。The local client transmits the audio indicated by the audio playback instruction to the peer client, so that the peer client plays the audio indicated by the audio playback instruction as the background music of the audio-video session. The client used.

本地客户端将音频播放指令指示的音频的URL传输至对端客户端，以使得对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The local client transmits the URL of the audio indicated by the audio playback instruction to the peer client, so that the peer client downloads the audio indicated by the audio playback instruction according to the URL, and uses the audio indicated by the audio playback instruction as the background music of the audio-video session to play.

可选的，音频列表包括歌曲列表，Optionally, the audio list includes a list of songs,

在本地客户端接收音频播放指令之前，该方法还包括：Before the local client receives the audio playback instruction, the method further includes:

本地客户端根据歌曲添加指令在网络获取歌曲添加指令指示的歌曲对应的链接；The local client obtains the link corresponding to the song indicated by the song addition instruction in the network according to the song addition instruction;

另一方面，一个或者一个以上程序包含用于进行本发明实施例提供的如下的即时通讯方法的指令：On the other hand, one or more programs include instructions for performing the following instant messaging methods provided by the embodiments of the present invention:

在即时通讯音视频会话过程中，对端客户端接收本地客户端传输的音频播放指令指示的音频，该音频播放指令是本地客户端通过设置在即时通讯界面的音乐插件入口接收的，对端客户端为用户的聊天对象所使用的客户端。During the instant messaging audio and video session, the peer client receives the audio indicated by the audio playback instruction transmitted by the local client. Client is the client used by the user's chat partner.

对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The peer client plays the audio indicated by the audio playing instruction as the background music of the audio-video session.

对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。The peer client downloads the audio indicated by the audio playback instruction according to the URL, and plays the audio indicated by the audio playback instruction as the background music of the audio-video session.

综上所述，本发明实施例提供的终端，在即时通讯音视频会话过程中，由于客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。To sum up, in the terminal provided by the embodiment of the present invention, during an instant messaging audio and video session, since the client can obtain audio and video information through the music plug-in entry set on the instant messaging interface while the user communicates through the instant messaging interface. The audio of the background music of the conversation, and play the audio, so that on the premise of not affecting the user's audio and video communication, in addition to inputting simple chat content such as text, emoticons, screenshots, etc., the background music can also be played, thus enriching Instant messaging communication scene.

本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成，也可以通过程序来指令相关的硬件完成，所述的程序可以存储于一种计算机可读存储介质中，上述提到的存储介质可以是只读存储器，磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps for implementing the above embodiments can be completed by hardware, and can also be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium. The above-mentioned The storage medium mentioned may be a read-only memory, a magnetic disk or an optical disk, and the like.

以上所述仅为本发明的较佳实施例，并不用以限制本发明，凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection of the present invention. within range.