Movatterモバイル変換


[0]ホーム

URL:


CN110264986A - Online K song device, method and computer readable storage medium - Google Patents

Online K song device, method and computer readable storage medium
Download PDF

Info

Publication number
CN110264986A
CN110264986ACN201910252219.3ACN201910252219ACN110264986ACN 110264986 ACN110264986 ACN 110264986ACN 201910252219 ACN201910252219 ACN 201910252219ACN 110264986 ACN110264986 ACN 110264986A
Authority
CN
China
Prior art keywords
main
audio stream
accompaniment
video stream
singer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910252219.3A
Other languages
Chinese (zh)
Other versions
CN110264986B (en
Inventor
林友尧
金健忠
关旭
邱国钦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Instant Construction Technology Co Ltd
Original Assignee
Shenzhen Instant Construction Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Instant Construction Technology Co LtdfiledCriticalShenzhen Instant Construction Technology Co Ltd
Priority to CN201910252219.3ApriorityCriticalpatent/CN110264986B/en
Publication of CN110264986ApublicationCriticalpatent/CN110264986A/en
Application grantedgrantedCritical
Publication of CN110264986BpublicationCriticalpatent/CN110264986B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Classifications

Landscapes

Abstract

Translated fromChinese

一种在线K歌方法,包括:获取登陆一虚拟K歌房间的用户身份信息;当用户身份为主唱时,获取主唱选定的歌曲信息并输出与歌曲信息对应的伴奏MV;采集主唱声音及主唱影像;将主唱声音与伴奏MV的伴奏音乐进行混合得到第一混合声音;将第一混合声音、主唱影像分别封装成主音频流及主视频流,并将主音频流、主视频流、伴奏MV及伴奏MV的歌词时间戳传送至一服务器;当用户身份为观众时,从服务器获取主音频流、主视频流、伴奏MV及歌词时间戳并解析输出。本发明还提供一种在线K歌装置及计算机可读存储介质。上述在线K歌装置、方法及计算机可读存储介质,可模拟线下KTV场景,用户可实时观赏他人演唱,提升用户使用体验。

An online karaoke method, comprising: acquiring identity information of a user who logs into a virtual karaoke room; when the user identity is the lead singer, obtaining song information selected by the lead singer and outputting an accompaniment MV corresponding to the song information; collecting lead singer voice and lead singer Image; mixing the voice of the lead vocalist with the accompaniment music of the accompaniment MV to obtain the first mixed sound; packaging the first mixed sound and the image of the lead singer into a main audio stream and a main video stream respectively, and combining the main audio stream, the main video stream, and the accompaniment MV and the timestamp of the lyrics of the accompanying MV are sent to a server; when the user is a viewer, the main audio stream, the main video stream, the accompanying MV and the timestamp of the lyrics are obtained from the server and analyzed and output. The invention also provides an online karaoke device and a computer-readable storage medium. The above-mentioned online karaoke device, method and computer-readable storage medium can simulate an offline KTV scene, and users can watch other people's singing in real time, improving user experience.

Description

Translated fromChinese
在线K歌装置、方法及计算机可读存储介质Online karaoke device, method and computer-readable storage medium

技术领域technical field

本发明涉及多媒体技术领域,尤其涉及一种在线K歌装置、方法及计算机可读存储介质。The invention relates to the field of multimedia technology, in particular to an online karaoke device, method and computer-readable storage medium.

背景技术Background technique

卡拉OK是人们休闲娱乐的一种方式,也是线下社交中的保留节目。而建立在计算机网络通信基础上的在线卡拉OK,凭借其自身方便、低成本和互动性强等特点,日益受到人们的关注和认同。现有的在线K歌软件一般支持的K歌模式是用户登录后,根据选择的伴奏音乐自己唱歌自己听或者是录制唱歌后分享给其他用户听,模式较单一,用户体验不佳。Karaoke is a way of leisure and entertainment for people, and it is also a reserved program in offline social interaction. On the basis of computer network communication, online karaoke is increasingly attracting people's attention and recognition by virtue of its own convenience, low cost and strong interaction. The karaoke mode generally supported by existing online karaoke software is that after the user logs in, he sings according to the selected accompaniment music and listens to himself or records the singing and shares it with other users. The mode is relatively single and the user experience is not good.

发明内容Contents of the invention

有鉴于此,有必要提供一种在线K歌装置、方法及计算机可读存储介质,其可实现模拟线下KTV场景,用户可实时听、看其他用户的歌声及伴奏MV,提升用户使用体验。In view of this, it is necessary to provide an online karaoke device, method and computer-readable storage medium, which can simulate offline KTV scenes, and users can listen to and watch other users' singing and accompaniment MV in real time, so as to improve user experience.

本发明一实施方式提供一种在线K歌方法,所述方法包括:An embodiment of the present invention provides an online karaoke method, the method comprising:

获取登陆一虚拟K歌房间的用户身份信息;Obtain the identity information of users who log in to a virtual karaoke room;

当所述用户身份为主唱时,获取所述主唱选定的歌曲信息并输出与所述歌曲信息对应的伴奏MV;When the user identity is the lead singer, obtain the song information selected by the lead singer and output the accompaniment MV corresponding to the song information;

采集主唱声音及主唱影像;Collect the voice of the lead singer and the image of the lead singer;

将所述主唱声音与所述伴奏MV的伴奏音乐进行混合得到第一混合声音;Mixing the lead singer voice with the accompaniment music of the accompaniment MV to obtain a first mixed voice;

将所述第一混合声音、所述主唱影像分别封装成主音频流及主视频流,并将所述主音频流、所述主视频流、所述伴奏MV及所述伴奏MV的歌词时间戳传送至一服务器;Encapsulating the first mixed sound and the lead vocal image into a main audio stream and a main video stream respectively, and timestamping the lyrics of the main audio stream, the main video stream, the accompaniment MV and the accompaniment MV sent to a server;

当所述用户身份为观众时,从所述服务器获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳;及When the user identity is a viewer, obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server; and

解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像。Parsing the main audio stream and the main video stream to obtain the first mixed sound and the main vocal image.

优选地,所述虚拟K歌房间包括单人K歌模式、双人K歌模式、多人K歌模式及多麦直播K歌模式。Preferably, the virtual karaoke room includes a single karaoke mode, a two-person karaoke mode, a multi-person karaoke mode and a multi-mic live karaoke mode.

优选地,当所述虚拟K歌房间为所述双人K歌模式,所述方法还包括:Preferably, when the virtual karaoke room is the two-person karaoke mode, the method also includes:

当所述用户身份为副唱时,从所述服务器获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像;When the user identity is sub-singer, obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server, and analyze the main audio stream and the main video stream , to obtain the first mixed sound and the lead singer image;

采集副唱声音及副唱影像;及Acquisition of sub-singer voice and video of sub-singer; and

将所述副唱声音、所述副唱影像分别封装成副音频流及副视频流传送至所述服务器。Encapsulating the sub-song sound and the sub-song image respectively into a sub-audio stream and a sub-video stream and sending them to the server.

优选地,所述方法还包括:Preferably, the method also includes:

当所述用户身份为主唱时,从所述服务器获取并输出所述副音频流。When the user identity is the main vocalist, the secondary audio stream is obtained from the server and output.

优选地,所述方法还包括:Preferably, the method also includes:

当所述用户身份为观众时,识别所述观众选取的听歌模式,其中所述听歌模式包括第一听歌模式及第二听歌模式;When the user identity is an audience, identify the listening mode selected by the audience, wherein the listening mode includes a first listening mode and a second listening mode;

当所述观众选择的听歌模式为所述第一听歌模式时,从所述服务器获取所述主视频流,解析所述主视频流,以输出所述主唱影像;及When the listening mode selected by the viewer is the first listening mode, obtain the main video stream from the server, analyze the main video stream, and output the main vocal image; and

当所述观众选择的听歌模式为所述第二听歌模式时,从所述服务器获取所述主音频流、所述副音频流、所述副视频流、所述伴奏MV及所述歌词时间戳,解析所述主音频流、所述副音频流及所述副视频流,以得到第二混合声音及所述副唱影像,其中所述第二混合声音包括所述主唱声音、所述副唱声音及所述伴奏MV的伴奏音乐。When the listening mode selected by the audience is the second listening mode, obtain the main audio stream, the secondary audio stream, the secondary video stream, the accompaniment MV and the lyrics from the server Timestamp, analyzing the main audio stream, the secondary audio stream and the secondary video stream to obtain the second mixed sound and the sub-singer image, wherein the second mixed sound includes the main vocal sound, the The voice of the sub-singer and the accompaniment music of the accompaniment MV.

优选地,当所述虚拟K歌房间为所述多麦直播K歌模式,所述方法还包括:Preferably, when the virtual karaoke room is the multi-mai live karaoke mode, the method further includes:

当所述用户身份为麦主时,从所述服务器获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像;When the user identity is a microphone master, obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server, and analyze the main audio stream and the main video stream , to obtain the first mixed sound and the lead singer image;

采集麦主声音及麦主影像;及Collect Mai Zhu's voice and Mai Zhu's video; and

将所述麦主声音、所述麦主影像分别封装成麦音频流及麦视频流传送至所述服务器。Encapsulating the microphone audio and the microphone image respectively into a microphone audio stream and a microphone video stream and sending them to the server.

优选地,所述方法还包括:Preferably, the method also includes:

当所述用户身份为主唱时,识别所述主唱选取的互动模式,其中所述互动模式包括第一互动模式及第二互动模式;When the user identity is the lead singer, identify the interaction mode selected by the lead singer, wherein the interaction mode includes a first interaction mode and a second interaction mode;

当所述主唱选择的互动模式为所述第一互动模式时,获取所述主唱选定的歌曲信息并输出与所述歌曲信息对应的伴奏MV;及When the interaction mode selected by the lead singer is the first interaction mode, acquiring song information selected by the lead singer and outputting an accompaniment MV corresponding to the song information; and

当所述主唱选择的互动模式为所述第二互动模式时,从所述服务器获取所述麦音频流及所述麦视频流,解析所述麦音频流及所述麦视频流,以输出所述麦主声音及所述麦主影像。When the interaction mode selected by the lead singer is the second interaction mode, obtain the microphone audio stream and the microphone video stream from the server, analyze the microphone audio stream and the microphone video stream, and output the The voice of Maizhu and the image of Maizhu.

优选地,所述方法还包括:Preferably, the method also includes:

当所述用户身份为观众时,识别所述观众选取的听歌模式,其中所述听歌模式包括第一听歌模式及第二听歌模式;When the user identity is an audience, identify the listening mode selected by the audience, wherein the listening mode includes a first listening mode and a second listening mode;

当所述观众选择的听歌模式为所述第一听歌模式时,从所述服务器获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像;及When the listening mode selected by the audience is the first listening mode, obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server, and analyze the a main audio stream and the main video stream to obtain the first mixed sound and the main vocal image; and

当所述观众选择的听歌模式为所述第二听歌模式时,从所述服务器获取所述麦音频流及所述麦视频流,解析所述麦音频流及所述麦视频流,以输出所述麦主声音及所述麦主影像。When the listening mode selected by the audience is the second listening mode, obtain the wheat audio stream and the wheat video stream from the server, analyze the wheat audio stream and the wheat video stream, and Outputting the main microphone sound and the main main image.

本发明一实施方式提供一种在线K歌装置,所述在线K歌装置包括显示屏、麦克风、扬声器、摄像头、处理器及存储器,所述存储器上存储有在线K歌程序,所述处理器用于执行所述存储器中存储的在线K歌程序时实现上述在线K歌方法的步骤。An embodiment of the present invention provides an online karaoke device, the online karaoke device includes a display screen, a microphone, a speaker, a camera, a processor and a memory, the memory is stored with an online karaoke program, and the processor is used to When the online karaoke program stored in the memory is executed, the above steps of the online karaoke method are realized.

本发明一实施方式提供一种计算机可读存储介质,所述计算机可读存储介质存储有多条指令,多条所述指令可被一个或者多个处理器执行,以实现上述的在线K歌方法的步骤。One embodiment of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a plurality of instructions, and the plurality of instructions can be executed by one or more processors to implement the above online karaoke method A step of.

与现有技术相比,上述在线K歌装置、方法及计算机可读存储介质,基于互联网的在线K歌方式可使得用户在线体验线下KTV的歌唱场景,且支持多样化K歌模式,提升用户使用体验。Compared with the prior art, the above-mentioned online karaoke device, method and computer-readable storage medium, the online karaoke mode based on the Internet can enable users to experience the singing scene of offline KTV online, and support diversified karaoke modes, improving the user experience. Use experience.

附图说明Description of drawings

图1是本发明一实施方式的在线K歌装置的架构示意图。FIG. 1 is a schematic structural diagram of an online karaoke device according to an embodiment of the present invention.

图2是本发明一实施方式的在线K歌系统的功能模块图。Fig. 2 is a functional block diagram of an online karaoke system according to an embodiment of the present invention.

图3是本发明一实施方式的单人K歌模式下在线K歌装置的运行环境图。Fig. 3 is an operating environment diagram of an online karaoke device in a single karaoke mode according to an embodiment of the present invention.

图4是本发明一实施方式的双单人K歌模式下在线K歌装置的运行环境图。Fig. 4 is an operating environment diagram of an online karaoke device in a dual-single-person karaoke mode according to an embodiment of the present invention.

图5是本发明一实施方式的多麦直播K歌模式下在线K歌装置的运行环境图。Fig. 5 is an operating environment diagram of an online karaoke device in a multi-mic live karaoke mode according to an embodiment of the present invention.

图6是本发明一实施方式的在线K歌方法的流程图。Fig. 6 is a flowchart of an online karaoke method according to an embodiment of the present invention.

主要元件符号说明Description of main component symbols

具体实施方式Detailed ways

如下具体实施方式将结合上述附图进一步说明本发明。The following specific embodiments will further illustrate the present invention in conjunction with the above-mentioned drawings.

为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

进一步需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It is further to be noted that in this document, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements , but also includes other elements not expressly listed, or also includes elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

请参阅图1,为本发明在线K歌装置较佳实施例的示意图。Please refer to FIG. 1 , which is a schematic diagram of a preferred embodiment of the online karaoke device of the present invention.

在线K歌装置100包括存储器10、处理器20以及存储在所述存储器10中并可在所述处理器20上运行的在线K歌系统30,所述在线K歌系统30优选为计算机程序。所述处理器20执行所述计算机程序时可以实现在线K歌方法实施例中的步骤,例如图6所示的步骤S600~S612。或者,所述处理器20执行所述计算机程序时实现在线K歌系统30(图2所示)实施例中各模块的功能,例如图2中的模块101~106。The online karaoke device 100 includes a memory 10, a processor 20, and an online karaoke system 30 stored in the memory 10 and operable on the processor 20. The online karaoke system 30 is preferably a computer program. When the processor 20 executes the computer program, the steps in the embodiment of the online karaoke method can be implemented, such as steps S600-S612 shown in FIG. 6 . Alternatively, when the processor 20 executes the computer program, it realizes the functions of each module in the embodiment of the online karaoke system 30 (shown in FIG. 2 ), such as modules 101-106 in FIG. 2 .

所述在线K歌系统30可以被分割成一个或多个模块/单元,所述一个或者多个模块/单元被存储在所述存储器10中,并由所述处理器20执行,以完成本发明。所述一个或多个模块/单元可以是能够完成特定功能的一系列计算机程序指令段,所述指令段用于描述所述在线K歌系统30在所述在线K歌装置100中的执行过程。例如,所述在线K歌系统30可以被分割成图2中的第一获取模块101、第二获取模块102、采集模块103、混合模块104、封装模块105及解析模块106。各模块具体功能参见在线K歌系统实施例中各模块的功能。The online karaoke system 30 can be divided into one or more modules/units, and the one or more modules/units are stored in the memory 10 and executed by the processor 20 to complete the present invention . The one or more modules/units may be a series of computer program instruction segments capable of accomplishing specific functions, and the instruction segments are used to describe the execution process of the online karaoke system 30 in the online karaoke device 100 . For example, the online karaoke system 30 can be divided into the first acquisition module 101 , the second acquisition module 102 , the acquisition module 103 , the mixing module 104 , the encapsulation module 105 and the analysis module 106 in FIG. 2 . For the specific functions of each module, refer to the functions of each module in the embodiment of the online karaoke system.

所述在线K歌装置100可以是桌上型计算机、掌上电脑、手机等计算设备。多个所述在线K歌装置100可以通过有线或者无线方式与服务器200进行通信,从而可以实现多人线上K歌场景体验。本领域技术人员可以理解,所述示意图仅是在线K歌装置100的示例,并不构成对在线K歌装置100的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如所述在线K歌装置100还可以包括麦克风40、扬声器50、摄像头60及显示屏70。进一步地所述在线K歌装置100还可以网络接入设备(图未示)、通信总线(图未示)等。The online karaoke device 100 may be a computing device such as a desktop computer, a palmtop computer, or a mobile phone. Multiple online karaoke devices 100 can communicate with the server 200 through wired or wireless means, so as to realize multi-person online karaoke scene experience. Those skilled in the art can understand that the schematic diagram is only an example of the online karaoke device 100, and does not constitute a limitation to the online karaoke device 100, and may include more or less components than those shown in the illustration, or combine certain components , or different components, for example, the online karaoke device 100 may also include a microphone 40 , a speaker 50 , a camera 60 and a display screen 70 . Further, the online karaoke device 100 may also be a network access device (not shown), a communication bus (not shown), and the like.

所称处理器20可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者所述处理器20也可以是任何常规的处理器等,所述处理器20可以利用各种接口和线路连接在线K歌装置100的其他各个部分。The so-called processor 20 may be a central processing unit (Central Processing Unit, CPU), and may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general processor can be a microprocessor or the processor 20 can also be any conventional processor, etc. The processor 20 can be connected to other parts of the online karaoke device 100 through various interfaces and lines.

所述存储器10可用于存储所述在线K歌系统30和/或模块/单元,所述处理器20通过运行或执行存储在所述存储器10内的在线K歌系统30和/或模块/单元,以及调用存储在存储器10内的数据,实现所述在线K歌装置100的各种功能。所述存储器10可以包括高速随机存取存储器,还可以包括非易失性存储器,例如硬盘、内存、插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)、至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 10 can be used to store the online karaoke system 30 and/or module/unit, and the processor 20 runs or executes the online karaoke system 30 and/or module/unit stored in the memory 10, And call the data stored in the memory 10 to realize various functions of the online karaoke device 100 . Described memory 10 can comprise high-speed random access memory, can also comprise non-volatile memory, such as hard disk, internal memory, plug-in hard disk, smart memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash memory card (Flash Card), at least one magnetic disk storage device, flash memory device, or other volatile solid state storage devices.

图2为本发明在线K歌系统较佳实施例的功能模块图。Fig. 2 is a functional block diagram of a preferred embodiment of the online karaoke system of the present invention.

参阅图2所示,所述在线K歌系统30可以包括第一获取模块101、第二获取模块102、采集模块103、混合模块104、封装模块105及解析模块106。可以理解的是,在其他实施方式中,上述模块也可为固化于所述处理器20中的程序指令或固件(firmware)。Referring to FIG. 2 , the online karaoke system 30 may include a first acquisition module 101 , a second acquisition module 102 , an acquisition module 103 , a mixing module 104 , an encapsulation module 105 and an analysis module 106 . It can be understood that, in other implementation manners, the above-mentioned modules may also be program instructions or firmware solidified in the processor 20 .

所述第一获取模块101用于获取登陆一虚拟K歌房间的用户身份信息。The first obtaining module 101 is used to obtain the identity information of users logging into a virtual karaoke room.

在一实施方式中,所述虚拟K歌房间可以是用户创建的K歌房间,也可以是在线K歌系统30预先创建的K歌房间。所述虚拟K歌房间可以允许多个用户登录,多个用户之间可以具有相同或者不相同的用户身份信息,在同一虚拟K歌房间的用户之间可以互动,包括但不限于聊天框互动、弹幕互动、声音互动。所述虚拟K歌房间可以具有多种K歌模式,可以在房间创建时预先设定好所述虚拟K歌房间的模式,不同的K歌模式可以包含有不同的用户身份。In one embodiment, the virtual karaoke room may be a karaoke room created by a user, or may be a karaoke room pre-created by the online karaoke system 30 . The virtual karaoke room can allow multiple users to log in, and multiple users can have the same or different user identity information, and users in the same virtual karaoke room can interact, including but not limited to chat box interaction, Barrage interaction, voice interaction. The virtual karaoke room can have multiple karaoke modes, and the mode of the virtual karaoke room can be preset when the room is created, and different karaoke modes can contain different user identities.

举例而言,所述K歌模式包括单人K歌模式、双人K歌模式、多人K歌模式及多麦直播K歌模式。所述单人K歌模式可以是指单人唱歌、一个或多个观众互动模式,所述单人K歌模式下的虚拟K歌房间的用户身份包括主唱及观众,观众可以在线实时听主唱歌声。所述双人K歌模式可以是指双人合唱、一个或多个观众互动模式,所述双人K歌模式下的虚拟K歌房间的用户身份包括主唱、副唱及观众,观众可以在线实时听主唱与副唱的合唱歌声,也可以选择只听主唱歌声。所述多人K歌模式可以是指三人或三人以上合唱、一个或多个观众互动模式,所述多人K歌模式下的虚拟K歌房间的用户身份包括主唱、多个副唱及观众,观众可以在线实时听主唱与多个副唱的合唱歌声,也可以选择只听主唱歌声。所述多麦直播K歌模式可以是指单人唱歌、麦主在线点评、一个或多个观众互动模式,所述多麦直播K歌模式下的虚拟K歌房间的用户身份包括主唱、麦主及观众,观众可以在线实时听主唱歌声,也可以选择听麦主点评。For example, the K-song mode includes a single-person K-song mode, a two-person K-song mode, a multi-person K-song mode and a multi-mic live K-song mode. The single karaoke mode can refer to a single person singing, one or more audience interaction modes, the user identity of the virtual karaoke room under the single karaoke mode includes lead singer and audience, and the audience can listen to the lead singer in real time online . The two-person K-song mode can refer to a two-person chorus, one or more audience interaction modes, and the user identities of the virtual K-song room under the two-person K-song mode include lead singer, sub-singer and audience, and the audience can listen to the lead singer and the audience in real time online. The chorus of the sub-singer, or you can choose to listen to only the main vocal. The multi-person karaoke mode can refer to three or more choruses, one or more audience interaction modes, and the user identities of the virtual karaoke room under the multi-person karaoke mode include a lead singer, a plurality of sub-singers and Audience, the audience can listen to the chorus of the lead singer and multiple sub-singers online in real time, or they can choose to listen to the lead singer only. The multi-wheat live karaoke mode can refer to single person singing, wheat master online comments, one or more audience interaction modes, and the user identities of the virtual karaoke room under the multi-wheat live karaoke mode include lead singer, wheat master And the audience, the audience can listen to the main singing voice online in real time, or they can choose to listen to the Maizhu comment.

所述第二获取模块102用于在所述用户身份为主唱时,获取所述主唱选定的歌曲信息并输出与所述歌曲信息对应的伴奏MV。The second acquiring module 102 is configured to acquire song information selected by the lead singer and output an accompaniment MV corresponding to the song information when the user is the lead singer.

在一实施方式中,通过所述第一获取模块101可以得到登陆所述虚拟K歌房间的用户身份信息,当用户身份为主唱时,所述第二获取模块102获取所述主唱选定的歌曲信息并输出与所述歌曲信息对应的伴奏MV,以使得所述主唱可以根据所述伴奏MV进行唱歌。所述主唱选定的歌曲信息可以包括待唱歌曲清单及播放顺序。In one embodiment, the first obtaining module 101 can obtain the identity information of the user who logs into the virtual karaoke room, and when the user identity is the main singer, the second obtaining module 102 obtains the song selected by the main singer information and output the accompaniment MV corresponding to the song information, so that the lead singer can sing according to the accompaniment MV. The song information selected by the lead singer may include a list of songs to be sung and a playing order.

在一实施方式中,所述第二获取模块102可以控制所述扬声器50及所述显示屏70输出与所述歌曲信息对应的伴奏MV。In an implementation manner, the second acquisition module 102 may control the speaker 50 and the display screen 70 to output an accompaniment MV corresponding to the song information.

所述采集模块103用于采集主唱声音及主唱影像。The collection module 103 is used to collect the lead singer's voice and lead singer's image.

在一实施方式中,所述采集模块103可以采集主唱在唱歌时的声音及影像。比如,所述采集模块103可以通过控制麦克风40及摄像头60来采集主唱声音及主唱影像。In one embodiment, the collection module 103 can collect the voice and video of the lead singer singing. For example, the collection module 103 can collect the voice and image of the lead singer by controlling the microphone 40 and the camera 60 .

所述混合模块104用于将所述主唱声音与所述伴奏MV的伴奏音乐进行混合得到第一混合声音。The mixing module 104 is used for mixing the lead vocal voice with the accompaniment music of the accompaniment MV to obtain a first mixed voice.

在一实施方式中,当采集到主唱声音后,可以将主唱声音与所述伴奏MV的伴奏音乐进行混合得到第一混合声,该第一混合声即可是观众可听到的主唱唱歌声音。In one embodiment, after the lead singer's voice is collected, the lead singer's voice can be mixed with the accompaniment music of the accompaniment MV to obtain a first mixed sound, which is the lead singer's singing sound audible to the audience.

所述封装模块105用于将所述第一混合声音、所述主唱影像分别封装成主音频流及主视频流,并将所述主音频流、所述主视频流、所述伴奏MV及所述伴奏MV的歌词时间戳传送至所述服务器200。The encapsulation module 105 is used for encapsulating the first mixed sound and the lead vocal image into a main audio stream and a main video stream respectively, and combining the main audio stream, the main video stream, the accompaniment MV and all The lyrics timestamp of the accompaniment MV is transmitted to the server 200.

在一实施方式中,所述封装模块105可以基于流媒体SDK(Software DevelopmentKit、软件开发工具包)将所述第一混合声音、所述主唱影像封装成主音频流及主视频流,并基于所述SDK将所述主音频流、所述主视频流、所述伴奏MV及所述伴奏MV的歌词时间戳传送至所述服务器200。In one embodiment, the encapsulation module 105 can encapsulate the first mixed sound and the lead singer image into a main audio stream and a main video stream based on a streaming media SDK (Software Development Kit, software development kit), and based on the The SDK transmits the main audio stream, the main video stream, the accompaniment MV and the timestamp of the lyrics of the accompaniment MV to the server 200 .

在一实施方式中,所述第二获取模块102还用于在所述用户身份为观众时,从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及所述伴奏MV的歌词时间戳。In one embodiment, the second acquiring module 102 is further configured to acquire the main audio stream, the main video stream, the accompaniment MV and the The timestamp of the lyrics of the accompaniment MV.

所述解析模块106用于解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像,进而可以在用户身份为观众时输出所述第一混合声音、所述主唱影像、所述伴奏MV及所述伴奏MV的歌词时间戳,使得观众可以体验在线KTV效果,观赏主唱唱歌。The parsing module 106 is used to parse the main audio stream and the main video stream to obtain the first mixed sound and the lead vocal image, and then output the first mixed sound, The lead singer image, the accompaniment MV and the lyrics time stamp of the accompaniment MV enable the audience to experience the online KTV effect and watch the lead singer sing.

当所述虚拟K歌房间为单人K歌模式时,在单人K歌模式下用户身份是包括主唱与观众,主唱与观众之间的媒体流交互可以参照上述各模块101~106的功能。When the virtual K-song room is a single-person K-song mode, the user identity in the single-person K-song mode includes the lead singer and the audience, and the media flow interaction between the lead singer and the audience can refer to the functions of the above-mentioned modules 101-106.

当所述虚拟K歌房间为双人K歌模式时,用户身份包括主唱、副唱及观众。所述第二获取模块102还用于在所述用户身份为副唱时,从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,所述解析模块106还用于解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像,进而可以输出所述第一混合声音、所述主唱影像、所述伴奏MV及所述歌词时间戳,使得所述副唱可以听到主唱的声音、伴奏音乐及观看伴奏MV、主唱影像,以与主唱进行合唱。所述采集模块103还用于采集副唱声音及副唱影像,所述封装模块105还用于将所述副唱声音、所述副唱影像分别封装成副音频流及副视频流传送至所述服务器200。When the virtual K-song room is a two-person K-song mode, user identities include lead singer, sub-singer and audience. The second obtaining module 102 is also used to obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics time stamp from the server 200 when the user identity is a sub-singer. The parsing module 106 is further configured to parse the main audio stream and the main video stream to obtain the first mixed sound and the lead vocal image, and then output the first mixed sound, the lead vocal image, and the The accompaniment MV and the time stamp of the lyrics, so that the sub-singer can hear the voice of the lead singer, the accompaniment music and watch the accompaniment MV, the image of the lead singer, so as to sing in chorus with the lead singer. The collection module 103 is also used to collect the sub-song sound and the sub-song image, and the packaging module 105 is also used to package the sub-song sound and the sub-song image respectively into a sub-audio stream and a sub-video stream to transmit to the sub-song. The above server 200.

在双人K歌模式下,当所述用户身份为主唱时,所述第二获取模块102还用于从所述服务器200获取所述副音频流,以解析输出所述副唱声音,进而使得所述主唱可以听到副唱的清唱声音,以与所述副唱进行合唱。当所述用户身份为观众时,观众可以选择第一听歌模式及第二听歌模式,第一听歌模式可以是只看主唱影像,第二听歌模式可以是听主唱与副唱的合唱。当所述观众选择的听歌模式为第一听歌模式时,所述第二获取模块102还用于从所述服务器200获取所述主视频流,所述解析模块106用于解析所述主视频流,以输出所述主唱影像,进而所述观众可以观看主唱唱歌影像。当所述观众选择的听歌模式为第二听歌模式时,所述第二获取模块102还用于从所述服务器200获取所述主音频流、所述副音频流、所述副视频流、所述伴奏MV及所述歌词时间戳,所述解析模块106用于解析所述主音频流、所述副音频流及所述副视频流,以得到第二混合声音及所述副唱影像,进而可以输出所述主唱声音、伴奏音乐、所述副唱声音、所述副唱影像、所述伴奏MV及所述歌词时间戳。其中所述第二混合声音包括所述主唱声音、所述副唱声音及所述伴奏MV的伴奏音乐,此时所述观众可以听到主唱与副唱的合唱声音、伴奏音乐及观看副唱影像、伴奏MV。In the double karaoke mode, when the user identity is the main singer, the second acquisition module 102 is also used to obtain the sub-audio stream from the server 200 to analyze and output the sub-singer sound, so that all The lead singer can hear the a cappella voice of the sub-singer to sing in chorus with the sub-singer. When the user identity is the audience, the audience can choose the first listening mode and the second listening mode, the first listening mode can be to watch only the lead singer video, and the second listening mode can be to listen to the chorus of the lead singer and the sub-singer . When the listening mode selected by the audience is the first listening mode, the second obtaining module 102 is also used to obtain the main video stream from the server 200, and the analyzing module 106 is used to analyze the main video stream. A video stream is used to output the image of the lead singer, so that the audience can watch the image of the lead singer singing. When the listening mode selected by the audience is the second listening mode, the second obtaining module 102 is also used to obtain the main audio stream, the secondary audio stream, and the secondary video stream from the server 200 , the accompaniment MV and the lyrics timestamp, the analysis module 106 is used to analyze the main audio stream, the sub audio stream and the sub video stream to obtain the second mixed sound and the sub vocal image , and further output the lead vocal voice, accompaniment music, sub vocal voice, sub vocal video, accompaniment MV and lyrics timestamp. Wherein the second mixed sound includes the voice of the lead singer, the voice of the sub-singer, and the accompaniment music of the accompaniment MV. At this time, the audience can hear the chorus voice of the lead singer and the sub-singer, the accompaniment music and watch the video of the accompaniment , Accompaniment MV.

当所述虚拟K歌房间为多人K歌模式时,用户身份可以包括一个主唱、多个副唱及观众。主唱、多个副唱、观众之间的媒体流交互可以参照上述双人K歌模式。When the virtual K-song room is a multi-person K-song mode, user identities may include a lead singer, multiple sub-singers and audiences. For the media stream interaction between the lead singer, multiple sub-singers, and the audience, you can refer to the above-mentioned two-person karaoke mode.

当所述虚拟K歌房间为多麦直播K歌模式,用户身份包括主唱、麦主及观众。当所述用户身份为麦主时,所述第二获取模块102还用于从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,所述解析模块106用于解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像,进而所述麦主可以听到主唱的声音、伴奏音乐及观看伴奏MV、主唱影像。所述采集模块103还用于采集麦主声音及麦主影像,所述封装模块105还用于将所述麦主声音及所述麦主影像分别封装成麦音频流及麦视频流传送至所述服务器200。When the virtual K-song room is a multi-mic live K-song mode, the user identities include the lead singer, the host and the audience. When the user identity is the host, the second obtaining module 102 is also used to obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server 200, so The analysis module 106 is used to analyze the main audio stream and the main video stream to obtain the first mixed sound and the lead singer image, and then the host can hear the lead singer's voice, accompaniment music and watch the accompaniment MV, vocal video. The collection module 103 is also used to collect the main microphone sound and the main microphone image, and the encapsulation module 105 is also used to package the main microphone sound and the main microphone image respectively into a microphone audio stream and a microphone video stream and transmit them to the The above server 200.

在多麦直播K歌模式下,主唱具有第一互动模式及第二互动模式可供选择。第一互动模式下,主唱可以依据伴奏MV进行唱歌,第二互动模式下,主唱可以听麦主的点评。当所述主唱选择的互动模式为所述第一互动模式时,所述第二获取模块102获取所述主唱选定的歌曲信息并输出与所述歌曲信息对应的伴奏MV,进而所述主唱可以根据伴奏MV进行唱歌。当所述主唱选择的互动模式为所述第二互动模式时,从所述服务器200获取所述麦音频流及所述麦视频流,所述解析模块106还用于解析所述麦音频流及所述麦视频流,以输出所述麦主声音及所述麦主影像,进而主唱可以听到麦主点评及观看麦主点评影像。In the multi-mai live karaoke mode, the lead singer has the first interactive mode and the second interactive mode to choose from. In the first interactive mode, the lead singer can sing according to the accompaniment MV, and in the second interactive mode, the lead singer can listen to Mai Zhu’s comments. When the interaction mode selected by the lead singer is the first interaction mode, the second acquisition module 102 obtains the song information selected by the lead singer and outputs the accompaniment MV corresponding to the song information, and then the lead singer can Sing according to the accompaniment MV. When the interaction mode selected by the lead singer is the second interaction mode, the microphone audio stream and the microphone video stream are obtained from the server 200, and the parsing module 106 is also used to analyze the microphone audio stream and the microphone video stream. The Mai's video stream is used to output the Mai's voice and the Mai's image, so that the lead singer can hear Mai's comments and watch Mai's comments.

在多麦直播K歌模式下,观众同样具有第一听歌模式及第二听歌模式可供选择。第一听歌模式可以是只听主唱唱歌,第二听歌模式可以是听麦主点评。当所述观众选择的听歌模式为第一听歌模式时,所述第二获取模块102还用于从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,所述解析模块106用于解析所述主音频流及所述主视频流,以输出所述第一混合声音及所述主唱影像,进而所述观众可以听到主唱唱歌声音、伴奏音乐及观看主唱唱歌影像及伴奏MV。当所述观众选择的听歌模式为第二听歌模式时,所述第二获取模块102还用于从所述服务器200获取所述麦音频流及所述麦视频流,所述解析模块106用于解析所述麦音频流及所述麦视频流,以输出所述麦主声音及所述麦主影像,进而所述观众可以听到麦主点评及观看麦主点评影像。In the multi-mic live K song mode, the audience also has the first listening mode and the second listening mode to choose from. The first mode of listening to songs can be to listen to the lead singer only, and the second mode of listening to songs can be to listen to the comments of the main singer. When the listening mode selected by the audience is the first listening mode, the second acquisition module 102 is also used to acquire the main audio stream, the main video stream, the accompaniment MV and The lyrics time stamp, the analysis module 106 is used to analyze the main audio stream and the main video stream to output the first mixed sound and the lead singer image, and then the audience can hear the lead singer singing voice , accompaniment music and watching the lead singer singing video and accompaniment MV. When the listening mode selected by the viewer is the second listening mode, the second acquisition module 102 is further configured to acquire the microphone audio stream and the microphone video stream from the server 200, and the parsing module 106 It is used to analyze the Mai main audio stream and the Mai main video stream to output the Mai main voice and the Mai main video, so that the audience can hear Mai main comments and watch Mai main commentary images.

图3示意出了所述虚拟K歌房间为单人K歌模式下在线K歌装置的运行环境图。FIG. 3 schematically shows the operating environment diagram of the online karaoke device in the single karaoke mode of the virtual karaoke room.

两个在线K歌装置100a、100b与服务器200通过有线或者无线方式进行通信,在线K歌装置100a的用户身份为主唱,在线K歌装置100b的用户身份为观众。在线K歌装置100a将主音频流(图3简称主音)、所述主视频流(图3简称主视)、所述伴奏MV(图3简称伴奏)及歌词时间戳(图3简称歌词戳)传送至所述服务器200,所述K歌装置100b可以从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及歌词时间戳并进行解析输出。The two online karaoke devices 100a, 100b communicate with the server 200 via wired or wireless means, the user identity of the online karaoke device 100a is the singer, and the user identity of the online karaoke device 100b is the audience. Online karaoke device 100a with main audio stream (Fig. 3 is called for short main tone), described main video stream (Fig. 3 is called for short main view), described accompaniment MV (Fig. 3 is called for short accompaniment) and lyrics timestamp (Fig. 3 is called for short lyrics stamp) After sending to the server 200, the karaoke device 100b can obtain the main audio stream, the main video stream, the accompaniment MV and the timestamp of the lyrics from the server 200 and analyze and output them.

图4示意出了所述虚拟K歌房间为双人K歌模式下在线K歌装置的运行环境图。FIG. 4 schematically shows the operating environment diagram of the online karaoke device in the two-person karaoke mode in the virtual karaoke room.

三个在线K歌装置100a、100b、100c与服务器200通过有线或者无线方式进行通信,在线K歌装置100a的用户身份为主唱,在线K歌装置100b的用户身份为副唱,在线K歌装置100c的用户身份为观众。在线K歌装置100a将主音频流(图4简称主音)、所述主视频流(图4简称主视)、所述伴奏MV(图4简称伴奏)及歌词时间戳(图4简称歌词戳)传送至所述服务器200,在线K歌装置100b可以从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及歌词时间戳并进行解析输出,在线K歌装置100c同样可以从所述服务器200获取所述主视频流并进行解析输出。在线K歌装置100b还将副音频流(图4简称副音)及副视频流(图4简称副视)传送至所述服务器200,在线K歌装置100c还可以从所述服务器200获取所述主音频流、所述副音频流、所述副视频流、所述伴奏MV及所述歌词时间戳并进行解析输出,在线K歌装置100a还可以从所述服务器200获取所述副音频流,并对所述副音频流进行解析输出。Three online karaoke devices 100a, 100b, 100c communicate with the server 200 by wired or wireless means, the user identity of the online karaoke device 100a is the main singer, the user identity of the online karaoke device 100b is the sub-singer, and the online karaoke device 100c of users who are viewers. Online karaoke device 100a will main audio stream (Fig. 4 is called for short main tone), described main video stream (Fig. 4 is called for short main view), described accompaniment MV (Fig. 4 is called for short accompaniment) and lyrics time stamp (Fig. 4 is called for short lyrics stamp) Send it to the server 200, and the online karaoke device 100b can obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server 200 and analyze and output it, and the online karaoke device 100c also The main video stream may be obtained from the server 200 and parsed and output. The online karaoke device 100b also transmits the sub-audio stream (Fig. 4 for short) and the sub-video stream (Fig. 4 for short) to the server 200, and the online karaoke device 100c can also obtain the described server 200. The main audio stream, the secondary audio stream, the secondary video stream, the accompaniment MV and the lyrics timestamp are analyzed and output, and the online karaoke device 100a can also obtain the secondary audio stream from the server 200, And analyze and output the secondary audio stream.

图5示意出了所述虚拟K歌房间为多麦直播K歌模式下在线K歌装置的运行环境图。FIG. 5 schematically shows the operating environment diagram of the online karaoke device in the multi-mai live karaoke mode as described in the virtual karaoke room.

三个在线K歌装置100a、100b、100c与服务器200通过有线或者无线方式进行通信,在线K歌装置100a的用户身份为主唱,在线K歌装置100b的用户身份为麦主,在线K歌装置100c的用户身份为观众。在线K歌装置100a将所述主音频流(图5简称主音)、所述主视频流(图5简称主视)、所述伴奏MV(图5简称伴奏)及歌词时间戳(图5简称歌词戳)传送至所述服务器200,在线K歌装置100b可以从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及歌词时间戳并进行解析输出,在线K歌装置100c同样可以从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及歌词时间戳并进行解析。在线K歌装置100b还将麦音频流(图5简称麦音)及麦视频流(图5简称麦视)传送至所述服务器200,在线K歌装置100c还可以从所述服务器200获取所述麦音频流及所述麦视频流并进行解析输出,在线K歌装置100a还可以从所述服务器200获取所述麦音频流及所述麦视频流并进行解析输出。Three online karaoke devices 100a, 100b, 100c communicate with the server 200 by wired or wireless means, the user identity of the online karaoke device 100a is the singer, the user identity of the online karaoke device 100b is the wheat master, and the online karaoke device 100c of users who are viewers. Online karaoke device 100a with described main audio stream (Fig. 5 is called for short main sound), described main video stream (Fig. 5 is called for short main view), described accompaniment MV (Fig. Stamp) sent to the server 200, the online karaoke device 100b can obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server 200 and analyze the output, the online karaoke device 100c may also obtain and analyze the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server 200 . The online karaoke device 100b also transmits the wheat audio stream (Fig. 5 is called Maiyin for short) and the wheat video stream (Fig. 5 is called Maishi for short) to the server 200, and the online karaoke device 100c can also obtain the described server 200. The microphone audio stream and the microphone video stream are analyzed and output, and the online karaoke device 100a can also obtain the microphone audio stream and the microphone video stream from the server 200 and perform analysis and output.

图6为本发明一实施方式中在线K歌方法的流程图。根据不同的需求,所述流程图中步骤的顺序可以改变,某些步骤可以省略。Fig. 6 is a flowchart of an online karaoke method in an embodiment of the present invention. According to different requirements, the order of the steps in the flowchart can be changed, and some steps can be omitted.

步骤S600,所述第一获取模块101获取登陆一虚拟K歌房间的用户身份信息。Step S600, the first acquiring module 101 acquires the identity information of the user who logs into a virtual karaoke room.

步骤S602,所述第二获取模块102在所述用户身份为主唱时,获取所述主唱选定的歌曲信息并输出与所述歌曲信息对应的伴奏MV。Step S602, the second acquisition module 102 acquires the song information selected by the lead singer and outputs the accompaniment MV corresponding to the song information when the user identity is the lead singer.

步骤S604,所述采集模块103采集主唱声音及主唱影像。Step S604, the collection module 103 collects the lead singer's voice and lead singer's image.

步骤S606,所述混合模块104将所述主唱声音与所述伴奏MV的伴奏音乐进行混合得到第一混合声音。Step S606, the mixing module 104 mixes the voice of the vocalist with the accompaniment music of the accompaniment MV to obtain a first mixed voice.

步骤S608,所述封装模块105将所述第一混合声音、所述主唱影像分别封装成主音频流及主视频流,并将所述主音频流、所述主视频流、所述伴奏MV及所述伴奏MV的歌词时间戳传送至所述服务器200。Step S608, the encapsulation module 105 encapsulates the first mixed sound and the vocal image respectively into a main audio stream and a main video stream, and packages the main audio stream, the main video stream, the accompaniment MV and The lyrics time stamp of the accompaniment MV is sent to the server 200 .

步骤S610,所述第二获取模块102在所述用户身份为观众时,从所述服务器200获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳。Step S610, the second acquisition module 102 acquires the main audio stream, the main video stream, the accompaniment MV and the lyrics time stamp from the server 200 when the user identity is a viewer.

步骤S612,所述解析模块106解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像。Step S612, the parsing module 106 parses the main audio stream and the main video stream to obtain the first mixed sound and the vocal image.

上述在线K歌装置、方法及计算机可读存储介质,基于互联网的在线K歌方式可使得用户在线体验线下KTV的歌唱场景,且支持多样化K歌模式,提升用户使用体验。The above-mentioned online karaoke device, method and computer-readable storage medium, the online karaoke method based on the Internet can enable users to experience offline KTV singing scenes online, and support diversified karaoke modes to improve user experience.

对本领域的技术人员来说,可以根据本发明的发明方案和发明构思结合生产的实际需要做出其他相应的改变或调整,而这些改变和调整都应属于本发明所公开的范围。For those skilled in the art, other corresponding changes or adjustments can be made according to the inventive solution and the inventive concept of the present invention combined with the actual needs of production, and these changes and adjustments should all belong to the scope of the present invention.

Claims (10)

Translated fromChinese
1.一种在线K歌方法,其特征在于,所述方法包括:1. an online karaoke method, is characterized in that, described method comprises:获取登陆一虚拟K歌房间的用户身份信息;Obtain the identity information of users who log in to a virtual karaoke room;当所述用户身份为主唱时,获取所述主唱选定的歌曲信息并输出与所述歌曲信息对应的伴奏MV;When the user identity is the lead singer, obtain the song information selected by the lead singer and output the accompaniment MV corresponding to the song information;采集主唱声音及主唱影像;Collect the voice of the lead singer and the image of the lead singer;将所述主唱声音与所述伴奏MV的伴奏音乐进行混合得到第一混合声音;Mixing the lead singer voice with the accompaniment music of the accompaniment MV to obtain a first mixed voice;将所述第一混合声音、所述主唱影像分别封装成主音频流及主视频流,并将所述主音频流、所述主视频流、所述伴奏MV及所述伴奏MV的歌词时间戳传送至一服务器;Encapsulating the first mixed sound and the lead vocal image into a main audio stream and a main video stream respectively, and timestamping the lyrics of the main audio stream, the main video stream, the accompaniment MV and the accompaniment MV sent to a server;当所述用户身份为观众时,从所述服务器获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳;及When the user identity is a viewer, obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server; and解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像。Parsing the main audio stream and the main video stream to obtain the first mixed sound and the main vocal image.2.如权利要求1所述的方法,其特征在于,所述虚拟K歌房间包括单人K歌模式、双人K歌模式、多人K歌模式及多麦直播K歌模式。2. The method according to claim 1, wherein the virtual K-song room includes a single-person K-song mode, a two-person K-song mode, a multi-person K-song mode and a multi-wheat live K-song mode.3.如权利要求2所述的方法,其特征在于,当所述虚拟K歌房间为所述双人K歌模式,所述方法还包括:3. The method according to claim 2, wherein when the virtual karaoke room is the two-person karaoke mode, the method further comprises:当所述用户身份为副唱时,从所述服务器获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像;When the user identity is sub-singer, obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server, and analyze the main audio stream and the main video stream , to obtain the first mixed sound and the lead singer image;采集副唱声音及副唱影像;及Acquisition of sub-singer voice and video of sub-singer; and将所述副唱声音、所述副唱影像分别封装成副音频流及副视频流传送至所述服务器。Encapsulating the sub-song sound and the sub-song image respectively into a sub-audio stream and a sub-video stream and sending them to the server.4.如权利要求3所述的方法,其特征在于,所述方法还包括:4. The method of claim 3, further comprising:当所述用户身份为主唱时,从所述服务器获取并输出所述副音频流。When the user identity is the main singer, the secondary audio stream is acquired from the server and output.5.如权利要求3所述的方法,其特征在于,所述方法还包括:5. The method of claim 3, further comprising:当所述用户身份为观众时,识别所述观众选取的听歌模式,其中所述听歌模式包括第一听歌模式及第二听歌模式;When the user identity is an audience, identify the listening mode selected by the audience, wherein the listening mode includes a first listening mode and a second listening mode;当所述观众选择的听歌模式为所述第一听歌模式时,从所述服务器获取所述主视频流,解析所述主视频流,以输出所述主唱影像;及When the listening mode selected by the viewer is the first listening mode, obtain the main video stream from the server, analyze the main video stream, and output the main vocal image; and当所述观众选择的听歌模式为所述第二听歌模式时,从所述服务器获取所述主音频流、所述副音频流、所述副视频流、所述伴奏MV及所述歌词时间戳,解析所述主音频流、所述副音频流及所述副视频流,以得到第二混合声音及所述副唱影像,其中所述第二混合声音包括所述主唱声音、所述副唱声音及所述伴奏MV的伴奏音乐。When the listening mode selected by the audience is the second listening mode, obtain the main audio stream, the secondary audio stream, the secondary video stream, the accompaniment MV and the lyrics from the server Timestamp, analyzing the main audio stream, the secondary audio stream and the secondary video stream to obtain the second mixed sound and the sub-singer image, wherein the second mixed sound includes the main vocal sound, the The voice of the sub-singer and the accompaniment music of the accompaniment MV.6.如权利要求2所述的方法,其特征在于,当所述虚拟K歌房间为所述多麦直播K歌模式,所述方法还包括:6. The method according to claim 2, wherein when the virtual karaoke room is the multi-mai live karaoke mode, the method further comprises:当所述用户身份为麦主时,从所述服务器获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像;When the user identity is a microphone master, obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server, and analyze the main audio stream and the main video stream , to obtain the first mixed sound and the lead singer image;采集麦主声音及麦主影像;及Collect Mai Zhu's voice and Mai Zhu's video; and将所述麦主声音、所述麦主影像分别封装成麦音频流及麦视频流传送至所述服务器。Encapsulating the microphone audio and the microphone image respectively into a microphone audio stream and a microphone video stream and sending them to the server.7.如权利要求6所述的方法,其特征在于,所述方法还包括:7. The method of claim 6, further comprising:当所述用户身份为主唱时,识别所述主唱选取的互动模式,其中所述互动模式包括第一互动模式及第二互动模式;When the user identity is the lead singer, identify the interaction mode selected by the lead singer, wherein the interaction mode includes a first interaction mode and a second interaction mode;当所述主唱选择的互动模式为所述第一互动模式时,获取所述主唱选定的歌曲信息并输出与所述歌曲信息对应的伴奏MV;及When the interaction mode selected by the lead singer is the first interaction mode, acquiring song information selected by the lead singer and outputting an accompaniment MV corresponding to the song information; and当所述主唱选择的互动模式为所述第二互动模式时,从所述服务器获取所述麦音频流及所述麦视频流,解析所述麦音频流及所述麦视频流,以输出所述麦主声音及所述麦主影像。When the interaction mode selected by the lead singer is the second interaction mode, obtain the microphone audio stream and the microphone video stream from the server, analyze the microphone audio stream and the microphone video stream, and output the The voice of Maizhu and the image of Maizhu.8.如权利要求6所述的方法,其特征在于,所述方法还包括:8. The method of claim 6, further comprising:当所述用户身份为观众时,识别所述观众选取的听歌模式,其中所述听歌模式包括第一听歌模式及第二听歌模式;When the user identity is an audience, identify the listening mode selected by the audience, wherein the listening mode includes a first listening mode and a second listening mode;当所述观众选择的听歌模式为所述第一听歌模式时,从所述服务器获取所述主音频流、所述主视频流、所述伴奏MV及所述歌词时间戳,解析所述主音频流及所述主视频流,以得到所述第一混合声音及所述主唱影像;及When the listening mode selected by the audience is the first listening mode, obtain the main audio stream, the main video stream, the accompaniment MV and the lyrics timestamp from the server, and analyze the a main audio stream and the main video stream to obtain the first mixed sound and the main vocal image; and当所述观众选择的听歌模式为所述第二听歌模式时,从所述服务器获取所述麦音频流及所述麦视频流,解析所述麦音频流及所述麦视频流,以输出所述麦主声音及所述麦主影像。When the listening mode selected by the audience is the second listening mode, obtain the wheat audio stream and the wheat video stream from the server, analyze the wheat audio stream and the wheat video stream, and Outputting the main microphone sound and the main main image.9.一种在线K歌装置,所述在线K歌装置包括显示屏、麦克风、扬声器、摄像头、处理器及存储器,其特征在于,所述存储器上存储有在线K歌程序,所述处理器用于执行所述存储器中存储的在线K歌程序时实现如权利要求1-8任一项所述的在线K歌方法的步骤。9. An online karaoke device, the online karaoke device comprises a display screen, a microphone, a loudspeaker, a camera, a processor and a memory, it is characterized in that an online karaoke program is stored on the memory, and the processor is used for When executing the online karaoke program stored in the memory, the steps of the online karaoke method according to any one of claims 1-8 are realized.10.一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有多条指令,多条所述指令可被一个或者多个处理器执行,以实现如权利要求1-8任一项所述的在线K歌方法的步骤。10. A computer-readable storage medium, characterized in that, the computer-readable storage medium stores a plurality of instructions, and the plurality of instructions can be executed by one or more processors, so as to implement claims 1-8 The step of the online karaoke method described in any one.
CN201910252219.3A2019-03-292019-03-29 Online karaoke device, method and computer-readable storage mediumActiveCN110264986B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201910252219.3ACN110264986B (en)2019-03-292019-03-29 Online karaoke device, method and computer-readable storage medium

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201910252219.3ACN110264986B (en)2019-03-292019-03-29 Online karaoke device, method and computer-readable storage medium

Publications (2)

Publication NumberPublication Date
CN110264986Atrue CN110264986A (en)2019-09-20
CN110264986B CN110264986B (en)2023-06-27

Family

ID=67913066

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201910252219.3AActiveCN110264986B (en)2019-03-292019-03-29 Online karaoke device, method and computer-readable storage medium

Country Status (1)

CountryLink
CN (1)CN110264986B (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN110856009A (en)*2019-11-272020-02-28广州华多网络科技有限公司Network karaoke system, audio and video playing method of network karaoke and related equipment
CN110910860A (en)*2019-11-292020-03-24北京达佳互联信息技术有限公司Online KTV implementation method and device, electronic equipment and storage medium
CN110944226A (en)*2019-11-272020-03-31广州华多网络科技有限公司Network Karaoke system, lyric display method in Karaoke scene and related equipment
CN111261133A (en)*2020-01-152020-06-09腾讯科技(深圳)有限公司Singing processing method and device, electronic equipment and storage medium
CN112015505A (en)*2020-08-132020-12-01北京字节跳动网络技术有限公司Mode switching method and device and electronic equipment
CN112752142A (en)*2020-08-262021-05-04腾讯科技(深圳)有限公司Dubbing data processing method and device and electronic equipment
CN113490007A (en)*2021-07-022021-10-08广州博冠信息科技有限公司Live broadcast processing system, method, storage medium and electronic device
CN113747217A (en)*2020-05-292021-12-03聚好看科技股份有限公司Display device and method for improving chorus speed
CN113836344A (en)*2021-09-302021-12-24广州艾美网络科技有限公司Personalized song file generation method and device and music singing equipment
CN114125480A (en)*2021-11-172022-03-01广州方硅信息技术有限公司Live broadcasting chorus interaction method, system and device and computer equipment
WO2023087932A1 (en)*2021-11-222023-05-25腾讯科技(深圳)有限公司Virtual concert processing method and apparatus, and device, storage medium and program product
CN116170613A (en)*2022-09-082023-05-26腾讯音乐娱乐科技(深圳)有限公司Audio stream processing method, computer device and computer program product
CN116349231A (en)*2020-05-132023-06-27聚好看科技股份有限公司 Method for Adjusting Display Position of Text Box Control and Display Device
CN116437282A (en)*2023-03-232023-07-14合众新能源汽车股份有限公司 Acoustic processing method, storage medium, and electronic equipment for virtual concert

Citations (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP2000039893A (en)*1998-07-232000-02-08Daiichikosho Co Ltd Host device and communication karaoke performance terminal constituting communication karaoke system
JP2006337702A (en)*2005-06-012006-12-14Hiroshi HosakaKaraoke service method and karaoke system
CN101282257A (en)*2007-04-052008-10-08丰行互动科技股份有限公司Method for realizing real-time multi-person singing audio-video system by using network
CN101630507A (en)*2009-08-182010-01-20深圳华为通信技术有限公司Method, device and system for realizing remote karaoke
CN102104799A (en)*2011-02-182011-06-22深圳创维数字技术股份有限公司Karaoke business Implementation method, terminal, server side and system
CN102325173A (en)*2011-08-302012-01-18重庆抛物线信息技术有限责任公司Mixed audio and video sharing method and system
CN102456340A (en)*2010-10-192012-05-16盛大计算机(上海)有限公司Karaoke in-pair singing method based on internet and system thereof
CN105045578A (en)*2015-06-292015-11-11广州酷狗计算机科技有限公司Method and apparatus for audio synthesis
CN105808710A (en)*2016-03-052016-07-27上海斐讯数据通信技术有限公司Remote karaoke terminal, remote karaoke system and remote karaoke method
CN106910491A (en)*2015-09-252017-06-30美食党私人有限公司Karaoke OK system
CN107027050A (en)*2017-04-132017-08-08广州华多网络科技有限公司Auxiliary live audio/video processing method and device
CN107770628A (en)*2016-08-232018-03-06中兴通讯股份有限公司One kind Karaoke realization method and system, intelligent household terminal
CN108269560A (en)*2017-01-042018-07-10北京酷我科技有限公司A kind of speech synthesizing method and system

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP2000039893A (en)*1998-07-232000-02-08Daiichikosho Co Ltd Host device and communication karaoke performance terminal constituting communication karaoke system
JP2006337702A (en)*2005-06-012006-12-14Hiroshi HosakaKaraoke service method and karaoke system
CN101282257A (en)*2007-04-052008-10-08丰行互动科技股份有限公司Method for realizing real-time multi-person singing audio-video system by using network
CN101630507A (en)*2009-08-182010-01-20深圳华为通信技术有限公司Method, device and system for realizing remote karaoke
CN102456340A (en)*2010-10-192012-05-16盛大计算机(上海)有限公司Karaoke in-pair singing method based on internet and system thereof
CN102104799A (en)*2011-02-182011-06-22深圳创维数字技术股份有限公司Karaoke business Implementation method, terminal, server side and system
CN102325173A (en)*2011-08-302012-01-18重庆抛物线信息技术有限责任公司Mixed audio and video sharing method and system
CN105045578A (en)*2015-06-292015-11-11广州酷狗计算机科技有限公司Method and apparatus for audio synthesis
CN106910491A (en)*2015-09-252017-06-30美食党私人有限公司Karaoke OK system
CN105808710A (en)*2016-03-052016-07-27上海斐讯数据通信技术有限公司Remote karaoke terminal, remote karaoke system and remote karaoke method
CN107770628A (en)*2016-08-232018-03-06中兴通讯股份有限公司One kind Karaoke realization method and system, intelligent household terminal
CN108269560A (en)*2017-01-042018-07-10北京酷我科技有限公司A kind of speech synthesizing method and system
CN107027050A (en)*2017-04-132017-08-08广州华多网络科技有限公司Auxiliary live audio/video processing method and device

Cited By (17)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN110944226A (en)*2019-11-272020-03-31广州华多网络科技有限公司Network Karaoke system, lyric display method in Karaoke scene and related equipment
CN110856009B (en)*2019-11-272021-02-26广州华多网络科技有限公司Network karaoke system, audio and video playing method of network karaoke and related equipment
CN110944226B (en)*2019-11-272021-05-11广州华多网络科技有限公司Network Karaoke system, lyric display method in Karaoke scene and related equipment
CN110856009A (en)*2019-11-272020-02-28广州华多网络科技有限公司Network karaoke system, audio and video playing method of network karaoke and related equipment
CN110910860A (en)*2019-11-292020-03-24北京达佳互联信息技术有限公司Online KTV implementation method and device, electronic equipment and storage medium
CN111261133A (en)*2020-01-152020-06-09腾讯科技(深圳)有限公司Singing processing method and device, electronic equipment and storage medium
CN116349231A (en)*2020-05-132023-06-27聚好看科技股份有限公司 Method for Adjusting Display Position of Text Box Control and Display Device
CN113747217A (en)*2020-05-292021-12-03聚好看科技股份有限公司Display device and method for improving chorus speed
CN113747217B (en)*2020-05-292024-10-22聚好看科技股份有限公司 Display device and method for improving chorus speed
CN112015505A (en)*2020-08-132020-12-01北京字节跳动网络技术有限公司Mode switching method and device and electronic equipment
CN112752142A (en)*2020-08-262021-05-04腾讯科技(深圳)有限公司Dubbing data processing method and device and electronic equipment
CN113490007A (en)*2021-07-022021-10-08广州博冠信息科技有限公司Live broadcast processing system, method, storage medium and electronic device
CN113836344A (en)*2021-09-302021-12-24广州艾美网络科技有限公司Personalized song file generation method and device and music singing equipment
CN114125480A (en)*2021-11-172022-03-01广州方硅信息技术有限公司Live broadcasting chorus interaction method, system and device and computer equipment
WO2023087932A1 (en)*2021-11-222023-05-25腾讯科技(深圳)有限公司Virtual concert processing method and apparatus, and device, storage medium and program product
CN116170613A (en)*2022-09-082023-05-26腾讯音乐娱乐科技(深圳)有限公司Audio stream processing method, computer device and computer program product
CN116437282A (en)*2023-03-232023-07-14合众新能源汽车股份有限公司 Acoustic processing method, storage medium, and electronic equipment for virtual concert

Also Published As

Publication numberPublication date
CN110264986B (en)2023-06-27

Similar Documents

PublicationPublication DateTitle
CN110264986B (en) Online karaoke device, method and computer-readable storage medium
CN110910860B (en)Online KTV implementation method and device, electronic equipment and storage medium
JP2014530377A5 (en)
CN112653902A (en)Speaker recognition method and device and electronic equipment
CN107770628A (en)One kind Karaoke realization method and system, intelligent household terminal
CN105045578A (en)Method and apparatus for audio synthesis
CN111261133A (en)Singing processing method and device, electronic equipment and storage medium
CN108322791B (en) A kind of voice evaluation method and device
US20170092253A1 (en)Karaoke system
CN114981889A (en) Spatial Audio Extension for Video Notifications
NosenkoImmersive technologies in the formation of musical audio space
TWI498880B (en) Automatic Sentiment Classification System with Scale Sound
CN105450970A (en)Information processing method and electronic equipment
WO2024067157A1 (en)Special-effect video generation method and apparatus, electronic device and storage medium
CN115734000A (en)Method, device, medium and program product for concert on live broadcast line
CN115720275A (en) Audio and video synchronization method, system, device and medium for AI digital human in live broadcast
CN105979468A (en)Audio frequency processing method and device
CN107135407A (en)Synchronous method and system in a kind of piano video teaching
CN115440178A (en)Audio recording method, device and storage medium
CN105893496A (en) An information processing method and device, and electronic equipment
US20240015368A1 (en)Distribution system, distribution method, and non-transitory computer-readable recording medium
TWI498886B (en) An automatic emotion classification system with no sound
US20230269552A1 (en)Electronic device, system, method and computer program
CN103886854A (en) Online singing system and singing method thereof
Costa et al.Internet of Musical Things Environments and Pure Data: A Perfect Match?

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant
TG01Patent term adjustment
TG01Patent term adjustment

[8]ページ先頭

©2009-2025 Movatter.jp