CN110769265A - Simultaneous caption translation method, smart television and storage medium - Google Patents
Simultaneous caption translation method, smart television and storage mediumDownload PDFInfo
- Publication number
- CN110769265A CN110769265ACN201910950069.3ACN201910950069ACN110769265ACN 110769265 ACN110769265 ACN 110769265ACN 201910950069 ACN201910950069 ACN 201910950069ACN 110769265 ACN110769265 ACN 110769265A
- Authority
- CN
- China
- Prior art keywords
- target
- subtitle
- voice information
- cloud server
- subtitles
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42212—Specific keyboard arrangements
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42224—Touch pad or touch panel provided on the remote control
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
- H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4856—End-user interface for client configuration for language selection, e.g. for the menu or subtitles
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Electrically Operated Instructional Devices (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
Translated fromChineseDescription
Translated fromChinese技术领域technical field
本发明涉及智能电视技术领域，尤其涉及一种同声字幕翻译方法、智能电视及存储介质。The invention relates to the technical field of smart TVs, in particular to a simultaneous subtitle translation method, a smart TV and a storage medium.
背景技术Background technique
随着社会国际化程度越来越高，用户对外交流场景不断增加，使得人们对语言学习和新闻理解的需求越来越多，大屏智能显示设备(电视等)在这种交流中拥有便捷的使用环境。电视机作为大屏显示设备，在智能化发展的当下和未来，在观看影视和远程教育上有着独特的优势。随着社会的发展，人们融入全球化的进程不断加快。对普通民众而言，语言是一个融入国际社会，理解国际文化最大的障碍，尤其在一些独特优质的媒体资料上，由于用户外国语水平不高，会给希望学习和文化交流带来极大障碍。With the increasing degree of internationalization of the society, users' external communication scenarios continue to increase, which makes people's needs for language learning and news understanding more and more. Large-screen smart display devices (TV, etc.) use environment. As a large-screen display device, TV has unique advantages in watching movies and distance education in the present and future of intelligent development. With the development of society, the process of people's integration into globalization is accelerating. For ordinary people, language is the biggest obstacle to integrating into the international society and understanding international culture. Especially in some unique and high-quality media materials, because the user's foreign language level is not high, it will bring great obstacles to their hope of learning and cultural exchanges.
目前人工智能技术不断发展，语音实时传译、全文翻译等技术逐渐成熟，识别准确率不断提升，以及网络技术向着大速率，低延时的方向发展。但是由于在音视频内容领域存在大量的不同语种，会给非母语的人们观看时造成理解上的困难，导致用户无法跨域语种的障碍，在使用非母语的音视频资源存在很大的障碍。At present, artificial intelligence technology continues to develop, voice real-time interpretation, full-text translation and other technologies are gradually mature, recognition accuracy continues to improve, and network technology is developing in the direction of high speed and low latency. However, due to the existence of a large number of different languages in the field of audio and video content, it will cause difficulties in understanding for non-native speakers when viewing, resulting in users being unable to cross-domain language barriers, and there are great obstacles in using non-native language audio and video resources.
因此，现有技术还有待于改进和发展。Therefore, the existing technology still needs to be improved and developed.
发明内容SUMMARY OF THE INVENTION
本发明的主要目的在于提供一种同声字幕翻译方法、智能电视及存储介质，旨在解决现有技术中用户在使用优质影音资源的过程中存在语言障碍的问题。The main purpose of the present invention is to provide a simultaneous subtitle translation method, a smart TV and a storage medium, aiming to solve the problem of language barriers in the prior art when users use high-quality audio and video resources.
为实现上述目的，本发明提供一种同声字幕翻译方法，所述同声字幕翻译方法包括如下步骤：In order to achieve the above object, the present invention provides a simultaneous subtitle translation method, the simultaneous subtitle translation method comprises the following steps:
接收用户选择目标语言的操作指令，采集播放资源中的语音信息，将所述目标语言和所述语音信息发送至云端服务器；Receive the user's operation instruction for selecting the target language, collect the voice information in the playback resource, and send the target language and the voice information to the cloud server;
接收所述云端服务器回传的目标字幕，所述云端服务器用于将所述语音信息翻译成所述目标语言对应的所述目标字幕；receiving the target subtitle returned by the cloud server, where the cloud server is configured to translate the voice information into the target subtitle corresponding to the target language;
将所述目标字幕与所述播放资源的时间轴进行实时匹配，在播放过程中同步显示所述目标字幕。The target subtitles are matched in real time with the time axis of the playback resource, and the target subtitles are displayed synchronously during the playback process.
可选地，所述的同声字幕翻译方法，其中，所述接收用户选择目标语言的操作指令，采集播放资源中的语音信息，将所述目标语言和所述语音信息发送至云端服务器，具体包括：Optionally, the simultaneous subtitle translation method, wherein the receiving an operation instruction of the user to select the target language, collecting the voice information in the playback resource, and sending the target language and the voice information to the cloud server, specifically: include:
接收用户通过遥控器按键或者触摸屏触摸菜单选择目标语言的操作指令，所述目标语言包括多种预先存储的语言；Receive an operation instruction from a user to select a target language through a remote control button or a touch screen touch menu, where the target language includes multiple pre-stored languages;
采集当前需要播放的所述播放资源中的所述语音信息，将压缩处理后的所述语音信息和所述目标语言发送至所述云端服务器。The voice information in the playback resource that needs to be played currently is collected, and the compressed voice information and the target language are sent to the cloud server.
可选地，所述的同声字幕翻译方法，其中，所述采集播放资源中的语音信息，具体包括：Optionally, the method for translating simultaneous subtitles, wherein the collecting the voice information in the playback resource specifically includes:
当所述播放资源为音频资源时，直接获取所述音频资源中的语音信息；When the playback resource is an audio resource, directly acquiring the voice information in the audio resource;
当所述播放资源为视频资源时，识别并分离出所述视频资源中的语音信息。When the playback resource is a video resource, the voice information in the video resource is identified and separated.
可选地，所述的同声字幕翻译方法，其中，所述接收用户选择目标语言的操作指令，之后还包括：Optionally, the method for translating simultaneous subtitles, wherein the receiving an operation instruction for the user to select the target language further includes:
接收用户选择在显示界面上显示所述目标字幕的字幕样式，所述字幕样式的参数包括字幕颜色、字幕透明度、显示位置以及字体大小。The subtitle style selected by the user to display the target subtitle on the display interface is received, and the parameters of the subtitle style include subtitle color, subtitle transparency, display position and font size.
可选地，所述的同声字幕翻译方法，其中，所述将所述目标字幕与所述播放资源的时间轴进行实时匹配，在播放过程中同步显示所述目标字幕，具体包括：Optionally, the simultaneous subtitle translation method, wherein the matching the target subtitles with the timeline of the playback resource in real time, and displaying the target subtitles synchronously during the playback process, specifically includes:
获取所述云端服务器发送的所述目标字幕，将所述目标字幕与所述播放资源的时间轴进行实时匹配，所述匹配包括画面、语音和字幕的同步匹配；obtaining the target subtitles sent by the cloud server, and matching the target subtitles with the timeline of the playback resource in real time, where the matching includes synchronous matching of pictures, voices and subtitles;
当所述目标字幕与所述播放资源的时间轴匹配完成后，在所述播放资源播放过程中在显示界面上同步显示所述目标字幕。After the target subtitle is matched with the time axis of the playback resource, the target subtitle is displayed on the display interface synchronously during the playback of the playback resource.
可选地，所述的同声字幕翻译方法，其中，所述在播放过程中同步显示所述目标字幕，还包括：Optionally, the method for translating simultaneous subtitles, wherein the synchronously displaying the target subtitles during playback, further includes:
在所述播放资源播放过程中，在显示界面上对比显示原始字幕和所述目标字幕，用于形成所述原始字幕和所述目标字幕的对比效果以进行原始字幕语言的辅助学习。During the playback of the playback resource, the original subtitles and the target subtitles are displayed in comparison on the display interface, so as to form a contrast effect between the original subtitles and the target subtitles to assist in learning the language of the original subtitles.
可选地，所述的同声字幕翻译方法，其中，所述云端服务器用于将所述语音信息翻译成所述目标语言对应的所述目标字幕，具体包括：Optionally, in the simultaneous subtitle translation method, wherein the cloud server is configured to translate the voice information into the target subtitle corresponding to the target language, specifically including:
所述云端服务器接收所述语音信息和所述目标语言；The cloud server receives the voice information and the target language;
所述云端服务器根据所述目标语言对所述语音信息进行识别和翻译，并生成所述目标语言对应的所述目标字幕；The cloud server recognizes and translates the voice information according to the target language, and generates the target subtitles corresponding to the target language;
所述云端服务器将所述目标字幕回传至智能电视。The cloud server transmits the target subtitles back to the smart TV.
此外，为实现上述目的，本发明还提供一种智能电视，其中，所述智能电视包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的同声字幕翻译程序，所述同声字幕翻译程序被所述处理器执行时实现如上所述的同声字幕翻译方法的步骤。In addition, in order to achieve the above object, the present invention also provides a smart TV, wherein the smart TV includes: a memory, a processor, and a simultaneous subtitle translation program stored in the memory and running on the processor , when the simultaneous subtitle translation program is executed by the processor, the steps of the above-mentioned simultaneous subtitle translation method are implemented.
此外，为实现上述目的，本发明还提供一种同声字幕翻译系统，其中，所述同声字幕翻译系统包括如上所述的智能电视，还包括一与所述智能电视已建立通信连接的云端服务器；所述智能电视用于接收用户选择目标语言的操作指令，采集播放资源中的语音信息并发送至云端服务器；还用于接收所述云端服务器回传的目标字幕，并将所述目标字幕与所述播放资源的播放时间轴进行实时匹配，在播放过程中同步显示所述目标字幕；所述云端服务器用于将所述语音信息翻译成所述目标语言对应的所述目标字幕，并将所述目标字幕发送至所述智能电视。In addition, in order to achieve the above object, the present invention also provides a simultaneous subtitle translation system, wherein the simultaneous subtitle translation system includes the smart TV as described above, and also includes a cloud that has established a communication connection with the smart TV. server; the smart TV is used to receive the user's operation instruction for selecting the target language, collect the voice information in the playback resource and send it to the cloud server; it is also used to receive the target subtitle returned by the cloud server, and send the target subtitle to the Perform real-time matching with the playback timeline of the playback resource, and display the target subtitles synchronously during the playback process; the cloud server is used to translate the voice information into the target subtitles corresponding to the target language, and The target subtitles are sent to the smart TV.
此外，为实现上述目的，本发明还提供一种存储介质，其中，所述存储介质存储有同声字幕翻译程序，所述同声字幕翻译程序被处理器执行时实现如上所述的同声字幕翻译方法的步骤。In addition, in order to achieve the above object, the present invention also provides a storage medium, wherein the storage medium stores a simultaneous subtitle translation program, and when the simultaneous subtitle translation program is executed by a processor, the above-mentioned simultaneous subtitle is realized The steps of the translation method.
本发明通过接收用户选择目标语言的操作指令，采集播放资源中的语音信息，将所述目标语言和所述语音信息发送至云端服务器；接收所述云端服务器回传的目标字幕，所述云端服务器用于将所述语音信息翻译成所述目标语言对应的所述目标字幕；将所述目标字幕与所述播放资源的时间轴进行实时匹配，在播放过程中同步显示所述目标字幕。本发明通过采集播放资源中的语音信息，根据用户需要的语言字幕，将所述语音信息发送至云端服务器同步翻译成用户选择的目标语言对应的目标字幕，并在播放时进行同步显示，满足用户对多种语言字幕的需求，使用户能轻易理解不同语种音视频表达的内容信息，实现便捷观看或学习。The present invention collects the voice information in the playback resource by receiving the operation instruction of the user to select the target language, and sends the target language and the voice information to the cloud server; and receives the target subtitles returned by the cloud server, the cloud server It is used to translate the voice information into the target subtitles corresponding to the target language; match the target subtitles with the timeline of the playback resource in real time, and display the target subtitles synchronously during the playback process. The present invention collects the voice information in the playback resources, and according to the language subtitles required by the user, sends the voice information to the cloud server to be synchronously translated into the target subtitles corresponding to the target language selected by the user, and displays them synchronously during playback, so as to satisfy the needs of the user. The demand for subtitles in multiple languages enables users to easily understand the content information expressed by audio and video in different languages, enabling convenient viewing or learning.
附图说明Description of drawings
图1是本发明同声字幕翻译方法的较佳实施例的流程图；Fig. 1 is the flow chart of the preferred embodiment of the simultaneous subtitle translation method of the present invention;
图2是本发明同声字幕翻译方法的较佳实施例中步骤S10的流程图；Fig. 2 is the flow chart of step S10 in the preferred embodiment of the simultaneous subtitle translation method of the present invention;
图3是本发明同声字幕翻译方法的较佳实施例中步骤S30的流程图；Fig. 3 is the flow chart of step S30 in the preferred embodiment of the simultaneous subtitle translation method of the present invention;
图4是本发明同声字幕翻译方法的较佳实施例中进行目标字幕同步翻译的整个过程的流程图；Fig. 4 is the flow chart of the whole process of carrying out the synchronous translation of target subtitles in the preferred embodiment of the simultaneous subtitle translation method of the present invention;
图5为本发明智能电视的较佳实施例的运行环境示意图。FIG. 5 is a schematic diagram of the operating environment of the preferred embodiment of the smart TV of the present invention.
具体实施方式Detailed ways
为使本发明的目的、技术方案及优点更加清楚、明确，以下参照附图并举实施例对本发明进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。In order to make the objectives, technical solutions and advantages of the present invention clearer and clearer, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
本发明较佳实施例所述的同声字幕翻译方法，如图1所示，所述同声字幕翻译方法包括以下步骤：The simultaneous subtitle translation method described in the preferred embodiment of the present invention, as shown in Figure 1, the simultaneous subtitle translation method comprises the following steps:
步骤S10、接收用户选择目标语言的操作指令，采集播放资源中的语音信息，将所述目标语言和所述语音信息发送至云端服务器。Step S10: Receive an operation instruction from a user for selecting a target language, collect voice information in the playback resource, and send the target language and the voice information to a cloud server.
具体的过程请参阅图2，其为本发明提供的同声字幕翻译方法中步骤S10的流程图。For the specific process, please refer to FIG. 2 , which is a flowchart of step S10 in the simultaneous subtitle translation method provided by the present invention.
如图2所示，所述步骤S10包括：As shown in Figure 2, the step S10 includes:
S11、接收用户通过遥控器按键或者触摸屏触摸菜单选择目标语言的操作指令，所述目标语言包括多种预先存储的语言；S11. Receive an operation instruction from a user to select a target language through a remote control button or a touch screen touch menu, where the target language includes multiple pre-stored languages;
S12、采集当前需要播放的所述播放资源中的所述语音信息，将压缩处理后的所述语音信息和所述目标语言发送至所述云端服务器。S12. Collect the voice information in the playback resource that needs to be played currently, and send the compressed voice information and the target language to the cloud server.
具体地，首先要知道用户想要看到的字母语言是哪一种，那么就要接收用户选择目标语言的操作指令，而用户发出操作指令的方式可以多样化，本发明中，对于配套有遥控器的电视(例如智能电视)，用户可以通过遥控器发出选择目标语言的操作指令到电视，对于具有触摸功能(带有触摸屏)的设备，用户可以直接通过触摸屏触摸菜单发出选择目标语言的操作指令，电视或者触摸设备的系统中已经预先存储了多种语言，对于其他未存储的也可以进行添加。Specifically, first of all, it is necessary to know which alphabetic language the user wants to see, then an operation instruction for the user to select the target language must be received, and the manner in which the user issues the operation instruction can be diversified. For a TV with a monitor (such as a smart TV), the user can send the operation command to select the target language to the TV through the remote control. For the device with touch function (with a touch screen), the user can directly send the operation command to select the target language through the touch menu of the touch screen. , multiple languages have been pre-stored in the system of the TV or touch device, and other unstored languages can also be added.
进一步地，在接收用户选择目标语言的操作指令之后，还可以接收用户选择在显示界面上显示所述目标字幕的字幕样式，所述字幕样式的参数包括字幕颜色、字幕透明度、显示位置以及字体大小，例如用户选择最后输出的目标字幕的颜色为红色(例如原始字幕为黑色，两者颜色不同便于对比观看)，字幕透明度可根据用户的需要进行选择，显示位置可以在原始字幕的上方或者下方，字体大小也可以根据用户的需求进行选择，还可以选择其他的字幕参数或者相关设置。Further, after receiving an operation instruction for the user to select the target language, a subtitle style selected by the user to display the target subtitle on the display interface can also be received, and the parameters of the subtitle style include subtitle color, subtitle transparency, display position and font size. For example, the user selects the color of the final output target subtitle to be red (for example, the original subtitle is black, and the two colors are different for easy comparison viewing), the subtitle transparency can be selected according to the user's needs, and the display position can be above or below the original subtitle, The font size can also be selected according to the user's needs, and other subtitle parameters or related settings can also be selected.
当电视或者触摸设备接收到用户选择目标语言的操作指令之后，识别所述操作指令并执行对应的功能，也就是根据所述目标语言采集当前需要播放(或者当前正在播放的)的所述播放资源中的所述语音信息，其中，所述采集播放资源中的语音信息具体包括：当所述播放资源为音频资源(例如通过电视播放音频，虽然没有变动的画面，但是也会有显示界面，显示界面可能是某一个播放界面在音频播放过程中一直不变)时，那么直接获取所述音频资源中的语音信息即可；当所述播放资源为视频资源(包括音频信息和视频信息)时，那么就需要识别并分离出所述视频资源中的语音信息。因为进行目标字幕生成只需要得到语音信息即可。After the TV or the touch device receives the operation instruction for the user to select the target language, it recognizes the operation instruction and executes the corresponding function, that is, collects the playback resources that need to be played (or currently being played) according to the target language. The voice information in , wherein the voice information in the collection and playback resources specifically includes: when the playback resources are audio resources (for example, audio is played through a TV, although there is no changed picture, there will also be a display interface, displaying When the interface may be a certain playback interface that remains unchanged during the audio playback process), the voice information in the audio resource can be directly obtained; when the playback resource is a video resource (including audio information and video information), Then, it is necessary to identify and separate the voice information in the video resource. Because the target subtitle generation only needs to obtain the voice information.
将获取的所述语音信息进行压缩处理(便于数据的传输)，最后将压缩处理后的所述语音信息和所述目标语言发送至所述云端服务器，便于所述云端服务器根据用户的需求，对所述语音数据进行处理。The acquired voice information is compressed (to facilitate data transmission), and finally the compressed voice information and the target language are sent to the cloud server, so that the cloud server can, according to the needs of the user, send the data to the cloud server. The voice data is processed.
步骤S20、接收所述云端服务器回传的目标字幕，所述云端服务器用于将所述语音信息翻译成所述目标语言对应的所述目标字幕。Step S20: Receive the target subtitle returned by the cloud server, where the cloud server is configured to translate the voice information into the target subtitle corresponding to the target language.
具体地，当电视或者触摸设备将所述目标语言和所述语音信息发送至所述云端服务器之后，所述云端服务器主要根据所述目标语言对所述语音信息进行在线实时翻译操作，例如所述云端服务器可以通过人工智能(AI)进行语音识别和翻译，生成用户想要的目标字幕(目标字幕主要是指用户的母语)，同时，对于云端服务器AI技术层面，通过大量的音视频资源训练和客户各种需求的增加，可推动机器语言处理的快速发展。Specifically, after the TV or touch device sends the target language and the voice information to the cloud server, the cloud server mainly performs online real-time translation operations on the voice information according to the target language, for example, the The cloud server can perform speech recognition and translation through artificial intelligence (AI) to generate the target subtitles that the user wants (target subtitles mainly refer to the user's native language). The increase in various needs of customers can promote the rapid development of machine language processing.
其中，所述云端服务器接收所述语音信息和所述目标语言之后，所述云端服务器根据所述目标语言(例如原始音视频为法语资源，而用户需要的是中文，那么目标语言就是中文，原始字幕就是法文)对所述语音信息进行识别和翻译，并生成所述目标语言对应的所述目标字幕(例如生成中文字幕)，所述云端服务器将所述目标字幕回传至电视(例如智能电视)或者触摸设备。Wherein, after the cloud server receives the voice information and the target language, the cloud server according to the target language (for example, the original audio and video are French resources, and the user needs Chinese, then the target language is Chinese, the original Subtitles are French) to identify and translate the voice information, and generate the target subtitles corresponding to the target language (for example, generate Chinese subtitles), and the cloud server sends the target subtitles back to the TV (for example, a smart TV) ) or touch the device.
进一步地，所述云端服务器的翻译是在线实时翻译，并不影响用户的观看，同时，电视或者触摸设备也可根据用户的网络环境情况，根据需求选择边播边译，或先译后播，给用户提供连贯透明的观看体验。Further, the translation of the cloud server is online real-time translation, which does not affect the user's viewing. At the same time, the TV or touch device can also choose to translate while broadcasting, or to first translate and then broadcast, according to the user's network environment. Provide users with a coherent and transparent viewing experience.
步骤S30、将所述目标字幕与所述播放资源的时间轴进行实时匹配，在播放过程中同步显示所述目标字幕。Step S30: Match the target subtitles with the time axis of the playback resource in real time, and display the target subtitles synchronously during the playback process.
具体过程请参阅图3，其为本发明提供的同声字幕翻译方法中步骤S30的流程图。For the specific process, please refer to FIG. 3 , which is a flowchart of step S30 in the simultaneous subtitle translation method provided by the present invention.
如图3所示，所述步骤S30包括：As shown in Figure 3, the step S30 includes:
S31、获取所述云端服务器发送的所述目标字幕，将所述目标字幕与所述播放资源的时间轴进行实时匹配，所述匹配包括画面、语音和字幕的同步匹配；S31, acquiring the target subtitles sent by the cloud server, and matching the target subtitles with the timeline of the playback resource in real time, where the matching includes synchronous matching of pictures, voices and subtitles;
S32、当所述目标字幕与所述播放资源的时间轴匹配完成后，在所述播放资源播放过程中在显示界面上同步显示所述目标字幕。S32. After the target subtitle is matched with the time axis of the playback resource, the target subtitle is displayed on the display interface synchronously during the playback of the playback resource.
具体地，当所述云端服务器根据所述目标语言对所述语音信息进行识别和翻译，并生成所述目标语言对应的所述目标字幕，所述云端服务器将所述目标字幕回传至电视或者触摸设备后，电视或者触摸设备根据所述目标字幕匹配目标字幕和画面，根据时间轴进行同步输出，即将所述目标字幕与所述播放资源的时间轴进行实时匹配，使得画面、语音和目标字幕进行同步匹配；当完成时间轴匹配后，在音频或者视频播放过程中在显示界面(即显示屏)上同步显示所述目标字幕，例如在音频或者视频播放过程中，在显示屏上对比显示原始字幕和所述目标字幕(例如原始字幕显示在目标字幕的上方或者下方)，用于形成所述原始字幕和所述目标字幕的对比效果以进行原始字幕语言的辅助学习，既保留原音又能看懂所要表达的意思，例如用户想要学习原始字幕所代表的语言，那么进行对比显示就可以辅助用户进行其他语种的学习。Specifically, when the cloud server recognizes and translates the voice information according to the target language, and generates the target subtitles corresponding to the target language, the cloud server sends the target subtitles back to the TV or After touching the device, the TV or the touch device matches the target subtitles and pictures according to the target subtitles, and performs synchronous output according to the time axis, that is, the target subtitles are matched with the time axis of the playback resource in real time, so that the picture, voice and target subtitles are matched in real time. Perform synchronous matching; when the time axis matching is completed, the target subtitles are displayed synchronously on the display interface (ie, the display screen) during the audio or video playback process. Subtitles and the target subtitles (for example, the original subtitles are displayed above or below the target subtitles), which are used to form a contrast effect between the original subtitles and the target subtitles to assist in learning the language of the original subtitles. If the user understands the meaning to be expressed, for example, the user wants to learn the language represented by the original subtitle, then the comparison display can assist the user in learning other languages.
本发明的同声字幕翻译方法，通过对可解码的音视频资源进行解码和关键信息采样，根据用户对语种的需求，将关键采样信息传递到云端服务器，由云端服务器进行翻译后，返回到智能显示设备中，以字幕的方式配合原语输出，呈现给用户，使用户能轻易理解不同语种音视频表达的内容信息，实现便捷交流或学习，能给用户真实的语境，同时用户能立即明白音视频所要表达的信息，处理效率高，应用范围广。The simultaneous subtitle translation method of the present invention, by decoding the decodable audio and video resources and sampling key information, transmits the key sampling information to the cloud server according to the user's demand for the language, and the cloud server performs translation and returns to the intelligent In the display device, the original language is output in the form of subtitles and presented to the user, so that the user can easily understand the content information expressed by audio and video in different languages, realize convenient communication or learning, and give the user a real context, and the user can immediately understand. The information to be expressed by audio and video has high processing efficiency and a wide range of applications.
进一步地，如图4所示，本发明中进行目标字幕同步翻译的整个过程如下：Further, as shown in Figure 4, the whole process of carrying out the synchronous translation of target subtitles in the present invention is as follows:
步骤S0、用户根据最终需要输出的字幕选择目标语言(终端设备以智能电视为例，智能电视接收用户的操作指令)；Step S0, the user selects the target language according to the final subtitles that need to be output (the terminal device takes the smart TV as an example, and the smart TV receives the user's operation instruction);
步骤S1、智能电视采集播放资源(例如音频或者视频)中的语音信息；Step S1, the smart TV collects voice information in playback resources (such as audio or video);
步骤S2、，智能电视将所述目标语言和所述语音信息发送至云端服务器；Step S2, the smart TV sends the target language and the voice information to the cloud server;
步骤S3、云端服务器用于将所述语音信息翻译成所述目标语言对应的所述目标字幕，并将所述目标字幕回传至智能电视；Step S3, the cloud server is used to translate the voice information into the target subtitles corresponding to the target language, and return the target subtitles to the smart TV;
步骤S4、智能电视接收所述云端服务器发送的所述目标字幕，将所述目标字幕与所述播放资源的时间轴进行实时匹配，使得画面、语音和字幕的同步输出(步骤S4和步骤S1可以通过后台同步进行，不影响用户的观看)；Step S4, the smart TV receives the target subtitle sent by the cloud server, and matches the target subtitle with the timeline of the playback resource in real time, so that the synchronous output of the picture, voice and subtitle (step S4 and step S1 can be performed). Synchronized through the background, does not affect the user's viewing);
步骤S5、所述目标字幕与所述播放资源的时间轴匹配完成后，在所述播放资源播放过程中在智能电视的显示界面上同步显示所述目标字幕。Step S5: After the target subtitles are matched with the time axis of the playback resource, the target subtitles are displayed synchronously on the display interface of the smart TV during the playback of the playback resource.
本发明带来了如下技术好处：The present invention brings following technical advantages:
(1)增加了新功能无需额外增加成本，用户在已拥有智能显示终端的情况下，无需再购买其他硬件设备，节省了硬件费用。(1) No additional cost is required to add new functions, and users do not need to purchase other hardware devices if they already have an intelligent display terminal, which saves hardware costs.
(2)用户的使用场景更加广泛，用户可用此功能理解不同语种的新闻或教程等音视频资源所要表达的信息，由于可以同步输出母语与外语的对比字幕，用户也可以做为学习各种外语的辅助工具，在实际场景的语境中，获得水平的提升。(2) The user's usage scenarios are more extensive. The user can use this function to understand the information to be expressed by audio and video resources such as news or tutorials in different languages. Since the comparison subtitles between the native language and the foreign language can be output simultaneously, the user can also learn various foreign languages. Auxiliary tools, in the context of the actual scene, to obtain a level of improvement.
(3)对于大屏智能显示设备的厂商，可通过此功能获得更多的潜在客户，提升大屏的使用时间和客户粘度，获得更多的商业价值。(3) For manufacturers of large-screen smart display devices, this function can obtain more potential customers, improve the use time and customer viscosity of large-screen displays, and obtain more commercial value.
(4)对于云端服务器的AI技术层面，通过大量的音视频资源训练和客户各种需求的增加，可推动机器语言处理的快速发展。(4) For the AI technology level of the cloud server, the rapid development of machine language processing can be promoted through the training of a large number of audio and video resources and the increase of various needs of customers.
进一步地，如图5所示，基于上述同声字幕翻译方法，本发明还相应提供了一种智能电视，所述智能电视包括处理器10、存储器20及显示器30。图5仅示出了智能电视的部分组件，但是应理解的是，并不要求实施所有示出的组件，可以替代的实施更多或者更少的组件。Further, as shown in FIG. 5 , based on the above-mentioned simultaneous subtitle translation method, the present invention also provides a smart TV correspondingly. The smart TV includes a
所述存储器20在一些实施例中可以是所述智能电视的内部存储单元，例如智能电视的硬盘或内存。所述存储器20在另一些实施例中也可以是所述智能电视的外部存储设备，例如所述智能电视上配备的插接式硬盘，智能存储卡(Smart Media Card,SMC)，安全数字(Secure Digital,SD)卡，闪存卡(Flash Card)等。进一步地，所述存储器20还可以既包括所述智能电视的内部存储单元也包括外部存储设备。所述存储器20用于存储安装于所述智能电视的应用软件及各类数据，例如所述安装智能电视的程序代码等。所述存储器20还可以用于暂时地存储已经输出或者将要输出的数据。在一实施例中，存储器20上存储有同声字幕翻译程序40，该同声字幕翻译程序40可被处理器10所执行，从而实现本申请中同声字幕翻译方法。In some embodiments, the
所述处理器10在一些实施例中可以是一中央处理器(Central Processing Unit,CPU)，微处理器或其他数据处理芯片，用于运行所述存储器20中存储的程序代码或处理数据，例如执行所述同声字幕翻译方法等。In some embodiments, the
所述显示器30在一些实施例中可以是LED显示器、液晶显示器、触控式液晶显示器以及OLED(Organic Light-Emitting Diode，有机发光二极管)触摸器等。所述显示器30用于显示在所述智能电视的信息以及用于显示可视化的用户界面。所述智能电视的部件10-30通过系统总线相互通信。In some embodiments, the
在一实施例中，当处理器10执行所述存储器20中同声字幕翻译程序40时实现以下步骤：In one embodiment, when the
接收用户选择目标语言的操作指令，采集播放资源中的语音信息，将所述目标语言和所述语音信息发送至云端服务器；Receive the user's operation instruction for selecting the target language, collect the voice information in the playback resource, and send the target language and the voice information to the cloud server;
接收所述云端服务器回传的目标字幕，所述云端服务器用于将所述语音信息翻译成所述目标语言对应的所述目标字幕；receiving the target subtitle returned by the cloud server, where the cloud server is configured to translate the voice information into the target subtitle corresponding to the target language;
将所述目标字幕与所述播放资源的时间轴进行实时匹配，在播放过程中同步显示所述目标字幕。The target subtitles are matched in real time with the time axis of the playback resource, and the target subtitles are displayed synchronously during the playback process.
所述接收用户选择目标语言的操作指令，采集播放资源中的语音信息，将所述目标语言和所述语音信息发送至云端服务器，具体包括：The receiving an operation instruction of the user selecting the target language, collecting the voice information in the playback resource, and sending the target language and the voice information to the cloud server, specifically includes:
接收用户通过遥控器按键或者触摸屏触摸菜单选择目标语言的操作指令，所述目标语言包括多种预先存储的语言；Receive an operation instruction from a user to select a target language through a remote control button or a touch screen touch menu, where the target language includes multiple pre-stored languages;
采集当前需要播放的所述播放资源中的所述语音信息，将压缩处理后的所述语音信息和所述目标语言发送至所述云端服务器。The voice information in the playback resource that needs to be played currently is collected, and the compressed voice information and the target language are sent to the cloud server.
所述采集播放资源中的语音信息，具体包括：The voice information in the collecting and playing resources specifically includes:
当所述播放资源为音频资源时，直接获取所述音频资源中的语音信息；When the playback resource is an audio resource, directly acquiring the voice information in the audio resource;
当所述播放资源为视频资源时，识别并分离出所述视频资源中的语音信息。When the playback resource is a video resource, the voice information in the video resource is identified and separated.
所述接收用户选择目标语言的操作指令，之后还包括：The receiving an operation instruction for the user to select the target language further includes:
接收用户选择在显示界面上显示所述目标字幕的字幕样式，所述字幕样式的参数包括字幕颜色、字幕透明度、显示位置以及字体大小。The subtitle style selected by the user to display the target subtitle on the display interface is received, and the parameters of the subtitle style include subtitle color, subtitle transparency, display position and font size.
所述将所述目标字幕与所述播放资源的时间轴进行实时匹配，在播放过程中同步显示所述目标字幕，具体包括：The matching of the target subtitles with the timeline of the playback resource in real time, and displaying the target subtitles synchronously during the playback process, specifically includes:
获取所述云端服务器发送的所述目标字幕，将所述目标字幕与所述播放资源的时间轴进行实时匹配，所述匹配包括画面、语音和字幕的同步匹配；obtaining the target subtitles sent by the cloud server, and matching the target subtitles with the timeline of the playback resource in real time, where the matching includes synchronous matching of pictures, voices and subtitles;
当所述目标字幕与所述播放资源的时间轴匹配完成后，在所述播放资源播放过程中在显示界面上同步显示所述目标字幕。After the target subtitle is matched with the time axis of the playback resource, the target subtitle is displayed on the display interface synchronously during the playback of the playback resource.
所述在播放过程中同步显示所述目标字幕，还包括：The synchronously displaying the target subtitles during the playing process further includes:
在所述播放资源播放过程中，在显示界面上对比显示原始字幕和所述目标字幕，用于形成所述原始字幕和所述目标字幕的对比效果以进行原始字幕语言的辅助学习。During the playback of the playback resource, the original subtitles and the target subtitles are displayed in comparison on the display interface, so as to form a contrast effect between the original subtitles and the target subtitles to assist in learning the language of the original subtitles.
本发明还提供一种存储介质，其中，所述存储介质存储有同声字幕翻译程序，所述同声字幕翻译程序被处理器执行时实现如上所述的同声字幕翻译方法的步骤。The present invention also provides a storage medium, wherein the storage medium stores a simultaneous subtitle translation program, which implements the steps of the simultaneous subtitle translation method as described above when the simultaneous subtitle translation program is executed by a processor.
综上所述，本发明提供一种同声字幕翻译方法、智能电视及存储介质，所述方法包括：接收用户选择目标语言的操作指令，采集播放资源中的语音信息，将所述目标语言和所述语音信息发送至云端服务器；接收所述云端服务器回传的目标字幕，所述云端服务器用于将所述语音信息翻译成所述目标语言对应的所述目标字幕；将所述目标字幕与所述播放资源的时间轴进行实时匹配，在播放过程中同步显示所述目标字幕。本发明通过采集播放资源中的语音信息，根据用户需要的语言字幕，将所述语音信息发送至云端服务器同步翻译成用户选择的目标语言对应的目标字幕，并在播放时进行同步显示，满足用户对多种语言字幕的需求，使用户能轻易理解不同语种音视频表达的内容信息，实现便捷观看或学习。To sum up, the present invention provides a simultaneous subtitle translation method, a smart TV and a storage medium. The method includes: receiving an operation instruction for selecting a target language from a user, collecting voice information in playback resources, and converting the target language into the target language. The voice information is sent to the cloud server; the target subtitles returned by the cloud server are received, and the cloud server is used to translate the voice information into the target subtitles corresponding to the target language; The time axis of the playback resource is matched in real time, and the target subtitle is displayed synchronously during the playback process. The present invention collects the voice information in the playback resources, and according to the language subtitles required by the user, sends the voice information to the cloud server to be synchronously translated into the target subtitles corresponding to the target language selected by the user, and displays them synchronously during playback, so as to satisfy the needs of the user. The demand for subtitles in multiple languages enables users to easily understand the content information expressed by audio and video in different languages, enabling convenient viewing or learning.
当然，本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关硬件(如处理器，控制器等)来完成，所述的程序可存储于一计算机可读取的存储介质中，所述程序在执行时可包括如上述各方法实施例的流程。其中所述的存储介质可为存储器、磁碟、光盘等。Of course, those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware (such as processors, controllers, etc.) through a computer program, and the programs can be stored in a In a computer-readable storage medium, when the program is executed, it may include the processes of the foregoing method embodiments. The storage medium may be a memory, a magnetic disk, an optical disk, or the like.
应当理解的是，本发明的应用不限于上述的举例，对本领域普通技术人员来说，可以根据上述说明加以改进或变换，所有这些改进和变换都应属于本发明所附权利要求的保护范围。It should be understood that the application of the present invention is not limited to the above examples. For those of ordinary skill in the art, improvements or transformations can be made according to the above descriptions, and all these improvements and transformations should belong to the protection scope of the appended claims of the present invention.
Claims (10)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910950069.3ACN110769265A (en) | 2019-10-08 | 2019-10-08 | Simultaneous caption translation method, smart television and storage medium |
| PCT/CN2020/098074WO2021068558A1 (en) | 2019-10-08 | 2020-06-24 | Simultaneous subtitle translation method, smart television, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910950069.3ACN110769265A (en) | 2019-10-08 | 2019-10-08 | Simultaneous caption translation method, smart television and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110769265Atrue CN110769265A (en) | 2020-02-07 |
Family
ID=69330967
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910950069.3APendingCN110769265A (en) | 2019-10-08 | 2019-10-08 | Simultaneous caption translation method, smart television and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110769265A (en) |
| WO (1) | WO2021068558A1 (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111683266A (en)* | 2020-05-06 | 2020-09-18 | 厦门盈趣科技股份有限公司 | Method and terminal for configuring subtitles through simultaneous translation of videos |
| CN112055261A (en)* | 2020-07-14 | 2020-12-08 | 北京百度网讯科技有限公司 | Subtitle presentation method, device, electronic device and storage medium |
| CN112118309A (en)* | 2020-09-16 | 2020-12-22 | 三星电子（中国）研发中心 | Audio translation method and system |
| CN112584209A (en)* | 2020-12-04 | 2021-03-30 | 深圳创维－Rgb电子有限公司 | Display method, display device, storage medium and smart television |
| CN112601101A (en)* | 2020-12-11 | 2021-04-02 | 北京有竹居网络技术有限公司 | Subtitle display method and device, electronic equipment and storage medium |
| CN112601102A (en)* | 2020-12-11 | 2021-04-02 | 北京有竹居网络技术有限公司 | Method and device for determining simultaneous interpretation of subtitles, electronic equipment and storage medium |
| WO2021068558A1 (en)* | 2019-10-08 | 2021-04-15 | 深圳创维－Rgb电子有限公司 | Simultaneous subtitle translation method, smart television, and storage medium |
| CN112995749A (en)* | 2021-02-07 | 2021-06-18 | 北京字节跳动网络技术有限公司 | Method, device and equipment for processing video subtitles and storage medium |
| CN113301357A (en)* | 2020-07-27 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Live broadcast method and device and electronic equipment |
| CN113473238A (en)* | 2020-04-29 | 2021-10-01 | 海信集团有限公司 | Intelligent device and simultaneous interpretation method during video call |
| CN113709579A (en)* | 2021-08-05 | 2021-11-26 | 中移（杭州）信息技术有限公司 | Audio and video data transmission method and device and storage medium |
| CN113709558A (en)* | 2021-10-09 | 2021-11-26 | 立讯电子科技（昆山）有限公司 | Multimedia processing method and multimedia interaction system |
| CN113709509A (en)* | 2021-08-05 | 2021-11-26 | 中移（杭州）信息技术有限公司 | Audio and video data transmission method and device and storage medium |
| CN113992926A (en)* | 2021-10-19 | 2022-01-28 | 北京有竹居网络技术有限公司 | Interface display method and device, electronic equipment and storage medium |
| CN115051991A (en)* | 2022-07-08 | 2022-09-13 | 北京有竹居网络技术有限公司 | Audio processing method and device, storage medium and electronic equipment |
| CN116095421A (en)* | 2023-01-04 | 2023-05-09 | 北京达佳互联信息技术有限公司 | Subtitle editing method, device, electronic equipment and storage medium |
| CN118782046A (en)* | 2024-06-28 | 2024-10-15 | 万兴科技(湖南)有限公司 | Speech translation method, device, and electronic device |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101179669A (en)* | 2006-11-08 | 2008-05-14 | 中兴通讯股份有限公司 | A method for generating and superimposing subtitles in videoconferencing terminals |
| CN102316277A (en)* | 2011-09-06 | 2012-01-11 | Tcl新技术（惠州）有限公司 | Caption system and implement method thereof |
| CN103079039A (en)* | 2011-10-25 | 2013-05-01 | 康佳集团股份有限公司 | Rolling broadcasting method and rolling broadcasting system |
| CN103327397A (en)* | 2012-03-22 | 2013-09-25 | 联想(北京)有限公司 | Subtitle synchronous display method and system of media file |
| CN103561217A (en)* | 2013-10-14 | 2014-02-05 | 深圳创维数字技术股份有限公司 | Method and terminal for generating captions |
| CN103905743A (en)* | 2012-12-30 | 2014-07-02 | 上海能感物联网有限公司 | Phonotape and videotape recording and broadcasting method for automatic and real-time Chinese subtitles labeling with Chinese language |
| CN105681890A (en)* | 2016-01-26 | 2016-06-15 | 广东欧珀移动通信有限公司 | A subtitle display method and device for a video playback terminal |
| US9374612B2 (en)* | 2006-04-14 | 2016-06-21 | At&T Intellectual Property Ii, L.P. | On-demand language translation for television programs |
| CN105828101A (en)* | 2016-03-29 | 2016-08-03 | 北京小米移动软件有限公司 | Method and device for generation of subtitles files |
| CN105848004A (en)* | 2016-05-16 | 2016-08-10 | 乐视控股（北京）有限公司 | Caption playing method and caption playing device |
| CN106340291A (en)* | 2016-09-27 | 2017-01-18 | 广东小天才科技有限公司 | Bilingual subtitle making method and system |
| CN106340294A (en)* | 2016-09-29 | 2017-01-18 | 安徽声讯信息技术有限公司 | Synchronous translation-based news live streaming subtitle on-line production system |
| CN207264383U (en)* | 2017-08-23 | 2018-04-20 | 成都铅笔科技有限公司 | A kind of foreign language translation device of real-time voice translation |
| CN207530952U (en)* | 2017-12-13 | 2018-06-22 | 南京洛菲特数码科技有限公司 | A kind of multi-screen image splicing device |
| CN108197123A (en)* | 2018-02-07 | 2018-06-22 | 云南衍那科技有限公司 | A kind of cloud translation system and method based on smartwatch |
| CN108572950A (en)* | 2017-03-08 | 2018-09-25 | 捷音特科技股份有限公司 | headset translation system |
| CN108833810A (en)* | 2018-06-21 | 2018-11-16 | 珠海金山网络游戏科技有限公司 | The method and device of subtitle is generated in a kind of live streaming of three-dimensional idol in real time |
| CN108962220A (en)* | 2018-07-26 | 2018-12-07 | 北京小米移动软件有限公司 | Multimedia file plays the text display method and device under scene |
| TWM574267U (en)* | 2018-08-16 | 2019-02-11 | 張漢龍 | Live broadcast system of synchronous and automatic translation of real-time voice and subtitle |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170092274A1 (en)* | 2015-09-24 | 2017-03-30 | Otojoy LLC | Captioning system and/or method |
| CN106792097A (en)* | 2016-12-27 | 2017-05-31 | 深圳Tcl数字技术有限公司 | Audio signal captions matching process and device |
| CN207720194U (en)* | 2017-01-05 | 2018-08-10 | 陈伯妤 | A kind of simultaneous interpretation mobile phone |
| CN107277646A (en)* | 2017-08-08 | 2017-10-20 | 四川长虹电器股份有限公司 | A kind of captions configuration system of audio and video resources |
| CN108319590A (en)* | 2018-01-25 | 2018-07-24 | 芜湖应天光电科技有限责任公司 | A kind of adaptive translator based on cloud service |
| CN110769265A (en)* | 2019-10-08 | 2020-02-07 | 深圳创维－Rgb电子有限公司 | Simultaneous caption translation method, smart television and storage medium |
- 2019
- 2019-10-08CNCN201910950069.3Apatent/CN110769265A/enactivePending
- 2020
- 2020-06-24WOPCT/CN2020/098074patent/WO2021068558A1/ennot_activeCeased
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9374612B2 (en)* | 2006-04-14 | 2016-06-21 | At&T Intellectual Property Ii, L.P. | On-demand language translation for television programs |
| CN101179669A (en)* | 2006-11-08 | 2008-05-14 | 中兴通讯股份有限公司 | A method for generating and superimposing subtitles in videoconferencing terminals |
| CN102316277A (en)* | 2011-09-06 | 2012-01-11 | Tcl新技术（惠州）有限公司 | Caption system and implement method thereof |
| CN103079039A (en)* | 2011-10-25 | 2013-05-01 | 康佳集团股份有限公司 | Rolling broadcasting method and rolling broadcasting system |
| CN103327397A (en)* | 2012-03-22 | 2013-09-25 | 联想(北京)有限公司 | Subtitle synchronous display method and system of media file |
| CN103905743A (en)* | 2012-12-30 | 2014-07-02 | 上海能感物联网有限公司 | Phonotape and videotape recording and broadcasting method for automatic and real-time Chinese subtitles labeling with Chinese language |
| CN103561217A (en)* | 2013-10-14 | 2014-02-05 | 深圳创维数字技术股份有限公司 | Method and terminal for generating captions |
| CN105681890A (en)* | 2016-01-26 | 2016-06-15 | 广东欧珀移动通信有限公司 | A subtitle display method and device for a video playback terminal |
| CN105828101A (en)* | 2016-03-29 | 2016-08-03 | 北京小米移动软件有限公司 | Method and device for generation of subtitles files |
| CN105848004A (en)* | 2016-05-16 | 2016-08-10 | 乐视控股（北京）有限公司 | Caption playing method and caption playing device |
| CN106340291A (en)* | 2016-09-27 | 2017-01-18 | 广东小天才科技有限公司 | Bilingual subtitle making method and system |
| CN106340294A (en)* | 2016-09-29 | 2017-01-18 | 安徽声讯信息技术有限公司 | Synchronous translation-based news live streaming subtitle on-line production system |
| CN108572950A (en)* | 2017-03-08 | 2018-09-25 | 捷音特科技股份有限公司 | headset translation system |
| CN207264383U (en)* | 2017-08-23 | 2018-04-20 | 成都铅笔科技有限公司 | A kind of foreign language translation device of real-time voice translation |
| CN207530952U (en)* | 2017-12-13 | 2018-06-22 | 南京洛菲特数码科技有限公司 | A kind of multi-screen image splicing device |
| CN108197123A (en)* | 2018-02-07 | 2018-06-22 | 云南衍那科技有限公司 | A kind of cloud translation system and method based on smartwatch |
| CN108833810A (en)* | 2018-06-21 | 2018-11-16 | 珠海金山网络游戏科技有限公司 | The method and device of subtitle is generated in a kind of live streaming of three-dimensional idol in real time |
| CN108962220A (en)* | 2018-07-26 | 2018-12-07 | 北京小米移动软件有限公司 | Multimedia file plays the text display method and device under scene |
| TWM574267U (en)* | 2018-08-16 | 2019-02-11 | 張漢龍 | Live broadcast system of synchronous and automatic translation of real-time voice and subtitle |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021068558A1 (en)* | 2019-10-08 | 2021-04-15 | 深圳创维－Rgb电子有限公司 | Simultaneous subtitle translation method, smart television, and storage medium |
| CN113473238B (en)* | 2020-04-29 | 2022-10-18 | 海信集团有限公司 | Intelligent device and simultaneous interpretation method during video call |
| CN113473238A (en)* | 2020-04-29 | 2021-10-01 | 海信集团有限公司 | Intelligent device and simultaneous interpretation method during video call |
| CN111683266A (en)* | 2020-05-06 | 2020-09-18 | 厦门盈趣科技股份有限公司 | Method and terminal for configuring subtitles through simultaneous translation of videos |
| CN112055261A (en)* | 2020-07-14 | 2020-12-08 | 北京百度网讯科技有限公司 | Subtitle presentation method, device, electronic device and storage medium |
| CN113301357A (en)* | 2020-07-27 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Live broadcast method and device and electronic equipment |
| CN112118309A (en)* | 2020-09-16 | 2020-12-22 | 三星电子（中国）研发中心 | Audio translation method and system |
| CN112584209A (en)* | 2020-12-04 | 2021-03-30 | 深圳创维－Rgb电子有限公司 | Display method, display device, storage medium and smart television |
| CN112601102A (en)* | 2020-12-11 | 2021-04-02 | 北京有竹居网络技术有限公司 | Method and device for determining simultaneous interpretation of subtitles, electronic equipment and storage medium |
| CN112601101B (en)* | 2020-12-11 | 2023-02-24 | 北京有竹居网络技术有限公司 | A subtitle display method, device, electronic equipment and storage medium |
| CN112601101A (en)* | 2020-12-11 | 2021-04-02 | 北京有竹居网络技术有限公司 | Subtitle display method and device, electronic equipment and storage medium |
| CN112995749A (en)* | 2021-02-07 | 2021-06-18 | 北京字节跳动网络技术有限公司 | Method, device and equipment for processing video subtitles and storage medium |
| CN113709509A (en)* | 2021-08-05 | 2021-11-26 | 中移（杭州）信息技术有限公司 | Audio and video data transmission method and device and storage medium |
| CN113709579A (en)* | 2021-08-05 | 2021-11-26 | 中移（杭州）信息技术有限公司 | Audio and video data transmission method and device and storage medium |
| CN113709558A (en)* | 2021-10-09 | 2021-11-26 | 立讯电子科技（昆山）有限公司 | Multimedia processing method and multimedia interaction system |
| CN113709558B (en)* | 2021-10-09 | 2025-02-28 | 立讯电子科技（昆山）有限公司 | Multimedia processing method and multimedia interactive system |
| CN113992926A (en)* | 2021-10-19 | 2022-01-28 | 北京有竹居网络技术有限公司 | Interface display method and device, electronic equipment and storage medium |
| CN113992926B (en)* | 2021-10-19 | 2023-09-12 | 北京有竹居网络技术有限公司 | Interface display method, device, electronic equipment and storage medium |
| CN115051991A (en)* | 2022-07-08 | 2022-09-13 | 北京有竹居网络技术有限公司 | Audio processing method and device, storage medium and electronic equipment |
| CN115051991B (en)* | 2022-07-08 | 2024-08-16 | 北京有竹居网络技术有限公司 | Audio processing method, device, storage medium and electronic device |
| CN116095421A (en)* | 2023-01-04 | 2023-05-09 | 北京达佳互联信息技术有限公司 | Subtitle editing method, device, electronic equipment and storage medium |
| CN118782046A (en)* | 2024-06-28 | 2024-10-15 | 万兴科技(湖南)有限公司 | Speech translation method, device, and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021068558A1 (en) | 2021-04-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110769265A (en) | Simultaneous caption translation method, smart television and storage medium | |
| CN110933490B (en) | A kind of automatic adjustment method of picture quality and sound quality, smart TV and storage medium | |
| CN110737840B (en) | Voice control method and display device | |
| CN112163086B (en) | Multi-intention recognition method and display device | |
| CN114286173A (en) | A display device and method for adjusting audio and video parameters | |
| CN112000820A (en) | Media asset recommendation method and display device | |
| CN104918105B (en) | More screen playing methods, equipment and the system of media file | |
| CN112511882B (en) | Display device and voice call-out method | |
| EP3905663A1 (en) | Multi-subtitle display method, intelligent terminal and storage medium | |
| KR20150083355A (en) | Augmented media service providing method, apparatus thereof, and system thereof | |
| CN112053688B (en) | Voice interaction method, interaction equipment and server | |
| CN103984772A (en) | Method and device for generating text retrieval subtitle library and video retrieval method and device | |
| CN111625716A (en) | Media asset recommendation method, server and display device | |
| CN104102683A (en) | Contextual queries for augmenting video display | |
| CN111654732A (en) | Advertisement playing method and display device | |
| CN111866568B (en) | Display device, server and video collection acquisition method based on voice | |
| WO2022134555A1 (en) | Video processing method and terminal | |
| CN112653910A (en) | Display device, server and control method for television program recommendation | |
| CN114627864A (en) | Display device and voice interaction method | |
| CN114442989B (en) | Natural language analysis method and device | |
| CN113468351B (en) | Intelligent device and image processing method | |
| CN113840177A (en) | Live broadcast interaction method and device, storage medium and electronic equipment | |
| CN111107283B (en) | Information display method, electronic equipment and storage medium | |
| CN112929685A (en) | Interaction method and device for VR live broadcast room, electronic equipment and storage medium | |
| CN112256232A (en) | Display device and post-processing method for natural language generation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20200207 |