






技术领域technical field
本发明涉及数字电视技术领域,尤其涉及的是一种视频直播录制处理方法、装置、智能终端及存储介质。The present invention relates to the technical field of digital television, in particular to a video live recording processing method, device, intelligent terminal and storage medium.
背景技术Background technique
现有技术的数字电视产品,基本都内置磁盘具备录制及timeshift回放等功能,一般情况下保存在磁盘的媒体文件只是以频道或者节目名称命名,入口往往是菜单的多媒体子目录,而大量文件积累后也不利于用户查找,即现有技术的数字电视视频录制内容不方便查找,并且录制的内容也往往比较单一,仅仅是原始电视节目内容,缺乏娱乐性,不方便用户使用。Digital TV products in the prior art basically have built-in disks with functions such as recording and timeshift playback. Generally, the media files stored on the disks are only named after channels or program names. The entry is often the multimedia subdirectory of the menu, and a large number of files accumulate. Also be unfavorable for user's search after the end, promptly the digital TV video recording content of prior art is inconvenient to search, and the content of recording is also often relatively single, is only original TV program content, lacks entertainment, is inconvenient for user to use.
因此,现有技术还有待改进和发展。Therefore, the prior art still needs to be improved and developed.
发明内容Contents of the invention
本发明要解决的技术问题在于,针对现有技术的上述缺陷,提供一种视频直播录制处理方法、装置、智能终端及存储介质,旨在解决现有技术的数字电视视频录制内容不方便查找,并且录制的内容也往往比较单一,不方便用户使用的问题。The technical problem to be solved by the present invention is to provide a live video recording processing method, device, intelligent terminal and storage medium for the above-mentioned defects of the prior art, aiming at solving the inconvenient search of digital TV video recording content in the prior art, And the recorded content is often relatively simple, which is not convenient for users to use.
本发明解决问题所采用的技术方案如下:The technical solution adopted by the present invention to solve the problem is as follows:
一种视频直播录制处理方法,其中,所述方法包括:A method for processing live video recording, wherein the method includes:
启动录制视频文件;Start recording video files;
获取录制的视频文件,对每个录制视频文件按预定时长进行分割,分割为多个子视频文件;Obtain the recorded video file, divide each recorded video file according to the predetermined duration, and divide it into multiple sub-video files;
对分割的每个子视频文件,截取变化关键帧图片作为该子视频文件显示的缩略图标;For each sub-video file that is divided, intercept the changing key frame picture as the thumbnail icon displayed by the sub-video file;
将每个子视频文件与EPG电子节目指南菜单关联,用于定位查找。Each sub-video file is associated with an EPG electronic program guide menu for positioning and searching.
所述的视频直播录制处理方法,其中,还包括步骤:The method for processing live video recording, which also includes the steps of:
当在视频录制过程或视频回放过程中,接收到合拍操作指令,则控制画面缩小1/2,并控制摄像头采集用户场景画面;进行合拍操作。When a co-shooting operation instruction is received during video recording or video playback, the control screen is reduced by 1/2, and the camera is controlled to collect user scene images; and co-shooting operation is performed.
所述的视频直播录制处理方法,其中,其还包括:The described live video recording processing method, wherein it also includes:
当需查询对应子视频文件,通过与对应子视频文件关联的EPG电子节目指南菜单,快速定位查找对应视频文件。When it is necessary to query the corresponding sub-video file, quickly locate and find the corresponding video file through the EPG electronic program guide menu associated with the corresponding sub-video file.
所述的视频直播录制处理方法,其中,所述获取录制的视频文件,对每个录制视频文件按预定时长进行分割,分割为多个子视频文件的步骤包括:The method for processing live video recording, wherein the step of obtaining the recorded video files, dividing each recorded video file according to a predetermined duration, and dividing into multiple sub-video files includes:
给每个录制视频文件按照固定时间点,将每个录制的视频文件按预定时长平均分割为若干份子视频文件,将每个子视频文件开始播放的时间点作为固定时间点。According to a fixed time point for each recorded video file, each recorded video file is equally divided into several sub-video files according to a predetermined duration, and the time point at which each sub-video file starts playing is taken as a fixed time point.
所述的视频直播录制处理方法,其中,所述对分割的每个子视频文件,截取变化关键帧图片作为该子视频文件显示的缩略图标的步骤包括:The described live video recording processing method, wherein, for each divided sub-video file, the step of intercepting the changing key frame picture as the thumbnail icon displayed by the sub-video file includes:
对分割的每个子视频文件,根据该子视频文件中相邻帧内容的变化情况确定场景变换关键帧,并对所述场景变换关键帧对应的图片进行截取;To each sub-video file of segmentation, according to the changing situation of adjacent frame content in this sub-video file, determine the scene change key frame, and the picture corresponding to described scene change key frame is intercepted;
通过预先训练好的用于图片分类的机器学习模型为截取到的图片进行打分并排序;根据排序将得分最高的指定幅图片作为该对应子视频文件封面的候选图片;用于选中EPG电子节目指南菜单时预览作为该子视频文件显示的缩略图标。Score and sort the intercepted pictures through the pre-trained machine learning model for picture classification; according to the sorting, the specified picture with the highest score is used as the candidate picture for the cover of the corresponding sub-video file; used to select the EPG electronic program guide The thumbnail icon displayed as the sub video file when previewing in the menu.
所述的视频直播录制处理方法,其中,所述根据该子视频文件中相邻帧内容的变化情况确定场景变换关键帧,并对所述场景变换关键帧对应的图片进行截取的步骤包括:The method for processing live video recording, wherein, the step of determining the scene change key frame according to the change of the adjacent frame content in the sub-video file, and intercepting the picture corresponding to the scene change key frame includes:
判断视频文件中相邻两帧内容变化是否超出预置的变化阈值;Determine whether the content change of two adjacent frames in the video file exceeds the preset change threshold;
将超出预置变化阈值的帧确定为场景变换关键帧;Determining frames exceeding a preset change threshold as scene change key frames;
对场景变换关键帧对应的图片进行截取,并将截取到的图片组成场景变换关键帧图片集合。The pictures corresponding to the scene change key frames are intercepted, and the captured pictures are composed into a scene change key frame picture set.
所述的视频直播录制处理方法,其中,所述将每个子视频文件与EPG电子节目指南菜单关联,用于定位查找的步骤包括:The described live video recording processing method, wherein, the steps of associating each sub-video file with the EPG electronic program guide menu for locating and searching include:
对每个子视频文件对应节目的服务配置文件标识符Service id,网络地址Network id,事件识别符最新查询Event id找到对应EPG菜单的节目位置,并在该位置链接对应媒体文件路径,用于直接追溯EPG菜单的节目位置找到对应录制文件。For the service configuration file identifier Service id, network address Network id, and event identifier of the program corresponding to each sub-video file, query the latest Event id to find the program location corresponding to the EPG menu, and link the corresponding media file path at this location for direct traceability Find the corresponding recording file in the program location of the EPG menu.
一种视频直播录制处理装置,其中,所述装置包括:A live video recording processing device, wherein the device includes:
视频录制启动模块,用于控制启动录制视频文件;The video recording start module is used to control and start recording video files;
视频分割模块,用于获取录制的视频文件,对每个录制视频文件按预定时长进行分割,分割为多个子视频文件;The video segmentation module is used to obtain recorded video files, and each recorded video file is divided into a plurality of sub-video files according to a predetermined duration;
缩略图截取模块,用于对分割的每个子视频文件,截取变化关键帧图片作为该子视频文件显示的缩略图标;Thumbnail image interception module, for each sub-video file of division, intercepts the change key frame picture as the thumbnail icon that this sub-video file shows;
菜单关联模块,用于将每个子视频文件与EPG电子节目指南菜单关联,用于定位查找;The menu association module is used to associate each sub-video file with the EPG electronic program guide menu for positioning and searching;
合拍操作模块,用于当在视频录制过程或视频回放过程中,接收到合拍操作指令,则控制画面缩小1/2,并控制摄像头采集用户场景画面;进行合拍操作。The co-shooting operation module is used to control the image to shrink by 1/2 when the co-shooting operation command is received during the video recording process or the video playback process, and to control the camera to collect user scene images; to perform the co-shooting operation.
一种智能终端,其中,包括有存储器,以及一个或者一个以上的程序,其中一个或者一个以上程序存储于存储器中,且经配置以由一个或者一个以上处理器执行所述一个或者一个以上程序包含用于执行任意一项所述的方法。An intelligent terminal, including a memory, and one or more programs, wherein one or more programs are stored in the memory, and configured to be executed by one or more processors. The one or more programs include For performing any one of the described methods.
一种非临时性计算机可读存储介质,当所述存储介质中的指令由电子设备的处理器执行时,使得电子设备能够执行任意一项所述的方法。A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can execute any one of the methods described above.
本发明的有益效果:本发明实施例通过给每个录制视频文件按照固定时间点(比如,将一个视频按时长平均分割为若干份子视频,将每份子视频开始播放的时间点作为固定时间点,等等),从该视频中截取图片作为视频封面的候选图片,视频文件以缩略图的形式展示,并且针对该录制视频对应节目的Service id(服务配置文件标识符),Network id(网络地址),Event id(事件识别符最新查询)找到对应EPG菜单的event(节目)位置(坐标位置),在该位置链接对应媒体文件路径,这样用户也可以直接追溯EPG菜单的event(节目)位置找到该对应录制文件,提高用户操作体验,在录制的过程中,用户可以一边timeshift回看录制文件,也可以选择通过麦克风和摄像头,采集当前用户场景的音视频数据,加入录制文件一控制合拍,以获得和明星偶现一起出镜的画面,提高娱乐性。Beneficial effects of the present invention: the embodiment of the present invention is by giving each recorded video file a fixed time point (for example, a video is divided into several sub-videos on average according to the duration, and the time point at which each sub-video starts to play is taken as a fixed time point, Etc.), intercept the picture from the video as a candidate picture for the video cover, the video file is displayed in the form of a thumbnail, and for the Service id (service configuration file identifier) and Network id (network address) of the program corresponding to the recorded video , Event id (the latest query of the event identifier) finds the event (program) position (coordinate position) corresponding to the EPG menu, and links the corresponding media file path at this position, so that the user can also directly trace the event (program) position of the EPG menu to find the Corresponding to the recorded files to improve the user experience. During the recording process, the user can watch the recorded files while timeshifting, or choose to collect the audio and video data of the current user scene through the microphone and camera, add the recorded files and control the co-production to obtain The scene of appearing on camera with stars occasionally improves entertainment.
与已知现有技术相比,本发明关键在于录制视频文件的封面智能截取显示,既可保证不遗漏视频文件中的所有重要场景,又可降低提供的视频封面候选图片的重复度,提升候选图片的质量。视频文件与EPG电子节目指南菜单关联的快速定位查找,以及在视频录制过程与用户采集音视频数据,进行合拍对口型等娱乐化应用,提高用户操作体验及娱乐趣味性,提升产品竞争力。Compared with the known prior art, the key of the present invention lies in the intelligent interception and display of the cover of the recorded video file, which can not only ensure that all important scenes in the video file are not missed, but also reduce the repetition degree of the provided video cover candidate pictures, and improve the candidates. The quality of the picture. Quick positioning and search of video files associated with EPG electronic program guide menus, as well as audio and video data collection with users during video recording, and entertainment applications such as co-shooting and lip-synching, improve user operating experience and entertainment fun, and enhance product competitiveness.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明中记载的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments described in the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1是本发明实施例提供的视频直播录制处理方法的流程示意图。FIG. 1 is a schematic flowchart of a method for processing live video recording provided by an embodiment of the present invention.
图2是本发明实施例提供的视频直播录制处理方法的具体应用实施例流程示意图。Fig. 2 is a schematic flow chart of a specific application embodiment of the video live recording processing method provided by the embodiment of the present invention.
图3是本发明实施例提供的视频直播录制处理方法的具体应用实施例的封面截取过程示意图。Fig. 3 is a schematic diagram of the cover art interception process of a specific application embodiment of the video live recording processing method provided by the embodiment of the present invention.
图4是本发明实施例提供的视频直播录制处理方法的具体应用实施例的合拍效果示意图。Fig. 4 is a schematic diagram of co-shooting effects of a specific application embodiment of the video live recording processing method provided by the embodiment of the present invention.
图5是本发明实施例提供的视频直播录制处理方法的具体应用实施例的数据流示意图。Fig. 5 is a schematic diagram of a data flow of a specific application embodiment of the video live recording processing method provided by the embodiment of the present invention.
图6是本发明实施例提供的视频直播录制处理装置的原理框图。Fig. 6 is a functional block diagram of a live video recording processing device provided by an embodiment of the present invention.
图7是本发明实施例提供的智能终端的内部结构原理框图。Fig. 7 is a functional block diagram of an internal structure of a smart terminal provided by an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明的目的、技术方案及优点更加清楚、明确,以下参照附图并举实施例对本发明进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to make the object, technical solution and advantages of the present invention more clear and definite, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
需要说明,若本发明实施例中有涉及方向性指示(诸如上、下、左、右、前、后……),则该方向性指示仅用于解释在某一特定姿态(如附图所示)下各部件之间的相对位置关系、运动情况等,如果该特定姿态发生改变时,则该方向性指示也相应地随之改变。It should be noted that if there is a directional indication (such as up, down, left, right, front, back...) in the embodiment of the present invention, the directional indication is only used to explain the position in a certain posture (as shown in the accompanying drawing). If the specific posture changes, the directional indication will also change accordingly.
现有技术的数字电视产品,基本都内置磁盘具备录制及timeshift回放等功能,一般情况下保存在磁盘的媒体文件只是以频道或者节目名称命名,入口往往是菜单的多媒体子目录,而大量文件积累后也不利于用户查找,即现有技术的数字电视视频录制内容不方便查找,并且录制的内容也往往比较单一,仅仅是原始电视节目内容,缺乏娱乐性,不方便用户使用的问题。Digital TV products in the prior art basically have built-in disks with functions such as recording and timeshift playback. Generally, the media files stored on the disks are only named after channels or program names. The entry is often the multimedia subdirectory of the menu, and a large number of files accumulate. Also be unfavorable for the user to search afterward, promptly the digital TV video recording content of prior art is inconvenient to search, and the content of recording is also often relatively single, is only original TV program content, lacks entertainment, the problem that user is inconvenient to use.
为了解决现有技术的问题,本发明提供一种视频直播录制处理方法,在发明实施例中,通过给每个录制视频文件按照固定时间点(比如,将一个视频按时长平均分割为若干份子视频,将每份子视频开始播放的时间点作为固定时间点,等等),从该视频中截取图片作为视频封面的候选图片,视频文件以缩略图的形式展示,并且针对该录制视频对应节目的Service id(服务配置文件标识符),Network id(网络地址),Event id(事件识别符最新查询)找到对应EPG菜单的event(节目)位置(坐标位置),在该位置链接对应媒体文件路径,这样用户也可以直接追溯EPG菜单的event(节目)位置找到该对应录制文件,提高用户操作体验,在录制的过程中,用户可以一边timeshift回看录制文件,也可以选择通过麦克风和摄像头,采集当前用户场景的音视频数据,加入录制文件一控制合拍,以获得和明星偶现一起出镜的画面,提高娱乐性。In order to solve the problems of the prior art, the present invention provides a method for processing live video recording. In the embodiment of the invention, by assigning each recorded video file to a fixed time point (for example, dividing a video into several sub-videos , take the time point at which each sub-video starts playing as a fixed time point, etc.), capture a picture from the video as a candidate picture for the video cover, and display the video file in the form of a thumbnail, and for the Service of the program corresponding to the recorded video id (service configuration file identifier), Network id (network address), Event id (event identifier latest query) to find the event (program) position (coordinate position) of the corresponding EPG menu, link the corresponding media file path at this position, like this The user can also directly trace the event (program) position of the EPG menu to find the corresponding recording file, which improves the user's operating experience. The audio and video data of the scene is added to the recording file to control the co-production, so as to obtain the picture of appearing with the star occasionally and improve the entertainment.
示例性方法exemplary method
如图1中所示,本发明实施例提供一种视频直播录制处理方法,所述方法包括如下步骤:As shown in Figure 1, an embodiment of the present invention provides a video live recording processing method, the method includes the following steps:
步骤S100、启动录制视频文件;Step S100, start recording video files;
本发明实施例,当需要录制视频文件时,接收操作指令启动录制视频文件。本发明实施例中录制视频文件可以为当前电视直播的视频节目,例如数字电视直播的视频文件,或电视回放的视频文件,或其它视频文件等。In the embodiment of the present invention, when a video file needs to be recorded, an operation instruction is received to start recording the video file. The recorded video file in the embodiment of the present invention may be a video program of the current live TV broadcast, such as a video file of a digital TV live broadcast, or a video file of a TV playback, or other video files.
本发明中用户也可以通过遥控器在EPG(电子节目)菜单设置预约录制时间。In the present invention, the user can also set the scheduled recording time in the EPG (Electronic Program) menu through the remote controller.
步骤S200、获取录制的视频文件,对每个录制视频文件按预定时长进行分割,分割为多个子视频文件;Step S200, obtaining recorded video files, and dividing each recorded video file into multiple sub-video files according to a predetermined duration;
本步骤获取录制的视频文件,对每个录制视频文件按预定时长进行分割,分割为多个子视频文件。In this step, recorded video files are obtained, and each recorded video file is divided into multiple sub-video files according to a predetermined duration.
本发明具体实施时,给每个录制视频文件按照固定时间点,将每个录制的视频文件按预定时长平均分割为若干份子视频文件,将每个子视频文件开始播放的时间点作为固定时间点。During the specific implementation of the present invention, each recorded video file is divided into several sub-video files on average according to a fixed time point according to a predetermined duration, and the time point at which each sub-video file starts playing is taken as a fixed time point.
例如,给每个录制视频文件按照固定时间点(比如,将一个视频按时长平均分割为若干份子视频,将每份子视频开始播放的时间点作为固定时间点,等等)。For example, according to a fixed time point for each recorded video file (for example, a video is divided into several sub-videos on average according to the duration, and the time point at which each sub-video starts playing is used as a fixed time point, etc.).
步骤S300、对分割的每个子视频文件,截取变化关键帧图片作为该子视频文件显示的缩略图标;Step S300, for each divided sub-video file, intercept the changing key frame picture as the thumbnail icon displayed by the sub-video file;
本步骤主要是对分割的每个子视频文件,截取变化关键帧图片作为该子视频文件显示的缩略图标。即本发明实施例中,对每个子视频文件,截取变化关键帧图像作为该子视频文件显示的缩略图标。This step is mainly to intercept the changing key frame picture as the thumbnail icon displayed by the sub-video file for each sub-video file divided. That is, in the embodiment of the present invention, for each sub-video file, the image of the changed key frame is intercepted as the thumbnail icon displayed by the sub-video file.
具体为:对分割的每个子视频文件,根据该子视频文件中相邻帧内容的变化情况确定场景变换关键帧,并对所述场景变换关键帧对应的图片进行截取;Specifically: for each sub-video file of segmentation, determine the key frame of scene change according to the variation of adjacent frame content in the sub-video file, and intercept the picture corresponding to the key frame of scene change;
然后通过预先训练好的用于图片分类的机器学习模型为截取到的图片进行打分并排序;根据排序将得分最高的指定幅图片作为该对应子视频文件封面的候选图片;用于选中EPG电子节目指南菜单时预览作为该子视频文件显示的缩略图标。例如根据排序将得分最高的10幅图片作为视频封面的候选图片,以便用户选中Event菜单时预览该10幅图片,或者磁盘文件列表时缩略显示最高分图片。Then score and sort the captured pictures through the pre-trained machine learning model for picture classification; according to the sorting, the specified picture with the highest score is used as the candidate picture for the cover of the corresponding sub-video file; it is used to select the EPG electronic program The thumbnail icon displayed as the sub video file when previewing the guide menu. For example, according to the ranking, the 10 highest-scoring images are used as candidate images for the video cover, so that the user can preview the 10 images when selecting the Event menu, or display the highest-scoring images as thumbnails in the disk file list.
其中,所述根据该子视频文件中相邻帧内容的变化情况确定场景变换关键帧,并对所述场景变换关键帧对应的图片进行截取的步骤包括:Wherein, the described step of determining the scene change key frame according to the variation of the adjacent frame content in the sub-video file, and intercepting the picture corresponding to the scene change key frame includes:
判断视频文件中相邻两帧内容变化是否超出预置的变化阈值;Determine whether the content change of two adjacent frames in the video file exceeds the preset change threshold;
将超出预置变化阈值的帧确定为场景变换关键帧;Determining frames exceeding a preset change threshold as scene change key frames;
对场景变换关键帧对应的图片进行截取,并将截取到的图片组成场景变换关键帧图片集合。The pictures corresponding to the scene change key frames are intercepted, and the captured pictures are composed into a scene change key frame picture set.
步骤S400、将每个子视频文件与EPG电子节目指南菜单关联,用于定位查找。Step S400, associating each sub-video file with an EPG electronic program guide menu for positioning and searching.
本发明实施例中,会将每个子视频文件与EPG电子节目指南菜单关联,例如将子视频文件的地址与EPG电子节目指南菜单建立链接,用于定位查找。In the embodiment of the present invention, each sub-video file is associated with the EPG electronic program guide menu, for example, the address of the sub-video file is linked with the EPG electronic program guide menu for locating and searching.
具体为:对每个子视频文件对应节目的服务配置文件标识符Service id,网络地址Network id,事件识别符最新查询Event id找到对应EPG菜单的节目位置,并在该位置链接对应媒体文件路径,即链接对应的子视频文件,用于直接追溯EPG菜单的节目位置找到对应录制文件。Specifically: for the service configuration file identifier Service id of the program corresponding to each sub-video file, the network address Network id, and the latest query Event id of the event identifier to find the program position corresponding to the EPG menu, and link the corresponding media file path at this position, that is Link to the corresponding sub-video file, which is used to directly trace the program position of the EPG menu to find the corresponding recording file.
例如、用户可以通过关联Service id,Network id,Event id找到EPG菜单上对应节目的录制回放文件,也可通过预览封面及截图了解视频文件大概内容。For example, users can find the recording and playback files of corresponding programs on the EPG menu by associating Service id, Network id, and Event id, and can also learn about the approximate content of video files by previewing the cover art and screenshots.
进一步地实施例,所述的视频直播录制处理方法,其中,其还包括步骤:As a further embodiment, the described live video recording processing method, wherein it also includes the steps of:
当在视频录制过程或视频回放过程中,接收到合拍操作指令,则控制画面缩小1/2,并控制摄像头采集用户场景画面;进行合拍操作。When a co-shooting operation instruction is received during video recording or video playback, the control screen is reduced by 1/2, and the camera is controlled to collect user scene images; and co-shooting operation is performed.
例如当用户看到喜爱的明星偶像出现桥段时,可以通过按下Timeshift回放键,立即回放当前时间段直播内容,点击合拍按钮,回放画面缩小1/2,此时摄像头采集用户场景画面,将视频数据填充到Video Out窗口的另1/2,过滤掉当前用户声音。此时Video通道输出数据Buffer保存到磁盘为合拍文件,相应地也可以采集脸部图像数据,在录制文件中替换人物脸部图像,达到换脸效果。For example, when a user sees a scene of their favorite star idol, they can press the Timeshift playback button to immediately playback the live broadcast content of the current time period, click the co-shoot button, and the playback screen will be reduced by 1/2. At this time, the camera captures the user scene screen and The video data is filled to the other 1/2 of the Video Out window, and the current user's voice is filtered out. At this time, the output data Buffer of the Video channel is saved to the disk as a co-shooting file. Correspondingly, the face image data can also be collected, and the face image of the person can be replaced in the recording file to achieve the face-changing effect.
进一步地实施例,所述的视频直播录制处理方法,其还包括步骤:As a further embodiment, the described live video recording processing method also includes the steps of:
当需查询对应子视频文件,通过与对应子视频文件关联的EPG电子节目指南菜单,快速定位查找对应视频文件。即本发明实施例中,一方面可以通过分割后的子视频文件的关键帧缩略图迅速找到对应的子视频文件,另一方面可以通过与对应子视频文件关联的EPG电子节目指南菜单,快速定位查找对应视频文件,为用户的操作使用大大提供了方便。When it is necessary to query the corresponding sub-video file, quickly locate and find the corresponding video file through the EPG electronic program guide menu associated with the corresponding sub-video file. That is, in the embodiment of the present invention, on the one hand, the corresponding sub-video file can be quickly found through the key frame thumbnails of the divided sub-video files; Find the corresponding video file, which greatly provides convenience for the user's operation and use.
以下通过具体的应用实施例对本发明做进一步说明:The present invention will be further described below by specific application examples:
本具体应用实施例的一种视频直播录制处理方法,包括以下步骤:A method for processing live video recording in this specific application embodiment includes the following steps:
步骤S10、开始;Step S10, start;
步骤S11、预约一个时间点的节目录制,并进入S12;Step S11, reserve a program recording at a time point, and proceed to S12;
例如、用户遥控器在EPG菜单预约录制下设定时间,当时间到达时记录当前所录频道当前节目的Serviceid,Network id,Event Id(来自数据电视广播DVB码流规范协议内容,三要素唯一确定一个Event节目,可从EIT表获得),在磁盘生成该视频文件。For example, the user's remote controller sets the time under the EPG menu reservation recording, and when the time arrives, it will record the Serviceid, Network id, and Event Id of the current program of the currently recorded channel (from the data TV broadcasting DVB code stream specification protocol content, the three elements are uniquely determined An Event program, available from the EIT table), generates the video file on disk.
步骤S12、根据内容变化情况截取关键帧图片,并进入S13;Step S12, intercepting key frame pictures according to content changes, and proceeding to S13;
例如根据该视频文件中相邻帧内容的变化情况确定场景变换关键帧,并对所述场景变换关键帧对应的图片进行截取。图3是本发明实施例提供的视频直播录制处理方法的具体应用实施例的封面截取过程示意图。For example, the key frame of scene change is determined according to the content change of adjacent frames in the video file, and the picture corresponding to the key frame of scene change is intercepted. Fig. 3 is a schematic diagram of the cover art interception process of a specific application embodiment of the video live recording processing method provided by the embodiment of the present invention.
步骤S13、训练图像分类的CNN机器学习模型,给截图图片打分;并进入步骤S14;Step S13, training the CNN machine learning model for image classification, scoring the screenshots; and entering step S14;
步骤S14、评估打分是否通过,当是进入步骤S16,当否进入步骤S15;Step S14, evaluate whether the scoring is passed, if yes, go to step S16, if no, go to step S15;
步骤S15,当打分不通过,调整算法及CNN权值;并返回步骤S13。Step S15, when the scoring fails, adjust the algorithm and CNN weights; and return to step S13.
步骤S16,将该录制节目Service id,Network id,Event id三要素与录制文件一一对应;并进入步骤S17;Step S16, corresponding the recording program Service id, Network id, and Event id three elements to the recording file one by one; and enter step S17;
步骤S17、保存为录制文件,并已生成10副封面图,并进入S18;Step S17, save as a recording file, and 10 cover images have been generated, and proceed to S18;
其中上述步骤S13至步骤S17举例为:例如通过预先训练好的用于图片分类的CNN机器学习模型为截取到的图片进行打分并排序;根据排序将得分最高的10幅图片作为视频封面的候选图片,以便用户选中Event菜单时预览该10幅图片,或者磁盘文件列表时缩略显示最高分图片。Among them, the above-mentioned steps S13 to S17 are exemplified as: for example, scoring and sorting the intercepted pictures through the pre-trained CNN machine learning model for picture classification; according to the sorting, the 10 pictures with the highest scores are used as candidate pictures for the video cover , so that the user can preview the 10 images when selecting the Event menu, or display the highest-scoring image as a thumbnail in the disk file list.
根据视频文件中相邻帧内容的变化情况确定场景变换关键帧并对所述场景变换关键帧对应的图片进行截取,包括:判断视频文件中相邻两帧内容变化是否超出预置的变化阈值;Determine the scene change key frame according to the change situation of the adjacent frame content in the video file and intercept the picture corresponding to the scene change key frame, including: judging whether the content change of two adjacent frames in the video file exceeds a preset change threshold;
将超出预置变化阈值的帧确定为场景变换关键帧;对场景变换关键帧对应的图片进行截取,并将截取到的图片组成场景变换关键帧图片集合。Determining frames exceeding a preset change threshold as scene change key frames; intercepting pictures corresponding to the scene change key frames, and composing the captured pictures into a scene change key frame picture set.
本发明中对用于图片分类的机器学习模型的训练,包括:确定用于训练的图片数据;将所述图片数据在的CNN机器学习模型中做迭代训练,并在迭代训练过程中调整卷积神经网络的权值,以在CNN机器学习模型的基础上得到用于图片分类的CNN机器学习模型;对所述用于图片分类的CNN机器学习模型进行评估;若评估通过,则训练结束。In the present invention, the training of the machine learning model used for picture classification includes: determining the picture data for training; performing iterative training on the picture data in the CNN machine learning model, and adjusting the convolution during the iterative training process The weight of the neural network is used to obtain the CNN machine learning model for picture classification on the basis of the CNN machine learning model; the CNN machine learning model for picture classification is evaluated; if the evaluation is passed, the training ends.
本发明实施例中若评估未通过,则对CNN机器学习模型中采用算法参数进行调整,并在迭代训练过程中CNN的权值,直至得到的CNN机器学习模型评估通过。In the embodiment of the present invention, if the evaluation fails, the algorithm parameters used in the CNN machine learning model are adjusted, and the weights of the CNN are adjusted during the iterative training process until the obtained CNN machine learning model passes the evaluation.
本具体实施例中,用于机器学习模型训练的图片数据包括:基础图片数据集,色彩特征参数值,饱和度阈值,黑白图片亮度值等不符合预置条件的图片去除。至此按照上述步骤,预约录制的文件已经为用户生成并且有10幅预览封面。In this specific embodiment, the picture data used for machine learning model training includes: basic picture data set, color feature parameter value, saturation threshold, black and white picture brightness value and other pictures that do not meet the preset conditions are removed. So far, according to the above steps, the scheduled recording file has been generated for the user and has 10 preview covers.
例如用户可以通过关联Service id,Network id,Event id找到EPG菜单上对应节目的录制回放文件,也可通过预览封面及截图了解视频文件大概内容。For example, users can find the recording and playback files of corresponding programs on the EPG menu by associating Service id, Network id, and Event id, and can also learn about the general content of video files by previewing the cover and screenshots.
步骤S18,检测用户是否需要合拍,当是进入S19,当否进入S21;Step S18, detect whether the user needs to shoot together, if yes, go to S19, if not, go to S21;
步骤S19、按下Timeshift回放键,立即回放当前时间段直播内容,点击合拍按钮,并进入步骤S20;Step S19, press the Timeshift playback key, immediately replay the live broadcast content of the current time period, click the co-production button, and enter step S20;
步骤S20、回放画面数据与用户场景画面,分别填充到Video Out的1/2窗口Video通道输出数据Buffer保存到磁盘为合拍文件,并进入步骤S21。Step S20, the playback image data and the user scene image are respectively filled into the 1/2 window of Video Out, the Video channel output data Buffer is saved to the disk as a co-production file, and the process proceeds to step S21.
图4是本发明实施例提供的视频直播录制处理方法的具体应用实施例的合拍效果示意图。本发明实施例中,当用户看到喜爱的明星偶像出现桥段时,可以通过按下Timeshift回放键,立即回放当前时间段直播内容,点击合拍按钮,回放画面缩小1/2,此时摄像头采集用户场景画面,Fig. 4 is a schematic diagram of co-shooting effects of a specific application embodiment of the video live recording processing method provided by the embodiment of the present invention. In the embodiment of the present invention, when the user sees the appearance of a favorite star idol, he can press the Timeshift playback button to immediately playback the live broadcast content of the current time period, click the co-shoot button, and the playback screen will be reduced by 1/2. At this time, the camera captures user scene screen,
将视频数据填充到Video Out窗口的另1/2,过滤掉当前用户声音。此时Video通道输出数据Buffer保存到磁盘为合拍文件,相应地也可以采集脸部图像数据,在录制文件中替换人物脸部图像,达到换脸效果。如图4,Fill the video data into the other 1/2 of the Video Out window, and filter out the current user's voice. At this time, the output data Buffer of the Video channel is saved to the disk as a co-shooting file. Correspondingly, the face image data can also be collected, and the face image of the person can be replaced in the recording file to achieve the face-changing effect. As shown in Figure 4,
图5是本发明实施例提供的视频直播录制处理方法的具体应用实施例的数据流示意图,图4中(1)和(2)两路数据合成到一路保存为文件。Fig. 5 is a schematic diagram of the data flow of a specific application embodiment of the video live recording processing method provided by the embodiment of the present invention, in Fig. 4, two channels of data (1) and (2) are synthesized into one and saved as a file.
本发明实施例中,打开合拍文件,可以浏览,可以分享给朋友。In the embodiment of the present invention, the co-shooting file can be opened, browsed, and shared with friends.
综上,以上步骤就可以达到上述2种目的,提高用户体验及娱乐性。图3,图4示意所述效果。To sum up, the above steps can achieve the above two purposes and improve user experience and entertainment. Figure 3 and Figure 4 illustrate the effect.
由此可见,本发明实施例与已知现有技术相比,本发明关键在于录制视频文件的封面智能截取显示,既可保证不遗漏视频文件中的所有重要场景,又可降低提供的视频封面候选图片的重复度,提升候选图片的质量。视频文件与EPG电子节目指南菜单关联的快速定位查找,以及在视频录制过程与用户采集音视频数据,进行合拍对口型等娱乐化应用,提高用户操作体验及娱乐趣味性,提升产品竞争力。It can be seen that, compared with the known prior art, the embodiment of the present invention lies in the intelligent interception and display of the cover of the recorded video file, which can not only ensure that all important scenes in the video file are not missed, but also reduce the number of provided video covers. The repetition degree of the candidate picture improves the quality of the candidate picture. Quick positioning and search of video files associated with EPG electronic program guide menus, as well as audio and video data collection with users during video recording, and entertainment applications such as co-shooting and lip-syncing, improve user operating experience and entertainment fun, and enhance product competitiveness.
示例性设备exemplary device
如图5中所示,本发明实施例提供一种视频直播录制处理装置,该装置包括:As shown in Figure 5, an embodiment of the present invention provides a live video recording processing device, which includes:
视频录制启动模块510,用于控制启动录制视频文件;Video
视频分割模块520,用于获取录制的视频文件,对每个录制视频文件按预定时长进行分割,分割为多个子视频文件;The
缩略图截取模块530,用于对分割的每个子视频文件,截取变化关键帧图片作为该子视频文件显示的缩略图标;Thumbnail
菜单关联模块540,用于将每个子视频文件与EPG电子节目指南菜单关联,用于定位查找;
合拍操作模块550,用于当在视频录制过程或视频回放过程中,接收到合拍操作指令,则控制画面缩小1/2,并控制摄像头采集用户场景画面;进行合拍操作,具体如上所述。The
基于上述实施例,本发明还提供了一种智能终端,其原理框图可以如图7所示。该智能终端包括通过系统总线连接的处理器、存储器、网络接口、显示屏、摄像头。其中,该智能终端的处理器用于提供计算和控制能力。该智能终端的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该智能终端的网络接口用于与外部的终端通过网络连接通信。该计算机程序被处理器执行时以实现一种视频直播录制处理方法。该智能终端的显示屏可以是液晶显示屏或者电子墨水显示屏,该智能终端的摄像头是预先在智能终端上,用于合拍时拍摄录制。本发明的智能终端可以为数字电视。Based on the above embodiments, the present invention also provides an intelligent terminal, the functional block diagram of which may be shown in FIG. 7 . The intelligent terminal includes a processor, a memory, a network interface, a display screen and a camera connected through a system bus. Wherein, the processor of the smart terminal is used to provide calculation and control capabilities. The memory of the smart terminal includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface of the smart terminal is used to communicate with external terminals through a network connection. When the computer program is executed by the processor, a method for processing live video recording is realized. The display screen of the smart terminal may be a liquid crystal display screen or an electronic ink display screen, and the camera of the smart terminal is pre-installed on the smart terminal for shooting and recording during co-shooting. The intelligent terminal of the present invention may be a digital TV.
本领域技术人员可以理解,图7中示出的原理框图,仅仅是与本发明方案相关的部分结构的框图,并不构成对本发明方案所应用于其上的智能终端的限定,具体的智能终端可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。Those skilled in the art can understand that the functional block diagram shown in FIG. 7 is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation on the intelligent terminal to which the solution of the present invention is applied. The specific intelligent terminal More or fewer components than shown in the figures may be included, or certain components may be combined, or have a different arrangement of components.
在一个实施例中,提供了一种智能终端,包括有存储器,以及一个或者一个以上的程序,其中一个或者一个以上程序存储于存储器中,且经配置以由一个或者一个以上处理器执行所述一个或者一个以上程序包含用于进行以下操作的指令:In one embodiment, an intelligent terminal is provided, including a memory, and one or more programs, wherein one or more programs are stored in the memory, and are configured to be executed by one or more processors. One or more programs contain instructions for:
启动录制视频文件;Start recording video files;
获取录制的视频文件,对每个录制视频文件按预定时长进行分割,分割为多个子视频文件;Obtain the recorded video file, divide each recorded video file according to the predetermined duration, and divide it into multiple sub-video files;
对分割的每个子视频文件,截取变化关键帧图片作为该子视频文件显示的缩略图标;For each sub-video file that is divided, intercept the changing key frame picture as the thumbnail icon displayed by the sub-video file;
将每个子视频文件与EPG电子节目指南菜单关联,用于定位查找。Each sub-video file is associated with an EPG electronic program guide menu for positioning and searching.
当在视频录制过程或视频回放过程中,接收到合拍操作指令,则控制画面缩小1/2,并控制摄像头采集用户场景画面;进行合拍操作。When a co-shooting operation instruction is received during video recording or video playback, the control screen is reduced by 1/2, and the camera is controlled to collect user scene images; and co-shooting operation is performed.
当需查询对应子视频文件,通过与对应子视频文件关联的EPG电子节目指南菜单,快速定位查找对应视频文件;具体如上所述。When it is necessary to query the corresponding sub-video file, quickly locate and find the corresponding video file through the EPG electronic program guide menu associated with the corresponding sub-video file; the details are as described above.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本发明所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the computer programs can be stored in a non-volatile computer-readable memory In the medium, when the computer program is executed, it may include the processes of the embodiments of the above-mentioned methods. Wherein, any references to memory, storage, database or other media used in the various embodiments provided by the present invention may include non-volatile and/or volatile memory. Nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
综上所述,本发明公开了一种视频直播录制处理方法、装置、智能终端及存储介质,所述方法包括:启动录制视频文件;获取录制的视频文件,对每个录制视频文件按预定时长进行分割,分割为多个子视频文件;对分割的每个子视频文件,截取变化关键帧图片作为该子视频文件显示的缩略图标;将每个子视频文件与EPG电子节目指南菜单关联,用于定位查找。本发明关键在于录制视频文件的封面智能截取显示,既可保证不遗漏视频文件中的所有重要场景,又可降低提供的视频封面候选图片的重复度,提升候选图片的质量。视频文件与EPG电子节目指南菜单关联的快速定位查找,以及在视频录制过程与用户采集音视频数据,进行合拍对口型等娱乐化应用,提高用户操作体验及娱乐趣味性,提升产品竞争力。In summary, the present invention discloses a video live recording processing method, device, intelligent terminal and storage medium. The method includes: starting to record video files; Carry out segmentation, be divided into a plurality of sub-video files; For each sub-video file of segmentation, intercept the change key frame picture as the thumbnail icon that this sub-video file shows; Each sub-video file is associated with the EPG electronic program guide menu for positioning find. The key of the present invention lies in the intelligent interception and display of the cover of the recorded video file, which can not only ensure that all important scenes in the video file are not missed, but also reduce the repetition degree of the provided video cover candidate pictures and improve the quality of the candidate pictures. Quick positioning and search of video files associated with EPG electronic program guide menus, as well as audio and video data collection with users during video recording, and entertainment applications such as co-shooting and lip-syncing, improve user operating experience and entertainment fun, and enhance product competitiveness.
应当理解的是,本发明的应用不限于上述的举例,对本领域普通技术人员来说,可以根据上述说明加以改进或变换,所有这些改进和变换都应属于本发明所附权利要求的保护范围。It should be understood that the application of the present invention is not limited to the above examples, and those skilled in the art can make improvements or transformations according to the above descriptions, and all these improvements and transformations should belong to the protection scope of the appended claims of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010870180.4ACN112004108B (en) | 2020-08-26 | 2020-08-26 | Live video recording processing method and device, intelligent terminal and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010870180.4ACN112004108B (en) | 2020-08-26 | 2020-08-26 | Live video recording processing method and device, intelligent terminal and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN112004108A CN112004108A (en) | 2020-11-27 |
| CN112004108Btrue CN112004108B (en) | 2022-11-01 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010870180.4AActiveCN112004108B (en) | 2020-08-26 | 2020-08-26 | Live video recording processing method and device, intelligent terminal and storage medium |
| Country | Link |
|---|---|
| CN (1) | CN112004108B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112689108A (en)* | 2020-12-22 | 2021-04-20 | 山东快课信息科技有限公司 | System and method for recording and playing blackboard writing in sections based on key frames |
| CN113392129B (en)* | 2021-06-28 | 2024-04-12 | 恒安嘉新(北京)科技股份公司 | Menu searching method and device, electronic equipment and storage medium |
| CN113556492B (en)* | 2021-07-09 | 2023-10-20 | 深圳传音控股股份有限公司 | Thumbnail generation method, mobile terminal and readable storage medium |
| CN117014649A (en)* | 2022-04-28 | 2023-11-07 | 北京字跳网络技术有限公司 | Video processing method and device and electronic equipment |
| CN114915851A (en)* | 2022-05-31 | 2022-08-16 | 展讯通信(天津)有限公司 | Video recording and playing method and device |
| CN115883862A (en)* | 2022-11-11 | 2023-03-31 | 深圳市其乐游戏科技有限公司 | Automatic live recording method, server, system and storage medium |
| CN118016110B (en)* | 2024-04-07 | 2024-09-13 | 路九阳 | Media data recording and playing method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2243078A4 (en)* | 2008-01-07 | 2011-05-11 | Smart Technologies Ulc | Method of launching a selected application in a multi-monitor computer system and multi-monitor computer system employing the same |
| CN101572788A (en)* | 2009-04-03 | 2009-11-04 | 深圳市同洲电子股份有限公司 | Method, system and PVR set-top box for poster displaying of recorded files |
| CN106503693B (en)* | 2016-11-28 | 2019-03-15 | 北京字节跳动科技有限公司 | The providing method and device of video cover |
| CN107580254A (en)* | 2017-08-08 | 2018-01-12 | 深圳Tcl数字技术有限公司 | Player method, method for recording and the record device of television program |
| CN108989691B (en)* | 2018-10-19 | 2021-04-06 | 北京微播视界科技有限公司 | Video shooting method and device, electronic equipment and computer readable storage medium |
| Publication number | Publication date |
|---|---|
| CN112004108A (en) | 2020-11-27 |
| Publication | Publication Date | Title |
|---|---|---|
| CN112004108B (en) | Live video recording processing method and device, intelligent terminal and storage medium | |
| US20210026886A1 (en) | Method and apparatus for determining background music of a video, terminal device and storage medium | |
| US8600191B2 (en) | Composite imaging method and system | |
| KR100637741B1 (en) | Image display method, program, and image display apparatus | |
| JP5552767B2 (en) | Display processing apparatus, display processing method, and display processing program | |
| WO2019191708A1 (en) | Socially annotated audiovisual content | |
| US20230315784A1 (en) | Multimedia focalization | |
| JP4510718B2 (en) | Image output apparatus and control method thereof | |
| JP2013257869A (en) | Overlay image provision system, server and method | |
| US12132971B2 (en) | Automatically generating supercuts | |
| CN114598819B (en) | Video recording method and device and electronic equipment | |
| WO2022037307A1 (en) | Information recommendation method and apparatus, and electronic device | |
| WO2021169720A1 (en) | Content operation method and device, terminal, and storage medium | |
| CN111405339A (en) | A split-screen display method, electronic device and storage medium | |
| US20240146863A1 (en) | Information processing device, information processing program, and recording medium | |
| CN107480265A (en) | Data recommendation method, device, equipment and storage medium | |
| CN113992992A (en) | Fragmented film viewing processing method and device based on face recognition and smart television | |
| WO2013187796A1 (en) | Method for automatically editing digital video files | |
| US11477541B2 (en) | Automatically generating supercuts | |
| US10992901B2 (en) | Method, apparatus, device and storage medium for controlling video playback speed | |
| EP2914010A1 (en) | Content switching method and apparatus | |
| CN115086611A (en) | Lightweight video supervision method, system and equipment | |
| WO2022239281A1 (en) | Image processing device, image processing method, and program | |
| JP4876736B2 (en) | Document camera device | |
| CN106507183B (en) | Method and device for acquiring video name |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |