


技术领域technical field
本发明属于视频播放技术领域,具体涉及一种视频内容索引文件的自动产生、编辑方法与应用。The invention belongs to the technical field of video playing, and in particular relates to an automatic generation and editing method and application of a video content index file.
背景技术Background technique
场景分割技术,是将视频文件按照场景进行机器分割的方法。通过场景分割技术能够实现按照场景的变化将完整视频结构化地分成若干视频片段,这些视频片段处于独立的场景中。Scene segmentation technology is a method of machine-segmenting video files according to scenes. The scene segmentation technology can be used to structurally divide a complete video into several video clips according to scene changes, and these video clips are in independent scenes.
在视频播放系统中,人们希望有一种视频内容索引文件,以便用户有针对性地选择感兴趣的视频,并辅助用户观看视频。In a video playback system, people hope to have a video content index file so that users can select videos of interest in a targeted manner and assist users to watch videos.
本发明中,经过场景分割后形成的视频内容索引由一个目录文件进行组织。目录文件包含了视频内容索引文件的序号以及对应在视频中的时间。In the present invention, the video content index formed after scene segmentation is organized by a directory file. The directory file contains the serial number of the video content index file and the corresponding time in the video.
发明内容Contents of the invention
本发明的目的在于提供一种能辅助用户观看视频的视频内容索引文件的自动产生、编辑方法,并提供该视频内容索引文件的应用。The purpose of the present invention is to provide an automatic generation and editing method of a video content index file that can assist users to watch videos, and provide an application of the video content index file.
本发明首先将视频文件按内容上的关联性分割成若干片段,在每个片段中提取具有代表性的一帧图像作为该片段视频内容的索引,同时记录每个视频内容索引对应于整个视频文件的时间偏移值,并且以时间的顺序对每一个视频内容索引进行编号(即索引ID)。然后将一个视频文件产生的所有视频内容索引保存在视频内容索引文件中,并且记录视频的ID号、视频文件名、视频描述、视频大小、视频时长、分享者信息、视频内容索引图片的尺寸等信息。通过视频ID+索引ID的方式,能够精确定位到每一个视频内容索引,从而实现了用户评论、视频观看热度统计、热门视频推荐等操作细化到每个视频内容索引对应的视频片段,而在传统方式下用户只能对视频进行评论,统计与推荐等。The present invention first divides the video file into several segments according to the relevance of the content, extracts a representative frame of image in each segment as the index of the video content of the segment, and records that each video content index corresponds to the entire video file The time offset value of , and number each video content index in time order (that is, the index ID). Then save all video content indexes generated by a video file in the video content index file, and record the video ID number, video file name, video description, video size, video duration, sharer information, video content index image size, etc. information. Through the method of video ID + index ID, each video content index can be accurately located, so that operations such as user comments, video viewing popularity statistics, and popular video recommendations can be refined to the video clips corresponding to each video content index. In this mode, users can only make comments, statistics and recommendations on videos.
视频内容索引在整个播放系统中的应用可以总结为视频内容索引的产生、视频内容索引的编辑和视频内容索引的使用三个过程:The application of video content index in the entire playback system can be summarized as three processes: the generation of video content index, the editing of video content index and the use of video content index:
一、视频内容索引文件的产生1. Generation of video content index files
本发明使用视频场景分割的技术,对视频内容进行结构化分析,在逻辑上将一部完整的视频按照其故事情节分为关联性若干片段。在每个片段中提取具有代表性的一帧图像作为该片段视频内容的索引;同时记录每个视频内容索引对应于整个视频文件的时间偏移值,并以时间顺序对每一个视频内容索引进行编号(即索引ID)。The present invention uses the technology of video scene segmentation to structurally analyze the video content, and logically divides a complete video into several related segments according to its storyline. Extract a representative frame of image in each segment as the index of the video content of the segment; record the time offset value of each video content index corresponding to the entire video file at the same time, and perform each video content index in time order number (i.e. index ID).
视频内容索引文件由一个索引目录文件和若干视频内容索引文件组成,索引目录文件包含整部视频的信息和进行场景分割后的各个视频片段的组织及时间信息,例如视频的ID号、视频文件名、视频描述、视频大小、视频时长、分享者信息、视频内容索引图片的尺寸等信息。视频内容索引文件中包含视频片段中的一帧图像作为视频内容的索引以及完整视频的信息,当视频内容索引独立于目录文件时仍能检索出该视频内容索引对应的视频信息。 The video content index file consists of an index directory file and several video content index files. The index directory file contains the information of the entire video and the organization and time information of each video segment after scene segmentation, such as the ID number of the video and the name of the video file. , video description, video size, video duration, sharer information, video content index image size and other information. The video content index file contains a frame of image in the video clip as the video content index and complete video information. When the video content index is independent of the directory file, the video information corresponding to the video content index can still be retrieved. the
二、视频内容索引文件的编辑2. Editing of video content index files
视频内容索引文件具有多态性:视频内容索引文件的产生可以发生在用户机器或者服务器上,但在互联网中分享的视频内容索引文件必须上传至服务器,服务器中存储的视频内容索引文件即为原始态的视频内容索引文件;当用户从服务器中下载原始态的视频内容索引文件后,可任意编辑视频内容索引文件,此时即为用户态的视频内容索引文件,用户态的视频内容索引文件不会对原始态的视频内容索引文件产生干扰,此方法即保证了用户操作的自由度,同时保护了视频内容索引数据的一致性。The video content index file has polymorphism: the generation of the video content index file can happen on the user machine or the server, but the video content index file shared on the Internet must be uploaded to the server, and the video content index file stored in the server is the original The video content index file in the user state; when the user downloads the video content index file in the original state from the server, he can edit the video content index file arbitrarily. At this time, it is the video content index file in the user state, and the video content index file in the user state It will interfere with the original video content index file. This method not only ensures the freedom of user operation, but also protects the consistency of the video content index data.
用户从服务器中下载原始态的视频内容索引文件后,进行用户态的视频内容索引文件编辑操作,主要包括:视频内容索引文件的合并、手动产生视频内容索引文件等。视频内容索引文件的合并指的是用户可以对机器自动分割后的片段数量进行调整,将若干相邻的视频内容索引文件进行合并操作;手动产生视频内容索引文件指的是,用户替代机器分割的方式,手动对视频文件进行分割,自行调整分割的片段数,视频内容索引文件的起始时间等。After the user downloads the original video content index file from the server, edit the video content index file in the user mode, mainly including: merging video content index files, manually generating video content index files, etc. The merging of video content index files means that the user can adjust the number of segments automatically divided by the machine, and merge several adjacent video content index files; Manually split the video file, adjust the number of split segments, the start time of the video content index file, etc.
三、视频内容索引文件的应用3. Application of Video Content Index File
从用户角度而言视频内容索引可以在预览、定位、分享操作时得到应用,并能够极大的方便用户的诸多操作。From the user's point of view, the video content index can be applied in preview, positioning, and sharing operations, and can greatly facilitate many operations of the user.
快速预览。一个视频文件的视频内容索引文件是该视频的内容概括,通过视频内容索引用户能够大致判断视频的类型、风格、语言、地域等信息,便于用户快速了解视频信息,从而为做出快速的观看选择。Quick preview. The video content index file of a video file is a summary of the video content. Through the video content index, the user can roughly judge the type, style, language, region and other information of the video, which is convenient for the user to quickly understand the video information, so as to make a quick viewing choice. .
快速定位。每个视频内容索引文件在产生的时候存储了对应的视频时间偏移信息,通过视频内容索引能够快速,准确的定位到该视频片段,极大的方便了用户进行快进、快退等定位操作。Rapid positioning. Each video content index file stores the corresponding video time offset information when it is generated. Through the video content index, the video segment can be quickly and accurately located, which greatly facilitates the user to perform positioning operations such as fast forward and rewind. .
快速分享。用户分享到服务器的数据量由完整的视频文件减少到若干视频的视频内容索引,相比现有的在线视频观看系统,用户的分享操更为简单,快速。Quick share. The amount of data shared by users to the server is reduced from a complete video file to a video content index of several videos. Compared with the existing online video viewing system, the user's sharing operation is simpler and faster.
微化视频。视频内容索引技术通过结构化的分割视频增加了视频的维数,即将原有的以整个文件为播放、评论、分享最小单元,改为以视频内容索引所代表的视频片段作为播放、评论、分享的最小单元。Minimized video. The video content indexing technology increases the dimensionality of the video through structured video segmentation, that is, the original whole file is used as the smallest unit for playback, commenting, and sharing, and the video clip represented by the video content index is used as the playback, commenting, and sharing. the smallest unit of .
从视频网站角度而言,使用了基于视频内容索引的解决方案,能够极大地降低建设成本,同时能够更精确的挖掘用户的观看行为与喜好。From the perspective of video websites, using a solution based on video content index can greatly reduce construction costs, and at the same time can more accurately mine users' viewing behavior and preferences.
降低存储成本。服务器只需要存储元数据以及视频原始文件的映射地址,使得所需要的存储开销减少到原有需求的几百分之一。Reduce storage costs. The server only needs to store metadata and the mapping address of the original video file, reducing the required storage overhead to a few hundredths of the original requirement.
精确的用户行为统计。传统的视频在线系统统计的是基于完整视频的热度信息,用户偏好,使用了基于视频内容索引的方案好,系统除了可以统计基于完整视频的用户偏好、行为信息,还可以细致到对片段的统计,使系统能够发掘更多的用户信息,方便提供更有针对性的服务。Accurate user behavior statistics. The traditional video online system counts the popularity information and user preferences based on the complete video. It is better to use a video content index-based solution. In addition to statistics of user preferences and behavior information based on the complete video, the system can also perform detailed statistics on clips. , so that the system can discover more user information and provide more targeted services.
附图说明Description of drawings
图1为本系统中视频内容索引文件的结构图。Figure 1 is a structural diagram of the video content index file in this system.
图2 为本系统中的视频内容索引的目录文件的结构图。Figure 2 is a structural diagram of the catalog file of the video content index in this system.
图3为本系统由场景分割产生视频内容索引,并通过目录文件组织视频内容索引的过程。Figure 3 shows the process of the system generating video content indexes by scene segmentation and organizing video content indexes through directory files.
具体实施方式Detailed ways
要实现基于视频内容索引的视频播放系统,服务器端需要建立数据库存储用户分享的元数据,用户端需要视频分割、编辑模块,支持机器和手动分割两种模式,此外用户需要网络传输元数据的模块,当用户收到元数据并选择播放视频时候,视频数据通过P2P的方式从各个拥有视频数据的用户中获得,因此客户端需要P2P的传输模块。To implement a video playback system based on video content indexing, the server needs to establish a database to store metadata shared by users, and the user needs a video segmentation and editing module that supports two modes of machine and manual segmentation. In addition, users need a module for network transmission of metadata , when the user receives the metadata and chooses to play the video, the video data is obtained from each user who owns the video data through P2P, so the client needs a P2P transmission module.
只需要按上述扩展,现有的播放系统就可以很容易地升级为本发明所描述的,丰富用户体验,方便用户操作,减少系统开销的全新视频播放系统。Only need to expand according to the above, the existing playback system can be easily upgraded to a new video playback system described in the present invention, which enriches user experience, facilitates user operation, and reduces system overhead.
在视频播放系统中,可独立对若干视频内容索引文件对应的视频片段进行播放。In the video playing system, video clips corresponding to several video content index files can be played independently.
在视频播放系统中,可对完整的视频进行评论,也可以对视频内容索引对应的视频片段进行评论。In the video playback system, comments can be made on a complete video, or on a video segment corresponding to a video content index.
在视频播放系统中,可以分享若干视频内容索引。In the video playback system, several video content indexes can be shared.
在视频播放系统中,服务器只需存贮视频内容索引文件信息。In the video playing system, the server only needs to store the video content index file information.
参考文献:references:
[1] Xin Wang., Changyi Zheng., Zhenyuan Zhang., Hong lu. The Design of video segmentation-aided VCR support for P2P VoD System, 2008, IEEE Transactions on Consumer Electronics, 54(2), 531-537.[1] Xin Wang., Changyi Zheng., Zhenyuan Zhang., Hong lu. The Design of video segmentation-aided VCR support for P2P VoD System, 2008, IEEE Transactions on Consumer Electronics, 54(2), 531-537.
[2] Lingjie Yu., Linxiang Gao., Jin Zhao., Xin Wang. SonicVoD:A VCR-Supported P2P-VoD System with Network Coding, 2009, IEEE Transactions on Consumer Electronics, 55(2), 576-582.[2] Lingjie Yu., Linxiang Gao., Jin Zhao., Xin Wang. SonicVoD: A VCR-Supported P2P-VoD System with Network Coding, 2009, IEEE Transactions on Consumer Electronics, 55(2), 576-582.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010238815CN101901620A (en) | 2010-07-28 | 2010-07-28 | Automatic generation and editing method and application of video content index file |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010238815CN101901620A (en) | 2010-07-28 | 2010-07-28 | Automatic generation and editing method and application of video content index file |
| Publication Number | Publication Date |
|---|---|
| CN101901620Atrue CN101901620A (en) | 2010-12-01 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010238815PendingCN101901620A (en) | 2010-07-28 | 2010-07-28 | Automatic generation and editing method and application of video content index file |
| Country | Link |
|---|---|
| CN (1) | CN101901620A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102299960A (en)* | 2011-08-22 | 2011-12-28 | 盛乐信息技术(上海)有限公司 | Peer-to-peer (P2P) technology-based network file system and method |
| CN102572514A (en)* | 2012-01-11 | 2012-07-11 | 复旦大学 | Service system based on video content epitome |
| CN102970347A (en)* | 2012-11-02 | 2013-03-13 | 东莞宇龙通信科技有限公司 | A processing method, system and electronic terminal for sharing content |
| CN103491455A (en)* | 2013-03-29 | 2014-01-01 | 吴晗 | Video playing control system |
| CN103916718A (en)* | 2013-01-05 | 2014-07-09 | 腾讯科技(北京)有限公司 | Method and system for playing video based on video clip |
| CN103970869A (en)* | 2014-05-12 | 2014-08-06 | 浙江宇视科技有限公司 | Large file storage method |
| CN104053016A (en)* | 2014-06-24 | 2014-09-17 | 深圳市江波龙电子有限公司 | Image previewing method and device |
| CN104185074A (en)* | 2014-08-04 | 2014-12-03 | 北京奇虎科技有限公司 | Method and client for fixed point playing of series videos through pictures |
| CN104202658A (en)* | 2014-08-29 | 2014-12-10 | 北京奇虎科技有限公司 | Method and system for playing video in groups |
| CN104202657A (en)* | 2014-08-29 | 2014-12-10 | 北京奇虎科技有限公司 | Multi-video selective playing method and device for video group with same theme |
| CN104427351A (en)* | 2013-08-30 | 2015-03-18 | 北京计算机技术及应用研究所 | Time-overlapped video stream rapid-positioning method and system for video monitoring |
| CN104584537A (en)* | 2012-09-27 | 2015-04-29 | 英特尔公司 | Improved seek techniques for content playback |
| CN104703040A (en)* | 2015-03-13 | 2015-06-10 | 天脉聚源(北京)教育科技有限公司 | Video processing method and device |
| CN104822087A (en)* | 2015-04-30 | 2015-08-05 | 无锡天脉聚源传媒科技有限公司 | Processing method and apparatus of video segment |
| CN105740306A (en)* | 2015-11-26 | 2016-07-06 | 中国传媒大学 | Holographic video data index method |
| CN105872858A (en)* | 2016-04-27 | 2016-08-17 | 亦非云互联网技术(上海)有限公司 | Video sharing method and system, video processing system and client side |
| CN106412677A (en)* | 2016-10-28 | 2017-02-15 | 北京奇虎科技有限公司 | Generation method and device of playback video file |
| CN107079138A (en)* | 2014-09-10 | 2017-08-18 | 弗莱耶有限公司 | Storage and editing of event video using sensors and participant and audience tag data |
| CN108776578A (en)* | 2018-06-01 | 2018-11-09 | 南京紫光云信息科技有限公司 | A kind of method and system of quick combining objects |
| CN110381371A (en)* | 2019-07-30 | 2019-10-25 | 维沃移动通信有限公司 | A kind of video clipping method and electronic equipment |
| CN111125427A (en)* | 2019-12-26 | 2020-05-08 | 浪潮电子信息产业股份有限公司 | Video file reading method and device, electronic equipment and medium |
| CN112653896A (en)* | 2020-11-24 | 2021-04-13 | 贝壳技术有限公司 | House source information playback method and device with watching assistant, electronic equipment and medium |
| CN114697756A (en)* | 2022-04-07 | 2022-07-01 | 脸萌有限公司 | Display method, display device, terminal equipment and medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101021904A (en)* | 2006-10-11 | 2007-08-22 | 鲍东山 | Video content analysis system |
| CN101035274A (en)* | 2006-03-06 | 2007-09-12 | 鸿富锦精密工业(深圳)有限公司 | Stream media data processing system and method |
| US20070230781A1 (en)* | 2006-03-30 | 2007-10-04 | Koji Yamamoto | Moving image division apparatus, caption extraction apparatus, method and program |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101035274A (en)* | 2006-03-06 | 2007-09-12 | 鸿富锦精密工业(深圳)有限公司 | Stream media data processing system and method |
| US20070230781A1 (en)* | 2006-03-30 | 2007-10-04 | Koji Yamamoto | Moving image division apparatus, caption extraction apparatus, method and program |
| CN101021904A (en)* | 2006-10-11 | 2007-08-22 | 鲍东山 | Video content analysis system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102299960A (en)* | 2011-08-22 | 2011-12-28 | 盛乐信息技术(上海)有限公司 | Peer-to-peer (P2P) technology-based network file system and method |
| CN102572514A (en)* | 2012-01-11 | 2012-07-11 | 复旦大学 | Service system based on video content epitome |
| CN104584537B (en)* | 2012-09-27 | 2019-07-16 | 英特尔公司 | Improved search method and apparatus for content playback |
| CN104584537A (en)* | 2012-09-27 | 2015-04-29 | 英特尔公司 | Improved seek techniques for content playback |
| CN102970347A (en)* | 2012-11-02 | 2013-03-13 | 东莞宇龙通信科技有限公司 | A processing method, system and electronic terminal for sharing content |
| CN103916718B (en)* | 2013-01-05 | 2018-12-11 | 腾讯科技(北京)有限公司 | The method and system of video playing is carried out based on video clip |
| CN103916718A (en)* | 2013-01-05 | 2014-07-09 | 腾讯科技(北京)有限公司 | Method and system for playing video based on video clip |
| CN103491455A (en)* | 2013-03-29 | 2014-01-01 | 吴晗 | Video playing control system |
| CN104427351A (en)* | 2013-08-30 | 2015-03-18 | 北京计算机技术及应用研究所 | Time-overlapped video stream rapid-positioning method and system for video monitoring |
| CN103970869A (en)* | 2014-05-12 | 2014-08-06 | 浙江宇视科技有限公司 | Large file storage method |
| CN104053016A (en)* | 2014-06-24 | 2014-09-17 | 深圳市江波龙电子有限公司 | Image previewing method and device |
| CN104053016B (en)* | 2014-06-24 | 2018-09-28 | 深圳市江波龙电子有限公司 | A kind of image preview method and device |
| CN104185074A (en)* | 2014-08-04 | 2014-12-03 | 北京奇虎科技有限公司 | Method and client for fixed point playing of series videos through pictures |
| CN104202657A (en)* | 2014-08-29 | 2014-12-10 | 北京奇虎科技有限公司 | Multi-video selective playing method and device for video group with same theme |
| CN104202658A (en)* | 2014-08-29 | 2014-12-10 | 北京奇虎科技有限公司 | Method and system for playing video in groups |
| CN104202657B (en)* | 2014-08-29 | 2018-09-18 | 北京奇虎科技有限公司 | The method and device that multiple videos selection in same theme video group is played |
| US10277861B2 (en) | 2014-09-10 | 2019-04-30 | Fleye, Inc. | Storage and editing of video of activities using sensor and tag data of participants and spectators |
| CN107079138A (en)* | 2014-09-10 | 2017-08-18 | 弗莱耶有限公司 | Storage and editing of event video using sensors and participant and audience tag data |
| CN104703040A (en)* | 2015-03-13 | 2015-06-10 | 天脉聚源(北京)教育科技有限公司 | Video processing method and device |
| CN104822087A (en)* | 2015-04-30 | 2015-08-05 | 无锡天脉聚源传媒科技有限公司 | Processing method and apparatus of video segment |
| CN104822087B (en)* | 2015-04-30 | 2017-11-28 | 无锡天脉聚源传媒科技有限公司 | A kind of processing method and processing device of video-frequency band |
| CN105740306A (en)* | 2015-11-26 | 2016-07-06 | 中国传媒大学 | Holographic video data index method |
| CN105872858A (en)* | 2016-04-27 | 2016-08-17 | 亦非云互联网技术(上海)有限公司 | Video sharing method and system, video processing system and client side |
| CN106412677A (en)* | 2016-10-28 | 2017-02-15 | 北京奇虎科技有限公司 | Generation method and device of playback video file |
| CN108776578A (en)* | 2018-06-01 | 2018-11-09 | 南京紫光云信息科技有限公司 | A kind of method and system of quick combining objects |
| CN108776578B (en)* | 2018-06-01 | 2021-10-26 | 紫光西部数据(南京)有限公司 | Method and system for rapidly merging objects |
| CN110381371A (en)* | 2019-07-30 | 2019-10-25 | 维沃移动通信有限公司 | A kind of video clipping method and electronic equipment |
| CN110381371B (en)* | 2019-07-30 | 2021-08-31 | 维沃移动通信有限公司 | A video editing method and electronic device |
| CN111125427A (en)* | 2019-12-26 | 2020-05-08 | 浪潮电子信息产业股份有限公司 | Video file reading method and device, electronic equipment and medium |
| CN112653896A (en)* | 2020-11-24 | 2021-04-13 | 贝壳技术有限公司 | House source information playback method and device with watching assistant, electronic equipment and medium |
| CN114697756A (en)* | 2022-04-07 | 2022-07-01 | 脸萌有限公司 | Display method, display device, terminal equipment and medium |
| Publication | Publication Date | Title |
|---|---|---|
| CN101901620A (en) | Automatic generation and editing method and application of video content index file | |
| US11615131B2 (en) | Method and system for storytelling on a computing device via social media | |
| US9342596B2 (en) | System and method for generating media bookmarks | |
| US20080101762A1 (en) | Method of Automatically Editing Media Recordings | |
| US20140089800A1 (en) | Multimedia comment system and multimedia comment method | |
| US20070239787A1 (en) | Video generation based on aggregate user data | |
| CN105142028A (en) | Television program content searching and recommending method oriented to integration of three networks | |
| JP2017505012A (en) | Video processing method, apparatus, and playback apparatus | |
| CN103780974A (en) | Scene clip playing system and method thereof | |
| CN103823870B (en) | Information processing method and electronic equipment | |
| KR20160098949A (en) | Apparatus and method for generating a video, and computer program for executing the method | |
| KR20140126556A (en) | Apparatus, Server, Terminal, Method, and Recording Medium for playing Multimedia based on Emotion | |
| EP3794465B1 (en) | Event progress detection in media items | |
| US11003711B2 (en) | Accessing audio files from an online content management system | |
| CN102572514A (en) | Service system based on video content epitome | |
| CN103780975A (en) | Scene abstract capturing and playing system and method thereof | |
| KR100846752B1 (en) | How to automatically edit media recordings | |
| JP2015008014A (en) | Method for recommendation of content to user, system for recommendation of content to user, and computer readable recording medium | |
| KR20150063686A (en) | Recording Media recorded with an Editted Video File for providing a Vide editted by a User |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20101201 |