Summary of the invention
The purpose of the present invention is intended at least solve one of described technological deficiency.
To this end, it is an object of the invention to propose a kind of structuring system for managing video, the structuring completing video processesFunction, and can be realized the efficient association of structuring video library and service application by multi-semantic meaning condition, really allows video monitoring systemSystem plays actual effect.
To achieve these goals, embodiments of the invention provide a kind of structuring system for managing video, including: access tubeReason service module, theme video management module, foreground browse module and cloud server, wherein,
Described access-in management service module is used for from external system or the video flowing of equipment, and sets up video monitoring dataStorehouse；
Described theme video management module communicates with described access-in management service module, for the video flowing accessedCarry out theme video management, including: receive various video warning signal, and described warning signal analysis carries out alarming processing, instituteState theme video management module to be additionally operable to customs service system docking to obtain the real-time video from customs service system, rootAccording to described pre-set business tables of data to described real-time video interpolation label information, and the video data after adding label is carried outStructuring processes, generating structure video；
Described cloud server pushes, for receiving described theme video management module, the structuring video of coming, and to describedStructuring video carries out transcoding and is suitable for playing on the terminal device；
Described foreground browses module and communicates with described cloud server, shows for transcoding rear video is supplied to userShow, described structuring video is carried out real-time play and playback.
Further, described foreground browses module and includes: the Web browser on mobile terminal and/or personal computer.
Further, described various video warning signal is entered by described theme video management module according to default alarm type tableRow is analyzed, and draws the alarm event of correspondence, and takes corresponding alarming processing, including: trigger alarm video recording, alarm event is enteredRow label associates to classify alarm event.
Further, described theme video management module carries out structuring process to video data, including: will be from customs's industryVideo data after the interpolation label of business system, is associated with the business information in customs service system, by video data thingPartization forms theme video segment, generating structure video.
Further, the label information in the customs service system of association, including: cargo papers number, license plate number, containerNumber, Hull Number, supervision place, supervisor.
Further, described theme video management module is additionally operable to video dispatching and accesses, and regards according to the application from managerFrequently access request, transfers corresponding camera list, obtains the video of above-mentioned camera list shooting and imports video, to above-mentionedThe video offer imported is checked, is uploaded and store function.
Further, described theme video management module also provides for video storage service, supports this index data and masterThe collaborative storage of topic video image, and can be that the two sets up efficient association to ensure the synchronization guarantor of index information and target videoDeposit.
Further, described theme video management module passes through cloud storage calling interface, is uploaded in real time by the video of storageCloud server preserves.
Further, described theme video management module is submitted to and is uploaded cloud server application, and according to video structural rankData to be uploaded are confirmed by video data table and the label information table of section, including: after confirming whether it be structuringData, whether it meets the association in video data table and label information table, if it is confirmed that success, is then uploaded to cloud serverStorage.
Further, described cloud server is according to the video format of user setup, video width height, video code rate, frame of videoRate carries out transcoding to video.
Structuring system for managing video according to embodiments of the present invention, the structuring completing video processes function, can be by non-The data such as structurized video, sound, picture are converted into structural data, and can realize structuring video by multi-semantic meaning conditionStorehouse and the efficient association of service application, really allow video monitoring system play actual effect.User can use all kinds of business datum flexiblyInformation, as document numbering, examination place title, license plate number, container number carry out query search, provides structuring for service applicationResource pool, makes video monitoring system more meet service application demand.
Aspect and advantage that the present invention adds will part be given in the following description, and part will become from the following descriptionObtain substantially, or recognized by the practice of the present invention.
Detailed description of the invention
Embodiments of the invention are described below in detail, and the example of described embodiment is shown in the drawings, the most from start to finishSame or similar label represents same or similar element or has the element of same or like function.Below with reference to attachedThe embodiment that figure describes is exemplary, it is intended to is used for explaining the present invention, and is not considered as limiting the invention.
As it is shown in figure 1, the structuring system for managing video of the embodiment of the present invention, including: access-in management service module 1, masterTopic video management module 2, foreground browse module 3 and cloud server 4.
Specifically, with reference to Fig. 2, access-in management service module 1 is used for from external system or the video flowing of equipment, and sets upVideo monitoring data storehouse.Now, the video flowing that access-in management service module receives is unstructured data.Access-in management service mouldBlock realizes the collection of unstructured data, it is achieved customs respectively supervises customs's emphasis videos such as scene, means of transport, ping procedureAcquisition operations.Video resource table includes the destructuring video gathered, manager complete destructuring video resource and gather workMake, with reference to Figure 11.
The data that access-in management service module receives can include with Types Below: audio frequency (mp3, wav, amr), video(MP4, flv, avi), document (Word, Excel, PPT), picture (jpg, jpeg, gif, png, bmp) all kinds.
As it is shown in fig. 7, in theme video processing platform application process, ownership limits the use of family can carry out query video, videoBrowse, report form statistics analysis etc..Theme video management just can be carried out after only video imports to platform.
Theme video management module 2 communicates with access-in management service module, for leading the video flowing accessedTopic video management, including: receive various video warning signal, and warning signal analysis carries out alarming processing.
As it is shown on figure 3, various video warning signal is carried out point by theme video management module 2 according to default alarm type tableAnalysis, draws the alarm event of correspondence, and takes corresponding alarming processing, including: trigger alarm video recording, alarm event is markedSign association so that alarm event to be classified.
Wherein, preset alarm type table and produced by intelligent video analysis platform, call for theme video processing platform,By manager, alarm type is confirmed.
Theme video management module 2 is additionally operable to customs service system docking to obtain real-time from customs service systemVideo, adds label information according to pre-set business tables of data to real-time video.
The present invention is by service-oriented realization mechanism, it is provided that with platform-independent video access integration capability, greatlyThe complexity of the various data source of simplified access, can combine with customs at different levels industry platform construction and development.Pass through standard simultaneouslyThe mode of protocol communication realizes the data sharing between application and service and interoperability.Owing to each operation system interface is different, because ofThis there is no unified technical standard and implementation, need to be customized exploitation according to Ge Guan district operation system present situation.
As shown in Figure 4, theme video management module 2 can manually or automatically realize customs service system and masterThe docking of topic video processing platform, it is achieved the acquisition of theme video processing platform label information.
Customs service docks: docks with customs service subsystem based on theme video processing platform and realizes obtaining of label informationTake.Customs service system docking is realized by standard agreement or customized development.
Wherein, business datum table is produced by customs service system, and calls for theme video processing platform.Specifically bySite disposal Customs Officer carries out selecting item entries.
Theme video management module 2 carries out structuring process, generating structure video to the video data after adding label.
Specifically, video structural description refers to video content by semantic relation, use space-time dividing, feature extraction,The means such as Object identifying, are organized into the technology of the text message being available for computer and people's understanding.I.e. to set up in unified videoHold description standard, allow video system move towards semantization textual from digitized, such that it is able to complicated video frequency searching is converted toText retrieval ripe as Baidu, Google, can accomplish when any case has access to video information that retrieval is rapid, express standardReally.Based on the technology such as visually-perceptible, image recognition, intellectual analysis, with the mode construction monitor video content of semanteme tissueStructural description information, thus break the limitation that video monitoring system can only manually be seen, it is achieved video content " sees automaticallyIn vain ".
Video structural technology, as the strong core solving video investigation key technology, is to realize massive video information to depositStorage, retrieval and the key point of profound application, application prospect is boundless, new with video structural description technology as representativeGeneration Video Supervision Technique is an important directions of video monitoring industrial technology innovation development from now on.
As shown in Figure 8 and Figure 9, theme video management module 2 carries out structuring process to video data, including: will be fromVideo data after the interpolation label of customs service system, is associated with the business information in customs service system, by videoData eventization forms theme video segment, and generating structure video, to generate theme video segment.
After by customs service system business data label, can be by theme video management module 2 to video dataCarry out structuring process, and related service label can be associated with the video segment generated, forms corresponding theme video.
In one embodiment of the invention, the label information in the customs service system of association, including: cargo papersNumber, license plate number, container number, Hull Number, supervision place, supervisor.
Video record realizes carrying out video intercepting dump, comprises manually and automatically two ways.
Manually video recording: as required, check the video information of a certain road photographic head, carries out video recording operation.
Automatic video recording: according to pre-set rule, utilize Intellectual Analysis Technology, the video information to video camera captureCarry out real-time video recording to intercept and storage.
As shown in figure 12, theme video management module 2 carries out structuring process to destructuring video data, by this streamThe linearisation that customs can be collected by journey, discrete unstructured data are transformed into evented theme video segment.BusinessTables of data derives from the operation system of customs, calls with structuring processing module for unstructured data collection, and generation is gathered aroundThere is the video segment of customs service information.This function is confirmed specifically comprise which traffic item by system manager.
The present invention supports that distributed multi-stage stores, and platforms at different levels have the administrative power of video resource in respective compass of competencyLimit；Superior platforms can access subordinate's platform resource according to mandate；Authorized between at the same level or subordinate's platform can access non-affiliated districtThe video resource in territory.Between peer, tricks is unrestricted.Subordinate's platform data can be managed concentratedly by superior platforms, it is achieved dataThe United Dispatching of resource.
The built-in files in stream media distribution module of platform supports the different deployment mode such as cloth, concentrating type, both can carry out pointLayer point territory is disposed, it is possible to provide key service in data center with concentrating type deployment way.Multi-client can be tackled operate simultaneouslyAnd theme video watches requirement simultaneously.
The present invention relies on intelligent video analysis platform and video structural technology, extracts feature from the video data of magnanimityInformation, carries out classifying, label for labelling so that it is become structured message, and realize storage based on theme video data, transmission,Inquiry, analytic function, it is achieved linear data structure, subject data labeling, provide for market demand businessization and support.
Further, as it is shown in figure 5, theme video management module 2 is additionally operable to video dispatching access, according to from manager'sApplication video access request, transfers corresponding camera list, obtains the video of above-mentioned camera list shooting and imports video,Video offer to above-mentioned importing is checked, is uploaded and store function.
The present invention supports stream media scheduling technology, the live video stream of accessible command scheduling support platform forwarding and historyVideo flowing, and multi-level forwarding can be carried out at platform interior and share.
Theme video management module 2 carries out video dispatching access process flow process: realize the acquisition of video resource, by shootingMachine list obtains video resource.Camera list source is to be provided by other video monitoring platforms or supported by command scheduling videoPlatform provides, and only manager could obtain camera list.Then the scheduling of theme video processing platform video source is realized,In theme video processing platform application process, accessed by video dispatching and realize that video is uploaded, video flowing real-time play, history regardThe functions such as frequency file playback broadcasting, alarm monitoring video recording.
Additionally, as shown in Figure 6, theme video management module 2 also provides for video storage service, supports this index dataWith the collaborative storage of theme video image, and can be that the two sets up efficient association to ensure index information and the synchronization of target videoPreserve.The video of storage, by cloud storage calling interface, is uploaded to cloud server 4 and protects by theme video management module 2 in real timeDeposit.
For cascade system, subordinate's platform also can be by storage data real time propelling movement to superior platforms, it is achieved between multi-stage platformData sharing and centralized management.The present invention supports high in the clouds storage mode, can pass through cloud storage calling interface, data be passed in real timeIt is passed to high in the clouds preserve.
Theme video management module 2 continues video storage service processing flow process: realize the acquisition of video resource, by shootingMachine list obtains video resource.Camera list source is to be provided by other video monitoring platforms or supported by command scheduling videoPlatform provides, and only manager could obtain camera list.Then the storage realizing theme video processing platform video source is visitedAsk, in theme video processing platform application process, realize video storage, video record tactical management by video storage serviceEtc. function.
Specifically, as shown in Figure 10, the submission of theme video management module 2 is uploaded cloud server 4 and is applied for, and according to videoData to be uploaded are confirmed by video data table and the label information table in structuring stage, including: confirm whether it is knotData after structure, whether it meets the association in video data table and label information table, if it is confirmed that success, only when by reallyThe data recognized could be unified to upload to big data cloud centralized stores, is uploaded to cloud server 4 and stores.
Video data table: produce the processing stage that this information being data structured, cloud module in data call, it is achieved knotCloud storage on structure video segment.
Label information table: this information table produces the processing stage of being by data structured, is called by cloud module in data, realThe storage of existing structural data label information.
Data upload the handling process of cloud server 4: realize the upper cloud storage of structural data, existing by Ali's Semen CaesalpiniaeStructuring centralized stores, customs service system connects big data cloud by network can transfer theme video segment.
Cloud server 4 pushes, for receiving theme video management module 2, the structuring video of coming, and to structuring videoCarry out transcoding to be suitable for playing on the terminal device.Wherein, cloud server 4 is according to the video format of user setup, video widthHeight, video code rate, video frame rate carry out transcoding to video.
Resources all kinds of in video cloud are externally provided by resource pool as service, by centralized management and flexible resource scheduling etc.Technology, by abstract for the multimedia resource of script static allocation for managing, be prone to scheduling, demand assigned resource pool, it is provided that pressThe service of all kinds of video resource need to be used flexibly.For all kinds of backend application systems, when its deployed environment is unrelated with geographical positionTime, then can dispose in resource pool, the most all kinds of resource service provided by resource pool realize application systemFlexible expansion.Resource pool provides the model of resource service as shown in figure 11 for types of applications system.
Owing to each application system brand is different, the storage mode of data is also not quite similar, therefore resources integration moduleThe storage content of different application systems should be able to be identified, and it can be carried out Classification Management.Each application system is many with integrated serviceThere are certain logical relation, such as resource name, store path etc. between media video fusion application cloud platform, therefore need to buildA set of special business object transform engine, merging application system and integrated service multimedia video according to predefined rule shouldTranslation conversion is carried out by the business object data of cloud platform.Business object accesses engine and includes business object access scheduling device, rightAs main functional modules such as relation Transformation Service.
Present invention employs a large amount of cloud middleware, specifically include:
1) cloud access technology: platform uses advanced Plug & Play (plug and play) technology, possesses domestically leading networkPenetration capacity, it is adaptable to various complexity networks, it is not necessary to be configured adjusting to gateway, fire wall, can be by headend equipment masterDynamic initiation connects, and cloud platform carries out facility registration, on-demand forwarding to the back-end.
2) cloud storage technology: platform uses cloud storage, distributed data base to realize unified storage architecture, it is ensured that systemAutgmentability, availability and performance.Can be applicable to for Video Applications customization is a set of in conjunction with user's practical business application demand simultaneouslyThe storage system of Video Applications.The advantage of video cloud storage is the effectively management of video resource and accesses, and supports magnanimity simultaneouslyThe efficient storage of small documents.
Specifically, traditional storage means have been difficult in adapt to current demand, therefore present invention employs Ali's cloud as depositingStorage backstage, uses the mentality of designing of user oriented service application, has merged cluster application, load balancing, virtualization, cloud structureVarious types of storage devices a large amount of in network can be closed by the technology such as change, discrete storage by professional application software setCarry out collaborative work, the storage of high-performance, video highly reliable, continual, image data and Operational Visit service be the most externally provided,Realize storage Full-virtualization, be greatly simplified application and alleviate, save client's construction cost, higher storage is provided simultaneously and sharesFunction.
Generally speaking, compared to traditional memory module, cloud storage pattern has a following advantage shown in table 1:
Table 1
There is the unstructured data objects such as substantial amounts of picture, photo, video in video monitoring system, this kind of data are with rightThe form tissue of elephant, not association between object, such data are commonly referred to as Blob, and (Binary Large Object, two enterMake big object) data, it is particularly well-suited to cloud storage.
3) cloud computing technology: platform operates on video cloud computing platform, it is achieved that resource virtualizing technique, griddingComputing technique, virtualization storage technology, disributed media access and retransmission technique application etc. in video actual combat.
4) cloud retrieval technique: video cloud is retrieved as Video Applications system and provides multiple retrieval mode, and will retrieve resultOutput retrieval result after fusion.By video structural Treatment Analysis and efficient search engine, it is achieved the inquiry inspection of multi-semantic meaningRope, can make video conscientiously meet service application demand according to the retrieval corresponding video video recording of user's concrete business datum, provides simultaneouslyThe full-text search of similar the Internet, it is achieved looked into i.e. gained, support data mining based on application in actual combat model.
5) cloud transcoding technology: platform can carry out backstage to video in cloud to be changed automatically, by unification be converted to general regardingFrequently form, for page end, client-access.Cloud video code conversion service provides the very fast video code conversion function in high in the clouds, supports defeatedGo out the video format of video, video width height, video code rate, video frame rate is isoparametric freely sets.
6) cloud browser technology: platform provides various viewing and way to manage of making video recording, and can meet all levels of management personnel differentApplication demand, as the viewing of long-range Real-time and Concurrent, long-range real-time playback, mobile subscriber access, operating service administrative situation inquiryDeng.
Foreground browses module 3 and communicates with cloud server 4, shows for transcoding rear video is supplied to user, rightStructuring video carries out real-time play and playback.
In one embodiment of the invention, foreground browses module 3 and includes: mobile terminal (Android, IOS system) and/orWeb browser on personal computer.
The present invention provides perfect query video mechanism, and can show Query Result according to customs service demand.Video is looked intoInquiry is divided into two ways:
1) directly fuzzy query can be carried out in search column input multi-semantic meaning condition.
User browses module 3 by foreground can input fuzzy query conditions, finds out all piece of video meeting this condition, withJust the video segment wanted quickly is searched.Multi-semantic meaning condition should be supported all search conditions.
2) user can inquire about by arranging search condition.
Search condition includes the content such as business information and supervision information.
The present invention provides net cast function, and net cast is the live broadcast exhibition to system access front-end camera picture,Camera list is shown on the right side of the page.The present invention can retrieve video camera to be play by search, and on the left of the page, display regardsFrequently play area.
Further, the present invention supports report form statistics, and can need self-defined report pattern and type according to customs supervision, reportTable should export to diagrammatic form or excel document.
During system Construction, the structuring video management platform of the embodiment of the present invention uses advanced SOA technology, canBy existing for area under one's jurisdiction information system, by calling relevant interface, existed system function is embedded into command centre and integrates solution partyIn case.
The present invention supports efficient mass data Organization And Management technology, sets up service-oriented data model, breaks through distributionThe key technologies such as formula data base administration, efficient spatial index, it is achieved the seamless storage between massive video resource and platform and management.Realize backstage to functions such as the metadata management of data base, exchange management, task management and routine safety management, for the height of platformGood external environment condition is created in effect, stable operation.
Data are the bases of integrated service video intelligent cloud processing platform, the basic data relevant to accident and industryBusiness data store theme video database after collection, process, standardization, transmission, through extracting, reconfigure, processing,Change and collect, forming the data acquisition system of multiple subject-oriented or the data acquisition system of decision making-oriented, providing technology for user's decision-makingSupport, be informed of a case for information during vital emergent event is tackled of contingency management mechanism and personnel simultaneously, launch emergency provision, withTrack, monitor, process, be published to terminate whole process data storage is provided, be also that event handling overall process obtains information simultaneouslyFoundation.
The data type related to during system Construction includes: video data, voice data, image data, number of filesAccording to, vector data, database table data.There is certain logical relation in the heart in each front end system and control and command, such as provideSource name, store path etc., therefore can be by building a set of special business object transform engine, according to predefined rule to frontBusiness object data between end system and platform carries out translation conversion, efficiently realizes the fusion of multi-source heterogeneous data.
The present invention can be by eliminating information island, it is achieved video monitoring system, command dispatching system and business supervisory systemsThe resources integration and share, solve data interconnection intercommunication problem, the most also can reserve access interface, can tackle neatly futureThe development of demand, can development and change according to demand, abundant many with the quick development & construction on this platform of loosely-coupled modeThe service application of sample, plays platform greatest benefit.
Structuring system for managing video according to embodiments of the present invention, the structuring completing video processes function, can be by non-The data such as structurized video, sound, picture are converted into structural data, and can realize structuring video by multi-semantic meaning conditionStorehouse and the efficient association of service application, really allow video monitoring system play actual effect.User can use all kinds of business datum flexiblyInformation, as document numbering, examination place title, license plate number, container number carry out query search, provides structuring for service applicationResource pool, makes video monitoring system more meet service application demand.
The structuring system for managing video of the embodiment of the present invention, has the advantages that
1) stability
The present invention supports that distributed multi-stage stores, and platforms at different levels have the administrative power of video resource in respective compass of competencyLimit；Superior platforms can access subordinate's platform resource according to mandate；Authorized between at the same level or subordinate's platform can access non-affiliated districtThe video resource in territory.Between peer, tricks is unrestricted.Subordinate's platform data can be managed concentratedly by general administration's platform simultaneously, it is achievedThe United Dispatching of data resource.
The files in stream media distribution module different deployment mode such as support cloth, concentrating type etc. that platform is built-in, both can be according to seaThe feature closing three-level structure carries out the deployment of layering point territory, it is possible to provide key clothes in data center of customs with concentrating type deployment wayBusiness.Multi-client can be tackled operate and theme video watches requirement simultaneously simultaneously.
2) database distributed deployment
The present invention supports the distributed deployment of data base, can determine the data base side of deployment according to user's site environment demandFormula.Can be based on the existing database environment of user, by the database access interface that system is built-in, it is achieved with Database SystemsDocking, carry out data storage, read, increase, the operation such as deletion.
3) database compatibility
The present invention is successfully realized the multiple expansions of Database Systems, and data base interface is highly integrated, by highly integratedConfiguration parameter achieve that the data bases such as ACCESS, MySQL Server, Microsoft SQL Server, Oracle put downFreely switching of platform, is truly realized the Perfect Experience of " mainstream data platform slitless connection ".It is integrated with powerful data simultaneouslyLibrary backup, recover, compress, system detection function.
4) system cascade
The present invention is divided into General Administration of Customs-directly under closing-be subordinate to pass Three-level Platform, and has extensibility, it is possible to downwardly extendTo business scene platform.Platform support layering, point territory, classification, decentralized management.
5) system integration
Service-oriented system of the present invention and other application system provide standard access interface, support platform major function collectionBecome among operation system, at the theme video data checking business datum its correspondence of simultaneous display simultaneously, it is achieved between systemIntelligent integration and management.
The history image information unification of magnanimity is managed, in conjunction with cloud computing distributed treatment ability, sets up efficient index machineSystem so that huge historical data can second level process when post-mordem forensics is adjusted back.
6) service application model innovation
Video cloud platform, from user perspective, solves to face a difficult problem in the storage of big data age video and Video Applications,On the basis of the existing video monitoring system of customs, utilize the memory technology of cloud computing, access technology, retrieval technique, virtualizationTechnology and my intelligent video analysis of company's independent research, video quality diagnosis, structuring video technique, eliminate information island,Realize the integration of resource and share.And by the way of theme video library, all kinds of video resources and the service application number that will generateAccording to being associated, prominent natural barrier between video monitoring system and business application system.
Video cloud platform overcomes the shortcomings such as the memory space of existing system is big, utilization ratio is low, business association is poor.UtilizeThe subject-oriented database technology of company's independent research carries out data management, can increase flexibly according to customer service demand, deleteType of theme, number, form the video data warehouse of service-oriented application, and user can be regarded by business datum search call themeFrequently, such as querying conditions such as cargo papers number, container number, license plate number, boats and ships number, examination personnel, video monitoring has significantly been expandedSystem utilize space, have also been changed the difficult problem that passing service application is low to video monitoring data utilization rate.
In the description of this specification, reference term " embodiment ", " some embodiments ", " example ", " specifically showExample " or the description of " some examples " etc. means to combine this embodiment or example describes specific features, structure, material or spyPoint is contained at least one embodiment or the example of the present invention.In this manual, to the schematic representation of above-mentioned term notNecessarily refer to identical embodiment or example.And, the specific features of description, structure, material or feature can be anyOne or more embodiments or example in combine in an appropriate manner.
Although above it has been shown and described that embodiments of the invention, it is to be understood that above-described embodiment is exampleProperty, it is impossible to be interpreted as limitation of the present invention, those of ordinary skill in the art is without departing from the principle of the present invention and objectiveIn the case of above-described embodiment can be changed within the scope of the invention, revise, replace and modification.The scope of the present inventionLimited by claims and equivalent thereof.