CN101609610A - A flight information data collector and its processing method - Google Patents

Abstract

Translated fromChinese

本发明涉及一种航班信息数据采集器及其处理方法。本发明属于民航技术领域。一种航班信息数据采集器，有电源、微处理器、输入控制、显示单元、通信单元、数据获取单元、数据处理单元和数据存储单元组成，微处理器连接控制输入控制、显示单元、通信单元、数据获取单元、数据处理单元和数据存储单元。航班信息数据采集器处理方法，其从航空公司、机场、空管的多样化网站上、业务系统数据库中、共享数据服务的数据源上定时设置采集获取航班信息；对采集到的数据依据定制模板进行抽取，获取需要的定制信息，数据信息打包成文件，投递和存储。本发明形成统一、完整、一致的数据形式，实现数据交换与共享，为发布、决策提供完整、准确、及时的数据信息。

The invention relates to a flight information data collector and a processing method thereof. The invention belongs to the technical field of civil aviation. A flight information data collector, composed of a power supply, a microprocessor, an input control, a display unit, a communication unit, a data acquisition unit, a data processing unit and a data storage unit, the microprocessor is connected to control the input control, display unit, and communication unit , a data acquisition unit, a data processing unit and a data storage unit. The flight information data collector processing method, which regularly sets and collects flight information from the diversified websites of airlines, airports, and air traffic control, business system databases, and data sources of shared data services; the collected data is based on customized templates Extract, obtain the required customized information, pack the data information into files, deliver and store. The invention forms a unified, complete and consistent data form, realizes data exchange and sharing, and provides complete, accurate and timely data information for release and decision-making.

Description

A kind of Flight Information data acquisition unit and disposal route thereof

Technical field

The invention belongs to civil aviaton's technical field, particularly relate to a kind of Flight Information data acquisition unit and disposal route thereof.

Background technology

At present, airline, airport, blank pipe office etc. are being arranged, problem such as each data source exists concept data indeterminate, and is not comprehensive, untimely based on the Data Source in civil aviaton's generalized information management platform research and construction of service architecture; And the system of different pieces of information source service unit may be an isomery, network environment also is an isomery, the technology that realizes also is an isomery, this information dispersion, lack the situation of the effective mechanism of interconnecting, the interchange that has hindered the industry internal information is with shared, can not fully, efficiently bring into play the facilitation of information, be difficult to the Coordination Decision that realizes that industry is interior the production and operation.In case be in an emergency, supervision department lacks the comprehensive production and operation condition information timely that obtains of effective and efficient manner, is difficult to coordinate relevant department and implements effective emergency command.

Summary of the invention

The present invention provides a kind of Flight Information data acquisition unit and disposal route thereof for solving the problem that prior art exists.

The present invention will solve the prior art problem, at first gather the civil aviaton's production information that is dispersed in all departments, information is carried out the standard combing, form unified, complete, consistent data mode, realize on this basis towards the public the information issue and towards the decision support and the emergency command of industry unit and supervision department.

One of the object of the invention provides a kind of airline, blank pipe, on the website on airport, the integrated information of operation system, shared data service provider, sub-category, have levels, complete, gather and be delivered to the Flight Information data acquisition unit of the medium characteristics of database of civil aviaton's public information service platform accurately and timely.

Flight Information data acquisition unit of the present invention adopts following technical scheme:

A kind of Flight Information data acquisition unit, be characterized in: power supply is arranged, microprocessor, input control, display unit, communication unit, data capture unit, data processing unit and data storage cell are formed, microprocessor connects control input control, display unit, communication unit, data capture unit, data processing unit and data storage cell, data capture unit connects collection by communication unit and is dispersed in airline, the airport, the website of blank pipe, operation system, civil aviaton's information on the share service, microprocessor connects control information is carried out the standard extraction, obtain the data processing unit of customized information, microprocessor connects control and delivers communication unit that obtains data and the data storage cell that obtains data storage with the form of message.

Flight Information data acquisition unit of the present invention can also adopt following technical measures:

Described Flight Information data acquisition unit is characterized in: data capture unit, built-in acquisition module and the passive collection acquisition module initiatively gathered; Initiatively gather acquisition module, obtain the module of Flight Information for data source parameter setting information and classification; Passive collection acquisition module is the real-time physics reception to active delivery data source transmission data, and the line data decompress(ion) of going forward side by side, Data Source feature identification are transferred to data processing unit again and extracted the module of handling.

Described Flight Information data acquisition unit, be characterized in: data processing unit, built-in customization extraction template, the customization extraction template is decimation rule, service enabler, carries out content recognition and extraction, identification and specified data scope, carry out data-switching, analysis and arrangement forms the data press behind the rule definition again, and compression is handled, and generation is packaged into Standard File Format, carry out data delivery or directly transfer to the module of data storage cell stores processor.

Described Flight Information data acquisition unit is characterized in: data storage cell is to being packaged into Standard File Format, carrying out data delivery or directly transferring to the module of data storage cell stores processor.

Described Flight Information data acquisition unit is characterized in: Input Control Element, be touch-screen type handwriting input mode, to the collection source add, revise, stop/open control, acquisition module, parameter input are adjusted the unit are set; Display unit is video data information, monitoring gatherer process, the LCD color liquid crystal module of analysis collection result.

Described Flight Information data acquisition unit is characterized in: data communication units, for the built-in FTP/S of communication mode, HTTP/S, POP3/SMTP, XFB communication protocol are supported and wireless communication module; Graphic interface is arranged; Have and adopt the multi-protocols mode to carry out collection, the receipt source data acquisition communication interface of multi-source heterogeneous data; The connection peripheral storage device is arranged, and is that the data acquisition acquiring unit is stored the memory device communication interface with peripheral storage device.

The Flight Information collector for crossing over the difference between various hardware and software platforms, diversified website, multiple class operation system database, various shared data service and the polynary acquisition mode, provides otherwise effective technique approach and instrument.Can access and be updated on different operating system, the hardware platform, be stored in the disparate databases, based on the data of various data format standards or flat civilian form.It can directly be connected the exchange of real-time, event driven and fully-integrated application data with database, open interface design, extensibility and dirigibility combine, and can comprehensively use communication protocols such as FTP/S, HTTP/S, POP3/SMTP, XFB on communicating by letter.

Encapsulate various data capture logics, form various collection middleware, realize the data acquisition of a plurality of heterogeneous system data sources such as diversified website, multiple class operation system database, various shared data services.

Two of the object of the invention provides a kind of airline, blank pipe, on the website on airport, the integrated information of operation system, shared data service provider, sub-category, have levels, complete, gather and be delivered in the database of civil aviaton's public information service platform accurately and timely, the disposal route of the Flight Information data acquisition unit of characteristics such as information accurately and timely is provided for the services request of the public and industry department.

The disposal route of Flight Information data acquisition unit of the present invention adopts following technical scheme:

Described Flight Information data acquisition unit disposal route is characterized in: data acquisition unit regularly is provided with to gather from the diversified website of airline, airport, blank pipe, the operation system database, on the data source of shared data service and obtains Flight Information; The data that collect are extracted according to custom built forms, obtain the customized information that needs, and data message is packaged into file, deliver, store, and, analyze collection result the gatherer process monitoring with the form of message.

The disposal route of Flight Information data acquisition unit of the present invention can also adopt following technical measures:

Described Flight Information data acquisition unit disposal route, be characterized in: the website Information Monitoring is handled, adding stops using enables data source, and its URL address of configuration, parameter, coding, the page extract content match setting and frequency acquisition in each website data source profile; Data capture unit is according to URL address, parameter in the configuration, with of the web site requests inquiry of HTTP request mode to airline, blank pipe, airport, resolve page module and the html page of inquiring about is as a result carried out the parsing of particular content item with the XML form, data extraction module extracts according to template configuration the data after resolving, and is assembled into the XML form according to data exchange standard and delivers, store.

Described Flight Information data acquisition unit disposal route, be characterized in: data acquisition information is handled in the operation system database, built-in Oracle, SQL Server, Sybase data-driven module, configuration extracted data type, tables of data, when realizing that by trigger or database log file surveillance style production data takes place to upgrade, send the Data Update notice to the Data Update monitor process, and the storage data are in temporary table, data extraction module extracts according to template configuration the temporary table data, and is assembled into the XML form according to data exchange standard and delivers, storage.

Described Flight Information data acquisition unit disposal route, be characterized in: the Information Monitoring of shared data service data is handled, according to shared data service FTP, the address of service of Web Service data source, parameter, frequency acquisition, data type, extraction template configuration information, regularly the method for called Web service is obtained flight data information, result to the Web service response, data extraction module extracts according to template configuration the data after resolving, and is assembled into the XML form according to data exchange standard and delivers, store.

The passive data acquisition process of Flight Information data acquisition unit, built-in message-oriented middleware treatment mechanism, based on the data file that JMS standard monitoring reception sends, call the parsing conversion process of data parsing engine realization then, and carry out verification according to business rule to data; Data extraction module extracts according to template configuration the data of resolving after the conversion, and is assembled into the XML form according to data exchange standard and delivers, store.

Flight Information data acquisition unit disposal route has in its data message: Flight Information: flight planning information, flight dynamic information, aerodrome traffic information, ground service information, runway information, canteen information, engineering relevant information, passenger traffic volume information, goods are posted flow information, weather information; Acquisition parameter: frequency acquisition, destination address, user name, password; Gather source information: gather source name, extraction template identifying information, stop/open state, file designation rule, data source classification; Gather daily record: writing time, image data source, times of collection, collection start time, collection concluding time, collection result store path, extraction start time/concluding time, extraction are delivered file path, are delivered start time/concluding time, delivery state, extraction state, acquisition state.

Flight Information data acquisition unit disposal route of the present invention, the function of data stream conversion are the data that the data stream that will receive changes into the XML form.Carry out XML data layout verification operation then.The function of unprocessed form data processing is that the data that receive are handled according to the unprocessed form of business datum, generates the DML data of standard.The function of data conversion treatment is that the data that receive are handled according to the form of data center's database, generates the DML data of standard.The function of data load is that the data that receive are loaded in the database.

For under the data environment of " data source is varied, and data layout has nothing in common with each other ", data acquisition unit is normally moved, and can satisfy the business of total system in future and the expansion demand of processing capacity.Every operational factor of data acquisition unit can be provided with dynamic load flexibly.

The unprocessed form data can be carried out data and preserve operation in a plurality of crucial process points in data acquisition.Guaranteeing abnormal conditions occurring in the data acquisition, as: situations such as outage, network communication are interrupted, data center's database can not write, data can not lost.After abnormal conditions are removed, still can normally carry out data acquisition process, be included in the data of receiving between anomalistic period.

Feature of the present invention:

1, the system of different pieces of information source service unit may be an isomery, network environment also is an isomery, and the technology of realization also is an isomery, and data acquisition function is exactly the data of being responsible for gathering from the different pieces of information source, the unified processing prepared for follow-up data transmission work provides data.At the different pieces of information source, encapsulate various data acquisition modes, form and gather middleware, realize the data acquisition of a plurality of isomeries, polycomponent system data source.

1.1 the mode according to data acquisition is divided, and is divided into initiatively obtaining data and the passive data dual mode that obtains.Initiatively obtain, regularly initiatively obtain data message in website, operation system database, the shared data service, extract to be provided with according to template again and carry out data check, extraction, conversion process; The passive data of obtaining, data acquisition unit are to all departments' message-oriented middleware subscribe message theme, and message-oriented middleware is by configuration subscriber's address, can initiatively send XML message to data acquisition unit, data acquisition unit is accepted XML message, and the data that obtain are filtered, and extracts conversion; With the XML file mode is interface, supports digital certificate and cryptographic algorithm, supports the enforcement of host-host protocol.

1.2 database design

1.2.1 Flight Information: flight planning information, flight dynamic information, aerodrome traffic information, ground service information, runway information, canteen information, engineering relevant information, passenger traffic volume information, goods are posted flow information, weather information;

1.2.2 acquisition parameter: frequency acquisition, destination address, user name, password;

1.2.3 collection source information: gather source name, extraction template identifying information, stop/open state, file designation rule, data source classification;

1.2.4 collection daily record: file path, delivery start time, delivery concluding time, delivery state sign indicating number, extraction status code, acquisition state sign indicating number are delivered in writing time, image data source, times of collection, collection start time, collection concluding time, collection result store path, extraction start time, extraction concluding time, extraction.

2, abnormality processing strategy

2.1 polling routine operation exception, periodic monitor polling routine running status, if the automatic regular polling program takes place need restart unusually and resends the data query request of upgrading by timestamp constantly according to the daily record of writing down, and according to Data Update request delivery time and up-to-date Data Update timestamp, the initial moment of automatic regular polling is revised, and the relevant daily record of record;

2.2 the request access exception is overtime or when makeing mistakes when data, services such as visit Web Service, HTTP, the relevant daily record of record.

2.3 compressed file generates unusual, and restart condensing routine and carry out File Compress, and the relevant daily record of record.

Advantage that the present invention has and good effect:

Flight Information data acquisition unit and disposal route thereof, owing to adopt brand-new technology scheme of the present invention, the relevant information of production units such as blank pipe, airport, airline is collected in the platform database with certain business rule, collection is obtained, is sent and receive and needn't onlinely wait for, the change of each production system in the future simultaneously can not bring influence to collection with upgrading, is easy to safeguard; Can support multiple program development language easily, can compatible various application programs.Adjustment such as either party the possible production system upgrading in the future or the replacement, can not influence the production and the maintenance of collection, only need the corresponding modify configuration to carry out the standard combing to information, form unified, complete, consistent data mode, realize exchanges data and share, and for information issue, decision support etc. provide complete, accurately, data, services timely.

Description of drawings

Fig. 1 Flight Information data acquisition unit structural representation;

Fig. 2 Flight Information data acquisition unit data processing overview flow chart;

Fig. 3 Flight Information collector website data acquisition process process flow diagram;

Fig. 4 Flight Information collector extracts the translation data processing flow chart;

Fig. 5 Flight Information collector is delivered storage flow chart of data processing figure.

Among the figure, 1-communication interface, 2-power supply, 3-handwriting input display screen, 4-radio communication, 5-stop and start switch.

Embodiment

For further understanding technology contents of the present invention, characteristics and effect, enumerate following example now, and conjunction with figs. is described in detail as follows:

With reference to accompanyingdrawing 1, Fig. 2, Fig. 3, Fig. 4 and Fig. 5.

Embodiment 1

A kind of Flight Information data acquisition unit,power supply 2 is arranged, stop andstart switch 5, microprocessor, input control, display unit, communication unit, data capture unit, data processing unit and data storage cell are formed, microprocessor connects control input control, display unit, communication unit, data capture unit, data processing unit and data storage cell, data capture unit connects collection bycommunication interface 1 and is dispersed in airline, the airport, the website of blank pipe, operation system, civil aviaton's information on the share service, microprocessor connects control information is carried out the standard extraction, obtain the data processing unit of customized information, microprocessor connects control and deliversradio communication Unit 4 that obtain data and the data storage cell that obtains data storage with the form of message.

Data capture unit, built-in acquisition module and the passive collection acquisition module initiatively gathered; Initiatively gather acquisition module, obtain the module of Flight Information for data source parameter setting information and classification; Passive collection acquisition module is the real-time physics reception to active delivery data source transmission data, and the line data decompress(ion) of going forward side by side, Data Source feature identification are transferred to data processing unit again and extracted the module of handling.

Data processing unit, built-in customization extraction template, the customization extraction template is decimation rule, service enabler, carry out content recognition and extraction, identification and specified data scope are carried out data-switching, and the data behind the rule definition are pressed in analysis and arrangement formation again, compression is handled, and generates and is packaged into standard x ML file layout, carries out data delivery or directly transfer to the module of data storage cell stores processor.

Data storage cell is to being packaged into standard x ML file layout, carrying out data delivery or directly transferring to the module of data storage cell stores processor.Storage comprises that each gathers classify interim secondary storage and to the interim secondary storage of the acquisition process data of delivery data, permanent storage failure of the reception obtain source data.

Input Control Element is touch-screen type handwriting input mode, to the collection source add, revise, stop/open control, acquisition module, parameter input are adjusted the unit are set; Display unit is video data information, and monitoring gatherer process module has the LCD color liquid crystal handwritinginput display screen 3 of analyzing collection result.

Data communication units is for the built-in FTP/S of communication mode, HTTP/S, POP3/SMTP, XFB communication protocol are supported and wireless communication module; Graphic interface is arranged; Have and adopt the multi-protocols mode to carry out collection, the receipt source data acquisition communication interface of multi-source heterogeneous data; The connection peripheral storage device is arranged, and is that the data acquisition acquiring unit is stored the memory device communication interface with peripheral storage device.

Embodiment 2

Flight Information data acquisition unit disposal route: data acquisition unit regularly is provided with to gather from the diversified website of airline, airport, blank pipe, the operation system database, on the data source of shared data service and obtains Flight Information; The data that collect are extracted according to custom built forms, obtain the customized information that needs, and data message is packaged into the XML formatted file, deliver, store, and, analyze collection result the gatherer process monitoring with the form of message.

The website Information Monitoring is handled, and adding stops using enables data source, and its URL address of configuration, parameter, coding, the page extract content match setting and frequency acquisition in each website data source profile; Data capture unit is according to URL address, parameter in the configuration, with of the web site requests inquiry of HTTP request mode to airline, blank pipe, airport, resolve page module and the html page of inquiring about is as a result carried out the parsing of particular content item with the XML form, data extraction module extracts according to template configuration the data after resolving, and is assembled into the XML form according to data exchange standard and delivers, store.

Data acquisition information is handled in the operation system database, built-in Oracle, SQL Server, Sybase data-driven module, configuration extracted data type, tables of data, when realizing that by trigger or database log file surveillance style production data takes place to upgrade, send the Data Update notice to the Data Update monitor process, and the storage data are in temporary table, data extraction module extracts according to template configuration the temporary table data, and is assembled into the XML form according to data exchange standard and delivers, store.

The Information Monitoring of shared data service data is handled, according to shared data service FTP, the address of service of Web Service data source, parameter, frequency acquisition, data type, extraction template configuration information, regularly the method for called Web service is obtained flight data information, result to the Web service response, data extraction module extracts according to template configuration the data after resolving, and is assembled into the XML form according to data exchange standard and delivers, store.

Embodiment 3

CA's integrated information platform provides Web service, and the Flight Information collector obtains production data by the method for regular called Web service: its implementation of obtaining data is as follows:

(1) at first have a Flight Information collector timing (1 minute at interval) to call the Web service (data query) that CA provides, call parameters comprises the update time of data as inquiry constraint condition.

(2) result that Web service is responded carries out verification, if data are correct, the data pick-up unit need with as backup, call the data persistence of receiving data delivery, store to unite and carry out data transmission delivery storage simultaneously; If the data check failure then needs to call again the Web service that CA provides.

(3) the Flight Information collector calls and utilizes data delivery to finish the transmission of data; After the data transmission success, transmission receives sends out a receipt; After data acquisition unit is received receipt, with the message deletion of backup in this locality.

Embodiment 4

The South Airways website provides the flight dynamic information inquiry service, the Flight Information collector is according to the configuration data origin url, structure Http Post request, the node resolution response result (html file) of the needs inquiry in disposing in conjunction with Xml then, and the data of calling after data extraction module will be resolved carry out XML format organization according to standard, by the data delivery module with the data of organizing advance to deliver, storage.Picking rate performance optimization solution: according to the table timetable, each samsara image data scope falls in advance for pre-rising began to gather pre-rising in preceding 1 hour, the real data that rise; Have pre-change then to gather to change postpones thereupon, real rising then according to the flight time section arranged, the measuring and calculating expectation landing time, gathered real falling (by shifting to an earlier date 30 minutes in 6 hours flight time in 30 minutes in advance, shift to anearlier date 1 hour more than 6 hours, 1.5 hours in advance real falling of collection more than 12 hours).Gather flight dynamic information and follow each flight and fall in fact or cancel, or shared flight then stops to gather, do not have the real cardinal rule that samsara at every turn all will be gathered of falling then.

Software and hardware system of the present invention constitutes and implementation process:

Flight Information data acquisition unit and disposal route thereof are formed collector equipment jointly by power-supply system, microprocessor, Input Control Element, display unit, communication unit, data acquisition acquiring unit, data processing unit, data delivery storage unit; Data source collections such as realization regularly is provided with from the website of existing airline, airport, blank pipe, the operation system database, shared data service are obtained Flight Information.The data that collect are extracted according to custom built forms, obtain the customized information that needs; In order to show the feasibility of data exchange standard, data acquisition unit becomes the XML file with the packing data of obtaining, form with message is delivered, storage, form unified, complete, consistent data mode, for realize data integration, exchange and shared and information issue, decision support etc. provide complete, accurately, data, services timely.

1, the administration interface that utilizes input control, display unit to provide is provided with acquisition parameter information, data source information, extraction template, verification rule, destination address information and storage configuration information.

2, communication protocol is set, ensures that the network of collector and data source, destination address and data storage can proper communication, startup collection switch then.

3, data acquisition acquiring unit reads acquisition parameter, data source information, initiatively gathers acquisition module, according to the data source parameter setting information, structure is gathered polling list information, and Flight Information is obtained in classification, and the data message of gathering is back transferred to data processing unit extract processing; Passive collection acquisition module is realized the real-time physics of active delivery data source transmission data is received, and the line data decompress(ion) of going forward side by side, Data Source feature identification are transferred to data processing unit and extracted processing.

4, data pick-up conversion processing unit, built-in customization extraction template, according to decimation rule, service enabler, carry out content recognition and extraction, identification and specified data scope are carried out data-switching, and the data behind the rule definition are pressed in analysis and arrangement formation again, compression is handled, and generates to be packaged into standard x ML file layout, to carry out data delivery or directly to transfer to the data storage cell stores processor.

5, data delivery storage unit, storage comprise that each gathers classify interim secondary storage and to the interim secondary storage of the acquisition process data of delivery data, permanent storage failure of the reception obtain source data; This processing is to being packaged into standard x ML file layout, carrying out data delivery or directly transferring to the data storage cell stores processor.

6, in display module LCD color liquid crystal module video data information, can check the collection log information, the monitoring gatherer process is analyzed collection result.

Data structure: Flight Information: flight planning information, flight dynamic information, aerodrome traffic information, ground service information, runway information, canteen information, engineering relevant information, passenger traffic volume information, goods are posted flow information, weather information; Acquisition parameter: frequency acquisition, destination address, user name, password; Gather source information: gather source name, extraction template identifying information, stop/open state, file designation rule, data source classification; Gather daily record: file path, delivery start time, delivery concluding time, delivery state sign indicating number, extraction status code, acquisition state sign indicating number are delivered in writing time, image data source, times of collection, collection start time, collection concluding time, collection result store path, extraction start time, extraction concluding time, extraction.

Claims (10)

Translated fromChinese

1.一种航班信息数据采集器，其特征是：有电源、微处理器、输入控制、显示单元、通信单元、数据获取单元、数据处理单元和数据存储单元组成，微处理器连接控制输入控制、显示单元、通信单元、数据获取单元、数据处理单元和数据存储单元，数据获取单元由通信单元连接采集分散在航空公司、机场、空管的网站、业务系统、共享服务上的民航信息，微处理器连接控制对信息进行规范抽取、获取定制信息的数据处理单元，微处理器连接控制以消息的形式投递获取数据的通信单元和获取数据存储的数据存储单元。1. A flight information data collector is characterized in that: it is composed of a power supply, a microprocessor, an input control, a display unit, a communication unit, a data acquisition unit, a data processing unit and a data storage unit, and the microprocessor is connected to control the input control , display unit, communication unit, data acquisition unit, data processing unit and data storage unit, the data acquisition unit is connected by the communication unit to collect civil aviation information scattered on the websites, business systems and shared services of airlines, airports and air traffic control, micro The processor connects and controls the data processing unit for standardized extraction of information and obtains customized information, and the microprocessor connects and controls the delivery of the communication unit for obtaining data and the data storage unit for obtaining data storage in the form of messages.2.根据权利要求1所述的航班信息数据采集器，其特征是：数据获取单元，内置主动采集获取模块和被动采集获取模块；主动采集获取模块，为数据源参数设置信息和分类获取航班信息的模块；被动采集获取模块为对主动投递数据源传输数据的实时物理接收，并进行数据解压、数据来源特征识别，再交由数据处理单元抽取处理的模块。2. flight information data collector according to claim 1, is characterized in that: data acquisition unit, built-in active acquisition acquisition module and passive acquisition acquisition module; Active acquisition acquisition module, for data source parameter setting information and classification acquisition flight information The passive collection and acquisition module is a module that physically receives the data transmitted by the active delivery data source in real time, performs data decompression, and identifies the characteristics of the data source, and then submits it to the data processing unit for extraction and processing.3.根据权利要求1所述的航班信息数据采集器，其特征是：数据处理单元，内置定制抽取模板，定制抽取模板为抽取规则、业务引擎，进行内容识别与抽取，识别和确定数据范围，进行数据转换，再分析整理形成按规则定义后的数据，压缩处理，生成打包成标准文件格式、进行数据投递或直接交由数据存储单元存储处理的模块。3. flight information data collector according to claim 1, is characterized in that: data processing unit, built-in customized extraction template, custom extraction template is extraction rule, business engine, carries out content identification and extraction, identification and determination data range, Carry out data conversion, then analyze and sort out the data defined according to the rules, compress and process, and generate a module that is packaged into a standard file format for data delivery or directly handed over to the data storage unit for storage and processing.4.根据权利要求1所述的航班信息数据采集器，其特征是：数据存储单元，是对打包成标准文件格式、进行数据投递或直接交由数据存储单元存储处理的模块。4. The flight information data collector according to claim 1, characterized in that: the data storage unit is a module for packaging into a standard file format, delivering data or directly handing over the data storage unit for storage and processing.5.根据权利要求1所述的航班信息数据采集器，其特征是：输入控制单元，为触摸屏式手写输入方式，对采集源添加、修改、停/启控制，对采集模板、参数输入调整设置单元；显示单元，为显示数据信息，监控采集过程，分析采集结果的LCD彩色液晶模块。5. The flight information data collector according to claim 1, characterized in that: the input control unit is a touch-screen handwriting input mode, which adds, modifies, stops/starts control to the collection source, and adjusts and sets the collection template and parameter input Unit; the display unit is an LCD color liquid crystal module for displaying data information, monitoring the collection process, and analyzing the collection results.6.根据权利要求1所述的航班信息数据采集器，其特征是：数据通信单元，为通信方式内置FTP/S、HTTP/S、POP3/SMTP、XFB通信协议支持和无线通信模块；有图形化界面；有采用多协议方式进行多源异构数据的采集、接收来源数据采集通讯接口；有连接外存储设备，是数据采集获取单元进行存储和外存储设备的存储设备通讯接口。6. flight information data collector according to claim 1, is characterized in that: data communication unit, for communication mode built-in FTP/S, HTTP/S, POP3/SMTP, XFB communication protocol support and wireless communication module; Graphic There is a multi-protocol method for collecting multi-source heterogeneous data, and a communication interface for receiving source data collection; there is a communication interface for connecting external storage devices, which is the storage device communication interface for data collection and acquisition units to store and external storage devices.7.根据权利要求1所述的航班信息数据采集器处理方法，其特征是：数据采集器从航空公司、机场、空管的多样化网站上、业务系统数据库中、共享数据服务的数据源上定时设置采集获取航班信息；对采集到的数据依据定制模板进行抽取，获取需要的定制信息，并把数据信息打包成文件，以消息的形式投递、存储，并对采集过程监控，分析采集结果。7. flight information data acquisition device processing method according to claim 1, is characterized in that: data acquisition device is from the diversification website of airline company, airport, air traffic control, in business system database, on the data source of shared data service Timely set the collection to obtain flight information; extract the collected data according to the customized template, obtain the required customized information, and package the data information into files, deliver and store them in the form of messages, monitor the collection process, and analyze the collection results.8.根据权利要求7所述的航班信息数据采集器处理方法，其特征是：网站采集信息处理，添加停用启用数据源，在每个网站数据源配置文件中配置其URL地址、参数、编码、页面抽取内容匹配设置和采集频率；数据获取单元根据配置中的URL地址、参数，以HTTP请求的方式向航空公司、空管、机场的网站请求查询，解析页面模块以XML格式对查询的结果HTML页面进行具体内容项解析，数据抽取模块对解析后的数据依据模板配置进行抽取，并按照数据交换标准组装成XML格式进行投递、存储。8. flight information data collector processing method according to claim 7, is characterized in that: website collects information processing, adds and disables enabling data source, configures its URL address, parameter, coding in each website data source configuration file , page extraction content matching setting and collection frequency; the data acquisition unit requests query from the websites of airline companies, air traffic control, and airports in the form of HTTP requests according to the URL address and parameters in the configuration, and the page parsing module queries the results in XML format The HTML page analyzes the specific content items, and the data extraction module extracts the parsed data according to the template configuration, and assembles them into XML format according to the data exchange standard for delivery and storage.9.根据权利要求7所述的航班信息数据采集器处理方法，其特征是：业务系统数据库中数据采集信息处理，内置Oracle、SQL Server、Sybase数据驱动模块，配置抽取数据类型、数据表，通过触发器或数据库日志文件监视方式实现生产数据发生更新时，向数据更新监听进程发送数据更新通知，并存储数据到临时表中，数据抽取模块对临时表数据依据模板配置进行抽取，并按照数据交换标准组装成XML格式进行投递、存储。9. flight information data collector processing method according to claim 7, is characterized in that: data acquisition information processing in business system database, built-in Oracle, SQL Server, Sybase data drive module, configuration extracts data type, data table, by The trigger or database log file monitoring method realizes that when the production data is updated, the data update notification is sent to the data update monitoring process, and the data is stored in the temporary table. The data extraction module extracts the temporary table data according to the template configuration, and exchanges data according to the Standard assembly into XML format for delivery and storage.10.根据权利要求7所述的航班信息数据采集器处理方法，其特征是：共享数据服务数据采集信息处理，根据共享数据服务FTP、Web Service数据源的服务地址、参数、采集频率、数据类型、抽取模板设置信息，定期调用Web服务的方法来获取航班数据信息，对Web服务响应的结果，数据抽取模块对解析后的数据依据模板配置进行抽取，并按照数据交换标准组装成XML格式进行投递、存储。10. The flight information data collector processing method according to claim 7, characterized in that: shared data service data collection information processing, according to the service address, parameter, collection frequency, data type of shared data service FTP, Web Service data source , Extract template setting information, regularly call the method of Web service to obtain flight data information, respond to the result of Web service, the data extraction module extracts the parsed data according to the template configuration, and assembles it into XML format according to the data exchange standard for delivery ,storage.

Images