similarly, as to the field of "bud _ subset _ ICOME" in the data table of the B database, the collection is performed as long as the field of "subset _ ICOME" is input as the setting condition in the collection template. With the above arrangement, the a database and the B database can acquire the required data through the corresponding acquisition templates, and then transmit the acquired data to the data table 530 of the target database, and classify the acquired data into the same subset with the field name "accounting management data _ subject balance table". When the user wants to analyze the same type of data, all the related data can be acquired at once only in the subset of the "accounting management data _ subject balance table".

In some embodiments, matching fields may be configured in the collection template and Structured Query Language (SQL) may be employed. Using the SQL language, performing queries to a database, retrieving data from a database, inserting new records into a database, updating data in a database, deleting records from a database, creating a new database, creating new tables in a database, creating stored procedures in a database, creating views in a database, or setting up a table, storing procedures and permissions for views may be implemented.

FIG. 6 is a flow chart illustrating adata acquisition method 600 according to another embodiment of the invention. As shown in fig. 6, atstep 601, when data of the a database and the B database are to be collected to the target database at the same time, themethod 600 may establish a data transmission path between the a database and the target database, and between the B database and the target database, respectively. Next, atstep 602, themethod 600 identifies characteristics of the A and B databases, such as by using an identification module in a data acquisition device of the present invention. Here, the characteristics of the a database and the B database may include their types or data structures. In one embodiment, the a and B databases may be of disparate types and the first and second data tables may also be of different types and structures. For this reason, a single acquisition template cannot acquire data in the first data table and the second data table at the same time.

After completing identifying the features of the databases, atstep 603, themethod 600 may determine acquisition templates that match the a and B databases based on the type and structure of the a and B databases (or based on the different types and structures of the first and second data tables). According to an aspect of the invention, such a plurality of acquisition templates may be established through training of a large amount of data, and each acquisition template may have a type corresponding to the type of data to be acquired. After the recognition operation is performed using themethod 600, the A database may be matched to the first acquisition template. Similarly, the B database may be matched to a second acquisition template. Next, themethod 600 may collect the first data table of the a database by using the first collection template and the valid data required in the second data table of the B database by using the second collection template according to the requirement of the target database. For example, at step 604_1, themethod 600 collects a first subset of a first data table from the a database. Similarly, at step 604_2, themethod 600 may collect a second subset of the second data table from the B database.

After completing the data collection operations described above, atstep 605, themethod 600 may transmit the collected first and second subsets to a designated target database via a data transmission path. Further, in one or more embodiments, the collected data may also be stored in a specific data table to facilitate subsequent analysis of the data and perform additional processing and operations. It can be seen that, by the technical solution of the present invention, it is possible to acquire and store data of different systems (for example, different financial systems shown in fig. 5) in the same target database by using a set of systems (including two or more acquisition templates).

Through the above detailed description of the solution of the present invention, those skilled in the art can understand that the present invention identifies the database type through the automatic identification technology, and automatically matches to the appropriate acquisition template according to the database type and/or the data structure of the data table. Therefore, the data can be automatically collected, extracted, cleaned, checked, put in storage and the like through the collecting template, and accordingly labor cost is greatly reduced. After data are successfully collected, the data tables in the database are sorted and planned, so that operations such as system table translation, table relation identification and the like can be accelerated, basis and convenience are provided for front-end data collection personnel, and pre-preparation can be made for data management.

Further, based on the description of the present solution, those skilled in the art may also conceive that the present invention further discloses a data collecting apparatus for a data service system, where the data service system includes a source database and a target database, and the data collecting apparatus includes: at least one processor; at least one memory storing computer program instructions that, when executed by the at least one processor, cause the data acquisition apparatus to perform: establishing a data transmission path between the source database and the target database; identifying characteristics of the source database from which data is to be collected; determining a matched acquisition template according to the characteristics of the source databases, wherein each of one or more acquisition templates is matched with the characteristics of one of the one or more source databases; and collecting data from the source database by using the matched collection template, and transmitting the data to the target database through a data transmission path.

Correspondingly, the invention also discloses a data service system, which comprises a source database, a target database, and the data acquisition device and a plurality of embodiments thereof described in conjunction with fig. 2, fig. 3 and the above. Further, the present invention also discloses a computer readable storage medium comprising data acquisition program instructions for a data service system, which when executed by a processor, perform the method described in connection with fig. 4-6 and embodiments thereof.

It should be appreciated that any module, unit, component, server, computer, terminal, or device executing instructions exemplified herein may include or otherwise have access to a computer-readable medium, such as a storage medium, computer storage medium, or data storage device (removable) and/or non-removable), e.g., a magnetic disk, optical disk, or magnetic tape. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data.

Examples of computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by an application, a module, or both. Any such computer storage media may be part of, or accessible or connectable to, a device. Any applications or modules described herein may be implemented using computer-readable/executable instructions that may be stored or otherwise maintained by such computer-readable media.

It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the specification and claims of this application, the singular form of "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should be further understood that the term "and/or" as used in the specification and claims of this specification refers to any and all possible combinations of one or more of the associated listed items and includes such combinations.

The principles of the present invention have been explained above by means of a number of embodiments, and such an explanation is only intended to help understand the method of the present invention and its core idea. The invention is not limited to the embodiments described above, but rather to the embodiments of the invention, which are applicable to various fields of application.

Claims

1. A data collection apparatus for a data service system, the data service system including a source database and a target database, the data collection apparatus comprising:

a transmission module configured to establish a data transmission path between the source database and the target database;

one or more acquisition templates, wherein each acquisition template matches characteristics of one of the one or more source databases;

an identification module configured to identify characteristics of the source database from which data was collected; and

a matching module configured to determine the matching acquisition template according to the characteristics of the source database, wherein the matching acquisition template is configured to acquire data from the source database and transmit the data to the target database via the transmission module.

2. The data acquisition device as in claim 1, wherein the characteristics of the source database comprise a type or data structure of the source database.

3. The data acquisition apparatus as in claim 2, wherein the one or more acquisition templates are configured according to the type or data structure of the source database and are updated according to changes in the type or data structure of the source database.

4. The data collection device of claim 2, wherein the identification module is further configured to determine a type of the source database based on a data backup file, and wherein the matching module is further configured to determine the collection template that matches the source database based on the type.

5. The data collection device of claim 1, wherein the collection template is further configured to collect valid data from the source database and to transfer the valid data to the target database via the transfer module.

6. The data collection device of any of claims 1-5, wherein the collection template is further configured to utilize a structured query language to transmit the collected data to the target database via the transmission module.

7. A data collection method for a data service system, the data service system including a source database and a target database, the data collection method comprising:

establishing a data transmission path between the source database and the target database;

identifying characteristics of the source database from which data is to be collected;

determining a matched acquisition template according to the characteristics of the source database, wherein each of one or more acquisition templates is matched with the characteristics of one of the one or more source databases; and

and collecting data from the source database by using the matched collection template, and transmitting the data to the target database through a data transmission path.

8. A data collection apparatus for a data service system, the data service system including a source database and a target database, the data collection apparatus comprising:

at least one processor;

at least one memory storing computer program instructions that, when executed by the at least one processor, cause the data acquisition apparatus to perform:

identifying characteristics of the source database from which data is to be collected; and

9. A data service system comprising a source database, a target database and a data acquisition device according to any one of claims 1-6 and 8.

10. A computer readable storage medium comprising data acquisition program instructions for a data service system which, when executed by a processor, perform the method of claim 7.