Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a data index management method based on dynamic sources, which can realize dynamic configuration and management of data indexes, quickly respond to market change and business requirements, and improve decision quality and operation efficiency, thereby obtaining advantages in strong market competition.
The specific scheme provided by the invention is as follows:
the invention provides a data index management method based on dynamic sources, which comprises the following steps:
Step 1: establishing a database connection management flow aiming at a data source, wherein connection management is carried out by defining data source codes, data source names, database types, driving classes, data source addresses, database names, user names, passwords and remark information;
Step 2: establishing an interface access management flow aiming at a data source, wherein basic information and interface list information are defined, the basic information comprises an interface service name, an affiliated department, a responsible person contact way, an affiliated business system and interface description information, the interface list information comprises a request timeout time, a service Url, an authorization way, a request parameter, a Header parameter, body information and a return parameter, and interface document uploading and result previewing are provided;
step3: classifying and inputting the data indexes, wherein the classification names and the belonged upper levels of the data indexes are defined, and the data index classification is displayed in a tree structure in a list, so that the data indexes are convenient for a user to configure;
Step 4: forming a flow of configuring data indexes according to user requirements, wherein the flow comprises the following steps: providing data index classification selection according to the classification of the data index;
According to the selection condition of data index classification, carrying out data index inquiry, and carrying out changing, deleting and adding operations of configuration index data according to the data index inquiry result: performing new addition operation, selecting a data source acquisition mode, wherein the data source acquisition mode comprises database acquisition, interface acquisition, quotation calculation acquisition and manual reporting acquisition,
If the database is selected for collection, checking the connectivity of the data sources according to the database connection management flow, acquiring a data list according to the data source connection information, selecting the data list, inputting the required field names, the where conditions and the ordering mode, wherein the where conditions can refer to other data indexes as condition values, storing a configuration calculation model of the data indexes into the database after the configuration of the data indexes is completed,
If the interface acquisition is selected, acquiring interface list information for the user to select, receiving a return value and a request parameter according to the user selection, storing a configuration calculation model of the data index into a database after the configuration of the data index is completed,
If the reference calculation collection is selected, the configured data indexes are selected by a user, the data index configuration of the new scene is carried out, and after the configuration of the data indexes is completed, the configuration calculation model of the data indexes is stored in a database.
Further, in the method for managing data indexes based on dynamic sources, in step 1, a database connection management flow is established for the data sources, which includes: providing a visual interface for a user to input information of data source connection, storing data source codes, data source names, database types, drive types, data source addresses, database names, user names, passwords and remark information in the input information,
Connecting to a designated database by a JDBC database connection mode, selecting a corresponding driver according to the type of the database to perform database connectivity verification,
And displaying the maintained database information in a query list.
Further, in the method for managing data indexes based on dynamic sources, in step 2, an interface access management flow is established for the data sources, which includes: providing a visual interface for a user to enter interface basic information and interface list information,
Configuring an interface according to the interface list information, previewing the returned result data, verifying the connectivity of the interface, acquiring the subsequent data index configuration calculation result by configuring the returned result parameter path and the returned parameter list,
The maintained interfaces are presented in a query list.
Further, in step 4 of the dynamic source-based data index management method, if reference calculation collection is selected, the method includes: selecting data indexes from the configured data indexes as parameters and naming the parameters as keys, performing formula editing in a new scene by using the provided visual page, using the selected data indexes as condition judgment expression factors or formula factors, storing formula contents according to configuration, and storing a configuration calculation model of the data indexes into a database after the configuration of the data indexes is completed.
The invention also discloses a data index management device based on dynamic source, which comprises a database connection management module, an interface access management module, an index input module and a configuration data index module,
The database connection management module establishes a database connection management flow for a data source, wherein connection management is carried out by defining data source codes, data source names, database types, drive types, data source addresses, database names, user names, passwords and remark information;
The interface access management module establishes an interface access management flow aiming at a data source, wherein basic information and interface list information are defined, the basic information comprises interface service names, affiliated departments, responsible persons, contact ways of the responsible persons, affiliated service systems and interface description information, the interface list information comprises request timeout time, service Url, authorization modes, request parameters, header parameters, body information and return parameters, and interface document uploading and result previewing are provided;
The index input module classifies and inputs the data indexes, wherein classification names and belonged upper levels of the data indexes are defined, and the data index classification is displayed in a tree structure in a list, so that a user can conveniently configure the data indexes;
The configuration data index module forms a flow of configuration data indexes according to the requirements of a user, wherein the flow comprises the following steps: providing data index classification selection according to the classification of the data index;
According to the selection condition of data index classification, carrying out data index inquiry, and carrying out changing, deleting and adding operations of configuration index data according to the data index inquiry result: performing new addition operation, selecting a data source acquisition mode, wherein the data source acquisition mode comprises database acquisition, interface acquisition, quotation calculation acquisition and manual reporting acquisition,
If the database is selected for collection, checking the connectivity of the data sources according to the database connection management flow, acquiring a data list according to the data source connection information, selecting the data list, inputting the required field names, the where conditions and the ordering mode, wherein the where conditions can refer to other data indexes as condition values, storing a configuration calculation model of the data indexes into the database after the configuration of the data indexes is completed,
If the interface acquisition is selected, acquiring interface list information for the user to select, receiving a return value and a request parameter according to the user selection, storing a configuration calculation model of the data index into a database after the configuration of the data index is completed,
If the reference calculation collection is selected, the configured data indexes are selected by a user, the data index configuration of the new scene is carried out, and after the configuration of the data indexes is completed, the configuration calculation model of the data indexes is stored in a database.
Further, the database connection management module in the dynamic source-based data index management device establishes a database connection management flow for the data source, and the database connection management flow comprises: providing a visual interface for a user to input information of data source connection, storing data source codes, data source names, database types, drive types, data source addresses, database names, user names, passwords and remark information in the input information,
Connecting to a designated database by a JDBC database connection mode, selecting a corresponding driver according to the type of the database to perform database connectivity verification,
And displaying the maintained database information in a query list.
Further, the interface access management module in the data index management device based on the dynamic source establishes an interface access management flow for the data source, and the interface access management flow comprises the following steps: providing a visual interface for a user to enter interface basic information and interface list information,
Configuring an interface according to the interface list information, previewing the returned result data, verifying the connectivity of the interface, acquiring the subsequent data index configuration calculation result by configuring the returned result parameter path and the returned parameter list,
The maintained interfaces are presented in a query list.
Further, the method for calculating and collecting the configuration data index module in the data index management device based on the dynamic source comprises the following steps: selecting data indexes from the configured data indexes as parameters and naming the parameters as keys, performing formula editing in a new scene by using the provided visual page, using the selected data indexes as condition judgment expression factors or formula factors, storing formula contents according to configuration, and storing a configuration calculation model of the data indexes into a database after the configuration of the data indexes is completed.
The invention has the advantages that:
The invention provides a data index management method based on dynamic sources, which improves the flexibility and efficiency of data processing, improves user experience and optimizes the accuracy and reliability of data indexes. Compared with the conventional data index management method at present, the method has the following technical advantages:
the flexibility and the efficiency of data processing are improved: the data index can be dynamically acquired and managed, and the data source and the processing mode can be adjusted according to the actual requirements, so that the data processing is more flexible and efficient. Meanwhile, through automatic data collection and processing, the time and cost of manual operation can be greatly reduced, and the data processing efficiency is improved.
Optimizing accuracy and reliability of data indicators: the latest data can be acquired in real time, and the accuracy and reliability of the data index are ensured. In addition, automatic screening and filtering can be performed according to the data quality, inaccurate or invalid data is avoided, and the accuracy of the data index is further improved.
Support decision analysis and traffic optimization: can provide powerful support for decision analysis. Through real-time and accurate data indexes, a user can better know service conditions and market trends, and powerful data support is provided for decision making. Meanwhile, the method can help the user to find out problems and bottlenecks in the service and provide guidance for service optimization.
The service requirements can be satisfied: the requirements of the business system on data index management can be met. By dynamically configuring index-related information on the configuration page, an administrator can conveniently configure a desired evaluation index.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and specific examples, which are not intended to be limiting, so that those skilled in the art will better understand the invention and practice it.
Example 1
The invention provides a data index management method based on dynamic sources, which comprises the following steps:
Step 1: establishing a database connection management flow aiming at a data source, wherein connection management is carried out by defining data source codes, data source names, database types, driving classes, data source addresses, database names, user names, passwords and remark information;
Step 2: establishing an interface access management flow aiming at a data source, wherein basic information and interface list information are defined, the basic information comprises an interface service name, an affiliated department, a responsible person contact way, an affiliated business system and interface description information, the interface list information comprises a request timeout time, a service Url, an authorization way, a request parameter, a Header parameter, body information and a return parameter, and interface document uploading and result previewing are provided;
step3: classifying and inputting the data indexes, wherein the classification names and the belonged upper levels of the data indexes are defined, and the data index classification is displayed in a tree structure in a list, so that the data indexes are convenient for a user to configure;
Step 4: forming a flow of configuring data indexes according to user requirements, wherein the flow comprises the following steps: providing data index classification selection according to the classification of the data index;
According to the selection condition of data index classification, carrying out data index inquiry, and carrying out changing, deleting and adding operations of configuration index data according to the data index inquiry result: performing new addition operation, selecting a data source acquisition mode, wherein the data source acquisition mode comprises database acquisition, interface acquisition, quotation calculation acquisition and manual reporting acquisition,
If the database is selected for collection, checking the connectivity of the data sources according to the database connection management flow, acquiring a data list according to the data source connection information, selecting the data list, inputting the required field names, the where conditions and the ordering mode, wherein the where conditions can refer to other data indexes as condition values, storing a configuration calculation model of the data indexes into the database after the configuration of the data indexes is completed,
If the interface acquisition is selected, acquiring interface list information for the user to select, receiving a return value and a request parameter according to the user selection, storing a configuration calculation model of the data index into a database after the configuration of the data index is completed,
If the reference calculation collection is selected, the configured data indexes are selected by a user, the data index configuration of the new scene is carried out, and after the configuration of the data indexes is completed, the configuration calculation model of the data indexes is stored in a database.
The method of the invention dynamically configures the data source, can flexibly access various data with different types and different sources, and dynamically generates and adjusts the data index according to the service requirement. The dynamic property not only improves the adaptability and the flexibility of the data index management system, but also enables enterprises to respond to market changes and business demands more quickly.
Example 2
Based on embodiment 1, referring to fig. 1, the method of the present invention is used for querying and maintaining database connection information of different data sources, so as to provide for selection of data index data acquisition modes. Further, in step 1, a database connection management flow is established for the data source, including: a visual interface is provided for the user to enter information for the connection of the data sources,
Storing the data source code, the data source name, the database type, the driving class, the data source address, the database name, the user name, the password and remark information in the input information,
Connecting to a designated database by a JDBC database connection mode, selecting a corresponding driver according to the type of the database to perform database connectivity verification,
And displaying the maintained database information in a query list. Which may be available for use by a user in a subsequent embodiment.
Example 3
Based on embodiments 1 and 2, the method of the invention performs inquiry and maintenance on interface information of various request modes, provides the interface calling modes for user visualization, analyzes the required information according to the returned result, enables the user with less interface calling operation to perform interface information addition according to the visualized page, and provides the interface list configured by the evaluation index configuration user on the other hand, and can directly select for use.
Further, in step 2, an interface access management flow is established for the data source, including: providing a visual interface for a user to input interface basic information and interface list information, wherein the user inputs basic information including interface service names, affiliated departments, responsible persons, responsible person contact ways, affiliated service systems, interface descriptions and the like.
Configuring an interface according to interface list information, wherein information such as request timeout time, service Url, authorization mode, request parameter, request header parameter, request Body, return result parameter path, return parameter list and the like is input, previewing return result data, verifying interface connectivity, acquiring subsequent data index configuration calculation results by configuring the return result parameter path and the return parameter list,
The maintained interfaces are presented in a query list. Can be used in subsequent embodiments for user access.
Example 4
Based on embodiment 1, the method is suitable for classification and upper and lower relation of user set data indexes, and subsequent index management and quotation of the user provide rapid positioning and searching functions, so that reusability of the indexes is improved.
As shown in fig. 3, step 3 may include:
and providing a visual interface for a user to maintain data index classification, and inputting information such as classification names, belonging superior levels and the like.
The entered data index classifications are presented in a list in a tree structure for use in configuring data indexes for a user in a subsequent embodiment.
Example 5
Based on embodiments 1-4, the present invention is suitable for providing configuration and query functions of data indexes themselves in a data index management system. By establishing an index library, a user can flexibly select data indexes according to requirements to configure an assessment system. In step 4, the method may further specifically include:
the acquired data index classification information is provided for a user to carry out classification selection through visual interface information;
after the user finishes selecting, according to the classification selected by the user, inquiring the existing data indexes, and the user can change, delete and newly add the data indexes;
The user selects a newly added data index, and a visual interface is provided for a client to input basic information and data sources, wherein the basic information comprises index content, index description and classification information; the data source acquisition mode is used for users to select: manual filling acquisition, database acquisition, interface acquisition and reference calculation acquisition, wherein a manual processing index result path is reserved if manual filling is selected.
If the database is selected for collection, the obtained data source list information is selected by the user through the process of embodiment 2, the system automatically checks the connectivity of the data source after the user completes the selection and obtains the data list according to the data source connection information, the user selects the data list and inputs the required field names, the where condition and the ordering mode, wherein the where condition can refer to other data indexes as condition values, and after the data indexes are configured, the configuration calculation model of the data indexes is stored in the database. The index list is presented under the selected category.
If the interface is selected for collection, the interface list information obtained in the embodiment 3 is selected by the user, the user configures and receives the return value and the request parameter after finishing the selection, the request parameter can be input into a plurality of data indexes and can refer to other data indexes as parameter values, and the configuration calculation model of the data indexes is stored in the database after the completion of the configuration of the data indexes. The index list is presented under the selected category.
If the reference calculation collection is selected, a configured data index list in the example is provided for the user to select, the data index is selected as a parameter, and the parameter key is named. And providing a visual page for a user to edit the formula, judging the expression factor or the formula factor by using the selected data index as the condition, and storing the formula content according to the configuration. And after the data index is configured, storing the configuration calculation model of the data index into a database. The index list is presented under the selected category.
When the index list is displayed: and providing an interface and a query page display index list for display by a user and reference in the evaluation result calculation model.
Example 6
The invention also discloses a data index management device based on dynamic source, which comprises a database connection management module, an interface access management module, an index input module and a configuration data index module,
The database connection management module establishes a database connection management flow for a data source, wherein connection management is carried out by defining data source codes, data source names, database types, drive types, data source addresses, database names, user names, passwords and remark information;
The interface access management module establishes an interface access management flow aiming at a data source, wherein basic information and interface list information are defined, the basic information comprises interface service names, affiliated departments, responsible persons, contact ways of the responsible persons, affiliated service systems and interface description information, the interface list information comprises request timeout time, service Url, authorization modes, request parameters, header parameters, body information and return parameters, and interface document uploading and result previewing are provided;
The index input module classifies and inputs the data indexes, wherein classification names and belonged upper levels of the data indexes are defined, and the data index classification is displayed in a tree structure in a list, so that a user can conveniently configure the data indexes;
The configuration data index module forms a flow of configuration data indexes according to the requirements of a user, wherein the flow comprises the following steps: providing data index classification selection according to the classification of the data index;
According to the selection condition of data index classification, carrying out data index inquiry, and carrying out changing, deleting and adding operations of configuration index data according to the data index inquiry result: performing new addition operation, selecting a data source acquisition mode, wherein the data source acquisition mode comprises database acquisition, interface acquisition, quotation calculation acquisition and manual reporting acquisition,
If the database is selected for collection, checking the connectivity of the data sources according to the database connection management flow, acquiring a data list according to the data source connection information, selecting the data list, inputting the required field names, the where conditions and the ordering mode, wherein the where conditions can refer to other data indexes as condition values, storing a configuration calculation model of the data indexes into the database after the configuration of the data indexes is completed,
If the interface acquisition is selected, acquiring interface list information for the user to select, receiving a return value and a request parameter according to the user selection, storing a configuration calculation model of the data index into a database after the configuration of the data index is completed,
If the reference calculation collection is selected, the configured data indexes are selected by a user, the data index configuration of the new scene is carried out, and after the configuration of the data indexes is completed, the configuration calculation model of the data indexes is stored in a database.
The content of information interaction between the modules in the device and executing the readable program process and the like are based on the same conception as the embodiment of the method of the present invention, and specific content can be referred to the description in the embodiment of the method of the present invention, which is not repeated here.
The device of the invention improves the flexibility and the efficiency of data processing, improves the user experience, and optimizes the accuracy and the reliability of the data index. Compared with the conventional data index management method at present, the method has the following technical advantages:
the flexibility and the efficiency of data processing are improved: the data index can be dynamically acquired and managed, and the data source and the processing mode can be adjusted according to the actual requirements, so that the data processing is more flexible and efficient. Meanwhile, through automatic data collection and processing, the time and cost of manual operation can be greatly reduced, and the data processing efficiency is improved.
Optimizing accuracy and reliability of data indicators: the latest data can be acquired in real time, and the accuracy and reliability of the data index are ensured. In addition, automatic screening and filtering can be performed according to the data quality, inaccurate or invalid data is avoided, and the accuracy of the data index is further improved.
Support decision analysis and traffic optimization: can provide powerful support for decision analysis. Through real-time and accurate data indexes, a user can better know service conditions and market trends, and powerful data support is provided for decision making. Meanwhile, the method can help the user to find out problems and bottlenecks in the service and provide guidance for service optimization.
The service requirements can be satisfied: the requirements of the business system on data index management can be met. By dynamically configuring index-related information on the configuration page, an administrator can conveniently configure a desired evaluation index.
It should be noted that not all the steps and modules in the above processes and the structures of the devices are necessary, and some steps or modules may be omitted according to actual needs. The execution sequence of the steps is not fixed and can be adjusted as required. The system structure described in the above embodiments may be a physical structure or a logical structure, that is, some modules may be implemented by the same physical entity, or some modules may be implemented by multiple physical entities, or may be implemented jointly by some components in multiple independent devices.
The above-described embodiments are merely preferred embodiments for fully explaining the present invention, and the scope of the present invention is not limited thereto. Equivalent substitutions and modifications will occur to those skilled in the art based on the present invention, and are intended to be within the scope of the present invention. The protection scope of the invention is subject to the claims.