Disclosure of Invention
The invention provides an enterprise application configuration system based on a digital basic platform, which solves the challenges faced in enterprise application configuration management in the related art, including the technical problems of high configuration complexity, frequent change and consistency.
The invention provides an enterprise application configuration system based on a digital basic platform, which comprises:
The configuration center module is responsible for centralized storage and management of configuration information of all applications, and supports multi-environment configuration, version control and real-time push update;
step S100 is executed through a configuration center module, application configuration requirements are identified, configuration center services are selected and deployed, and standard configuration files are loaded;
the workflow engine module is used for realizing the approval and execution flow automation of the configuration change and designing complex workflow, including the application, auditing, preview and deployment of the configuration change;
Step S200 is executed through a workflow engine module, a change approval process is designed in the workflow engine, and access control authorities are distributed according to roles;
The authority and access control module is used for enabling authorized users or services to access and modify the configuration information;
step S300 is executed through the authority and access control module, an application configuration template is customized, environment specific variables are configured, and the multi-environment deployment requirement is supported;
the monitoring and alarming module is used for monitoring the configuration state and the application running state in real time and timely finding and early warning potential problems;
Step S400 is executed through the monitoring and alarming module, the application integration configuration center is modified, and the automatic testing unit is integrated into the changing flow;
The self-service portal module realizes configuration inquiry, modification, approval and deployment through an operation interface.
And executing step S500 through the self-service portal module, starting a change request flow, and configuring a monitoring system to monitor the configuration state and the application performance.
Further, identifying application configuration requirements, selecting and deploying configuration center services, and loading standard configuration files as follows:
s110, collecting configuration requirements of different applications, including database connection, API keys and log levels;
s120, evaluating a configuration center solution on the market according to a demand analysis result;
S130, preparing infrastructure resources including servers, network configuration and security policies;
S140, designing a configuration file template, and adopting YAML or JSON format.
Further, the design change approval process is in the workflow engine, and the steps of distributing the access control authority according to the roles are as follows:
S210, analyzing a business flow of configuration change and identifying key steps;
Creating a flow chart by using a graphical interface dragging element in a workflow engine module, and defining participants, task types and conditional branches of each step;
Configuring workflow logic;
s220, determining various roles participating in configuration management, and defining the responsibility scope of each role;
s230, defining an access control strategy according to roles to realize fine granularity control;
s240, integrating the designed workflow with a configuration center module, triggering the workflow by a change request, and automatically updating the configuration after the completion;
and (3) performing a permission configuration test to verify whether permissions of different roles in actual operation are valid or not, and whether the process can be executed according to expectations or not.
Further, the steps of customizing an application configuration template, configuring environment-specific variables, and supporting the multi-environment deployment requirements are as follows:
S310, constructing a configuration template set T, customizing a template Ti for each type of application or service, and enabling the template to contain necessary configuration items and variable placeholders;
S320, establishing a variable set V, and defining the function and expected environmental adaptability of each variable Vj;
S330, defining an environment set E, and designing a mapping function M for each environment Em;
S340, for any variable vl in the template tk, determining a specific value of the variable in the environment em through a mapping function M (tk,vl,em);
s350, applying a configuration template to each environment, and associating the template with environment variables by using an interface or a tool of a configuration center to ensure that each application instance can load correct configuration according to the environment;
deployment and testing are performed to verify the correctness of the variable mapping, and ensure that applications in each environment can be started and run based on the correct configuration.
Further, the application integration configuration center is modified, and the steps in the process of integrating the automatic test unit into the change flow are as follows:
s410, modifying application codes to enable the application codes to support dynamic acquisition of configuration from a configuration center;
s420, configuring each application instance, ensuring communication with a configuration center, including specifying a configuration file path and an environment identifier;
A monitoring mechanism is arranged, so that the application can automatically reload the configuration without restarting when the configuration is updated;
S430, designing an automatic test suite to cover all key business scenes and edge situations which may be affected by configuration change;
integrating the test framework and the continuous integration/continuous deployment flow, so that each configuration change automatically triggers the test;
s440, inserting an automatic test stage into the workflow of the configuration change;
Defining conditions such as test coverage rate, performance index and error rate threshold as preconditions for configuration change approval;
s450, configuring a monitoring tool, and monitoring the execution state and the result of the automatic test;
and implementing a feedback loop, and automatically rolling back configuration change or suspending deployment flow when the test fails until the problem is solved.
Further, the steps of starting the change request flow and configuring the monitoring system to monitor the configuration state and the application performance are as follows:
S510, a user submits a configuration change request including change content, affected applications and expected environments through a self-service portal or API of a configuration management system;
S520, the submitted change request automatically enters a preset workflow, and a corresponding approval process is triggered according to the importance and the influence range of the change
S530, automatically deploying the approved change request to a target environment, and pushing new configuration information to an application instance by an application configuration center;
s540, the state and the configuration version of the configuration center are continuously tracked by the monitoring system, so that all configuration changes are accurately recorded and reported;
The monitoring system sets threshold values and rules, such as configuration update frequency and success rate;
s550, integrating application performance monitoring tools to monitor performance indexes of the application after configuration change, such as response time, throughput and error rate;
s560, when the monitoring system detects configuration errors, performance degradation or other abnormal conditions, an alarm mechanism is automatically triggered, and related personnel are informed of intervention treatment.
Further, in step S520, if the change influence level is High l=high, the multi-level approval is necessary;
Otherwise, performing a simplified approval process;
the expression is as follows:
Wherein, multi-levelApproval is Multi-level approval, simplifiedApproval is simplified approval process.
Further, in step S530, after deployment, the automated test unit is activated to verify the change effect, so that the application operates normally, expressed as:
V(Cnew)＝Test Suite(Cold→Cnew);
Wherein, Cnew and Cold represent new and old configuration states, respectively, and Test Suite is an executed Test Suite.
Further, in step S550, the expression of the performance monitoring logic is as follows:
Pt＝f(Ct,At);
Wherein, Pt is an application performance index at time t, Ct is a configuration state applied at that time, at is an application activity or load condition, and the function f represents a relationship model between configuration and performance.
A storage medium storing non-transitory computer readable instructions for executing one or more modules of the aforementioned digital base platform based enterprise application configuration system.
The invention has the beneficial effects that:
The invention can accurately identify and respond to diversified configuration requirements of different business departments, simultaneously automatically execute application, approval, preview, deployment and other processes of configuration change through the intelligent workflow engine, ensure that the accuracy of configuration information and the effectiveness of version control can be maintained on the premise of reducing manual intervention, also can immediately monitor the influence of configuration change on application performance, and automatically trigger an alarm and rollback mechanism when configuration errors or performance decay are encountered, thereby achieving the purposes of optimizing the internal application configuration management process of enterprises, remarkably improving IT operation and maintenance efficiency and shortening business response time, and elaborating interactive logic and data flow among all modules of the system, and ensuring the stability and safety of the system under large-scale deployment.
Detailed Description
The subject matter described herein will now be discussed with reference to example embodiments. It is to be understood that these embodiments are merely discussed so that those skilled in the art may better understand and implement the subject matter described herein and that changes may be made in the function and arrangement of the elements discussed without departing from the scope of the disclosure herein. Various examples may omit, replace, or add various procedures or components as desired. In addition, features described with respect to some examples may be combined in other examples as well.
Referring to fig. 1 and 2, an enterprise application configuration system based on a digital base platform, comprising:
And the configuration center module is responsible for centralized storage and management of configuration information of all applications, supports multi-environment configuration, version control and real-time push update, and ensures consistency and traceability of configuration.
In one embodiment of the invention, the system is highly customizable, allows a user to customize configuration templates and formats according to different application requirements, supports various data formats such as JSON, YAML and the like, and has functions such as variable replacement, environment variable injection and the like.
And (3) automatic management, namely integrating an automatic test and verification process, and ensuring the compatibility and stability of the application before and after configuration change.
And the workflow engine module realizes the approval of the configuration change and the automation of the execution flow, and a user can design a complex workflow, including a plurality of links such as application, audit, preview, deployment and the like of the configuration change.
In one embodiment of the invention, the workflow can be customized by supporting the drawing creation and editing of the graphical interface, and customizing each step according to the approval rules and the flow inside the enterprise;
And automatically executing, namely automatically triggering configuration updating to a target application or environment once the configuration change request passes approval, reducing manual intervention and accelerating deployment speed.
Rights and access control module-ensuring that only authorized users or services can access and modify configuration information.
In one embodiment of the invention, fine-grained rights management is supported by role assignment, rights grading, ensuring that each user or service account only has access to the configuration within its sphere of responsibility;
and (3) automatic audit, namely recording histories and audit logs of all configuration changes, and facilitating tracking and backtracking of problems.
And the monitoring and alarming module is used for monitoring the configuration state and the application running state in real time and timely discovering and early warning potential problems.
In one embodiment of the invention, the user can set the monitoring index and the threshold value according to the need, such as the conditions of failure of configuration update, inconsistent configuration and the like;
and (3) automatic alarm, namely automatically sending alarm notification through mail, short message or an integrated enterprise IM tool, and rapidly responding to the alarm notification.
And the self-service portal module provides an intuitive operation interface for developers and operation and maintenance teams to realize the operations of configuration inquiry, modification, approval, deployment and the like.
In one embodiment of the invention, the method has high interactivity, which is friendly in interface, supports searching, filtering and comparing different versions of configuration, and improves the working efficiency;
and (3) automatically generating a configuration document and a change log by using an automatic document, so that team members can quickly know configuration details and change histories.
Referring to fig. 2, an enterprise application configuration method based on a digital basic platform includes the following steps:
s100, building a demand analysis and configuration center module, namely identifying application configuration demands, selecting and deploying configuration center services, and loading a standard configuration file;
the building of the demand analysis and configuration center module comprises the following steps:
S110, meeting with a business team and a development team, and collecting configuration requirements of different applications, including but not limited to database connection, API keys, log levels and the like;
Classifying and sorting requirements, identifying commonalities and differences, and formulating a configuration item list and a default value range thereof;
s120, evaluating configuration center solutions in the market, such as Spring Cloud Config, hashiCorp Consul, etcd and the like, according to the requirement analysis results (such as safety, expansibility and usability requirements).
Selecting the most suitable configuration center service, and considering factors such as community activity, technical support, integration difficulty and the like;
s130, preparing infrastructure resources such as servers, network configuration, security policies and the like;
the configuration center service is deployed by using containerization technologies such as Docker or Kubernetes, and high availability and expandability are ensured;
and configuring operation and maintenance requirements such as backup recovery strategies, log records, monitoring alarms and the like of the service.
S140, designing a configuration file template, and adopting a YAML or JSON format to ensure clear configuration items and strong readability;
converting the sorted configuration item list into a standard configuration file, and preparing corresponding configuration templates for different environments (development, test and production);
these standard configuration files are loaded into the configuration center using an API or CLI tool to set initial version control.
In one embodiment of the invention, the organization of configuration items and version control logic is represented by a mathematical model:
C= { C1,c2,...,cn } represents a set of configuration items, where each ci represents a specific configuration item;
e= { E1,e2,.. } represents a set of environments, such as dev, test, prod;
Vj denotes therein the version sequence of configuration item cj, Vj＝{vj1,vj2, a.i. }, wherein Vjk is the kth version;
mij represents the version used by configuration item cj under environment ei, i.e., Mij∈Vj;
One of the tasks of the configuration center may be formalized to find a set of configuration item versions Mi1,Mi2,...,Min for each environment ei so that the configuration needs of all applications under that environment are satisfied while maintaining consistency and traceability of the configuration.
S200, designing a flow design and authority configuration, namely designing a change approval flow in a workflow engine, and distributing access control authorities according to roles;
In one embodiment of the present invention,
S210, workflow design, namely analyzing a business flow of configuration change, and identifying key steps such as change application, technical review, test verification, approval, deployment and the like;
in a workflow engine module (e.g., camunda, actiti, or Jira), a flow chart is created using graphical interface drag elements, defining participants, task types, conditional branches, etc. for each step;
configuring workflow logic to ensure smooth flow, such as setting conditions to be met by the approval node, and automatically routing to rules of the next stage;
s220, role definition, namely determining various roles participating in configuration management, such as a configuration manager, a developer, a test engineer, an operation and maintenance person, an approver and the like;
defining the responsibility scope of each role, for example, a configuration manager is responsible for maintaining a configuration template, a developer has the authority to request configuration change and the like;
S230, authority allocation, namely defining an access control strategy according to roles in an authority management system;
assigning specific rights to each character, including rights to view, edit, and approve a particular configuration item or flow;
fine-grained control is achieved, such as limiting certain roles to view or modify configuration only in certain circumstances;
s240, integrating and testing, namely integrating the designed workflow with a configuration center, ensuring that a change request can trigger the workflow, and automatically updating the configuration after the completion;
and (3) performing a permission configuration test to verify whether permissions of different roles in actual operation are valid or not, and whether the process can be executed according to expectations or not.
The rights assignment problem in configuration management can be represented abstractly by an access control matrix (Access Control Matrix, ACM), while in practice it is more dependent on the system configuration, the theoretical model helps to understand the rights structure.
What needs to be stated is:
U= { U1,u2,...,um } represents a set of users, where each Ui represents one user or role;
O= { O1,o2,...,on } represents a set of operation objects, here, configuration items, workflow steps, etc.;
a= { read, write, apply, } represents a set of operations, including permissions to view, write, approve, etc.;
the access control moment ACM is a three-dimensional array of m×n×|a|, where ACM [ i ] [ j ] [ k ] =true indicates that user ui has the authority ak of operation on the operation object oj, otherwise false.
For example, if the configuration manager (assumed u1) has read and write rights to all configuration items (O), then in the ACM, true should be for all Oj and ACM [1] [ j ] [ read ].
The model concisely shows the relationship between the user and the resource operation authority, and is a theoretical basis for the authority configuration in the configuration management system.
S300, creating a template and setting variables, namely customizing an application configuration template, configuring environment specific variables and supporting multi-environment deployment requirements;
In one embodiment of the invention, the steps of template creation and variable setting are as follows:
s310, template requirement identification and design, namely constructing a configuration template set T, customizing a template Ti for each type of application or service, and ensuring that the template contains necessary configuration items and variable placeholders, such as database URLs, API keys and the like;
S320, establishing a variable set V, and defining the function and expected environmental adaptability of each variable Vj;
s330, establishing environment definition and mapping rules, namely defining an environment set E, and designing a mapping function M for each environment Em (such as development environment dev, test environment test and production environment prod);
S340, realizing mapping logic, namely determining the specific value of any variable vl in a template tk in an environment em through a mapping function M (tk,vl,em);
s350, template application and verification, namely, applying a configuration template to each environment, and associating the template with environment variables by utilizing an interface or a tool of a configuration center to ensure that each application instance can load correct configuration according to the environment;
deployment and testing are performed to verify the correctness of the variable mapping, and ensure that applications in each environment can be started and run based on the correct configuration.
S400, system integration and automatic inspection, namely modifying an application integration configuration center, and integrating an automatic test unit into a change flow;
s410, modifying the application code to enable the application code to support dynamic acquisition of configuration from a configuration center;
Typically involves introducing a configuration center client library, such as Spring Cloud Config Client, or communicating directly with the configuration center using an HTTP/REST API;
the address of the configuration center, authentication information, and how to load the code of the corresponding configuration according to the environment variables are added to the application start logic.
S420, configuring a configuration center client to configure each application instance, ensuring that they know how to communicate with the configuration center, including specifying a configuration file path, an environment identifier, etc.;
And setting a monitoring mechanism, so that the application can automatically reload the configuration without restarting when the configuration is updated.
S430, automatic test integration, namely designing an automatic test suite to cover all key business scenes and edge conditions possibly affected by configuration change;
integration test frameworks (e.g., JUnit, testNG, pyTest, etc.) and continuous integration/continuous deployment (CI/CD) procedures ensure that each configuration change automatically triggers a test.
S440, integrating workflow engines, namely inserting an automatic test stage into the workflow with changed configuration, namely, checking that the configuration must pass an automatic test before updating to a pre-production or production environment;
Conditions under which the test passes, such as test coverage, performance index, error rate threshold, etc., are defined as preconditions for configuration change approval.
S450, a monitoring and feedback mechanism is established, wherein a monitoring tool is configured to monitor the execution state and result of the automatic test, so that relevant personnel can be notified immediately when the test fails;
and implementing a feedback loop, and automatically rolling back configuration change or suspending deployment flow when the test fails until the problem is solved.
S500, configuration change implementation and monitoring deployment, namely, starting a change request flow, and configuring a monitoring system to monitor a configuration state and application performance;
in one embodiment of the invention, the configuration change implementation and monitoring deployment includes the steps of:
s510, initiating a change request, wherein a user (usually a development or operation team member) submits a configuration change request comprising information such as change content, affected application, expected environment and the like through a self-service portal or API of a configuration management system;
S520, workflow driving approval, namely automatically entering a submitted change request into a preset workflow, and triggering a corresponding approval process according to the importance and the influence range of the change;
Expressed using a mathematical expression, if the change impact level is High (l=high), then multiple levels of approval must be passed (a=multi-levelApproval);
Otherwise, a simplified approval process is performed (a= SimplifiedApproval).
Namely:
S530, automatic deployment and verification, wherein the approved change request is automatically deployed to a target environment, and the application configuration center pushes new configuration information to the application instance;
after deployment, the automatic test unit is activated to verify the change effect, so that the normal operation of the application is ensured, and the method can be expressed as follows:
V(Cnew)＝Test Suite(Cold→Cnew)
Wherein, Cnew and Cold represent new and old configuration states respectively, test Suite is the executed Test Suite, and the correctness of configuration change and the stability of application are verified.
S540, monitoring the configuration state, namely continuously tracking the state and the configuration version of the configuration center by a monitoring system, and ensuring that all configuration changes can be accurately recorded and reported;
The monitoring system sets thresholds and rules, such as configuration update frequency, success rate, etc., for measuring the health status of configuration management.
S550, monitoring application performance, namely integrating an Application Performance Monitoring (APM) tool, and monitoring performance indexes of the application after configuration change, such as response time, throughput, error rate and the like;
the performance monitoring logic is represented by a mathematical expression:
Pt＝f(Ct,At)
Wherein, Pt is an application performance index at time t, Ct is a configuration state applied at the time, at is an application activity or load condition, and the function f represents a relation model between configuration and performance, and is used for analyzing the influence of configuration change on performance.
S560, abnormal response and alarm, namely when the monitoring system detects configuration errors, performance degradation or other abnormal conditions, automatically triggering an alarm mechanism to inform related personnel of intervention treatment.
At least one embodiment of the present disclosure provides a storage medium storing non-transitory computer readable instructions for performing one or more steps of the aforementioned film-tv based AI image super-resolution detail enhancement method.
A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
The embodiment has been described above with reference to the embodiment, but the embodiment is not limited to the above-described specific implementation, which is only illustrative and not restrictive, and many forms can be made by those of ordinary skill in the art, given the benefit of this disclosure, are within the scope of this embodiment.