Movatterモバイル変換


[0]ホーム

URL:


CN113377399A - Non-stop system drilling verification method and device - Google Patents

Non-stop system drilling verification method and device
Download PDF

Info

Publication number
CN113377399A
CN113377399ACN202110655049.0ACN202110655049ACN113377399ACN 113377399 ACN113377399 ACN 113377399ACN 202110655049 ACN202110655049 ACN 202110655049ACN 113377399 ACN113377399 ACN 113377399A
Authority
CN
China
Prior art keywords
server
flow
application
traffic
production
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110655049.0A
Other languages
Chinese (zh)
Other versions
CN113377399B (en
Inventor
陈壮壮
郑重
高汉
杨圣洁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBCfiledCriticalIndustrial and Commercial Bank of China Ltd ICBC
Priority to CN202110655049.0ApriorityCriticalpatent/CN113377399B/en
Publication of CN113377399ApublicationCriticalpatent/CN113377399A/en
Application grantedgrantedCritical
Publication of CN113377399BpublicationCriticalpatent/CN113377399B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

Translated fromChinese

一种不停机系统演练验证方法及装置,涉及数据测试领域,可应用于金融领域和其他领域,所述方法包含:获取应用的服务器信息和生产流量指标,根据服务器信息生成应用的环境信息,以及根据生产流量指标生成流量模拟任务;根据环境信息和流量模拟任务对应用发起背景模拟流量,并进行应用升级安装;监控应用的入口流量、服务器的性能参数和服务器关联设备的负载情况;通过入口流量、性能参数和负载情况获得应用的投产演练结果。以此,能够在投产演练过程中模拟生产流量,监控版本升级安装对网络、服务器、负载等方面的影响,评估升级过程中服务能力的下降程度,确定合适的投产窗口和投产时间,对生产安全平稳投产提供指导意见。

Figure 202110655049

A non-stop system exercise verification method and device, which relate to the field of data testing and can be applied to the financial field and other fields, the method comprising: acquiring server information and production flow indicators of an application, generating environment information of the application according to the server information, and Generate traffic simulation tasks based on production traffic indicators; initiate background simulation traffic for applications based on environmental information and traffic simulation tasks, and perform application upgrades and installations; monitor application ingress traffic, server performance parameters, and server-related device loads; pass ingress traffic , performance parameters and load conditions to obtain the results of the application's production exercise. In this way, it is possible to simulate the production flow during the production exercise, monitor the impact of the version upgrade and installation on the network, server, load, etc., evaluate the degree of service capacity decline during the upgrade process, and determine the appropriate production window and time. Provide guidance for stable production.

Figure 202110655049

Description

Non-stop system drilling verification method and device
Technical Field
The invention relates to the field of data testing, can be applied to the financial field and other fields, and particularly relates to a non-stop system drilling method and device.
Background
In the version upgrading process of financial application software, a lot of application software requires no shutdown for 7 × 24 hours to provide services, the capability of providing services to the outside cannot be influenced in the version upgrading process, and meanwhile, the functions and the performances of the application software are ensured to be normal, so that production practice needs to be carried out in a test environment before software upgrading in a production environment. For the financial application software, three phenomena exist: firstly, the version is quick to change, and under the continuous release scene, new functions are on-line every week, and software needs to be upgraded; secondly, the calling relationship among the applications is frequent and complicated, and if one application is upgraded, a plurality of applications can be influenced; thirdly, many applications are distributed deployment in multiple parks, and loads, networks and servers are affected in the upgrading process. Aiming at the three phenomena, if the fact that version installation and functions are normal is only verified in the commissioning test, the following defects exist: the performance cannot be evaluated in the upgrading process without upgrading under the background of production flow. The problems of network, server, load and the like are not considered in the process of commissioning exercise.
Disclosure of Invention
The invention aims to provide a non-stop system drilling method and a non-stop system drilling device, which can simulate real production flow during production drilling and ensure that system upgrading does not influence the capability of providing services to the outside during production drilling. The invention can verify the problems of the system upgrading on the aspects of the function influence on the service, the performance influence on the service, the load balance influence, the network influence and the like, and simultaneously determine the optimal production window and production time.
To achieve the above object, the present invention provides a method for validating a system drill without shutdown, the method comprising: acquiring server information and a production flow index of an application, generating environment information of the application according to the server information, and generating a flow simulation task according to the production flow index; initiating background simulation flow for the application according to the environment information and the flow simulation task, and upgrading and installing the application; monitoring the inlet flow of the application, the performance parameters of the server and the load condition of the server-associated equipment; and obtaining the application production exercise result through the inlet flow, the performance parameters and the load condition.
In the above drilling verification method for an uninterruptible system, preferably, the generating a flow simulation task according to the production flow index includes: and converting the production flow index into a query rate index and a response time index, and generating a flow simulation task according to the query rate index and the response time index.
In the above method for performing validation on a non-stop system, preferably, the monitoring the ingress traffic of the application, the performance parameter of the server, and the load condition of the server-associated device further includes: acquiring historical access flow data of the application according to the environment information; and comparing the background simulation flow with the historical access flow data, and monitoring the inlet flow of the application, the performance parameters of the server and the load condition of the equipment associated with the server when the difference between the background simulation flow and the historical access flow is smaller than a preset difference threshold value.
In the above method for validating the drill of the non-stop system, preferably, the performance parameters of the monitoring server include: and acquiring the performance parameters of the server through a Promiex monitoring system, and storing the performance parameters and the identification information of the server into a preset time sequence database according to a time sequence after the performance parameters are associated with the identification information of the server.
In the non-stop system drilling verification method, preferably, the performance parameters include memory usage ratio, CPU usage ratio, and coefficient disk processing efficiency; the entry flow comprises a transaction success flow and a transaction failure flow; the load condition includes access flow and load of each network device in the distributed architecture server.
In the above method for validating the non-stop system drilling, preferably, the obtaining of the production drilling result of the application through the inlet flow, the performance parameter and the load condition further includes: comparing the inlet flow, the performance parameters and the load condition in the commissioning result with a preset alarm threshold respectively, and generating an alarm signal when any data among the inlet flow, the performance parameters and the load condition meets a preset alarm condition; providing the alert signal to a predetermined location.
The invention also provides a non-stop system drilling verification device, which comprises a flow simulation module and a monitoring module; the flow simulation module is used for acquiring server information and production flow indexes of the application, generating environment information of the application according to the server information, and generating a flow simulation task according to the production flow indexes; initiating background simulation flow for the application according to the environment information and the flow simulation task, and upgrading and installing the application; the monitoring module is used for monitoring the inlet flow of the application, the performance parameters of the server and the load condition of the server-associated equipment; and obtaining the application production exercise result through the inlet flow, the performance parameters and the load condition.
In the above-mentioned training verification apparatus for an uninterruptible system, preferably, the simulated traffic module further includes a module for acquiring historical access traffic data of the application according to the environment information; and comparing the background simulation flow with the historical access flow data, and monitoring the inlet flow of the application, the performance parameters of the server and the load condition of the equipment associated with the server when the difference between the background simulation flow and the historical access flow is smaller than a preset difference threshold value.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method when executing the computer program.
The present invention also provides a computer-readable storage medium storing a computer program for executing the above method.
The invention has the beneficial technical effects that: the production practice can be carried out under the condition of simulating the production flow, so that the practice result is more suitable for the actual production condition; the service capability reduction condition caused by the upgrading of the application software can be evaluated, and the production time and the production window can be conveniently confirmed; whether system resources have bottlenecks caused by application software upgrading or not, if the system resources have bottlenecks, capacity can be expanded in time; and whether the application software is upgraded to cause load imbalance and whether the network equipment and each server can bear increased flow is beneficial to guiding the smooth production.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:
fig. 1 is a schematic diagram of an application timing sequence of a non-stop system drilling verification method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating a schematic flow of a non-stop system drilling verification method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a non-stop system drilling verification apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a schematic diagram of a non-stop system drilling verification apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following detailed description of the embodiments of the present invention will be provided with reference to the drawings and examples, so that how to apply the technical means to solve the technical problems and achieve the technical effects can be fully understood and implemented. It should be noted that, unless otherwise specified, the embodiments and features of the embodiments of the present invention may be combined with each other, and the technical solutions formed are within the scope of the present invention.
Additionally, the steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions and, although a logical order is illustrated in the flow charts, in some cases, the steps illustrated or described may be performed in an order different than here.
Referring to fig. 2, a non-stop system drilling verification method provided by the present invention includes:
s201, acquiring server information and a production flow index of an application, generating environment information of the application according to the server information, and generating a flow simulation task according to the production flow index;
s202, initiating background simulation flow to the application according to the environment information and the flow simulation task, and upgrading and installing the application;
s203, monitoring the inlet flow of the application, the performance parameters of the server and the load condition of the server-associated equipment;
s204, obtaining the production drilling result of the application through the inlet flow, the performance parameters and the load condition.
The performance parameters comprise memory use ratio, CPU use ratio and coefficient disk processing efficiency; the entry flow comprises a transaction success flow and a transaction failure flow; the load condition includes access flow and load of each network device in the distributed architecture server. Therefore, the production flow can be simulated in the process of production exercise, the influence of version upgrading installation on the network, the server, the load and the like can be monitored, the reduction degree of the service capacity in the upgrading process can be evaluated, the proper production window and production time can be determined, and guidance opinions can be provided for safe and stable production.
In an embodiment of the present invention, generating the flow simulation task according to the production flow index includes: and converting the production flow index into a query rate index and a response time index, and generating a flow simulation task according to the query rate index and the response time index. Further, monitoring the ingress traffic of the application, the performance parameters of the server, and the load condition of the server-associated device further comprises: acquiring historical access flow data of the application according to the environment information; and comparing the background simulation flow with the historical access flow data, and monitoring the inlet flow of the application, the performance parameters of the server and the load condition of the equipment associated with the server when the difference between the background simulation flow and the historical access flow is smaller than a preset difference threshold value. In the actual process, the simulation production real flow initiates concurrent access to the application software service, the production real flow comes from data obtained by counting the software flow, and then the multithreading high-concurrency simulation production flow initiates access. The concurrency number is gradually increased from 1 before the visit is started, the flow condition is monitored in real time and is continued until the simulation flow is consistent with the production flow, and therefore the initiated flow is consistent with the production.
In an embodiment of the present invention, the performance parameters of the monitoring server include: and acquiring the performance parameters of the server through a Promiex monitoring system, and storing the performance parameters and the identification information of the server into a preset time sequence database according to a time sequence after the performance parameters are associated with the identification information of the server. In practical operation, the monitoring service may use an open source promemeus system, and promemeus has the following characteristics: the multidimensional data model and the flexible query language do not depend on distributed storage, and a single server node is autonomous; time sequence data are acquired in a pull mode based on HTTP, and time sequence data pushing can be carried out through an intermediate gateway; target service objects are discovered through service discovery or static configuration, and various icon and page displays such as Grafana and the like are supported.
In the above embodiment, the basic principle of Prometheus is to periodically capture the state of a monitored component through the HTTP protocol, any component can access monitoring as long as a corresponding HTTP interface is provided, and the HTTP interface that outputs information of the monitored component is called an exporter. The monitoring module can automatically send the exporter to the corresponding server and start the exporter service (the information of CPU, memory, IO, flow and the like of the main acquisition system of the exporter) according to the ip information of the environment server input by the user, then the prometheus can pull the data from the corresponding exporter, and the pulled information can be stored to the self time sequence database according to the time sequence. CPU, memory and IO information collected by the Exporter are used as main information monitored by the server; the acquired flow information is used as main information for flow monitoring; if the servers are deployed in a multi-server and distributed mode, comparing whether the flow of each server is balanced or not, if so, considering that the load is balanced, and if not, considering that the load is unbalanced. The three monitors are collected and stored through prometheus and exporter, and then are used for different monitoring parts, namely flow monitoring, server monitoring and load balancing monitoring. Relationship of three monitoring and overall scheme: the three monitors can ensure normal flow, normal server performance and normal load balance in the drilling process. If one monitoring is abnormal, the whole drilling process is considered to have problems, and the three monitoring are parallel monitoring and data acquisition and analysis are carried out simultaneously.
In an embodiment of the present invention, obtaining a commissioning result of an application through the ingress traffic, the performance parameter, and the load condition further includes: comparing the inlet flow, the performance parameters and the load condition in the commissioning result with a preset alarm threshold respectively, and generating an alarm signal when any data among the inlet flow, the performance parameters and the load condition meets a preset alarm condition; providing the alert signal to a predetermined location.
To facilitate a more clear understanding of the specific application of the above embodiments provided by the present invention, the following description refers to fig. 1 to illustrate the practical application process of the above embodiments, and it should be understood by those skilled in the art that this example is only one application of the embodiments provided by the present invention for convenience of understanding, and is not intended to limit the invention in any way.
S101 registers environment information such as an IP of the application server for subsequent S102 service registration.
S102, the environmental information such as the application software server registered in S101 is registered in a management cluster, and the management cluster can realize health check and dynamic management of server information.
S103 refines the traffic into QPS (Query Per Second, Query rate), response time, and other indicators.
S104, the flow initiating module dynamically pulls the environment information such as the application software server and the like from the registered cluster, performs timing detection, and dynamically updates the environment information once the environment information changes.
S105 represents the generation of the corresponding flow simulation task according to the index of S103.
S106 executes the task of S106, initiating background simulation traffic.
And S107, normally carrying out application software upgrading and installation under the simulation flow.
S108 monitors the change of the background traffic in the upgrading process, where what is monitored is the traffic of the entry, that is, all the traffic of the whole application software.
S109, counting the inlet amount.
S110, the consumption condition of system resources in the upgrading process of the application software is monitored.
S111 refines the system monitoring of S110, including Web, middleware, storage.
And S112, monitoring the load equipment of the application software, and being suitable for distributed deployment, multi-server deployment, multi-park deployment and other applications.
S113 refines the monitoring device of S112, including network device monitoring, traffic monitoring of each server, and the like.
Specifically, in combination with a production drilling scene of the distributed cache system, the above process is applied as follows:
1. according to the production drill plan, the production drill personnel need to register the environmental information such as the IP of the distributed cache system and input the production flow index.
2. The management and control module can register the registered environmental information to the management cluster, the management cluster can detect the health of the environmental information, and meanwhile, the management and control module can refine the flow index into indexes such as QPS and response time.
3. The task module acquires the flow index information from the control module and generates a corresponding flow simulation initiation task script.
4. The flow initiating module firstly obtains the application software environment information from the master-slave cluster, and then obtains the task script from the task module.
5. And when no problem exists in the third step, the flow initiating module executes the task script and simulates the production flow.
6. And under the background of simulating the production flow, the commissioning personnel upgrade and install the normal application software.
7. In the upgrade and installation process of the application software, the simulation flow, the system, the network and the like are inevitably affected, and the flow, the system and the load need to be monitored respectively.
8. The flow monitoring mainly monitors the change condition of the whole simulation flow for the entrance of the application software so as to evaluate the reduction condition of the service capability during the application software upgrading and whether the application software upgrading has problems.
9. The system monitors the system performance of web, middleware and stored equipment when the application software is upgraded, so as to evaluate whether the whole system meets the upgrading condition.
10. The load monitoring mainly monitors whether the pressure and the load of the network equipment are normal during the upgrading of the application software, and the server can support corresponding flow when the flow of each server is changed under the condition of rolling upgrading.
11. And finally, after the production practice is finished, evaluating whether the service capacity change condition, the system resource use condition, the load balance and the like are balanced when the application software is upgraded.
Referring to fig. 3, the present invention further provides a non-stop system drilling verification apparatus, which includes a flow simulation module and a monitoring module; the flow simulation module is used for acquiring server information and production flow indexes of the application, generating environment information of the application according to the server information, and generating a flow simulation task according to the production flow indexes; initiating background simulation flow for the application according to the environment information and the flow simulation task, and upgrading and installing the application; the monitoring module is used for monitoring the inlet flow of the application, the performance parameters of the server and the load condition of the server-associated equipment; and obtaining the application production exercise result through the inlet flow, the performance parameters and the load condition. The simulation flow module also acquires historical access flow data of the application according to the environment information; and comparing the background simulation flow with the historical access flow data, and monitoring the inlet flow of the application, the performance parameters of the server and the load condition of the equipment associated with the server when the difference between the background simulation flow and the historical access flow is smaller than a preset difference threshold value.
The flow simulation system comprises a flow simulation module, a task module and a flow simulation module, wherein the flow simulation module can comprise a task module, the task module is used for converting the production flow index into a query rate index and a response time index, and generating a flow simulation task according to the query rate index and the response time index; specifically, in actual work, the traffic task may be refined into indexes such as QPS, response time, Throughput (TPS), QPS, and concurrency number, so as to quantize the traffic simulation task to generate corresponding traffic data to complete traffic simulation, in this process, a person skilled in the art may select and use according to actual needs, for example, using query rate index and response time as quantization indexes, or using concurrency number as quantization indexes, which may be determined by drilling requirements, and thus, detailed description is omitted here.
Specifically referring to fig. 4, the application structure of the non-stop system drilling verification apparatus provided by the present invention in actual work may be composed of the following components:
the simulation flow module is mainly used for simulating production flow during production and practice of application software, wherein 001 is a management and control module and is used for registering application software environment information and refining the production flow to indexes such as QPS (quick Path System), response time and the like, 002 is a registration cluster and is used for dynamically managing the application software environment information, 003 is a task module and is used for generating a simulation flow script according to the index information, 004 is a flow initiating module and is used for executing the task script after acquiring the application software environment information from the registration cluster and acquiring the task script by the task module and initiating simulation flow access to the application software; when the simulation flow reaches the flow same as the production flow, the commissioning personnel normally carries out the installation and the upgrade of the application software, and the monitoring is synchronously carried out in the installation and the upgrade process; 005,006,007, belonging to the monitoring module of the invention, is used for monitoring relevant data in the process of commissioning, wherein 005 is flow monitoring for monitoring whether the flow of the whole application software changes, more precisely, whether the simulation flow drops in the process of application software installation and upgrade, and how large the drop amplitude is, 006 is system monitoring for monitoring the front-end server, middleware, storage and other systems of the application software, 007 is load monitoring for monitoring the network load equipment of the application software and the flow condition of each server, and exactly, if rolling upgrade is adopted in the upgrade process, the network load equipment and part of servers are bound to bear larger flow impact. The detailed description is as follows:
001 is a management and control module, which registers environment information such as an application software server to the 002 registration cluster, generates indexes such as a QPS and a response time for refining traffic, and uses the indexes to subsequently generate a task script. 002 is a registered cluster, which is used for dynamically managing environment information such as application software servers and the like, and can ensure the health and availability of the application software environment. And 003, a task module, configured to generate a corresponding analog flow task script according to the index information output by 001. Thetraffic initiating module 004 acquires environment information such as an application software server from the 002, and then acquires a simulation traffic task script from the 003 to execute the task script. 005 is a flow monitoring module, which is used to monitor the change of the analog flow when the application software is installed and upgraded, where the analog flow refers to the whole flow. And 006 is a system monitoring module, which is used for monitoring the system performance of nodes such as a front-end server, middleware, storage and the like when the application software is installed and upgraded. 007 is a load monitoring module, which is used to monitor the performance consumption of the network load device when the application software is installed and upgraded, and a traffic module of each server of the application software, to be precise, when the application software is updated in a rolling manner, after the original traffic inevitably passes through the load, the traffic is distributed to the servers that are not upgraded, and this module can monitor the load condition of the traffic.
The non-stop system drilling verification method and the device provided by the invention can be used for performing production drilling under the condition of simulating production flow, so that the drilling result is more suitable for the actual production condition; the service capability reduction condition caused by the upgrading of the application software can be evaluated, and the production time and the production window can be conveniently confirmed; whether system resources have bottlenecks caused by application software upgrading or not, if the system resources have bottlenecks, capacity can be expanded in time; and whether the application software is upgraded to cause load imbalance and whether the network equipment and each server can bear increased flow is beneficial to guiding the smooth production.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method when executing the computer program.
The present invention also provides a computer-readable storage medium storing a computer program for executing the above method.
As shown in fig. 5, theelectronic device 600 may further include:communication module 110,input unit 120,audio processing unit 130,display 160,power supply 170. It is noted that theelectronic device 600 does not necessarily include all of the components shown in fig. 5; furthermore, theelectronic device 600 may also comprise components not shown in fig. 5, which may be referred to in the prior art.
As shown in fig. 5, thecentral processor 100, sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, thecentral processor 100 receiving input and controlling the operation of the various components of theelectronic device 600.
Thememory 140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And thecentral processing unit 100 may execute the program stored in thememory 140 to realize information storage or processing, etc.
Theinput unit 120 provides input to thecpu 100. Theinput unit 120 is, for example, a key or a touch input device. Thepower supply 170 is used to provide power to theelectronic device 600. Thedisplay 160 is used to display an object to be displayed, such as an image or a character. The display may be, for example, an LCD display, but is not limited thereto.
Thememory 140 may be a solid state memory such as Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. Thememory 140 may also be some other type of device.Memory 140 includes buffer memory 141 (sometimes referred to as a buffer). Thememory 140 may include an application/function storage section 142, and the application/function storage section 142 is used to store application programs and function programs or a flow for executing the operation of theelectronic device 600 by thecentral processing unit 100.
Thememory 140 may also include adata store 143, thedata store 143 for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by the electronic device. Thedriver storage portion 144 of thememory 140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging application, address book application, etc.).
Thecommunication module 110 is a transmitter/receiver 110 that transmits and receives signals via anantenna 111. The communication module (transmitter/receiver) 110 is coupled to thecentral processor 100 to provide an input signal and receive an output signal, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality ofcommunication modules 110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 110 is also coupled to aspeaker 131 and amicrophone 132 via anaudio processor 130 to provide audio output via thespeaker 131 and receive audio input from themicrophone 132 to implement general telecommunications functions.Audio processor 130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, anaudio processor 130 is also coupled to thecentral processor 100, so that recording on the local can be enabled through amicrophone 132, and so that sound stored on the local can be played through aspeaker 131.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (10)

Translated fromChinese
1.一种不停机系统演练验证方法,其特征在于,所述方法包含:1. a non-stop system drill verification method, is characterized in that, described method comprises:获取应用的服务器信息和生产流量指标,根据所述服务器信息生成应用的环境信息,以及根据所述生产流量指标生成流量模拟任务;Obtain application server information and production flow indicators, generate application environment information according to the server information, and generate a flow simulation task according to the production flow indicators;根据所述环境信息和所述流量模拟任务对应用发起背景模拟流量,并进行应用升级安装;Initiate background simulated traffic to the application according to the environment information and the traffic simulation task, and perform application upgrade and installation;监控应用的入口流量、服务器的性能参数和服务器关联设备的负载情况;Monitor the ingress traffic of the application, the performance parameters of the server and the load of the equipment associated with the server;通过所述入口流量、所述性能参数和所述负载情况获得应用的投产演练结果。The application commissioning exercise result is obtained through the inlet flow, the performance parameter and the load condition.2.根据权利要求1所述的不停机系统演练验证方法,其特征在于,根据所述生产流量指标生成流量模拟任务包含:将所述生产流量指标转化为查询率指标和响应时间指标,根据所述查询率指标和所述响应时间指标生成流量模拟任务。2. The non-stop system drill verification method according to claim 1, wherein generating a flow simulation task according to the production flow index comprises: converting the production flow index into a query rate index and a response time index, according to the production flow index. The query rate indicator and the response time indicator generate a traffic simulation task.3.根据权利要求1所述的不停机系统演练验证方法,其特征在于,监控应用的入口流量、服务器的性能参数和服务器关联设备的负载情况还包含:3. The non-stop system drill verification method according to claim 1, characterized in that, monitoring the ingress flow of the application, the performance parameter of the server and the load situation of the server-related equipment also include:根据所述环境信息获取所述应用的历史访问流量数据;Acquire historical access traffic data of the application according to the environmental information;比较所述背景模拟流量和所述历史访问流量数据,当两者之间差值小于预设差值阈值时,监控应用的入口流量、服务器的性能参数和服务器关联设备的负载情况。Compare the background simulated traffic and the historical access traffic data, and when the difference between the two is less than a preset difference threshold, monitor the ingress traffic of the application, the performance parameters of the server, and the load of the server-related equipment.4.根据权利要求1所述的不停机系统演练验证方法,其特征在于,监控服务器的性能参数包含:4. non-stop system drill verification method according to claim 1, is characterized in that, the performance parameter of monitoring server comprises:通过普罗米修斯监控体系采集所述服务器的性能参数,将所述性能参数和所述服务器的标识信息关联后按时间顺序存储至预定时序数据库。The performance parameters of the server are collected through the Prometheus monitoring system, and the performance parameters are associated with the identification information of the server and stored in a predetermined time series database in chronological order.5.根据权利要求1所述的不停机系统演练验证方法,其特征在于,所述性能参数包含内存使用比例、CPU使用比例、系数磁盘处理效率;所述入口流量包含交易成功流量和交易失败流量;所述负载情况包含分布式架构服务器中各网络设备的访问流量及负载。5. The non-stop system exercise verification method according to claim 1, wherein the performance parameters comprise memory usage ratio, CPU usage ratio, and coefficient disk processing efficiency; and the ingress traffic comprises transaction success flow and transaction failure flow ; The load situation includes the access traffic and load of each network device in the distributed architecture server.6.根据权利要求1所述的不停机系统演练验证方法,其特征在于,通过所述入口流量、所述性能参数和所述负载情况获得应用的投产演练结果还包含:6. The non-stop system drill verification method according to claim 1, characterized in that, obtaining the production drill result of the application through the ingress flow, the performance parameter and the load condition further comprises:将所述投产演练结果中所述入口流量、所述性能参数和所述负载情况分别与预定告警阈值比较,当所述入口流量、所述性能参数和所述负载情况中任一数据符合预定告警条件时生成告警信号;Comparing the ingress flow, the performance parameter, and the load condition in the production-commissioning exercise result with a predetermined alarm threshold, respectively, when any data in the ingress flow, the performance parameter, and the load condition conforms to a predetermined alarm Generate an alarm signal when conditions are met;将所述告警信号提供至预定位置。The warning signal is provided to a predetermined location.7.一种不停机系统演练验证装置,其特征在于,所述装置包含模拟流量模块和监控模块;7. A non-stop system drill and verification device, characterized in that the device comprises an analog flow module and a monitoring module;所述模拟流量模块用于获取应用的服务器信息和生产流量指标,根据所述服务器信息生成应用的环境信息,以及根据所述生产流量指标生成流量模拟任务;根据所述环境信息和所述流量模拟任务对应用发起背景模拟流量,并进行应用升级安装;The simulated traffic module is used to obtain application server information and production traffic indicators, generate application environment information according to the server information, and generate traffic simulation tasks according to the production traffic indicators; The task initiates background simulation traffic to the application, and upgrades and installs the application;所述监控模块用于监控应用的入口流量、服务器的性能参数和服务器关联设备的负载情况;通过所述入口流量、所述性能参数和所述负载情况获得应用的投产演练结果。The monitoring module is used to monitor the ingress traffic of the application, the performance parameters of the server and the load situation of the equipment associated with the server; and obtain the production exercise result of the application through the ingress traffic, the performance parameter and the load situation.8.根据权利要求7所述的不停机系统演练验证装置,其特征在于,所述模拟流量模块还包含根据所述环境信息获取所述应用的历史访问流量数据;比较所述背景模拟流量和所述历史访问流量数据,当两者之间差值小于预设差值阈值时,监控应用的入口流量、服务器的性能参数和服务器关联设备的负载情况。8 . The non-stop system exercise verification device according to claim 7 , wherein the simulated traffic module further comprises obtaining historical access traffic data of the application according to the environmental information; comparing the background simulated traffic with all When the difference between the two is less than the preset difference threshold, the ingress traffic of the application, the performance parameters of the server, and the load of the device associated with the server are monitored.9.一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至6任一所述方法。9. An electronic device comprising a memory, a processor and a computer program stored on the memory and running on the processor, wherein the processor implements any one of claims 1 to 6 when the processor executes the computer program the method.10.一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有由计算机执行权利要求1至6任一所述方法的计算机程序。10. A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for executing any one of the methods of claims 1 to 6 by a computer.
CN202110655049.0A2021-06-112021-06-11 Non-stop system drill verification method and deviceActiveCN113377399B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202110655049.0ACN113377399B (en)2021-06-112021-06-11 Non-stop system drill verification method and device

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202110655049.0ACN113377399B (en)2021-06-112021-06-11 Non-stop system drill verification method and device

Publications (2)

Publication NumberPublication Date
CN113377399Atrue CN113377399A (en)2021-09-10
CN113377399B CN113377399B (en)2025-06-13

Family

ID=77574095

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202110655049.0AActiveCN113377399B (en)2021-06-112021-06-11 Non-stop system drill verification method and device

Country Status (1)

CountryLink
CN (1)CN113377399B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN114070625A (en)*2021-11-162022-02-18北京华云安信息技术有限公司Analog flow generation method, device, equipment and storage medium
CN114546655A (en)*2022-02-252022-05-27中国工商银行股份有限公司Application program performance capacity evaluation method, dynamic capacity expansion method and device
WO2025066710A1 (en)*2023-09-282025-04-03中国电信股份有限公司技术创新中心Method and apparatus for acquiring node performance data, and computer device and storage medium

Citations (11)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20160246467A1 (en)*2015-02-252016-08-25Salesforce.Com, Inc.Automatically generating a walkthrough of an application or an online service
US20170109393A1 (en)*2015-10-162017-04-20Salesforce.Com, Inc.Automatically matching start criteria and completion criteria of a walkthrough for an application or online service
CN108681461A (en)*2018-05-072018-10-19广东电网有限责任公司A kind of clustered software system does not shut down newer method, system and relevant apparatus
CN110309955A (en)*2019-06-132019-10-08南瑞集团有限公司 A load prediction method and device for non-stop upgrade of cloud environment application system
CN111274117A (en)*2018-12-042020-06-12阿里巴巴集团控股有限公司 Experiment of recommendation service and management method, device and system thereof
CN111294333A (en)*2020-01-142020-06-16中国传媒大学Construction system of open type adaptive vulnerability drilling platform
CN111355611A (en)*2020-02-262020-06-30北京字节跳动网络技术有限公司Plan drilling method and device and computer readable storage medium
CN112256301A (en)*2020-10-192021-01-22平安科技(深圳)有限公司 Application online upgrade method, apparatus, device and computer-readable storage medium
CN112559012A (en)*2020-12-232021-03-26平安银行股份有限公司System upgrading and testing method and device, computer equipment and readable storage medium
CN112612495A (en)*2020-12-252021-04-06深圳市科力锐科技有限公司Upgrade protection method, device, equipment and storage medium
CN112667271A (en)*2020-12-282021-04-16深圳供电局有限公司 Software upgrade method, apparatus, device, system and storage medium

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20160246467A1 (en)*2015-02-252016-08-25Salesforce.Com, Inc.Automatically generating a walkthrough of an application or an online service
US20170109393A1 (en)*2015-10-162017-04-20Salesforce.Com, Inc.Automatically matching start criteria and completion criteria of a walkthrough for an application or online service
CN108681461A (en)*2018-05-072018-10-19广东电网有限责任公司A kind of clustered software system does not shut down newer method, system and relevant apparatus
CN111274117A (en)*2018-12-042020-06-12阿里巴巴集团控股有限公司 Experiment of recommendation service and management method, device and system thereof
CN110309955A (en)*2019-06-132019-10-08南瑞集团有限公司 A load prediction method and device for non-stop upgrade of cloud environment application system
CN111294333A (en)*2020-01-142020-06-16中国传媒大学Construction system of open type adaptive vulnerability drilling platform
CN111355611A (en)*2020-02-262020-06-30北京字节跳动网络技术有限公司Plan drilling method and device and computer readable storage medium
CN112256301A (en)*2020-10-192021-01-22平安科技(深圳)有限公司 Application online upgrade method, apparatus, device and computer-readable storage medium
CN112559012A (en)*2020-12-232021-03-26平安银行股份有限公司System upgrading and testing method and device, computer equipment and readable storage medium
CN112612495A (en)*2020-12-252021-04-06深圳市科力锐科技有限公司Upgrade protection method, device, equipment and storage medium
CN112667271A (en)*2020-12-282021-04-16深圳供电局有限公司 Software upgrade method, apparatus, device, system and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
阿里云云栖号: "复杂系统如何在不停机升级同时保持稳定?你必须考虑以下几个点...", Retrieved from the Internet <URL:《https://zhuanlan.zhihu.com/p/262123006》>*

Cited By (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN114070625A (en)*2021-11-162022-02-18北京华云安信息技术有限公司Analog flow generation method, device, equipment and storage medium
CN114546655A (en)*2022-02-252022-05-27中国工商银行股份有限公司Application program performance capacity evaluation method, dynamic capacity expansion method and device
WO2025066710A1 (en)*2023-09-282025-04-03中国电信股份有限公司技术创新中心Method and apparatus for acquiring node performance data, and computer device and storage medium

Also Published As

Publication numberPublication date
CN113377399B (en)2025-06-13

Similar Documents

PublicationPublication DateTitle
CN113377399A (en)Non-stop system drilling verification method and device
US8079018B2 (en)Test impact feedback system for software developers
CN108399114B (en)System performance testing method and device and storage medium
US10474563B1 (en)System testing from production transactions
US8745590B2 (en)Testing an application
CN103336696B (en)The Oftware updating method of test instrunment and system
US20160283356A1 (en)Event-driven automation testing for mobile devices
CN106201552A (en)A kind of method for upgrading software, client, server and system
CN109995614B (en)Alpha testing method and device
KR20210055560A (en)Apparatus and Method for Managing Performance about Artificial Intelligent Service
CN112650688A (en)Automated regression testing method, associated device and computer program product
CN102681942A (en)Testing method and system of mobile application
CN107220169B (en)Method and equipment for simulating server to return customized data
CN113742226B (en)Software performance test method and device, medium and electronic equipment
CN113377637A (en)Performance capacity diagnostic method and device
CN106341244A (en)Method and system for updating configuration file, client and server
CN114338443B (en)CDN node full link monitoring method and device
CN111930625A (en)Log obtaining method, device and system based on cloud service platform
CN112181784A (en)Code fault analysis method and system based on bytecode injection
CN112134961B (en)Client use control method, client and computer storage medium
KR101792864B1 (en)System and Method for verifying application
CN112703485A (en)Supporting experimental assessment of modifications to computing environments within a distributed system using machine learning methods
RU2532714C2 (en)Method of acquiring data when evaluating network resources and apparatus therefor
CN112882948A (en)Stability testing method, device and system for application and storage medium
CN109413663B (en)Information processing method and equipment

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp