CN110109686B - Application operation and maintenance method and system based on container management engine - Google Patents

Abstract

Translated fromChinese

一种基于容器管理引擎的应用运维方法，该方法包括以下步骤：构建微服务镜像；以容器形式规划、编排应用服务架构，形成应用蓝图；对应用蓝图进行部署，并形成以应用为维度的实例；配置应用/服务的健康检查方式；配置应用/服务的告警策略；运维人员收到告警消息后，根据消息提示，采取相应的运维方式处理。

An application operation and maintenance method based on a container management engine. The method includes the following steps: constructing a microservice image; planning and arranging an application service architecture in the form of a container to form an application blueprint; deploying the application blueprint and forming an application-oriented Example; configure the health check method of the application/service; configure the alarm policy of the application/service; after the operation and maintenance personnel receive the alarm message, they will take the corresponding operation and maintenance method according to the message prompt.

Description

Translated fromChinese

一种基于容器管理引擎的应用运维方法和系统Application operation and maintenance method and system based on container management engine

技术领域technical field

本发明属于软件运维技术领域，特别涉及一种基于容器管理引擎的应用运维方法和系统。The invention belongs to the technical field of software operation and maintenance, and in particular relates to an application operation and maintenance method and system based on a container management engine.

背景技术Background technique

在当今的Web和移动应用开发过程中，开发者倾向于基于服务去构建应用程序，而不是从车轮造起。一般情况下，这些服务称之为微服务——单用途，API可访问的应用变成了构建大型应用的基石。“微服务”架构是近期软件应用领域非常热门的概念，可以大幅度改善传统应用开发遇到的一些典型问题。例如，使用传统的整体式架构(MonolithicArchitecture)应用开发系统，如CRM、ERP等大型应用，随着新需求的不断增加，企业更新和修复大型整体式应用变得越来越困难。随着移动互联网的发展，企业被迫将其应用迁移至现代化UI界面架构以便能兼容移动设备，这要求企业能实现应用功能的快速上线。In today's web and mobile application development process, developers tend to build applications based on services rather than from wheels. Typically, these services are called microservices—single-purpose, API-accessible applications that become building blocks for larger applications. The "microservice" architecture is a very popular concept in the recent software application field, which can greatly improve some typical problems encountered in traditional application development. For example, using the traditional monolithic architecture (Monolithic Architecture) application development system, such as CRM, ERP and other large applications, with the continuous increase of new requirements, it becomes more and more difficult for enterprises to update and repair large monolithic applications. With the development of the mobile Internet, enterprises are forced to migrate their applications to a modern UI interface architecture to be compatible with mobile devices, which requires enterprises to quickly launch application functions.

基于这种需求，越来越多的企业和行业的复杂系统的构建模式逐渐从传统的单体应用向微服务架构开始改变。这种改变带来的直接后果就是行业业务将从由几个相对独立的大型单体应用构成转变为由大量的相互有关联的微应用构成。这种模式将有力的改善行业业务系统的更新发展方式，推动行业业务应用以互联网的方式以迭代滚动的爆发式增长。这也将为行业业务带来无尽的活力。现在正在逐渐变为热点的DevOps相关的一系列技术以及基于云平台的应用自动化部署和发布等能力的大幅度发展都将有力的推动这一进程。Based on this demand, more and more enterprises and industries have started to change the construction mode of complex systems from traditional monolithic applications to microservice architectures. The direct consequence of this change is that the business of the industry will change from being composed of several relatively independent large-scale single applications to being composed of a large number of interrelated micro-applications. This model will effectively improve the update and development method of the industry business system, and promote the explosive growth of industry business applications in the form of the Internet. This will also bring endless vitality to the industry business. A series of technologies related to DevOps, which are gradually becoming hot spots, and the substantial development of cloud-based application automation deployment and release capabilities will strongly promote this process.

但是这种行业业务系统由大量微应用构成的方式也为系统的运维带来了新的挑战。应用的增加所带来了的运维复杂度将会对运维团队带来巨大的挑战，如何能够使运维团队方便快捷地定位问题、升级应用、并修复问题是目前需要解决的问题。However, the way that this industry business system is composed of a large number of micro-applications also brings new challenges to the operation and maintenance of the system. The complexity of operation and maintenance brought about by the increase of applications will bring huge challenges to the operation and maintenance team. How to enable the operation and maintenance team to locate problems, upgrade applications, and repair problems conveniently and quickly is a problem that needs to be solved at present.

发明内容Contents of the invention

本发明提供一种基于容器管理引擎的应用运维方法和系统，目的在于解决运维团队对微服务架构体系应用的运维问题。The present invention provides an application operation and maintenance method and system based on a container management engine, with the purpose of solving the operation and maintenance problem of the operation and maintenance team on the application of the microservice architecture system.

本发明实施例之一，一种基于容器管理引擎的应用运维方法，该方法包括以下步骤：One of the embodiments of the present invention is an application operation and maintenance method based on a container management engine, the method comprising the following steps:

构建微服务镜像；Build a microservice image;

以容器形式规划、编排应用服务架构，形成应用蓝图；Plan and orchestrate the application service architecture in the form of containers to form an application blueprint;

对应用蓝图进行部署，并形成以应用为维度的实例；Deploy the application blueprint and form an instance with the application as the dimension;

配置应用/服务的健康检查方式；Configure the health check method of the application/service;

配置应用/服务的告警策略；Configure the alarm policy of the application/service;

运维人员收到告警消息后，根据消息提示，采取相应的运维方式处理。After receiving the alarm message, the operation and maintenance personnel will take corresponding operation and maintenance methods to deal with it according to the message prompt.

本发明针对应用通过微服务方式改造后，微服务过多及结构复杂所带来的运维难题，从各个维度去分析环境和应用的健康状态，包含计算节点、应用所包含的微服务、构成微服务的容器等，通过设置告警策略、站内信等方式通知运维人员，进行运维操作。本发明提出一种以应用蓝图编排，并以应用实例为中心的运维管理，能够通过告警策略和消息通知等形式通知运维人员，并提供一套针对应用/服务/容器的生命周期管理操作来完成应用的运维，达到应用运维的自动化和结构清晰的应用架构体系管理。The present invention aims at the operation and maintenance problems caused by too many microservices and complex structures after the application is transformed through microservices, and analyzes the health status of the environment and applications from various dimensions, including computing nodes, microservices contained in applications, composition Microservice containers, etc., notify the operation and maintenance personnel by setting alarm policies, station messages, etc., to perform operation and maintenance operations. The present invention proposes an application blueprint layout and application instance-centered operation and maintenance management, which can notify the operation and maintenance personnel through alarm policies and message notifications, and provide a set of life cycle management operations for applications/services/containers To complete the operation and maintenance of the application, to achieve the automation of application operation and maintenance and the management of the application architecture system with a clear structure.

附图说明Description of drawings

通过参考附图阅读下文的详细描述，本发明示例性实施方式的上述以及其他目的、特征和优点将变得易于理解。在附图中，以示例性而非限制性的方式示出了本发明的若干实施方式，其中：The above and other objects, features and advantages of exemplary embodiments of the present invention will become readily understood by reading the following detailed description with reference to the accompanying drawings. In the drawings, several embodiments of the invention are shown by way of illustration and not limitation, in which:

图1根据本发明实施例之一的运维管理功能结构图。FIG. 1 is a functional structure diagram of operation and maintenance management according to one embodiment of the present invention.

具体实施方式Detailed ways

根据一个或者多个实施例之一，如图1所示，以功能模块构成的形式描述了构成本专利方法提到的运维架构体系，可以通过附图中的功能模块实现一套完整的软件运维系统。According to one or more embodiments, as shown in Figure 1, the operation and maintenance architecture system mentioned in the patent method is described in the form of functional modules, and a complete set of software can be realized through the functional modules in the accompanying drawings Operation and maintenance system.

镜像管理，通过调用镜像构建服务器将应用程序包生成容器镜像，并储存在镜像仓库内。Image management, by calling the image build server to generate a container image from the application package, and store it in the image warehouse.

编排管理，将构成应用架构的服务进行架构编配，配置相互之间的引用关系，并设置好访问入口、环境变量及告警策略和弹性伸缩策略等。Arrangement management, arrange the services that constitute the application architecture, configure the reference relationship between them, and set the access entry, environment variables, alarm policies, and elastic scaling policies.

应用管理，负责将编排好的应用架构，通过调用容器管理引擎服务器提供的API，将应用服务以容器的形式部署在容器管理引擎计算节点中。Application management is responsible for deploying the orchestrated application architecture and deploying application services in the container management engine computing nodes in the form of containers by calling the API provided by the container management engine server.

应用运维，负责提供应用的迭代升级，状态查看等。Application operation and maintenance, responsible for providing iterative upgrades of applications, status viewing, etc.

监控告警，负责将应用的运行状态以消息或邮件的形式反馈给用户或运维人员。Monitor alarms, responsible for feeding back the running status of the application to users or operation and maintenance personnel in the form of messages or emails.

容器管理引擎，提供了面向应用的容器集群部署和管理系统。The container management engine provides an application-oriented container cluster deployment and management system.

一种基于容器管理引擎的应用运维方法，包括如下步骤：An application operation and maintenance method based on a container management engine, comprising the following steps:

(1)制作组成应用的微服务镜像。(1) Make microservice images that make up the application.

用户可以通过持续集成的方式制作构成微服务的容器镜像，持续集成的起点可以是完成编译构建的具体的应用运行程序包(如java应用的war包和jar包)，也可以是从代码库的源代码开始，提供Dockerfile的构建输入，通过镜像构建服务器完成容器镜像的构建。Users can make container images that constitute microservices through continuous integration. The starting point of continuous integration can be the specific application running package (such as the war package and jar package of the java application) that has been compiled and built, or it can be from the code base Start with the source code, provide the build input of the Dockerfile, and complete the construction of the container image through the image build server.

(2)按应用的组织架构，编排微服务镜像。(2) Arrange microservice images according to the organizational structure of the application.

按照应用的组织架构依赖方式，编排服务，构成服务的主体是题哦你通过持续集成方式生成的容器镜像，并对镜像提供了镜像运行所需要的环境变量、配置文件、端口映射和访问入口等依赖；通过对构成应用的所有服务进行配置，最终生成容器部署引擎能够识别的编排文件(如kubernetes能够失败的yaml和json文件)。According to the organizational structure dependency of the application, arrange the service and form the main body of the service. You generate the container image through continuous integration, and provide the image with the environment variables, configuration files, port mapping and access entry required for the image to run. Dependency; by configuring all the services that make up the application, an orchestration file that the container deployment engine can recognize (such as yaml and json files that kubernetes can fail) is finally generated.

(3)配置微服务的健康检查方式、告警策略以及弹性伸缩条件。(3) Configure the health check method, alarm policy and elastic scaling conditions of microservices.

应用的构建过程中，我们可以利用容器管理引擎提供的健康检查的探针，以及服务资源的使用率的监控，并通过回调函数的方式提供告警通知功能；甚至还可以通过对资源使用率的监控，利用容器管理引擎的弹性伸缩功能，完成弹性伸缩的配置。最终以容器部署引擎能识别的编排文件进行部署。During the construction of the application, we can use the health check probes provided by the container management engine and monitor the usage of service resources, and provide alarm notification functions through callback functions; we can even monitor resource usage , use the auto-scaling function of the container management engine to complete the auto-scaling configuration. Finally, it is deployed with an orchestration file that the container deployment engine can recognize.

(4)通过容器部署引擎，部署由微服务构建的应用。(4) Deploy applications built by microservices through the container deployment engine.

通过容器部署引擎提供的API，部署通过应用编排步骤生成的编排文件，生成容器部署引擎管理的资源信息，其中包含配置文件、访问入口、存储资源、容器container及弹性伸缩和告警策略的监控资源。Through the API provided by the container deployment engine, deploy the orchestration files generated through the application orchestration steps, and generate resource information managed by the container deployment engine, including configuration files, access entries, storage resources, container containers, and monitoring resources for elastic scaling and alarm policies.

(5)通过告警消息及监控报警，定位应用的健康状况。(5) Locate the health status of the application through alarm messages and monitoring alarms.

运维人员通过接受容器部署引擎配置的回调的告警通知得知应用及服务的运行状态，及存在的问题，进而很好的定位整个环境的问题所在。The operation and maintenance personnel can know the running status of the application and service and the existing problems by receiving the alarm notification of the callback configured by the container deployment engine, so as to locate the problem of the whole environment well.

(6)通过调整微服务资源及负载来修复应用的告警状况。(6) Repair the alarm status of the application by adjusting the microservice resources and load.

运维人员在对告警监控信息进行分析后，确定是否是微服的配置存在问题、是否是资源利用的问题及部署管理引擎的计算节点等问题，再通过调整配置、增加资源或恢复计算节点等方式来修复应用。After analyzing the alarm monitoring information, the operation and maintenance personnel determine whether there is a problem with the configuration of the microservice, whether it is a problem with resource utilization, or a problem with the computing node where the management engine is deployed, and then adjust the configuration, increase resources, or restore the computing node. to repair the application.

(7)通过升级手动完成应用的迭代更新。(7) Manually complete the iterative update of the application by upgrading.

用户可以通过持续集成构建的镜像版本，选择不同的升级方式进行迭代更新升级(含有滚动升级、蓝绿升级和灰度升级)。Users can choose different upgrade methods to iteratively update and upgrade (including rolling upgrade, blue-green upgrade, and grayscale upgrade) through the image version built by continuous integration.

根据一个或者多个实施例之一，如图1所示，一种基于容器管理引擎的应用运维系统，该系统包括镜像管理模块、编排管理模块、应用管理模块、应用运维模块，还包括According to one or more embodiments, as shown in Figure 1, an application operation and maintenance system based on a container management engine, the system includes a mirror management module, an orchestration management module, an application management module, an application operation and maintenance module, and also includes

镜像构建服务器及镜像仓库，与镜像管理模块连接，Mirror build server and mirror warehouse, connected with mirror management module,

容器管理引擎控制节点，包括负责维护集群状态的控制器、负责资源调度的编排器、API服务器和数据库，API服务器连接镜像管理模块、编排管理模块、应用管理模块和应用运维模块，The container management engine control node, including the controller responsible for maintaining the cluster state, the orchestrator responsible for resource scheduling, API server and database, the API server is connected to the mirror management module, orchestration management module, application management module and application operation and maintenance module,

监控告警管理模块与API服务器连接，The monitoring and alarm management module is connected to the API server,

容器管理引擎计算节点资源池包括多个计算节点，每个计算节点包括容器管理引擎客户端，容器管理引擎客户端与API服务器相连。The container management engine computing node resource pool includes multiple computing nodes, each computing node includes a container management engine client, and the container management engine client is connected to the API server.

在本申请所提供的几个实施例中，应该理解到，所揭露的系统、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另外，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口、装置或单元的间接耦合或通信连接，也可以是电的，机械的或其它的形式连接。In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may also be electrical, mechanical or other forms of connection.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本发明实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.

所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分，或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-OnlyMemory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of software products, and the computer software products are stored in a storage medium In, several instructions are included to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and other media that can store program codes.

以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以权利要求的保护范围为准。The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person familiar with the technical field can easily think of various equivalents within the technical scope disclosed in the present invention. Modifications or replacements shall all fall within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (1)

Translated fromChinese

1.一种基于容器管理引擎的应用运维系统，其特征在于，该系统包括，1. An application operation and maintenance system based on a container management engine, characterized in that the system includes,镜像管理模块，通过调用镜像构建服务器将应用程序包生成容器镜像，并储存在镜像仓库内，The image management module generates a container image from the application package by calling the image construction server, and stores it in the image warehouse.编排管理模块，将构成应用架构的服务进行架构编配，配置相互之间的引用关系，并设置好访问入口、环境变量及告警策略和弹性伸缩策略，The orchestration management module arranges the services that constitute the application architecture, configures the mutual reference relationship, and sets the access entry, environment variables, alarm policies and elastic scaling policies.应用管理模块，负责将编排好的应用架构，通过调用容器管理引擎服务器提供的API，将应用服务以容器的形式部署在容器管理引擎计算节点中，The application management module is responsible for deploying the orchestrated application architecture in the computing node of the container management engine in the form of a container by calling the API provided by the container management engine server.应用运维模块，负责提供应用的迭代升级，状态查看，The application operation and maintenance module is responsible for providing iterative upgrades of applications, status viewing,监控告警模块，负责将应用的运行状态以消息或邮件的形式反馈给用户或运维人员，The monitoring alarm module is responsible for feeding back the running status of the application to users or operation and maintenance personnel in the form of messages or emails.容器管理引擎，提供了面向应用的容器集群部署和管理系统，镜像构建服务器及镜像仓库，与镜像管理模块连接，The container management engine provides an application-oriented container cluster deployment and management system, mirror build server and mirror warehouse, and connects with the mirror management module.容器管理引擎控制节点，包括负责维护集群状态的控制器、负责资源调度的编排器、API服务器和数据库，API服务器连接镜像管理模块、编排管理模块、应用管理模块和应用运维模块，监控告警管理模块与API服务器连接，The container management engine control node, including the controller responsible for maintaining the cluster state, the orchestrator responsible for resource scheduling, API server and database, the API server is connected to the mirror management module, orchestration management module, application management module and application operation and maintenance module, monitoring alarm management The module connects with the API server,容器管理引擎计算节点资源池包括多个计算节点，每个计算节点包括容器管理引擎客户端，容器管理引擎客户端与API服务器相连，The container management engine computing node resource pool includes multiple computing nodes, each computing node includes a container management engine client, and the container management engine client is connected to the API server.该运维系统的运维方法，包括以下步骤：The operation and maintenance method of the operation and maintenance system includes the following steps:构建微服务镜像；Build a microservice image;以容器形式规划、编排应用服务架构，形成应用蓝图；Plan and orchestrate the application service architecture in the form of containers to form an application blueprint;对应用蓝图进行部署，并形成以应用为维度的实例；Deploy the application blueprint and form an instance with the application as the dimension;配置应用/服务的健康检查方式；Configure the health check method of the application/service;配置应用/服务的告警策略；Configure the alarm policy of the application/service;运维人员收到告警消息后，根据消息提示，采取相应的运维方式处理，After the operation and maintenance personnel receive the alarm message, they will take the corresponding operation and maintenance method to deal with it according to the message prompt.所述运维方法，还包括，The operation and maintenance method also includes,通过持续集成的方式制作组成应用的微服务容器镜像，持续集成的起点包括完成编译构建的应用运行程序包，以及代码库的源代码，提供Dockerfile的构建输入，通过镜像构建服务器完成容器镜像的构建；Make the microservice container images that make up the application through continuous integration. The starting point of continuous integration includes the application running package that has been compiled and built, as well as the source code of the code library, provide the build input of the Dockerfile, and complete the construction of the container image through the image build server ;按应用的组织架构，编排微服务镜像，构成服务的主体是通过持续集成方式生成的容器镜像，并对镜像提供镜像运行所需要的环境变量、配置文件、端口映射和访问入口；通过对构成应用的所有服务进行配置，最终生成容器部署引擎能够识别的编排文件；According to the organizational structure of the application, the microservice image is arranged. The main body of the service is the container image generated by the continuous integration method, and the environment variable, configuration file, port mapping and access entry required for the image operation are provided for the image; through the composition of the application Configure all the services of the container, and finally generate an orchestration file that the container deployment engine can recognize;配置微服务的健康检查方式、告警策略以及弹性伸缩条件，利用容器管理引擎提供的健康检查的探针，以及服务资源的使用率的监控，并通过回调函数的方式提供告警通知功能，通过对资源使用率的监控，利用容器管理引擎的弹性伸缩功能，完成弹性伸缩的配置，以容器部署引擎识别的编排文件进行部署；Configure the health check method, alarm policy, and elastic scaling conditions of microservices, use the health check probes provided by the container management engine, and monitor the usage of service resources, and provide alarm notification functions through callback functions. Utilization rate monitoring uses the elastic scaling function of the container management engine to complete the configuration of elastic scaling, and deploys with the orchestration files identified by the container deployment engine;通过容器部署引擎，部署由微服务构建的应用，通过容器部署引擎提供的API，部署通过应用编排步骤生成的编排文件，生成容器部署引擎管理的资源信息，其中包含配置文件、访问入口、存储资源、容器container及弹性伸缩和告警策略的监控资源；Deploy applications built by microservices through the container deployment engine, deploy the orchestration files generated through the application orchestration steps through the API provided by the container deployment engine, and generate resource information managed by the container deployment engine, including configuration files, access entries, and storage resources. , container container and monitoring resources for elastic scaling and alarm policies;通过告警消息及监控报警，定位应用的健康状况，通过接受容器部署引擎配置的回调的告警通知得知应用及服务的运行状态，及存在的问题，进而定位整个环境的问题所在；Locate the health status of the application through alarm messages and monitoring alarms, and learn the running status and existing problems of applications and services by accepting the callback alarm notification configured by the container deployment engine, and then locate the problems of the entire environment;通过调整微服务资源及负载来修复应用的告警状况，在对告警监控信息进行分析后，确定是否是微服的配置存在问题、是否是资源利用的问题及部署管理引擎的计算节点等问题，再通过调整配置、增加资源或恢复计算节点方式来修复应用；Repair the alarm status of the application by adjusting the microservice resources and load. After analyzing the alarm monitoring information, determine whether there is a problem with the configuration of the microservice, whether it is a resource utilization problem, or a problem with the computing node deployment management engine. Adjust configuration, increase resources or restore computing nodes to repair applications;通过升级手动完成应用的迭代更新，通过持续集成构建的镜像版本，选择不同的升级方式进行迭代更新升级。The iterative update of the application is completed manually through the upgrade, and the image version built through continuous integration is selected to perform iterative update and upgrade through different upgrade methods.

Images