技术领域Technical field
本发明涉及企业管理技术领域，尤其是一种管理企业内部elasticsearch集群的自动化管理系统。The invention relates to the technical field of enterprise management, and in particular, to an automated management system for managing elastic search clusters within an enterprise.
背景技术Background technique
目前行业中Elasticsearch的管理系统可以帮助管理员监控、管理和维护Elasticsearch集群，它提供了一组工具和功能，使管理员能够执行以下任务：集群监控和健康管理：管理员可以通过管理系统监视整个Elasticsearch集群的状态、性能和健康状况，它提供了实时指标和图形化界面，以便管理员能够识别和解决任何潜在的问题；配置和管理索引：管理员可以使用管理系统来创建、配置和管理Elasticsearch的索引，他们可以定义索引的映射、设置索引的分片和副本、执行索引的优化和维护操作等；数据备份和恢复：管理系统通常提供了备份和恢复数据的功能，以确保在发生故障或数据丢失时能够恢复数据，管理员可以定期备份数据，并在需要时进行恢复操作；安全管理：管理系统提供了对Elasticsearch集群的安全管理功能，包括用户认证、访问控制和权限管理，管理员可以配置用户和角色，并控制谁可以访问集群的哪些资源和操作。The current Elasticsearch management system in the industry can help administrators monitor, manage and maintain Elasticsearch clusters. It provides a set of tools and functions that enable administrators to perform the following tasks: Cluster monitoring and health management: Administrators can monitor the entire Status, performance, and health of the Elasticsearch cluster, which provides real-time metrics and a graphical interface so administrators can identify and resolve any potential issues; Configure and manage indexes: Administrators can use the management system to create, configure, and manage Elasticsearch Indexes, they can define index mapping, set index shards and copies, perform index optimization and maintenance operations, etc.; Data backup and recovery: Management systems usually provide the function of backing up and recovering data to ensure that in the event of a failure or Data can be restored when data is lost. Administrators can back up data regularly and perform recovery operations when needed; security management: The management system provides security management functions for the Elasticsearch cluster, including user authentication, access control and permission management. Administrators can Configure users and roles, and control who can access which resources and operations of the cluster.
但现有技术中，不具备管控整个ES集群生命周期能力，偏重于运维侧人员使用，开发侧人员无法享用管理系统带来的便捷性和效能提升，且不能满足企业内部资源利用率统计和预算计费的需求。因此，针对上述问题提出了一种管理企业内部elasticsearch集群的自动化管理系统。However, the existing technology does not have the ability to control the entire ES cluster life cycle, and focuses on the use of operation and maintenance side personnel. Development side personnel cannot enjoy the convenience and performance improvements brought by the management system, and cannot meet the requirements of internal resource utilization statistics and statistics of the enterprise. Budget billing needs. Therefore, in order to solve the above problems, an automated management system for managing elastic search clusters within enterprises is proposed.
发明内容Contents of the invention
本发明的目的在于提供一种管理企业内部elasticsearch集群的自动化管理系统，主要解决的技术问题是如何进一步解放运维人员，提高运维人员的工作效率。The purpose of the present invention is to provide an automated management system for managing elastic search clusters within an enterprise. The main technical problem to be solved is how to further liberate operation and maintenance personnel and improve the work efficiency of operation and maintenance personnel.
一种管理企业内部elasticsearch集群的自动化管理系统，包括ES集群生命周期管理、指标监控与图形化、告警订阅、索引管理、账号管理、一键分析和通过与CMDB系统、预算系统整合；An automated management system for managing elasticsearch clusters within an enterprise, including ES cluster life cycle management, indicator monitoring and graphics, alarm subscription, index management, account management, one-click analysis and integration with CMDB systems and budget systems;
所述ES集群生命周期管理：通过该功能用户可自动化管理ES集群的整个生命周期，而无需运维干预；也可以根据实际资源需求，动态调整集群的实例个数和资源配置；The ES cluster life cycle management: Through this function, users can automatically manage the entire life cycle of the ES cluster without operation and maintenance intervention; the number of instances and resource configuration of the cluster can also be dynamically adjusted according to actual resource requirements;
所述指标监控与图形化：通过多维度对ES的各项指标分析监控，助力运维人员和开发人员迅速定位集群状况、排查问题和优化集群状态；The above-mentioned indicator monitoring and graphics: through multi-dimensional analysis and monitoring of various indicators of ES, it helps operation and maintenance personnel and developers to quickly locate the cluster status, troubleshoot problems and optimize the cluster status;
所述告警订阅：用户可根据需求或者已有策略，配置告警并订阅，当集群发生异常时获得短信或电话提醒；The alarm subscription: users can configure alarms and subscribe according to needs or existing policies, and receive text messages or phone calls when an abnormality occurs in the cluster;
所述索引管理：通过对ES深度开发，实现了索引元数据近实时抓取；可在该功能模块中进行索引结构查看、修改、关闭；The index management: through in-depth development of ES, near-real-time capture of index metadata is achieved; the index structure can be viewed, modified, and closed in this functional module;
所述账号管理：实现了对ES体系账号的管理，在这个功能模块中，用户可按照索引前缀定义ES账户并授权，授权类型支持只读、只写、all三种；The account management: realizes the management of ES system accounts. In this functional module, users can define ES accounts according to the index prefix and authorize them. The authorization types support read-only, write-only, and all;
所述一键分析：在SRE理念指引下，结合多年ES开发和运维实践经验，一键分析功能可实时结合ES集群状态、网络状况、索引写速率、查询速率、SLA、pending tasks、系统和实例负载、分片满载率、索引Pool、查询Pool、Manage Pool等多个维度诊断集群问题，并给出人性化科学建议；The one-click analysis: Under the guidance of the SRE concept, combined with many years of ES development and operation and maintenance practical experience, the one-click analysis function can combine ES cluster status, network conditions, index write rate, query rate, SLA, pending tasks, system and Diagnose cluster problems from multiple dimensions such as instance load, shard full load rate, index pool, query pool, and manage pool, and provide humanized scientific suggestions;
所述通过与CMDB系统、预算系统整合：使得企业内部各业务线ES资源使用和花销情况一目了然，为指导企业内部开源节流，合理申请和使用资源，提升资源利用率提供了科学的数据依据。Through the integration with the CMDB system and the budget system, the usage and expenditure of ES resources in each business line within the enterprise can be seen at a glance, providing scientific data basis for guiding the enterprise to increase revenue and reduce expenditure, apply for and use resources reasonably, and improve resource utilization.
进一步地，所述ES集群生命周期管理的具体实现方案如下：Further, the specific implementation plan of the ES cluster life cycle management is as follows:
借助工单系统的自定义表单功能，为用户提供了ES自动化创建，销毁，扩容，缩容入口；With the help of the custom form function of the work order system, users are provided with ES automated creation, destruction, expansion, and reduction entrances;
工单审批通过后，会将用户提交的信息提交给ES管理系统进一步处理，ES管理系统获取到工单审批通过的信息后，结合套餐的详细配置和模板文件，会动态生成一个ElasticSearch Operator可运行的yaml文件；After the work order is approved, the information submitted by the user will be submitted to the ES management system for further processing. After the ES management system obtains the information that the work order is approved, it will dynamically generate an ElasticSearch Operator that can be run based on the detailed configuration and template file of the package. yaml file;
ES管理系统将该yaml文件提交给容器管理系统对外暴露的K8S service API，该API接口会把yaml文件提交给ElasticSearch Operator运行；The ES management system submits the yaml file to the K8S service API exposed by the container management system, and the API interface submits the yaml file to the ElasticSearch Operator for running;
ElasticSearch Operator获取到yaml文件后，会根据文件描述，执行集群创建、销毁、扩缩等操作，从而实现ES集群的全生命周期管理。After ElasticSearch Operator obtains the yaml file, it will perform cluster creation, destruction, scaling and other operations according to the file description, thereby realizing the full life cycle management of the ES cluster.
进一步地，指标监控总体分为2部分，一是集群监控和图形化，另一个是实例监控和图形化。Furthermore, indicator monitoring is generally divided into two parts, one is cluster monitoring and graphics, and the other is instance monitoring and graphics.
进一步地，所述集群监控和图形化包括集群状态监控、JVM监控、CPU监控、查询监控、写入耗时监控、GC监控、pending tasks监控和分片监控。Further, the cluster monitoring and graphics include cluster status monitoring, JVM monitoring, CPU monitoring, query monitoring, writing time-consuming monitoring, GC monitoring, pending tasks monitoring and sharding monitoring.
进一步地，所述实例监控和图形化包括实例的JVM监控、CPU监控、查询耗时监控、query查询速率监控、index写入速率监控、GC次数监控、GC耗时监控和拒绝队列监控。Further, the instance monitoring and graphics include instance JVM monitoring, CPU monitoring, query time-consuming monitoring, query query rate monitoring, index writing rate monitoring, GC times monitoring, GC time-consuming monitoring and rejection queue monitoring.
进一步地，所述ES管理系统会定时将每个集群的资源情况和利用率定时上报给CMDB系统，在ES集群生命周期管理过程中，每一次的集群变化比如扩缩，ES管理系统都把集群的变化上报给预算系统，当预算不足时给出提示和消费账单，用户也可以自助去CMDB系统或预算系统了解资源使用情况或消费明细。Furthermore, the ES management system will regularly report the resource status and utilization of each cluster to the CMDB system. During the ES cluster life cycle management process, every time the cluster changes such as expansion and contraction, the ES management system will report the cluster to the CMDB system. Changes are reported to the budget system. When the budget is insufficient, prompts and consumption bills are given. Users can also go to the CMDB system or budget system to learn about resource usage or consumption details.
进一步地，利用Elastic Operator和动态模板实现ES集群容器化，实现集群创建、销毁、扩缩容；Elastic Operator是一个用于在Kubernetes环境中部署和管理Elasticsearch集群的技术；Elasticsearch是一个开源的分布式搜索和分析引擎，它具有强大的数据处理和搜索能力。Furthermore, Elastic Operator and dynamic templates are used to implement ES cluster containerization and realize cluster creation, destruction, expansion and contraction; Elastic Operator is a technology used to deploy and manage Elasticsearch clusters in the Kubernetes environment; Elasticsearch is an open source distributed Search and analysis engine, which has powerful data processing and search capabilities.
进一步地，通过整合自定义工单系统、预算系统、CMDB系统，开发人员可根据套餐配置，按需通过工单自助申请ES集群；并将资源占用情况，利用率，机房等信息分别上报到企业内部的预算系统和CMDB资源管理系统。Furthermore, by integrating the custom work order system, budget system, and CMDB system, developers can apply for ES clusters through work orders on their own according to the package configuration, and report resource occupancy, utilization, computer room and other information to the enterprise respectively. Internal budget system and CMDB resource management system.
进一步地，通过系统设计和功能开发，完成了ES集群和节点监控，支持开发和运维查看ES节点和索引状态和性能指标，可根据需求自定义告警，管理索引的生命周期和ES账号权限。Furthermore, through system design and function development, ES cluster and node monitoring has been completed, supporting development and operation and maintenance to view ES node and index status and performance indicators. Alarms can be customized according to needs, and the life cycle of indexes and ES account permissions can be managed.
进一步地，设计和开发了一键分析高级智能检测功能，可对集群节点、索引、网络、分片、磁盘、内存、CPU、满载率等多维度多角度分析集群现状并预测可能出现的问题。Furthermore, a one-click analysis advanced intelligent detection function is designed and developed, which can analyze the cluster status and predict possible problems from multiple dimensions and angles such as cluster nodes, indexes, networks, shards, disks, memory, CPU, full load rate, etc.
通过本发明上述实施例，通过整合CMDB系统和预算系统，使得企业内部各业务线ES资源使用和花销情况一目了然，为指导企业内部开源节流，合理申请和使用资源，提升资源利用率提供了科学的数据支撑。Through the above embodiments of the present invention, by integrating the CMDB system and the budget system, the usage and expenditure of ES resources of each business line within the enterprise can be seen at a glance, which provides a scientific basis for guiding the enterprise to increase revenue and reduce expenditure, rationally apply for and use resources, and improve resource utilization. Data support.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其它的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting any creative effort.
图1为本发明一种实施例的系统构架图。Figure 1 is a system architecture diagram of an embodiment of the present invention.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本发明方案，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分的实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都应当属于本发明保护的范围。In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only These are some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts should fall within the scope of protection of the present invention.
需要说明的是，本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本发明的实施例。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that data so used may be interchanged where appropriate for the embodiments of the invention described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, e.g., a process, method, system, product, or apparatus that encompasses a series of steps or units and need not be limited to those explicitly listed. Those steps or elements may instead include other steps or elements not expressly listed or inherent to the process, method, product or apparatus.
在本发明中，术语“上”、“下”、“左”、“右”、“前”、“后”、“顶”、“底”、“内”、“外”、“中”、“竖直”、“水平”、“横向”、“纵向”等指示的方位或位置关系为基于附图所示的方位或位置关系。这些术语主要是为了更好地描述本发明及其实施例，并非用于限定所指示的装置、元件或组成部分必须具有特定方位，或以特定方位进行构造和操作。In the present invention, the terms "upper", "lower", "left", "right", "front", "back", "top", "bottom", "inner", "outer", "middle", The orientations or positional relationships indicated by "vertical", "horizontal", "horizontal", "longitudinal", etc. are based on the orientations or positional relationships shown in the drawings. These terms are mainly used to better describe the present invention and its embodiments and are not intended to limit the indicated device, element or component to having a specific orientation, or to be constructed and operated in a specific orientation.
并且，上述部分术语除了可以用于表示方位或位置关系以外，还可能用于表示其他含义，例如术语“上”在某些情况下也可能用于表示某种依附关系或连接关系。对于本领域普通技术人员而言，可以根据具体情况理解这些术语在本发明中的具体含义。Moreover, some of the above terms may also be used to express other meanings in addition to indicating orientation or positional relationships. For example, the term "upper" may also be used to express a certain dependence relationship or connection relationship in some cases. For those of ordinary skill in the art, the specific meanings of these terms in the present invention can be understood according to specific circumstances.
此外，术语“安装”、“设置”、“设有”、“连接”、“相连”、“套接”应做广义理解。例如，可以是固定连接，可拆卸连接，或整体式构造；可以是机械连接，或电连接；可以是直接相连，或者是通过中间媒介间接相连，又或者是两个装置、元件或组成部分之间内部的连通。对于本领域普通技术人员而言，可以根据具体情况理解上述术语在本发明中的具体含义。In addition, the terms "installed," "set," "provided," "connected," "connected to," and "socketed" should be interpreted broadly. For example, it can be a fixed connection, a detachable connection, or an integral structure; it can be a mechanical connection or an electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, or between two devices, components or components. internal connectivity. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
需要说明的是，在不冲突的情况下，本发明中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本发明。It should be noted that, as long as there is no conflict, the embodiments and features in the embodiments of the present invention can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and embodiments.
请参阅图1所示，一种管理企业内部elasticsearch集群的自动化管理系统，包括ES集群生命周期管理、指标监控与图形化、告警订阅、索引管理、账号管理、一键分析和通过与CMDB系统、预算系统整合；Please refer to Figure 1, an automated management system for managing elastic search clusters within an enterprise, including ES cluster life cycle management, indicator monitoring and graphics, alarm subscription, index management, account management, one-click analysis and CMDB system, budget system integration;
所述ES集群生命周期管理：通过该功能用户可自动化管理ES集群的整个生命周期，而无需运维干预；也可以根据实际资源需求，动态调整集群的实例个数和资源配置；The ES cluster life cycle management: Through this function, users can automatically manage the entire life cycle of the ES cluster without operation and maintenance intervention; the number of instances and resource configuration of the cluster can also be dynamically adjusted according to actual resource requirements;
所述指标监控与图形化：通过多维度对ES的各项指标分析监控，助力运维人员和开发人员迅速定位集群状况、排查问题和优化集群状态；The above-mentioned indicator monitoring and graphics: through multi-dimensional analysis and monitoring of various indicators of ES, it helps operation and maintenance personnel and developers to quickly locate the cluster status, troubleshoot problems and optimize the cluster status;
所述告警订阅：用户可根据需求或者已有策略，配置告警并订阅，当集群发生异常时获得短信或电话提醒；The alarm subscription: users can configure alarms and subscribe according to needs or existing policies, and receive text messages or phone calls when an abnormality occurs in the cluster;
所述索引管理：通过对ES深度开发，实现了索引元数据近实时抓取；可在该功能模块中进行索引结构查看、修改、关闭；The index management: through in-depth development of ES, near-real-time capture of index metadata is achieved; the index structure can be viewed, modified, and closed in this functional module;
所述账号管理：实现了对ES体系账号的管理，在这个功能模块中，用户可按照索引前缀定义ES账户并授权，授权类型支持只读、只写、all三种；The account management: realizes the management of ES system accounts. In this functional module, users can define ES accounts according to the index prefix and authorize them. The authorization types support read-only, write-only, and all;
所述一键分析：在SRE理念指引下，结合多年ES开发和运维实践经验，一键分析功能可实时结合ES集群状态、网络状况、索引写速率、查询速率、SLA、pending tasks、系统和实例负载、分片满载率、索引Pool、查询Pool、Manage Pool等多个维度诊断集群问题，并给出人性化科学建议；The one-click analysis: Under the guidance of the SRE concept, combined with many years of ES development and operation and maintenance practical experience, the one-click analysis function can combine ES cluster status, network conditions, index write rate, query rate, SLA, pending tasks, system and Diagnose cluster problems from multiple dimensions such as instance load, shard full load rate, index pool, query pool, and manage pool, and provide humanized scientific suggestions;
所述通过与CMDB系统、预算系统整合：使得企业内部各业务线ES资源使用和花销情况一目了然，为指导企业内部开源节流，合理申请和使用资源，提升资源利用率提供了科学的数据依据。Through the integration with the CMDB system and the budget system, the usage and expenditure of ES resources in each business line within the enterprise can be seen at a glance, providing scientific data basis for guiding the enterprise to increase revenue and reduce expenditure, apply for and use resources reasonably, and improve resource utilization.
进一步地，所述ES集群生命周期管理的具体实现方案如下：Further, the specific implementation plan of the ES cluster life cycle management is as follows:
借助工单系统的自定义表单功能，为用户提供了ES自动化创建，销毁，扩容，缩容入口；With the help of the custom form function of the work order system, users are provided with ES automated creation, destruction, expansion, and reduction entrances;
工单审批通过后，会将用户提交的信息提交给ES管理系统进一步处理，ES管理系统获取到工单审批通过的信息后，结合套餐的详细配置和模板文件，会动态生成一个ElasticSearch Operator可运行的yaml文件；After the work order is approved, the information submitted by the user will be submitted to the ES management system for further processing. After the ES management system obtains the information that the work order is approved, it will dynamically generate an ElasticSearch Operator that can be run based on the detailed configuration and template file of the package. yaml file;
ES管理系统将该yaml文件提交给容器管理系统对外暴露的K8S service API，该API接口会把yaml文件提交给ElasticSearch Operator运行；The ES management system submits the yaml file to the K8S service API exposed by the container management system, and the API interface submits the yaml file to the ElasticSearch Operator for running;
ElasticSearch Operator获取到yaml文件后，会根据文件描述，执行集群创建、销毁、扩缩等操作，从而实现ES集群的全生命周期管理。After ElasticSearch Operator obtains the yaml file, it will perform cluster creation, destruction, scaling and other operations according to the file description, thereby realizing the full life cycle management of the ES cluster.
进一步地，指标监控总体分为2部分，一是集群监控和图形化，另一个是实例监控和图形化。Furthermore, indicator monitoring is generally divided into two parts, one is cluster monitoring and graphics, and the other is instance monitoring and graphics.
进一步地，所述集群监控和图形化包括集群状态监控、JVM监控、CPU监控、查询监控、写入耗时监控、GC监控、pending tasks监控和分片监控。Further, the cluster monitoring and graphics include cluster status monitoring, JVM monitoring, CPU monitoring, query monitoring, writing time-consuming monitoring, GC monitoring, pending tasks monitoring and sharding monitoring.
进一步地，所述实例监控和图形化包括实例的JVM监控、CPU监控、查询耗时监控、query查询速率监控、index写入速率监控、GC次数监控、GC耗时监控和拒绝队列监控。Further, the instance monitoring and graphics include instance JVM monitoring, CPU monitoring, query time-consuming monitoring, query query rate monitoring, index writing rate monitoring, GC times monitoring, GC time-consuming monitoring and rejection queue monitoring.
进一步地，所述ES管理系统会定时将每个集群的资源情况和利用率定时上报给CMDB系统，在ES集群生命周期管理过程中，每一次的集群变化比如扩缩，ES管理系统都把集群的变化上报给预算系统，当预算不足时给出提示和消费账单，用户也可以自助去CMDB系统或预算系统了解资源使用情况或消费明细。Furthermore, the ES management system will regularly report the resource status and utilization of each cluster to the CMDB system. During the ES cluster life cycle management process, every time the cluster changes such as expansion and contraction, the ES management system will report the cluster to the CMDB system. Changes are reported to the budget system. When the budget is insufficient, prompts and consumption bills are given. Users can also go to the CMDB system or budget system to learn about resource usage or consumption details.
进一步地，利用Elastic Operator和动态模板实现ES集群容器化，实现集群创建、销毁、扩缩容；Elastic Operator是一个用于在Kubernetes环境中部署和管理Elasticsearch集群的技术；Elasticsearch是一个开源的分布式搜索和分析引擎，它具有强大的数据处理和搜索能力。Furthermore, Elastic Operator and dynamic templates are used to implement ES cluster containerization and realize cluster creation, destruction, expansion and contraction; Elastic Operator is a technology used to deploy and manage Elasticsearch clusters in the Kubernetes environment; Elasticsearch is an open source distributed Search and analysis engine, which has powerful data processing and search capabilities.
进一步地，通过整合自定义工单系统、预算系统、CMDB系统，开发人员可根据套餐配置，按需通过工单自助申请ES集群；并将资源占用情况，利用率，机房等信息分别上报到企业内部的预算系统和CMDB资源管理系统。Furthermore, by integrating the custom work order system, budget system, and CMDB system, developers can apply for ES clusters through work orders on their own according to the package configuration, and report resource occupancy, utilization, computer room and other information to the enterprise respectively. Internal budget system and CMDB resource management system.
进一步地，通过系统设计和功能开发，完成了ES集群和节点监控，支持开发和运维查看ES节点和索引状态和性能指标，可根据需求自定义告警，管理索引的生命周期和ES账号权限。Furthermore, through system design and function development, ES cluster and node monitoring has been completed, supporting development and operation and maintenance to view ES node and index status and performance indicators. Alarms can be customized according to needs, and the life cycle of indexes and ES account permissions can be managed.
进一步地，设计和开发了一键分析高级智能检测功能，可对集群节点、索引、网络、分片、磁盘、内存、CPU、满载率等多维度多角度分析集群现状并预测可能出现的问题。Furthermore, a one-click analysis advanced intelligent detection function is designed and developed, which can analyze the cluster status and predict possible problems from multiple dimensions and angles such as cluster nodes, indexes, networks, shards, disks, memory, CPU, full load rate, etc.
本发明的有益之处在于：The benefits of the present invention are:
1.本发明降低开发人员中间件使用门槛，使开发人员享用到管理系统带来的便捷性和效能提升；1. This invention lowers the threshold for developers to use middleware, allowing developers to enjoy the convenience and efficiency improvement brought by the management system;
2.本发明进一步解放运维人员，提升了系统稳定性；降低运维人员的日常工作量，使运维将时间和精力投入到更重要的事务中；2. The present invention further liberates operation and maintenance personnel and improves system stability; reduces the daily workload of operation and maintenance personnel, allowing operation and maintenance personnel to devote time and energy to more important matters;
3.本发明提供智能化的故障预测，容量预测和多维指标分析；使开发人员和运维人员分析定位问题更佳得心应手；3. The present invention provides intelligent fault prediction, capacity prediction and multi-dimensional index analysis; making it easier for developers and operation and maintenance personnel to analyze and locate problems;
4.本发明通过整合CMDB系统和预算系统，使得企业内部各业务线ES资源使用和花销情况一目了然，为指导企业内部开源节流，合理申请和使用资源，提升资源利用率提供了科学的数据支撑。4. By integrating the CMDB system and the budget system, the present invention makes the usage and expenditure of ES resources of each business line within the enterprise clear at a glance, and provides scientific data support to guide the enterprise to increase revenue and reduce expenditure, rationally apply for and use resources, and improve resource utilization.
以上所述仅为，本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310812665.1ACN117235035A (en) | 2023-07-04 | 2023-07-04 | An automated management system for managing elasticsearch clusters within an enterprise |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310812665.1ACN117235035A (en) | 2023-07-04 | 2023-07-04 | An automated management system for managing elasticsearch clusters within an enterprise |
| Publication Number | Publication Date |
|---|---|
| CN117235035Atrue CN117235035A (en) | 2023-12-15 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310812665.1APendingCN117235035A (en) | 2023-07-04 | 2023-07-04 | An automated management system for managing elasticsearch clusters within an enterprise |
| Country | Link |
|---|---|
| CN (1) | CN117235035A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117851182A (en)* | 2024-01-30 | 2024-04-09 | 南方电网数字电网集团信息通信科技有限公司 | CMDB-based Kubernetes resource monitoring method and system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105844543A (en)* | 2016-04-07 | 2016-08-10 | 国网天津市电力公司 | Automation operation management system for power enterprise information system |
| CN105933175A (en)* | 2016-07-14 | 2016-09-07 | 微额速达（上海）金融信息服务有限公司 | Real-time monitoring early-warning system |
| US9769032B1 (en)* | 2015-03-20 | 2017-09-19 | Databricks Inc. | Cluster instance management system |
| CN112714018A (en)* | 2020-12-28 | 2021-04-27 | 上海领健信息技术有限公司 | Gateway-based ElasticSearch search service method, system, medium and terminal |
| CN116151787A (en)* | 2021-11-18 | 2023-05-23 | 北京航天长峰科技工业集团有限公司 | IT operation and maintenance management system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9769032B1 (en)* | 2015-03-20 | 2017-09-19 | Databricks Inc. | Cluster instance management system |
| CN105844543A (en)* | 2016-04-07 | 2016-08-10 | 国网天津市电力公司 | Automation operation management system for power enterprise information system |
| CN105933175A (en)* | 2016-07-14 | 2016-09-07 | 微额速达（上海）金融信息服务有限公司 | Real-time monitoring early-warning system |
| CN112714018A (en)* | 2020-12-28 | 2021-04-27 | 上海领健信息技术有限公司 | Gateway-based ElasticSearch search service method, system, medium and terminal |
| CN116151787A (en)* | 2021-11-18 | 2023-05-23 | 北京航天长峰科技工业集团有限公司 | IT operation and maintenance management system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117851182A (en)* | 2024-01-30 | 2024-04-09 | 南方电网数字电网集团信息通信科技有限公司 | CMDB-based Kubernetes resource monitoring method and system |
| CN117851182B (en)* | 2024-01-30 | 2024-11-29 | 南方电网数字电网集团信息通信科技有限公司 | A Kubernetes resource monitoring method and system based on CMDB |
| Publication | Publication Date | Title |
|---|---|---|
| CN112631856B (en) | An intent-driven 6G network intelligent operation and maintenance method, system, device and application | |
| JP7551745B2 (en) | ML-based event handling | |
| US12085901B2 (en) | Bot management framework for robotic process automation systems | |
| AU2019201687B2 (en) | Network device vulnerability prediction | |
| CN100412802C (en) | Planned computer problem diagnosis and solvement and its automatic report and update | |
| CN105071969B (en) | System and method for customized real-time monitoring and automatic exception handling based on JMX | |
| US20130198050A1 (en) | Systems and methods for providing decision time brokerage in a hybrid cloud ecosystem | |
| KR20130114592A (en) | Bug clearing house | |
| CN104881352A (en) | System resource monitoring device based on mobile terminal | |
| Muniswamaiah et al. | Green computing for Internet of Things | |
| CN111352806A (en) | Log data monitoring method and device | |
| CN108234199A (en) | Monitoring method, apparatus and system based on Kafka | |
| CN118170845A (en) | Information technology analysis system based on cloud computing | |
| CN113238736A (en) | Method for generating integrated platform | |
| Kravets et al. | The risk management model of design department’s PDM information system | |
| CN115794566A (en) | Method, device, electronic equipment and storage medium for data alarm | |
| CN117235035A (en) | An automated management system for managing elasticsearch clusters within an enterprise | |
| CN120029858A (en) | Comprehensive financial IT operation and maintenance management system and method based on artificial intelligence | |
| CN110532312A (en) | A kind of industry interconnection cloud platform system based on big data | |
| CN119449354A (en) | Deployment method, device, electronic device and storage medium of bastion host | |
| CN109343955A (en) | Recommended service invocation method, medium, apparatus and computing device | |
| US11188924B2 (en) | Connectivity interface optimization recommendation engine for enterprise system | |
| CN117992023A (en) | A system that implements multi-level architecture asset maintenance and ensures consistency between architecture design and system operation status | |
| CN113824590B (en) | Problem prediction method, computer device and storage medium for microservice network | |
| CN110209903A (en) | A kind of industry interconnection cloud platform system based on big data |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |