Movatterモバイル変換


[0]ホーム

URL:


CN111245669A - Monitoring system and method based on Zabbix and Prometheus - Google Patents

Monitoring system and method based on Zabbix and Prometheus
Download PDF

Info

Publication number
CN111245669A
CN111245669ACN201911277347.XACN201911277347ACN111245669ACN 111245669 ACN111245669 ACN 111245669ACN 201911277347 ACN201911277347 ACN 201911277347ACN 111245669 ACN111245669 ACN 111245669A
Authority
CN
China
Prior art keywords
monitoring system
early warning
zabbix
message
prometous
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911277347.XA
Other languages
Chinese (zh)
Inventor
曹天佑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Weishenma Technology Dalian Co ltd
Original Assignee
Weishenma Technology Dalian Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Weishenma Technology Dalian Co ltdfiledCriticalWeishenma Technology Dalian Co ltd
Priority to CN201911277347.XApriorityCriticalpatent/CN111245669A/en
Publication of CN111245669ApublicationCriticalpatent/CN111245669A/en
Pendinglegal-statusCriticalCurrent

Links

Images

Classifications

Landscapes

Abstract

The invention discloses a monitoring system and a method based on Zabbix and Prometous, which comprises a Zabbix monitoring system and a Prometous monitoring system, wherein an alarm message of the Zabbix monitoring system is converted into a message format which can be identified by Prometous through a unified message converter, and the Zabbix monitoring system and the Alertmanager component of the Prometous monitoring system. On one hand, the Alertmanager can directly send the message to the early warning medium through the early warning message distributor, on the other hand, the message can be simultaneously filed into the Mysql database through the early warning data collector, and the Mysql database is uniformly managed and analyzed through the chart display and early warning information management platform. The invention can convert the early warning messages of other monitoring systems outside the Prometheus system into the messages which can be processed inside the monitoring systems and conform to the internal logic of the monitoring systems, thereby realizing the work order type management, the historical information statistics and the chart display functions of the early warning messages.

Description

Monitoring system and method based on Zabbix and Prometheus
Technical Field
The invention relates to the technical field of monitoring systems, in particular to a monitoring system and a monitoring method based on Zabbix and Prometheus.
Background
Current internet technology has gained significant position and impact in various areas of society, and monitoring is an important aspect of current internet enterprise computer systems. At present, internet enterprises often rely on one or more sets of business systems developed independently to develop various business behaviors, and monitoring the stable operation of the systems also becomes important for internet companies.
Currently, there are many open-source monitoring software in the market, such as: zabbix, Nagios, Prometous and the like, wherein a plurality of enterprises can adopt one mode for monitoring, but generally one monitoring mode cannot realize the monitoring behavior of each level of the whole business system, and a single monitoring solution cannot meet the specific requirements of the Internet enterprises on the performance and the expansibility of monitoring software along with the rapid development of business; meanwhile, the monitoring by adopting two or more than two kinds of monitoring software can cause the problems of difficult management and disordered receiving of the monitoring early warning, and the problems of processing and filing after the sending of the monitoring early warning.
The invention provides a monitoring system based on Zabbix and Prometolus, which integrates a main stream open source monitoring system Zabbix and Prometolus, performs unified management and early warning, performs claiming or distribution according to early warning related personnel, and performs filing and data analysis after the processing is completed.
Disclosure of Invention
The invention aims at the problem that the market demand and the achievement target of the current technical development are not matched, and provides a monitoring system and a method based on Zabbix and Prometheus.
The method comprises the steps of converting Zabbix alarm messages into message formats which can be identified by Prometous through a unified message converter, sending early warning information to an early warning receiving medium and a Mysql database through an Alertmanager component respectively, transmitting the early warning receiving medium through a unified early warning message distributor, transmitting the Mysql database through an early warning data collector, unifying the two messages through standardization of early warning levels and message grouping rules, and filing the messages to the database through the early warning data collector for unified management, analysis and display.
Zabbix is a relatively primitive network monitoring system.
A unified message converter for receiving messages from Zabbix.
Prometheus is a newer network monitoring system.
An alert manager component for an early warning management system within a promemeus ecosystem.
And the early warning data collector is used for receiving the message of the Alertmanager.
And the Mysql database is used for storing the data of the early warning data collector.
The uniform early warning message distributor is used for receiving the messages of the Alertmanager.
And the early warning information management platform is used for displaying a network interface of the early warning information.
The invention at least comprises the following beneficial effects:
the monitoring of the original single set of Zabbix monitoring system service layer is combined into a whole set of monitoring system by adopting a Prometheus monitoring system and a unified message converter, so that the problem that one monitoring system is not enough to solve the monitoring is realized, and the problems that two monitoring systems are difficult to manage and the standard cannot be established are solved. On the other hand, the failure of tracing of historical early warning is another critical problem existing in Prometheus at present, and for the technical field of the current year, technical means are necessary to be adopted to implement the necessary technical characteristics of tracing of early warning.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a block diagram of a monitoring system of Zabbix and Prometheus in the present invention.
Detailed Description
The invention patent is a complete set of monitoring system which runs on a plurality of servers or in a plurality of containers.
On the basis of the original Zabbix monitoring system, an early warning plug-in for sending alarm messages of Zabbix is manufactured to a unified message converter.
The early warning levels of all monitoring items are configured inside the Zabbix system so as to meet the overall level division standard.
The early warning level is set into five layers including notification, warning, fault, emergency fault and others.
And the interior of the Zabbix system is configured with an early warning strategy, so that all early warning messages are sent to a self-made early warning plug-in.
And the early warning plug-in unit forwards the Zabbix early warning message to the unified message converter according to the original format.
The unified message transformer is a connector of Zabbix and alert manager.
And sending a self-defined json template message by the Zabbix early warning plug-in.
The template message needs to contain an authentication identifier, i.e. an early warning or recovery.
The message bodies are listed as follows:
Figure BSA0000197379800000031
Figure BSA0000197379800000041
it needs to contain an identifier to identify whether the message is an early warning or a recovery, here "status", and when a recovery message is received, the content of "status" is "resolved" to facilitate the judgment of the unified message converter.
The unified message converter converts the message into an alarm message format which can be identified by Prometheus; considering the grouping strategy of Prometheus, the content is fixed by taking 'alert name' as a grouping basis; secondly, through the early warning grade division standard, the "visibility" is converted into a unified standard grade, and other basic information is converted into a cable of Prometheus.
Particularly, it is stated that "status", when "status" is recovery, it is necessary to set the endsAt item of Prometheus to rfc3339 format of the current time, and Prometheus judges whether the warning is recovered through endsAt.
The above processes all need to inject additional information such as grouping and message type information into the message according to the overall standard specification of the system, and if special service needs exist, other identifying contents can be added according to the requirements.
And sending the message to an API (application program interface) of an early warning management system Alertmanager of Prometheus for unified processing. The message will then follow the alert manager policy for subsequent processing.
According to the overall standard specification of the system, an alarm strategy meeting the standard is formulated, and the alarm strategy comprises the following steps: early warning level, grouping according to classes, and adding other identification contents according to requirements if special service requirements exist.
And after the early warning is triggered, the early warning is sent to an Alertmanager for unified processing.
And adding a unique identifier of each UUID of the new early warning to the inside of the Alertmanager component for judging the repeatability of the early warning in a later system, wherein the UUID is obtained by performing HASH operation on Labels and startsAt attributes of the early warning.
And modifying the source code of the Alertmanager, and adding a unique identification code for each early warning.
The processed early warning message is sent to the early warning data collector and the unified early warning message distributor through webhook (an external function call interface) of Alertmanager.
The early warning data collector receives the information from the Alertmanager, analyzes and splits the early warning information into database entries with single unique identification codes and inserts the database entries into the Mysql database, and if the database already contains the information, the information is not processed.
When the early warning message with the unique identification code is received again and is in a recovery state, the updating database marks the message in the recovery state.
The Mysql database stores the early warning data from the "early warning data collector".
The storage data fields include: the system comprises an early warning ID, an early warning name, a host name, an IP address, early warning information, a product type, an early warning level, early warning time, an early warning state, an early warning label, an early warning unique identification code, a claim state, a claimant, claim time, closing time and completion time.
The uniform early warning message distributor receives the message from the Alertmanager, and sends the message to E-mail, nail, short message and telephone in a mode of self-defining template according to different warning levels and grouping information.
The early warning information management platform UI is a webpage-form early warning information management system, and has the functions of allowing technicians to log in through own accounts, claim early warning information, and mark a processing process and a processing result in a comment form after the early warning information is processed; and searching and screening historical early warning information.
The implementation mode of the method is divided into a front end part and a rear end part, the front end is developed by adopting a mainstream front end framework VUE, and the rear end is compiled by adopting a Python Web framework flash.

Claims (5)

1. Monitoring system and method based on Zabbix and Prometous, including Zabbix and Prometous two systems, characterized by that to change Zabbix monitoring system into the message format that Prometous monitoring system can discern through the unified message converter, Zabbix monitoring system and Prometous monitoring system Alertmanager's assembly.
2. The Zabbix and Prometheus based monitoring system and method of claim 1 wherein the information is received by the unified warning message distributor and sent to the warning agent.
3. The Zabbix and Prometheus based monitoring system and method of claim 1 wherein the alert manager component files messages to Mysql database simultaneously through the early warning data collector.
4. The Zabbix and Prometheus based monitoring system and method as claimed in claim 3, wherein UUID unique identifier for each new pre-alarm is added in Alertmanager for the repeated judgment of pre-alarm in the following system, and the UUID is obtained by HASH operation based on labels and startsAt attribute of pre-alarm.
5. The monitoring system and method based on Zabbix and Prometheus as claimed in claim 3, wherein Mysql database can be managed and analyzed uniformly through chart display and early warning information management platform.
CN201911277347.XA2019-12-092019-12-09Monitoring system and method based on Zabbix and PrometheusPendingCN111245669A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201911277347.XACN111245669A (en)2019-12-092019-12-09Monitoring system and method based on Zabbix and Prometheus

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201911277347.XACN111245669A (en)2019-12-092019-12-09Monitoring system and method based on Zabbix and Prometheus

Publications (1)

Publication NumberPublication Date
CN111245669Atrue CN111245669A (en)2020-06-05

Family

ID=70877559

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201911277347.XAPendingCN111245669A (en)2019-12-092019-12-09Monitoring system and method based on Zabbix and Prometheus

Country Status (1)

CountryLink
CN (1)CN111245669A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN114978860A (en)*2022-03-312022-08-30亿玛创新网络(天津)有限公司 Fault monitoring method, device, electronic device and storage medium
CN116340083A (en)*2021-12-222023-06-27奇安信科技集团股份有限公司 Alarm rule generation method, device, electronic equipment and storage medium
CN117806911A (en)*2024-01-122024-04-02上海锡鼎智能科技有限公司Prometaus-based operation and maintenance monitoring management system and monitoring method

Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20130273968A1 (en)*2008-08-192013-10-17Digimarc CorporationMethods and systems for content processing
CN104243236A (en)*2014-09-172014-12-24深圳供电局有限公司Method, system and server for analyzing operation and maintenance alarm data of monitoring system
CN106713281A (en)*2016-11-302017-05-24国网北京市电力公司Monitoring system
CN109450693A (en)*2018-11-232019-03-08金色熊猫有限公司Hybrid cloud monitoring system and monitoring method using same
CN110048888A (en)*2019-04-162019-07-23深圳市致宸信息科技有限公司A kind of method based on zabbix monitoring alarm, server, equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20130273968A1 (en)*2008-08-192013-10-17Digimarc CorporationMethods and systems for content processing
CN104243236A (en)*2014-09-172014-12-24深圳供电局有限公司Method, system and server for analyzing operation and maintenance alarm data of monitoring system
CN106713281A (en)*2016-11-302017-05-24国网北京市电力公司Monitoring system
CN109450693A (en)*2018-11-232019-03-08金色熊猫有限公司Hybrid cloud monitoring system and monitoring method using same
CN110048888A (en)*2019-04-162019-07-23深圳市致宸信息科技有限公司A kind of method based on zabbix monitoring alarm, server, equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
GEEKBOYDQZ: "《Prometheus+Grafana+Zabbix+alertmanager 部署》", 14 October 2019*

Cited By (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN116340083A (en)*2021-12-222023-06-27奇安信科技集团股份有限公司 Alarm rule generation method, device, electronic equipment and storage medium
CN114978860A (en)*2022-03-312022-08-30亿玛创新网络(天津)有限公司 Fault monitoring method, device, electronic device and storage medium
CN117806911A (en)*2024-01-122024-04-02上海锡鼎智能科技有限公司Prometaus-based operation and maintenance monitoring management system and monitoring method

Similar Documents

PublicationPublication DateTitle
CN111651471B (en)Target data query method and device, electronic equipment and storage medium
AU2022224845B2 (en)Intelligent vulnerability lifecycle management system
CN111245669A (en)Monitoring system and method based on Zabbix and Prometheus
US11411871B2 (en)Augmenting functionality in distributed systems with payload headers
CN118101352B (en)Abnormality detection rule generation method and device
CN110708232A (en)Method and system for realizing JIRA message real-time notification
CN105427545A (en)Drools-based equipment warning management method and device
CN111371581A (en) Method, device, device and medium for abnormal detection of IoT card business
JP5268589B2 (en) Information processing apparatus and information processing apparatus operating method
CN115002062A (en)Message processing method, device, equipment and readable storage medium
CN110362627A (en)Based on the business diagnosis method and device of block chain, electronic equipment, storage medium
CN112749124A (en)Page information management method and device, computer equipment and readable storage medium
CN109754140A (en)A kind of asset management mode based on two dimensional code
CN111652681A (en)Receipt processing method, server and computer readable storage medium
CN117692499A (en)Distributed monitoring management method, system, equipment and medium for operation and maintenance service
CN114416560A (en)Program crash analysis aggregation method and system
CN105763371A (en)Alarm processing method and apparatus
CN117010917A (en)Fire-fighting product maintenance traceability system and method
CN115545838A (en)Order data processing method and device, electronic equipment and storage medium
CN112417085A (en)Message comparison method and device, computer equipment and storage medium
CN111767322A (en) A method and device for managing offshore oilfield service equipment
CN118897773B (en) Alert method and system for generating configuration object model based on aPaas platform
CN110717137A (en)Message distribution processing method and message system
CN111539665B (en)Mail monitoring method, device, equipment and storage medium
CN117421198B (en)Visual asset management system and method based on security

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication
RJ01Rejection of invention patent application after publication

Application publication date:20200605


[8]ページ先頭

©2009-2025 Movatter.jp