- Notifications
You must be signed in to change notification settings - Fork0
Elastic beat to read messages from RabbitMQ over AMQP and send them to Logstash, Elasticsearch
License
Jahor/rmqbeat
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
Welcome to Rmqbeat.
Rmqbeat allows to read messages over AMQP (from RabbitMQ or other server) and post them to Elasticsearch, Logstash, etc.
It preserves both payload and properties including headers.
It also supportstracer
mode, which is designed to connect toamq.rabbitmq.trace
node and receive trace messages activity.In this mode it publishes message as it was sent (with original properties) and adds some additional information such as username, action performed (publish|deliver), etc.
It can also serve as a RabbitMQ log shipper when you subscribe toamq.rabbitmq.log
exchange.And inevent
mode it will read different rabbitmq events fromamq.rabbitmq.event
.
Seedocs for more information on configuration parameters.
Ensure that this folder is at the following location:${GOPATH}/src/github.com/jahor/rmqbeat
- Golang 1.9
To get running with Rmqbeat and also install thedependencies, run the following command:
make setup
It will create a clean git history for each major step. Note that you can always rewrite the history if you wish before pushing your changes.
To push Rmqbeat in the git repository, run the following commands:
git remote set-url origin https://github.com/jahor/rmqbeatgit push origin master
For further development, check out thebeat developer guide.
To build the binary for Rmqbeat run the command below. This will generate a binaryin the same directory with the name rmqbeat.
make
To run Rmqbeat with debugging output enabled, run:
./rmqbeat -c rmqbeat.yml -e -d "*"
To test Rmqbeat, run the following command:
make testsuite
alternatively:
make unit-testsmake system-testsmake integration-testsmake coverage-report
The test coverage is reported in the folder./build/coverage/
Each beat has a template for the mapping in elasticsearch and a documentation for the fieldswhich is automatically generated based onfields.yml
by running the following command.
make update
To clean Rmqbeat source code, run the following commands:
make fmtmake simplify
To clean up the build directory and generated artifacts, run:
make clean
To clone Rmqbeat from the git repository, run the following commands:
mkdir -p ${GOPATH}/src/github.com/jahor/rmqbeatgit clone https://github.com/jahor/rmqbeat ${GOPATH}/src/github.com/jahor/rmqbeat
For further development, check out thebeat developer guide.
The beat frameworks provides tools to crosscompile and package your beat for different platforms. This requiresdocker and vendoring as described above. To build packages of your beat, run the following command:
make package
This will fetch and create all images required for the build process. The whole process to finish can take several minutes.
About
Elastic beat to read messages from RabbitMQ over AMQP and send them to Logstash, Elasticsearch