Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

(NOT ACCEPTING ISSUES/PRS!! AWS-internal repository to track the upstream Fluent Bit)

License

NotificationsYou must be signed in to change notification settings

amazon-contributing/upstream-to-fluent-bit

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

logo

CI Status

CI WorkflowStatus
Unit Tests (master)CI/Unit Tests
Integration Tests (master)CI/Integration Tests
Arm buildsArm CI sponsored by Actuated
Latest releaseCI/Build

About

Fluent Bit is a fast Log Processor and Forwarder for Linux, Windows, Embedded Linux, MacOS and BSD family operating systems. It's part of the GraduatedFluentd Ecosystem and aCNCF sub-project.

Fluent Bit allows to collect log events or metrics from different sources, process them and deliver them to different backends such asFluentd, Elasticsearch, Splunk, DataDog, Kafka, New Relic, Azure services, AWS services, Google services, NATS, InfluxDB or any custom HTTP end-point.

Fluent Bit comes with full SQLStream Processing capabilities: data manipulation and analytics using SQL queries.

Fluent Bit runs on x86_64, x86, arm32v7, and arm64v8 architectures.

Features

  • High Performance at low CPU and Memory footprint
  • Data Parsing
  • Reliability and Data Integrity
  • Networking
    • Security: built-in TLS/SSL support
    • Asynchronous I/O
  • Pluggable Architecture andExtensibility: Inputs, Filters and Outputs
  • Monitoring: expose internal metrics over HTTP in JSON andPrometheus format
  • Stream Processing: Perform data selection and transformation using simple SQL queries
    • Create new streams of data using query results
    • Aggregation Windows
    • Data analysis and prediction: Timeseries forecasting
  • Portable: runs on Linux, MacOS, Windows and BSD systems

Fluent Bit in Production

Fluent Bit is used widely in production environments. As of 2022,Fluent Bit surpasses 3 Billion downloads and continues to be deployed over10 million times a day. The following is a preview of who uses Fluent Bit heavily in production:

If your company uses Fluent Bit and is not listed, feel free to open a GitHub issue and we will add the logo.

users

Our official project documentation forinstallation,configuration, deployment and development topics is located here:

Quick Start

Build from Scratch

If you aim to build Fluent Bit from sources, you can go ahead and start with the following commands.

cd buildcmake ..makebin/fluent-bit -i cpu -o stdout -f 1

If you are interested into more details, please refer to theBuild & Install section.

Requirements

  • CMake >= 3.0
  • Flex
  • Bison
  • YAML library/headers
  • OpenSSL library/headers

Linux Packages

We provide packages for most common Linux distributions:

Linux / Docker Container Images

Our Linux containers images are the most common deployment model, thousands ofnew installation happen every day, learn more about the available images andtagshere.

Windows Packages

Fluent Bit is fully supported on Windows environments, get started withthese instructions.

Running on s390x

Fluent Bit runs on Linux on IBM Z(s390x), but the WASM filter plugin is not. For the LUA filter plugin, it runs whenlibluajit is installed on the system and fluent bit is built withFLB_LUAJIT andFLB_PREFER_SYSTEM_LIB_LUAJIT on.

Plugins: Inputs, Filters and Outputs

Fluent Bit is based in a pluggable architecture where different plugins plays a major role in the data pipeline:

Input Plugins

nametitledescription
collectdCollectdListen for UDP packets from Collectd.
cpuCPU Usagemeasure total CPU usage of the system.
diskDisk Usagemeasure Disk I/Os.
dummyDummygenerate dummy event.
execExecexecutes external program and collects event logs.
forwardForwardFluentd forward protocol.
headHeadread first part of files.
healthHealthCheck health of TCP services.
kmsgKernel Log Bufferread the Linux Kernel log buffer messages.
memMemory Usagemeasure the total amount of memory used on the system.
mqttMQTTstart a MQTT server and receive publish messages.
netifNetwork Trafficmeasure network traffic.
procProcessCheck health of Process.
randomRandomGenerate Random samples.
serialSerial Interfaceread data information from the serial interface.
stdinStandard Inputread data from the standard input.
syslogSyslogread syslog messages from a Unix socket.
systemdSystemdread logs from Systemd/Journald.
tailTailTail log files.
tcpTCPListen for JSON messages over TCP.
thermalThermalmeasure system temperature(s).

Filter Plugins

nametitledescription
awsAWS MetadataEnrich logs with AWS Metadata.
expectExpectValidate records match certain criteria in structure.
grepGrepMatch or exclude specific records by patterns.
kubernetesKubernetesEnrich logs with Kubernetes Metadata.
luaLuaFilter records using Lua Scripts.
parserParserParse record.
record_modifierRecord ModifierModify record.
rewrite_tagRewrite TagRe-emit records under new tag.
stdoutStdoutPrint records to the standard output interface.
throttleThrottleApply rate limit to event flow.
nestNestNest records under a specified key
modifyModifyModifications to record.

Output Plugins

nametitledescription
azureAzure Log AnalyticsIngest records into Azure Log Analytics
bigqueryBigQueryIngest records into Google BigQuery
counterCount RecordsSimple records counter.
datadogDatadogIngest logs into Datadog.
esElasticsearchflush records to a Elasticsearch server.
fileFileFlush records to a file.
flowcounterFlowCounterCount records.
forwardForwardFluentd forward protocol.
gelfGELFFlush records to Graylog
httpHTTPFlush records to an HTTP end point.
influxdbInfluxDBFlush records to InfluxDB time series database.
kafkaApache KafkaFlush records to Apache Kafka
kafka-restKafka REST ProxyFlush records to a Kafka REST Proxy server.
lokiLokiFlush records to Loki server.
natsNATSFlush records to a NATS server.
nullNULLThrow away events.
s3S3Flush records to s3
stackdriverGoogle Stackdriver LoggingFlush records to Google Stackdriver Logging service.
stdoutStandard OutputFlush records to the standard output.
splunkSplunkFlush records to a Splunk Enterprise service
tcpTCP & TLSFlush records to a TCP server.
tdTreasure DataFlush records to theTreasure Data cloud service for analytics.

Contributing

Fluent Bit is an open project, several individuals and companies contribute in different forms like coding, documenting, testing, spreading the word at events within others. If you want to learn more about contributing opportunities please reach out to us through ourCommunity Channels.

If you are interested in contributing to Fluent bit with bug fixes, new features or coding in general, please refer to the codeCONTRIBUTING guidelines. You can also refer the Beginners Guide to contributing to Fluent Bithere.

Community & Contact

Feel free to join us on our Slack channel, Mailing List or IRC:

License

This program is under the terms of theApache License v2.0.

Authors

Fluent Bit is sponsored and maintained by several companies in the Cloud Native community, including all the major cloud providers.

You can see a list of contributorshere.

About

(NOT ACCEPTING ISSUES/PRS!! AWS-internal repository to track the upstream Fluent Bit)

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • C81.4%
  • C++8.0%
  • Shell2.6%
  • CMake1.6%
  • Python1.4%
  • Makefile1.3%
  • Other3.7%

[8]ページ先頭

©2009-2025 Movatter.jp