- Notifications
You must be signed in to change notification settings - Fork1.8k
A high-performance observability data pipeline.
License
MPL-2.0, Unknown licenses found
Licenses found
vectordotdev/vector
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
Quickstart • Docs • Guides • Integrations • Chat • Download • Rust Crate Docs
Vector is a high-performance, end-to-end (agent & aggregator) observability datapipeline that puts you in control of your observability data.Collect,transform, androuteall your logs and metrics to any vendors you want today and any othervendors you may want tomorrow. Vector enables dramatic cost reduction, noveldata enrichment, and data security where you need it, not where it is mostconvenient for your vendors. Additionally, it is open source and up to 10xfaster than every alternative in the space.
To get started, follow ourquickstart guide orinstallVector.
Vector is maintained by the Datadog'sCommunity Open Source Engineering team.
- Reliable - Built inRust, Vector's primary design goal is reliability.
- End-to-end - Deploys as anagent oraggregator. Vector is a complete platform.
- Unified -Logs,metrics (beta), and traces (coming soon). One tool for all of your data.
- Reduce total observability costs.
- Transition vendors without disrupting workflows.
- Enhance data quality and improve insights.
- Consolidate agents and eliminate agent fatigue.
- Improve overall observability performance and reliability.
- Vector is relied on by startups and enterprises likeAtlassian,T-Mobile,Comcast,Zendesk,Discord,Fastly,CVS,Trivago,Tuple,Douban,Visa,Mambu,Blockfi,Claranet,Instacart,Forcepoint, andmany more.
- Vector isdownloaded over 100,000 times per day.
- Vector's largest userprocesses over 500TB daily.
- Vector hasover 500 contributors and growing.
All user documentation is available atvector.dev/docs.
Other Resources:
The following performance tests demonstrate baseline performance betweencommon protocols with the exception of the Regex Parsing test.
Test | Vector | Filebeat | FluentBit | FluentD | Logstash | SplunkUF | SplunkHF |
---|---|---|---|---|---|---|---|
TCP to Blackhole | 86mib/s | n/a | 64.4mib/s | 27.7mib/s | 40.6mib/s | n/a | n/a |
File to TCP | 76.7mib/s | 7.8mib/s | 35mib/s | 26.1mib/s | 3.1mib/s | 40.1mib/s | 39mib/s |
Regex Parsing | 13.2mib/s | n/a | 20.5mib/s | 2.6mib/s | 4.6mib/s | n/a | 7.8mib/s |
TCP to HTTP | 26.7mib/s | n/a | 19.6mib/s | <1mib/s | 2.7mib/s | n/a | n/a |
TCP to TCP | 69.9mib/s | 5mib/s | 67.1mib/s | 3.9mib/s | 10mib/s | 70.4mib/s | 7.6mib/s |
To learn more about our performance tests, please see theVector test harness.
The following correctness tests are not exhaustive, but they demonstratefundamental differences in quality and attention to detail:
Test | Vector | Filebeat | FluentBit | FluentD | Logstash | Splunk UF | Splunk HF |
---|---|---|---|---|---|---|---|
Disk Buffer Persistence | ✓ | ✓ | ⚠ | ✓ | ✓ | ||
File Rotate (create) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
File Rotate (copytruncate) | ✓ | ✓ | ✓ | ||||
File Truncation | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Process (SIGHUP) | ✓ | ⚠ | ✓ | ✓ | |||
JSON (wrapped) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
To learn more about our correctness tests, please see theVector test harness.
Vector is an end-to-end, unified, open data platform.
Vector | Beats | Fluentbit | Fluentd | Logstash | Splunk UF | Splunk HF | Telegraf | |
---|---|---|---|---|---|---|---|---|
End-to-end | ✓ | ✓ | ||||||
Agent | ✓ | ✓ | ✓ | ✓ | ✓ | |||
Aggregator | ✓ | ✓ | ✓ | ✓ | ✓ | |||
Unified | ✓ | ✓ | ||||||
Logs | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Metrics | ✓ | ⚠ | ⚠ | ⚠ | ⚠ | ⚠ | ⚠ | ✓ |
Traces | 🚧 | |||||||
Open | ✓ | ✓ | ✓ | ✓ | ||||
Open-source | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||
Vendor-neutral | ✓ | ✓ | ✓ | ✓ | ||||
Reliability | ✓ | |||||||
Memory-safe | ✓ | ✓ | ||||||
Delivery guarantees | ✓ | ✓ | ✓ | |||||
Multi-core | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
⚠ = Not interoperable, metrics are represented as structured logs
Developed with ❤️ byDatadog -Security Policy -Privacy Policy
About
A high-performance observability data pipeline.
Topics
Resources
License
MPL-2.0, Unknown licenses found
Licenses found
Code of conduct
Security policy
Uh oh!
There was an error while loading.Please reload this page.
Stars
Watchers
Forks
Uh oh!
There was an error while loading.Please reload this page.