Amazon EventBridge Pipes
Integrate event producers and consumers in a simpler, consistent, and cost-effective way
Amazon EventBridge Pipes helps you create point-to-point integrations between event producers and consumers with optional transform, filter and enrich steps. EventBridge Pipes reduces the amount of integration code you need to write and maintain when building event-driven applications.
How it works
The diagram shows how Amazon EventBridge Pipes works.
The first step is tilted “Source” and says “pull events from a supported AWS service.” The first illustration is a list of Amazon sources including: Amazon SQS, Amazon Kinesis Data Streams, Amazon DynamoDB, Amazon MSK, and Amazon MQ.
The next step is titled “Amazon EventBridge Pipes” and says “Filter, enrich, and transform your events.”
The illustration is the EventBridge logo.
The next step is titled “Filter” and says “Choose which events to keep.” The illustration is a funnel.
The next step is titled “Enrich and transform” and says “Restructure, modify, or pull additional data into your account.” The illustration is a list of Amazon Services including: AWS Lambda, AWS Step Functions, Amazon API Gateway, and Amazon EventBridge API Destinations.
The last step is titled “Target” and says “Send your event to one of over 14 AWS services.” The last illustration is a list of AWS services including: Amazon EventBridge, Amazon Kinesis Data Streams, AWS Step Functions, Amazon API Gateway, and Amazon SQS.
Use cases
Filter Amazon Kinesis Data Streams
Use EventBridge Pipes event filters to select specific high-value events from your Kinesis Data Streams, enabling you to only process the events you need.
React to Amazon DynamoDB changes in real-time
Connect DynamoDB to over 14 AWS services, including Amazon Simple Notification Service (SNS) or EventBridge to easily propagate database changes to multiple applications.
Connect self-hosted Apache Kafka to AWS
Move data from your on-premises or self-hosted Kafka topics to AWS services such as Amazon Kinesis Data Firehose or Amazon Simple Queue Service (SQS).
Enrich your events with software as a service (SaaS) apps
Add more data to an event by making an API call to a third-party API before delivering the event to a target.
Features
Filter Events
Ensure your applications process only the necessary events, so that you consume only a subset of events.
Batch Events
Retrieve events from sources and deliver to targets in batches, making integrations more efficient.
Order Events
Provide guaranteed ordering of events for applications where the ordering is critical.
High Concurrency
Support high concurrency, so you can process large volumes of events quickly.
Advanced Enrichment
Provide enrichment capabilities using AWS Lambda, AWS Step Functions, API Gateway, or an API call to a third-party API using API Destinations.