etl-framework
Here are 242 public repositories matching this topic...
Language:All
Sort:Most stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- Updated
Dec 17, 2025 - Python
Logstash - transport and process your logs, events, or other data
- Updated
Dec 17, 2025 - Java
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
- Updated
Dec 17, 2025 - Go
Flow-based programming for JavaScript
- Updated
Apr 7, 2024 - JavaScript
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
- Updated
Dec 6, 2025 - Jupyter Notebook
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
- Updated
Mar 9, 2020 - Python
This repository is a getting started guide to Singer.
- Updated
Aug 8, 2025 - Makefile
Making data lake work for time series
- Updated
Aug 21, 2024 - Python
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TOwww.github.com/dagworks-inc/hamilton
- Updated
Jul 3, 2023 - Python
SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).
- Updated
Nov 5, 2025 - Java
A simplified, lightweight ETL Framework based on Apache Spark
- Updated
Jan 24, 2024 - Scala
Extract, Transform, Load: Any SQL Database in 4 lines of Code.
- Updated
May 23, 2019 - Python
Knowledge Graph Toolkit
- Updated
Jun 25, 2025 - Jupyter Notebook
A tool for building feature stores.
- Updated
Jun 30, 2025 - Python
A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
- Updated
Dec 12, 2025 - Python
Bender - Serverless ETL Framework
- Updated
Dec 19, 2023 - Java
Structured Data Extractor for AI Agents. Search your documents or the web for specific data and get it back in JSON or Markdown in a single tool call.
- Updated
Mar 29, 2025 - Python
Configurable Extract, Transform, and Load
- Updated
May 15, 2025 - C#
Improve this page
Add a description, image, and links to theetl-framework topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with theetl-framework topic, visit your repo's landing page and select "manage topics."