data-engineering
Here are 6,001 public repositories matching this topic...
Language:All
Sort:Most stars
Apache Superset is a Data Visualization and Data Exploration Platform
- Updated
Dec 17, 2025 - TypeScript
Learn how to design, develop, deploy and iterate on production-grade ML applications.
- Updated
Aug 18, 2024 - Jupyter Notebook
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
- Updated
Dec 17, 2025 - Python
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
- Updated
Jul 18, 2024
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
- Updated
Dec 17, 2025 - Python
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
- Updated
Dec 17, 2025 - Python
Turns Data and AI algorithms into production-ready web applications in no time.
- Updated
Dec 2, 2025 - Python
Workflow Engine for Kubernetes
- Updated
Dec 17, 2025 - Go
The Data Engineering Cookbook
- Updated
Oct 6, 2025 - Python
An orchestration platform for the development, production, and observation of data assets.
- Updated
Dec 17, 2025 - Python
Roadmap to becoming a data engineer in 2021
- Updated
Jan 25, 2022
Always know what to expect from your data.
- Updated
Dec 17, 2025 - Python
🐚 Python-powered shell. Full-featured and cross-platform.
- Updated
Dec 17, 2025 - Python
Streaming data platform. Real-time stream processing, low-latency serving, and Iceberg table management.
- Updated
Dec 17, 2025 - Rust
🧙 Build, run, and manage data pipelines for integrating and transforming data.
- Updated
Dec 16, 2025 - Python
Fancy stream processing made operationally mundane
- Updated
Dec 17, 2025 - Go
Open Source Feature Flagging and A/B Testing Platform
- Updated
Dec 17, 2025 - TypeScript
The Open Source Feature Store for AI/ML
- Updated
Dec 17, 2025 - Python
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
- Updated
Dec 17, 2025 - Go
Improve this page
Add a description, image, and links to thedata-engineering topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with thedata-engineering topic, visit your repo's landing page and select "manage topics."