lakeFS - Data version control for your data lake | Git for data

• UpdatedFeb 19, 2026
• Go

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

• UpdatedFeb 20, 2026
• Python

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

• UpdatedFeb 14, 2026
• Scala

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

• UpdatedAug 26, 2022
• Python

BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.

• UpdatedJan 1, 2024
• Java

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

• UpdatedMar 9, 2020
• Python

Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.

• UpdatedFeb 20, 2026
• Rust

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

• UpdatedJan 12, 2023
• Java

Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.

• UpdatedFeb 20, 2026
• Java

Personal Data Engineering Projects

• UpdatedFeb 8, 2023
• Jupyter Notebook

An efficient storage and compute engine for both on-prem and cloud-native data analytics.

• UpdatedFeb 20, 2026
• Java

Data API Framework for AI Agents and Data Apps

• UpdatedJul 1, 2024
• TypeScript

🤖 The Semantic Engine for Model Context Protocol(MCP) Clients and AI Agents 🔥

• UpdatedFeb 16, 2026
• Java

Generic Data Ingestion & Dispersal Library for Hadoop

• UpdatedMar 19, 2023
• Java

Enterprise-grade, production-hardened, serverless data lake on AWS

• UpdatedOct 1, 2025
• Python

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

• UpdatedNov 5, 2020
• Jupyter Notebook

GigAPI is a Timeseries lakehouse for real-time data and sub-second queries, powered by DuckDB OLAP + Parquet Query Engine, Compactor w/ Cloud-Native Storage. Drop-in FDAP alternative ⭐

• UpdatedOct 20, 2025
• Go

Use SQL to build ELT pipelines on a data lakehouse.

• UpdatedMay 25, 2022
• JavaScript

BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)

• UpdatedApr 7, 2025
• C++

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

• UpdatedJan 24, 2026
• Python