Apache DataFusion SQL Query Engine

• UpdatedMar 17, 2025
• Rust

the portable Python dataframe library

• UpdatedMar 18, 2025
• Python

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

• UpdatedFeb 17, 2025
• Rust

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

• UpdatedMar 13, 2025
• Java

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

• UpdatedMar 17, 2025
• Rust

Apache DataFusion Comet Spark Accelerator

• UpdatedMar 17, 2025
• Rust

LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive (AI) workloads.

• UpdatedMar 18, 2025
• Rust

DuckDB-powered data lake analytics from Postgres

• UpdatedMar 5, 2025
• Rust

Analytical database for data-driven Web applications 🪶

• UpdatedFeb 25, 2025
• Rust

High-performance Rust stream processing engine, providing powerful data stream processing capabilities, supporting multiple input/output sources and processors.

• UpdatedMar 17, 2025
• Rust

Next-generation decentralized data lakehouse and a multi-party stream processing network

• UpdatedMar 17, 2025
• Rust

Rust implementation of Apache Iceberg with integration for Datafusion

• UpdatedMar 17, 2025
• Rust

Batteries included CLI, TUI, and server implementations for DataFusion.

• UpdatedMar 17, 2025
• Rust

Query and transform data with PRQL

• UpdatedSep 23, 2023
• Rust

Java binding to Apache DataFusion

• UpdatedMar 17, 2025
• Java

A lightweight Logging and Tracing observability solution for Rust, built with Apache Arrow, Apache Parquet and Apache DataFusion.

• UpdatedSep 18, 2024
• Rust

etl engine 轻量级 跨平台 流批一体ETL引擎 数据抽取-转换-装载 ETL engine lightweight cross platform batch flow integration ETL engine data extraction transformation loading

• UpdatedDec 1, 2024
• Go

S3 as an ObjectStore for DataFusion

• UpdatedMar 12, 2023
• Rust

A Python library to run analytics workloads with the performance of Rust, the flexibility of Python and O(1) cost in moving data between the two. Uses Apache Arrow in-memory format and respective query engine DataFusion.

• UpdatedMay 6, 2021
• Rust

10x lower latency for cloud-native DataFusion

• UpdatedMar 18, 2025
• Rust