the portable Python dataframe library

• UpdatedDec 16, 2025
• Python

Simple and Distributed Machine Learning

• UpdatedDec 15, 2025
• Scala

State of the Art Natural Language Processing

• UpdatedDec 16, 2025
• Scala

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

• UpdatedNov 29, 2025
• Java

Implementing best practices for PySpark ETL jobs and applications.

• UpdatedJan 1, 2023
• Python

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

• UpdatedDec 16, 2025
• Python

A curated list of awesome Apache Spark packages and resources.

• UpdatedOct 24, 2024
• Shell

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

• UpdatedMar 16, 2024
• Jupyter Notebook

SQL data analysis & visualization projects using MySQL, PostgreSQL, SQLite, Tableau, Apache Spark and pySpark.

• UpdatedJul 18, 2022
• Jupyter Notebook

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

• UpdatedDec 2, 2024
• Python

Lightweight and extensible compatibility layer between dataframe libraries!

• UpdatedDec 17, 2025
• Python

Jupyter magics and kernels for working with remote Spark clusters

• UpdatedSep 9, 2025
• Python

Hopsworks - Data-Intensive AI platform with a Feature Store

• UpdatedFeb 10, 2025
• Java

PySpark-Tutorial provides basic algorithms using PySpark

• UpdatedMay 26, 2025
• Jupyter Notebook

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

• UpdatedDec 6, 2025
• Scala

LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.

• UpdatedDec 17, 2025
• Rust

MapReduce, Spark, Java, and Scala for Data Algorithms Book

• UpdatedOct 14, 2024
• Java

Sparkling Water provides H2O functionality inside Spark cluster

• UpdatedNov 5, 2025
• Scala

pyspark🍒🥭 is delicious，just eat it!😋😋

• UpdatedSep 22, 2022
• Python

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

• UpdatedDec 11, 2024
• Vue