Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

• UpdatedJul 18, 2025
• Go

Kubernetes-native platform to run massively parallel data/streaming jobs

• UpdatedNov 11, 2025
• Rust

A search engine which can hold 100 trillion lines of log data.

• UpdatedMay 22, 2017
• Go

Efficient transducers for Julia

• UpdatedNov 9, 2025
• Julia

Fundamentals of Spark with Python (using PySpark), code examples

• UpdatedOct 29, 2022
• Jupyter Notebook

Parallelized Base functions

• UpdatedNov 9, 2025
• Julia

Demonstration of using Python to process the Common Crawl dataset with the mrjob framework

• UpdatedApr 1, 2022
• Python

Data science and Big Data with Python

• UpdatedAug 27, 2023
• Jupyter Notebook

Fast & furious GroupBy operations for dask.array

• UpdatedNov 1, 2025
• Python

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

• UpdatedNov 21, 2021
• Python

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

• UpdatedNov 11, 2016
• Python

Data-parallelism on CUDA using Transducers.jl and for loops (FLoops.jl)

• UpdatedMay 30, 2023
• Julia

The core parallel and shared memory library used by Hack, Flow, and Pyre

• UpdatedFeb 27, 2021
• OCaml

pingcap 面试小作业

• UpdatedAug 28, 2020
• Go

• UpdatedJan 20, 2022
• Julia

RedisGears python client

• UpdatedJun 19, 2023
• Python

A lightweight modern map reduce framework brought to k8s

• UpdatedApr 2, 2025
• Go

There are Python 2.7 codes and learning notes for Spark 2.1.1

• UpdatedAug 21, 2018
• Python

Inverted Indexer, web crawler, sort, search and poster steamer written using Python for information retrieval.

• UpdatedNov 9, 2024
• HTML

Appengine Datastore Mapper in Go

• UpdatedMar 20, 2017
• Go