bigdata

Star

Here are 2,261 public repositories matching this topic...

Language:All

Filter by language

All2,261 Jupyter Notebook427 Python381 Java343 Scala156 HTML102 JavaScript88 Shell85 Go53 TypeScript32 R28

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

DataExpert-io /data-engineer-handbook

Star35.6k

This is a repo with links to everything you'd ever want to learn about data engineering

data awesome sql bigdata dataengineering apachespark

UpdatedJul 17, 2025
Jupyter Notebook

taosdata /TDengine

Star24.1k

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

iot sql database monitoring time-series metrics cluster bigdata scalability distributed cloud-native financial-analysis tsdb time-series-database connected-vehicles industrial-iot tdengine

UpdatedJul 18, 2025
C

apache /shardingsphere

Star20.4k

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

mysql sql database bigdata postgresql shard distributed-database encrypt data-pipeline data-encryption database-cluster distributed-transaction read-write-splitting database-middleware distributed-sql-database database-gateway

UpdatedJul 18, 2025
Java

heibaiying /BigData-Notes

Star16.5k

大数据入门指南 ⭐

phoenix scala kafka big-data spark yarn hive hadoop storm bigdata hbase zookeeper hdfs mapreduce flume azkaban sqoop

UpdatedJan 5, 2024
Java

oxnr /awesome-bigdata

Star13.7k

A curated list of awesome big data frameworks, ressources and other awesomeness.

data-science data awesome database data-stream bigdata series-database data-visualization data-warehouse stream-processing data-analytics awesome-list distributed-database visualize-data streaming-data

UpdatedFeb 14, 2025

juicedata /juicefs

Star11.9k

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

go redis golang distributed-systems storage filesystem bigdata s3 posix hdfs cloud-native object-storage

UpdatedJul 17, 2025
Go

wangzhiwubigdata /God-Of-BigData

Star10.2k

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

kafka spark hive hadoop bigdata hbase zookeeper hdfs flume flink azkaban

UpdatedAug 7, 2023

databendlabs /databend

Star8.6k

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics.https://databend.com

rust sql database ai serverless bigdata snowflake olap lakehouse

UpdatedJul 18, 2025
Rust

vaexio /vaex

Star8.4k

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

visualization python data-science machine-learning bigdata tabular-data hdf5 machinelearning dataframe memory-mapped-file pyarrow

UpdatedOct 8, 2024
Python

apache /hudi

Star5.9k

Upserts, Deletes And Incremental Processing on Big Data.

bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink

UpdatedJul 18, 2025
Java

rustfs /rustfs

Star5.6k

🚀 High-performance distributed object storage for MinIO alternative.

rust distributed-systems oss filesystem bigdata s3 minio cloud-native object-storage

UpdatedJul 18, 2025
Rust

volcano-sh /volcano

Star4.8k

A Cloud Native Batch System (Project under CNCF)

training kubernetes golang machine-learning gene ai hpc bigdata serving batch-systems

UpdatedJul 18, 2025
Go

iGaoWei /BigDataView

Star4.3k

100+套大数据可视化炫酷大屏Html5模板；包含行业：社区、物业、政务、交通、金融银行等，全网最新、最多，最全、最酷、最炫大数据可视化模板。陆续更新中

bigdata html-template viewmodel echarts bigdataviewer

UpdatedJul 14, 2025
JavaScript

DTStack /chunjun

Star4.1k

A data integration framework

java framework bigdata data-integration flink

UpdatedMar 5, 2025
Java

liyupi /sql-generator

Star3.5k

🔨 用 JSON 来生成结构化的 SQL 语句，基于 Vue3 + TypeScript + Vite + Ant Design + MonacoEditor 实现，项目简单（重逻辑轻页面）、适合练手~

javascript mysql json typescript sql spark vue hive bigdata monaco-editor ant-design vue3 vite

UpdatedJan 17, 2024
Vue

apache /avro

Star3.1k

Apache Avro is a data serialization system.

ruby python c java php csharp cplusplus avro dotnet perl bigdata

UpdatedJul 18, 2025
Java

MoRan1607 /BigDataGuide

Star3k

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

scala kafka spark hive hadoop bigdata hbase zookeeper flume flink javase

UpdatedJun 6, 2025

douban /dpark

Star2.7k

Python clone of Spark, a MapReduce alike framework in Python

python spark bigdata stream-processing mapreduce dpark

UpdatedDec 25, 2020
Python

griddb /griddb

Star2.4k

GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.

fast iot sql database timeseries time-series nosql bigdata newsql griddb

UpdatedJun 16, 2025
C++

dotnet /spark

Star2.1k

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

microsoft emr machine-learning streaming spark apache-spark csharp fsharp analytics dotnet azure bigdata spark-streaming dotnet-core dotnet-standard databricks spark-sql tpcds hdinsight tpch

UpdatedJul 4, 2025
C#

Improve this page

Add a description, image, and links to thebigdata topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thebigdata topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly