kafka

Here are 14,905 public repositories matching this topic...

Language:All

Filter by language

All14,905 Java5,011 Python2,213 Go1,429 TypeScript938 JavaScript754 Scala591 Shell570 Jupyter Notebook444 C#398 Kotlin316

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

pathwaycom /pathway

Star50.7k

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

python rust streaming real-time kafka etl machine-learning-algorithms stream-processing data-analytics dataflow data-processing data-pipelines batch-processing pathway iot-analytics etl-framework time-series-analysis

UpdatedDec 17, 2025
Python

DataTalksClub /data-engineering-zoomcamp

Star33.9k

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼

docker course kafka spark data-engineering free dbt kestra

UpdatedDec 16, 2025
Jupyter Notebook

apache /kafka

Star31.6k

Mirror of Apache Kafka

scala kafka

UpdatedDec 17, 2025
Java

thingsboard /thingsboard

Star20.6k

Open-source IoT Platform - Device management, data collection, processing and visualization.

visualization java platform mqtt iot coap middleware cloud microservices kafka dashboard netty snmp websockets widgets iot-platform lwm2m thingsboard iot-analytics iot-solutions

UpdatedDec 17, 2025
Java

yudaocode /SpringBoot-Labs

Star20k

一个涵盖六个专栏：Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖，右上角来个 Star，感恩 1024

kafka spring-boot rabbitmq spring-cloud activemq dubbo rocketmq spring-cloud-alibaba

UpdatedApr 28, 2024
Java

heibaiying /BigData-Notes

Star16.8k

大数据入门指南 ⭐

phoenix scala kafka big-data spark yarn hive hadoop storm bigdata hbase zookeeper hdfs mapreduce flume azkaban sqoop

UpdatedJan 5, 2024
Java

influxdata /telegraf

Star16.6k

Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

golang mqtt json kafka monitoring influxdb time-series metrics logs modbus telegraf xpath hacktoberfest windows-eventlog opcua gnmi windows-management-instrumentation

UpdatedDec 17, 2025
Go

flink learning blog.http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

mysql redis elasticsearch streaming kafka spark influxdb rabbitmq clickhouse hbase stream-processing opentsdb loki flink rocketmq

UpdatedMar 12, 2025
Java

aalansehaiyang /technology-talk

Star14.7k

【大厂面试专栏】一份Java程序员需要的技术指南，这里有面试题、系统架构、职场锦囊、主流中间件等，让你成为更牛的自己！

git java kafka spark spring es6 hbase springboot dubbo mycat

UpdatedJul 21, 2025

sogou /workflow

Star14.2k

C++ Parallel Computing and Asynchronous Networking Framework

mysql redis http kafka consul dag sogou tasking

UpdatedDec 1, 2025
C++

IBM /sarama

Star12.3k

Sarama is a Go library for Apache Kafka.

go kafka kafka-client

UpdatedDec 17, 2025
Go

debezium /debezium

Star12.2k

Change data capture for a variety of databases. Please log issues athttps://github.com/debezium/dbz/issues.

database kafka kafka-connect apache-kafka kafka-producer cdc hacktoberfest data-pipeline change-data-capture debezium event-streaming

UpdatedDec 17, 2025
Java

yahoo /CMAK

Star11.9k

CMAK is a tool for managing Apache Kafka clusters

scala kafka big-data cluster-management

UpdatedAug 2, 2023
Scala

provectus /kafka-ui

Star11.7k

Open-Source Web UI for Apache Kafka Management

opensource kafka big-data web-ui streams kafka-connect apache-kafka kafka-producer kafka-client kafka-streams hacktoberfest streaming-data kafka-manager kafka-cluster event-streaming cluster-management kafka-ui kafka-brokers

UpdatedJul 26, 2024
Java

kubeshark /kubeshark

Star11.6k

API traffic analyzer for Kubernetes, providing deep packet inspection with complete API and Kubernetes contexts, retaining cluster-wide L4 traffic (PCAP), and using minimal production compute resources.

go docker kubernetes redis golang devops microservices kafka rest microservice amqp incident-response grpc sniffer forensics wireshark cloud-native devops-tools observability microservices-application

UpdatedDec 16, 2025
Go

redpanda-data /redpanda

Star11.5k

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

go kubernetes streaming microservices kafka cpp seastar storage-engine containers realtime stream-processing event-driven redpanda

UpdatedDec 17, 2025
C++

wangzhiwubigdata /God-Of-BigData

Star10.4k

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

kafka spark hive hadoop bigdata hbase zookeeper hdfs flume flink azkaban

UpdatedAug 7, 2023

ThreeDotsLabs /watermill

Star9.3k

Building event-driven applications the easy way in Go.

go golang events reactive kafka cqrs sagas rabbitmq event-sourcing nats stream-processing event-driven watermill

UpdatedNov 28, 2025
Go

AutoMQ /automq

Star8.7k

AutoMQ is a diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.

kafka serverless diskless automq