💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

• UpdatedApr 15, 2021
• Scala

Real-time Machine Learning with Apache Spark on Twitter Public Stream

• UpdatedApr 27, 2017
• Python

全套大数据基础学习教程，包含最基础的centos、maven。大数据主要包含hdfs、mr、yarn、hbase、kafka、scala、sparkcore、sparkstreaming、sparksql。教程包含所有的源代码演示以及在线文档说明。

• UpdatedOct 4, 2022
• Scala

SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失

• UpdatedAug 2, 2017
• Scala

💥 👽 ♨️🚀Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等

• UpdatedDec 18, 2019
• Scala

Spark 2.x 案例操作：Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql、SparkStreaming。同时提供了Spark高级性能优化、序列化、广播变量、数据倾斜、算子优化、JVM优化、troubleshooting、数据倾斜解决方案。是多年来根据工作积累整理出来！

• UpdatedJun 21, 2022
• Java

电影推荐系统，包括基于ALS、LFM的离线推荐、实时推荐，基于Spark

• UpdatedDec 16, 2020
• Scala

Spark in Action, 2e - chapter 10 - Ingestion through structured streaming

• UpdatedJan 4, 2022
• Java

A Simple Real-Time Detector of DDOS Attacks with Apache Kafka And Spark Streaming

• UpdatedApr 5, 2017
• Python

spark salesforce connector

• UpdatedFeb 23, 2021
• Scala

Apache Spark machine learning project using pyspark

• UpdatedJul 30, 2020
• Jupyter Notebook

A Realtime Stock Portfolio Manager built using Apache Distributed Technologies!

• UpdatedApr 10, 2017
• Python

A real-time sales data analysis Application using Spark Structured Streaming, Kafka as a messaging system, PostgreSQL as a storage for processed data, and Superset for creating a dashboard.

• UpdatedNov 26, 2023
• Python

A Dockerized Kafka system for streaming server metrics and load balancer logs, with data processing using Spark and storage in a relational database and Hadoop.

• UpdatedAug 2, 2024
• Java

The project aims to design and implement a real-time movie recommendation system using the EK Stack (Elasticsearch and Kibana), Kafka, and a personalized recommendation API to enhance the user experience on Jay-Zz Entertainment's streaming platform.

• UpdatedNov 18, 2023

Big Data Project - SSML - Spark Streaming for Machine Learning

• UpdatedDec 31, 2021
• Python

write , append avro to hdfs file

• UpdatedMar 22, 2017
• Scala

SparkStreaming新手友好向模板，简化SparkStreaming开发

• UpdatedJun 21, 2022
• Java

This is a repository i have created to put up some of the knowledge i have gained around Big Data Technologies especially Spark, GraphX etc.

• UpdatedApr 20, 2019

• UpdatedApr 3, 2018
• Python