酷玩 Spark: Spark 源代码解析、Spark 类库等

• UpdatedMay 18, 2022
• Scala

Learning Apache spark,including code and data .Most part can run local.

• UpdatedNov 4, 2021
• Scala

Scala examples for learning to use Spark

• UpdatedSep 17, 2020
• Scala

Spark源码分析,主要包含SparkContext源码、Executor进程启动、Stage划分、Task执行和Spark2.0的新特性

• UpdatedJul 7, 2019
• Scala

Spark 2.x 案例操作：Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql、SparkStreaming。同时提供了Spark高级性能优化、序列化、广播变量、数据倾斜、算子优化、JVM优化、troubleshooting、数据倾斜解决方案。是多年来根据工作积累整理出来！

• UpdatedJun 21, 2022
• Java

Smart(kinda) Bathroom

• UpdatedDec 25, 2014
• Arduino

Particle IDE Library for a keypad connected over I2C

• UpdatedMar 14, 2017
• C++

Stranger Things lights driven by SparkCore

• UpdatedFeb 6, 2017
• Arduino

Streaming Twitter data in near real-time using Apache Spark Streaming API

• UpdatedOct 11, 2018
• Java

Problem statement, get the revenue and number of orders from order_items on daily basis.

• UpdatedNov 16, 2016

1. 从hive中读取数据到spark中，对数据进行离线统计，将统计 结果写入到mysql中进行保存。2. 模拟实时生产数据，写入文件，使用flume实时监控文件将数据传输到kafka中保存，再对接kafka-streaming进行实时的数据统计

• UpdatedJan 22, 2021
• JavaScript

sparkSql spark kafka hbase

• UpdatedFeb 1, 2018
• Scala

• UpdatedFeb 12, 2023
• Jupyter Notebook

Earth Similarity Index computation on Spark. Trying to find the most similar-to-earth exoplanets from a NASA dataset.

• UpdatedMay 3, 2020
• Scala

Spark Multi char delimiter using RDD approach

• UpdatedDec 24, 2021
• Scala

This project contains snippets of Scala code for illustrating various Apache Spark concepts. I write all these code when i'm learning spark.

• UpdatedMay 26, 2017
• Scala

Big Data Project such as Spark core, Spark Sql, ...

• UpdatedMar 11, 2025
• Jupyter Notebook