lambda-architecture

Basic logging mechanism for Node.js Lambda Functions and other AWS services, which produces logs in JSON format for easier reading through Cloudwatch Logs.

nodejs metadata aws json lambda cloud node aws-lambda log serverless logger logging lambda-functions cloudwatch error-handling lambda-architecture lambda-log

UpdatedApr 18, 2023
JavaScript

apssouza22 /big-data-pipeline-lambda-arch

Star179

A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.

spark bigdata lambda-architecture

UpdatedJun 27, 2025
Java

malleum-inc /canari3

Star144

Canari v3 - next gen Maltego framework for rapid remote and local transform development

python docker framework aws-lambda python3 tds maltego rapid-development lambda-architecture maltego-transformations canari

UpdatedApr 21, 2021
Python

dwyl /phoenix-ecto-append-only-log-example

Star82

📝 A step-by-step example/tutorial showing how to build a Phoenix (Elixir) App where all data is immutable (append only). Precursor to Blockchain, IPFS or Solid!

tutorial elixir phoenix howto learn elixir-lang elixir-phoenix lambda-architecture append-only kappa-architecture

UpdatedApr 25, 2019
Elixir

NashTech-Labs /Lambda-Arch-Spark

Star75

kafka spark cassandra apache-spark lambda-architecture

UpdatedJun 27, 2020
Scala

ymericson /big-data-streets

Star41

Big Data webapp using Chicago street congestion, crashes, red light violations, and speed camera violations

scala kafka spark hive hbase lambda-architecture

UpdatedJan 9, 2021
Scala

ivarvermeulen /nuxt-serverless-at-edge

Star35

Nuxt.js Serverless SSR using Cloudfront, Lambda@edge and S3

aws-lambda serverless server-side-rendering cloudfront nuxtjs lambda-architecture lambda-edge nuxt-demo

UpdatedJan 3, 2023
Vue

sanchitvj /sports_betting_analytics_engine

Star32

A data and analytics engineering platform designed for real-time sports betting analytics.

aws airflow kafka grafana snowflake data-engineering spark-streaming druid dbt cdc lambda-architecture sports-betting analytics-engineering olap-database betflow

UpdatedMar 21, 2025
Python

Smart-Shaped /chaM3Leon

Star28

By Smart Shaped s.r.l. (https://www.smartshaped.com/)

java machine-learning big-data apache-spark spring-boot maven data-engineering apache-kafka data-preprocessing data-processing data-pipeline lambda-architecture hadoop-hdfs mlops apache-sedona

UpdatedJul 2, 2025
Java

data-mill-cloud /data-mill

Star24

A K8s-based infrastructure for analytics

infrastructure data-science machine-learning streaming spark analytics data-lake k8s lambda-architecture data-mill

UpdatedJan 15, 2020
Shell

dorianbg /lambda-architecture-demo

Star23

Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python

python kafka spark-streaming lambda-architecture tweepy-api

UpdatedMar 8, 2020
Jupyter Notebook

hmmhmmhm /serverless-ts-template

Star15

Serverless Typescript Template

nodejs javascript npm lambda typescript serverless lambda-functions serverless-functions serverless-framework lambda-architecture serverless-examples

UpdatedJan 9, 2023
TypeScript

aymane-maghouti /Big-Data-Project

Star14

This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.

python java machine-learning streaming apache-spark spring-boot hbase pyspark hdfs ingestion apache-kafka postgresql-database powerbi batch-processing lambda-architecture apache-airflow big-data-projects