PinnedLoading

1. iot-elt-airflow-mongo-timescaledbiot-elt-airflow-mongo-timescaledbPublic

   Modern ELT for processing IOT smart watch Fitbit data from MongoDB to Timescaledb using Airflow (dbt, dlt).

   Python 3

2. kafka-stream-aggregatorkafka-stream-aggregatorPublic

   Compute aggregate metrics (i.e. EWMA) on Kafka streams with Rust. Use CDC Kafka Connect to stream raw data into Postgres. Monitor RDBMS & queue latencies via pgAdmin/AKHQ.

   Rust 5 1

3. dicom-etl-dagster-snowflakedicom-etl-dagster-snowflakePublic

   ETL for processing DICOM files using Dagster, DBT, PySpark and storing data on S3, Snowflake.

   Python 7