Beginner data engineering project - batch edition

• UpdatedJan 22, 2025
• HTML

Terraform module to create AWS Redshift resources 🇺🇦

• UpdatedNov 16, 2025
• HCL

Use AWS Lambda to Pull E-Scooter and E-Bike Location Data, store in S3 & Redshift using Data Vault Data Model, Server to Google Data Studio Dashboard

• UpdatedJun 12, 2022
• PLpgSQL

This checklist aims to be an exhaustive list of all elements you should consider when using Amazon Redshift.

• UpdatedSep 21, 2020

Data Warehouse with AWS Redshift and Visualizing data using Power BI

• UpdatedJan 21, 2023
• Jupyter Notebook

Simple getting started 1-node redshift cluster stack

• UpdatedDec 31, 2020
• Python

Building and executing end-to-end ELT pipeline and driving analytics using Amazon Redshift as the data warehouse solution.

• UpdatedJul 2, 2022

The idea is how can we prepare data to be used by Business Intelligence applications like Tableu or even Jupyternotebook! 👍 In order to help the business see an overview of the data in a diagram of what important features of the product their customers might be using. Mainly, how can we improve the performance of these OLAP and OLTP transactions…

• UpdatedAug 29, 2020
• Jupyter Notebook

Sparkify - Data Pipelines with Airflow - Udacity Data Engineering Expert Track.

• UpdatedJan 17, 2023
• Python

In this project, an ETL pipeline is built for a database hosted on Redshift. In this project, data from S3 is loaded to staging tables on Redshift and execute SQL statements that create the analytics tables from these staging tables.

• UpdatedSep 8, 2020
• Python

Health Synth simplifies healthcare with unified data, automated notifications, and patient feedback and monitoring the reports for better care and efficiency.

• UpdatedDec 1, 2024
• Go

• UpdatedJun 27, 2021
• Jupyter Notebook

Deploy an Amazon Redshift Cluster in AWS using Terraform

• UpdatedJan 29, 2023
• HCL

Airflow orchestrated ETL (running in docker containers) that pulls batch data from an API to a local Postgres database, loads to AWS S3/Redshift provisioned by Terraform, and visualized in Quicksight.

• UpdatedMay 5, 2023
• Python

Udacity Course, Data Engineering Nanodegree, 3rd Project, Data Warehouse with Amazon Redshift

• UpdatedNov 30, 2021
• Jupyter Notebook

An end-to-end AWS data engineering pipeline for processing, and visualizing historical climate data for Russia.

• UpdatedApr 28, 2025
• HCL

This project builds a cloud-based ETL pipeline for Sparkify to move data to a cloud data warehouse. It extracts song and user activity data from AWS S3, stages it in Redshift, and transforms it into a star-schema data model with fact and dimension tables, enabling efficient querying to answer business questions.

• UpdatedSep 9, 2024
• Jupyter Notebook

Data Pipeline with Apache Airflow

• UpdatedSep 28, 2022
• Python

Udacity Data Engineering project: Data Warehouse

• UpdatedFeb 14, 2021
• Python

This project is a data warehousing solution for Sparkify, a music streaming service to extract data from JSON logs and stores it in a star schema data model in Amazon Redshift.

• UpdatedFeb 24, 2023
• Python