Implementing best practices for PySpark ETL jobs and applications.

• UpdatedJan 1, 2023
• Python

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

• UpdatedMar 9, 2020
• Python

Mass processing data with a complete ETL for .net developers

• UpdatedMar 17, 2025
• C#

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

• UpdatedMay 29, 2024
• C#

A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.

• UpdatedFeb 17, 2025
• TSQL

• UpdatedOct 28, 2024
• HTML

Terraform modules for provisioning and managing AWS Glue resources

• UpdatedFeb 2, 2025
• HCL

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

• UpdatedAug 4, 2021
• HCL

This repo will guide you step-by-step method to create star schema dimensional model.

• UpdatedJun 1, 2021
• Python

A Python PySpark Projet with Poetry

• UpdatedSep 16, 2024
• Jupyter Notebook

A declarative, SQL-like DSL for data integration tasks.

• UpdatedJul 4, 2018
• Go

An end-to-end Twitter Data Pipeline that extracts data from Twitter and loads it into AWS S3.

• UpdatedAug 26, 2023
• Python

Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE

• UpdatedDec 19, 2022
• Python

Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and transforms the raw data (ETL process) using Apache spark to meet business requirements and also enables Data Analyst create Data Visualization using Superset. Airflow is used to orchestrate the pipeline

• UpdatedMay 25, 2023
• Python

This is a PHP project which combines ETL with different strategies to extract data from multiple databases, files, and services, transform it and load it into multiple destinations.

• UpdatedApr 19, 2023
• PHP

Introduction to the data pipeline management with Airflow. Airflow schedule and maintain numerous ETL processes running on a large scale Enterprise Data Warehouse.

• UpdatedNov 26, 2018
• Python

A simple in-memory, configuration driven, data processing pipeline for Apache Spark.

• UpdatedDec 20, 2022
• Scala

Sentiment Analysis of Tweets Using ETL process and Elastic Search

• UpdatedJun 7, 2018
• Python

Comms processing (ETL) with Apache Flink.

• UpdatedOct 19, 2020
• Java

Telecom ETL is a SSIS package that ingest it's data from CSVs to DB

• UpdatedOct 28, 2022
• TSQL