Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization

• UpdatedJul 16, 2023
• Jupyter Notebook

Local SQL Database ---> Azure ---> Power BI

• UpdatedOct 13, 2023
• Jupyter Notebook

Generic Pipelines / Templates for Data Factory / Synapse Pipelines w.r.t Different MSFT Offering Integrations / Use Cases

• UpdatedJul 15, 2025

Explore the Tokyo Olympics data journey! We ingested a GitHub CSV into Azure via Data Factory, stored it in Data Lake Storage Gen2, performed transformations in Databricks, conducted advanced analytics in Azure Synapse, and visualized insights in Synapse or Power BI.

• UpdatedFeb 7, 2024
• Jupyter Notebook

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2022LT Database.

• UpdatedJan 24, 2024
• Jupyter Notebook

Ingested Tokyo Olympic data into Azure Data Lake using Azure Data Factory. Enhanced data quality with Apache Spark on Azure Databricks. Optimized SQL queries on Synapse Analytics, reducing execution time. Developed engaging Power BI dashboards, boosting user engagement creating KPI's with DAX.

• UpdatedMar 5, 2024
• Jupyter Notebook

This project aims to predict customer booking behaviors by classifying them into three categories: Booked and Canceled Booked and Checked Out Booked and Did Not Show

• UpdatedOct 18, 2024
• Python

Practice with Azure Synapse Analytics/Databricks Pipeline

• UpdatedNov 25, 2022

Create high-quality data pipelines using Azure

• UpdatedApr 27, 2025

A spark reader to read the Common Event Format (CEF) built using Scala and SBT and optimised for Databricks workloads

• UpdatedOct 28, 2023
• Scala

Azure_Synapse_Project_NYC_TAXI_DATA--Sayantan Barat

• UpdatedSep 30, 2022
• TSQL

• UpdatedNov 15, 2022
• TSQL

Contains solutions/versions of Batch Data Pipelines created on Azure Data Factory

• UpdatedOct 26, 2022

• UpdatedJan 5, 2023
• TSQL

Implemented an end-to-end Azure data engineering solution to process Tokyo Olympics 2021 data, encompassing extraction, transformation, analytics, and visualization.

• UpdatedFeb 12, 2024
• Jupyter Notebook

Examples & Solutions from Azure Synapse course

• UpdatedFeb 7, 2023

The repo simulates query load, optimizes performance, and offers practical guidance for building data warehouses with Azure Synapse Analytics. 🚀

• UpdatedApr 21, 2024
• TSQL

This Python-based project extracts data from Wikipedia using Apache Airflow, cleans it and pushes it Azure Data Lake for processing and further processing and visualization is done on Tableau.

• UpdatedNov 25, 2024
• Python

Built a pipeline to scrape, clean, and analyze Trustpilot reviews, then load results into Azure Synapse and archive them in Azure Blob Storage. It runs on WSL and is fully orchestrated with Apache Airflow.

• UpdatedApr 14, 2025
• Python

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Artificial Intelligence topics.

• UpdatedOct 1, 2024