End-to-end data pipeline transforming Olist e-commerce data through Azure cloud services. Implements medallion architecture (Bronze-Silver-Gold) with multi-source ingestion, Spark-based processing, and OLTP-to-OLAP optimization for analytics-ready datasets.

• UpdatedNov 4, 2025
• Jupyter Notebook

FabricEngineer is a comprehensive Python package designed specifically for Microsoft Fabric developers to streamline data transformation workflows and automate complex ETL processes. This package provides enterprise-grade solutions for building robust data pipelines with minimal boilerplate code.

• UpdatedAug 27, 2025
• Jupyter Notebook

A full-stack financial application featuring real-time forex rates and machine learning-powered price predictions across multiple currency pairs. Built with automated data pipelines and Prophet time series forecasting.

• UpdatedOct 29, 2025
• Jupyter Notebook

A complete reference implementation of a local-first ecosystem for AI-powered analytics. This repository contains the source code for the SBDK.dev website, the central hub for the SBDK suite of open-source tools.

• UpdatedNov 25, 2025
• TypeScript

End-to-End PV Monitoring & Streaming Pipeline with Delta Lake

• UpdatedAug 12, 2025

An end-to-end, multi-container solution for collecting and visualizing stock market data

• UpdatedNov 21, 2025
• Python

Data automation involves automating the extraction, transformation, and loading (ETL) processes to streamline data workflows. GitHub Actions enables automated execution of tasks, such as building, testing, and deploying code, in response to events. This integration simplifies continuous deployment and ensures repeatable data pipeline operations

• UpdatedFeb 25, 2025
• HTML

Automated data pipeline scraping fuel prices daily, apply transformations and load the data to a PostgreSQL database.

• UpdatedDec 4, 2025
• Python

“End-to-end data engineering pipeline for real-time weather data using Python, PostgreSQL, and Streamlit.”

• UpdatedNov 14, 2025
• Python

This project is an end-to-end machine learning pipeline for predicting diamond prices based on various features. It includes data preprocessing, model training, and prediction scripts, and is designed for easy setup and use by anyone familiar with Python and data science.

• UpdatedJul 26, 2025
• Jupyter Notebook

Automated pipeline to scrape and compare gaming gear prices & ratings from Amazon and eBay, including laptops, mice, Nintendo Switch, PS5, and Xbox. Outputs daily CSVs, SQL-ready datasets, and marketplace insights for competitive analysis.

• UpdatedSep 20, 2025
• Jupyter Notebook