• I have a background in Computer Science ✌️

• I have 5+ years of experience working with Data in various capacities - Credit risk data scientist, Software Engineer (MLOPS), Data Engineer ✌️

• I have 1 year+ work experience in doing data science for fintech 🏦

• I have 1+ years experience doing software engineering professionally with a focus on building data centric products 🚀

• I have ~3 years experience as a Data engineer with expeience a variety of industries 🚀

• I am currently learning about software design patterns in python 🚀

• I am currently exploring the modern data stack in a truly open source way 🚀

• My Long term goal is to become a full stack Data Engineer 🔥 🔥

PinnedLoading

1. CruiseCruisePublic

   Easily Deploy your Tensorflow models to Heroku with just the click of a button!

   Shell 9 7

2. dagster-lakehouse-eltdagster-lakehouse-eltPublic

   an implementation of an Ingestion framework for lakehouses using dagster, dlthub, slingdata, trino, dremio and minio

   Python 1

3. CDCraftCDCraftPublic

   Simulate PostgreSQL Change Data Capture with realistic inserts, updates, deletes, and optional schema evolution. Ideal for testing CDC pipelines, Debezium connectors, and streaming systems.

   Python 2

4. kafka-sparkkafka-sparkPublic

   exploring CDC with Debezium, Kafka Connect, Spark structured streaming and Lakehouses

   Dockerfile

5. etl-helpersetl-helpersPublic

   helper functions/ public script dump to help accelerate custom ELT pipeline development

   Python 1

6. faux-geniefaux-geniePublic

   e-commerce fake user events data generator

   Python 1