An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

• UpdatedNov 25, 2024
• Python

A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.

• UpdatedAug 21, 2023
• Python

An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL database.

• UpdatedJun 30, 2024
• Python

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.

• UpdatedMar 14, 2025
• Python

Reference implementations for orchestration project using Astronomer/Airflow

• UpdatedMar 3, 2025
• Python

An example project of how to use local devcontainers with the Astronomer Astro platform

• UpdatedMay 27, 2024
• Python

Este projeto tem como objetivo extrair dados da API FIPE utilizando um ambiente Astronomer com Airflow para orquestração das tarefas que facilita o gerenciamento e implantação de fluxos de trabalho.

• UpdatedNov 4, 2024
• Python

The Smart Data Warehouse project automates e-commerce data ETL processes using Apache Airflow. It uploads data to Google Cloud Storage, loads it into BigQuery, performs quality checks, and enables visualization in Looker Studio for insightful reporting and analysis.

• UpdatedFeb 20, 2025
• Python

Sentiment Analysis using DistlBERT Transformer from HuggingFace. Also integrated Airflow for end-to-end pipeline

• UpdatedDec 26, 2024
• Jupyter Notebook

Analyse personal Netflix usage

• UpdatedJan 19, 2025
• Jupyter Notebook

A project that extracts data from Open Meteo API and stores it in a PostgreSQL database for further analysis.

• UpdatedMar 10, 2025
• Python

ETL PIPELINE AIRFLOW

• UpdatedOct 18, 2024
• Python

Airflow DAGs project with DBT hosted by Astronomer.

• UpdatedDec 26, 2023
• Python

Chess Data Harmony is an ETL data engineering project using different tools like Python with pandas, AWS S3, Snowflake, all orchestrated by Airflow (Astronomer)

• UpdatedMar 26, 2024
• Python

This project demonstrates how to use Terraform to provision data infrastructure on GCP to facilitate ETL pipeline.

• UpdatedJun 28, 2024
• Python

WeatherFlow ETL is an automated pipeline that extracts weather data from public APIs, transforms it by cleaning and standardizing the information, and loads it into a PostgreSQL database for analysis.

• UpdatedDec 16, 2024
• Python

This DBT (Data Build Tool) project leverages GCP (Google Cloud Platform) services, specifically Google BigQuery, and Metabase for data transformation, visualization, and Sales Dashboard creation, while also utilizing Soda (Streaming Data Build Tool) for real-time data processing

• UpdatedMar 16, 2024
• Python

Setting up the dev environment with the Docker compose , Astro and Airflow

• UpdatedNov 20, 2023
• Python

Hello, Astronomer! - The Enterprise Framework for Apache Airflow

• UpdatedApr 14, 2021
• Python

astro plugin for asdf version manager

• UpdatedSep 24, 2024
• Shell