superglue (YC W25) builds integrations and tools from natural language. Get production-grade tools for long tail and enterprise systems.

• UpdatedNov 28, 2025
• TypeScript

Structured Data Extractor for AI Agents. Search your documents or the web for specific data and get it back in JSON or Markdown in a single tool call.

• UpdatedMar 29, 2025
• Python

an app engine for your business. Seamlessly implement business logic with a powerful API. Out of the box CMS, blog, forum and email functionality. Developer friendly & easily extendable for your next SaaS/XaaS project. Built with Rails 6, Devise, Sidekiq & PostgreSQL

• UpdatedNov 26, 2025
• Ruby

Treats CSV and JSON files as SQL tables, and exports SQL SELECTs back to CSV or JSON.

• UpdatedOct 22, 2025
• Kotlin

[EOL] Real-Time Event Streaming & Change Data Capture

• UpdatedNov 4, 2025
• Shell

The Virtual Data Warehouse is a code generation and template management tool. It is part of the data solution automation ecosystem - the 'engine' for data solution automation.

• UpdatedJul 13, 2025
• Handlebars

• UpdatedOct 28, 2024
• HTML

Generic interface exchange format for Data Warehouse Automation and ETL generation.

• UpdatedJul 8, 2024
• C#

The goal of this project is to illustrate Extract Transform Load (ETL) using Python and SQL. ETL is a process commonly done in computing, which takes raw data, cleans it and stores it for later use. The extraction phase targets and retrieves the data. Transform manipulates and cleans the data. Then load stores the data, typically in a data wareh…

• UpdatedSep 7, 2021
• Jupyter Notebook

DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics control framework that can be used to monitor, log, audit and control data integration / ETL processes.

• UpdatedNov 25, 2025
• TSQL

Data Engineering portfolio projects, resources used to study data tools...

• UpdatedMar 25, 2024
• Jupyter Notebook

proof of concept to generate Airbyte low-code YAML connectors from API documentation

• UpdatedMar 11, 2024
• Python

ETL flow framework based on Yaml configs in Python

• UpdatedOct 21, 2023
• Python

BETL. Meta data driven ETL generation using T-SQL

• UpdatedJun 29, 2022

Apache Arrow Guide

• UpdatedOct 10, 2021

Automatically download and transform Hetzner invoices.

• UpdatedMay 28, 2020
• Python

Amazon Redshift Serverless RSQL ETL Framework

• UpdatedApr 1, 2025
• TypeScript

This is a PHP project which combines ETL with different strategies to extract data from multiple databases, files, and services, transform it and load it into multiple destinations.

• UpdatedOct 22, 2025
• PHP

An ASP NET MVC 6 Web GUI (Net core) for easy reports generation using ReportGenerator

• UpdatedApr 28, 2023
• C#

End-to-end data engineering processes for the NIGERIA Health Facility Registry (HFR). The project leveraged Selenium, Pandas, PySpark, PostgreSQL and Airflow

• UpdatedSep 1, 2022
• Python