mageai
Here are 28 public repositories matching this topic...
Language:All
Sort:Most stars
🎨 UI for the Free Data Engineering Zoomcamp Course provided by DataTalksClub
- Updated
Aug 2, 2024 - Python
Contains a Python script designed to validate data replication tasks in AWS Database Migration Service (DMS). The script checks for potential issues such as missing or duplicate data in the tables being replicated.
- Updated
Feb 2, 2025 - Python
The AWS DMS Task Restart and Status Checker is a Python script designed to restart various AWS Database Migration Service (DMS) tasks and check their status. This script leverages AWS SDK (Boto3) and Mage.ai for DMS task integration and management, ensuring efficient and reliable task handling.
- Updated
Feb 2, 2025 - Python
The Zoomcamp LLM Course focuses on tools for working with LLMs and RAG, including OpenAI API, HuggingFace, Elasticsearch, and Streamlit. It covers vector search, embedding creation, data ingestion with Mage, and monitoring using Grafana, emphasizing practical applications and best practices.
- Updated
Feb 18, 2025 - Jupyter Notebook
An ETL data pipeline that extracts data from source and loads it to destination, automated using mage.ai
- Updated
Nov 21, 2023 - Python
Automated script developed in Mage.ai to monitor and validate the status of AWS DMS CDC tasks, ensuring data integrity and synchronization. Sends notifications for any detected validation issues.
- Updated
Feb 15, 2025 - Python
This script automates cleaning up a specific folder in an S3 bucket, deleting all objects within it. It uses secure AWS credentials and is built on the Mage.ai platform. Additionally, the roadmap includes approach handling and logging for greater robustness and monitoring.
- Updated
Feb 4, 2025 - Python
This project is a Data Engineering solution implemented to validate the data types of columns in PostgreSQL tables in a DataMart. It aims to validate whether the data stored in tables conforms to the expected data types, improving data integrity and reliability.
- Updated
Jul 28, 2024 - Python
pokéFastApi: A backend API with Docker Compose integration for retrieving and searching Pokémon data using FastAPI and DuckDB.
- Updated
Jan 11, 2024 - Python
Using machine learning, feature engineering, and web scraping, I created an end-to-end laptop price prediction website by scraping data from a popular Iranian source. Empowering users with accurate pricing estimates and model comparisons
- Updated
Dec 26, 2023 - Jupyter Notebook
An ETL Pipeline built over GCP and orchestrated by Mage, which involves Extracting Data from GCS Bucket, building Dimensional Model, loading the Data into BigQuery and a Looker Dashboard for further analysis.
- Updated
Nov 18, 2023 - Jupyter Notebook
Datatalks Club Free Data Engineering Zoomcamp Project
- Updated
Jul 14, 2024 - Jupyter Notebook
Data Engineering Zoomcamp Final Project
- Updated
Jul 14, 2024 - Jupyter Notebook
- Updated
Jun 20, 2024 - Python
🚕 Performing Data Analytics on NYC Taxi data using GCP and MageAI
- Updated
Mar 30, 2024 - Jupyter Notebook
Engineered a real-time Cryptocurrency dashboard on AWS using Python, MageAI, SQL, and NLP for sentiment analysis, with ML forecasting and PowerBI integration for dynamic reporting and decision-making.
- Updated
Jan 10, 2025 - Jupyter Notebook
Data Engineering Swiss Air Quality
- Updated
Mar 31, 2024 - Python
Docker image for Mage AI deployment using Docker
- Updated
Dec 23, 2024 - Dockerfile
Improve this page
Add a description, image, and links to themageai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with themageai topic, visit your repo's landing page and select "manage topics."