data-preparation

Continuously updated paper list on advancements in Data Agents. Companion repo to our paper "A Survey of Data Agents: Emerging Paradigm or Overstated Hype?"

data-science database data-discovery data-analytics data-analysis data-integration data-management data-preparation data-cleaning datalake unstructured-data text-to-sql nl2sql report-generation tableqa data-storytelling nl2vis llm dataagent

UpdatedDec 16, 2025
Python

PacktWorkshops /The-Data-Science-Workshop

Star241

A New, Interactive Approach to Learning Data Science

python machine-learning random-forest regression datascience dimensionality-reduction feature-engineering data-preparation machine-learning-pipelines binaryclassification clusteranalysis hyperparameter-tuning-ensemble-learning-

UpdatedDec 15, 2025
Jupyter Notebook

pablo14 /data-science-live-book

Star227

An open source book to learn data science, data analysis and machine learning, suitable for all ages!

visualization learning data-science machine-learning statistics big-data analytics data-analysis predictive-analysis predictive-modeling data-preparation descriptive-statistics

UpdatedApr 14, 2024
TeX

hi-primus /bumblebee

Star141

🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)

python gui gpu datasets dask optimus data-preparation data-cleaning data-profiling bumblebee prepare-data cudf dask-cudf

UpdatedJul 15, 2023
Vue

whwu95 /MVFNet

Star135

【AAAI'2021】MVFNet: Multi-View Fusion Network for Efficient Video Recognition

model-zoo data-preparation video-understanding temporal-modeling efficient-video-recognition

UpdatedMar 28, 2022
Python

asavinov /prosto

Star93

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

python workflow data-science spark pandas map-reduce business-intelligence olap data-wrangling data-preprocessing feature-engineering data-processing data-preparation

UpdatedNov 21, 2021
Python

sbcgua /mockup_loader

Star69

ABAP unit testing framework, prepare in Excel, reuse in abap code

unit-testing sap abap test-automation testing-tools data-preparation hacktoberfest mockup-loader

UpdatedAug 13, 2025
ABAP

Sriram-PR /doc-scraper

Star69

Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data).

web-scraper data-preparation llm

UpdatedJul 22, 2025
Go

ruchikaverma-iitg /MoNuSAC

Star66

This repository contains my implementations of the algorithms which MoNuSAC participants could use for data preparation to train their models at ISBI 2020.

data-preparation monusac-challenge

UpdatedDec 2, 2021
Jupyter Notebook

hegongshan /Storage-for-AI-Paper

Star55

Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)

deep-learning tensorflow data-storage pytorch checkpoint dataloader data-preprocessing data-preparation storage-system model-training data-loading mlsys model-storage model-inference storage-for-ai

UpdatedDec 17, 2025

soumyadip007 /Data-Science-Using-Python-University-Course-Module

Star46

“Data science” is just about as broad of a term as they come. It may be easiest to describe what it is by listing its more concrete components: Data exploration & analysis. Included here: Pandas; NumPy; SciPy; a helping hand from Python's Standard Library.

python data-science numpy jupyter-notebook data-visualization plotting data-preprocessing panda data-processing data-preparation knn