data-centric

Star

Here are 44 public repositories matching this topic...

Language:All

Filter by language

All44 Python15 Jupyter Notebook4 C++3 JavaScript3 C#2 HTML2 Java2 Rust2 CMake1 Lua1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

ludwig-ai /ludwig

Star11.6k

Low-code framework for building custom LLMs, neural networks, and other AI models

learning data-science machine-learning natural-language-processing computer-vision deep-learning neural-network natural-language ml deep pytorch machinelearning llama deeplearning mistral fine-tuning data-centric llm llm-training llama2

UpdatedJan 19, 2026
Python

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

python rust data-science machine-learning computer-vision deep-learning embeddings dataops data-analytics data-analysis data-format apache-arrow data-centric mlops duckdb llms

UpdatedFeb 20, 2026
Rust

daochenzha /data-centric-AI

Star1.1k

A curated, but incomplete, list of data-centric AI resources.

data-science machine-learning ai artificial-intelligence data-engineering data-quality data-curation data-centric data-centric-ai data-centric-machine-learning

UpdatedJun 26, 2024

hkust-nlp /deita

Star588

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

alignment data-centric large-language-models instruction-tuning

UpdatedDec 9, 2024
Python

encord-team /encord-active

Star455

The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.

python data-science data machine-learning computer-vision deep-learning data-validation annotations ml object-detection data-cleaning active-learning data-quality data-centric mlops noisy-labels model-quality label-errors label-quality

UpdatedMay 23, 2025
Python

s2e-systems /dust-dds

Sponsor

Star154

Rust implementation of the Data Distribution Service (DDS)

rust middleware udp dds dcps data-centric

UpdatedJan 21, 2026
Rust

CLUEbenchmark /DataCLUE

Star145

DataCLUE: 数据为中心的NLP基准和工具包

nlp ai chinese classification-algorithm human-in-the-loop data-centric

UpdatedMay 11, 2022
Python

PrincetonUniversity /muchiSim

Star75

Simulator framework for analysis of performance, energy consumption, area and cost of multi-node multi-chiplet tile-based manycore designs

simulator simulation network cost-model pgas execution energy-model manycore multi-chip data-centric data-local performance-modeling-and-analysis multi-chiplet

UpdatedJun 30, 2024
C++

USTC-StarTeam /DR4SR

Star69

🔥🔥🔥 KDD2024 Best Student Paper

recommender-system data-centric sequential-recommendation

UpdatedFeb 21, 2025
Python

ChandlerBang /GTrans

Star65

[ICLR'23] Implementation of "Empowering Graph Representation Learning with Test-Time Graph Transformation"

robustness adversarial-attacks data-centric graph-neural-networks out-of-distribution distribution-shift test-time-adaptation

UpdatedJun 23, 2023
Python

luo-junyu /Awesome-Data-Efficient-LLM

Star51

A list of data-efficient and data-centric LLM (Large Language Model) papers. Our Survey Paper: Towards Efficient LLM Post Training: A Data-centric Perspective

efficient data-centric data-efficient data-centric-ai data-centric-machine-learning large-language-models llm