data-centric

Star

Here are 39 public repositories matching this topic...

Language:All

Filter by language

All39 Python13 Jupyter Notebook4 C++3 JavaScript3 C#2 Java2 Rust2 CMake1 HTML1 Lua1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

ludwig-ai /ludwig

Star11.4k

Low-code framework for building custom LLMs, neural networks, and other AI models

learning data-science machine-learning natural-language-processing computer-vision deep-learning neural-network natural-language ml deep pytorch machinelearning llama deeplearning mistral fine-tuning data-centric llm llm-training llama2

UpdatedMar 3, 2025
Python

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

python rust data-science machine-learning computer-vision deep-learning embeddings dataops data-analytics data-analysis data-format apache-arrow data-centric mlops duckdb llms

UpdatedMar 20, 2025
Rust

daochenzha /data-centric-AI

Star1.1k

A curated, but incomplete, list of data-centric AI resources.

data-science machine-learning ai artificial-intelligence data-engineering data-quality data-curation data-centric data-centric-ai data-centric-machine-learning

UpdatedJun 26, 2024

hkust-nlp /deita

Star541

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

alignment data-centric large-language-models instruction-tuning

UpdatedDec 9, 2024
Python

encord-team /encord-active

Star448

The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.

python data-science data machine-learning computer-vision deep-learning data-validation annotations ml object-detection data-cleaning active-learning data-quality data-centric mlops noisy-labels model-quality label-errors label-quality

UpdatedFeb 6, 2025
Python

CLUEbenchmark /DataCLUE

Star142

DataCLUE: 数据为中心的NLP基准和工具包

nlp ai chinese classification-algorithm human-in-the-loop data-centric

UpdatedMay 11, 2022
Python

s2e-systems /dust-dds

Star114

Rust implementation of the Data Distribution Service (DDS)

rust middleware udp dds dcps data-centric

UpdatedMar 14, 2025
Rust

PrincetonUniversity /muchiSim

Star62

Simulator framework for analysis of performance, energy consumption, area and cost of multi-node multi-chiplet tile-based manycore designs

simulator simulation network cost-model pgas execution energy-model manycore multi-chip data-centric data-local performance-modeling-and-analysis multi-chiplet

UpdatedJun 30, 2024
C++

ChandlerBang /GTrans

Star56

[ICLR'23] Implementation of "Empowering Graph Representation Learning with Test-Time Graph Transformation"

robustness adversarial-attacks data-centric graph-neural-networks out-of-distribution distribution-shift test-time-adaptation

UpdatedJun 23, 2023
Python

USTC-StarTeam /DR4SR

Star52

🔥🔥🔥 KDD2024 Best Student Paper

recommender-system data-centric sequential-recommendation

UpdatedFeb 21, 2025
Python

astutic /Acharya

Star45

A Data Centric NER annotation tool for your Named Entity Recognition projects

machine-learning natural-language-processing ai named-entity-recognition datasets annotation-processing ner annotation-tool text-annotation data-quality data-centric mlops data-quality-monitoring data-labeling annota text-annotation-tool data-labeling-tools data-centric-ai

UpdatedApr 10, 2024

zhorton34 /vuejs-form

Star41

Vue Form with Laravel Inspired Validation and Simply Enjoyable Error Messages Api. (Form Api, Validator Api, Rules Api, Error Messages Api)

react javascript vue js reactjs reactivity data-centric

UpdatedMar 5, 2022
JavaScript

luo-junyu /Awesome-Data-Efficient-LLM

Star28

A list of data-efficient and data-centric LLM (Large Language Model) papers. Our Survey Paper: Towards Efficient LLM Post Training: A Data-centric Perspective

efficient data-centric data-efficient data-centric-ai data-centric-machine-learning large-language-models llm