Movatterモバイル変換

Skip to content

#

large-scale-data-processing

Here are 2 public repositories matching this topic...

Language:All

Filter by language

All2 HTML1 Python1

NVIDIA-NeMo /Curator

Scalable data pre processing and curation toolkit for LLMs

python data data-processing data-preparation deduplication data-quality data-curation data-prep fine-tuning fast-data-processing data-processing-pipelines datacuration large-language-models llm llmapps large-scale-data-processing datarecipes semantic-deduplication llm-data-quality

UpdatedJul 18, 2025
Python

data-prep-kit /data-prep-kit

Open source project for data preparation for GenAI applications

python data spark malware code-quality data-preprocessing ray data-preparation deduplication data-prep finetuning data-preprocessing-pipelines datacuration large-language-models llm llmapps large-scale-data-processing datarecipes

UpdatedJul 17, 2025
HTML

Improve this page

Add a description, image, and links to thelarge-scale-data-processing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thelarge-scale-data-processing topic, visit your repo's landing page and select "manage topics."

[8]ページ先頭

©2009-2025 Movatter.jp