data-preprocessing

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

data-science data-mining exploratory-data-analysis tabular-data feature-selection data-engineering feature-extraction data-analytics knowledge-discovery data-wrangling data-preprocessing feature-engineering spreadsheets data-exploration data-mining-algorithms data-cleaning data-profiling anomaly-detection data-cleansing correlations

UpdatedDec 16, 2025
C++

shamspias /customizable-gpt-chatbot

Star394

A dynamic, scalable AI chatbot built with Django REST framework, supporting custom training from PDFs, documents, websites, and YouTube videos. Leveraging OpenAI's GPT-3.5, Pinecone, FAISS, and Celery for seamless integration and performance.

python nlp machine-learning natural-language-processing django chatbot django-rest-framework artificial-intelligence voice-recognition voice-chat data-preprocessing voice-to-text conversational-ai gpt-3 voice-transcription langchain gpt-voice langchain-python longchain autogpt

UpdatedMar 16, 2024
Python

msamogh /nonechucks

Star378

Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!

machine-learning torch pytorch data-preprocessing preprocessing data-processing data-cleaning data-pipeline

UpdatedSep 22, 2022
Python

TirendazAcademy /PANDAS-TUTORIAL

Star234

Jupyter Notebooks and Data Sets for Pandas Library

python data-science data machine-learning pandas-dataframe pandas data-analysis data-preprocessing pandas-tutorial pandas-library pandas-datareader pandas-python pandas-tricks-for-data-manipulation pandas-series

UpdatedJun 25, 2024
Jupyter Notebook

harunurrashid97 /100-Days-Of-ML-Code

Star226

A day to day plan for this challenge. Covers both theoritical and practical aspects

python data-science machine-learning article linear-regression exploratory-data-analysis machine-learning-algorithms eda tutorials datascience data-preprocessing implementation decision-tree 100-days-of-code infographics regression-algorithms textsummarization siraj-raval-challenge vizualization 100daysofmlcode

UpdatedFeb 6, 2023
Jupyter Notebook

HasnainRaz /SemSegPipeline

Star143

A simpler way of reading and augmenting image segmentation data into TensorFlow

python deep-learning pipeline tensorflow data-preprocessing masks semantic-segmentation data-augmentation image-augmentation augmentation image-preprocessing input-pipeline data-augmentations

UpdatedJun 15, 2020
Python

triton-inference-server /dali_backend

Star139

The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.

python deep-learning gpu image-processing dali data-preprocessing nvidia-dali fast-data-pipeline

UpdatedDec 11, 2025
C++

thepanacealab /SMMT

Star136

Social Media Mining Toolkit (SMMT) main repository

tweets annotation twitter-api data-acquisition spacy data-preprocessing gathering data-annotation

UpdatedNov 11, 2022
Python

dansuh17 /segan-pytorch

Star110

SEGAN pytorch implementationhttps://arxiv.org/abs/1703.09452

audio pytorch data-preprocessing mir source-separation speech-enhancement segan segan-pytorch

UpdatedMar 11, 2019
Python

TensorMSA /tensormsa

Star108

Deep learning GUI frame work for enterprise

docker machine-learning deep-learning docker-compose tensorflow gpu microservices-architecture data-preprocessing

UpdatedMar 8, 2018
Python

Mohan-Zhang-u /mzutils

Star104

machine-learning natural-language-processing reinforcement-learning deep-learning toolkit tensorflow torch data-visualization question-answering readthedocs machinelearning data-preprocessing tensorflow2

UpdatedAug 11, 2023
Python

wangxb96 /Awesome-EdgeAI

Star98

Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"

machine-learning deep-learning awesome-list data-preprocessing efficient-algorithm model-compression edge-computing model-deployment model-acceleration edge-ai tiny-ml model-design model-inference

UpdatedSep 11, 2025

asavinov /prosto

Star93

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

python workflow data-science spark pandas map-reduce business-intelligence olap data-wrangling data-preprocessing feature-engineering data-processing data-preparation

UpdatedNov 21, 2021
Python

HypoX64 /candock

Star86

A time series signal analysis and classification framework

deep-learning eeg classification data-preprocessing data-augmentation series-signal-analysis

UpdatedJul 6, 2023
Python

Improve this page

Add a description, image, and links to thedata-preprocessing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thedata-preprocessing topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

data-preprocessing

Here are 2,215 public repositories matching this topic...

zzw922cn /Automatic_Speech_Recognition

skrub-data /skrub

data-prep-kit /data-prep-kit

Western-OC2-Lab /AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics

machinelearnjs /machinelearnjs

akanz1 /klib

Desbordante /desbordante-core