distilbert

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

machine-learning text-summarization summarization albert extractive-summarization automatic-summarization bert roberta transformer-models pytorch-lightning distilbert summarization-dataset

UpdatedMay 26, 2025
Python

barissayil /SentimentAnalysis

Star380

Sentiment analysis neural network trained by fine-tuning BERT, ALBERT, or DistilBERT on the Stanford Sentiment Treebank.

nlp flask machine-learning vuejs sentiment-analysis pytorch transformer stanford-sentiment-treebank albert bert pytorch-implementation bert-model huggingface distilbert huggingface-transformer huggingface-transformers

UpdatedJun 12, 2023
Python

sudharsan13296 /Getting-Started-with-Google-BERT

Star226

Build and train state-of-the-art natural language processing models using BERT

nlp pytorch transformer bart albert bert electra roberta spanbert bertsum distilbert sbert sentence-bert huggingface-transformers videobert tinybert clinical-bert

UpdatedMay 20, 2021
Jupyter Notebook

liuyukid /transformers-ner

Star210

Pytorch-Named-Entity-Recognition-with-transformers

crf transformers pgd pytorch span ner albert bert softmax fgm electra xlm roberta adversarial-training distilbert camembert xlmroberta

UpdatedJun 1, 2020
Python

labteral /ernie

Star201

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

nlp natural-language-processing tensorflow keras transformers sentence-classification albert bert roberta bert-model transformer-architecture tensorflow2 bert-embeddings huggingface bert-models bert-as-service transformer-tensorflow2 distilbert huggingface-transformer

UpdatedMay 26, 2024
Python

MahmoudWahdan /dialog-nlu

Star100

Tensorflow and Keras implementation of the state of the art researches in Dialog System NLU

nlp natural-language-processing tensorflow nlu keras transformers tf2 transfer-learning albert bert dialogue-systems joint-models natural-language-understanding model-compression conversational-ai roberta nlu-engine prunning distilbert distilroberta

UpdatedMar 21, 2021
Jupyter Notebook

aniass /Product-Categorization-NLP

Star97

Multi-Class Text Classification for products based on their description with Machine Learning algorithms and Neural Networks (MLP, CNN, Distilbert).

python text-classification word2vec transformers pandas nltk topic-modeling data-analysis gensim doc2vec mlp-classifier cnn-text-classification doc2vec-model distilbert huggingface-transformers

UpdatedNov 26, 2025
Jupyter Notebook

DomHudson /bert-in-production

Star96

A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.

python language awesome tutorial deployment tensorflow paper model natural-language production transformers resources smaller implementation language-models knowledge-distillation bert elmo bert-pytorch distilbert

UpdatedApr 8, 2021

elephantmipt /bert-distillation

Star78

Distillation of BERT model with catalyst framework

nlp catalyst bert distillation rubert distilbert

UpdatedJun 12, 2023
Python

chambliss /foodbert

Star59

FoodBERT: Food Extraction with DistilBERT

python nlp food natural-language-processing transformers information-extraction nlp-machine-learning bert bert-model distilbert food-extraction

UpdatedOct 31, 2020
Python

line /LINE-DistilBERT-Japanese

Star46

DistilBERT model pre-trained on 131 GB of Japanese web text. The teacher model is BERT-base that built in-house at LINE.

japanese distilbert

UpdatedMar 22, 2023

abhilash1910 /ClusterTransformer

Sponsor

Star44

Topic clustering library built on Transformer embeddings and cosine similarity metrics.Compatible with all BERT base transformers from huggingface.

clustering pytorch embeddings transformer albert pytorch-implementation bert-embeddings distilbert roberta-model

UpdatedJun 11, 2021
Python

muhdshahan /Aura-Emotion-Based-Song-Recommender

Star42

Aura is an emotion-aware music recommender that understands your mood from natural language input. It uses a fine-tuned BERT model trained on the GoEmotions dataset to detect your emotion. Based on the emotion, Aura suggests a song to comfort your mood or celebrate it through music.

natural-language-processing transformers cosine-similarity distilbert emotionrecognition