Transformer-based models implemented in tensorflow 2.x(using keras).

• UpdatedNov 23, 2021
• Python

[NeurIPS 2023 Main Track] This is the repository for the paper titled "Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner"

• UpdatedFeb 4, 2024
• Python

The source code used for paper "Empower Entity Set Expansion via Language Model Probing", published in ACL 2020.

• UpdatedNov 3, 2020
• Python

Recent Advances in Vision-Language Pre-training!

• UpdatedJan 10, 2022

Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision"https://arxiv.org/abs/2205.09357

• UpdatedOct 23, 2023
• Jupyter Notebook

Sample tutorials for training Natural Language Processing Models with Transformers

• UpdatedApr 25, 2023
• Python

😷 The Fill-Mask Association Test (FMAT): Measuring Propositions in Natural Language.

• UpdatedMar 27, 2025
• R

Comparing Selective Masking Methods for Depression Detection in Social Media

• UpdatedJun 3, 2023
• Python

A transformer-based language model trained on politics-related Twitter data. This repo is the official resource of the paper "PoliBERTweet: A Pre-trained Language Model for Analyzing Political Content on Twitter", LREC 2022

• UpdatedOct 3, 2022

[CHIL 2024] Interpretation of Intracardiac Electrograms Through Textual Representations

• UpdatedSep 4, 2024
• Python

Grammar test suite for masked language models

• UpdatedJan 1, 2023
• Python

A Context Aware Approach for Generating Natural Language Attacks.

• UpdatedDec 16, 2020
• Python

Transformers Intuition

• UpdatedDec 11, 2023
• Jupyter Notebook

Transformers Pre-Training with MLM objective — implemented encoder-only model and trained from scratch on Wikipedia dataset.

• UpdatedOct 11, 2023
• Jupyter Notebook

Predict the whole sequence and 3D structure of masked protein sequences with ESM by@evolutionaryscale

• UpdatedJun 29, 2024
• Python

Measuring Biases in Masked Language Models for PyTorch Transformers. Support for multiple social biases and evaluation measures.

• UpdatedDec 23, 2024
• Python

[EMNLP 2024] Official Implementation of DisGeM: Distractor Generation for Multiple Choice Question with Span Masking

• UpdatedOct 14, 2024
• Python

Score masked language models on grammar test suites

• UpdatedJan 2, 2023
• Python

Final assigment for "Gestione dell'Informazione" ("Search Engines") course @ UniMoRe

• UpdatedFeb 8, 2024
• Jupyter Notebook

Masked language model with Positional & One-Hot encoding - built using Aurora

• UpdatedJan 10, 2025
• Java