CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

• UpdatedJan 31, 2025
• Python

🔥 🔥 🔥Open Source & AI driven Data Onboarding Platform:Free flatfile.com alternative

• UpdatedAug 3, 2023
• JavaScript

This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (NeurIPS22).

• UpdatedJan 21, 2025
• Python

[NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation

• UpdatedMar 7, 2024
• Python

Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).

• UpdatedOct 1, 2024
• Python

Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"

• UpdatedFeb 11, 2025
• Python

高性能小模型测评 Shared Tasks in NLPCC 2020. Task 1 - Light Pre-Training Chinese Language Model for NLP Task

• UpdatedJun 1, 2020
• Python

Embeddings: State-of-the-art Text Representations for Natural Language Processing tasks, an initial version of library focus on the Polish Language

• UpdatedDec 3, 2023
• Python

TurkishBERTweet: Fast and Reliable Large Language Model for Social Media Analysis

• UpdatedSep 22, 2024
• Python

The PreTENS shared task hosted at SemEval 2022 aims at focusing on semantic competence with specific attention on the evaluation of language models with respect to the recognition of appropriate taxonomic relations between two nominal arguments (i.e. cases where one is a supercategory of the other, or in extensional terms, one denotes a superset…

• UpdatedFeb 5, 2022
• Jupyter Notebook

Code for "Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization"

• UpdatedOct 4, 2020
• Python

A 78.5% word sense disambiguator based on Transformers and RoBERTa (PyTorch)

• UpdatedJun 9, 2020
• Python

Informal to formal dataset mask MLM

• UpdatedMar 6, 2025
• Python

A project that harnesses the Stanford NLP library to gauge sentiment from provided text via an intuitive graphical interface.

• UpdatedAug 20, 2023
• Java

translatorlab: a machine translation tool that uses artificial intelligence models to provide accurate and fast translations between different languages

• UpdatedFeb 26, 2025
• Python

This is an API which uses Google PaLM API to give responses to user requests

• UpdatedDec 21, 2024
• HTML

This project scrapes and cleans Shakespeare's public domain texts, trains a character-level LSTM model in PyTorch, and generates fresh, Shakespeare-like text. Perfect for literature and NLP enthusiasts, it provides metrics (loss, perplexity, accuracy) and a platform for tuning hyperparameters and exploring the art of AI-driven language modeling.

• UpdatedDec 19, 2024
• Jupyter Notebook

The PowerShell Random Text Generator is a script that generates random text based on a given model.

• UpdatedJul 7, 2024
• PowerShell

The project generates a sentence given a pre-defined starting phrase from the user such as "Ilbierah kont" and the script attempts to build a sentence off of that phrase. Structurally, the generator works in an n-gram fashion but the main structures used to generate the sentences were the unigram, bigram and trigram. The perplexity for each n-gr…

• UpdatedAug 11, 2021
• Jupyter Notebook

Language Model with RNN in tensorflow

• UpdatedOct 8, 2017
• Python