text-data

Star

Here are 65 public repositories matching this topic...

Language:All

Filter by language

All65 Jupyter Notebook22 Python20 R6 HTML4 JavaScript2 Julia1 Mathematica1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

microsoft /DialoGPT

Star2.4k

Large-scale pretraining for dialogue

machine-learning dialogue text-generation pytorch transformer data-processing text-data gpt-2 dialogpt

UpdatedOct 17, 2022
Python

asyml /texar

Star2.4k

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project:http://casl-project.ai/

python machine-learning natural-language-processing deep-learning tensorflow machine-translation text-generation data-processing bert text-data dialog-systems gpt-2 texar xlnet casl-project

UpdatedAug 26, 2021
Python

microsoft /GODEL

Star888

Large-scale pretrained models for goal-directed dialog

machine-learning dialogue transformers text-generation pytorch transformer data-processing language-model dialogue-systems text-data conversational-ai language-grounding pretrained-model dialogpt grounded-generation

UpdatedDec 10, 2023
Python

asyml /texar-pytorch

Star746

Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project:http://casl-project.ai/

python machine-learning natural-language-processing deep-learning machine-translation text-generation pytorch data-processing bert text-data dialog-systems roberta gpt-2 texar xlnet casl-project texar-pytorch

UpdatedApr 14, 2022
Python

asyml /forte

Star251

Forte is a flexible and powerful ML workflow builder. This is part of the CASL project:http://casl-project.ai/

python machine-learning natural-language-processing information-retrieval deep-learning pipeline natural-language data-processing text-data

UpdatedFeb 5, 2024
Python

thu-coai /cotk

Star129

Conversational Toolkit. An Open-Source Toolkit for Fast Development and Fair Evaluation of Text Generation

python machine-learning natural-language-processing deep-learning metrics data-processing natural-language-generation text-data cotk

UpdatedAug 31, 2020
Python

LoLei /redditcleaner

Star83

Cleans Reddit Text Data 📜 🧹

python nlp reddit praw data-cleaning hacktoberfest text-data pushshift psaw

UpdatedApr 14, 2020
Python

trinker /textreadr

Star76

Tools to uniformly read in text data including semi-structured transcripts

text-mining r docx doc text-data read-transcripts pdf-reading

UpdatedMar 7, 2023
R

trinker /textshape

Star53

Tools for reshaping text data

r tidy manipulation text-data sentence-boundary-detection data-reshaping text-formating

UpdatedApr 1, 2024
R

BALaka-18 /rake_new2

Star29

A Python library that enables smooth keyword extraction from any text using the RAKE(Rapid Automatic Keyword Extraction) algorithm.

nlp text python-library keywords keyword-extraction text-data keyword-search

UpdatedMay 3, 2024
Python

PratikBarhate /question-classification

Star29

Question Classification for the dataset CogComp QC Dataset - [http://cogcomp.org/Data/QA/QC/ ].

nlp machine-learning experimental neural-network python3 pytorch spacy text-data question-classification

UpdatedNov 10, 2020
Python

YaleDHLab /wordmap

Star26

Visualize large text collections with WebGL

nlp webgl word2vec data-visualization text-data

UpdatedSep 4, 2024
JavaScript

carted /processing-text-data

Star20

Presents an optimized Apache Beam pipeline for generating sentence embeddings (runnable on Cloud Dataflow).

tensorflow dataflow apache-beam bert text-data tfhub use-bert

UpdatedMar 7, 2022
Python

PedroBarcha /old-books-dataset

Star15

Old book pages (with groundtruth), formerly used for OCR studies. There are several versions of the set (concerning resolution and binarization). Noised and denoised sets (done by several methods) are eventually going to be uploaded.

text dataset ground-truth text-data binarization ocr-database text-database old-books old-documents books-dataset ocr-dataset binarized-dataset groundtruth