small, safe, and great commonmark (optionally gfm) compliant markdown parser

• UpdatedFeb 27, 2025
• JavaScript

Developer friendly Natural Language Processing ✨

• UpdatedFeb 18, 2025
• JavaScript

CommonMark compliant markdown parser in Rust with ASTs and extensions

• UpdatedFeb 28, 2025
• Rust

Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript

• UpdatedJul 2, 2024
• Go

mdast utility to parse markdown

• UpdatedMar 5, 2025
• JavaScript

snapdragon is an extremely pluggable, powerful and easy-to-use parser-renderer factory.

• UpdatedMar 14, 2023
• JavaScript

NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.

• UpdatedMar 3, 2024
• JavaScript

A pythonic wrapper for Stanford CoreNLP.

• UpdatedJun 29, 2018
• Python

Tokenize2 is a plugin which allows your users to select multiple items from a predefined list or ajax, using autocompletion as they type to find each item. You may have seen a similar type of text entry when filling in the recipients field sending messages on facebook or tags on tumblr.

• UpdatedNov 30, 2022
• JavaScript

Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.

• UpdatedFeb 20, 2025
• Jupyter Notebook

Extract JavaScript code comments from a string or glob of files.

• UpdatedNov 24, 2018
• JavaScript

bKash payment gateway integration in flutter

• UpdatedOct 19, 2024
• Dart

Lexers, tokenizers, parsers, compilers, renderers, stringifiers... What's the difference, and how do they work?

• UpdatedApr 26, 2017

A token based HTML Document parser and minifier written in PHP. Extract attribute values and text using CSS selectors.

• UpdatedDec 25, 2024
• PHP

A Python library for interacting with TI-(e)z80 (82/83/84 series) calculator files

• UpdatedJan 17, 2025
• Python

Korean text data preprocess toolkit for NLP

• UpdatedJun 11, 2019
• Python

Uses snapdragon to tokenize a single JavaScript block comment into an object, with description, tags, and code example sections that can be passed to any other comment parsers for further parsing.

• UpdatedJun 12, 2023
• JavaScript

Uses babel to extract JavaScript code comments from a string. Returns an array of comment objects, with line, column, index, comment type and comment string.

• UpdatedMay 22, 2018
• JavaScript

A Python toolkit to generate a tokenized dump of Wikipedia for NLP

• UpdatedMay 3, 2024
• Python

Implemented transformer NN block for Machine translation, text classfication, Natural language inference as well as Machine reading comprehension model.

• UpdatedMay 17, 2024
• Python