- Notifications
You must be signed in to change notification settings - Fork6
upura/nlp-recipes-ja
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
This repository contains samples codes for natural language processing in Japanese.It's highly inspired bymicrosoft/nlp-recipes.
The following is a summary of the commonly used NLP scenarios covered in the repository. Each scenario is demonstrated in one or more scripts or Jupyter notebook examples that make use of the core code base of models and repository utilities.
| Category | Methods |
|---|---|
| Basic | Cleaning, Normalization, Stopwords, Sentence Segmantation, Ruby |
| Embeddings | Word2Vec, fastText, Universal Sentence Encoder |
| Feature Engineering | Bag-of-Words, TF-IDF, BM25, SWEM, SCDV |
| Morphological Analysis | Konoha, nagisa |
| Sentence Similarity | Cosine Similarity |
| Sentiment Analysis | oseti |
| Text Classification | TF-IDF & Logistic Regression, TF-IDF & LightGBM, BERT, T5 |
| Visualization | Visualization with Japanese texts |
docker-compose up -d --builddockerexec -it nlp-recipes-ja bashAbout
Samples codes for natural language processing in Japanese
Resources
Uh oh!
There was an error while loading.Please reload this page.
Stars
Watchers
Forks
Uh oh!
There was an error while loading.Please reload this page.