- Notifications
You must be signed in to change notification settings - Fork143
takuyaa/kuromoji.js
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
JavaScript implementation of Japanese morphological analyzer.This is a pure JavaScript porting ofKuromoji.
You can see how kuromoji.js works indemo site.
Directory tree is as follows:
build/ kuromoji.js -- JavaScript file for browser (Browserified)demo/ -- Demodict/ -- Dictionaries for tokenizer (gzipped)example/ -- Examples to use in Node.jssrc/ -- JavaScript sourcetest/ -- Unit test
You can tokenize sentences with only 5 lines of code.If you need working examples, you can see the files under the demo or example directory.
Install with npm package manager:
npm install kuromoji
Load this library as follows:
var kuromoji = require("kuromoji");
You can prepare tokenizer like this:
kuromoji.builder({ dicPath: "path/to/dictionary/dir/" }).build(function (err, tokenizer) { // tokenizer is ready var path = tokenizer.tokenize("すもももももももものうち"); console.log(path);});
You only need the build/kuromoji.js and dict/*.dat.gz files
Install with Bower package manager:
bower install kuromoji
Or you can use the kuromoji.js file and dictionary files from the GitHub repository.
In your HTML:
<script src="url/to/kuromoji.js"></script>
In your #"kuromoji.builder({ dicPath: "/url/to/dictionary/dir/" }).build(function (err, tokenizer) { // tokenizer is ready var path = tokenizer.tokenize("すもももももももものうち"); console.log(path);});">
kuromoji.builder({ dicPath: "/url/to/dictionary/dir/" }).build(function (err, tokenizer) { // tokenizer is ready var path = tokenizer.tokenize("すもももももももものうち"); console.log(path);});
The function tokenize() returns an JSON array like this:
[ { word_id: 509800, // 辞書内での単語ID word_type: 'KNOWN', // 単語タイプ(辞書に登録されている単語ならKNOWN, 未知語ならUNKNOWN) word_position: 1, // 単語の開始位置 surface_form: '黒文字', // 表層形 pos: '名詞', // 品詞 pos_detail_1: '一般', // 品詞細分類1 pos_detail_2: '*', // 品詞細分類2 pos_detail_3: '*', // 品詞細分類3 conjugated_type: '*', // 活用型 conjugated_form: '*', // 活用形 basic_form: '黒文字', // 基本形 reading: 'クロモジ', // 読み pronunciation: 'クロモジ' // 発音 } ]
(This is defined in src/util/IpadicFormatter.js)
See alsoJSDoc page in details.
About
JavaScript implementation of Japanese morphological analyzer
Resources
Uh oh!
There was an error while loading.Please reload this page.
Stars
Watchers
Forks
Packages0
Uh oh!
There was an error while loading.Please reload this page.