Installation

Build from source

$ pip install --upgrade pip

$ pip install .

Example Usage

importvibratowithopen('path/to/system.dic','rb')asfp:dict_data=fp.read()tokenizer=vibrato.Vibrato(dict_data)tokens=tokenizer.tokenize('社長は火星猫だ')len(tokens)#=> 5list(tokens)#=> [Token { surface: "社長", feature: "名詞,一般,*,*,*,*,社長,シャチョウ,シャチョー,," },#    Token { surface: "は", feature: "助詞,係助詞,*,*,*,*,は,ハ,ワ,," },#    Token { surface: "火星", feature: "名詞,一般,*,*,*,*,火星,カセイ,カセイ,," },#    Token { surface: "猫", feature: "名詞,一般,*,*,*,*,猫,ネコ,ネコ,," },#    Token { surface: "だ", feature: "助動詞,*,*,*,特殊・ダ,基本形,だ,ダ,ダ,," }]tokens[0].surface()#=> '社長'tokens[0].feature()#=> '名詞,一般,*,*,*,*,社長,シャチョウ,シャチョー,,'tokens[0].start()#=> 0tokens[0].end()#=> 2

Documentation

importvibratohelp(vibrato)

License