Repository files navigation

🚀 Help me to become a full-time open-source developer bysponsoring me on GitHub

The Jieba Chinese Word Segmentation Implemented in Rust

Add it to yourCargo.toml:

[dependencies]jieba-rs ="0.7"

then you are good to go. If you are using Rust 2015 you have toextern crate jieba_rs to your crate root as well.

use jieba_rs::Jieba;fnmain(){let jieba =Jieba::new();let words = jieba.cut("我们中出了一个叛徒",false);assert_eq!(words, vec!["我们","中","出","了","一个","叛徒"]);}

• default-dict feature enables embedded dictionary, this features is enabled by default
• tfidf feature enables TF-IDF keywords extractor
• textrank feature enables TextRank keywords extractor

[dependencies]jieba-rs = {version ="0.7",features = ["tfidf","textrank"] }

cargo bench --all-features

• Optimizing jieba-rs to be 33% faster than cppjieba
• 优化 jieba-rs 中文分词性能评测
• 最佳化 jieba-rs 中文斷詞性能測試

• @node-rs/jieba NodeJS binding
• jieba-php PHP binding
• rjieba-py Python binding
• cang-jie Chinese tokenizer for tantivy
• tantivy-jieba An adapter that bridges between tantivy and jieba-rs
• jieba-wasm the WebAssembly binding

This work is released under the MIT license. A copy of the license is provided in theLICENSE file.