Repository files navigation

Iterators which split strings on Grapheme Cluster or Word boundaries, accordingto theUnicode Standard Annex #29 rules.

Documentation

use unicode_segmentation::UnicodeSegmentation;fnmain(){let s ="a̐éö̲\r\n";let g = s.graphemes(true).collect::<Vec<&str>>();let b:&[_] =&["a̐","é","ö̲","\r\n"];assert_eq!(g, b);let s ="The quick (\"brown\") fox can't jump 32.3 feet, right?";let w = s.unicode_words().collect::<Vec<&str>>();let b:&[_] =&["The","quick","brown","fox","can't","jump","32.3","feet","right"];assert_eq!(w, b);let s ="The quick (\"brown\")  fox";let w = s.split_word_bounds().collect::<Vec<&str>>();let b:&[_] =&["The"," ","quick"," ","(","\"","brown","\"",")","  ","fox"];assert_eq!(w, b);}

unicode-segmentation does not depend on libstd, so it can be used in crateswith the#![no_std] attribute.

You can use this package in your project by adding the followingto yourCargo.toml:

[dependencies]unicode-segmentation ="1.10.1"

• #124 Update data to Unicode 15.1
• #128 Addsize_hint to iterators

• #113 Use criterion.rs for word benchmarks
• #112 Improve table search speed through lookups

• #107 Upgrade to Unicode 15.0.0
• #104 Supersedes and fixes#75

• #101 Upgrade to Unicode 14.0.0

• #100 *#100 - Increase#[inline] opportunities, resulting in 15-40% performance improvement.
• #95 Implement debug for Graphemes
• #94 Add Initial fuzzer for oss-fuzz integration
• #93 Fix unused imports and deprecated pattern warnings
• #91 Made local variable immutable by moving it into loop
• #91 Add new iteratorUnicodeWordIndices andunicode_word_indices

• Update docs on version number

• #87 Upgrade to Unicode 13
• #79 Implement a special-case lookup for ascii grapheme categories
• #77 Optimization for grapheme iteration

• #72 Upgrade to Unicode 12

• #68 Upgrade to Unicode 11

• #56 Upgrade to Unicode 10

• #24 Add support for sentence boundaries
• #44 Treatgc=No as a subset ofgc=N

• #37:Fix panic inprovide_context.
• #40:Fix crash inprev_boundary.

• NewGraphemeCursor API allows random access and bidirectional iteration.
• Fixed incorrect splitting of certain emoji modifier sequences.

• Addas_str methods to the iterator types.

• Code cleanup and additional tests.

• Fix a bug affecting some grapheme clusters containing Prepend characters.

• Upgrade to Unicode 9.0.0.