Upgrade to Unicode 10#56

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Jump to bottom

Merged

Manishearth merged 1 commit intounicode-rs:masterfromrth:unicode-10

Oct 22, 2019

Merged

Upgrade to Unicode 10#56

Manishearth merged 1 commit intounicode-rs:masterfromrth:unicode-10

Oct 22, 2019

Conversation

Copy link

Contributor

rth commentedMay 15, 2019

Partially addresses#43 by first upgrading to Unicode 10.0 (from 9.0).

As mentioned in that issue,

We may want to update to Unicode 10 before that; that should be a straightforward regen of the tables IIRC.

which is what I have done here.

Fromhttp://www.unicode.org/versions/Unicode10.0.0/ release notes,

UAX # 29 Unicode Text Segmentation
Strengthened the recommendation to use tailorings based on CLDR rules and emoji properties, for improved segmentation behavior of emoji zwj sequences. Changed the derivation of the Word_Break property value ALetter to include a set of 35 phonetic modifiers, to prevent word boundaries between those characters and alphabetic letters.

So no code changes are necessary as these modifications are included in the updated tables data, if I understand it right ?