cw2vec: Learning Chinese Word Embeddings with Stroke n-gram Information
Authors
- Shaosheng CaoAnt Financial Services Group; Singapore University of Technology and Design
- Wei LuSingapore University of Technology and Design
- Jun ZhouAnt Financial Services Group
- Xiaolong LiAnt Financial Services Group
DOI:
https://doi.org/10.1609/aaai.v32i1.12029Abstract
We propose cw2vec, a novel method for learning Chinese word embeddings. It is based on our observation that exploiting stroke-level information is crucial for improving the learning of Chinese word embeddings. Specifically, we design a minimalist approach to exploit such features, by using stroke n-grams, which capture semantic and morphological level information of Chinese words. Through qualitative analysis, we demonstrate that our model is able to extract semantic information that cannot be captured by existing methods. Empirical results on the word similarity, word analogy, text classification and named entity recognition tasks show that the proposed approach consistently outperforms state-of-the-art approaches such as word-based word2vec and GloVe, character-based CWE, component-based JWE and pixel-based GWE.