cw2vec: Learning Chinese Word Embeddings with Stroke n-gram Information

Authors

  • Shaosheng CaoAnt Financial Services Group; Singapore University of Technology and Design
  • Wei LuSingapore University of Technology and Design
  • Jun ZhouAnt Financial Services Group
  • Xiaolong LiAnt Financial Services Group

DOI:

https://doi.org/10.1609/aaai.v32i1.12029

Abstract

We propose cw2vec, a novel method for learning Chinese word embeddings. It is based on our observation that exploiting stroke-level information is crucial for improving the learning of Chinese word embeddings. Specifically, we design a minimalist approach to exploit such features, by using stroke n-grams, which capture semantic and morphological level information of Chinese words. Through qualitative analysis, we demonstrate that our model is able to extract semantic information that  cannot be captured by existing methods. Empirical results on the word similarity, word analogy, text classification and named entity recognition tasks show that the proposed approach consistently outperforms state-of-the-art approaches such as word-based word2vec and GloVe, character-based CWE, component-based JWE and pixel-based GWE.

AAAI 2018 Proceedings Cover

Downloads

Published

2018-04-27

How to Cite

Cao, S., Lu, W., Zhou, J., & Li, X. (2018). cw2vec: Learning Chinese Word Embeddings with Stroke n-gram Information.Proceedings of the AAAI Conference on Artificial Intelligence,32(1). https://doi.org/10.1609/aaai.v32i1.12029