Part of the book series:Communications in Computer and Information Science ((CCIS,volume 1258))
Included in the following conference series:
1430Accesses
- The original version of this chapter was revised: The first sentence in section 4.2 has been revised by adding the reference [18], and the source has been added in the References section. The correction to this chapter is available athttps://doi.org/10.1007/978-981-15-7984-4_48
Abstract
Sentiment analysis is one of the most popular fields in NLP, and with the development of computer software and hardware, its application is increasingly extensive. Supervised corpus has a positive effect on model training, but these corpus are prohibitively expensive to manually produce. This paper proposes a deep learning sentiment analysis model based on transfer learning. It represents the sentiment and semantics of words and improves the effect of Vietnamese sentiment analysis model by using English corpus. It generated semantic vectors through Word2Vec, an open-source tool, and built sentiment vectors through LSTM with attention mechanism to get sentiment word vector. With the method of sharing parameters, the model was pre-training with English corpus. Finally, the sentiment of the text was classified by stacked Bi-LSTM with attention mechanism, with input of sentiment word vector. Experiments show that the model can effectively improve the performance of Vietnamese sentiment analysis under small language materials.
This is a preview of subscription content,log in via an institution to check access.
Access this chapter
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
- Chapter
- JPY 3498
- Price includes VAT (Japan)
- eBook
- JPY 5719
- Price includes VAT (Japan)
- Softcover Book
- JPY 7149
- Price includes VAT (Japan)
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Change history
20 August 2020
In the originally published chapter 3 the reference to source [18] was erroneously omitted. The first sentence in section 4.2 has been revised by adding the reference [18], and the source has been added in the References section.
References
Meng, S., Zhao, Y., Guan, D., Zhai, X.: A sentiment analysis method combining sentimental and semantic information. J. Comput. Appl.39(7), 1931–1935 (2019)
Xu, G., Yu, Z., Yao, H., Li, F., Meng, Y., Wu, X.: Chinese text sentiment analysis based on extended sentiment dictionary. IEEE Access7, 43749–43762 (2019)
Mullen, T., Collier, N.: Sentiment analysis using support vector machines with diverse information sources. In: Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pp. 412–418 (2004)
Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., Qin, B.: Learning sentiment-specific word embedding for Twitter sentiment classification. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1555–1565 (2014)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprintarXiv:1301.3781 (2013)
Xu, G., Meng, Y., Qiu, X., Yu, Z., Wu, X.: Sentiment analysis of comment texts based on BiLSTM. IEEE Access7, 51522–51532 (2019)
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1480–1489 (2016)
Wang, Y., Huang, M., Zhu, X., Zhao, L.: Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 606–615 (2016)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput.9(8), 1735–1780 (1997)
Lan, M., Zhang, Z., Lu, Y., Wu, J.: Three convolutional neural network-based models for learning sentiment word vectors towards sentiment analysis. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp. 3172–3179. IEEE (2016)
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res.12, 2493–2537 (2011)
Phu, V.N., Chau, V.T.N., Tran, V.T.N., Duy, D.N., Duy, K.L.D.: A valence-totaling model for vietnamese sentiment classification. Evolving Syst.10(3), 453–499 (2019)
Nguyen-Nhat, D.-K., Duong, H.-T.: One-document training for vietnamese sentiment analysis. In: Tagarelli, A., Tong, H. (eds.) CSoNet 2019. LNCS, vol. 11917, pp. 189–200. Springer, Cham (2019).https://doi.org/10.1007/978-3-030-34980-6_21
Zhou, P., et al.: Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 207–212 (2016)
Kim, Y.: Convolutional neural networks for sentence classification. arXiv preprintarXiv:1408.5882 (2014)
Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res.9, 2579–2605 (2008)
Maas, A.L., Daly, R.E., Pham, P.T., Huang, D., Ng, A.Y., Potts, C.: Learning word vectors for sentiment analysis. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, vol. 1, pp. 142–150. Association for Computational Linguistics (2011)
Van Nguyen, K., Nguyen, V.D., Nguyen, P.X.V., et al.: UIT-VSFC: Vietnamese students’ feedback corpus for sentiment analysis. In: Proceeedings of the 10th International Conference on Knowledge and Systems Engineering (KSE), pp. 19–24. IEEE (2018)
Acknowledgment
This work is supported by Chinese National Science Foundation (#61763007), the higher education research project of National Ethnic Affairs Commission “Research and Practice on the Training Mode of Applied Innovative Software Talents Base on Collaborative Education and innovation” (17056), and the Innovation Team project of Xiangsihu Youth Scholars of Guangxi University For Nationalities.
Author information
Authors and Affiliations
College of Software and Information Security, Guangxi University for Nationalities, Nanning, China
Yong Huang, Siwei Liu, Liangdong Qu & Yongsheng Li
College of Mathematics and Computer Science, Guangxi Normal University for Nationalities, Chongzuo, China
Yong Huang
- Yong Huang
You can also search for this author inPubMed Google Scholar
- Siwei Liu
You can also search for this author inPubMed Google Scholar
- Liangdong Qu
You can also search for this author inPubMed Google Scholar
- Yongsheng Li
You can also search for this author inPubMed Google Scholar
Corresponding author
Correspondence toSiwei Liu.
Editor information
Editors and Affiliations
North University of China, Taiyuan, China
Pinle Qin
Harbin Institute of Technology, Harbin, China
Hongzhi Wang
Harbin University of Science and Technology, Harbin, China
Guanglu Sun
National Academy of Guo Ding Institute of Data Science, Beijing, China
Zeguang Lu
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Huang, Y., Liu, S., Qu, L., Li, Y. (2020). Effective Vietnamese Sentiment Analysis Model Using Sentiment Word Embedding and Transfer Learning. In: Qin, P., Wang, H., Sun, G., Lu, Z. (eds) Data Science. ICPCSEE 2020. Communications in Computer and Information Science, vol 1258. Springer, Singapore. https://doi.org/10.1007/978-981-15-7984-4_3
Download citation
Published:
Publisher Name:Springer, Singapore
Print ISBN:978-981-15-7983-7
Online ISBN:978-981-15-7984-4
eBook Packages:Computer ScienceComputer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative