Part of the book series:Communications in Computer and Information Science ((CCIS,volume 1905))
Included in the following conference series:
149Accesses
Abstract
The task of predicting text complexity has been extensively studied in various languages. However, there has been relatively less research interest in predicting complexity at the sentence level specifically in the Russian language. In this paper, we conduct experiments using a novel dataset that includes sentence-level annotations for complexity. Our study focuses on examining simple syntactical features and baseline models, such as graph neural networks and pre-trained language models. Furthermore, we compare our findings with existing datasets in Italian and English.
This is a preview of subscription content,log in via an institution to check access.
Access this chapter
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
- Chapter
- JPY 3498
- Price includes VAT (Japan)
- eBook
- JPY 12583
- Price includes VAT (Japan)
- Softcover Book
- JPY 10724
- Price includes VAT (Japan)
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Here, we refer to model names from the Huggingface,https://huggingface.co.
References
Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. CoRR abs/1607.04606 (2016).http://arxiv.org/abs/1607.04606
Brunato, D., De Mattei, L., Dell’Orletta, F., Iavarone, B., Venturi, G.: Is this sentence difficult? Do you agree? In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, pp. 2690–2699. Association for Computational Linguistics (2018).https://doi.org/10.18653/v1/D18-1289,https://aclanthology.org/D18-1289
Brysbaert, M., New, B.: Subtlex-us frequency list with POS information final text version (2013)
Collins-Thompson, K., Callan, J.: Predicting reading difficulty with statistical language models. J. Am. Soc. Inform. Sci. Technol.56(13), 1448–1462 (2005)
Crossley, S.A., Greenfield, J., McNamara, D.S.: Assessing text readability using cognitively based indices. TESOL Q.42(3), 475–493 (2008)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprintarXiv:1810.04805 (2018)
Heilman, M., Collins-Thompson, K., Eskenazi, M.: An analysis of statistical models and features for reading difficulty prediction. In: Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications, pp. 71–79 (2008)
Iavarone, B., Brunato, D., Dell’Orletta, F.: Sentence complexity in context. In: Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pp. 186–199. Association for Computational Linguistics, Online (2021).https://doi.org/10.18653/v1/2021.cmcl-1.23
Inui, K., Yamamoto, S.: Corpus-based acquisition of sentence readability ranking models for deaf people. In: Proceedings of the Sixth Natural Language Processing Pacific Rim Symposium, 27–30 November 2001, Tokyo, Japan, pp. 159–166, Hitotsubashi Memorial Hall, National Center of Sciences (2001).http://www.afnlp.org/nlprs2001/pdf/0035-01.pdf
Ivanov, V.: Sentence-level complexity in Russian: an evaluation of BERT and graph neural networks. Front. Artif. Intell.5 (2022)
Ivanov, V., Elbayoumi, M.G.: A new dataset for sentence-level complexity in Russian. In: Computational Linguistics and Intellectual Technologies: Papers from the Annual International Conference “Dialogue” (2023)
Khallaf, N., Sharoff, S.: Automatic difficulty classification of Arabic sentences. In: Workshop on Arabic Natural Language Processing (2021)
Lo Bosco, G., Pilato, G., Schicchi, D.: Deepeva: a deep neural network architecture for assessing sentence complexity in Italian and English languages. Array12, 100097 (2021)https://doi.org/10.1016/j.array.2021.100097,https://www.sciencedirect.com/science/article/pii/S2590005621000424
Lyashevskaya, O., Sharov, S.A.: Frequency dictionary of the modern Russian language (the Russian National Corpus) (2009)
Lyding, V., et al.: The paisa’ corpus of Italian web texts (2014).https://doi.org/10.3115/v1/W14-0406
Maqsood, S., et al.: Assessing English language sentences readability using machine learning models. PeerJ Comput. Sci.7, e818 (2022)
Schicchi, D., Pilato, G., Bosco, G.L.: Deep neural attention-based model for the evaluation of Italian sentences complexity. In: 2020 IEEE 14th International Conference on Semantic Computing (ICSC), pp. 253–256. IEEE (2020)
Schumacher, E., Eskenazi, M., Frishkoff, G., Collins-Thompson, K.: Predicting the relative difficulty of single sentences with and without surrounding context. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 1871–1881, Austin, Texas. Association for Computational Linguistics (2016).https://doi.org/10.18653/v1/D16-1192,https://aclanthology.org/D16-1192
Shardlow, M., Cooper, M., Zampieri, M.: CompLex — a new corpus for lexical complexity prediction from Likert Scale data. In: Proceedings of the 1st Workshop on Tools and Resources to Empower People with REAding DIfficulties (READI), Marseille, France, pp. 57–62. European Language Resources Association (2020).https://aclanthology.org/2020.readi-1.9
Shardlow, M., Evans, R., Paetzold, G.H., Zampieri, M.: SemEval-2021 task 1: lexical complexity prediction. In: Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021). pp. 1–16. Association for Computational Linguistics, Online (2021).https://doi.org/10.18653/v1/2021.semeval-1.1,https://aclanthology.org/2021.semeval-1.1
Vajjala, S., Meurers, D.: Assessing the relative reading level of sentence pairs for text simplification. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, Gothenburg, Sweden, pp. 288–297. Association for Computational Linguistics (2014).https://doi.org/10.3115/v1/E14-1031,https://aclanthology.org/E14-1031
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Acknowledgments
This work is funded by Russian Science Foundation, grant # 22-21-00334.
Author information
Authors and Affiliations
Innopolis University, Innopolis, Russia
Vladimir Ivanov
Kazan Federal University, Kazan, Russia
Vladimir Ivanov & Elbayoumi Mohamed Gamal
- Vladimir Ivanov
You can also search for this author inPubMed Google Scholar
- Elbayoumi Mohamed Gamal
You can also search for this author inPubMed Google Scholar
Corresponding author
Correspondence toVladimir Ivanov.
Editor information
Editors and Affiliations
National Research University Higher School of Economics, Moscow, Russia
Dmitry I. Ignatov
Krasovskii Institute of Mathematics and Mechanics of Russian Academy of Sciences, Yekaterinburg, Russia
Michael Khachay
University of Oslo, Oslo, Norway
Andrey Kutuzov
American University of Armenia, Yerevan, Armenia
Habet Madoyan
Artificial Intelligence Research Institute, Moscow, Russia
Ilya Makarov
Universität Hamburg, Hamburg, Germany
Irina Nikishina
Skolkovo Institute of Science and Technology, Moscow, Russia
Alexander Panchenko
Mohamed bin Zayed University of Artificial Intelligence and Technology Innovation Institute, Abu Dhabi, United Arab Emirates
Maxim Panov
Industrial and Systems Engineering, University of Florida, Gainesville, FL, USA
Panos M. Pardalos
National Research University Higher School of Economics, Nizhny Novgorod, Russia
Andrey V. Savchenko
Apptek, Aachen, Nordrhein-Westfalen, Germany
Evgenii Tsymbalov
Kazan Federal University and HSE University, Moscow, Russia
Elena Tutubalina
MTS AI, Moscow, Russia
Sergey Zagoruyko
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ivanov, V., Gamal, E.M. (2024). Sentence Difficulty in Three Languages: Russian Dataset Compared to Italian and English. In: Ignatov, D.I.,et al. Recent Trends in Analysis of Images, Social Networks and Texts. AIST 2023. Communications in Computer and Information Science, vol 1905. Springer, Cham. https://doi.org/10.1007/978-3-031-67008-4_2
Download citation
Published:
Publisher Name:Springer, Cham
Print ISBN:978-3-031-67007-7
Online ISBN:978-3-031-67008-4
eBook Packages:Computer ScienceComputer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative