Movatterモバイル変換


[0]ホーム

URL:


Skip to main content

Advertisement

Springer Nature Link
Log in

Sentence Difficulty in Three Languages: Russian Dataset Compared to Italian and English

  • Conference paper
  • First Online:

Abstract

The task of predicting text complexity has been extensively studied in various languages. However, there has been relatively less research interest in predicting complexity at the sentence level specifically in the Russian language. In this paper, we conduct experiments using a novel dataset that includes sentence-level annotations for complexity. Our study focuses on examining simple syntactical features and baseline models, such as graph neural networks and pre-trained language models. Furthermore, we compare our findings with existing datasets in Italian and English.

This is a preview of subscription content,log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 12583
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 10724
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Similar content being viewed by others

Notes

  1. 1.

    Here, we refer to model names from the Huggingface,https://huggingface.co.

References

  1. Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. CoRR abs/1607.04606 (2016).http://arxiv.org/abs/1607.04606

  2. Brunato, D., De Mattei, L., Dell’Orletta, F., Iavarone, B., Venturi, G.: Is this sentence difficult? Do you agree? In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, pp. 2690–2699. Association for Computational Linguistics (2018).https://doi.org/10.18653/v1/D18-1289,https://aclanthology.org/D18-1289

  3. Brysbaert, M., New, B.: Subtlex-us frequency list with POS information final text version (2013)

    Google Scholar 

  4. Collins-Thompson, K., Callan, J.: Predicting reading difficulty with statistical language models. J. Am. Soc. Inform. Sci. Technol.56(13), 1448–1462 (2005)

    Article  Google Scholar 

  5. Crossley, S.A., Greenfield, J., McNamara, D.S.: Assessing text readability using cognitively based indices. TESOL Q.42(3), 475–493 (2008)

    Article  Google Scholar 

  6. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprintarXiv:1810.04805 (2018)

  7. Heilman, M., Collins-Thompson, K., Eskenazi, M.: An analysis of statistical models and features for reading difficulty prediction. In: Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications, pp. 71–79 (2008)

    Google Scholar 

  8. Iavarone, B., Brunato, D., Dell’Orletta, F.: Sentence complexity in context. In: Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, pp. 186–199. Association for Computational Linguistics, Online (2021).https://doi.org/10.18653/v1/2021.cmcl-1.23

  9. Inui, K., Yamamoto, S.: Corpus-based acquisition of sentence readability ranking models for deaf people. In: Proceedings of the Sixth Natural Language Processing Pacific Rim Symposium, 27–30 November 2001, Tokyo, Japan, pp. 159–166, Hitotsubashi Memorial Hall, National Center of Sciences (2001).http://www.afnlp.org/nlprs2001/pdf/0035-01.pdf

  10. Ivanov, V.: Sentence-level complexity in Russian: an evaluation of BERT and graph neural networks. Front. Artif. Intell.5 (2022)

    Google Scholar 

  11. Ivanov, V., Elbayoumi, M.G.: A new dataset for sentence-level complexity in Russian. In: Computational Linguistics and Intellectual Technologies: Papers from the Annual International Conference “Dialogue” (2023)

    Google Scholar 

  12. Khallaf, N., Sharoff, S.: Automatic difficulty classification of Arabic sentences. In: Workshop on Arabic Natural Language Processing (2021)

    Google Scholar 

  13. Lo Bosco, G., Pilato, G., Schicchi, D.: Deepeva: a deep neural network architecture for assessing sentence complexity in Italian and English languages. Array12, 100097 (2021)https://doi.org/10.1016/j.array.2021.100097,https://www.sciencedirect.com/science/article/pii/S2590005621000424

  14. Lyashevskaya, O., Sharov, S.A.: Frequency dictionary of the modern Russian language (the Russian National Corpus) (2009)

    Google Scholar 

  15. Lyding, V., et al.: The paisa’ corpus of Italian web texts (2014).https://doi.org/10.3115/v1/W14-0406

  16. Maqsood, S., et al.: Assessing English language sentences readability using machine learning models. PeerJ Comput. Sci.7, e818 (2022)

    Article  Google Scholar 

  17. Schicchi, D., Pilato, G., Bosco, G.L.: Deep neural attention-based model for the evaluation of Italian sentences complexity. In: 2020 IEEE 14th International Conference on Semantic Computing (ICSC), pp. 253–256. IEEE (2020)

    Google Scholar 

  18. Schumacher, E., Eskenazi, M., Frishkoff, G., Collins-Thompson, K.: Predicting the relative difficulty of single sentences with and without surrounding context. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 1871–1881, Austin, Texas. Association for Computational Linguistics (2016).https://doi.org/10.18653/v1/D16-1192,https://aclanthology.org/D16-1192

  19. Shardlow, M., Cooper, M., Zampieri, M.: CompLex — a new corpus for lexical complexity prediction from Likert Scale data. In: Proceedings of the 1st Workshop on Tools and Resources to Empower People with REAding DIfficulties (READI), Marseille, France, pp. 57–62. European Language Resources Association (2020).https://aclanthology.org/2020.readi-1.9

  20. Shardlow, M., Evans, R., Paetzold, G.H., Zampieri, M.: SemEval-2021 task 1: lexical complexity prediction. In: Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021). pp. 1–16. Association for Computational Linguistics, Online (2021).https://doi.org/10.18653/v1/2021.semeval-1.1,https://aclanthology.org/2021.semeval-1.1

  21. Vajjala, S., Meurers, D.: Assessing the relative reading level of sentence pairs for text simplification. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, Gothenburg, Sweden, pp. 288–297. Association for Computational Linguistics (2014).https://doi.org/10.3115/v1/E14-1031,https://aclanthology.org/E14-1031

  22. Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)

    Google Scholar 

Download references

Acknowledgments

This work is funded by Russian Science Foundation, grant # 22-21-00334.

Author information

Authors and Affiliations

  1. Innopolis University, Innopolis, Russia

    Vladimir Ivanov

  2. Kazan Federal University, Kazan, Russia

    Vladimir Ivanov & Elbayoumi Mohamed Gamal

Authors
  1. Vladimir Ivanov

    You can also search for this author inPubMed Google Scholar

  2. Elbayoumi Mohamed Gamal

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toVladimir Ivanov.

Editor information

Editors and Affiliations

  1. National Research University Higher School of Economics, Moscow, Russia

    Dmitry I. Ignatov

  2. Krasovskii Institute of Mathematics and Mechanics of Russian Academy of Sciences, Yekaterinburg, Russia

    Michael Khachay

  3. University of Oslo, Oslo, Norway

    Andrey Kutuzov

  4. American University of Armenia, Yerevan, Armenia

    Habet Madoyan

  5. Artificial Intelligence Research Institute, Moscow, Russia

    Ilya Makarov

  6. Universität Hamburg, Hamburg, Germany

    Irina Nikishina

  7. Skolkovo Institute of Science and Technology, Moscow, Russia

    Alexander Panchenko

  8. Mohamed bin Zayed University of Artificial Intelligence and Technology Innovation Institute, Abu Dhabi, United Arab Emirates

    Maxim Panov

  9. Industrial and Systems Engineering, University of Florida, Gainesville, FL, USA

    Panos M. Pardalos

  10. National Research University Higher School of Economics, Nizhny Novgorod, Russia

    Andrey V. Savchenko

  11. Apptek, Aachen, Nordrhein-Westfalen, Germany

    Evgenii Tsymbalov

  12. Kazan Federal University and HSE University, Moscow, Russia

    Elena Tutubalina

  13. MTS AI, Moscow, Russia

    Sergey Zagoruyko

Rights and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ivanov, V., Gamal, E.M. (2024). Sentence Difficulty in Three Languages: Russian Dataset Compared to Italian and English. In: Ignatov, D.I.,et al. Recent Trends in Analysis of Images, Social Networks and Texts. AIST 2023. Communications in Computer and Information Science, vol 1905. Springer, Cham. https://doi.org/10.1007/978-3-031-67008-4_2

Download citation

Publish with us

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 12583
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 10724
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only


[8]ページ先頭

©2009-2025 Movatter.jp