Movatterモバイル変換

[0]ホーム
URL:

Skip to main content

Advertisement

Springer Nature Link
Log in

ImageCLEF 2023 Highlight: Multimedia Retrieval in Medical, Social Media and Content Recommendation Applications

  • Conference paper
  • First Online:

Part of the book series:Lecture Notes in Computer Science ((LNCS,volume 13982))

Included in the following conference series:

Abstract

In this paper, we provide an overview of the upcoming ImageCLEF campaign. ImageCLEF is part of the CLEF Conference and Labs of the Evaluation Forum since 2003. ImageCLEF, the Multimedia Retrieval task in CLEF, is an ongoing evaluation initiative that promotes the evaluation of technologies for annotation, indexing, and retrieval of multimodal data with the aim of providing information access to large collections of data in various usage scenarios and domains. In its 21st edition, ImageCLEF 2023 will have four main tasks: (i) aMedical task addressing automatic image captioning, synthetic medical images created with GANs, Visual Question Answering for colonoscopy images, and medical dialogue summarization; (ii) anAware task addressing the prediction of real-life consequences of online photo sharing; (iii) aFusion task addressing late fusion techniques based on the expertise of a pool of classifiers; and (iv) aRecommending task addressing cultural heritage content-recommendation. In 2022, ImageCLEF received the participation of over 25 groups submitting more than 258 runs. These numbers show the impact of the campaign. With the COVID-19 pandemic now over, we expect that the interest in participating, especially at the physical CLEF sessions, will increase significantly in 2023.

This is a preview of subscription content,log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 11439
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 14299
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Similar content being viewed by others

References

  1. Azcona, D., Moreu, E., Hu, F., Ward, T.E., Smeaton, A.F.: Predicting media memorability using ensemble models. In: Working Notes Proceedings of the MediaEval 2019 Workshop. CEUR Workshop Proceedings, vol. 2670. CEUR-WS.org (2019)

    Google Scholar 

  2. Borgli, H., et al.: Hyperkvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Sci. Data7(1), 1–14 (2020)

    Article  Google Scholar 

  3. Cao, Y., Shui, R., Pan, L., Kan, M.Y., Liu, Z., Chua, T.S.: Expertise style transfer: a new task towards better communication between experts and laymen. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1061–1071. Association for Computational Linguistics (2020).https://doi.org/10.18653/v1/2020.acl-main.100.https://aclanthology.org/2020.acl-main.100

  4. Constantin, M.G., Ştefan, L.D., Ionescu, B., Duong, N.Q., Demarty, C.H., Sjöberg, M.: Visual interestingness prediction: a benchmark framework and literature review. Int. J. Comput. Vis. 1–25 (2021)

    Google Scholar 

  5. Dai, Q., et al.: Fudan-Huawei at MediaEval 2015: detecting violent scenes and affective impact in movies with deep learning. In: Working Notes Proceedings of the MediaEval 2015 Workshop. CEUR Workshop Proceedings, vol. 1436. CEUR-WS.org (2015)

    Google Scholar 

  6. Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, Minnesota, pp. 4171–4186. Association for Computational Linguistics (2019).https://doi.org/10.18653/v1/N19-1423.https://aclanthology.org/N19-1423D

  7. Doerr, M., Gradmann, S., Hennicke, S., Isaac, A., Meghini, C., Sompel, H.: The Europeana data model (EDM). In: World Library and Information Congress: 76th IFLA General Conference and Assembly, pp. 10–15 (2010)

    Google Scholar 

  8. Eickhoff, C., Schwall, I., García Seco de Herrera, A., Müller, H.: Overview of ImageCLEFcaption 2017 - the image caption prediction and concept extraction tasks to understand biomedical images. In: Working Notes of Conference and Labs of the Evaluation Forum (CLEF 2017). CEUR Workshop Proceedings, vol. 1866. CEUR-WS.org (2017)

    Google Scholar 

  9. Europeana Foundation: Europeana (2022).https://www.europeana.eu/

  10. García Seco De Herrera, A., Eickhof, C., Andrearczyk, V., Müller, H.: Overview of the ImageCLEF 2018 caption prediction tasks. In: Working Notes of Conference and Labs of the Evaluation Forum (CLEF 2018). CEUR Workshop Proceedings, vol. 2125. CEUR-WS.org (2018)

    Google Scholar 

  11. Goutte, C., Gaussier, E.: A probabilistic interpretation of precision, recall andF-score, with implication for evaluation. In: Losada, D.E., Fernández-Luna, J.M. (eds.) ECIR 2005. LNCS, vol. 3408, pp. 345–359. Springer, Heidelberg (2005).https://doi.org/10.1007/978-3-540-31865-1_25

    Chapter  Google Scholar 

  12. Hicks, S.A., et al.: On evaluation metrics for medical applications of artificial intelligence. Sci. Rep.12(1), 1–9 (2022)

    Article MathSciNet  Google Scholar 

  13. Ionescu, B., Rohm, M., Boteanu, B., Gînscă, A.L., Lupu, M., Müller, H.: Benchmarking image retrieval diversification techniques for social media. IEEE Trans. Multimedia23, 677–691 (2020)

    Article  Google Scholar 

  14. Kalpathy-Cramer, J., García Seco de Herrera, A., Demner-Fushman, D., Antani, S., Bedrick, S., Müller, H.: Evaluating performance of biomedical image retrieval systems: overview of the medical image retrieval task at ImageCLEF 2004–2014. Comput. Med. Imaging Graph.39, 55–61 (2015)

    Google Scholar 

  15. Li, J., Jia, R., He, H., Liang, P.: Delete, retrieve, generate: a simple approach to sentiment and style transfer. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), New Orleans, Louisiana, pp. 1865–1874. Association for Computational Linguistics (2018).https://doi.org/10.18653/v1/N18-1169.https://aclanthology.org/N18-1169

  16. Lin, C.Y.: ROUGE: a package for automatic evaluation of summaries. In: Text Summarization Branches Out, Barcelona, Spain, pp. 74–81. Association for Computational Linguistics (2004).https://aclanthology.org/W04-1013

  17. Müller, H., Clough, P., Deselaers, T., Caputo, B. (eds.): ImageCLEF - Experimental Evaluation in Visual Information Retrieval. The Information Retrieval Series, vol. 32. Springer, Heidelberg (2010).https://doi.org/10.1007/978-3-642-15181-1

    Book MATH  Google Scholar 

  18. Müller, H., Kalpathy-Cramer, J., García Seco de Herrera, A.: Experiences from the ImageCLEF medical retrieval and annotation tasks. In: Information Retrieval Evaluation in a Changing World. TIRS, vol. 41, pp. 231–250. Springer, Cham (2019).https://doi.org/10.1007/978-3-030-22948-1_10

    Chapter  Google Scholar 

  19. Pangeanic, Anacode and Europeana Foundation: The recommendation system (2022).https://pro.europeana.eu/page/the-recommendation-system

  20. Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL 2002), pp. 311–318 (2002)

    Google Scholar 

  21. Pelka, O., Abacha, A.B., García Seco de Herrera, A., Jacutprakart, J., Friedrich, C.M., Müller, H.: Overview of the ImageCLEFmed 2021 concept & caption prediction task. In: Working Notes of Conference and Labs of the Evaluation Forum (CLEF 2021). CEUR Workshop Proceedings, vol. 2936. CEUR-WS.org (2021)

    Google Scholar 

  22. Pelka, O., Friedrich, C.M., García Seco de Herrera, A., Müller, H.: Overview of the ImageCLEFmed 2019 concept detection task. In: Working Notes of Conference and Labs of the Evaluation Forum (CLEF 2019). CEUR Workshop Proceedings, vol. 2380. CEUR-WS.org (2019)

    Google Scholar 

  23. Pelka, O., Friedrich, C.M., García Seco de Herrera, A., Müller, H.: Overview of the ImageCLEFmed 2020 concept prediction task: medical image understanding. In: Working Notes of Conference and Labs of the Evaluation Forum (CLEF 2020). CEUR Workshop Proceedings, vol. 2696. CEUR-WS.org (2020)

    Google Scholar 

  24. Pelka, O., Koitka, S., Rückert, J., Nensa, F., Friedrich, C.M.: Radiology objects in COntext (ROCO): a multimodal image dataset. In: Stoyanov, D., et al. (eds.) LABELS/CVII/STENT -2018. LNCS, vol. 11043, pp. 180–189. Springer, Cham (2018).https://doi.org/10.1007/978-3-030-01364-6_20

    Chapter  Google Scholar 

  25. Rückert, J., et al.: Overview of ImageCLEFmedical 2022 - caption prediction and concept detection. In: CLEF2022 Working Notes, Bologna, Italy, 5–8 September 2022. CEUR Workshop Proceedings, CEUR-WS.org (2022)

    Google Scholar 

  26. Sellam, T., Das, D., Parikh, A.: BLEURT: learning robust metrics for text generation. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 7881–7892. Association for Computational Linguistics (2020).https://doi.org/10.18653/v1/2020.acl-main.704.https://aclanthology.org/2020.acl-main.704

  27. Ştefan, L.D., Constantin, M.G., Dogariu, M., Ionescu, B.: Overview of imagecleffusion 2022 task-ensembling methods for media interestingness prediction and result diversification. In: Working Notes of Conference and Labs of the Evaluation Forum (CLEF 2022). CEUR Workshop Proceedings, CEUR-WS.org (2022)

    Google Scholar 

  28. Sudhakaran, S., Escalera, S., Lanz, O.: Gate-shift networks for video action recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), pp. 1102–1111 (2020)

    Google Scholar 

  29. Tsikrika, T., de Herrera, A.G.S., Müller, H.: Assessing the scholarly impact of ImageCLEF. In: Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., de Rijke, M. (eds.) CLEF 2011. LNCS, vol. 6941, pp. 95–106. Springer, Heidelberg (2011).https://doi.org/10.1007/978-3-642-23708-9_12

    Chapter  Google Scholar 

  30. Wang, S., Chen, S., Zhao, J., Jin, Q.: Video interestingness prediction based on ranking model. In: Proceedings of the Joint Workshop of the 4th Workshop on Affective Social Multimedia Computing and First Multi-Modal Affective Computing of Large-Scale Multimedia Data (ASMMC-MMAC 2018), pp. 55–61. Association for Computing Machinery (ACM) (2018)

    Google Scholar 

  31. Xu, W., Saxon, M., Sra, M., Wang, W.Y.: Self-supervised knowledge assimilation for expert-layman text style transfer. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 10, pp. 11566–11574 (2022).https://doi.org/10.1609/aaai.v36i10.21410.https://ojs.aaai.org/index.php/AAAI/article/view/21410

  32. Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., Artzi, Y.: Bertscore: evaluating text generation with BERT. In: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, 26–30 April 2020 (2020).https://openreview.net/forum?id=SkeHuCVFDr

Download references

Acknowledgement

The lab is supported under the H2020 AI4Media “A European Excellence Centre for Media, Society and Democracy” project, contract\(\#951911\), as well as the ImageCLEFaware, ImageCLEFfusion and ImageCLEFrecommending tasks. The work of Louise Bloch and Raphael Brüngel was partially funded by a PhD grant from the University of Applied Sciences and Arts Dortmund (FH Dortmund), Germany. The work of Ahmad Idrissi-Yaghir and Henning Schäfer was funded by a PhD grant from the DFG Research Training Group 2535 Knowledge- and data-based personalisation of medicine at the point of care (WisPerMed).

Author information

Authors and Affiliations

  1. Politehnica University of Bucharest, Bucharest, Romania

    Bogdan Ionescu, Ana Maria Drăgulinescu, Alexandra Andrei, Ioan Coman, Liviu-Daniel Ştefan, Mihai Dogariu & Mihai Gabriel Constantin

  2. University of Applied Sciences Western Switzerland (HES-SO), Sierre, Switzerland

    Henning Müller

  3. CEA LIST, Gif-sur-Yvette, France

    Adrian Popescu & Jérôme Deshayes

  4. University of Applied Sciences and Arts Dortmund, Dortmund, Germany

    Ahmad Idrissi-Yaghir, Christoph M. Friedrich, Johannes Rückert, Louise Bloch & Raphael Brüngel

  5. University of Essex, Colchester, UK

    Alba García Seco de Herrera

  6. IN2 Digital Innovations, Lindau, Germany

    Alexandru Stan & George Ioannidis

  7. SimulaMet, Oslo, Norway

    Andrea M. Storås, Michael A. Riegler, Pål Halvorsen, Steven Hicks & Vajira Thambawita

  8. Microsoft, Redmond, USA

    Asma Ben Abacha, Neal Snider & Wen-Wai Yim

  9. Columbia University, New York, USA

    Griffin Adams

  10. University Hospital Essen, Essen, Germany

    Henning Schäfer

  11. Europeana Foundation, Hague, Netherlands

    Hugo Manguinhas

  12. Belarus State University, Minsk, Belarus

    Ihar Filipovich

  13. Sahlgrenska University Hospital, Gothenburg, Sweden

    Johanna Schöler, Nikolaos Papachrysos & Thomas de Lange

  14. University of Washington, Seattle, USA

    Meliha Yetisgen

  15. Nuance, Burlington, USA

    Neal Snider

  16. Belarusian Academy of Sciences, Minsk, Belarus

    Serge Kozlovski & Vassili Kovalev

Authors
  1. Bogdan Ionescu

    You can also search for this author inPubMed Google Scholar

  2. Henning Müller

    You can also search for this author inPubMed Google Scholar

  3. Ana Maria Drăgulinescu

    You can also search for this author inPubMed Google Scholar

  4. Adrian Popescu

    You can also search for this author inPubMed Google Scholar

  5. Ahmad Idrissi-Yaghir

    You can also search for this author inPubMed Google Scholar

  6. Alba García Seco de Herrera

    You can also search for this author inPubMed Google Scholar

  7. Alexandra Andrei

    You can also search for this author inPubMed Google Scholar

  8. Alexandru Stan

    You can also search for this author inPubMed Google Scholar

  9. Andrea M. Storås

    You can also search for this author inPubMed Google Scholar

  10. Asma Ben Abacha

    You can also search for this author inPubMed Google Scholar

  11. Christoph M. Friedrich

    You can also search for this author inPubMed Google Scholar

  12. George Ioannidis

    You can also search for this author inPubMed Google Scholar

  13. Griffin Adams

    You can also search for this author inPubMed Google Scholar

  14. Henning Schäfer

    You can also search for this author inPubMed Google Scholar

  15. Hugo Manguinhas

    You can also search for this author inPubMed Google Scholar

  16. Ihar Filipovich

    You can also search for this author inPubMed Google Scholar

  17. Ioan Coman

    You can also search for this author inPubMed Google Scholar

  18. Jérôme Deshayes

    You can also search for this author inPubMed Google Scholar

  19. Johanna Schöler

    You can also search for this author inPubMed Google Scholar

  20. Johannes Rückert

    You can also search for this author inPubMed Google Scholar

  21. Liviu-Daniel Ştefan

    You can also search for this author inPubMed Google Scholar

  22. Louise Bloch

    You can also search for this author inPubMed Google Scholar

  23. Meliha Yetisgen

    You can also search for this author inPubMed Google Scholar

  24. Michael A. Riegler

    You can also search for this author inPubMed Google Scholar

  25. Mihai Dogariu

    You can also search for this author inPubMed Google Scholar

  26. Mihai Gabriel Constantin

    You can also search for this author inPubMed Google Scholar

  27. Neal Snider

    You can also search for this author inPubMed Google Scholar

  28. Nikolaos Papachrysos

    You can also search for this author inPubMed Google Scholar

  29. Pål Halvorsen

    You can also search for this author inPubMed Google Scholar

  30. Raphael Brüngel

    You can also search for this author inPubMed Google Scholar

  31. Serge Kozlovski

    You can also search for this author inPubMed Google Scholar

  32. Steven Hicks

    You can also search for this author inPubMed Google Scholar

  33. Thomas de Lange

    You can also search for this author inPubMed Google Scholar

  34. Vajira Thambawita

    You can also search for this author inPubMed Google Scholar

  35. Vassili Kovalev

    You can also search for this author inPubMed Google Scholar

  36. Wen-Wai Yim

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toAna Maria Drăgulinescu.

Editor information

Editors and Affiliations

  1. University of Amsterdam, Amsterdam, The Netherlands

    Jaap Kamps

  2. Université Grenoble-Alpes, Saint-Martin-d’Hères, France

    Lorraine Goeuriot

  3. Università della Svizzera Italiana, Lugano, Switzerland

    Fabio Crestani

  4. University of Copenhagen, Copenhagen, Denmark

    Maria Maistro

  5. University of Tsukuba, Ibaraki, Japan

    Hideo Joho

  6. Dublin City University, Dublin, Ireland

    Brian Davis

  7. Dublin City University, Dublin, Ireland

    Cathal Gurrin

  8. Universität Regensburg, Regensburg, Germany

    Udo Kruschwitz

  9. Dublin City University, Dublin, Ireland

    Annalina Caputo

Rights and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ionescu, B.et al. (2023). ImageCLEF 2023 Highlight: Multimedia Retrieval in Medical, Social Media and Content Recommendation Applications. In: Kamps, J.,et al. Advances in Information Retrieval. ECIR 2023. Lecture Notes in Computer Science, vol 13982. Springer, Cham. https://doi.org/10.1007/978-3-031-28241-6_64

Download citation

Publish with us

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 11439
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 14299
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

[8]ページ先頭
©2009-2025 Movatter.jp