Movatterモバイル変換


[0]ホーム

URL:


Skip to main content

Advertisement

Springer Nature Link
Log in

Multilevel Causality Learning for Multi-label Gastric Atrophy Diagnosis

  • Conference paper
  • First Online:

Abstract

No studies have formulated endoscopic classification (EG) of gastric atrophy (GA) as a multi-label classification (MLC) problem, which requires the simultaneous detection of GA and its gastric sites during an endoscopic examination. Accurate EG of GA is crucial for assessing the progression of early gastric cancer. However, the strong visual interference in endoscopic images is caused by various inter-image differences and subtle intra-image differences, leading to confounding contexts and hindering the causalities between class-aware features (CAFs) and multi-label predictions. We propose a multilevel causality learning approach for multi-label gastric atrophy diagnosis for the first time, to learn robust causal CAFs by de-confounding multilevel confounders. Our multilevel causal model is built based on a transformer to construct a multilevel confounder set and implement a progressive causal intervention (PCI) on it. Specifically, the confounder set is constructed by a dual token path sampling module that leverages multiple class tokens and different hidden states of patch tokens to stratify various visual interference. PCI involves attention-based sample-level re-weighting and uncertainty-guided logit-level modulation. Comparative experiments on an endoscopic dataset demonstrate the significant improvement of our model, such as IDA (0.95\(\%\) on OP, and 0.65\(\%\) on mAP) and TS-Former (1.11\(\%\) on OP, and 1.05\(\%\) on mAP).

This is a preview of subscription content,log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 11210
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 14013
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Similar content being viewed by others

References

  1. Chahal, D., Byrne, M.F.: A primer on artificial intelligence and its application to endoscopy. Gastrointestinal endoscopy92(4), 813–820 (2020)

    Article  Google Scholar 

  2. Chen, T., Xu, M., Hui, X., Wu, H., Lin, L.: Learning semantic-specific graph representation for multi-label image recognition. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 522–531 (2019)

    Google Scholar 

  3. Fallah, H., Bruno, E., Bellot, P., Murisasco, E.: Exploiting label dependencies for multi-label document classification using transformers. In: Proceedings of the ACM Symposium on Document Engineering 2023. pp. 1–4 (2023)

    Google Scholar 

  4. Gao, B.B., Zhou, H.Y.: Learning to discover multi-class attentional regions for multi-label image recognition. IEEE Transactions on Image Processing30, 5920–5932 (2021)

    Article  Google Scholar 

  5. Gildenblat, J., contributors: Pytorch library for cam methods.https://github.com/jacobgil/pytorch-grad-cam (2021)

  6. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 770–778 (2016)

    Google Scholar 

  7. Kimura, K., Takemoto, T.: An endoscopic recognition of the atrophic border and its significance in chronic gastritis. Endoscopy1(03), 87–97 (1969)

    Article  Google Scholar 

  8. Klang, E., Soroush, A., Nadkarni, G.N., Sharif, K., Lahat, A.: Deep learning and gastric cancer: Systematic review of ai-assisted endoscopy. Diagnostics13(24),  3613 (2023)

    Article  Google Scholar 

  9. Lanchantin, J., Wang, T., Ordonez, V., Qi, Y.: General multi-label image classification with transformers. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 16478–16488 (2021)

    Google Scholar 

  10. Liu, R., Huang, J., Li, T.H., Li, G.: Causality compensated attention for contextual biased visual recognition. In: The Eleventh International Conference on Learning Representations (2022)

    Google Scholar 

  11. Liu, R., Liu, H., Li, G., Hou, H., Yu, T., Yang, T.: Contextual debiasing for visual recognition with causal mechanisms. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 12755–12765 (2022)

    Google Scholar 

  12. Liu, S., Zhang, L., Yang, X., Su, H., Zhu, J.: Query2label: A simple transformer way to multi-label classification. arXiv preprintarXiv:2107.10834 (2021)

  13. Liu, W., Wang, H., Shen, X., Tsang, I.W.: The emerging trends of multi-label learning. IEEE transactions on pattern analysis and machine intelligence44(11), 7955–7974 (2021)

    Article  Google Scholar 

  14. Nega Tarekegn, A., Ullah, M., Alaya Cheikh, F.: Deep learning for multi-label learning: A comprehensive survey. arXiv e-prints pp. arXiv–2401 (2024)

    Google Scholar 

  15. Pearl, J.: Causal inference in statistics: An overview (2009)

    Google Scholar 

  16. Pearl, J., Glymour, M., Jewell, N.P.: Causal inference in statistics: A primer. John Wiley & Sons (2016)

    Google Scholar 

  17. Tang, P., Yan, X., Nan, Y., Xiang, S., Krammer, S., Lasser, T.: Fusionm4net: A multi-stage multi-modal learning algorithm for multi-label skin lesion classification. Medical Image Analysis76, 102307 (2022)

    Article  Google Scholar 

  18. Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., Jégou, H.: Training data-efficient image transformers & distillation through attention. In: International conference on machine learning. pp. 10347–10357. PMLR (2021)

    Google Scholar 

  19. Wang, Y., He, D., Li, F., Long, X., Zhou, Z., Ma, J., Wen, S.: Multi-label classification with label graph superimposing. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 34, pp. 12265–12272 (2020)

    Google Scholar 

  20. Wang, Z., Chen, T., Li, G., Xu, R., Lin, L.: Multi-label image recognition by recurrently discovering attentional regions. In: Proceedings of the IEEE international conference on computer vision. pp. 464–472 (2017)

    Google Scholar 

  21. Yang, J., Ou, Y., Chen, Z., Liao, J., Sun, W., Luo, Y., Luo, C.: A benchmark dataset of endoscopic images and novel deep learning method to detect intestinal metaplasia and gastritis atrophy. IEEE Journal of Biomedical and Health Informatics27(1), 7–16 (2022)

    Article  Google Scholar 

  22. Zhang, J., Zhao, Q., Adeli, E., Pfefferbaum, A., Sullivan, E.V., Paul, R., Valcour, V., Pohl, K.M.: Multi-label, multi-domain learning identifies compounding effects of hiv and cognitive impairment. Medical Image Analysis75, 102246 (2022)

    Article  Google Scholar 

  23. Zhang, Y., Luo, L., Dou, Q., Heng, P.A.: Triplet attention and dual-pool contrastive learning for clinic-driven multi-label medical image classification. Medical Image Analysis86, 102772 (2023)

    Article  Google Scholar 

  24. Zhao, H., Rai, P., Du, L., Buntine, W.: Bayesian multi-label learning with sparse features and labels, and label co-occurrences. In: International Conference on Artificial Intelligence and Statistics. pp. 1943–1951. PMLR (2018)

    Google Scholar 

  25. Zhu, F., Li, H., Ouyang, W., Yu, N., Wang, X.: Learning spatial regularization with image-level supervisions for multi-label image classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 5513–5522 (2017)

    Google Scholar 

  26. Zhu, X., Xiong, Y., Dai, J., Yuan, L., Wei, Y.: Deep feature flow for video recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 2349–2358 (2017)

    Google Scholar 

  27. Zhu, X., Cao, J., Ge, J., Liu, W., Liu, B.: Two-stream transformer for multi-label image classification. In: Proceedings of the 30th ACM International Conference on Multimedia. pp. 3598–3607 (2022)

    Google Scholar 

Download references

Acknowledgments

This study was funded in part by Key R&D Program of Shandong Province under Grant 2021CXGC010506, in part by the Joint fund for Smart Computing of Shandong Natural Science Foundation under Grant ZR2020LZH013, in part by the Major Scientific and Technological Innovation Project in Shandong Province under Grant 2022CXGC010504, in part by New Universities 20 items Funding Project of Jinan under Grant 2021GXRC108, in part by Shandong Provincial Natural Science Foundation under Grant ZR2022LZH007, and in part by Qingdao Key Technology Research and Industrialization-Future Industry Cultivation Special Project under Grant 22-3-4-xxgg-5-nsh; in part by Qingdao Science and Technology Benefiting the People Demonstration Project 24-1-8-cspz-20-nsh.

Author information

Authors and Affiliations

  1. Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan, 250101, Shandong, China

    Xiaoxiao Cui, Yankun Cao & Lizhen Cui

  2. School of Information Science and Engineering, Shandong University, Qingdao, 266237, Shandong, China

    Shanzhi Jiang, Baolin Sun, Yiran Li & Zhi Liu

  3. Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, 250012, Shandong, China

    Zhen Li

  4. Department of Gastroenterology, Linyi County People’s Hospital, Dezhou, 251599, China

    Chaoyang Lv

  5. Case Western Reserve University, Cleveland, OH, 44106, USA

    Shuo Li

Authors
  1. Xiaoxiao Cui

    You can also search for this author inPubMed Google Scholar

  2. Shanzhi Jiang

    You can also search for this author inPubMed Google Scholar

  3. Baolin Sun

    You can also search for this author inPubMed Google Scholar

  4. Yiran Li

    You can also search for this author inPubMed Google Scholar

  5. Yankun Cao

    You can also search for this author inPubMed Google Scholar

  6. Zhen Li

    You can also search for this author inPubMed Google Scholar

  7. Chaoyang Lv

    You can also search for this author inPubMed Google Scholar

  8. Zhi Liu

    You can also search for this author inPubMed Google Scholar

  9. Lizhen Cui

    You can also search for this author inPubMed Google Scholar

  10. Shuo Li

    You can also search for this author inPubMed Google Scholar

Corresponding authors

Correspondence toZhi Liu orLizhen Cui.

Editor information

Editors and Affiliations

  1. Children’s National Hospital/George Washington University, Washington, DC, USA

    Marius George Linguraru

  2. The Chinese University of Hong Kong, Hong Kong, China

    Qi Dou

  3. Technical University of Denmark, Kgs Lyngby, Denmark

    Aasa Feragen

  4. Imperial College London, London, UK

    Stamatia Giannarou

  5. Imperial College London, London, UK

    Ben Glocker

  6. Universitat de Barcelona, Barcelona, Spain

    Karim Lekadir

  7. Helmholtz Munich, Technical University of Munich and King’s College London, Munich, Germany

    Julia A. Schnabel

Ethics declarations

Disclosure of Interests

The authors have no competing interests to declare that are relevant to the content of this article.

Rights and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cui, X.et al. (2024). Multilevel Causality Learning for Multi-label Gastric Atrophy Diagnosis. In: Linguraru, M.G.,et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. MICCAI 2024. Lecture Notes in Computer Science, vol 15003. Springer, Cham. https://doi.org/10.1007/978-3-031-72384-1_64

Download citation

Publish with us

Societies and partnerships

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 11210
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 14013
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only


[8]ページ先頭

©2009-2025 Movatter.jp