- Xiaoxiao Cui14,
- Shanzhi Jiang15,
- Baolin Sun15,
- Yiran Li15,
- Yankun Cao14,
- Zhen Li16,
- Chaoyang Lv17,
- Zhi Liu15,
- Lizhen Cui14 &
- …
- Shuo Li18
Part of the book series:Lecture Notes in Computer Science ((LNCS,volume 15003))
Included in the following conference series:
1753Accesses
Abstract
No studies have formulated endoscopic classification (EG) of gastric atrophy (GA) as a multi-label classification (MLC) problem, which requires the simultaneous detection of GA and its gastric sites during an endoscopic examination. Accurate EG of GA is crucial for assessing the progression of early gastric cancer. However, the strong visual interference in endoscopic images is caused by various inter-image differences and subtle intra-image differences, leading to confounding contexts and hindering the causalities between class-aware features (CAFs) and multi-label predictions. We propose a multilevel causality learning approach for multi-label gastric atrophy diagnosis for the first time, to learn robust causal CAFs by de-confounding multilevel confounders. Our multilevel causal model is built based on a transformer to construct a multilevel confounder set and implement a progressive causal intervention (PCI) on it. Specifically, the confounder set is constructed by a dual token path sampling module that leverages multiple class tokens and different hidden states of patch tokens to stratify various visual interference. PCI involves attention-based sample-level re-weighting and uncertainty-guided logit-level modulation. Comparative experiments on an endoscopic dataset demonstrate the significant improvement of our model, such as IDA (0.95\(\%\) on OP, and 0.65\(\%\) on mAP) and TS-Former (1.11\(\%\) on OP, and 1.05\(\%\) on mAP).
This is a preview of subscription content,log in via an institution to check access.
Access this chapter
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
- Chapter
- JPY 3498
- Price includes VAT (Japan)
- eBook
- JPY 11210
- Price includes VAT (Japan)
- Softcover Book
- JPY 14013
- Price includes VAT (Japan)
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chahal, D., Byrne, M.F.: A primer on artificial intelligence and its application to endoscopy. Gastrointestinal endoscopy92(4), 813–820 (2020)
Chen, T., Xu, M., Hui, X., Wu, H., Lin, L.: Learning semantic-specific graph representation for multi-label image recognition. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 522–531 (2019)
Fallah, H., Bruno, E., Bellot, P., Murisasco, E.: Exploiting label dependencies for multi-label document classification using transformers. In: Proceedings of the ACM Symposium on Document Engineering 2023. pp. 1–4 (2023)
Gao, B.B., Zhou, H.Y.: Learning to discover multi-class attentional regions for multi-label image recognition. IEEE Transactions on Image Processing30, 5920–5932 (2021)
Gildenblat, J., contributors: Pytorch library for cam methods.https://github.com/jacobgil/pytorch-grad-cam (2021)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 770–778 (2016)
Kimura, K., Takemoto, T.: An endoscopic recognition of the atrophic border and its significance in chronic gastritis. Endoscopy1(03), 87–97 (1969)
Klang, E., Soroush, A., Nadkarni, G.N., Sharif, K., Lahat, A.: Deep learning and gastric cancer: Systematic review of ai-assisted endoscopy. Diagnostics13(24), 3613 (2023)
Lanchantin, J., Wang, T., Ordonez, V., Qi, Y.: General multi-label image classification with transformers. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 16478–16488 (2021)
Liu, R., Huang, J., Li, T.H., Li, G.: Causality compensated attention for contextual biased visual recognition. In: The Eleventh International Conference on Learning Representations (2022)
Liu, R., Liu, H., Li, G., Hou, H., Yu, T., Yang, T.: Contextual debiasing for visual recognition with causal mechanisms. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 12755–12765 (2022)
Liu, S., Zhang, L., Yang, X., Su, H., Zhu, J.: Query2label: A simple transformer way to multi-label classification. arXiv preprintarXiv:2107.10834 (2021)
Liu, W., Wang, H., Shen, X., Tsang, I.W.: The emerging trends of multi-label learning. IEEE transactions on pattern analysis and machine intelligence44(11), 7955–7974 (2021)
Nega Tarekegn, A., Ullah, M., Alaya Cheikh, F.: Deep learning for multi-label learning: A comprehensive survey. arXiv e-prints pp. arXiv–2401 (2024)
Pearl, J.: Causal inference in statistics: An overview (2009)
Pearl, J., Glymour, M., Jewell, N.P.: Causal inference in statistics: A primer. John Wiley & Sons (2016)
Tang, P., Yan, X., Nan, Y., Xiang, S., Krammer, S., Lasser, T.: Fusionm4net: A multi-stage multi-modal learning algorithm for multi-label skin lesion classification. Medical Image Analysis76, 102307 (2022)
Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., Jégou, H.: Training data-efficient image transformers & distillation through attention. In: International conference on machine learning. pp. 10347–10357. PMLR (2021)
Wang, Y., He, D., Li, F., Long, X., Zhou, Z., Ma, J., Wen, S.: Multi-label classification with label graph superimposing. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 34, pp. 12265–12272 (2020)
Wang, Z., Chen, T., Li, G., Xu, R., Lin, L.: Multi-label image recognition by recurrently discovering attentional regions. In: Proceedings of the IEEE international conference on computer vision. pp. 464–472 (2017)
Yang, J., Ou, Y., Chen, Z., Liao, J., Sun, W., Luo, Y., Luo, C.: A benchmark dataset of endoscopic images and novel deep learning method to detect intestinal metaplasia and gastritis atrophy. IEEE Journal of Biomedical and Health Informatics27(1), 7–16 (2022)
Zhang, J., Zhao, Q., Adeli, E., Pfefferbaum, A., Sullivan, E.V., Paul, R., Valcour, V., Pohl, K.M.: Multi-label, multi-domain learning identifies compounding effects of hiv and cognitive impairment. Medical Image Analysis75, 102246 (2022)
Zhang, Y., Luo, L., Dou, Q., Heng, P.A.: Triplet attention and dual-pool contrastive learning for clinic-driven multi-label medical image classification. Medical Image Analysis86, 102772 (2023)
Zhao, H., Rai, P., Du, L., Buntine, W.: Bayesian multi-label learning with sparse features and labels, and label co-occurrences. In: International Conference on Artificial Intelligence and Statistics. pp. 1943–1951. PMLR (2018)
Zhu, F., Li, H., Ouyang, W., Yu, N., Wang, X.: Learning spatial regularization with image-level supervisions for multi-label image classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 5513–5522 (2017)
Zhu, X., Xiong, Y., Dai, J., Yuan, L., Wei, Y.: Deep feature flow for video recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 2349–2358 (2017)
Zhu, X., Cao, J., Ge, J., Liu, W., Liu, B.: Two-stream transformer for multi-label image classification. In: Proceedings of the 30th ACM International Conference on Multimedia. pp. 3598–3607 (2022)
Acknowledgments
This study was funded in part by Key R&D Program of Shandong Province under Grant 2021CXGC010506, in part by the Joint fund for Smart Computing of Shandong Natural Science Foundation under Grant ZR2020LZH013, in part by the Major Scientific and Technological Innovation Project in Shandong Province under Grant 2022CXGC010504, in part by New Universities 20 items Funding Project of Jinan under Grant 2021GXRC108, in part by Shandong Provincial Natural Science Foundation under Grant ZR2022LZH007, and in part by Qingdao Key Technology Research and Industrialization-Future Industry Cultivation Special Project under Grant 22-3-4-xxgg-5-nsh; in part by Qingdao Science and Technology Benefiting the People Demonstration Project 24-1-8-cspz-20-nsh.
Author information
Authors and Affiliations
Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan, 250101, Shandong, China
Xiaoxiao Cui, Yankun Cao & Lizhen Cui
School of Information Science and Engineering, Shandong University, Qingdao, 266237, Shandong, China
Shanzhi Jiang, Baolin Sun, Yiran Li & Zhi Liu
Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, 250012, Shandong, China
Zhen Li
Department of Gastroenterology, Linyi County People’s Hospital, Dezhou, 251599, China
Chaoyang Lv
Case Western Reserve University, Cleveland, OH, 44106, USA
Shuo Li
- Xiaoxiao Cui
You can also search for this author inPubMed Google Scholar
- Shanzhi Jiang
You can also search for this author inPubMed Google Scholar
- Baolin Sun
You can also search for this author inPubMed Google Scholar
- Yiran Li
You can also search for this author inPubMed Google Scholar
- Yankun Cao
You can also search for this author inPubMed Google Scholar
- Zhen Li
You can also search for this author inPubMed Google Scholar
- Chaoyang Lv
You can also search for this author inPubMed Google Scholar
- Zhi Liu
You can also search for this author inPubMed Google Scholar
- Lizhen Cui
You can also search for this author inPubMed Google Scholar
- Shuo Li
You can also search for this author inPubMed Google Scholar
Corresponding authors
Correspondence toZhi Liu orLizhen Cui.
Editor information
Editors and Affiliations
Children’s National Hospital/George Washington University, Washington, DC, USA
Marius George Linguraru
The Chinese University of Hong Kong, Hong Kong, China
Qi Dou
Technical University of Denmark, Kgs Lyngby, Denmark
Aasa Feragen
Imperial College London, London, UK
Stamatia Giannarou
Imperial College London, London, UK
Ben Glocker
Universitat de Barcelona, Barcelona, Spain
Karim Lekadir
Helmholtz Munich, Technical University of Munich and King’s College London, Munich, Germany
Julia A. Schnabel
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Cui, X.et al. (2024). Multilevel Causality Learning for Multi-label Gastric Atrophy Diagnosis. In: Linguraru, M.G.,et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. MICCAI 2024. Lecture Notes in Computer Science, vol 15003. Springer, Cham. https://doi.org/10.1007/978-3-031-72384-1_64
Download citation
Published:
Publisher Name:Springer, Cham
Print ISBN:978-3-031-72383-4
Online ISBN:978-3-031-72384-1
eBook Packages:Computer ScienceComputer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative