Movatterモバイル変換


[0]ホーム

URL:


Now on home page

ADS

MAIRA-2: Grounded Radiology Report Generation

Abstract

Radiology reporting is a complex task requiring detailed medical image understanding and precise language generation, for which generative multimodal models offer a promising solution. However, to impact clinical practice, models must achieve a high level of both verifiable performance and utility. We augment the utility of automated report generation by incorporating localisation of individual findings on the image - a task we call grounded report generation - and enhance performance by incorporating realistic reporting context as inputs. We design a novel evaluation framework (RadFact) leveraging the logical inference capabilities of large language models (LLMs) to quantify report correctness and completeness at the level of individual sentences, while supporting the new task of grounded reporting. We develop MAIRA-2, a large radiology-specific multimodal model designed to generate chest X-ray reports with and without grounding. MAIRA-2 achieves state of the art on existing report generation benchmarks and establishes the novel task of grounded report generation.


Publication:
arXiv e-prints
Pub Date:
June 2024
DOI:

10.48550/arXiv.2406.04449

arXiv:
arXiv:2406.04449
Bibcode:
2024arXiv240604449B
Keywords:
  • Computer Science - Computation and Language;
  • Computer Science - Computer Vision and Pattern Recognition
E-Print:
72 pages, 21 figures. v2 updates the model and adds results on the PadChest-GR dataset
full text sources
Preprint
|
🌓

[8]ページ先頭

©2009-2025 Movatter.jp