MARE: Multimodal Analogical Reasoning for Disease Evolution-Aware Radiology Report Generation

Authors

  • Qingqing Gao Beijing University of Technology
  • Tengfei Liu Beijing University of Technology
  • Xiaoyan Li Beijing University of Technology
  • Xiaodan Zhang Beijing University of Technology
  • Zhongfan Sun Beijing University of Technology
  • Boyue Wang Beijing University of Technology
  • Baocai Yin Beijing University of Technology
  • Zhaohui Liu Beijing Tongren Hospital

DOI:

https://doi.org/10.1609/aaai.v40i25.39262

Abstract

Radiology report generation from longitudinal medical data is critical for assessing disease progression and automating diagnostic workflows. While recent methods incorporate longitudinal information, they primarily rely on multimodal feature fusion, with limited capacity for explicit disease evolution modeling and temporal reasoning. To address this, we propose MARE, an end-to-end framework that formulates longitudinal radiology report generation as a multimodal analogical reasoning task. Inspired by the Abduction–Mapping–Induction paradigm, MARE models latent relational structures underlying disease evolution by aligning lesion-level visual features across time and mapping them to the textual domain for temporally coherent and clinically meaningful report generation. To mitigate the spatial misalignment caused by patient positioning or imaging variation, we introduce an Adaptive Region Alignment (ARA) module for robust temporal correspondence. Additionally, we design Dual Evolution Consistency (DEC) losses to regularize analogical reasoning by enforcing temporal coherence in both visual and textual evolution paths. Extensive experiments on the Longitudinal-MIMIC dataset demonstrate that MARE significantly outperforms state-of-the-art baselines across both natural language generation and clinical effectiveness metrics, highlighting the value of structured analogical reasoning for disease evolution-aware report generation.

Downloads

Published

2026-03-14

How to Cite

Gao, Q., Liu, T., Li, X., Zhang, X., Sun, Z., Wang, B., … Liu, Z. (2026). MARE: Multimodal Analogical Reasoning for Disease Evolution-Aware Radiology Report Generation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(25), 21180–21188. https://doi.org/10.1609/aaai.v40i25.39262

Issue

Section

AAAI Technical Track on Machine Learning II