Foundation Model Fine-Tuning with Attention-based Multi-View Fusion for Multi-Task Cardiac Function Assessment
João Freitas, Warre Snaet, Jan D'hooge, Sandro Queirós
Abstract
In cardio-oncology, left ventricular ejection fraction (LVEF) is the standard biomarker for monitoring cardiac function during cancer therapy. However, its estimation from echocardiography is highly operator dependent, and clinically meaningful declines are often detected only after myocardial injury has progressed, motivating automated methods for standardized assessment and earlier detection of LV dysfunction. To address this need, we propose a multi-task framework integrating cardiac cycle-based temporal standardization, multi-view spatiotemporal feature extraction, and joint optimization for LVEF estimation and LV dysfunction classification. Apical four- and two-chamber echocardiographic sequences are temporally standardized by sampling a clip over an estimated cardiac cycle before being processed by the EchoPrime foundation model, which is fine-tuned end-to-end within the proposed architecture. View-specific features are fused through an attention-based aggregation module to generate a patient-level embedding, from which two task-specific prediction heads estimate continuous LVEF and binary LV dysfunction. To broaden the LVEF distribution encountered during training, samples from the MIMIC-IV-ECHO dataset are incorporated using a balanced sampling strategy. Evaluated on the EchoRisk-MICCAI Challenge, our method achieves an MAE of 4.003 for LVEF estimation (Task 1) and an AUC of 0.764 for LV dysfunction detection (Task 2) on the validation set, demonstrating the effectiveness of foundation model fine-tuning with attention-based multi-view fusion for automated cardiac function assessment in cardio-oncology.
Create a lesson
Related papers
AnyVIO: Feed-Forward Streaming Visual-Inertial Odometry Across Platforms
Omoruyi Atekha, Marcus Greiff, Ray Zhang et al.
Susceptibility source separation via Closed-form Alternating Newton-type Optimization
Ignacio Contreras-Zúñiga, Cristian Tejos, Carlos Milovic
Physics-Informed Deep Learning for Shear Wave Speed Estimation in MR Elastography
Stefan Martin, Jakob Schattenfroh, Patrick Schuenke et al.
LBW-NPS: A Local Band-Weighted Noise Power Spectrum Loss for Texture-Preserving Low-Dose CT Denoising
Fatma Elif Yalçındağ, Mehmet Ozan Ünal, Metin Ertaş et al.
Life-IQA+: Boosting Blind Image Quality Assessment via GCN-enhanced Layer Interaction and Flexible Hierarchical Expert Specialization
Long Tang, Guoquan Zheng, Huiyu Duan et al.
Uncertainty-Aware Multimodal Deep Learning for Prediction of Radiation-Induced Xerostomia in Head and Neck Cancer
Jin Yang, Tian Liu, Jose Penagaricano et al.