Measure Before You Repair: An Explainable Agent for Blind Restoration of Multi-Artifact 3-D MRI
Necati Sefercioglu, Mehmet Ozan Unal, Metin Ertas, Altan Cakir, Isa Yildirim
Abstract
A brain MRI scan can carry an unknown mix of artifacts, so restoration has to be blind, yet most deep-learning methods are built to correct one known artifact. We present Dx-Rx, an agent in which a multimodal large language model (MLLM) measures suspected artifacts before it repairs them. To our knowledge, it is the first agent to restore whole 3-D MRI volumes, whereas earlier MRI agents restore 2-D slices. In a loop, it looks at slices of the 3-D volume, calls five diagnostic tools (noise, spike, ghosting, bias field, motion) and four restoration tools in any order it chooses, checks each repair, can return to any earlier version to change the order, and ends with a radiology-style report of its diagnostic reasons, the repairs it applied and their results. We simulated up to five artifacts on 148 whole 3-D T1-weighted volumes, at levels calibrated to radiologists' grades of real scans. An MLLM that only looked at the image, as earlier MRI agents do, removed at most 19.7 % of the artifact error. With the best of five MLLMs, Dx-Rx removed a mean 64.5 %, nearly matching the 64.6 % of the same tools given the ground-truth artifacts, which are never known for a clinical scan. With all five models, it made no volume worse and was on par with or better than an expert rule-based pipeline built from the same tools (62.3 %). Code and demo are public at https://itu-biai.github.io/measure-before-you-repair.
Create a lesson
Related papers
ELiCv2: Learned LiDAR Geometry Compression under Real-Time Embedded Constraints
Soowoong Kim, Junsik Kim, Gun Bang et al.
Simulation-Driven Approach for Occlusion-Based Non-Line-Of-Sight Detection Using a Low-Cost Flash LiDAR
Peizhao Qiu, Emmanuel A Olowe, Zhenya Zang et al.
DUNEDepth: Bronchoscopic Depth and Pose Estimation via Hybrid Adaptation of a 3D-Vision Foundation Model
Qi Chang, Austin Kao, Ange Lou et al.
Evaluating the Impact of Nonlinear Registration on Longitudinal PET Analysis in a Rodent Stroke Model
Haytham Ziani, El Mostafa Kalmoun, Zohaib Atif et al.
A Novel Conditional Adversarial Diffusion Model for High-Fidelity OCT-to-OCT Image Translation and Precise Anti-VEGF Therapy Response Prediction in Diabetic Macular Edema
Reza Rasti, Armin Biglari, Sobhan Mohammadi Hafshejani et al.
Toward Artifact-Free Dermoscopy: Characterization of ISIC 2019 Image Defects for Deep Learning Applications
Victoria Wegley, Joshua Hoog, Tristan Crawford et al.