MIRA: Reinforcing Multimodal Reasoning via Deceptive Contextual Augmentation
Zhihan Yin, Jianxin Liang, Yifeng Yao, Nonghai Zhang, and Bingyue Peng, Chunguang Qie, Huishuai Zhang, Dongyan Zhao
Abstract
While Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced multimodal reasoning, existing frameworks suffer from a critical "perception-reasoning gap." Due to an over-reliance on seemingly relevant visual tokens, even minor perceptual perturbations can propagate through the reasoning process, leading to compounding hallucinations. To address this issue, we propose MIRA, a training framework that improves robustness to erroneous visual contexts while enhancing logical reasoning ability. By injecting filtered, deceptive visual contexts during training, we construct challenging "hard traps" that stress-test the model's robustness to misleading information. Furthermore, we introduce a group-wise reflection-triggering mechanism that enables the model to autonomously detect and rectify inconsistencies between visual cues and logical constraints, which is ultimately internalized as an intrinsic policy behavior. Importantly, MIRA does not rely on human annotations. Experimental results across multiple reasoning and perception benchmarks show that MIRA yields an average 7% improvement on in-domain benchmarks, with consistent improvements on vision-centric benchmarks. These findings highlight that active error recovery is essential for robust multimodal reasoning. Comprehensive ablation studies and analyses further provide insights into why MIRA is effective.
Create a lesson
Related papers
Weather Adaptive Autonomous Driving
Nicholas Taylor, Alexander Picon, Sudip Dhakal
FlowTranslator: Training-Free In-Image Machine Translation with Flow-Based Editing
Zhixian Li, Xingsong Ye, Yongkun Du et al.
CLOCs-R: Radar-Assisted Camera-LiDAR Fusion for Long-Range Object Detection
Richard Beuck, John Nguyen, Sudip Dhakal
GroundSeek-CXR: Retrospective Evaluation-Guided Active Observation Framework for Multi-Label Chest Radiography Diagnosis
Yihang Fu, Xinyu Liu, Qing Xu et al.
Weight-Space Programming for Improving Image-Restoration Diffusion Models: Technical Conjectures and a Recursive Improvement Loop
Zhuoran Zheng, Doubao
Sketch-Omni: Instance-Level Sketch-Based Visual Prompting for Perception MLLMs
Dongyu Wang, Dar-Yen Chen, Zhiming Hong et al.