XLSAR-Bench: Towards Extremely Large SAR Imagery Understanding of MLLMs
La Jiang, Lingfeng Chen, Jiaqi Zhu, Fengrong Guo, Jiehua Zhang, Panhe Hu, Li Liu, Zhen Liu
Abstract
The rapid development of multimodal large language models (MLLMs) has highlighted the need for comprehensive benchmarks to assess their capabilities and limitations in remote sensing (RS). However, evaluating MLLMs in large-size synthetic aperture radar (SAR) scenarios remains challenging, as understanding complete scenes requires both global semantic interpretation and fine-grained target perception. Existing SAR benchmarks predominantly rely on small image patches, limiting their ability to assess these capabilities jointly. To address these limitations, we present XLSAR-Bench, a comprehensive benchmark for evaluating the perception and reasoning capabilities of MLLMs in large-scene SAR imagery. XLSAR-Bench comprises 405 images with an average size of 7153×7153 pixels, ten tasks spanning visual question answering, visual grounding, and detailed image captioning, with all evaluation samples meticulously annotated manually, assisted by a semi-automatic captioner. Experimental results from general-purpose and domain-specific MLLMs reveal persistent challenges in understanding large SAR scenes and accurately perceiving small targets. We have open-sourced XLSAR-Bench to support further research in developing more powerful MLLMs for complete large SAR scenes.
Create a lesson
Related papers
AnyVIO: Feed-Forward Streaming Visual-Inertial Odometry Across Platforms
Omoruyi Atekha, Marcus Greiff, Ray Zhang et al.
Susceptibility source separation via Closed-form Alternating Newton-type Optimization
Ignacio Contreras-Zúñiga, Cristian Tejos, Carlos Milovic
Physics-Informed Deep Learning for Shear Wave Speed Estimation in MR Elastography
Stefan Martin, Jakob Schattenfroh, Patrick Schuenke et al.
LBW-NPS: A Local Band-Weighted Noise Power Spectrum Loss for Texture-Preserving Low-Dose CT Denoising
Fatma Elif Yalçındağ, Mehmet Ozan Ünal, Metin Ertaş et al.
Life-IQA+: Boosting Blind Image Quality Assessment via GCN-enhanced Layer Interaction and Flexible Hierarchical Expert Specialization
Long Tang, Guoquan Zheng, Huiyu Duan et al.
Uncertainty-Aware Multimodal Deep Learning for Prediction of Radiation-Induced Xerostomia in Head and Neck Cancer
Jin Yang, Tian Liu, Jose Penagaricano et al.