Text-Aware, Vision-Blind: How Multimodal Image Editing Systems Handle Unsafe Inputs
Ziqing Yang, Yixin Wu, Michael Backes, Yang Zhang
Abstract
Multimodal image generation systems have made rapid progress and increasingly emphasize content safety. However, their safety mechanisms tend to rely on a single modality and lack joint consideration of both visual content and text prompts, particularly in instruction-guided image editing, where the uploaded image may itself carry risk. We thus introduce EditSafetyBench, a benchmark that measures system-level safety awareness of advanced image editing systems, containing 5,940 image-instruction pairs, covering safe and unsafe images across 11 risk categories and three edit intents. We then probe the benchmark dataset on four systems, including Gemini, GPT, Qwen API, and Qwen Local. Based on our evaluation, we observe a systematic text-vision safety mismatch: Gemini and GPT refuse 87.1\% and 81.6\% cases containing unsafe-intent editing prompts, while only refusing 24.2\% and 22.4\% cases with both unsafe images and neutral instructions. At the category level, most risks are considered inconsistently by different systems, e.g., GPT allows 70.4\% editing attempts of unsafe political content while Gemini only allows 34.8\%. Notably, sexual content shows the strongest visual sensitivity, likely benefiting from mature NSFW identification works. Our findings highlight the need for safety guardrails that jointly reason over both visual and textual modalities in image editing systems.
Create a lesson
Related papers
SoK: Assessing the Evolution of LLM Capability in Software Vulnerability Research
Amine Lbath, Manan Suri, Aurelien Delaitre et al.
GEOHunter: Mapping a Generative Engine Optimization Network in the Wild
Sean Tang, Peiran Wang, Ying Li et al.
Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)
Mengxiao Wang, Mahbub Alam, Kalyan Nakka et al.
Backtracking Agent Applications Security Incidents
Yicheng Cai, Taegyu Kim, Peng Liu
Visual Attribution Limits and Graded Provenance Auditing in Commercial Video-Generation APIs
Haocheng Mei, Yuchuan Tian, Yingte Shu et al.
DailySafe: Benchmarking Dynamic Safety Awareness in Everyday Multi-Turn Multimodal Interactions
Xuankun Rong, Xinhao Deng, Wenzhang Jiang et al.