SMSP: A Plug-and-Play Strategy of Multi-Scale Perception for MLLMs to Perceive Visual Illusions

arXiv cs.CV / 3/25/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper reports that multimodal large language models (MLLMs) can fail on hidden-pattern visual illusions that are obvious to humans, indicating a perceptual misalignment with human vision and raising safety concerns.
  • It introduces IlluChar, a comprehensive illusion dataset, and identifies a key failure mechanism: high-frequency attention bias that makes models get distracted by textured backgrounds and miss the hidden content.
  • To mitigate this, the authors propose SMSP (Strategy of Multi-Scale Perception), a plug-and-play framework that suppresses distracting high-frequency background information to better align model perception with humans.
  • Experiments show SMSP substantially boosts performance across evaluated MLLMs on illusion images, including a large jump in Qwen3-VL-8B-Instruct accuracy from 13.0% to 84.0%.
  • The authors make the code publicly available, positioning SMSP as a practical and robust approach for improving MLLM visual perception.

Abstract

Recent works have shown that Multimodal Large Language Models (MLLMs) are highly vulnerable to hidden-pattern visual illusions, where the hidden content is imperceptible to models but obvious to humans. This deficiency highlights a perceptual misalignment between current MLLMs and humans, and also introduces potential safety concerns. To systematically investigate this failure, we introduce IlluChar, a comprehensive and challenging illusion dataset, and uncover a key underlying mechanism for the models' failure: high-frequency attention bias, where the models are easily distracted by high-frequency background textures in illusion images, causing them to overlook hidden patterns. To address the issue, we propose the Strategy of Multi-Scale Perception (SMSP), a plug-and-play framework that aligns with human visual perceptual strategies. By suppressing distracting high-frequency backgrounds, SMSP generates images closer to human perception. Our experiments demonstrate that SMSP significantly improves the performance of all evaluated MLLMs on illusion images, for instance, increasing the accuracy of Qwen3-VL-8B-Instruct from 13.0% to 84.0%. Our work provides novel insights into MLLMs' visual perception, and offers a practical and robust solution to enhance it. Our code is publicly available at https://github.com/Tujz2023/SMSP.

SMSP: A Plug-and-Play Strategy of Multi-Scale Perception for MLLMs to Perceive Visual Illusions | AI Navigate