S1-VL: Scientific Multimodal Reasoning Model with Thinking-with-Images

arXiv cs.CV / 4/24/2026

📰 NewsDeveloper Stack & InfrastructureModels & Research

Key Points

  • The paper introduces S1-VL, a multimodal reasoning model for scientific domains that supports two reasoning paradigms: structured scientific chain-of-thought and “Thinking-with-Images” via image manipulation with Python code.
  • In Thinking-with-Images mode, the model generates and executes image-processing code in a sandbox, retrieves intermediate visual outputs, and iteratively continues reasoning across multiple turns.
  • The authors build training data across six scientific disciplines (math, physics, chemistry, astronomy, geography, biology) and add quality filtering and multi-stage pipelines to reduce redundant or erroneous visual operations, routing low-information samples to pure reasoning mode.
  • S1-VL-32B is trained using a four-stage progressive pipeline (scientific multimodal SFT, Thinking-with-Images cold-start SFT, and two SAPO-based reinforcement learning stages) and evaluated on 13 benchmarks.
  • Results indicate S1-VL-32B achieves state-of-the-art performance on all five Thinking-with-Images benchmarks (e.g., HRBench variants and MME-RealWorld) and strong gains on scientific reasoning benchmarks like Physics and VRSBench.

Abstract

We present S1-VL, a multimodal reasoning model for scientific domains that natively supports two complementary reasoning paradigms: Scientific Reasoning, which relies on structured chain-of-thought, and Thinking-with-Images, which enables the model to actively manipulate images through Python code execution during reasoning. In the Thinking-with-Images mode, the model generates and executes image-processing code in a sandbox environment, obtains intermediate visual results, and continues reasoning in a multi-turn iterative manner. This design is particularly effective for challenging scenarios such as high-resolution scientific chart interpretation, microscopic image understanding, and geometry-assisted reasoning. To construct the training data, we collect scientific multimodal datasets spanning six disciplines: mathematics, physics, chemistry, astronomy, geography, and biology. We further develop a six-dimensional quality filtering framework for reasoning trajectories. To mitigate redundant, ineffective, and erroneous visual operations commonly found in existing datasets, we propose a multi-stage filtering pipeline together with an adaptive data routing strategy. This strategy converts samples with low visual information gain into pure Reasoning-mode data, enabling the model to learn when image operations are truly necessary. S1-VL is trained through a four-stage progressive pipeline: scientific multimodal SFT, Thinking-with-Images cold-start SFT, and two stages of reinforcement learning with SAPO. We build S1-VL-32B on top of Qwen3-VL-32B-Thinking and evaluate it on 13 benchmarks. Experimental results show that S1-VL-32B achieves state-of-the-art performance on all five Thinking-with-Images benchmarks, including HRBench-4K, HRBench-8K, MME-RealWorld-CN, MME-RealWorld-Lite, and V*, and outperforms compared systems on scientific reasoning benchmarks such as Physics and VRSBench.