Think 360{\deg}: Evaluating the Width-centric Reasoning Capability of MLLMs Beyond Depth

arXiv cs.CV / 3/25/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces a multimodal benchmark and evaluation protocol that explicitly measures reasoning width in MLLMs as a complement to the more common metric of reasoning depth.
  • Reasoning width is framed as the ability to perform broad, parallelizable exploration (e.g., trial-and-error search, constraint-based pruning, and efficient backtracking) rather than only long sequential chains.
  • The authors curate 1200+ high-quality multimodal cases across heterogeneous domains and propose a fine-grained tree-of-thought evaluation method that jointly quantifies both width and depth.
  • Experiments across 12 major model families (30+ advanced MLLMs) show strong performance on general/common-sense VQA, but persistent difficulty combining deep sequential reasoning with wide exploratory search for insight-based tasks.
  • The study analyzes characteristic failure modes and suggests directions for designing MLLMs that can improve both “deeper” and “wider” reasoning capabilities.

Abstract

In this paper, we present a holistic multimodal benchmark that evaluates the reasoning capabilities of MLLMs with an explicit focus on reasoning width, a complementary dimension to the more commonly studied reasoning depth. Specifically, reasoning depth measures the model's ability to carry out long-chain, sequential reasoning in which each step is tightly and rigorously linked to the next. Reasoning width tends to focus more on the model's capacity for broad trial-and-error search or multi-constrained optimization: it must systematically traverse many possible and parallelized reasoning paths, apply diverse constraints to prune unpromising branches, and identify valid solution routes for efficient iteration or backtracking. To achieve it, we carefully curate 1200+ high-quality multimodal cases spanning heterogeneous domains, and propose a fine-grained tree-of-thought evaluation protocol that jointly quantifies reasoning width and depth. We evaluate 12 major model families (over 30 advanced MLLMs) across difficulty tiers, question types, and required skills. Results show that while current models exhibit strong performance on general or common-sense VQA tasks, they still struggle to combine deep sequential thought chains with wide exploratory search to perform genuine insight-based reasoning. Finally, we analyze characteristic failure modes to provide possible directions for building MLLMs that reason not only deeper but also wider.