MultiPress: A Multi-Agent Framework for Interpretable Multimodal News Classification

arXiv cs.CL / 4/7/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • MultiPress is presented as a new three-stage multi-agent framework for multimodal news classification that jointly reasons over text and images rather than treating modalities separately.
  • The approach uses specialized agents for multimodal perception, retrieval-augmented reasoning, and gated fusion scoring, aiming to better capture cross-modal interactions and improve interpretability.
  • It includes a reward-driven iterative optimization mechanism to refine the classification process over iterations.
  • The framework is validated on a newly constructed large-scale multimodal news dataset, where it achieves significant gains over strong baselines.
  • The authors attribute performance improvements to modular multi-agent collaboration and retrieval-augmented reasoning as key contributors to higher accuracy and more interpretable outputs.

Abstract

With the growing prevalence of multimodal news content, effective news topic classification demands models capable of jointly understanding and reasoning over heterogeneous data such as text and images. Existing methods often process modalities independently or employ simplistic fusion strategies, limiting their ability to capture complex cross-modal interactions and leverage external knowledge. To overcome these limitations, we propose MultiPress, a novel three-stage multi-agent framework for multimodal news classification. MultiPress integrates specialized agents for multimodal perception, retrieval-augmented reasoning, and gated fusion scoring, followed by a reward-driven iterative optimization mechanism. We validate MultiPress on a newly constructed large-scale multimodal news dataset, demonstrating significant improvements over strong baselines and highlighting the effectiveness of modular multi-agent collaboration and retrieval-augmented reasoning in enhancing classification accuracy and interpretability.