Adaptive Semantic Communication for Wireless Image Transmission Leveraging Mixture-of-Experts Mechanism

arXiv cs.LG / 4/6/2026

📰 NewsSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper proposes an adaptive semantic communication framework for wireless image transmission that is more robust to varying image content and dynamic channel conditions than fixed-model approaches.
  • It introduces a multi-stage, end-to-end system for MIMO channels using an adaptive Mixture-of-Experts Swin Transformer block.
  • A key contribution is a dynamic expert-gating mechanism that jointly uses real-time channel state information (CSI) and the semantic content of input image patches to produce routing probabilities.
  • By activating only a specialized subset of experts, the method aims to avoid limitations of prior MoE designs that rely primarily on single-driven routing.
  • Simulation results reported in the abstract show improved reconstruction quality over existing methods while preserving transmission efficiency.

Abstract

Deep learning based semantic communication has achieved significant progress in wireless image transmission, but most existing schemes rely on fixed models and thus lack robustness to diverse image contents and dynamic channel conditions. To improve adaptability, recent studies have developed adaptive semantic communication strategies that adjust transmission or model behavior according to either source content or channel state. More recently, MoE-based semantic communication has emerged as a sparse and efficient adaptive architecture, although existing designs still mainly rely on single-driven routing. To address this limitation, we propose a novel multi-stage end-to-end image semantic communication system for multi-input multi-output (MIMO) channels, built upon an adaptive MoE Swin Transformer block. Specifically, we introduce a dynamic expert gating mechanism that jointly evaluates both real-time CSI and the semantic content of input image patches to compute adaptive routing probabilities. By selectively activating only a specialized subset of experts based on this joint condition, our approach breaks the rigid coupling of traditional adaptive methods and overcomes the bottlenecks of single-driven routing. Simulation results indicate a significant improvement in reconstruction quality over existing methods while maintaining the transmission efficiency.