AI Navigate

CLoE: Expert Consistency Learning for Missing Modality Segmentation

arXiv cs.CV / 3/11/2026

Ideas & Deep AnalysisModels & Research

Key Points

  • CLoE introduces a consistency-driven framework for multimodal medical image segmentation that addresses the challenge of missing modalities during inference, which typically causes instability and expert disagreement.
  • The method employs a dual-branch Expert Consistency Learning objective, ensuring global agreement among experts and emphasizing consistency on clinically important foreground regions to improve segmentation reliability.
  • A lightweight gating network maps consistency scores to modality reliability weights, allowing reliability-aware feature recalibration before modal fusion, enhancing robustness.
  • Extensive experiments on BraTS 2020 and MSD Prostate datasets demonstrate that CLoE surpasses state-of-the-art methods, showing strong performance even with incomplete modalities and better generalization across datasets.
  • CLoE's approach especially improves robustness in segmenting small, clinically critical structures, addressing a significant challenge in medical image analysis.

Computer Science > Computer Vision and Pattern Recognition

arXiv:2603.09316 (cs)
[Submitted on 10 Mar 2026]

Title:CLoE: Expert Consistency Learning for Missing Modality Segmentation

View a PDF of the paper titled CLoE: Expert Consistency Learning for Missing Modality Segmentation, by Xinyu Tong and 3 other authors
View PDF HTML (experimental)
Abstract:Multimodal medical image segmentation often faces missing modalities at inference, which induces disagreement among modality experts and makes fusion unstable, particularly on small foreground structures. We propose Consistency Learning of Experts (CLoE), a consistency-driven framework for missing-modality segmentation that preserves strong performance when all modalities are available. CLoE formulates robustness as decision-level expert consistency control and introduces a dual-branch Expert Consistency Learning objective. Modality Expert Consistency enforces global agreement among expert predictions to reduce case-wise drift under partial inputs, while Region Expert Consistency emphasizes agreement on clinically critical foreground regions to avoid background-dominated regularization. We further map consistency scores to modality reliability weights using a lightweight gating network, enabling reliability-aware feature recalibration before fusion. Extensive experiments on BraTS 2020 and MSD Prostate demonstrate that CLoE outperforms state-of-the-art methods in incomplete multimodal segmentation, while exhibiting strong cross-dataset generalization and improving robustness on clinically critical structures.
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2603.09316 [cs.CV]
  (or arXiv:2603.09316v1 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2603.09316
Focus to learn more
arXiv-issued DOI via DataCite

Submission history

From: Xinyu Tong [view email]
[v1] Tue, 10 Mar 2026 07:49:58 UTC (653 KB)
Full-text links:

Access Paper:

Current browse context:
cs.CV
< prev   |   next >
Change to browse by:

References & Citations

export BibTeX citation Loading...

BibTeX formatted citation

×
Data provided by:

Bookmark

BibSonomy logo Reddit logo
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
Links to Code Toggle
Papers with Code (What is Papers with Code?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos

Demos

Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers

Recommenders and Search Tools

Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.