Segmentation-before-Staining Improves Structural Fidelity in Virtual IHC-to-Multiplex IF Translation
arXiv cs.CV / 3/18/2026
💬 OpinionIdeas & Deep AnalysisModels & Research
Key Points
- The work introduces a supervision-free conditioning strategy that injects a continuous cell probability map from a pretrained nuclei segmentation foundation model as input prior to IHC-to-multiplex IF translation.
- It adds a variance-preserving regularization term that matches local intensity statistics to maintain cell-level heterogeneity in synthesized fluorescence channels.
- The soft prior preserves gradient-level boundary information instead of binary thresholding, improving nuclei-count fidelity and perceptual quality across multiple generator architectures and datasets.
- They report consistent improvements across Pix2Pix with U-Net and ResNet, deterministic regression U-Net, and conditional diffusion, with code to be released upon acceptance.




