Paired Wasserstein Autoencoders for Conditional Sampling

arXiv stat.ML / 3/25/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • This paper proposes a new generative modeling objective for performing conditional sampling from an optimal-transport (OT)-type coupling using Wasserstein autoencoders (WAEs).
  • It derives a loss that uses two paired WAEs with a shared latent space to obtain a fully parametrized joint distribution that represents an OT coupling.
  • The approach learns deterministic encoder-based cost-optimal transport maps between two marginal distributions and, under cost-consistency constraints, supports stochastic decoder-based conditional sampling.
  • The authors validate the method as a proof of concept on synthetic data where the marginal and conditional distributions are known and can be visualized.

Abstract

Generative autoencoders learn compact latent representations of data distributions through jointly optimized encoder--decoder pairs. In particular, Wasserstein autoencoders (WAEs) minimize a relaxed optimal transport (OT) objective, where similarity between distributions is measured through a cost-minimizing joint distribution (OT coupling). Beyond distribution matching, neural OT methods aim to learn mappings between two data distributions induced by an OT coupling. Building on the formulation of the WAE loss, we derive a novel loss that enables sampling from OT-type couplings via two paired WAEs with shared latent space. The resulting fully parametrized joint distribution yields (i) learned cost-optimal transport maps between the two data distributions via deterministic encoders. Under cost-consistency constraints, it further enables (ii) conditional sampling from an OT-type coupling through stochastic decoders. As a proof of concept, we use synthetic data with known and visualizable marginal and conditional distributions.