TripVVT: A Large-Scale Triplet Dataset and a Coarse-Mask Baseline for In-the-Wild Video Virtual Try-On

arXiv cs.CV / 5/1/2026

📰 NewsDeveloper Stack & InfrastructureTools & Practical UsageModels & Research

Key Points

  • The paper addresses limitations in video virtual try-on caused by scarce large-scale in-the-wild triplet data and unreliable mask usage.
  • It introduces TripVVT-10K, a large and diverse in-the-wild triplet dataset with explicit video-level cross-garment supervision.
  • Building on this dataset, the authors propose TripVVT, a Diffusion Transformer-based framework that replaces fragile garment masks with a stable human-mask prior to better preserve backgrounds under real-world motion and occlusion.
  • For evaluation, they release TripVVT-Bench, a 100-case benchmark with varied garments, environments, and multi-person scenes, assessing quality, try-on fidelity, background consistency, and temporal coherence.
  • Experiments show TripVVT improves video quality and garment fidelity while improving generalization to challenging in-the-wild videos, and the dataset/benchmark are publicly released.

Abstract

Due to the scarcity of large-scale in-the-wild triplet data and the improper use of masks, the performance of video virtual try-on models remains limited. In this paper, we first introduce **TripVVT-10K**, the largest and most diverse in-the-wild triplet dataset to date, providing explicit video-level cross-garment supervision that existing video datasets lack. Built upon this resource, we develop **TripVVT**, a Diffusion Transformer-based framework that replaces fragile garment masks with a simple, stable human-mask prior, enabling reliable background preservation while remaining robust to real-world motion, occlusion, and cluttered scenes. To support comprehensive evaluation, we further establish **TripVVT-Bench**, a 100-case benchmark covering diverse garments, complex environments, and multi-person scenarios, with metrics spanning video quality, try-on fidelity, background consistency, and temporal coherence. Compared to state-of-the-art academic and commercial systems, TripVVT achieves superior video quality and garment fidelity while markedly improving generalization to challenging in-the-wild videos. We publicly release the dataset and benchmark, which we believe provide a solid foundation for advancing controllable, realistic, and temporally stable video virtual try-on.