 | I rented different GPUs on vast.ai for a few minutes each to benchmark a small TTS model, OmniVoice, with a peak VRAM usage of about 5 GB. I wanted to see how various mostly consumer GPUs would stack up against my own RTX 3090. This is by no means an extensive or scientific analysis, but I think it gives a rough estimate of how these GPUs perform relative to each other. xRT means times real-time. It shows how much faster than real-time the GPU generates audio. Average of 3 runs of a small paragraph with reference audio provided (voice cloning). [link] [comments] |
21 GPU's benchmarked running a small TTS model (vram peak: 5GB)
Reddit r/LocalLLaMA / 5/19/2026
💬 OpinionSignals & Early TrendsTools & Practical Usage
Key Points
- A user benchmarked a small TTS model, OmniVoice, on 21 different rented GPUs via vast.ai, focusing on peak VRAM usage of about 5GB.
- The tests compare GPU performance against the user’s own RTX 3090 using an xRT metric (times real-time) based on generating audio for a short paragraph with voice cloning.
- Results are presented as a rough, non-scientific comparison based on three runs per configuration rather than a comprehensive study.
- The main goal is to estimate how mostly consumer GPUs stack up for local-ish TTS workloads in terms of throughput and memory headroom.
