Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence

arXiv cs.LG / 4/29/2026

📰 NewsDeveloper Stack & InfrastructureSignals & Early TrendsModels & Research

Key Points

  • Nemotron 3 Nano Omni is a new multimodal model that natively accepts audio inputs in addition to text, images, and video.
  • The model achieves consistent accuracy gains over Nemotron Nano V2 VL across all modalities, attributed to improvements in architecture, training data, and training recipes.
  • It reports strong performance in real-world document understanding, long audio-video comprehension, and agentic computer use.
  • Built on the efficient Nemotron 3 Nano 30B-A3B backbone, it uses multimodal token-reduction techniques to lower inference latency and increase throughput versus similarly sized models.
  • The authors plan to release model checkpoints in BF16, FP8, and FP4, along with parts of the training data and codebase, to support further research and development.

Abstract

We introduce Nemotron 3 Nano Omni, the latest model in the Nemotron multimodal series and the first to natively support audio inputs alongside text, images, and video. Nemotron 3 Nano Omni delivers consistent accuracy improvements over its predecessor, Nemotron Nano V2 VL, across all modalities, enabled by advances in architecture, training data and recipes. In particular, Nemotron 3 delivers leading results in real-world document understanding, long audio-video comprehension, and agentic computer use. Built on the highly efficient Nemotron 3 Nano 30B-A3B backbone, Nemotron 3 Nano Omni further incorporates innovative multimodal token-reduction techniques to deliver substantially lower inference latency and higher throughput than other models of similar size. We are releasing model checkpoints in BF16, FP8, and FP4 formats, along with portions of the training data and codebase to facilitate further research and development.