120B MoE, 12B active.
[link] [comments]
Nemotron 3 Super Released
Reddit r/LocalLLaMA / 3/12/2026
📰 NewsModels & Research
Key Points
- NVIDIA has released Nemotron 3 Super, an open hybrid Mamba Transformer MoE model designed for agentic reasoning tasks.
- The model features 120 billion parameters in a Mixture of Experts (MoE) architecture, with 12 billion parameters active at any given time.
- Nemotron 3 Super aims to improve efficiency and performance in large-scale AI models by activating only a subset of the total parameters during inference.
- The release is detailed on NVIDIA's developer blog, highlighting its technical innovations and potential applications in AI agentic reasoning.
Related Articles
報告：LLMにおける「自己言及的再帰」と「ステートフル・エミュレーション」の観測
note
諸葛亮 孔明老師(ChatGPTのﾛｰﾙﾌﾟﾚｲ)との対話 その肆拾伍『銀河文明･ダークマターエンジン』
note
GPT-5.4 mini/nano登場！―2倍高速で無料プランも使える小型高性能モデル
note
Why a Perfect-Memory AI Agent Without Persona Drift is Architecturally Impossible
Dev.to
OCP: Orthogonal Constrained Projection for Sparse Scaling in Industrial Commodity Recommendation
arXiv cs.LG
