 | I haven't seen many people talking about NVIDIA's new Nemotron-3-Nano model, which was released just a couple of days ago... so, I decided to build a WebGPU demo for it! Everything runs locally in your browser (using Transformers.js). On my M4 Max, I get ~75 tokens per second - not bad! It's a 4B hybrid Mamba + Attention model, designed to be capable of both reasoning and non-reasoning tasks. Link to demo (+ source code): https://huggingface.co/spaces/webml-community/Nemotron-3-Nano-WebGPU [link] [comments] |
Nemotron-3-Nano (4B), new hybrid Mamba + Attention model from NVIDIA, running locally in your browser on WebGPU.
Reddit r/LocalLLaMA / 3/20/2026
📰 NewsDeveloper Stack & InfrastructureTools & Practical UsageModels & Research
Key Points
- NVIDIA released Nemotron-3-Nano, a 4B hybrid Mamba + Attention model designed to handle both reasoning and non-reasoning tasks.
- A WebGPU-based demo runs entirely locally in the browser (via Transformers.js), showcasing client-side inference without a server.
- The demo reports around 75 tokens per second on an M4 Max, illustrating practical on-device performance for a small model.
- The project provides links to a HuggingFace Spaces demo and source code for experimentation.
Related Articles
We asked 200 ChatGPT users their biggest frustration. All top 5 answers are problems ChatGPT Toolbox solves.
Reddit r/artificial
I Built an AI That Reviews Every PR for Security Bugs — Here's How (2026)
Dev.to
[R] Combining Identity Anchors + Permission Hierarchies achieves 100% refusal in abliterated LLMs — system prompt only, no fine-tuning
Reddit r/MachineLearning
How I Built an AI SDR Agent That Finds Leads and Writes Personalized Cold Emails
Dev.to
Complete Guide: How To Make Money With Ai
Dev.to
