In case it helps anyone I'm sharing the config I am using for Qwen3-5-122B-A10B-NVFP4 deployed on a single 6000 Pro.
https://github.com/ian-hailey/vllm-docker-Qwen3-5-122B-A10B-NVFP4
[link] [comments]
Docker vllm config for Qwen3-5-122B-A10B-NVFP4
Reddit r/LocalLLaMA / 3/22/2026
💬 OpinionDeveloper Stack & InfrastructureTools & Practical Usage
Key Points
- It shares a Docker/vLLM configuration used to deploy Qwen3-5-122B-A10B-NVFP4 on a single 6000 Pro GPU, providing a practical setup reference.
- The post links to a GitHub repository with the exact config needed for this deployment.
- It serves as a hands-on guide for practitioners aiming to run Qwen-based LLMs locally using vLLM in Docker.
- The submission originates from a Reddit post by user /u/1-a-n in the r/LocalLLaMA community.
submitted by /u/1-a-n
[link] [comments]
Related Articles
How to Enforce LLM Spend Limits Per Team Without Slowing Down Your Engineers
Dev.to
v1.82.6.rc.1
LiteLLM Releases
Reduce errores y costos de tokens en agentes con seleccion semantica de herramientas
Dev.to
How I Built Enterprise Monitoring Software in 6 Weeks Using Structured AI Development
Dev.to
Engenharia de Prompt: Por Que a Forma Como Você Pergunta Muda Tudo(Um guia introdutório)
Dev.to
