Hi,
I would like to try running this model locally - I have RTX 4090, 64GB DDR5, Ryzen 9800X3D. Win11.
What is the best way to set this model up for local coding, using IDE?
What would be the best version to download? Ollama, vLLM, LLM Studio, llama.cpp?
Best way to optmize performance for such rig?
Appreciate any advice!
[link] [comments]




