Started running local models for a variety of purposes on state-owned research cluster. VRAM and inference time are essentially non-issues, but I explicitly can't use DeepSeek or AliBaba products or their derivatives, and, implicitly, any other Chinese models would be heavily frowned upon. It seems like GPT-OSS, Nemotron, and Mistral models make up the frontier of non-Chinese models right now, maybe including something like IBM Granite for small tool calling models. I really like Olmo for a variety of reasons, but it's probably not the best tool for any job. Are there any model families I'm unaware of that I should be looking at? Gemma? Phi? Llama 4?
[link] [comments]
