AI Navigate

Best Qwen3.5 27b GUFFS for coding (~Q4-Q5) ?

Reddit r/LocalLLaMA / 3/17/2026

💬 OpinionTools & Practical UsageModels & Research

Key Points

  • The post seeks the best Qwen3.5 27b GUFFs for coding tasks, targeting ~Q4-Q5 quantization with a memory footprint around 20-24 GB.
  • Potential candidates named include Unslosh, bartowski, and mradermacher, with room for additional options.
  • It asks for insights on how to compare these GUFFs to determine the best performing choice.
  • A Reddit link to the LocalLLaMA thread is provided for reference and discussion.
  • The topic is a practical inquiry into selecting and evaluating quantized GUFFs for coding workloads.

What is current the best Qwen3.5 27b GUFFs for coding tasks (~Q4-Q5 quantization, ~20-24gb max) ? Unslosh? bartowski? mradermacher? other?

And any insights how to compare them right to find the best?

submitted by /u/bitcoinbookmarks
[link] [comments]