AI Navigate

Qwen3.5 35b exl3 quants with text-generation-webui?

Reddit r/LocalLLaMA / 3/15/2026

💬 OpinionTools & Practical UsageModels & Research
Read original →
共有:

Key Points

  • A Reddit post reports that loading the Qwen3.5 35B EXL3 quantized model with text-generation-webui hangs and never starts.
  • The user tried exl3 quants by turboderp as well as the git version, pip, and released GitHub files of exllamav3, but none load.
  • They link to a HuggingFace repository for turboderp's Qwen3.5-35B-A3B-exl3 (4.00bpw) and ask if anyone has a workaround.
  • The post highlights ongoing community troubleshooting for integrating large language models with web UI tools.

I've been trying to load the model but it just gets stuck at loading and never seems to start? I tried the exl3 quants by turboderp https://huggingface.co/turboderp/Qwen3.5-35B-A3B-exl3/tree/4.00bpw and tried the git version of exllamav3 and the pip one and also the released files on github and it doesn't load.

Has anyone figured it out?

submitted by /u/2muchnet42day
[link] [comments]

関連おすすめサービス

※当サイトはアフィリエイト広告を利用しています
🎧

Notta搭載AI議事録イヤホン ZENCHORD1

AI時代の仕事術。Notta搭載で会議の議事録を自動生成するスマートイヤホン。

🎙️

AI搭載ボイスレコーダー Plaud

世界100万人が愛用。AIで文字起こし・要約を自動化するボイスレコーダー。

🖼️

画像高画質化AIツール Aiarty Image Enhancer

AIで画像を高画質化。写真・イラストを簡単にアップスケール。