https://github.com/ggml-org/llama.cpp/pull/20334
It would be already in the latest release.
There is a performance boost in my AMD RX7800XT setup (Fedora Linux).
For Qwen 3.5 27B, token generation was ~28t/s.
It is now ~36t/s.
[link] [comments]
GATED_DELTA_NET for vulkan merged in llama.cpp
Reddit r/LocalLLaMA / 3/13/2026
📰 NewsDeveloper Stack & InfrastructureTools & Practical UsageModels & Research
Key Points
- GATED_DELTA_NET for Vulkan has been merged into llama.cpp and is available in the latest release via PR 20334.
- On AMD RX7800XT systems running Fedora Linux, the change yields a notable performance boost, increasing Qwen 3.5 27B token generation speed from about 28t/s to about 36t/s.
- The improvement comes from the gated delta-net for Vulkan implementation integrated into llama.cpp.
- This update can enhance Vulkan-based inference workloads for users deploying Llama-derived models, potentially improving throughput and efficiency.
[link] [comments]
Related Articles
NVIDIA、GTC 2026で次世代AI基盤を発表 「Vera Rubin」を軸にエージェント・ゲーム・宇宙領域へ展開のサムネイル画像
Ledge.ai
1Password、AIエージェントのアクセス制御を統合管理する「Unified Access」発表 人間・マシン・AIの資格情報を一元統制のサムネイル画像
Ledge.ai
『モンドーモンドー』｜夏目龍頭流闇文学｜AI画像生成｜自由詩｜散文詩｜ホラー｜ダークファンタジー｜深淵図書館
note
報告：LLMにおける「自己言及的再帰」と「ステートフル・エミュレーション」の観測
note
「お金、見直したいけどどこから？」AIが改善ヒントを教えてくれる、公式プロンプトを公開
note
