AI Navigate
インサイト最新記事一覧AI大全

Hosting Assistant_Pepe_70B on Horde!

Reddit r/LocalLLaMA / 3/28/2026

📰 NewsDeveloper Stack & InfrastructureSignals & Early TrendsTools & Practical Usage
Read original →
共有:

Key Points

  • The post announces that “Assistant_Pepe_70B” is being hosted on Hugging Face and made available through Horde with very high availability across 2xA6000 GPUs.
  • It specifies FP8 precision running at 16k context length, claiming roughly 99.99% accuracy for the FP8 mode.
  • The author points readers to Lite KoboldAI (FREE, no login required) as the interface to try the model.
  • Feedback from users is explicitly encouraged to iterate on hosting quality and/or usage.
  • The update highlights practical deployment options for large local/hosted LLMs via distributed inference infrastructure like Horde.

Hi all,

Hosting https://huggingface.co/SicariusSicariiStuff/Assistant_Pepe_70B on Horde at very high availability on 2xA6000.

FP8 precision at 16k context (FP8 is about 99.99% accuracy).

( https://lite.koboldai.net/ FREE, no login required)

So give it a try!
(Feedback always welcomed)

submitted by /u/Sicarius_The_First
[link] [comments]
広告

関連おすすめサービス

※当サイトはアフィリエイト広告を利用しています
🎧

Notta搭載AI議事録イヤホン ZENCHORD1

AI時代の仕事術。Notta搭載で会議の議事録を自動生成するスマートイヤホン。

🎙️

AI搭載ボイスレコーダー Plaud

世界100万人が愛用。AIで文字起こし・要約を自動化するボイスレコーダー。

🖼️

画像高画質化AIツール Aiarty Image Enhancer

AIで画像を高画質化。写真・イラストを簡単にアップスケール。