AI Navigate
インサイト最新記事AI大全カオスマップ

What kind of device is suitable for running local LLM?

Reddit r/LocalLLaMA / 5/2/2026

💬 OpinionDeveloper Stack & InfrastructureTools & Practical Usage
Read original →
共有:

Key Points

  • The author considers running local LLMs due to rising costs after Copilot changed its billing model and asks what hardware is suitable for that use case.
  • They compare options including a Mac with large RAM (e.g., 128GB), a Windows PC with high-end RTX GPUs (5070/5080/5090) while worrying about GPU memory limits.
  • They also mention using mini supercomputers such as Spark DGX, noting they may be slower than other approaches based on what they’ve heard.
  • The post requests community experience and advice on how to choose a device for running local LLMs effectively.

Since copilot has changed it's billing model, become super expensive, I'm starting to think the possibility of running local LLM myself. But I'm not sure what kind of device is suitable for this kind of usage?

  1. A Mac with large RAM such as 128GB

  2. A Windows with RTX5070/5080/5090, but will the memory limit become a serious problem?

  3. A mini super computer, such as Spark DGX, but I've heard it's relatively slow in comparison to the others?

Can you share your experience about how to pick a device for running local LLm? Thanks for the advice!

submitted by /u/attic0218
[link] [comments]

関連おすすめサービス

※当サイトはアフィリエイト広告を利用しています
🎧

Notta搭載AI議事録イヤホン ZENCHORD1

AI時代の仕事術。Notta搭載で会議の議事録を自動生成するスマートイヤホン。

🎙️

AI搭載ボイスレコーダー Plaud

世界100万人が愛用。AIで文字起こし・要約を自動化するボイスレコーダー。

🖼️

画像高画質化AIツール Aiarty Image Enhancer

AIで画像を高画質化。写真・イラストを簡単にアップスケール。