AI Navigate
インサイト最新記事一覧AI大全

Banned from cloud services at work. Is a local AI worth it?

Reddit r/LocalLLaMA / 2026/3/24

💬 オピニオンDeveloper Stack & InfrastructureSignals & Early TrendsTools & Practical Usage
原文を読む →
共有:

要点

  • A Reddit user’s workplace has prohibited uploading proprietary data to cloud services, pushing them to consider running an AI assistant locally for document analysis and report writing.
  • With a ~$1500 budget and strong requirements for portability, they’re comparing a small startup device (TiinyAI) advertising ~80GB RAM and 190 TOPS versus a Mac mini M4 with 64GB RAM enabled by a trade-in discount.
  • They don’t need very large models but want to run roughly 30B-class models smoothly and potentially run multiple smaller models concurrently.
  • The core decision hinges on practical constraints like hardware capability for local LLM inference, device size, and the risk that a small startup may not ship on time.

My company just banned us from putting any proprietary data into clould services for security reasons. I need help deciding between 2 pc. My main requirement is portability, the smaller the better. I need an AI assistant for document analysis and writing reports. I don't need massive models; I just want to run 30B models smoothly and maybe some smaller ones at the same time. I currently have two options with a budget of around $1500:

  1. TiinyAI: I saw their ads. 80GB RAM and 190TOPS. The size is very small. However they are a startup and I am not sure if they will ship on time

  2. Mac Mini M4 64GB: I can use a trade-in to get about $300 off by giving them my old Mac

Is there a better choice for my budget? Appreciate your advices

submitted by /u/daksh_0623
[link] [comments]

関連おすすめサービス

※当サイトはアフィリエイト広告を利用しています
🎧

Notta搭載AI議事録イヤホン ZENCHORD1

AI時代の仕事術。Notta搭載で会議の議事録を自動生成するスマートイヤホン。

🎙️

AI搭載ボイスレコーダー Plaud

世界100万人が愛用。AIで文字起こし・要約を自動化するボイスレコーダー。

🖼️

画像高画質化AIツール Aiarty Image Enhancer

AIで画像を高画質化。写真・イラストを簡単にアップスケール。