Hi everyone, I’m looking to build a local, 100% private AI setup that feels less like a technical assistant and more like a warm, therapeutic companion. I’ve done some initial research on a hardware/software stack, but I’d love a second opinion on whether this will actually meet my needs for deep self-reflection without becoming a maintenance nightmare.
Subject: Second Opinion: Private "Personal AI" Setup (RTX 4060 + 64GB RAM + Inner-Dialogue/Obsidian)
Goal: I want a 100% private, offline AI system for deep self-reflection, life organization, and exploring my thought processes (identifying patterns and repressed thoughts).
My Two Non-Negotiables:
- Therapeutic & Life-Context Tone: I’m interested in the "Inner Dialogue" (ataglianetti) style. I don't want a "robotic assistant." I need the AI to have a warm, insightful, and clinically-informed tone. It needs to remember my context across sessions to help me see the "big picture" of my mental health and recurring internal patterns over time.
- Zero Maintenance: I am happy to do a one-time deep setup, but I absolutely do not want to spend my time troubleshooting plugins or constantly tuning parameters. I want a system that runs reliably in the background so I can focus on my actual journaling.
The Proposed Hardware:
- Laptop: Used ASUS TUF A15 (FA507NV) with RTX 4060 (8GB VRAM).
- Memory: Upgraded to 64GB DDR5 RAM to handle larger models.
The Proposed Software Stack:
- Backend: Ollama running locally.
- Interface: Inner-Dialogue for the actual chat-based sessions.
- Vault: Obsidian (with the Smart Connections plugin) to index the journal files in the background. The goal is for the AI to surface long-term patterns across months or years of entries automatically.
- Models: Llama 3/4 8B for daily check-ins; Llama 3/4 70B (quantized) for deep weekly reflection.
Questions for the community:
- Is an RTX 4060 + 64GB RAM still the "sweet spot" in 2026 for running 70B models at a readable speed (~1.5 t/s) for deep personal reflection?
- Does this hybrid (Inner-Dialogue + Obsidian) actually stay low-maintenance, or will the background indexing and plugin syncing eventually become a chore?
- Are there better models for a warm, empathetic, yet intellectually sharp tone than the standard Llama-3/4 series (e.g., Mistral-Nemo-12B or specific "Roleplay/Therapy" finetunes)?
[link] [comments]
