Hi everyone
I'm on a laptop (Dell XPS 9300, 32gb ram / 2tb drive, linux mint), don't plan to change it anytime soon.
I'm tip toeing my way into the llm, and would like to sense check the models I have, they were suggested by claude when asking about lightweight types, claude made the descriptions for me:
llama.cpp
Openweb UI
Models:
Qwen2.5-Coder 3B Q6_K - DAILY: quick Python, formulas, fast answers
Qwen3.5-9B Q6_K - DEEP: complex financial analysis, long programs
Gemma 3 4B Q6_K - VISION: charts, images, screenshots
Phi-4-mini-reasoning Q6_K - CHECK: verify maths and logic
At the moment, they are working great, response times are reasonably ok, better than expected to be honest!
I'm struggling (at the moment) to fully understand, and appreciate the different models on huggingface, and wondered, are these the most 'lean' based on descriptions, or should I be looking at swapping any? I'm certainly no power user, the models will be used for data analysis (csv/ods/txt), python programming and to bounce ideas off.
Next week I'll be buying a dummies/idiot guide. 30 years IT experience and I'm still amazed how much and quick systems have progressed!
[link] [comments]
