I BUILT MY FIRST MODEL FROM SCRATCH

Reddit r/LocalLLaMA / 5/3/2026

💬 OpinionSignals & Early TrendsTools & Practical UsageModels & Research

共有:

Key Points

The author, Crownelius, introduces “Shard,” a 40M-parameter LLM they built and shares it via a Hugging Face organization link.
They describe broader work on creating small “tiny LLMs” intended to run coherently for IoT-oriented tasks.
The post mentions researching “atomic models” and learning from a project called Compact AI after joining it.
They state that the model they created from scratch is named “Shard” (also referred to as “Scamp”) and is available publicly.

Sup, I'm Crownelius, I made that popular opus distill dataset.

TODAY YOU ARE INTRODUCED TO SHARD a 40m parameter mal-formed LLM.

Right now I'm working on a series of tiny LLM's, with a goal to run a coherent model for IoT tasks. I've researched atomic models, and while doing that I came across a project called Compact AI. Since joining them, I've learned a lot and even made my own model from scratch.

The model is available here: CompactAI-O[HF Organization]

About my model named "Shard"-I call it Scamp.

submitted by /u/volious-ka
[link] [comments]