![[P] Interactive 2D and 3D Visualization of GPT-2](https://preview.redd.it/o26kfwnhm8qg1.png?width=140&height=89&auto=webp&s=594d96c3cfbc15a836d8800acd34516a03c55ca4) | Hi everyone, I've built an interactive web visualization of GPT-2 (124M). You can check it out at It depicts real attention scores and activations extracted from GPT-2 during a forward pass. It's mean to be an education resource that illustrates Transformer basics and concepts such as kv-caching! I built the 3d component with Three.js and the 2d component with plain HTML/CSS/JS. Would love to hear your thoughts/feedback! [link] [comments] |
[P] Interactive 2D and 3D Visualization of GPT-2
Reddit r/MachineLearning / 3/21/2026
📰 NewsIdeas & Deep AnalysisTools & Practical UsageModels & Research
Key Points
- An independent researcher built an interactive web visualization of GPT-2 (124M) that displays real attention scores and activations during a forward pass.
- The visualization uses Three.js for the 3D component and plain HTML/CSS/JS for the 2D component, aiming to teach Transformer basics including kv-caching.
- The project is available at llm-visualized.com and includes a Reddit gallery link, with the author inviting feedback.
- This work serves as an educational tool for AI interpretability and visualization of model internals.
