这个工具把 Transformer 的黑箱彻底透明化了,做 AI 学习或教学的人可以直接上手体验,比看论文直观一百倍。
Transformer Explainer 是一个免费的开源互动工具,通过浏览器运行 GPT-2 模型,实时展示文本生成的全过程。它提供实时推理、可视化步骤图和温度滑块,让用户直观看到嵌入、注意力头和最终 token 排名。该工具使用 ONNX runtime 和 HuggingFace 在本地运行,前端基于 Svelte 和 D3 动画。对于想理解 Transformer 工作原理的开发者、学生和 AI 爱好者来说,这是一个极佳的学习资源。
This free interactive explainer just exposed how G…
This free interactive explainer just exposed how GPT actually works.
Most people treat Transformers like magic. You type something in, words come out. What happens inside stays a black box for almost everyone. Transformer Explainer cracks that box wide open. It runs a live GPT-2 model in your browser. The tool gives you three things at once: > Live inference on any text > A visual map of every step > A working temperature slider A Sankey diagram traces your words through the full pipeline.
You see embeddings, attention heads, and the final token ranking.
You can collapse and expand each operation to control the depth. Move the slider and the probability distribution shifts instantly.
High values spread predictions wide, low values sharpen them. The whole thing runs locally using ONNX runtime and HuggingFace.
The frontend uses Svelte and D3 for animations. The project is open-source and free.