Hugging Face 自建 AI 下载 CDN,每月流量接近 1 exabyte
Hugging Face 每月要分发近 1EB 的开源模型和数据集,大到他们干脆自建了 CDN,还放了一个实时流量地图,能看到全球哪里的人在下模型。做 AI 基础设施或者关心开源生态规模的人可以看看这个数字。
Hugging Face 的 Julien Simon 透露,该平台每月通过互联网分发的开源模型和数据集体量已接近 1 exabyte(约 100 万 TB)。
为了支撑这一规模,团队没有依赖第三方 CDN,而是自建了专门面向 AI 下载的 CDN。团队中的 @hugoch 还制作了一个实时流量地图,可视化展示全球各地下载流量的走向。
这一数字直观反映开源模型生态的使用量:仅 Hugging Face 一家的月分发量就达到 EB 级别,说明模型下载已成为一种体量接近传统内容分发的负载类型,需要专门的基础设施来承载。
We serve almost 1 exabyte of open models and datasets over the internet per month. At that scale, we had to build our own CDN for AI downloads. 🌎 @hugoch and team made this live map of where the traffic flows and it's beautiful 😍
This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include Hugging Face, CDN, open-source models, AI infrastructure.
Source attribution: curated from Julien Chaumond (@julien_c).