精选理由
Etched把注意力写进芯片里,2年搞定,LLM推理成本要降10倍了。
Etched公司仅用2年就完成了芯片设计和出货。该芯片将注意力机制硬编码到硅片中,实现了极高的模型利用率(MFU)。这种为LLM推理定制的硬件有望将智能成本降低10倍。
原文 · Tri Dao (FlashAttention)
It's wild how quickly Etched designed and got the …
It's wild how quickly Etched designed and got the chips out, all within 2 years. They went deep, hardcoding attention into silicon and getting very high MFU. This kind of hardware tailored made for LLM inference is soon gonna bring cost of intelligence down 10x