AI产品精选

Etched 2年设计出硬编码注意力芯片,LLM推理成本将降10倍

It's wild how quickly Etched designed and got the …

精选理由

Etched把注意力写进芯片里,2年搞定,LLM推理成本要降10倍了。

AI 摘要

Etched公司仅用2年就完成了芯片设计和出货。该芯片将注意力机制硬编码到硅片中,实现了极高的模型利用率(MFU)。这种为LLM推理定制的硬件有望将智能成本降低10倍。

原文 · Tri Dao (FlashAttention)

It's wild how quickly Etched designed and got the …

It's wild how quickly Etched designed and got the chips out, all within 2 years. They went deep, hardcoding attention into silicon and getting very high MFU. This kind of hardware tailored made for LLM inference is soon gonna bring cost of intelligence down 10x