Suhail 出100万美元支持蒸馏研究,还说监管可能反而让蒸馏技术加速10倍,想听听他怎么看。
Suhail 在 X 上表示蒸馏是一种研究技术,本身无好坏。他愿意提供100万美元资助优秀研究者进行蒸馏实验,使其更高效,并公开结果。他警告称,开源模型限制会引发斯特赖桑德效应,导致蒸馏研究增长10倍,从而更高效地利用数据和算力,以对抗政府监管。
Distillation is a research technique/algo. It's not inherently good or bad. If you want to do this k...
Distillation is a research technique/algo. It's not inherently good or bad. If you want to do this kind of research, I'll fund great researchers who want to do this with $1M to do experiments that will make it even more sample efficient. Then, we will openly release to the world - DM Suhail @Suhail There is going to be 10x more distillation research with the threat of open weight model restrictions. It will Streisand effect the whole community into making it even more data / compute efficient. Just to troll the government. Silly game to play. 🔗 View Quoted Tweet 💬 15 🔄 5 ❤️ 59 👀 7065 📊 15 ⚡