模型蒸馏再蒸馏会怎样?Suhail称监管无用

If I distill from a model that distilled from a model that distilled from another model, what’s goin...

精选理由

Suhail聊透蒸馏链:重复蒸馏没事,监管没用,重点该投开源模型。

AI 摘要

Suhail在X上发帖讨论模型蒸馏链:从一个蒸馏模型继续蒸馏多次,结果不会出问题。他认为监管无法阻止这种行为,因为原始模型基于海量版权数据训练,不会因此被起诉。呼吁美国公司投资开源权重模型以保障国家安全。

原文 · Suhail

If I distill from a model that distilled from a model that distilled from another model, what’s goin...

If I distill from a model that distilled from a model that distilled from another model, what’s going to happen? Nothing. You cannot prevent any of this. It’s also BS to try when the original model trained on metric tons of copyright data it will never be taken to court for. It’s a waste of time to regulate the inevitable. The real solution is to heavily invest in American companies securing open weight models for our citizens and national security. 💬 16 🔄 9 ❤️ 118 👀 7496 📊 27 ⚡

模型蒸馏再蒸馏会怎样?Suhail称监管无用 · AI 热点