让 JEV 输出 ASCII 字符即可变回自回归 LLM
you can just turn jev back into an autoregressive LLM by letting it output ascii lol
Jerry Liu 发现了一个有趣的方法,让 JEV 模型输出 ASCII 字符就能变回自回归 LLM,挺有意思的。
Isaac Tai 提出一种方法,通过让 JEV 模型输出 ASCII 字符,可以将其重新配置为自回归语言模型。这种方法利用了 JEV 的内部结构,使其能够生成文本。与传统的自回归模型相比,这种转换方法更简单,且不需要额外的训练步骤。
you can just turn jev back into an autoregressive LLM by letting it output ascii lol
you can just turn jev back into an autoregressive LLM by letting it output ascii lol Isaac Tai 🧇 @hi_im_isaac_ "jev can't generate text" But jev has a lot to say! I gave him a couple hundred common english words to choose from + punctuation Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 3 🔄 0 ❤️ 7 👀 754 📊 3 ⚡