模型86°

博主抢先体验 Meta 新模型 Watermelon:编程能力强但文风偏干

精选理由

有人提前玩了 Meta 的新模型 Watermelon,说它写代码能自己跑自己查,测试基准居然还超出预期,就是文笔有点干。

博主 kimmonismus 称自己提前几天试用 Meta 新模型 Watermelon。他测试了陷阱类问题,模型没有被误导,并能严格按指令执行。作为编程智能体,它能够自己编写、运行并检查代码。他还表示其表现与基准测试结果相符,基准成绩甚至超出他的预期;创意写作则被他评价为偏干。

原文 · kimmonismus

Now I can say it: Had early access to @Meta’s new "Watermelon" for the past few days.

Trick questions didn’t fool it, it followed instructions to the word, and as a coding agent it wrote, ran and checked its own code. Creative writing still a bit dry for my taste, but very very very impressive overall.

From my initial testings its as good as the benchmarks make it look. Meta really nailed it with their model!

P.s.: the benchmarks still surprised me, in a postive way. Didnt see the benchmark evals in advance.