Gary Marcus转发Anthropic员工的话：模型和harness拆不开，测试必须连着一起测。神经符号AI派觉得这是胜利。
Anthropic技术员工Jess Yan表示，模型与harness无法分离，分离就会损失性能。她认为测试模型时必须搭配harness进行，且会选择Anthropic自建的harness。Gary Marcus转发该言论，称这是神经符号AI的胜利。
Checkmate: you can’t take the harness (which is typically in large part symbolic) away from the neu...
Checkmate: you can’t take the harness (which is typically in large part symbolic) away from the neural model without giving up performance. HUGE victory for neurosymbolic AI, straight from @AnthropicAI Technical Staff. Fireside Alpha @firesidealpha Anthropic Technical Staff Jess Yan says the harness and the model cannot be pulled apart without giving up performance, though she flags her own bias. "I think I am quite biased but I also think that it is impossible to get the maximum possible performance without tying together the harness and the model." "Now the components of the harness and maybe the thickness of the harness will change over time as models get more and more capable." "However, when we test our models and when we are assessing their performance we always have to test it in conjunction with a harness." "And are we going to test it with all the different harnesses of the world? We're going to select the harnesses that we have built." "And so there is an aspect of the necessity of building models is that you have to be testing them with harnesses, and that sort of keeps them paired together." Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 1 🔄 1 ❤️ 7 👀 1723 📊 2 ⚡