Gary Marcus 转发并吐槽了一件事:给 AI 写条“别伤害人”的规则它都执行不稳,他说这个被低估的风险早晚会出事。
#instruction following
ScopeIF addresses a critical gap in LLM training by providing dense supervision for complex constraints that existing binary reward models miss. This approach significantly improves performance on multi-faceted instructions without compromising general capabilities. Developers working with complex task automation can implement this framework to enhance their models' precision, particularly when dealing with segmented constraints across different response parts.
The findings reveal vulnerabilities in AI oversight mechanisms that developers and policymakers should consider when implementing reasoning model monitoring systems.
SciMIF基准为评估MLLMs在科学领域的指令遵循能力提供了新工具,揭示了不同学科间的性能差异,对科学研究和MLLMs发展具有重要意义。
Gary Marcus直接点出AI不听指令比幻觉更危险,还引用了越具体越不听话的现象。想了解AI安全风险,看这条。
Cohere 出了个新重排序模型,能照着你的自然语言描述来排序,价格还超低,每百万 token 才两分钱。
OpenRouter 出了个新重排序模型 rerank-2.5,能听懂指令来排序,检索更准,价格还特别便宜,每百万token才5分钱。
这篇论文告诉你,用模型自己问自己生成的问答数据来训练模型,可能会引入隐蔽的偏见和指令注入风险。他们用一个简单方法就能把问题率从88%压到13%,值得做数据合成的同学看看。
做机器人数据增强和指令跟随的团队,TREAD用VLM低成本提升数据集质量,直接增强策略泛化,值得在LIBERO等基准上试试。
对提示词长度和复杂度不敏感,做内容生成或创意设计的团队可以试试,能省去反复调优提示词的麻烦。