Models8月7日 10:14

《指环王》成新基准，卡帕西强推大模型评测

Show me《指环王》！卡帕西强推大模型评测新基准

量子位@henry

Blog/Media

Read the original

Why we picked it

卡帕西推了个新基准，用《指环王》当考题测大模型，比枯燥的选择题有意思多了。

卡帕西（Andrej Karpathy）公开推荐了一个名为“指环王基准”的大模型评测方案。该基准用《指环王》原著考察模型对长篇叙事的理解，而非简单问答。

Image · 量子位

Body

目前“指环王基准”尚未放出完整测试集和模型成绩，但已在开发者社区引发讨论。

Original · 量子位

Show me《指环王》！卡帕西强推大模型评测新基准

指环王成为大模型新基准

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Models" desk. Key entities and technical topics under continuous tracking include 指环王, Karpathy, 基准测试.

Source attribution: curated from 量子位 (@henry).

#指环王 #Karpathy #基准测试

Keep reading

Recent stories with the same tag or section

Models US vs ChinaOfficial18:54

Chinese contentGoogle 发布 Gemini 4 Hydrogen：速度较 Gemini 3.8 Flash 提升 2.5 倍

Google 新出的 Gemini 4 Hydrogen 主打快，比 Gemini 3.8 Flash 快 2.5 倍，还带 1M 上下文和 4 档思考模式。跑 agent 或批量任务的开发者可以关注下这个价格和 Terminal-Bench 成绩，算算换过来省不省。

#Gemini 4 Hydrogen #Google #推理模型 #智能体

Event

Primary sourcemarktechpost@Michal SutterSource

Models US vs ChinaSelected17:33

Tencent Hunyuan Hy4 Ranks #3 on Artificial Analysis Cyber Index

Cost efficiency rather than raw leaderboard position is the real story: matching near-frontier security performance at roughly 1/11th the cost of Grok 4.7 (xhigh) changes the calculus for teams running vulnerability-scanning agents at volume. Security engineering teams and platform builders evaluating agentic models for code audit pipelines can use the per-task cost and token-consumption figures directly in procurement comparisons. Against DeepSeek V4.1 Flash 1017 (max), the tradeoff is higher token usage for a slight accuracy edge.

#Tencent Hunyuan #Hy4 #DeepSeek #Kimi K3.1 Pro