Gemini 3.7 Flash登顶AA - AnalystAgent分析榜单

Gemini 3.7 Flash just took #1 on @ArtificialAnlys new AA-AnalystAgent. AA-AnalystAgent evaluates ag...

精选理由

Gemini 3.7 Flash在这项真实任务评测中夺冠,能高效处理多样数据,比其他参与者表现更好。

AI 摘要

Gemini 3.7 Flash在@ArtificialAnlys推出的AA - AnalystAgent评测中获得第一名。该评测包含80项真实世界的定量分析任务,覆盖14个业务与科学领域。评测采用Python 3.12沙盒环境,提供pandas等多类库辅助脚本编写。Gemini 3.7 Flash在准确性、速度等方面表现领先。

原文 · Philipp Schmid

Gemini 3.7 Flash just took #1 on @ArtificialAnlys new AA-AnalystAgent. AA-AnalystAgent evaluates ag...

Gemini 3.7 Flash just took #1 on @ArtificialAnlys new AA-AnalystAgent. AA-AnalystAgent evaluates against 80 real-world quantitative analysis tasks across 14 business and scientific domains (finance, healthcare, hydrology, government appropriations). The Agent run inside an isolated Python 3.12 sandbox using AA's open-source Stirrup harness. They receive reference spreadsheets (.xlsx) and documents (.docx) alongside standard data libraries (pandas, polars, openpyxl, scipy, PyMuPDF) to inspect schemas, write scripts, handle edge cases, and calculate final figures. Gemini 3.7 Flash: • Accuracy: #1 with 60.0% pass^5 (70.5% pass @1 , 77.5% pass @5 ) • Speed: 1.32s per task (fastest) • Cost: $0.54 avg per task (middle) 💬 3 🔄 2 ❤️ 9 👀 629 📊 4 ⚡

Gemini 3.7 Flash登顶AA - AnalystAgent分析榜单 · AI 热点