TAU-Agent 是一款用于交通异常理解的新框架，通过结合视频字幕和跟踪工具，实现了对交通视频的异常检测和解释，其在基准测试中的表现值得一看。
TAU-Agent 是一种用于交通异常理解的代理检索增强框架，通过视频字幕工具和开放词汇跟踪工具检索相关证据，并使用视觉语言模型进行推理和答案生成。在 AI City Challenge 2026 的基准测试中，TAU-Agent 在三个任务中分别排名第二、第十二和第五。代码可在 GitHub 上获取。
TAU-Agent: An Agentic Retrieval-Augmented Framework for Traffic Anomaly Understanding
Traffic Anomaly Understanding (TAU) requires models and systems to detect, reason about, and explain anomalous events in transportation videos. To address this challenge, we propose TAU-Agent, an agentic retrieval-augmented framework for traffic anomaly understanding. Given a task query, a central retrieval agent orchestrates two visual perception tools, namely a Video Captioning Tool and an Open-Vocabulary Tracking Tool, to retrieve and select query-relevant evidence, including captions, temporal intervals, and object trajectories. The selected evidence, together with sampled video frames and the input query, is provided to a supervised fine-tuned vision-language model for final reasoning and answer generation. We evaluate TAU-Agent on both the in-domain and the out-of-domain benchmarks from the AI City Challenge 2026. TAU-Agent achieves scores of 0.6779 on Track 3, 0.3998 on Track 7, and 67.9275 on Track 8, ranking second, twelfth, and fifth, respectively. Code is available at: https://github.com/siri-rouser/TAU-Agent.