用 GPT-Realtime-2 模型边聊边读文档
Simon Willison 更新了其 OpenAI WebRTC 音频会话工具，新增对 GPT-Realtime-2 模型的支持，该模型具备 GPT-5 级推理能力，知识截止日期为 2024 年 9 月 30 日。用户现在可以在浏览器中粘贴文档上下文，与模型进行基于文档内容的音频对话。该工具最初于 2024 年 12 月发布，用于测试 OpenAI 的 WebRTC 实时音频 API。
OpenAI WebRTC Audio Session, now with document context
OpenAI WebRTC Audio Session, now with document context I built the first version of this tool in December 2024 to try out the then-new OpenAI WebRTC API for interacting with their realtime audio models. Last month OpenAI introduced a brand new model to that API called GPT‑Realtime‑2 , which they promoted as "our first voice model with GPT‑5‑class reasoning" - with a Sep 30, 2024 knowledge cut-off. I've been waiting for that model to show up in the ChatGPT iPhone app but it still hasn't, so I revisited my old playground. You can now pick the better model, and you can also paste in a big chunk of document context so you can have as audio conversation in your browser about whatever information you think would be useful to explore in a conversational way. Tags: audio , tools , ai , openai , generative-ai , llms , multi-modal-output , webrtc