技巧多源确认

OpenAI/Anthropic 批量 API 请求超 1B tokens/日?想交流实现经验

If you do > 1B tokens a day in batched api requests with OpenAI or Anthropic, would love to talk ...

精选理由

OpenAI 和 Anthropic 的 API 用户,如果每日批量请求的 token 数量超过 1B,想交流实现经验,可以私信作者。

OpenAI 和 Anthropic 的 API 用户,如果每日批量请求的 token 数量超过 1B,可以私信作者交流实现过程中的优缺点。作者希望了解这些高流量用户的实际操作经验。

原文 · Suhail

If you do > 1B tokens a day in batched api requests with OpenAI or Anthropic, would love to talk ...

If you do > 1B tokens a day in batched api requests with OpenAI or Anthropic, would love to talk to you to learn about ups/downs of implementing batching. DM 💬 6 🔄 0 ❤️ 16 👀 2741 📊 7 ⚡