NVIDIA发布Switchyard代理库

Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs

精选理由

NVIDIA出了个Switchyard代理库,能让OpenAI和Anthropic API互转,Claude Code和Codex CLI能无缝跑在vLLM上。

AI 摘要

NVIDIA发布了Switchyard,一个Apache-2.0许可的Rust代理和库,用于LLM流量处理。该工具可将请求解码为提供商中立类型,使用直通、随机、LLM分类器或阶段路由器算法进行路由,并将响应转换回客户端格式。Switchyard支持Claude Code或Codex CLI在vLLM、NIM或Ollama上运行无需修改。目前项目处于预alpha阶段,不适合生产环境使用。

图片来源 · marktechpost
原文 · marktechpost

Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs

NVIDIA has released Switchyard, an Apache-2.0 Rust proxy and library for LLM traffic. It decodes requests into provider-neutral types, routes them with passthrough, random, LLM-classifier, or stage-router algorithms, and translates responses back into the client's format, so Claude Code or Codex CLI can run against vLLM, NIM, or Ollama unchanged. The project is pre-alpha and not for production. The post Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs appeared first on MarkTechPost .