Architect推出Liquid Inference大模型实时拍卖系统
Architect Launches Liquid Inference, a Real-Time Auction for LLM Inference
Architect推出了Liquid Inference,让大模型推理变成实时拍卖,开发者只需换URL就能用上最低价服务。
Architect Financial Technologies发布了Liquid Inference,这是一个大模型推理路由器。该系统为每个提示词请求运行实时拍卖,由提供商竞标提供服务。买家只需支付符合其规则的最低报价。开发者只需替换基础URL即可使用。
Architect Launches Liquid Inference, a Real-Time Auction for LLM Inference
Architect Financial Technologies has launched Liquid Inference, an LLM router that runs a live auction for every request. Liquid Inference is an LLM inference marketplace from Architect where providers bid to serve each prompt. The buyer pays the lowest offer that meets its rules. For developers, it is quite simple message: swap a base URL, […] The post Architect Launches Liquid Inference, a Real-Time Auction for LLM Inference appeared first on MarkTechPost .