Simon 搞了个小工具，让你在本地用 OpenAI 的 API 格式调用任何 LLM 模型，像 qwen3.5-4b 这种，还能自动去重消息，试试看。
llm-chat-completions-server 0.1a0 基于 LLM 0.32rc1 的 content-addressable logs 特性构建，支持通过 OpenAI Chat Completions 格式请求多轮对话。用户安装后可通过命令行启动本地服务器（默认端口 9001），暴露所有已安装的 LLM 模型（如 qwen3.5-4b）。该插件由 GPT-5.6 Sol 编写，能自动去重重复消息部分。每个请求可携带完整对话历史，客户端负责维护状态。
llm-chat-completions-server 0.1a0
Release: llm-chat-completions-server 0.1a0 A key goal of the new content-addressable logs in LLM 0.32rc1 was being able to support OpenAI Chat Completion style requests where each incoming message extends the previous conversation, like this: curl http://localhost:8002/v1/chat/completions \ -H 'Content-Type: application/json' \ -d '{ "model": "qwen3.5-4b", "messages": [ {"role": "user", "content": "Capital of France?"}, {"role": "assistant", "content": "Paris."}, {"role": "user", "content": "Germany?"} ] }' Here the conversation state is tracked by the client, so each of these requests gets longer and longer. The new schema design in LLM is designed to de-duplicate these using hashes of the individual message parts. To test that out, I built this plugin: uv tool install llm --pre llm install llm-chat-completions-server llm chat-completions-server -p 9001 Running this starts a localhost server on port 9001 that exposes your full collection of LLM models (from any plugins you have installed) using a ChatGPT Completions compatible endpoint. GPT-5.6 Sol wrote the whole thing - it turns out it knows the OpenAI Chat Completions API shape really well. Tags: projects , openai , llm