VetClaw: 边缘-云多模态智能体系统用于兽医疾病筛查

VetClaw: An Edge-Cloud Multimodal Agentic System for Veterinary Disease Screening

精选理由

VetClaw 把摄像头和云端大模型结合起来,让兽医能快速做疾病初筛,比单用图片准确多了。

AI 摘要

VetClaw 是一个边缘-云多模态智能体系统,通过摄像头模块采集图像并结合症状描述,调用云端视觉语言模型进行零样本疾病分类。系统设计将代理交互与工作流编排分离:OpenClaw 负责边缘设备的调度、工具调用和用户通知,LangGraph 管理状态化筛查流程,包括输入验证、图像传输、模型调用、安全检查和故障处理。实验表明,仅用图像的 VLM 预测性能有限,而结合症状描述的多模态输入显著提升了零样本分类准确率。该系统将静态预测模型转化为具备工具使用、工作流管理和不确定性处理的协调安全系统。

原文 · arXiv cs.LG

VetClaw: An Edge-Cloud Multimodal Agentic System for Veterinary Disease Screening

We present VetClaw, an edge-cloud multimodal agentic system for early veterinary disease screening. VetClaw uses a camera module as an edge sensing device and sends captured images, together with optional symptom descriptions, to a server-hosted vision-language model for zero-shot disease classification. The system separates agent interaction from workflow orchestration: OpenClaw provides scheduling, tool access, user interaction, and notification services on the edge device, while LangGraph manages the stateful screening workflow, including input validation, image transmission, model invocation, safety checks, conditional routing, failure handling, and structured logging. This design moves beyond static image classification by enabling the system to collect visual evidence, invoke external models, apply deterministic safety rules, and generate diagnostic-support alerts. Results show that image-only VLM prediction remains limited, whereas symptom-guided and multimodal inputs improve zero-shot classification performance. Thus, VetClaw transforms a static prediction model into a coordinated, safety-aware system that can use tools, manage workflows, handle failures, and escalate uncertain cases.