边缘部署的视觉语言模型能否识别物种?
Can Edge-Deployable Vision-Language Models Identify Species?
想了解边缘部署的AI模型在野外实际场景中的表现,这篇论文对比了通用模型和专用模型在物种识别任务上的差异。
研究测试了四款2-8B规模的视觉语言模型(Qwen3-VL 2B/4B/8B、Gemma3 4B)在野外相机陷阱图像上的物种识别能力,发现它们在野外图像上的准确率比在标准照片上下降9.6-26.6个百分点,而专门用于生物领域的BioCLIP(300M参数)表现更好,但自身也存在18.0百分点的域差异。
Can Edge-Deployable Vision-Language Models Identify Species?
Camera traps often run in the field on edge hardware with limited or no connectivity, making small, locally-deployable vision-language models (VLMs) -- not frontier-scale ones -- the practically relevant class to evaluate for species identification. We test whether models in this deployment-relevant 2--8B range carry genuine taxonomic knowledge, evaluating four such VLMs (Qwen3-VL 2B/4B/8B, Gemma3 4B) against the domain-specific specialist BioCLIP (300M parameters) on a 96-species task, comparing clean iNaturalist photographs against camera-trap imagery from 6 LILA.science collections, on two independently-sampled evaluation sets. All models identify species far above chance, but every model -- general-purpose or specialist -- degrades sharply on field imagery (domain gaps of 9.6--26.6 percentage points, consistent across taxonomic levels and both evaluation sets), indicating the degradation reflects general image legibility rather than fine-grained discrimination failure. BioCLIP substantially outperforms every VLM tested (by 33.2--59.2 percentage points across an expanded 200-image sample for every model) despite its far smaller size, suggesting the gap reflects specialized training data rather than model scale; yet BioCLIP's own domain gap (18.0 points) is statistically indistinguishable from the best VLM's (22.3 points), suggesting the clean-to-field degradation itself is a property of the image-quality shift rather than a general-purpose-model weakness. Under open-set prompting, 5.9--9.6% of responses are syntactically valid but taxonomically nonexistent species names; the relative fabrication-rate ranking across models replicates exactly across both evaluation sets, a more robust finding than any single point estimate.