这篇论文搞了个ARMDIL，用MLLM当路由器给图像挑合适的视觉模型，效果不输专门训练的，还能改提示词加新数据。
论文提出ARMDIL，一种使用多模态大语言模型（MLLM）作为自适应路由器的图像分类集成方法。该集成包含ResNet、自监督学习（SSL）和视觉语言模型（VLM）等视觉骨干，在统一标签空间上训练。实验显示，ARMDIL与专用的训练型路由器性能相当，同时能通过简单提示修改快速整合新信息。该方法用自然语言推理轨迹增强可解释性，为通用视觉系统提供支持。
MLLM-Routed Heterogeneous Ensembles for Robust Cross-Dataset Image Classification
Modern image classification models excel when trained on single task-specific datasets but often struggle to generalize across domains and difficulty levels. We propose ARMDIL, an Adaptive Router for Multi-Domain Image classification with LLMs. ARMDIL is an ensemble that uses a multimodal large language model (MLLM) agent to dynamically route each image to the most suitable vision backbone. Our diverse ensemble employs convolutional neural networks (ResNets), self-supervised representation learners (SSL), and vision-language models (VLMs), each trained on a unified label space constructed from multiple image datasets with differing distributions and characteristics. Empirical evaluations illuminate the distinct capabilities and vulnerabilities of each architecture across disparate visual domains. Crucially, we show that ARMDIL effectively navigates these trade-offs, performing competitively with specialized training-based routers. Furthermore, it drastically improves adaptability by allowing new information to be integrated via simple prompt modifications, while enhancing interpretability through natural language reasoning traces. These advances in cross-dataset image classification pave the way for more reliable general-purpose vision systems such as AI assistants and autonomous robots.