JustinLin610分享了一个实用经验：搞MoE专家路由和任务路由器都不如直接按任务简单/复杂选模型，省心省力。
推文讨论了模型战略使用而非技术方法。作者尝试了让MoE以专家模式运行以及设置任务路由器来节省成本，但发现效果不佳。他提出一个粗略标准：对于QA和简单智能体任务（如使用工具一次或两次或修复小bug），应使用较简单模型；对于大型代码项目或ML实验评估，则应使用更强模型。
one thought about possible misunderstanding: here we are discussing more about strategic use of mode...
one thought about possible misunderstanding: here we are discussing more about strategic use of models instead of technical methods. we did things like imagining moe really playing like experts or setting up a task router to save costs but found them hard to work well. here what I am seeing is more about a rough standard of choosing different models. q and a and very simple agentic tasks like problems solved by using tools once or twice or fixing a small bugs, compared with building a large code projects or doing ml experiments and evals, etc. 💬 0 🔄 0 ❤️ 5 👀 270 📊 1 ⚡