Medical AI randomized trial results

Scoring bias in judge models flows directly into training signal and leaderboard rankings, so skewed calibration quietly shapes which outputs get rewarded. Teams using MLLM-as-a-judge pipelines should audit scale usage and split alignment reports by reference culture rather than averaging. Anyone building evaluation or RLHF infrastructure for products serving both Western and Chinese audiences has a concrete methodology to copy here.

官方账号Salesforce AI Research@SFResearchSource

Fixed macro execution works only when the skill matches the task; making granularity adaptive turns brittle agent failures into recoverable ones. Developers building coding agents can apply the macro-to-micro fallback pattern to improve reliability without hand-tuning heuristics. The learned router beating a hand-written heuristic on the 12-task study shows the approach scales beyond scripted workflows.

DAIR.AI@dair_aiSource

Cost and privacy trade-offs in agent execution do not move together — once task completion converges, strategy choice is mostly a privacy decision, and the best-scoring setup is also the most exposed. Teams deploying on-device agents can pick a collaboration mode based on edge model size: route execution to the cloud for small models, use cloud advisory for 9B-class ones. The comparison against Tsinghua-affiliated GLM-5.3 makes the findings directly applicable to Chinese open-source model stacks.

OpenBMB@OpenBMBSource