Cortex把长程操作拆成32个标准动作，用开放数据自动训练，比纯VLA模型在Libero和RoboTwin上高3-4%，还能零样本做化学实验。
Cortex是一个双向对齐的体现代理框架，通过将操作子任务标准化为32个规范技能原语，并结合可执行性约束（如对象属性和轨迹可达性）自动标注4000+小时开源视频数据并生成30小时模拟数据。在Libero-long和RoboTwin基准上，Cortex分别比单一VLA模型提升3.1%和4.1%。其通用VLM与微调VLA结合，能零样本完成未见过的真实世界长程任务（如多阶段化学实验），而这单靠VLA微调无法实现。
Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation
While recent Vision-Language-Action (VLA) models show promise toward generalist manipulation policies, they struggle with long-horizon tasks due to their Markovian nature-relying solely on current observations. Hierarchical dual-system methods address this but suffer from a gap between high-level planning semantics and low-level execution kinematics. We introduce Cortex, a bidirectionally aligned embodied agent framework with a customized planning interface that conveys executable and tractable subtask plans from high-level VLM to low-level VLA. Specifically, we standardize manipulation subtasks into 32 canonical skill primitives and inject tractability principles, such as representative object attributes and improved trajectory reachability, into the data generation pipeline. This enables automatic annotation of over 4k hours of open-source video data and generation of 30 hours of simulation data. We further devise an event-balanced sampling strategy to construct training data for fine-tuning the framework to better handle planning ambiguity during subtask transitions, enhanced by carefully designed harness engineering from task contexts to skill constraints during inference. Both open-loop VLM and closed-loop system evaluations demonstrate Cortex's efficacy, e.g., it outperforms monolithic baselines by 3.1% on Libero-long and 4.1% on RoboTwin. Notably, Cortex's generalist VLM enables zero-shot completion of unseen real-world long-horizon tasks, such as multi-stage chemistry experiments, by simply combining with a fine-tuned VLA-a capability infeasible through VLA fine-tuning alone.