近自主AI化学家用GPT-5.4改进关键药物合成反应

Average scores mask regression in self-improving systems: an agent can look better on a leaderboard while silently dropping tasks it once handled and inflating inference cost. Teams running GEPA, HyperAgents or similar prompt-optimisation pipelines should add per-task regression checks, cost tracking and held-out task evaluation before shipping an evolved harness. Engineering leads evaluating agent reliability for production deployments will find the re-testing protocol directly reusable as an evaluation checklist.

rohanpaul_ai@rohanpaul_aiSource

The practical shift is reframing skill screening: prompting the scanner LLM to look for missing human oversight outperforms framing the task as malware detection, both in recall and precision. Teams deploying agents that load shared skills should audit their SKILL.md files now and scope every "don't ask" instruction to a specific context like CI. This matters for anyone building on Claude, Codex or other agents that support skills.

rohanpaul_ai@rohanpaul_aiSource

The 6–7 month gap is a quantified benchmark of how quickly open-weight models absorb frontier-level cyber offensive capability, a metric security teams and policymakers can use to set review timelines. Chinese open-weight models closing in on US closed models is the notable trend here, relevant to anyone comparing model sourcing for security-sensitive workloads across ASEAN and beyond.

Official accountEpoch AI@EpochAIResearchSource