Google Cloud AI Research Releases PLE Engineering Agent Benchmark
Most existing engineering benchmarks are textbook QA or toy design problems that leading agents already saturate, so PLE measures the harder step from passing exams to producing work a licensed professional would accept. The 50.6% ceiling plus 27M tokens and 63 minutes per task gives teams concrete cost-versus-capability data for deploying agents on real engineering workloads. Anyone evaluating agent harnesses or building domain-specific benchmarks can reuse its Creator-Solver task-generation pipeline.
