FDE-Gym Benchmarks Agents as Forward-Deployed Engineers
The main failure mode is missing unstated constraints, which suggests conversational skill and requirement discovery matter more than coding ability for delivery-style agent work. Builders evaluating agent stacks can use the benchmark's penalty scheme to weigh interaction cost against task success. It offers a more realistic yardstick than static coding benchmarks like SWE-bench for teams deploying agents in client-facing settings.
