2026-09-24

Benchmark Tests AI Agents as FDEs

UPSTREAM TITLE: Trains but Doesn't Learn: A Post-Training Delivery Benchmark for LLM Agents as Forward-Deployed Engineers

SHORT SUMMARY: Researchers benchmarked frontier LLM agents and human engineers on governed, end-to-end post-training delivery tasks framed around the forward-deployed engineer role. They found that acceptance gates caught silent “trains but does not learn” failures, while human-plus-assistant teams retained a small judgment advantage over fully autonomous agents, suggesting governance matters more than whether the FDE seat is human or automated.

OUTLET: arXiv

LINK: https://arxiv.org/abs/2609.25237