A recent arXiv preprint, "Agents' Last Exam," highlights a persistent disconnect: AI systems excel on benchmarks yet have not achieved economically meaningful deployment across many professional domains. The authors argue that this gap is largely due to a factor that the abstract does not fully specify in the available text.
The paper's title suggests a focus on evaluating AI agents, possibly proposing a new exam or framework. However, the abstract excerpt provided stops mid-sentence, so the specific mechanism or proposed solution is not available from this source.
The preprint is listed as a replacement (v3), indicating it has been revised. Readers interested in the full argument would need to consult the paper directly.