A new arXiv preprint (2610.25111) examines how LLM agents handle discovery when experiments are costly and noisy. As model reasoning becomes cheaper, the physical experiment becomes the bottleneck. Each measurement returns a noisy reading, so a high value could signal a genuinely promising candidate or simply a lucky draw.
The study focuses on how agents allocate a fixed measurement budget. The abstract indicates that agents misallocate these measurements, though the full details are not yet available. The key tension is between exploring new candidates and confirming promising ones—a trade-off that becomes sharper when noise clouds every reading.
This work highlights a practical challenge for AI-driven science: even if an agent reasons well, it can waste scarce experimental resources by chasing noise or over-verifying weak leads. The preprint is an early release, so its conclusions have not yet been peer-reviewed.