Two new benchmarks focus on video understanding. AgentVidBench (arXiv:2609.21386) targets multi-hop video question answering, requiring MLLM agents to reason across multiple video segments. VidOmni-Bench (arXiv:2609.21521) instead emphasizes fine-grained spatio-temporal event verification, testing models on precise details across varying complexity and duration. Both agree that existing video benchmarks are insufficient, but they differ in approach: AgentVidBench stresses multi-step reasoning, while VidOmni-Bench stresses fine-grained verification.
In a different domain, PolyBridgeBench (arXiv:2609.21493) evaluates multimodal LLMs on physics-grounded bridge design. The authors argue that strong visual understanding and structured generation do not guarantee that a design will actually work when built. This benchmark likely requires models to produce structurally sound designs, moving beyond typical visual QA.
The fourth paper, "Verify, Don't Trust" (arXiv:2609.21257), is not a benchmark but a proposal for agentic model development. It suggests that LLM agents should verify their own outputs through iterative loops, applied here to video discovery retrieval at scale. This aligns with the verification theme in VidOmni-Bench, but it is broader in scope, focusing on autonomous model improvement rather than evaluation.
Taken together, these papers signal a shift toward more rigorous, operational testing of multimodal LLMs—whether in video reasoning or physical design—and highlight the need for verification mechanisms beyond simple accuracy metrics.