WorldOracle is a new benchmark introduced in a recent arXiv paper for evaluating action-conditioned world models (ACWMs) — models that predict future outcomes from a given initial observation and a sequence of low-level actions. The benchmark is designed to test these models against paired real-world executions, meaning the same initial observation and action sequence are run both in the model and in reality, allowing direct comparison.
The abstract states that WorldOracle is "specifically designed to evaluate action-conditioned world models against paired real-world executions." It emphasizes that the evaluation uses the same initial observation and low-level action sequence for both the model and the real-world execution. This pairing is intended to provide a rigorous test of how well ACWMs can anticipate actual outcomes.
Because the abstract is truncated, further details about the benchmark's scope, tasks, or results are not available in the source. The paper is listed as arXiv:2610.18826v2.