Most of what we know about human perception and cognition comes from carefully controlled but artificial lab tasks: static images on flat screens, sedentary observers, and responses reduced to button presses. A new preprint on arXiv argues that this approach may miss the richness of real-world behavior, and that extended reality (XR) could offer a more naturalistic alternative.
The authors describe XR—spanning virtual, augmented, and mixed reality—as a way to present immersive, three-dimensional stimuli while allowing participants to move and interact as they would in daily life. This could let researchers study brain and behavior in settings that are both experimentally controlled and ecologically valid.
But the paper also cautions that XR introduces its own obstacles, including technical limitations, potential discomfort for users, and the difficulty of interpreting the large, complex datasets these experiments generate. The review aims to map both the promise and the pitfalls, offering a roadmap for using XR to expand the scope of human neuroscience.