Handheld demonstration devices let humans show robots how to perform tasks, but conventional designs are cumbersome. They typically burden the hand with a wrist camera, cables, and a pose tracker such as SLAM, an IMU, a VR controller, or a fixed external camera.
A new preprint on arXiv proposes a simpler alternative: an electronics-free UMI glove that is observed by a single moving head camera. Because the glove itself carries no electronics, the hand is freed from extra hardware, and the head camera provides the necessary observation.
The approach could make data collection for robot learning more natural and less intrusive. The paper is a preprint, so it has not yet been peer-reviewed, but the idea of relying on a head camera alone may reduce the complexity of current demonstration systems.