robotic scaffolding

disambiguating objects in the environment for robotic interaction

OBJECTIVE

Robonaut 2 is a highly dexterous humanoid robot, capable of performing simple, often repetitive, or especially dangerous tasks on the International Space Station (ISS). The task focused on the production of a user experience that would provide operators on the ground the ability to identify physical objects in the environment, and then instruct Robonaut 2 on how to interact with the objects to fulfill a certain task. In this instance, the use case was opening a box and extracting a smaller set of boxes.