NASA uses Kinect, Oculus Rift to control robot arm

NASA’s foray into the gaming world might not be what you’d expect. Researchers are now using the Xbox One sensor and an Oculus Rift to control a robot arm in real time.

Manipulation works by combing position tracking from the Kinect with the Oculus Rift’s rotational tracking and first-person perspective. In the video, which you can watch above, the user is able to pick up a block virtually, which in turn translates to the real-life robot arm.

The video also shows off a potential application of the technology: robonauts in space stations. NASA eventually hopes to integrate sensor array data to humanoid robots on the International Space Station.