VR Bimnaul Robot Arm Teleoperation

Visiting Scholar at BIG(CMU)

This figure illustrates our bimanual teleoperation setup that integrates real robots, RGB-D cameras, and a VR interface.

Remote Robot Workspace

  • Two robot arms operate in a shared workspace.
  • Calibrated RGB-D cameras capture the scene, streaming both video and point clouds in real time.

Virtual Environment

  • The workspace is reconstructed in a VR environment (Meta Quest 2).
  • The operator can observe the 3D scene with an immersive first-person view.

Operator

  • Using VR controllers, the operator directly manipulates the robot arms with two hands.
  • This allows precise and intuitive remote control as if the user were physically present.

Demo

References