Your hands drive the mocap targets of the same MuJoCo scene the policies train in.
Holdspace while you want the arms to follow · pinch thumb–index to close a gripper · your video stays in the browser.
SPACE
Connecting…
Hold space (or press and hold this bar) while the arms should follow your hands.
Release to move your hand back, hold again to continue.
Recording & research data notice
With recording enabled, every stretch of driving is saved automatically for robotics
research — the simulated arm trajectories, which object you handled, and how far the handoff
got. Recording starts when you take control and stops when you pause, reset, or leave; idle
time with the page open is never stored. To understand data quality we also keep basic
technical context (browser/OS, screen size, webcam resolution, tracking frame rate) and an
estimated location (country/region-level).
Your webcam video never leaves your browser — only hand landmarks are used, locally.
No account, no cookies, no raw IP address is stored; sessions get a random ID.
Allow the webcam and show one or two hands. Your right hand drives the right arm,
left hand the left arm.
Hold space — don't tap it. The arms only follow while it's held (the bar
above turns green). Release to bring your hand back to a comfortable spot, hold again to
continue from where the arm is — like a clutch.
Left/right and up/down follow your hand; move toward or away from the camera for
depth (into / out of the scene).
Pinch thumb and index finger to close that gripper; open your hand to release.
Pick the object up with the right arm, carry it above the table to the left gripper, close
the left, then open the right — that's a complete handoff.
Recording is automatic once enabled: each stretch of driving is saved when you pause,
reset, or leave — idle time is never recorded. Every episode is re-scored later by replaying it.
No webcam? Autopilot runs the scripted expert through the same pipe (not recorded).