Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
dexhand-assemble-hamburger-i00-privileged
dexhand-assemble-hamburger-i00-standard
dexhand-batter-whisk-i00-privileged
dexhand-batter-whisk-i00-standard
dexhand-bicycle-pump-stroke-i00-privileged
dexhand-bicycle-pump-stroke-i00-standard
dexhand-binder-page-load-i00-privileged
dexhand-binder-page-load-i00-standard
dexhand-book-page-turn-i00-privileged
dexhand-book-page-turn-i00-standard
dexhand-boot-sole-brush-i00-privileged
dexhand-boot-sole-brush-i00-standard
dexhand-coffee-stir-i00-privileged
dexhand-coffee-stir-i00-standard
dexhand-drying-rack-unfold-i00-privileged
dexhand-drying-rack-unfold-i00-standard
dexhand-envelope-letter-insert-i00-privileged
dexhand-envelope-letter-insert-i00-standard
dexhand-essential-cube-layer-i00-privileged
dexhand-essential-cube-layer-i00-standard
dexhand-essential-cube-reorient-i00-privileged
dexhand-essential-cube-reorient-i00-standard
dexhand-essential-held-joystick-i00-privileged
dexhand-essential-held-joystick-i00-standard
dexhand-essential-pen-regrasp-i00-privileged
dexhand-essential-pen-regrasp-i00-standard
dexhand-essential-rotary-gait-i00-privileged
dexhand-essential-rotary-gait-i00-standard
dexhand-essential-two-object-i00-privileged
dexhand-essential-two-object-i00-standard
dexhand-fan-guard-install-i00-privileged
dexhand-fan-guard-install-i00-standard
dexhand-grinder-crank-i00-privileged
dexhand-grinder-crank-i00-standard
dexhand-jar-lid-open-i00-privileged
dexhand-jar-lid-open-i00-standard
dexhand-pancake-serve-i00-privileged
dexhand-pancake-serve-i00-standard
dexhand-paper-half-fold-i00-privileged
dexhand-paper-half-fold-i00-standard
dexhand-paper-staple-i00-privileged
dexhand-paper-staple-i00-standard
dexhand-picture-hang-i00-privileged
dexhand-picture-hang-i00-standard
dexhand-pot-shelf-transfer-i00-privileged
dexhand-pot-shelf-transfer-i00-standard
dexhand-ram-module-install-i00-privileged
dexhand-ram-module-install-i00-standard
dexhand-remote-battery-swap-i00-privileged
dexhand-remote-battery-swap-i00-standard
dexhand-stool-brace-insert-i00-privileged
dexhand-stool-brace-insert-i00-standard
dexhand-sweep-dustpan-i00-privileged
dexhand-sweep-dustpan-i00-standard
dexhand-tray-glass-carry-i00-privileged
dexhand-tray-glass-carry-i00-standard
dexhand-usb-plug-insert-i00-privileged
dexhand-usb-plug-insert-i00-standard
dexhand-vacuum-bin-reseat-i00-privileged
dexhand-vacuum-bin-reseat-i00-standard
README.md