Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
metaworldplus-assembly-i00-privileged
metaworldplus-assembly-i00-standard
metaworldplus-basketball-i00-privileged
metaworldplus-basketball-i00-standard
metaworldplus-bin-picking-i00-privileged
metaworldplus-bin-picking-i00-standard
metaworldplus-box-close-i00-privileged
metaworldplus-box-close-i00-standard
metaworldplus-button-press-i00-privileged
metaworldplus-button-press-i00-standard
metaworldplus-button-press-topdown-i00-privileged
metaworldplus-button-press-topdown-i00-standard
metaworldplus-button-press-topdown-wall-i00-privileged
metaworldplus-button-press-topdown-wall-i00-standard
metaworldplus-button-press-wall-i00-privileged
metaworldplus-button-press-wall-i00-standard
metaworldplus-coffee-button-i00-privileged
metaworldplus-coffee-button-i00-standard
metaworldplus-coffee-pull-i00-privileged
metaworldplus-coffee-pull-i00-standard
metaworldplus-coffee-push-i00-privileged
metaworldplus-coffee-push-i00-standard
metaworldplus-dial-turn-i00-privileged
metaworldplus-dial-turn-i00-standard
metaworldplus-disassemble-i00-privileged
metaworldplus-disassemble-i00-standard
metaworldplus-door-close-i00-privileged
metaworldplus-door-close-i00-standard
metaworldplus-door-lock-i00-privileged
metaworldplus-door-lock-i00-standard
metaworldplus-door-open-i00-privileged
metaworldplus-door-open-i00-standard
metaworldplus-door-unlock-i00-privileged
metaworldplus-door-unlock-i00-standard
metaworldplus-drawer-close-i00-privileged
metaworldplus-drawer-close-i00-standard
metaworldplus-drawer-open-i00-privileged
metaworldplus-drawer-open-i00-standard
metaworldplus-faucet-close-i00-privileged
metaworldplus-faucet-close-i00-standard
metaworldplus-faucet-open-i00-privileged
metaworldplus-faucet-open-i00-standard
metaworldplus-hammer-i00-privileged
metaworldplus-hammer-i00-standard
metaworldplus-hand-insert-i00-privileged
metaworldplus-hand-insert-i00-standard
metaworldplus-handle-press-i00-privileged
metaworldplus-handle-press-i00-standard
metaworldplus-handle-press-side-i00-privileged
metaworldplus-handle-press-side-i00-standard
metaworldplus-handle-pull-i00-privileged
metaworldplus-handle-pull-i00-standard
metaworldplus-handle-pull-side-i00-privileged
metaworldplus-handle-pull-side-i00-standard
metaworldplus-lever-pull-i00-privileged
metaworldplus-lever-pull-i00-standard
metaworldplus-peg-insert-side-i00-privileged
metaworldplus-peg-insert-side-i00-standard
metaworldplus-peg-unplug-side-i00-privileged
metaworldplus-peg-unplug-side-i00-standard
metaworldplus-pick-out-of-hole-i00-privileged
metaworldplus-pick-out-of-hole-i00-standard
metaworldplus-pick-place-i00-privileged
metaworldplus-pick-place-i00-standard
metaworldplus-pick-place-wall-i00-privileged
metaworldplus-pick-place-wall-i00-standard
metaworldplus-plate-slide-back-i00-privileged
metaworldplus-plate-slide-back-i00-standard
metaworldplus-plate-slide-back-side-i00-privileged
metaworldplus-plate-slide-back-side-i00-standard
metaworldplus-plate-slide-i00-privileged
metaworldplus-plate-slide-i00-standard
metaworldplus-plate-slide-side-i00-privileged
metaworldplus-plate-slide-side-i00-standard
metaworldplus-push-back-i00-privileged
metaworldplus-push-back-i00-standard
metaworldplus-push-i00-privileged
metaworldplus-push-i00-standard
metaworldplus-push-wall-i00-privileged
metaworldplus-push-wall-i00-standard
metaworldplus-reach-i00-privileged
metaworldplus-reach-i00-standard
metaworldplus-reach-wall-i00-privileged
metaworldplus-reach-wall-i00-standard
metaworldplus-shelf-place-i00-privileged
metaworldplus-shelf-place-i00-standard
metaworldplus-soccer-i00-privileged
metaworldplus-soccer-i00-standard
metaworldplus-stick-pull-i00-privileged
metaworldplus-stick-pull-i00-standard
metaworldplus-stick-push-i00-privileged
metaworldplus-stick-push-i00-standard
metaworldplus-sweep-i00-privileged
metaworldplus-sweep-i00-standard
metaworldplus-sweep-into-i00-privileged
metaworldplus-sweep-into-i00-standard
metaworldplus-window-close-i00-privileged
metaworldplus-window-close-i00-standard
metaworldplus-window-open-i00-privileged
metaworldplus-window-open-i00-standard
README.md