Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
robodojo-align-blocks-i00-privileged
robodojo-align-blocks-i00-standard
robodojo-arrange-largest-number-i00-privileged
robodojo-arrange-largest-number-i00-standard
robodojo-arrange-largest-number-random-i00-privileged
robodojo-arrange-largest-number-random-i00-standard
robodojo-build-tower-i00-privileged
robodojo-build-tower-i00-standard
robodojo-classify-objects-by-language-i00-privileged
robodojo-classify-objects-by-language-i00-standard
robodojo-classify-objects-i00-privileged
robodojo-classify-objects-i00-standard
robodojo-cover-blocks-i00-privileged
robodojo-cover-blocks-i00-standard
robodojo-deposit-coin-i00-privileged
robodojo-deposit-coin-i00-standard
robodojo-fasten-screws-i00-privileged
robodojo-fasten-screws-i00-standard
robodojo-fill-egg-holder-i00-privileged
robodojo-fill-egg-holder-i00-standard
robodojo-fill-pen-holder-i00-privileged
robodojo-fill-pen-holder-i00-standard
robodojo-fold-clothes-i00-standard
robodojo-fold-clothes-random-i00-standard
robodojo-general-pickup-i00-privileged
robodojo-general-pickup-i00-standard
robodojo-hang-mugs-i00-privileged
robodojo-hang-mugs-i00-standard
robodojo-hang-mugs-random-i00-privileged
robodojo-hang-mugs-random-i00-standard
robodojo-imitate-sorting-sequence-i00-privileged
robodojo-imitate-sorting-sequence-i00-standard
robodojo-insert-key-i00-privileged
robodojo-insert-key-i00-standard
robodojo-insert-tubes-i00-privileged
robodojo-insert-tubes-i00-standard
robodojo-make-kong-i00-privileged
robodojo-make-kong-i00-standard
robodojo-make-toast-i00-privileged
robodojo-make-toast-i00-standard
robodojo-make-toast-random-i00-standard
robodojo-match-and-pick-from-conveyor-i00-privileged
robodojo-match-and-pick-from-conveyor-i00-standard
robodojo-organize-table-i00-privileged
robodojo-organize-table-i00-standard
robodojo-pack-objects-into-box-i00-privileged
robodojo-pack-objects-into-box-i00-standard
robodojo-pack-objects-into-box-random-i00-privileged
robodojo-pack-objects-into-box-random-i00-standard
robodojo-pick-from-conveyor-by-image-i00-privileged
robodojo-pick-from-conveyor-by-image-i00-standard
robodojo-play-stacking-toy-i00-privileged
robodojo-play-stacking-toy-i00-standard
robodojo-play-tic-tac-toe-i00-privileged
robodojo-play-tic-tac-toe-i00-standard
robodojo-play-xylophone-i00-privileged
robodojo-play-xylophone-i00-standard
robodojo-plug-in-charger-i00-privileged
robodojo-plug-in-charger-i00-standard
robodojo-pour-balls-into-vase-i00-privileged
robodojo-pour-balls-into-vase-i00-standard
robodojo-pour-by-language-i00-standard
robodojo-pour-liquid-into-cup-i00-standard
robodojo-pour-liquid-into-cup-random-i00-standard
robodojo-press-by-number-i00-privileged
robodojo-press-by-number-i00-standard
robodojo-push-t-i00-privileged
robodojo-push-t-i00-standard
robodojo-push-t-random-i00-privileged
robodojo-push-t-random-i00-standard
robodojo-put-bottles-into-dustbin-i00-privileged
robodojo-put-bottles-into-dustbin-i00-standard
robodojo-solve-equation-i00-privileged
robodojo-solve-equation-i00-standard
robodojo-sort-nesting-dolls-by-size-i00-privileged
robodojo-sort-nesting-dolls-by-size-i00-standard
robodojo-sort-nesting-dolls-by-size-random-i00-privileged
robodojo-sort-nesting-dolls-by-size-random-i00-standard
robodojo-stack-blocks-by-language-i00-privileged
robodojo-stack-blocks-by-language-i00-standard
robodojo-stack-blocks-i00-privileged
robodojo-stack-blocks-i00-standard
robodojo-stack-blocks-random-i00-privileged
robodojo-stack-blocks-random-i00-standard
robodojo-stack-bowls-i00-privileged
robodojo-stack-bowls-i00-standard
robodojo-stack-bowls-random-i00-privileged
robodojo-stack-bowls-random-i00-standard
robodojo-store-laptop-and-headphones-i00-privileged
robodojo-store-laptop-and-headphones-i00-standard
robodojo-store-laptop-and-headphones-random-i00-privileged
robodojo-store-laptop-and-headphones-random-i00-standard
robodojo-store-tools-in-toolbox-i00-privileged
robodojo-store-tools-in-toolbox-i00-standard
robodojo-swap-blocks-i00-privileged
robodojo-swap-blocks-i00-standard
robodojo-swap-t-i00-privileged
robodojo-swap-t-i00-standard
robodojo-sweep-blocks-i00-privileged
robodojo-sweep-blocks-i00-standard
robodojo-sweep-blocks-random-i00-privileged
robodojo-sweep-blocks-random-i00-standard
README.md