Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
embodiedswe-assembly-allen-bolt-franka-osc-i00-privileged
embodiedswe-assembly-allen-bolt-franka-osc-i00-standard
embodiedswe-assembly-bulb-franka-osc-i00-privileged
embodiedswe-assembly-bulb-franka-osc-i00-standard
embodiedswe-assembly-ikea-table-bimanual-franka-osc-i00-privileged
embodiedswe-assembly-ikea-table-bimanual-franka-osc-i00-standard
embodiedswe-assembly-nut-thread-franka-osc-i00-privileged
embodiedswe-assembly-nut-thread-franka-osc-i00-standard
embodiedswe-assembly-pc-gpu-franka-osc-i00-privileged
embodiedswe-assembly-pc-gpu-franka-osc-i00-standard
embodiedswe-assembly-pc-gpu-ram-franka-osc-i00-privileged
embodiedswe-assembly-pc-gpu-ram-franka-osc-i00-standard
embodiedswe-assembly-pc-motherboard-franka-osc-i00-privileged
embodiedswe-assembly-pc-motherboard-franka-osc-i00-standard
embodiedswe-assembly-pc-ram-franka-osc-i00-privileged
embodiedswe-assembly-pc-ram-franka-osc-i00-standard
embodiedswe-assembly-so101-bimanual-franka-osc-i00-privileged
embodiedswe-assembly-so101-bimanual-franka-osc-i00-standard
embodiedswe-cutting-dice-franka-osc-i00-privileged
embodiedswe-cutting-dice-franka-osc-i00-standard
embodiedswe-cutting-slice-franka-osc-i00-privileged
embodiedswe-cutting-slice-franka-osc-i00-standard
embodiedswe-locomanip-box-to-bin-g1-loco-pink-ik-i00-privileged
embodiedswe-locomanip-box-to-bin-g1-loco-pink-ik-i00-standard
embodiedswe-locomanip-fruit-delivery-g1-loco-pink-ik-i00-privileged
embodiedswe-locomanip-fruit-delivery-g1-loco-pink-ik-i00-standard
embodiedswe-locomanip-wheel-carry-g1-loco-pink-ik-i00-privileged
embodiedswe-locomanip-wheel-carry-g1-loco-pink-ik-i00-standard
embodiedswe-packing-clear-organic-objects-g1-pink-ik-i00-privileged
embodiedswe-packing-clear-organic-objects-g1-pink-ik-i00-standard
embodiedswe-packing-egg-carton-g1-pink-ik-i00-privileged
embodiedswe-packing-egg-carton-g1-pink-ik-i00-standard
embodiedswe-packing-pen-holder-franka-osc-i00-privileged
embodiedswe-packing-pen-holder-franka-osc-i00-standard
embodiedswe-packing-tool-packing-franka-osc-i00-privileged
embodiedswe-packing-tool-packing-franka-osc-i00-standard
embodiedswe-puzzle-classify-objects-g1-pink-ik-i00-privileged
embodiedswe-puzzle-classify-objects-g1-pink-ik-i00-standard
embodiedswe-puzzle-coffee-franka-osc-i00-privileged
embodiedswe-puzzle-coffee-franka-osc-i00-standard
embodiedswe-puzzle-push-shapes-g1-pink-ik-i00-privileged
embodiedswe-puzzle-push-shapes-g1-pink-ik-i00-standard
embodiedswe-puzzle-spatula-franka-osc-i00-privileged
embodiedswe-puzzle-spatula-franka-osc-i00-standard
embodiedswe-puzzle-stack-blocks-g1-pink-ik-i00-privileged
embodiedswe-puzzle-stack-blocks-g1-pink-ik-i00-standard
embodiedswe-puzzle-syringe-bimanual-franka-osc-i00-privileged
embodiedswe-puzzle-syringe-bimanual-franka-osc-i00-standard
README.md