Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
robocasa-gr1-bottle-to-cabinet-close-i00-privileged
robocasa-gr1-bottle-to-cabinet-close-i00-standard
robocasa-gr1-can-to-drawer-close-i00-privileged
robocasa-gr1-can-to-drawer-close-i00-standard
robocasa-gr1-cup-to-drawer-close-i00-privileged
robocasa-gr1-cup-to-drawer-close-i00-standard
robocasa-gr1-cuttingboard-to-basket-i00-privileged
robocasa-gr1-cuttingboard-to-basket-i00-standard
robocasa-gr1-cuttingboard-to-cardboardbox-i00-privileged
robocasa-gr1-cuttingboard-to-cardboardbox-i00-standard
robocasa-gr1-cuttingboard-to-pan-i00-privileged
robocasa-gr1-cuttingboard-to-pan-i00-standard
robocasa-gr1-cuttingboard-to-pot-i00-privileged
robocasa-gr1-cuttingboard-to-pot-i00-standard
robocasa-gr1-cuttingboard-to-tieredbasket-i00-privileged
robocasa-gr1-cuttingboard-to-tieredbasket-i00-standard
robocasa-gr1-milk-to-microwave-close-i00-privileged
robocasa-gr1-milk-to-microwave-close-i00-standard
robocasa-gr1-placemat-to-basket-i00-privileged
robocasa-gr1-placemat-to-basket-i00-standard
robocasa-gr1-placemat-to-bowl-i00-privileged
robocasa-gr1-placemat-to-bowl-i00-standard
robocasa-gr1-placemat-to-plate-i00-privileged
robocasa-gr1-placemat-to-plate-i00-standard
robocasa-gr1-placemat-to-tieredshelf-i00-privileged
robocasa-gr1-placemat-to-tieredshelf-i00-standard
robocasa-gr1-plate-to-bowl-i00-privileged
robocasa-gr1-plate-to-bowl-i00-standard
robocasa-gr1-plate-to-cardboardbox-i00-privileged
robocasa-gr1-plate-to-cardboardbox-i00-standard
robocasa-gr1-plate-to-pan-i00-privileged
robocasa-gr1-plate-to-pan-i00-standard
robocasa-gr1-plate-to-plate-i00-privileged
robocasa-gr1-plate-to-plate-i00-standard
robocasa-gr1-potato-to-microwave-close-i00-privileged
robocasa-gr1-potato-to-microwave-close-i00-standard
robocasa-gr1-tray-to-cardboardbox-i00-privileged
robocasa-gr1-tray-to-cardboardbox-i00-standard
robocasa-gr1-tray-to-plate-i00-privileged
robocasa-gr1-tray-to-plate-i00-standard
robocasa-gr1-tray-to-pot-i00-privileged
robocasa-gr1-tray-to-pot-i00-standard
robocasa-gr1-tray-to-tieredbasket-i00-privileged
robocasa-gr1-tray-to-tieredbasket-i00-standard
robocasa-gr1-tray-to-tieredshelf-i00-privileged
robocasa-gr1-tray-to-tieredshelf-i00-standard
robocasa-gr1-wine-to-cabinet-close-i00-privileged
robocasa-gr1-wine-to-cabinet-close-i00-standard
README.md