Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
robopaint-acrylic-applesoranges-i00-privileged
robopaint-acrylic-applesoranges-i00-standard
robopaint-acrylic-bedroom-i00-privileged
robopaint-acrylic-bedroom-i00-standard
robopaint-acrylic-bluehorses-i00-privileged
robopaint-acrylic-bluehorses-i00-standard
robopaint-acrylic-greatwave-i00-privileged
robopaint-acrylic-greatwave-i00-standard
robopaint-acrylic-kajikazawa-i00-privileged
robopaint-acrylic-kajikazawa-i00-standard
robopaint-acrylic-plumpark-i00-privileged
robopaint-acrylic-plumpark-i00-standard
robopaint-acrylic-redfuji-i00-privileged
robopaint-acrylic-redfuji-i00-standard
robopaint-acrylic-suddenshower-i00-privileged
robopaint-acrylic-suddenshower-i00-standard
robopaint-acrylic-sunflowers-i00-privileged
robopaint-acrylic-sunflowers-i00-standard
robopaint-acrylic-vision-i00-privileged
robopaint-acrylic-vision-i00-standard
robopaint-caoshu-beiquelindanshui-i00-privileged
robopaint-caoshu-beiquelindanshui-i00-standard
robopaint-caoshu-nangong-i00-privileged
robopaint-caoshu-nangong-i00-standard
robopaint-caoshu-siwushaonian-i00-privileged
robopaint-caoshu-siwushaonian-i00-standard
robopaint-caoshu-wen-i00-privileged
robopaint-caoshu-wen-i00-standard
robopaint-caoshu-zhen-i00-privileged
robopaint-caoshu-zhen-i00-standard
robopaint-caoshu-zhongtiangechuifen-i00-privileged
robopaint-caoshu-zhongtiangechuifen-i00-standard
robopaint-kaishu-linfengguilong-i00-privileged
robopaint-kaishu-linfengguilong-i00-standard
robopaint-kaishu-yongzibafa-i00-privileged
robopaint-kaishu-yongzibafa-i00-standard
robopaint-lettering-aim-i00-privileged
robopaint-lettering-aim-i00-standard
robopaint-lettering-business-i00-privileged
robopaint-lettering-business-i00-standard
robopaint-lettering-commendation-i00-privileged
robopaint-lettering-commendation-i00-standard
robopaint-lettering-diligence-i00-privileged
robopaint-lettering-diligence-i00-standard
robopaint-lettering-liberty-i00-privileged
robopaint-lettering-liberty-i00-standard
robopaint-lettering-virtue-i00-privileged
robopaint-lettering-virtue-i00-standard
robopaint-oil-bathers-i01-privileged
robopaint-oil-bathers-i01-standard
robopaint-oil-cafeterrace-i01-privileged
robopaint-oil-cafeterrace-i01-standard
robopaint-oil-cypresses-i01-privileged
robopaint-oil-cypresses-i01-standard
robopaint-oil-irises-i01-privileged
robopaint-oil-irises-i01-standard
robopaint-oil-milkmaid-i01-privileged
robopaint-oil-milkmaid-i01-standard
robopaint-oil-monalisa-i01-privileged
robopaint-oil-monalisa-i01-standard
robopaint-oil-pearlearring-i01-privileged
robopaint-oil-pearlearring-i01-standard
robopaint-oil-saintevictoire-i01-privileged
robopaint-oil-saintevictoire-i01-standard
robopaint-oil-starrynight-i01-privileged
robopaint-oil-starrynight-i01-standard
robopaint-oil-temeraire-i01-privileged
robopaint-oil-temeraire-i01-standard
robopaint-oil-wanderer-i01-privileged
robopaint-oil-wanderer-i01-standard
robopaint-xingshu-feng-i00-privileged
robopaint-xingshu-feng-i00-standard
robopaint-xingshu-he-i00-privileged
robopaint-xingshu-he-i00-standard
robopaint-xingshu-huifenghechang-i00-privileged
robopaint-xingshu-huifenghechang-i00-standard
robopaint-xingshu-maolinxiuzhu-i00-privileged
robopaint-xingshu-maolinxiuzhu-i00-standard
robopaint-xingshu-nian-i00-privileged
robopaint-xingshu-nian-i00-standard
robopaint-xingshu-shan-i00-privileged
robopaint-xingshu-shan-i00-standard
robopaint-xingshu-xian-i00-privileged
robopaint-xingshu-xian-i00-standard
robopaint-xingshu-yong-i00-privileged
robopaint-xingshu-yong-i00-standard
README.md
robopaint-sweep-boundary.png