Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
maniguard-cabinet-pickup-i19-privileged
maniguard-cabinet-pickup-i19-standard
maniguard-cabinet-pickup-i20-privileged
maniguard-cabinet-pickup-i20-standard
maniguard-cabinet-pickup-i22-privileged
maniguard-cabinet-pickup-i22-standard
maniguard-cabinet-pickup-i26-privileged
maniguard-cabinet-pickup-i26-standard
maniguard-cabinet-pickup-i29-privileged
maniguard-cabinet-pickup-i29-standard
maniguard-clutter-pickup-i09-privileged
maniguard-clutter-pickup-i09-standard
maniguard-clutter-pickup-i15-privileged
maniguard-clutter-pickup-i15-standard
maniguard-clutter-pickup-i23-privileged
maniguard-clutter-pickup-i23-standard
maniguard-clutter-pickup-i25-privileged
maniguard-clutter-pickup-i25-standard
maniguard-clutter-pickup-i28-privileged
maniguard-clutter-pickup-i28-standard
maniguard-dusty-transfer-i03-privileged
maniguard-dusty-transfer-i03-standard
maniguard-dusty-transfer-i16-privileged
maniguard-dusty-transfer-i16-standard
maniguard-dusty-transfer-i20-privileged
maniguard-dusty-transfer-i20-standard
maniguard-dusty-transfer-i24-privileged
maniguard-dusty-transfer-i24-standard
maniguard-dusty-transfer-i25-privileged
maniguard-dusty-transfer-i25-standard
maniguard-jar-transport-i02-privileged
maniguard-jar-transport-i02-standard
maniguard-jar-transport-i09-privileged
maniguard-jar-transport-i09-standard
maniguard-jar-transport-i13-privileged
maniguard-jar-transport-i13-standard
maniguard-jar-transport-i14-privileged
maniguard-jar-transport-i14-standard
maniguard-jar-transport-i25-privileged
maniguard-jar-transport-i25-standard
maniguard-lid-transport-i06-privileged
maniguard-lid-transport-i06-standard
maniguard-lid-transport-i07-privileged
maniguard-lid-transport-i07-standard
maniguard-lid-transport-i12-privileged
maniguard-lid-transport-i12-standard
maniguard-lid-transport-i15-privileged
maniguard-lid-transport-i15-standard
maniguard-lid-transport-i16-privileged
maniguard-lid-transport-i16-standard
maniguard-stack-retrieve-i08-privileged
maniguard-stack-retrieve-i08-standard
maniguard-stack-retrieve-i10-privileged
maniguard-stack-retrieve-i10-standard
maniguard-stack-retrieve-i12-privileged
maniguard-stack-retrieve-i12-standard
maniguard-stack-retrieve-i13-privileged
maniguard-stack-retrieve-i13-standard
maniguard-stack-retrieve-i21-privileged
maniguard-stack-retrieve-i21-standard
README.md