Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
embodied-olympics-match-badminton-duelrl-i01-privileged
embodied-olympics-match-badminton-duelrl-i01-realtime
embodied-olympics-match-badminton-duelrl-i01-standard
embodied-olympics-match-badminton-match-i04-privileged
embodied-olympics-match-badminton-match-i04-realtime
embodied-olympics-match-badminton-match-i04-standard
embodied-olympics-match-badminton-matchlow-i01-privileged
embodied-olympics-match-badminton-matchlow-i01-realtime
embodied-olympics-match-badminton-matchlow-i01-standard
embodied-olympics-match-fencing-bout-i02-privileged
embodied-olympics-match-fencing-bout-i02-standard
embodied-olympics-match-foosball-match-i01-privileged
embodied-olympics-match-foosball-match-i01-realtime
embodied-olympics-match-foosball-match-i01-standard
embodied-olympics-match-soccer-jointcpu-i01-privileged
embodied-olympics-match-soccer-jointcpu-i01-realtime
embodied-olympics-match-soccer-jointcpu-i01-standard
embodied-olympics-match-soccer-jointgpu-i01-privileged
embodied-olympics-match-soccer-jointgpu-i01-realtime
embodied-olympics-match-soccer-jointgpu-i01-standard
embodied-olympics-match-soccer-match-i00-privileged
embodied-olympics-match-soccer-match-i00-realtime
embodied-olympics-match-soccer-match-i00-standard
embodied-olympics-match-soccerssl-match-i01-privileged
embodied-olympics-match-soccerssl-match-i01-realtime
embodied-olympics-match-soccerssl-match-i01-standard
embodied-olympics-match-tabletennis-duelrl-i01-privileged
embodied-olympics-match-tabletennis-duelrl-i01-realtime
embodied-olympics-match-tabletennis-duelrl-i01-standard
embodied-olympics-match-tabletennis-match-i04-privileged
embodied-olympics-match-tabletennis-match-i04-realtime
embodied-olympics-match-tabletennis-match-i04-standard
embodied-olympics-match-tabletennis-matchlow-i01-privileged
embodied-olympics-match-tabletennis-matchlow-i01-realtime
embodied-olympics-match-tabletennis-matchlow-i01-standard
embodied-olympics-match-tabletennisg1-matchcpu-i01-privileged
embodied-olympics-match-tabletennisg1-matchcpu-i01-realtime
embodied-olympics-match-tabletennisg1-matchcpu-i01-standard
embodied-olympics-match-tabletennisg1-matchgpu-i01-privileged
embodied-olympics-match-tabletennisg1-matchgpu-i01-realtime
embodied-olympics-match-tabletennisg1-matchgpu-i01-standard
README.md