Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

549 B
Raw Blame
# The Embodied Safety Exam source pin and version (its release tag v0.5.6); images/ese/VERSION is the image tag.
ESE_COMMIT=64de8bc60418e3653b57b919998089406ae1910d
ESE_VERSION=0.5.6
# MuJoCo Menagerie, public: the robot models Embodied Safety Exam vendors are byte-for-byte copies of this commit
# (Embodied Safety Exam assets/third_party/README.md); the image takes them from here and checks context/menagerie.sha256.
MENAGERIE_REPO=https://github.com/google-deepmind/mujoco_menagerie.git
MENAGERIE_COMMIT=0059d4335f8156206f63a35662313385f7ad6d74