Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
dextoolbench_brush_blue_brush_sweep_forward-privileged
dextoolbench_brush_blue_brush_sweep_forward-standard
dextoolbench_brush_red_brush_sweep_forward-privileged
dextoolbench_brush_red_brush_sweep_forward-standard
dextoolbench_brush_red_brush_sweep_right-privileged
dextoolbench_brush_red_brush_sweep_right-standard
dextoolbench_eraser_handle_eraser_wipe_c-privileged
dextoolbench_eraser_handle_eraser_wipe_c-standard
dextoolbench_eraser_handle_eraser_wipe_smile-privileged
dextoolbench_eraser_handle_eraser_wipe_smile-standard
dextoolbench_hammer_claw_hammer_swing_down-privileged
dextoolbench_hammer_claw_hammer_swing_down-standard
dextoolbench_hammer_claw_hammer_swing_side-privileged
dextoolbench_hammer_claw_hammer_swing_side-standard
dextoolbench_hammer_mallet_hammer_swing_down-privileged
dextoolbench_hammer_mallet_hammer_swing_down-standard
dextoolbench_hammer_mallet_hammer_swing_side-privileged
dextoolbench_hammer_mallet_hammer_swing_side-standard
dextoolbench_marker_sharpie_marker_draw_smile-privileged
dextoolbench_marker_sharpie_marker_draw_smile-standard
dextoolbench_marker_sharpie_marker_write_c-privileged
dextoolbench_marker_sharpie_marker_write_c-standard
dextoolbench_marker_staples_marker_draw_smile-privileged
dextoolbench_marker_staples_marker_draw_smile-standard
dextoolbench_marker_staples_marker_write_c-privileged
dextoolbench_marker_staples_marker_write_c-standard
dextoolbench_screwdriver_long_screwdriver_spin_horizontal-privileged
dextoolbench_screwdriver_long_screwdriver_spin_horizontal-standard
dextoolbench_screwdriver_long_screwdriver_spin_vertical-privileged
dextoolbench_screwdriver_long_screwdriver_spin_vertical-standard
dextoolbench_screwdriver_short_screwdriver_spin_horizontal-privileged
dextoolbench_screwdriver_short_screwdriver_spin_horizontal-standard
dextoolbench_screwdriver_short_screwdriver_spin_vertical-privileged
dextoolbench_screwdriver_short_screwdriver_spin_vertical-standard
dextoolbench_spatula_flat_spatula_flip_over-privileged
dextoolbench_spatula_flat_spatula_flip_over-standard
dextoolbench_spatula_flat_spatula_serve_plate-privileged
dextoolbench_spatula_flat_spatula_serve_plate-standard
dextoolbench_spatula_spoon_spatula_flip_over-privileged
dextoolbench_spatula_spoon_spatula_flip_over-standard
dextoolbench_spatula_spoon_spatula_serve_plate-privileged
dextoolbench_spatula_spoon_spatula_serve_plate-standard
README.md