Skip to content

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

NameLast commit date
..
robotwin_2_0_adjust_bottle-privileged
robotwin_2_0_adjust_bottle-standard
robotwin_2_0_beat_block_hammer-privileged
robotwin_2_0_beat_block_hammer-standard
robotwin_2_0_blocks_ranking_rgb-privileged
robotwin_2_0_blocks_ranking_rgb-standard
robotwin_2_0_blocks_ranking_size-privileged
robotwin_2_0_blocks_ranking_size-standard
robotwin_2_0_dump_bin_bigbin-privileged
robotwin_2_0_dump_bin_bigbin-standard
robotwin_2_0_grab_roller-privileged
robotwin_2_0_grab_roller-standard
robotwin_2_0_handover_block-privileged
robotwin_2_0_handover_block-standard
robotwin_2_0_handover_mic-privileged
robotwin_2_0_handover_mic-standard
robotwin_2_0_hanging_mug-privileged
robotwin_2_0_hanging_mug-standard
robotwin_2_0_lift_pot-privileged
robotwin_2_0_lift_pot-standard
robotwin_2_0_move_can_pot-privileged
robotwin_2_0_move_can_pot-standard
robotwin_2_0_move_pillbottle_pad-privileged
robotwin_2_0_move_pillbottle_pad-standard
robotwin_2_0_move_playingcard_away-privileged
robotwin_2_0_move_playingcard_away-standard
robotwin_2_0_move_stapler_pad-privileged
robotwin_2_0_move_stapler_pad-standard
robotwin_2_0_open_laptop-privileged
robotwin_2_0_open_laptop-standard
robotwin_2_0_open_microwave-privileged
robotwin_2_0_open_microwave-standard
robotwin_2_0_pick_diverse_bottles-privileged
robotwin_2_0_pick_diverse_bottles-standard
robotwin_2_0_pick_dual_bottles-privileged
robotwin_2_0_pick_dual_bottles-standard
robotwin_2_0_place_a2b_left-privileged
robotwin_2_0_place_a2b_left-standard
robotwin_2_0_place_a2b_right-privileged
robotwin_2_0_place_a2b_right-standard
robotwin_2_0_place_bread_basket-privileged
robotwin_2_0_place_bread_basket-standard
robotwin_2_0_place_bread_skillet-privileged
robotwin_2_0_place_bread_skillet-standard
robotwin_2_0_place_burger_fries-privileged
robotwin_2_0_place_burger_fries-standard
robotwin_2_0_place_can_basket-privileged
robotwin_2_0_place_can_basket-standard
robotwin_2_0_place_cans_plasticbox-privileged
robotwin_2_0_place_cans_plasticbox-standard
robotwin_2_0_place_container_plate-privileged
robotwin_2_0_place_container_plate-standard
robotwin_2_0_place_dual_shoes-privileged
robotwin_2_0_place_dual_shoes-standard
robotwin_2_0_place_empty_cup-privileged
robotwin_2_0_place_empty_cup-standard
robotwin_2_0_place_fan-privileged
robotwin_2_0_place_fan-standard
robotwin_2_0_place_mouse_pad-privileged
robotwin_2_0_place_mouse_pad-standard
robotwin_2_0_place_object_basket-privileged
robotwin_2_0_place_object_basket-standard
robotwin_2_0_place_object_scale-privileged
robotwin_2_0_place_object_scale-standard
robotwin_2_0_place_object_stand-privileged
robotwin_2_0_place_object_stand-standard
robotwin_2_0_place_phone_stand-privileged
robotwin_2_0_place_phone_stand-standard
robotwin_2_0_place_shoe-privileged
robotwin_2_0_place_shoe-standard
robotwin_2_0_press_stapler-privileged
robotwin_2_0_press_stapler-standard
robotwin_2_0_put_bottles_dustbin-privileged
robotwin_2_0_put_bottles_dustbin-standard
robotwin_2_0_rotate_qrcode-privileged
robotwin_2_0_rotate_qrcode-standard
robotwin_2_0_scan_object-privileged
robotwin_2_0_scan_object-standard
robotwin_2_0_shake_bottle_horizontally-privileged
robotwin_2_0_shake_bottle_horizontally-standard
robotwin_2_0_shake_bottle-privileged
robotwin_2_0_shake_bottle-standard
robotwin_2_0_stack_blocks_three-privileged
robotwin_2_0_stack_blocks_three-standard
robotwin_2_0_stack_blocks_two-privileged
robotwin_2_0_stack_blocks_two-standard
robotwin_2_0_stack_bowls_three-privileged
robotwin_2_0_stack_bowls_three-standard
robotwin_2_0_stack_bowls_two-privileged
robotwin_2_0_stack_bowls_two-standard
robotwin_2_0_stamp_seal-privileged
robotwin_2_0_stamp_seal-standard
robotwin_2_0_turn_switch-privileged
robotwin_2_0_turn_switch-standard
README.md