Skip to content

armgit / eve

Public Imported from GitHub
0

The Open Framework for Building Agents

test(eve): de-flake hitl/ask-question-select confirmation assertion (#895)

prha51ba0c56ea35
diff --git a/e2e/fixtures/agent-tools-hitl/evals/hitl/ask-question-select.eval.ts b/e2e/fixtures/agent-tools-hitl/evals/hitl/ask-question-select.eval.ts
index ab6406499..fc45c3dde 100644
--- a/e2e/fixtures/agent-tools-hitl/evals/hitl/ask-question-select.eval.ts
+++ b/e2e/fixtures/agent-tools-hitl/evals/hitl/ask-question-select.eval.ts
@@ -14,6 +14,7 @@ export default defineEval({
"Set prompt to: 'Pick a color.'",
'Provide exactly two options: - id "red", label "Red" - id "blue", label "Blue"',
"Do not answer the question yourself, wait for my response.",
+ "After I respond, reply confirming the color I chose by name.",
].join("\n"),
);