Skip to content

The Postgres development platform. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.

feat(assistant): run 3 trials for Assistant evals in CI (#42510)

Matt Rossman851cc005456a
diff --git a/apps/studio/evals/assistant.eval.ts b/apps/studio/evals/assistant.eval.ts
index 9f069d54f51..32d48df4918 100644
--- a/apps/studio/evals/assistant.eval.ts
+++ b/apps/studio/evals/assistant.eval.ts
@@ -22,6 +22,7 @@ assert(process.env.OPENAI_API_KEY, 'OPENAI_API_KEY is not set')
Eval('Assistant', {
projectId: process.env.BRAINTRUST_PROJECT_ID,
+ trialCount: process.env.CI ? 3 : 1,
data: () => dataset,
task: async (input) => {
const result = await generateAssistantResponse({
diff --git a/turbo.json b/turbo.json
index 693483684b0..4f9364bc766 100644
--- a/turbo.json
+++ b/turbo.json
@@ -65,6 +65,7 @@
],
"env": [
"ANALYZE",
+ "CI",
"NEXT_PUBLIC_SUPPORT_API_URL",
"NEXT_PUBLIC_CONTENT_API_URL",
"NEXT_PUBLIC_BASE_PATH",