Skip to content

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

fix(api): accept is set / is not set in eval rule stringObject filter type (#18404)

Niklas Semmleraaad55c89c5b
diff --git a/fern/apis/server/definition/evaluation-commons.yml b/fern/apis/server/definition/evaluation-commons.yml
index 33b26daf57..31b3c0bc45 100644
--- a/fern/apis/server/definition/evaluation-commons.yml
+++ b/fern/apis/server/definition/evaluation-commons.yml
@@ -173,6 +173,23 @@ types:
- name: EndsWith
value: ends with
+ EvaluationRuleStringObjectFilterOperator:
+ enum:
+ - name: Equals
+ value: "="
+ - name: Contains
+ value: contains
+ - name: DoesNotContain
+ value: does not contain
+ - name: StartsWith
+ value: starts with
+ - name: EndsWith
+ value: ends with
+ - name: IsSet
+ value: is set
+ - name: IsNotSet
+ value: is not set
+
EvaluationRuleNumberFilterOperator:
enum:
- name: Equals
@@ -279,9 +296,11 @@ types:
type: string
docs: Top-level key inside the object-valued column to filter on.
operator:
- type: EvaluationRuleStringFilterOperator
+ type: EvaluationRuleStringObjectFilterOperator
+ docs: Use `is set` / `is not set` to filter on key presence.
value:
type: string
+ docs: Value to compare against. Ignored for `is set` / `is not set`; send `""`.
NumberObjectEvaluationRuleFilter:
properties:
diff --git a/web/public/generated/api/openapi.yml b/web/public/generated/api/openapi.yml
index 94184cddcf..cbd1941ca5 100644
--- a/web/public/generated/api/openapi.yml
+++ b/web/public/generated/api/openapi.yml
@@ -12194,6 +12194,17 @@ components:
- does not contain
- starts with
- ends with
+ EvaluationRuleStringObjectFilterOperator:
+ title: EvaluationRuleStringObjectFilterOperator
+ type: string
+ enum:
+ - '='
+ - contains
+ - does not contain
+ - starts with
+ - ends with
+ - is set
+ - is not set
EvaluationRuleNumberFilterOperator:
title: EvaluationRuleNumberFilterOperator
type: string
@@ -12326,9 +12337,13 @@ components:
type: string
description: Top-level key inside the object-valued column to filter on.
operator:
- $ref: '#/components/schemas/EvaluationRuleStringFilterOperator'
+ $ref: '#/components/schemas/EvaluationRuleStringObjectFilterOperator'
+ description: Use `is set` / `is not set` to filter on key presence.
value:
type: string
+ description: >-
+ Value to compare against. Ignored for `is set` / `is not set`; send
+ `""`.
required:
- column
- key