🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
fix(api): accept is set / is not set in eval rule stringObject filter type (#18404)
Niklas Semmleraaad55c89c5b
diff --git a/fern/apis/server/definition/evaluation-commons.yml b/fern/apis/server/definition/evaluation-commons.ymlindex 33b26daf57..31b3c0bc45 100644--- a/fern/apis/server/definition/evaluation-commons.yml+++ b/fern/apis/server/definition/evaluation-commons.yml@@ -173,6 +173,23 @@ types:- name: EndsWithvalue: ends with+ EvaluationRuleStringObjectFilterOperator:+ enum:+ - name: Equals+ value: "="+ - name: Contains+ value: contains+ - name: DoesNotContain+ value: does not contain+ - name: StartsWith+ value: starts with+ - name: EndsWith+ value: ends with+ - name: IsSet+ value: is set+ - name: IsNotSet+ value: is not set+EvaluationRuleNumberFilterOperator:enum:- name: Equals@@ -279,9 +296,11 @@ types:type: stringdocs: Top-level key inside the object-valued column to filter on.operator:- type: EvaluationRuleStringFilterOperator+ type: EvaluationRuleStringObjectFilterOperator+ docs: Use `is set` / `is not set` to filter on key presence.value:type: string+ docs: Value to compare against. Ignored for `is set` / `is not set`; send `""`.NumberObjectEvaluationRuleFilter:properties:diff --git a/web/public/generated/api/openapi.yml b/web/public/generated/api/openapi.ymlindex 94184cddcf..cbd1941ca5 100644--- a/web/public/generated/api/openapi.yml+++ b/web/public/generated/api/openapi.yml@@ -12194,6 +12194,17 @@ components:- does not contain- starts with- ends with+ EvaluationRuleStringObjectFilterOperator:+ title: EvaluationRuleStringObjectFilterOperator+ type: string+ enum:+ - '='+ - contains+ - does not contain+ - starts with+ - ends with+ - is set+ - is not setEvaluationRuleNumberFilterOperator:title: EvaluationRuleNumberFilterOperatortype: string@@ -12326,9 +12337,13 @@ components:type: stringdescription: Top-level key inside the object-valued column to filter on.operator:- $ref: '#/components/schemas/EvaluationRuleStringFilterOperator'+ $ref: '#/components/schemas/EvaluationRuleStringObjectFilterOperator'+ description: Use `is set` / `is not set` to filter on key presence.value:type: string+ description: >-+ Value to compare against. Ignored for `is set` / `is not set`; send+ `""`.required:- column- key