🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
TypeScript analyticsautogenevaluationlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
Entitlements
This feature allows to control for availability of features. Entitlements are managed on the organization level.
Concepts
Plan: A plan is a a tier of features. Eg.oss,cloud:pro,self-hosted:enterprise. They are managed inplans.ts.Entitlement: An entitlement is a feature that is available to a user. Eg.playground. They are managed inconstants/entitlements.ts.entitlements.tsalso includes the mapping of entitlements to plans.EntitlementLimit: An entitlement limit is a limit on the number of resources that can be created/used. Eg.annotation-queue-count. They are managed inconstants/entitlements.ts.
How it works
- Plan
- Cloud: added to the organization object on the JWT via NextAuth
- Self-hosted
- Added to JWT via NextAuth on
environmentasselfHostedInstancePlan - In addition, also added to the organization object on the JWT via NextAuth
- Available based on license key outside of TRPC apis and react hooks via
getSelfHostedInstancePlanServerSide
- Added to JWT via NextAuth on
- Use of plan
- Hook:
usePlan - Server side:
getOrganizationPlanServerSidebased on cloudConfig, orgetSelfHostedInstancePlanServerSidefor instance-level plan
- Hook:
- Use of Entitlements
- Client side: react hooks in
hooks.tsmake entitlements of current organization available to the components. - Server side:
hasEntitlement.tsandhasEntitlementLimit.tsallow to check for entitlements and entitlement limits given a session user object.
- Client side: react hooks in