:hedgehog: PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, flags, experiments, error tracking, logs, and more – capture all the context agents need to diagnose problems, uncover opportunities, and ship fixes. Steer it all from Slack, web, desktop, or the MCP.
Python ab-testingai-analyticsanalyticscdpdata-warehouseexperimentsfeature-flagsjavascriptproduct-analyticspythonreactsession-replaysurveystypescriptweb-analytics
feat(aio): add evaluation authors and compare scorer versions (#120400)
Radu Raicea194e93d115b5
diff --git a/docs/internal/ai-offline-evaluation-reporting.md b/docs/internal/ai-offline-evaluation-reporting.mdindex 639ed24726d2..3bfc4f287e40 100644--- a/docs/internal/ai-offline-evaluation-reporting.md+++ b/docs/internal/ai-offline-evaluation-reporting.md@@ -59,6 +59,17 @@ Provide the API key through the environment before running the suite:The publisher normalizes the cloud ingestion hosts (`us.i.posthog.com`, `eu.i.posthog.com`) and the legacy `app.posthog.com` host to their app origins.Uploads, result links, and trace-destination checks use that same origin.+Experiments submitted with a personal API key are attributed to that user. Project secret API key submissions+have no author. Attribution is recorded on the first accepted submission and stays unchanged on retries.+The offline evaluations overview shows the author and supports filtering experiments and score trends by author,+including experiments with no author. Choose "Any author" to clear the filter.+Scorer history includes the same author control, so filters carried from the overview remain visible and can be cleared.+API requests cannot combine `created_by` with `created_by_is_null=true`.+Each scorer chart displays the loaded versions with results in the selected date range and filters as separate series,+while the summary defaults to the latest matching version. The version arrows change only the summary.+Opening a scorer's history preserves the author and date filters and selects the version shown in the summary.+The scorer list shows each scorer's creator and last editor, and can be filtered by creator.+The SQL suite uses these existing scorers:| Metric name | Scorer kind |@@ -483,11 +494,11 @@ When no scores are selected, the overview selects up to three from recent compleThese choices are stored in local storage, scoped to the user and exact project/environment, and persist in that browser.Shared URL selections and dates take precedence for that view without replacing saved choices until the user saves a customization.The shared date picker supports presets, custom ranges, and all time.-History pages are bounded; the scorer history shows how many matching points are loaded.+History pages are bounded; each overview card loads at most five pages of 100 experiment/version results. The scorer history shows how many matching points are loaded.Overview cards show the loaded count and date span when history is incomplete, and explain that earlier experiments and scorer versions may not be shown.Different scorer versions retain their pinned configurations and are not averaged together.-Overview cards show one version at a time, with arrows to browse versions that have results in the selected period.-The card summary aggregates the loaded experiments in the selected period for the displayed scorer version, using the same history points as the chart.+Overview charts show each loaded scorer version as a separate series. Arrows browse version summaries without changing the chart.+The card summary aggregates the loaded experiments in the selected period for the selected scorer version, using the same history points as the chart. When history is partial, summaries cover only those loaded experiments.Numeric means are weighted by successful result counts; boolean and category rates pool their counts across successful results.Boolean charts show the passing rate, with true passing by default when polarity is omitted.Numeric charts keep the mean as their primary metric and show the configured threshold with faint passing and failing regions. Series retain their identity colors.diff --git a/frontend/snapshots.yml b/frontend/snapshots.ymlindex 66ceb5eb14e3..1da70423f088 100644--- a/frontend/snapshots.yml+++ b/frontend/snapshots.yml@@ -113,17 +113,17 @@ snapshots:ai-observability-offline-experiments-score-trends--numeric-passing-rule--light:hash: v1.k794b7964.e5367e5503e0e7a14586290abedd1f8f25d9a938013d330a9b3783a9377e32cf.2SZhg6Ri2BlDEHtHrLx7RAbuPEUQFdP-D1FP3_tOPNIai-observability-offline-experiments-scorer-history--default--dark:- hash: v1.k794b7964.14c39caa03b5f3200fc4a373483c9d6aec17633da886479913ee3e645f8b0faf.bPbuMAy_65PZ_O4LdmGd2UGMiGwxeMdSrTKmiUYbNxo+ hash: v1.k794b7964.de382c36f53d24e416c8a816a1cf194c9ac751b5eebfc7a373932035fecc1acb._coWDzE6lvhhThqoT_ASaYs0iiqQvERpqiwT5KhGunMai-observability-offline-experiments-scorer-history--default--light:- hash: v1.k794b7964.35b64cad1671eff7ac28a2b3b882662a5419f228124694de71b6851b6010200e.LVKYx94Kh5oZ3iSPLEt4rWdNXqZ66_013u3uO7wskbk+ hash: v1.k794b7964.15cbf9e2bdbbe89d7661c94ccd15d7732d828f564add36cdc067757e03a4a061.A0kjkj1ghKYsLEpla_XwYBMETI7KMu6YOB5BCiLbaxAai-observability-offline-experiments-scorer-history--empty-history--dark:- hash: v1.k794b7964.631e591fcd1fc7328ea05d5a593b56a2fbbe62f1867bc411f68bf41065b4a93b.WDNsJdmbscjNrENw9efsmZyEaxzTI57uMxtS7npbkZA+ hash: v1.k794b7964.7fc63300ab3d7bf38a3058a285f6ecc6e36ffaae97b532deef09d13ed6cbafca.EaYco8jti78XKAqv4PEAm_z3n3MvWyTgBGVRhkVD5doai-observability-offline-experiments-scorer-history--empty-history--light:- hash: v1.k794b7964.c48d7913e25042e743bfed5f6600e90ecee8f3bea019bc3598d59d0c064976cd.Lr6rJSUjois9B9eB8NV6uXAW-YexL2k1akLNs-NNFeQ+ hash: v1.k794b7964.95f6a34d52a423471450e0a21f00dd8af7cfaf36281b07c02323b79d05e9fb3f.1cb98HkzcmAOIVK-QmbF1Yykej6T_sSVSuWGwRoUj-cai-observability-offline-experiments-scorer-history--narrow--dark:- hash: v1.k794b7964.3070c141e9ae22be387cf373c5009f759190aebb0351373a087a802dbf4dc55d.p9b0tC3ZgtzpMP0PA9wK3VUrKeWwYbbqiiho2JhKG3g+ hash: v1.k794b7964.2d60979cab1b756742b3fef740e8c13a9b688f3eca76ddf7ae73dc08f2f58e64.48EDAeGamPjXu5HwCBjlgx4Z6130i2a_6kqwJ25p9jwai-observability-offline-experiments-scorer-history--narrow--light:- hash: v1.k794b7964.9d4a48ec4eff9ac47c121596e3a06b49e0034137db5a9605d8f0ca4fefcbdb6b.--7F2o6VAfVCzDcKJZX49I9X3KQtFmtVVq5j4XhSJmg+ hash: v1.k794b7964.4842515b727957419dffc97a061cd561a640c5b3d12357415b2c6b0c0a5b2729.7EOWporG0PIqDbpe8ArXsT-fl8w_hNdckYUgKv4uHDYai-observability-scorer-editor--boolean-detector--dark:hash: v1.k794b7964.841ab07e56ee68448ba1df160d2365beed4eec6db48856b984488836ad4ce85f.91iF4r5RJZ81eQDCcoFWZ5N1JTo-dznWBBKCzTSJ-mMai-observability-scorer-editor--boolean-detector--light:@@ -177,21 +177,21 @@ snapshots:ai-observability-scorer-form--offline-disabled--light:hash: v1.k794b7964.2dc03d1322685e9016f63454a0a2966ae96614bf08802aa725ebc955af65feaf.J8cmghXsSZoVxurLs2npYwulIcvOVgODD2EKNauo1F4ai-observability-scorers--default--dark:- hash: v1.k794b7964.f0ba08e3e9ad197df10bcf2dce7b2853bfd60117933d18d0ffaca306ce5df629.RAqptUlrl4tbYQ0XqDSI8CCuOVcb4_1vbasWnew--wU+ hash: v1.k794b7964.105dd90df7f4dee687709720baa591c4922ca61230af6f69e986ed2639d968e6.TALgmDkTXEx3Dvid49CXQZeoJoqUH700GouwkLSLLZMai-observability-scorers--default--light:- hash: v1.k794b7964.9c497d39b156b13d881c197fe14a03525b9037cde4a921c03eda4c36eb2a5e11.iw-mCPWxoJ6hSDzHLlqtBAHNctGHmxr1v5MaKifwcrA+ hash: v1.k794b7964.4d0810a94533130a29145429df6b048fbc7a7fa71938d183677fb8c7b74b4af3.zs4r15SouBP9zbQYX7H00T9URFOWoQZMgN3jp8XLSioai-observability-scorers--empty--dark:- hash: v1.k794b7964.5b5af62b9fe9b1659a678b10ddfdd76f593516514eb704bb872139c6cfae3f4a.lmMiFwPSa3CHpm8QT5jDt1GeJNguXoYW0-LYpYIKriQ+ hash: v1.k794b7964.a6315f5111c58a9e719d05a7bd7388e4190771b6567760b10e2d403192fb7f47.PA7TFbjqzcvJC0mrhJAiTwXxvfaFMBijhkO8kW0xzBoai-observability-scorers--empty--light:- hash: v1.k794b7964.92cdcc6bf06c193e17213f5040145ba82bab8f782eea57a1a697968978b5c1f8.xHPj4oGYZZZ2NaKZeSMmEcag3UJ_jef1pmnwhTv6XRY+ hash: v1.k794b7964.afc91ff60397c14759f014fa0504d21622a3ecc31b0fdb411cf2ae8b6cd5531f.Y6GnUWQ3zTGZreML0AlH_jpkG0Cv-QQ2wVCZLsALk0oai-observability-scorers--narrow--dark:- hash: v1.k794b7964.173a1de2de884d9bd6ead01bd2af5dfd9d0ddda02e80309cc75604d630bafb1c.HCFNIirledijJvxMlusCruykulTTYYYw2PV1fqJIM4E+ hash: v1.k794b7964.072195b7ef69ebf55d6f111083b48eb5b74ae29b2c3664f9db1d79e27c741cd5.UJyx1IfMh79T08W9nsasxZMauUAxUEjatPDW0OFrCnkai-observability-scorers--narrow--light:- hash: v1.k794b7964.bb73fe202ff0046137d66db340be06b67dd7ce791912735b42bd73f237e68b96.WBBZKIWNOarewm8SehIR2kLnSnLPlVhgW9mAAIZxlFg+ hash: v1.k794b7964.0d1bb933147d7910f3f3f16d97980b581a99cd56a51fed4b81194fc547f539b8.KZyTW_wbEDbTR8CXU9fbqjqD9z4hDvUb99tjDqaQW_wai-observability-scorers--offline-disabled--dark:- hash: v1.k794b7964.753de81720b4496f631f3947e7b1df6e5fdc75d819a5d564a1bd03b304e886f8.u9drGvsNdBGawHS3L5p2aJwOGsBOqWLHEa3itmFFwqM+ hash: v1.k794b7964.5811769002dfe17d6dd93b1ebd92284be4b2dbf12c0635533f529c30780981d6.KQirndbX4Ao8xtlOrhBCmJdIAz4rizWfekajwn0jqnMai-observability-scorers--offline-disabled--light:- hash: v1.k794b7964.61fbfcd2fefffbd0fce01f693e9463fc690e4f0f69bd9308eafc06de07591cfe.-isZUttu_1l77UgFFJOZVuz96QiwJ-vUlgsyPWzmk5s+ hash: v1.k794b7964.33c4b992e81d24167a2a93ff7fefd446163393d96fee65be672d7f2c37f66e92.-meL1Z1Bu2Q_uZirr9uMOFyFjzcLzQk9c2LohkP0tgscharts-heatmap--activity-by-day-and-hour--dark:hash: v1.k794b7964.cb3a745c072482c2b24a91879fea9a6f72d195ac683a38efc3f222d944828b9e.jlohG3R6gpgos058qmytizuCZtVRjXramep8NJDaIQEcharts-heatmap--activity-by-day-and-hour--light:@@ -8823,13 +8823,13 @@ snapshots:scenes-app-ai-observability-offline-experiments-experiment--request-failure--light:hash: v1.k794b7964.a31d57c72b94117a24a7a8948a68c6959b4fd00cde6d24aa3cdd206e1ca12eb7.392D8AhKK3JzKggndN4ojaEVt_vsHWraj2vVAWxz5NIscenes-app-ai-observability-offline-experiments-overview--all-time-synchronized-hover--dark:- hash: v1.k794b7964.537d45d84c3e236f478f812a16f8bf69a789c1921de4058d73e0f30691e2f8ce.eiNwt87jkPxYQ60DjZRwZWcURl1KdwsWshBFzypU3DQ+ hash: v1.k794b7964.fb3ce13091c4c7f3c908e142c2b4e79064192344b38097db465eda6c4cf79a3b.0PHKo_RVtCnJr9EefOBcHXNht8MHl_FoBKHcqd9ol-Yscenes-app-ai-observability-offline-experiments-overview--all-time-synchronized-hover--light:- hash: v1.k794b7964.4620ebeb5092fbecf405a12ad9c237118e143866a52af9672bceb4a890de9363.wXZJpitG_Zu-5btxfY3hlqszSqmUh1MBdnbU3vazCU0+ hash: v1.k794b7964.3df907417177586aa0f059463468cbab2be1d8c569fbfc349b0e00cddd7dea63.B9QMiTZkEOtrF1hQIUwQc25TjgyNMLgK3uRlboFL2UIscenes-app-ai-observability-offline-experiments-overview--default-scorers--dark:- hash: v1.k794b7964.d2b216a282f9e9080173796c66573bc2886a78a32164c84229591f1fe2efd079.xHaO6iiDcEjfU6C7G8s8GzNPvsHs_HFVbT7aDAhiMTM+ hash: v1.k794b7964.fa4c20dac4b64c4e62be12fb9f263082fe0ece58b4c5f3392c6fb19c5e403a59.yw0Qflw3sth1GPGHq6TOq4_fdSvLLHsN30lffaOu4uwscenes-app-ai-observability-offline-experiments-overview--default-scorers--light:- hash: v1.k794b7964.2ab5f3d19ad8a33efc493309db8bc355fe206573cf389da46f62d44857157615.CsLy6stBpE-MKi0kKep0kv6d1Dm-g0JTr1__zIFIpEo+ hash: v1.k794b7964.fc5e13d18d4567e67d59f1e4e2d330dcecddb178178f77555998dee7bdaac38f.qodNHeE8aFki2ZeCyyGaY_J-Q9P1fo3j2k2n80SoaVkscenes-app-ai-observability-offline-experiments-overview--empty--dark:hash: v1.k794b7964.977ade824abb5791ed84c5b6d125bc9589d0787b69daea3efeb6d0fe91f45f70.czJW_b0HTFrXWZGbmMZfAs1UD-NkCfVNLy36XZiTH7Yscenes-app-ai-observability-offline-experiments-overview--empty--light:@@ -8839,53 +8839,53 @@ snapshots:scenes-app-ai-observability-offline-experiments-overview--empty-narrow--light:hash: v1.k794b7964.754079aa9ab7ee416590c9bc8f94fa93f59b7769e98d4e63400883bf4d23ffae.hLRMtJxEnlm36ceer7qs_5s0s0euWyZB0BAqWPZz8c0scenes-app-ai-observability-offline-experiments-overview--filtered-trends--dark:- hash: v1.k794b7964.c48c8dbfe933d798ed7656446d7b1f8ab4b4346e5cbf54da0e4a17a911f76fe8.bcjQGTQZxdtyWGx-oz_RUJL5AMT1z5zGlTt6t38LVz4+ hash: v1.k794b7964.b364f69b2d316e73b525d40ae1d3e7fbae7ee1f9013e869125d8346005736145.ytOrnuZ9UQOyKRmTwQhFrIOFDlDDJn9oUzzsAGKA5Poscenes-app-ai-observability-offline-experiments-overview--filtered-trends--light:- hash: v1.k794b7964.91e07330df23f6cd13c9ac3435a4ebecab6de6695249a85a4f4eed7652d8464e.L8vDCa3kiPqURuztA9LIVyJEJE_21NKGvyS92W2-Oek+ hash: v1.k794b7964.377ad2181d398e9a57a1d7fac8fc7fb2237fc680c3c7c5563c5973c2d39f34a5.6hIWHqTofDepWwl5hoetAWimrE1eEatrRlEJwxUG_oEscenes-app-ai-observability-offline-experiments-overview--list-error--dark:- hash: v1.k794b7964.5c3c9c05034641362b5481f98a2da78a9415a0fdc49c5dcf6a4dba369b690ff0.PaaBerh2sH4kpLWTzjnSFshCOpO-MoAZWNkKHcMpKe4+ hash: v1.k794b7964.8b831fef9bfedf72e76e149939a00bf4a76900156748d3bafb93f1d3200f61d6.CUFTGjUs_D9pgPOcndn6bS7R25bmn-9mLEb9b4PDi4oscenes-app-ai-observability-offline-experiments-overview--list-error--light:- hash: v1.k794b7964.313d0039a600be146f2f62147db1fdb4d1202ea2cec5a95ef96dca12ed58b5bb.7Tolzb0JdrUiGuzLnZcHzOb1JMM4T4AvlYSxaK6IBCs+ hash: v1.k794b7964.fa8e8ecc24f4173a2267281305834cffe9f7eb099785fb88d0830aa165544ed2.j-uksYVVEc6BUX0THSvf1i60NT5xraYlyAP2m8byBgQscenes-app-ai-observability-offline-experiments-overview--multiple-versions--dark:- hash: v1.k794b7964.fb85e61c26c0ece457f33d1a3117d2e09be8de003d01a2d01309eb860479d383.TAB4EEjC3VRF7kHnOy53goKZacu2zBK_8zwvmyqdiQ8+ hash: v1.k794b7964.84a57ee92f9203aa1869bee3548823fb04a7288edec4eaffb8cc294206bb6290.rG4uZItUyrl_vHXhYQY-Ctz_8_jlXYrmALwq89ln5dEscenes-app-ai-observability-offline-experiments-overview--multiple-versions--light:- hash: v1.k794b7964.6587ac1425f5bc3ea004f29f79b3a444d58ba0396eda68fc58940ae8812539e9.Cmf4VY_wluLujzOsELEd9hiXSENOr24U8qqGxxNVeN4+ hash: v1.k794b7964.ebc934d093a8e63a084fe2d3e5cb9ad3871728bb40672f6cf61539975338ac16.dZzCqNHkhveuOCds4g7xVYzXzoGFMWJ7Dx46IMrxaDYscenes-app-ai-observability-offline-experiments-overview--multiple-versions-narrow--dark:- hash: v1.k794b7964.996f76f875e6c66d3a49bfd534e9d2e550b835048f5deadfe4ec7bfd22c13b28.LCXzcB3nX7t0MZ098MBj1oe9nLmoIet9lW8poNiOKvI+ hash: v1.k794b7964.030b960d331a7b7bea03eb21353c286d47a6268a333f940f8433ad624942dd28.WNcOt3ZcTgD9RG5goeQrngfLjg4IPg_xrlGQqtbA9P8scenes-app-ai-observability-offline-experiments-overview--multiple-versions-narrow--light:- hash: v1.k794b7964.a9050bf7854de6150999342699258288cd98fc9abc18ad25b45387d6d4f0a5b0.XPQOu_DedPjxdDMV-xkdAtNkC_qa5tuOAD6y09FpxeM+ hash: v1.k794b7964.423be802a7cf08f619cbcb4cb44a8a340f376f8ed37517a6a21b9c51f5f806ee.tvZnyRoE2qTCtCf1uFDX9gX8UYXqIQMGTlySrXoXrv4scenes-app-ai-observability-offline-experiments-overview--narrow--dark:- hash: v1.k794b7964.c6050b27f6f78d6f2aac415642e951fa9c9195502dff436729041be4e7e8e289.ruj_Xy6Y-uBpCZrHSSqGfZLYur_5qBWCGW6_KRLDjLU+ hash: v1.k794b7964.18ed7d7ec785488c7ab89a9e96c1ccd5b275354f306ecb34ae2fe5e432052176.xM7r2_DGEEvvWion1un3ajeDOXQjNS9SOo3ftnVC4mEscenes-app-ai-observability-offline-experiments-overview--narrow--light:- hash: v1.k794b7964.c9ec88221ddf7507b9a7ed6ebde1240e82e7193e1672dd0865aea4c39c563712.cBgiZ6eyhkh3TXKg3ffGB5XRBmdKrho0IfdsR5zJzZM+ hash: v1.k794b7964.1179772dcf2581f883409bea23a188fe79829a2886dd436a602f166534331a1f.2JhsYQ8qLMUOeSuRKMqsSsf2tXBMu77U0qoOHwP7g70scenes-app-ai-observability-offline-experiments-overview--no-matching-experiments--dark:- hash: v1.k794b7964.45e918a97afbe5e23e3140ba18f57bde3ae55c87c0553a4cdb4120df309733d8.fZ_g4XJOv7eTKp238ptSGkhqkTFQwh8vRglbeikiJdE+ hash: v1.k794b7964.1fcbfbaeaadd5301cc28702cbf6c93dc47f2fe56318e9c087303b0af08455def.9P2-61KkzzeyH14B56FzMWousQ3HXkJazoiEBMr6b3Ascenes-app-ai-observability-offline-experiments-overview--no-matching-experiments--light:- hash: v1.k794b7964.43ae51dc02eb5dee83bf66c48651dacc8f95a9868ec8900de21c887ba26ce307.wIeQH_SeBTNAdCnbN1JLIdCMWK1Z_6gOonWpcYsl3OI+ hash: v1.k794b7964.ef2304ac785a197aa675c9e826062246bb19cb244a12047629d26dcbd375a3cc.P9LAmLcHzhobEftRQ30_-UJJGpnLGA9-Z_th_nwd73Qscenes-app-ai-observability-offline-experiments-overview--partial-history--dark:- hash: v1.k794b7964.de7a21cacfaa7c8f6e4c39913e7386f52e156ad9071100f7df62fa39203109ae.yMKHVcbs8fDFDAi-1vZW3XBMG9anwFBV62VcFG0kAaM+ hash: v1.k794b7964.dfc8dfdcbc8b02b1593e54be9125973c174ac67cb4c5fde46f119fcbdce70d93.gWtzSWjSRhkQeb5LVEF_qLMpAQGHk4qOXPo6YvN7cNMscenes-app-ai-observability-offline-experiments-overview--partial-history--light:- hash: v1.k794b7964.7e650acc2575be9815c4edece4b8399585e604d38e0934c771362ee08288aa23.meUmr6mF3RzVIByqn0hWFnrOCYpJuXBGoAFdGJfLRRM+ hash: v1.k794b7964.7d61c4c030e2ac777b8eac0c612e36d23f9cb701bb09764986957c834e8160d3.uOegrRMSXAU7ry1PHSKRdlWrrskTbFcXEnGkaJcgULMscenes-app-ai-observability-offline-experiments-overview--partial-history-narrow--dark:- hash: v1.k794b7964.2a9a3a3311c12216bc99fd8bb08ba2a24b77f3d780ceddd4a501e4844ad89195.z5nROrbR9yDlG8llzDg18mzmIBGONgRXZRbH2nvwnxA+ hash: v1.k794b7964.263decd33e83edddaaa509224c0ab69be4cab9d0f1f0bb2aa6e42ec89b685417.sACn0pHOVuNcLWjOXOSdVZXvVOprawYthGBMuGinn3cscenes-app-ai-observability-offline-experiments-overview--partial-history-narrow--light:- hash: v1.k794b7964.0170b29bab838a1ce5b000a9e50a5a614e336fa86d9e8806a40e7fe8511675dc.Fa48OOiFQhT8vdq6NsvdN62J9BjhT4B9FwIjbpJ3QUU+ hash: v1.k794b7964.a02e0465d32c0184cca031c780901fd142ce28b32d792065811caf8eed6c8f21.RU-d8SUARzAYGDeVLBN8Hn1XeabYC0gaLz2BfNN3odUscenes-app-ai-observability-offline-experiments-overview--recent-experiments--dark:- hash: v1.k794b7964.d2b216a282f9e9080173796c66573bc2886a78a32164c84229591f1fe2efd079.KmkKO4x2AmWgqPIgwDVBUt1GL26zNQeMCc0WS3ELdgg+ hash: v1.k794b7964.fa4c20dac4b64c4e62be12fb9f263082fe0ece58b4c5f3392c6fb19c5e403a59.qSvAMWBW7apGQFrYPcJoNARPkAgjlSg94f8WuUuWek8scenes-app-ai-observability-offline-experiments-overview--recent-experiments--light:- hash: v1.k794b7964.2ab5f3d19ad8a33efc493309db8bc355fe206573cf389da46f62d44857157615.vrQKlZ3zgM8Epl2YShDovvuf8wCzHhhKelizMExl05o+ hash: v1.k794b7964.fc5e13d18d4567e67d59f1e4e2d330dcecddb178178f77555998dee7bdaac38f.ium6vEX51-vJpa_q1nCmYTwF67NJ68RsV-mLLX4AVkEscenes-app-ai-observability-offline-experiments-overview--score-error--dark:- hash: v1.k794b7964.13e3cb16faa223aab3c1951c2e81b38dbe7e04b11991953b913395d5a22adef2.MOklDxh1x7jGu_YpgkjOr_qECmSkGx9pteGHPZV9U9Q+ hash: v1.k794b7964.bc28fdc2405851f5b61cfedfa355a27d090fb84a4e496d9f2fc549eaa173435f.S1IV4V9DdF-gbm2AKqw4-4bc9gz3-eVSXk2sMG8Zs9Yscenes-app-ai-observability-offline-experiments-overview--score-error--light:- hash: v1.k794b7964.fd24de84c10d3bc761e22c92d795bb015276714562f62a65f81c023abe6f342c.Qld0U3x2dzcxfHKzSblh-0RWlOjh3CriMtMy2Ng5yho+ hash: v1.k794b7964.dece407dd02844758e8950c45573df48c523954726b16521214138d4a10f38d7.LaZL9pX6seylgIWgDtukSLSffO92cydY_RRpFKgEJHwscenes-app-ai-observability-offline-experiments-overview--synchronized-hover--dark:- hash: v1.k794b7964.95badff06a14f772cd75679650910d0bb7f5a6cd62684b3683c656087f9b3d4e.7-05dyZSFo3UadpiZ4X4hQ09zZqV4d_T_HiDdcdYy2w+ hash: v1.k794b7964.f82a77c70a10f644911e40efbbd9e5049ab6ddaa708ecdc1c0463b7b554ffb5b.MvIo2T4NRSyRK8PhTkhObMSioTbx_3kXKE_wOCYEk9Uscenes-app-ai-observability-offline-experiments-overview--synchronized-hover--light:- hash: v1.k794b7964.5c388b4942818fd3a11080eeb2928a171fbf97a322f441db747bbd8bde731c1f.OVp8z73MBocJrO08SdA1xrdOi9FQp85G5ZhRqmN4TwQ+ hash: v1.k794b7964.76fa7ae08158f6597e0763661932c7f9ae895dc25805bc304c56e8e45a64f15f.QkSBo1cy4H4qsYFYadwaRIuZtl1k7KgiTku4bgcGtgEscenes-app-ai-observability-offline-experiments-overview--synchronized-hover-narrow--dark:- hash: v1.k794b7964.d65e4efc17a29e026a23fba3b352abf817a7f3eab02eef299d8d06e46b896461.JSoaS57anUs6pGLncJkgDqL85NX-YzCixG4BId2WZZk+ hash: v1.k794b7964.56d79a197d4687fca8bcd4dcda8346f5e0914feb1db5466ec6e302599315c94d.HEivagJC0ow1_ZIhKVgJFkEo8CIv4ssSW4DEHXTqe8Mscenes-app-ai-observability-offline-experiments-overview--synchronized-hover-narrow--light:- hash: v1.k794b7964.689c3e205264cc850fb0cd5adee4f67275ffd893f9f5634afa258900c3720323.1AOxrJW_lz6MsorLuPjy83lS7Lbxjm4_QaCoUaPpiXM+ hash: v1.k794b7964.c34bcc78bfa8f503b5cabac0aee2b534ac814a7387219c007ddd24d636b87df3.b-l0k8WJngZByacU9IzDwQDBGU6gXMfFeOLtK9jMwM0scenes-app-ai-observability-promptreferencetags--label-and-version-references--dark:hash: v1.k794b7964.4cc699d7489063a64cf4ec1f930d11fc062eb0d9c9e46150f939503945bb8841.jKmH2ZmjZex98fImM00HE_xBBayalWKHtqXbVlhE_VMscenes-app-ai-observability-promptreferencetags--label-and-version-references--light:diff --git a/products/ai_observability/backend/api/offline_experiment_read_serializers.py b/products/ai_observability/backend/api/offline_experiment_read_serializers.pyindex 034992a37a5c..618c28c5c724 100644--- a/products/ai_observability/backend/api/offline_experiment_read_serializers.py+++ b/products/ai_observability/backend/api/offline_experiment_read_serializers.py@@ -6,6 +6,8 @@ from drf_spectacular.utils import extend_schema_serializerfrom rest_framework import serializersfrom rest_framework_dataclasses.serializers import DataclassSerializer+from posthog.api.shared import UserBasicSerializer+from products.ai_observability.backend.api.offline_experiment_serializers import (ItemPayloadField,ResultPayloadField,@@ -110,6 +112,12 @@ class OfflineResultCellQuerySerializer(_OfflineQuerySerializer[OfflineResultCellclass OfflineHistoryQuerySerializer(OfflineResultQuerySerializer):+ created_by = serializers.IntegerField(+ required=False, min_value=1, help_text="Filter experiments by the author's user ID."+ )+ created_by_is_null = serializers.BooleanField(+ required=False, help_text="Only include experiments without an author."+ )tags = ResourceTagFilterField()tag_match = serializers.ChoiceField(choices=TagMatch.choices,@@ -162,6 +170,8 @@ class OfflineHistoryQuerySerializer(OfflineResultQuerySerializer):"date_to","search","run_source",+ "created_by",+ "created_by_is_null","statuses","suite_key","dataset_source",@@ -202,6 +212,9 @@ class OfflineExperimentQuerySerializer(OfflineHistoryQuerySerializer):class OfflineExperimentReadSerializer(serializers.Serializer):+ created_by = UserBasicSerializer(+ read_only=True, allow_null=True, help_text="User who submitted the experiment, or null for service credentials."+ )tags = serializers.ListField(child=serializers.CharField(), help_text="Project tag names assigned to this experiment.")diff --git a/products/ai_observability/backend/api/offline_experiments.py b/products/ai_observability/backend/api/offline_experiments.pyindex f5bb618724e7..045028d24f86 100644--- a/products/ai_observability/backend/api/offline_experiments.py+++ b/products/ai_observability/backend/api/offline_experiments.py@@ -199,7 +199,10 @@ class OfflineExperimentViewSet(OfflineExperimentReadViewSet):def create(self, request: TypedRequest[ExperimentSubmission], **kwargs: object) -> Response:receipt = OfflineExperimentService(team_id=self.team_id, user_access_control=self._reference_access_control()- ).create(request.validated_data)+ ).create(+ request.validated_data,+ created_by_id=None if is_service_auth(request) else request.user.pk,+ )return _experiment_response(receipt, status=201 if receipt.created else 200)def _experiment_id(self) -> UUID:diff --git a/products/ai_observability/backend/api/score_definitions.py b/products/ai_observability/backend/api/score_definitions.pyindex 6f484c51154a..a1df95573d3b 100644--- a/products/ai_observability/backend/api/score_definitions.py+++ b/products/ai_observability/backend/api/score_definitions.py@@ -42,6 +42,9 @@ from products.ai_observability.backend.score_definition_configs import ScoreDeficlass ScoreDefinitionSerializer(ResourceTagsReadSerializer, serializers.ModelSerializer):+ updated_by = UserBasicSerializer(+ read_only=True, allow_null=True, help_text="User who last updated the scorer or created a version."+ )created_by = UserBasicSerializer(read_only=True,allow_null=True,@@ -78,6 +81,7 @@ class ScoreDefinitionSerializer(ResourceTagsReadSerializer, serializers.ModelSer"created_by","created_at","updated_at",+ "updated_by","team",]read_only_fields = fields@@ -221,6 +225,7 @@ class ScoreDefinitionNewVersionSerializer(serializers.Serializer):class ScoreDefinitionFilter(django_filters.FilterSet):+ created_by = django_filters.NumberFilter(field_name="created_by_id", help_text="Filter by the creator's user ID.")search = django_filters.CharFilter(method="filter_search",help_text="Search scorers by name or description.",@@ -277,7 +282,9 @@ class ScoreDefinitionViewSet(self, queryset: QuerySet[ScoreDefinition, ScoreDefinition]) -> QuerySet[ScoreDefinition, ScoreDefinition]:queryset = (- queryset.filter(team_id=self.team_id).select_related("current_version", "created_by").order_by("name", "id")+ queryset.filter(team_id=self.team_id)+ .select_related("current_version", "created_by", "updated_by")+ .order_by("name", "id"))# List defaults to active scorers to mirror the UI; non-boolean `?archived=` values keep that default.@@ -347,7 +354,10 @@ class ScoreDefinitionViewSet(if not changed_fields:return- definition.save(update_fields=[*[field for field in changed_fields if field != "tags"], "updated_at"])+ definition.updated_by = cast(User, self.request.user)+ definition.save(+ update_fields=[*[field for field in changed_fields if field != "tags"], "updated_at", "updated_by"]+ )event_properties: dict[str, str | bool | int | list[str]] = {**self._event_properties(definition),"changed_fields": changed_fields,diff --git a/products/ai_observability/backend/api/test/test_offline_experiment_reads.py b/products/ai_observability/backend/api/test/test_offline_experiment_reads.pyindex 24daf54483ce..f8385384a3e8 100644--- a/products/ai_observability/backend/api/test/test_offline_experiment_reads.py+++ b/products/ai_observability/backend/api/test/test_offline_experiment_reads.py@@ -11,6 +11,7 @@ from django.utils import timezonefrom parameterized import parameterizedfrom rest_framework import status+from posthog.api.shared import UserBasicSerializerfrom posthog.constants import AvailableFeaturefrom posthog.models import OrganizationMembership, Project, Team, Userfrom posthog.models.personal_api_key import PersonalAPIKey@@ -113,6 +114,59 @@ class TestOfflineExperimentReads(APIBaseTest):self._history(),]+ def test_author_filter_applies_to_experiments_and_history(self) -> None:+ self.user.hedgehog_config = {+ "version": 2,+ "use_as_profile": True,+ "actor_options": {"color": "red"},+ }+ self.user.save(update_fields=["hedgehog_config"])+ self.experiment.created_by = self.user+ self.experiment.save(update_fields=["created_by"])+ service_experiment = OfflineExperiment.objects.for_team(self.team.id).create(+ id=uuid4(),+ team=self.team,+ name="Service run",+ status="completed",+ started_at=self.experiment.started_at + timedelta(hours=1),+ finished_at=self.experiment.started_at + timedelta(hours=1, minutes=1),+ submission_fingerprint="d" * 64,+ )+ service_item = OfflineExperimentItem.objects.for_team(self.team.id).create(+ id=uuid4(), team=self.team, experiment=service_experiment, submission_fingerprint="e" * 64+ )+ OfflineEvaluationResult.objects.for_team(self.team.id).create(+ team=self.team,+ item=service_item,+ scorer_definition=self.definition,+ scorer_version=self.version,+ status="ok",+ boolean_value=False,+ submission_fingerprint="f" * 64,+ )+ for endpoint in [self._endpoint(), self._history()]:+ with self.subTest(endpoint=endpoint):+ response = self.client.get(endpoint, {"created_by": self.user.id, "limit": 1})+ self.assertEqual(response.status_code, 200, response.data)+ self.assertEqual(response.data["count"], 1)+ self.assertIsNone(response.data["next_cursor"])+ row = response.data["results"][0]+ experiment = row.get("experiment", row)+ self.assertEqual(experiment["id"], str(self.experiment.id))+ self.assertEqual(experiment["created_by"], UserBasicSerializer(self.user).data)+ empty = self.client.get(endpoint, {"created_by": self.user.id + 10000})+ self.assertEqual(empty.data["count"], 0)+ no_author = self.client.get(endpoint, {"created_by_is_null": "true", "limit": "1"})+ self.assertEqual(no_author.status_code, 200, no_author.data)+ self.assertEqual(no_author.data["count"], 1)+ self.assertIsNone(no_author.data["next_cursor"])+ row = no_author.data["results"][0]+ self.assertEqual(row.get("experiment", row)["id"], str(service_experiment.id))+ all_authors = self.client.get(endpoint, {"created_by_is_null": "false"})+ self.assertEqual(all_authors.data["count"], 2)+ response = self.client.get(self._endpoint(f"{service_experiment.id}/"))+ self.assertIsNone(response.data["created_by"])+def test_history_filters_experiment_tags_before_pagination(self) -> None:ResourceTags.set(self.experiment, ["quality", "production"])for index, tags in enumerate((["quality"], []), start=1):@@ -470,6 +524,9 @@ class TestOfflineExperimentReads(APIBaseTest):"item_ids",),(self._endpoint(), {"limit": 101}, "limit"),+ (self._endpoint(), {"created_by": "invalid"}, "created_by"),+ (self._history(), {"created_by": 0}, "created_by"),+ (self._history(), {"created_by": self.user.id, "created_by_is_null": "true"}, "created_by"),(self._endpoint(f"{self.experiment.id}/"), {"limit": 1}, "limit"),(self._endpoint(f"{self.experiment.id}/items/{self.item.id}/"), {"limit": 1}, "limit"),(self._endpoint(f"{self.experiment.id}/items/{self.item.id}/payload/"), {"limit": 1}, "limit"),diff --git a/products/ai_observability/backend/api/test/test_offline_experiment_serializers.py b/products/ai_observability/backend/api/test/test_offline_experiment_serializers.pyindex 787c96390d9f..cfbf2890a1a7 100644--- a/products/ai_observability/backend/api/test/test_offline_experiment_serializers.py+++ b/products/ai_observability/backend/api/test/test_offline_experiment_serializers.py@@ -79,6 +79,7 @@ class TestOfflineReadQuerySerializers(SimpleTestCase):("unknown_source", {"run_source": "cron"}, "run_source"),("unknown_status", {"statuses": "complete"}, "statuses"),("duplicate_status", {"statuses": "completed,completed"}, "statuses"),+ ("conflicting_authors", {"created_by": "5", "created_by_is_null": "true"}, "created_by"),("reversed_dates",{"date_from": "2026-09-25T10:00:00Z", "date_to": "2026-09-24T10:00:00Z"},diff --git a/products/ai_observability/backend/api/test/test_offline_experiments.py b/products/ai_observability/backend/api/test/test_offline_experiments.pyindex c90278abf922..07ad7bfd00c2 100644--- a/products/ai_observability/backend/api/test/test_offline_experiments.py+++ b/products/ai_observability/backend/api/test/test_offline_experiments.py@@ -123,7 +123,10 @@ class TestOfflineExperimentsAPI(APIBaseTest):self.assertEqual(created.status_code, status.HTTP_201_CREATED, created.data)experiment_id = str(body["id"])self.assertEqual(created.data["id"], experiment_id)-+ expected_author = None if auth_kind == "project_key" else self.user.pk+ self.assertEqual(+ OfflineExperiment.objects.for_team(self.team.id).get(pk=experiment_id).created_by_id, expected_author+ )incomplete = self.client.post(self._endpoint(experiment_id, "complete"), {}, format="json")self.assertEqual(incomplete.status_code, status.HTTP_409_CONFLICT, incomplete.data)self.assertEqual(incomplete.data["code"], "expected_count_mismatch")@@ -161,6 +164,13 @@ class TestOfflineExperimentsAPI(APIBaseTest):self.assertEqual(failed.data["status"], "failed")self.assertEqual(failed.data["accepted_result_count"], 0)+ self._authenticate("project_key" if auth_kind != "project_key" else "session")+ retried = self.client.post(self._endpoint(), body, format="json")+ self.assertEqual(retried.status_code, status.HTTP_200_OK)+ self.assertEqual(+ OfflineExperiment.objects.for_team(self.team.id).get(pk=experiment_id).created_by_id, expected_author+ )+@parameterized.expand([("personal_missing", "personal_key", []),diff --git a/products/ai_observability/backend/api/test/test_score_definitions.py b/products/ai_observability/backend/api/test/test_score_definitions.pyindex 2443f81dc9e0..8c2998e46555 100644--- a/products/ai_observability/backend/api/test/test_score_definitions.py+++ b/products/ai_observability/backend/api/test/test_score_definitions.py@@ -92,12 +92,15 @@ class TestScoreDefinitionsApi(APIBaseTest):definition = ScoreDefinition.objects.get(pk=response.data["id"])current_version = self._current_version(definition)self.assertEqual(definition.created_by, self.user)+ self.assertEqual(response.data["updated_by"]["id"], self.user.id)self.assertEqual(definition.kind, payload["kind"])self.assertEqual(current_version.version, 1)self.assertEqual(current_version.config, payload["config"])def test_patch_updates_metadata_without_creating_a_new_version(self):definition = self._create_definition()+ original_author = definition.created_by+ ScoreDefinition.objects.filter(pk=definition.pk).update(updated_by=None)response = self.client.patch(f"{self._endpoint()}{definition.id}/",@@ -109,6 +112,8 @@ class TestScoreDefinitionsApi(APIBaseTest):definition.refresh_from_db()current_version = self._current_version(definition)self.assertEqual(definition.name, "Updated quality")+ self.assertEqual(definition.created_by, original_author)+ self.assertEqual(response.data["updated_by"]["id"], self.user.id)self.assertEqual(definition.description, "Updated description")self.assertTrue(definition.archived)self.assertEqual(current_version.version, 1)@@ -259,6 +264,7 @@ class TestScoreDefinitionsApi(APIBaseTest):definition.refresh_from_db()current_version = self._current_version(definition)self.assertEqual(current_version.version, 2)+ self.assertEqual(response.data["updated_by"]["id"], self.user.id)self.assertEqual((definition.name, definition.description), ("Updated scorer", "Updated description"))self.assertEqual(definition.versions.count(), 2)self.assertEqual(definition.versions.get(version=1).config, original_config)@@ -603,6 +609,12 @@ class TestScoreDefinitionsApi(APIBaseTest):self.assertEqual(response.status_code, status.HTTP_200_OK)self.assertEqual([result["id"] for result in response.data["results"]], [str(archived.id)])self.assertNotIn(str(active.id), [result["id"] for result in response.data["results"]])+ ScoreDefinition.objects.filter(pk=active.pk).update(created_by=None)+ response = self.client.get(self._endpoint(), {"created_by": str(self.user.id), "archived": "true"})+ self.assertEqual(response.status_code, status.HTTP_200_OK)+ self.assertEqual([result["id"] for result in response.data["results"]], [str(archived.id)])+ response = self.client.get(self._endpoint(), {"created_by": str(self.user.id), "archived": "false"})+ self.assertEqual(response.data["results"], [])@patch("products.ai_observability.backend.api.score_definitions.report_user_action")def test_patch_reports_user_action(self, mock_report_user_action: Mock) -> None:diff --git a/products/ai_observability/backend/migrations/0066_scorer_and_experiment_authors.py b/products/ai_observability/backend/migrations/0066_scorer_and_experiment_authors.pynew file mode 100644index 000000000000..b1a0c8f40bd2--- /dev/null+++ b/products/ai_observability/backend/migrations/0066_scorer_and_experiment_authors.py@@ -0,0 +1,39 @@+# Generated by Django 5.2.18 on 2026-10-20 13:56++import django.db.models.deletion+from django.conf import settings+from django.db import migrations, models+++class Migration(migrations.Migration):+ dependencies = [+ ("ai_observability", "0065_delete_zeabur_provider_keys"),+ migrations.swappable_dependency(settings.AUTH_USER_MODEL),+ ]++ operations = [+ migrations.AddField(+ model_name="offlineexperiment",+ name="created_by",+ field=models.ForeignKey(+ blank=True,+ db_constraint=False,+ null=True,+ on_delete=django.db.models.deletion.SET_NULL,+ related_name="+",+ to=settings.AUTH_USER_MODEL,+ ),+ ),+ migrations.AddField(+ model_name="scoredefinition",+ name="updated_by",+ field=models.ForeignKey(+ blank=True,+ db_constraint=False,+ null=True,+ on_delete=django.db.models.deletion.SET_NULL,+ related_name="+",+ to=settings.AUTH_USER_MODEL,+ ),+ ),+ ]diff --git a/products/ai_observability/backend/migrations/max_migration.txt b/products/ai_observability/backend/migrations/max_migration.txtindex bdafa98379a5..d62786b97f43 100644--- a/products/ai_observability/backend/migrations/max_migration.txt+++ b/products/ai_observability/backend/migrations/max_migration.txt@@ -1 +1 @@-0065_delete_zeabur_provider_keys+0066_scorer_and_experiment_authorsdiff --git a/products/ai_observability/backend/models/offline_evaluations.py b/products/ai_observability/backend/models/offline_evaluations.pyindex 971842a2ed2e..c2304a7c8a61 100644--- a/products/ai_observability/backend/models/offline_evaluations.py+++ b/products/ai_observability/backend/models/offline_evaluations.py@@ -33,6 +33,9 @@ class OfflineExperiment(Taggable):status = models.CharField(max_length=16, choices=Status.choices, default=Status.UPLOADING)started_at = models.DateTimeField()created_at = models.DateTimeField(default=timezone.now, editable=False)+ created_by = models.ForeignKey(+ "posthog.User", on_delete=models.SET_NULL, null=True, blank=True, related_name="+", db_constraint=False+ )finished_at = models.DateTimeField(null=True, blank=True)expected_item_count = models.PositiveBigIntegerField(null=True, blank=True)expected_result_count = models.PositiveBigIntegerField(null=True, blank=True)diff --git a/products/ai_observability/backend/models/score_definitions.py b/products/ai_observability/backend/models/score_definitions.pyindex 2b58c6e1e17f..1aaab15272c3 100644--- a/products/ai_observability/backend/models/score_definitions.py+++ b/products/ai_observability/backend/models/score_definitions.py@@ -29,6 +29,9 @@ class ScoreDefinition(Taggable, UUIDModel, CreatedMetaFields, UpdatedMetaFields)description = models.TextField(blank=True, default="")kind = models.CharField(max_length=32, choices=Kind)archived = models.BooleanField(default=False)+ updated_by = models.ForeignKey(+ User, on_delete=models.SET_NULL, null=True, blank=True, related_name="+", db_constraint=False+ )current_version = models.ForeignKey("ScoreDefinitionVersion",null=True,@@ -68,9 +71,11 @@ class ScoreDefinition(Taggable, UUIDModel, CreatedMetaFields, UpdatedMetaFields))definition.current_version = version- definition.save(update_fields=["current_version", "updated_at"])+ definition.updated_by = created_by+ definition.save(update_fields=["current_version", "updated_at", "updated_by"])self.current_version = version+ self.updated_by = created_byreturn versiondiff --git a/products/ai_observability/backend/offline_evaluation_read_service.py b/products/ai_observability/backend/offline_evaluation_read_service.pyindex c706febec6f6..bfb139840fdc 100644--- a/products/ai_observability/backend/offline_evaluation_read_service.py+++ b/products/ai_observability/backend/offline_evaluation_read_service.py@@ -3,6 +3,7 @@ from __future__ import annotationsimport jsonimport hashlibfrom collections import defaultdict+from copy import deepcopyfrom dataclasses import asdict, replacefrom datetime import datetimefrom typing import TYPE_CHECKING, cast@@ -24,6 +25,7 @@ from products.ai_observability.backend.models.offline_evaluations import (from products.ai_observability.backend.models.score_definitions import ScoreDefinition, ScoreDefinitionVersionfrom products.ai_observability.backend.offline_evaluation_read_types import (OfflineCategorySummary,+ OfflineExperimentAuthor,OfflineExperimentRead,OfflineHistoryPoint,OfflineItemPage,@@ -101,7 +103,7 @@ class OfflineEvaluationReadService:self.can_read_scores = can_read_scoresdef _experiments(self) -> QuerySet[OfflineExperiment]:- return OfflineExperiment.objects.for_team(self.team_id)+ return OfflineExperiment.objects.for_team(self.team_id).select_related("created_by")def _items(self) -> QuerySet[OfflineExperimentItem]:return OfflineExperimentItem.objects.for_team(self.team_id)@@ -164,6 +166,10 @@ class OfflineEvaluationReadService:experiments = experiments.filter(started_at__lt=query.date_to)if query.search:experiments = experiments.filter(name__icontains=query.search)+ if query.created_by is not None:+ experiments = experiments.filter(created_by_id=query.created_by)+ if query.created_by_is_null:+ experiments = experiments.filter(created_by__isnull=True)if query.run_source_is_null:experiments = experiments.filter(run_source__isnull=True)elif query.run_source is not None:@@ -285,9 +291,23 @@ class OfflineEvaluationReadService:output = []for experiment in experiments:counts = visible_counts.get(experiment.id, _ExperimentCounts())+ author = experiment.created_byoutput.append(OfflineExperimentRead(tags=tuple(ResourceTags.names(experiment)),+ created_by=OfflineExperimentAuthor(+ id=author.id,+ uuid=author.uuid,+ distinct_id=author.distinct_id,+ first_name=author.first_name,+ last_name=author.last_name,+ email=author.email,+ is_email_verified=author.is_email_verified,+ hedgehog_config=deepcopy(author.hedgehog_config),+ role_at_organization=author.role_at_organization,+ )+ if author is not None+ else None,id=experiment.id,name=experiment.name,run_source=experiment.run_source,diff --git a/products/ai_observability/backend/offline_evaluation_read_types.py b/products/ai_observability/backend/offline_evaluation_read_types.pyindex 498b079676de..4eed70ad5ecb 100644--- a/products/ai_observability/backend/offline_evaluation_read_types.py+++ b/products/ai_observability/backend/offline_evaluation_read_types.py@@ -21,6 +21,8 @@ class OfflineReadQuery:date_to: datetime | None = Nonesearch: str | None = Nonerun_source: str | None = None+ created_by: int | None = None+ created_by_is_null: bool = Falserun_source_is_null: bool = Falsestatuses: tuple[str, ...] | None = Nonesuite_key: str | None = None@@ -36,6 +38,8 @@ class OfflineReadQuery:tag_match: Literal["any", "all"] = "any"def __post_init__(self) -> None:+ if self.created_by is not None and self.created_by_is_null:+ raise OfflineEvaluationValidationError("created_by", "Choose an author or no author, not both.")if not 1 <= self.limit <= 100:raise OfflineEvaluationValidationError("limit", "Use a page size between 1 and 100.")if len(self.scorer_version_ids) > MAX_READ_SCORER_VERSIONS or len(set(self.scorer_version_ids)) != len(@@ -62,9 +66,23 @@ class OfflineResultCellQuery:raise OfflineEvaluationValidationError(name, f"Select between 1 and {limit} distinct UUIDs.")+@frozen+class OfflineExperimentAuthor:+ id: int+ uuid: UUID+ distinct_id: str | None+ first_name: str+ last_name: str+ email: str+ is_email_verified: bool | None+ hedgehog_config: dict[str, JSONValue] | None+ role_at_organization: str | None++@frozenclass OfflineExperimentRead:tags: tuple[str, ...] = ()+ created_by: OfflineExperimentAuthor | None = Noneid: UUIDname: strrun_source: str | Nonediff --git a/products/ai_observability/backend/offline_evaluation_service.py b/products/ai_observability/backend/offline_evaluation_service.pyindex 14e78268e961..04dd1d51067e 100644--- a/products/ai_observability/backend/offline_evaluation_service.py+++ b/products/ai_observability/backend/offline_evaluation_service.py@@ -209,7 +209,7 @@ class OfflineExperimentService(_OfflineEvaluationService):raise OfflineEvaluationValidationError.from_errors(errors)return fields- def create(self, submission: ExperimentSubmission) -> ExperimentReceipt:+ def create(self, submission: ExperimentSubmission, *, created_by_id: int | None = None) -> ExperimentReceipt:fingerprint = submission_fingerprint(submission)try:with transaction.atomic():@@ -222,7 +222,12 @@ class OfflineExperimentService(_OfflineEvaluationService):fields.pop("id")experiment, created = experiments.get_or_create(id=submission.id,- defaults={**fields, "team_id": self.team_id, "submission_fingerprint": fingerprint},+ defaults={+ **fields,+ "team_id": self.team_id,+ "submission_fingerprint": fingerprint,+ "created_by_id": created_by_id,+ },)_check_fingerprint(experiment.submission_fingerprint, fingerprint, field="id")receipt = ExperimentReceipt(diff --git a/products/ai_observability/frontend/generated/api.schemas.ts b/products/ai_observability/frontend/generated/api.schemas.tsindex bf167846c394..1288a51216b2 100644--- a/products/ai_observability/frontend/generated/api.schemas.ts+++ b/products/ai_observability/frontend/generated/api.schemas.ts@@ -294,6 +294,63 @@ export interface InstrumentationCheckActionApi {check: AIObservabilityInstrumentationCheckEnumApi}+/**+ * * `engineering` - Engineering+ * * `data` - Data+ * * `product` - Product Management+ * * `founder` - Founder+ * * `leadership` - Leadership+ * * `marketing` - Marketing+ * * `sales` - Sales / Success+ * * `student` - Student+ * * `other` - Other+ */+export type RoleAtOrganizationEnumApi = (typeof RoleAtOrganizationEnumApi)[keyof typeof RoleAtOrganizationEnumApi]++export const RoleAtOrganizationEnumApi = {+ Engineering: 'engineering',+ Data: 'data',+ Product: 'product',+ Founder: 'founder',+ Leadership: 'leadership',+ Marketing: 'marketing',+ Sales: 'sales',+ Student: 'student',+ Other: 'other',+} as const++export type BlankEnumApi = (typeof BlankEnumApi)[keyof typeof BlankEnumApi]++export const BlankEnumApi = {+ '': '',+} as const++/**+ * @nullable+ */+export type UserBasicApiHedgehogConfig = { [key: string]: unknown } | null++export interface UserBasicApi {+ readonly id: number+ readonly uuid: string+ /**+ * @maxLength 200+ * @nullable+ */+ distinct_id?: string | null+ /** @maxLength 150 */+ first_name?: string+ /** @maxLength 150 */+ last_name?: string+ /** @maxLength 254 */+ email: string+ /** @nullable */+ is_email_verified?: boolean | null+ /** @nullable */+ readonly hedgehog_config: UserBasicApiHedgehogConfig+ role_at_organization?: RoleAtOrganizationEnumApi | BlankEnumApi | null+}+/*** * `ci` - CI* * `local` - Local@@ -323,6 +380,8 @@ export const OfflineExperimentStatusEnumApi = {} as constexport interface OfflineExperimentReadApi {+ /** User who submitted the experiment, or null for service credentials. */+ readonly created_by: UserBasicApi | null/** Project tag names assigned to this experiment. */tags: string[]/** Stable experiment UUID. */@@ -1384,63 +1443,6 @@ export interface TraceNodeDetailApi {export type DatasetJSONValueApi = { [key: string]: unknown } | unknown[] | string | number | boolean-/**- * * `engineering` - Engineering- * * `data` - Data- * * `product` - Product Management- * * `founder` - Founder- * * `leadership` - Leadership- * * `marketing` - Marketing- * * `sales` - Sales / Success- * * `student` - Student- * * `other` - Other- */-export type RoleAtOrganizationEnumApi = (typeof RoleAtOrganizationEnumApi)[keyof typeof RoleAtOrganizationEnumApi]--export const RoleAtOrganizationEnumApi = {- Engineering: 'engineering',- Data: 'data',- Product: 'product',- Founder: 'founder',- Leadership: 'leadership',- Marketing: 'marketing',- Sales: 'sales',- Student: 'student',- Other: 'other',-} as const--export type BlankEnumApi = (typeof BlankEnumApi)[keyof typeof BlankEnumApi]--export const BlankEnumApi = {- '': '',-} as const--/**- * @nullable- */-export type UserBasicApiHedgehogConfig = { [key: string]: unknown } | null--export interface UserBasicApi {- readonly id: number- readonly uuid: string- /**- * @maxLength 200- * @nullable- */- distinct_id?: string | null- /** @maxLength 150 */- first_name?: string- /** @maxLength 150 */- last_name?: string- /** @maxLength 254 */- email: string- /** @nullable */- is_email_verified?: boolean | null- /** @nullable */- readonly hedgehog_config: UserBasicApiHedgehogConfig- role_at_organization?: RoleAtOrganizationEnumApi | BlankEnumApi | null-}-/*** JSON object with item metadata.*/@@ -3755,6 +3757,8 @@ export interface ScoreDefinitionApi {readonly created_at: string/** @nullable */readonly updated_at: string | null+ /** User who last updated the scorer or created a version. */+ readonly updated_by: UserBasicApi | nullreadonly team: number}@@ -4801,6 +4805,15 @@ export type AiObservabilityOfflineExperimentsListParams = {* @maxLength 255*/application_version?: string+ /**+ * Filter experiments by the author's user ID.+ * @minimum 1+ */+ created_by?: number+ /**+ * Only include experiments without an author.+ */+ created_by_is_null?: boolean/*** Continuation cursor returned by the previous page.* @minLength 1@@ -5000,6 +5013,15 @@ export type AiObservabilityOfflineScorersHistoryListParams = {* @maxLength 255*/application_version?: string+ /**+ * Filter experiments by the author's user ID.+ * @minimum 1+ */+ created_by?: number+ /**+ * Only include experiments without an author.+ */+ created_by_is_null?: boolean/*** Continuation cursor returned by the previous page.* @minLength 1@@ -5474,6 +5496,10 @@ export type LlmAnalyticsScoreDefinitionsListParams = {* Filter by archived state.*/archived?: boolean+ /**+ * Filter by the creator's user ID.+ */+ created_by?: number/*** Filter by scorer kind.*/diff --git a/products/ai_observability/frontend/offline-evaluations/OfflineExperimentsOverview.stories.tsx b/products/ai_observability/frontend/offline-evaluations/OfflineExperimentsOverview.stories.tsxindex 227859e77737..612f260e7db0 100644--- a/products/ai_observability/frontend/offline-evaluations/OfflineExperimentsOverview.stories.tsx+++ b/products/ai_observability/frontend/offline-evaluations/OfflineExperimentsOverview.stories.tsx@@ -66,7 +66,7 @@ export const PartialHistory: Story = {get: {'/api/projects/:team/ai_observability/offline_scorers/:id/history/': {count: 200,- next_cursor: 'older-results',+ next_cursor: null,results: overviewHistory(overviewScorers[0]),},},diff --git a/products/ai_observability/frontend/offline-evaluations/OfflineExperimentsOverview.tsx b/products/ai_observability/frontend/offline-evaluations/OfflineExperimentsOverview.tsxindex ed5074e5f3c6..cfb2bbde679f 100644--- a/products/ai_observability/frontend/offline-evaluations/OfflineExperimentsOverview.tsx+++ b/products/ai_observability/frontend/offline-evaluations/OfflineExperimentsOverview.tsx@@ -13,10 +13,14 @@ import {} from '@posthog/lemon-ui'import { DateFilter } from 'lib/components/DateFilter/DateFilter'+import { MemberSelect } from 'lib/components/MemberSelect'import { TZLabel } from 'lib/components/TZLabel'import type { LemonTableColumns } from 'lib/lemon-ui/LemonTable'+import { ProfilePicture } from 'lib/lemon-ui/ProfilePicture'import { urls } from 'scenes/urls'+import type { UserBasicType } from '~/types'+import { ResourceTagFilter } from '../components/ResourceTagFilter'import { cleanTagFilters } from '../components/resourceTagFilters'import { ResourceTags } from '../components/ResourceTags'@@ -51,7 +55,7 @@ export function OfflineExperimentsOverview(props: OfflineExperimentsLogicProps):title: 'Experiment',key: 'name',className: '@max-[50rem]:w-1/3',- width: '22%',+ width: '19%',render: (_, experiment) => (<Tooltip title={`${experiment.name} · ${experiment.id}`}><Link@@ -67,7 +71,7 @@ export function OfflineExperimentsOverview(props: OfflineExperimentsLogicProps):{title: 'Tags',key: 'tags',- width: '25%',+ width: '19%',render: (_, experiment) => (<ResourceTagsentity="experiments"@@ -78,6 +82,18 @@ export function OfflineExperimentsOverview(props: OfflineExperimentsLogicProps):/>),},+ {+ title: 'Author',+ key: 'created_by',+ width: '18%',+ className: '[&_.profile-package]:max-w-full [&_.profile-name]:truncate',+ render: (_, experiment) =>+ experiment.created_by ? (+ <ProfilePicture user={experiment.created_by as UserBasicType} size="md" showName />+ ) : (+ <span className="text-muted">No author</span>+ ),+ },{title: 'Execution',key: 'execution',@@ -93,7 +109,7 @@ export function OfflineExperimentsOverview(props: OfflineExperimentsLogicProps):title: 'Source',key: 'source',className: '@max-[50rem]:hidden',- width: '12%',+ width: '10%',render: (_, experiment) => (<Tooltip title={offlineRunSourceLabel(experiment.run_source)}><span className="block truncate">{offlineRunSourceLabel(experiment.run_source)}</span>@@ -103,14 +119,14 @@ export function OfflineExperimentsOverview(props: OfflineExperimentsLogicProps):{title: 'Upload',key: 'status',- width: '12%',+ width: '10%',render: (_, experiment) => <OfflineExperimentStatus status={experiment.status} />,},{title: <Tooltip title="Result and scorer counts include only results you can access.">Coverage</Tooltip>,key: 'coverage',className: '@max-[40rem]:hidden',- width: '15%',+ width: '10%',render: (_, experiment) => (<Tooltiptitle={[@@ -149,6 +165,7 @@ export function OfflineExperimentsOverview(props: OfflineExperimentsLogicProps):<div className="@container space-y-6 min-w-0"><div aria-label="Experiment filters" className="flex flex-wrap items-center gap-2"><DateFilter+ size="medium"dateFrom={filters.date_from || '-30d'}dateTo={filters.date_to || null}onChange={(dateFrom, dateTo) =>@@ -181,6 +198,28 @@ export function OfflineExperimentsOverview(props: OfflineExperimentsLogicProps):]}/><ResourceTagFilter filters={cleanTagFilters(filters)} onChange={setFilters} />+ <div data-attr="offline-experiments-author-filter">+ <MemberSelect+ value={filters.created_by ?? null}+ size="medium"+ defaultLabel="Any author"+ extraOptions={[+ {+ label: 'No author',+ onClick: () => setFilters({ created_by: undefined, created_by_is_null: true }),+ },+ ]}+ onChange={(user) => setFilters({ created_by: user?.id, created_by_is_null: undefined })}+ >+ {filters.created_by_is_null+ ? () => (+ <LemonButton type="secondary" size="medium">+ No author+ </LemonButton>+ )+ : undefined}+ </MemberSelect>+ </div><LemonButtontype="secondary"icon={<IconRefresh />}diff --git a/products/ai_observability/frontend/offline-evaluations/OfflineOverviewTrend.test.tsx b/products/ai_observability/frontend/offline-evaluations/OfflineOverviewTrend.test.tsxindex 9b6aa4b68ff1..0f35cf67c5e4 100644--- a/products/ai_observability/frontend/offline-evaluations/OfflineOverviewTrend.test.tsx+++ b/products/ai_observability/frontend/offline-evaluations/OfflineOverviewTrend.test.tsx@@ -25,11 +25,21 @@ describe('OfflineOverviewTrend', () => {it.each([false, true])('discloses incomplete history only when the results are partial (%s)', async (partial) => {const scorer = overviewScorers[0]const results = overviewHistory(scorer)- jest.mocked(api.llmAnalyticsScoreDefinitionsRetrieve).mockResolvedValue(scorer)- jest.mocked(api.aiObservabilityOfflineScorersHistoryList).mockResolvedValue({- results,- count: partial ? 200 : results.length,- next_cursor: partial ? 'older-results' : null,+ jest.mocked(api.llmAnalyticsScoreDefinitionsRetrieve).mockResolvedValue({+ ...scorer,+ current_version: 3,+ current_version_id: 'newer-version-with-no-results',+ })+ jest.mocked(api.aiObservabilityOfflineScorersHistoryList).mockImplementation(async (_team, _scorer, query) => {+ const pageIndex = Number(query?.cursor || 0)+ return {+ results: results.map((point) => ({+ ...point,+ experiment: { ...point.experiment, id: `${point.experiment.id}-${pageIndex}` },+ })),+ count: partial ? 200 : results.length,+ next_cursor: partial ? String(pageIndex + 1) : null,+ }})render(@@ -44,11 +54,17 @@ describe('OfflineOverviewTrend', () => {)await screen.findByText(scorer.name)+ expect(screen.getByText(scorer.name).closest('a')).toHaveAttribute(+ 'href',+ expect.stringContaining(`version=${results[0].summary.scorer.id}`)+ )expect(screen.getByText('0.851667')).toBeInTheDocument()- expect(screen.getByText('6 experiments (570 items)')).toBeInTheDocument()+ expect(+ screen.getByText(partial ? '30 experiments (2850 items)' : '6 experiments (570 items)')+ ).toBeInTheDocument()expect(screen.getByText('Mean score')).toBeInTheDocument()if (partial) {- expect(screen.getByText(/6 of 200 experiment\/version results.*Partial history/)).toBeInTheDocument()+ expect(screen.getByText(/30 of 200 experiment\/version results.*Partial history/)).toBeInTheDocument()expect(screen.getByText('Earlier experiments and scorer versions may not be shown.')).toBeInTheDocument()} else {expect(screen.queryByText(/Partial history/)).not.toBeInTheDocument()diff --git a/products/ai_observability/frontend/offline-evaluations/OfflineOverviewTrend.tsx b/products/ai_observability/frontend/offline-evaluations/OfflineOverviewTrend.tsxindex 4817958b7a8f..8a0cc195fa7d 100644--- a/products/ai_observability/frontend/offline-evaluations/OfflineOverviewTrend.tsx+++ b/products/ai_observability/frontend/offline-evaluations/OfflineOverviewTrend.tsx@@ -22,9 +22,9 @@ export function OfflineOverviewTrend(): JSX.Element {const { overviewLogic, ...trendProps } = propsconst logic = offlineOverviewTrendLogic(trendProps)- const { trend, trendLoading, trendError, versions, activeVersion, versionPoints, periodSummary } = useValues(logic)+ const { trend, trendLoading, trendError, points, versionSummaries, periodSummary } = useValues(logic)const { loadOfflineOverviewTrend, selectVersion } = useActions(logic)- const versionIndex = versions.findIndex((version) => version.id === activeVersion?.id)+ const versionIndex = versionSummaries.findIndex((summary) => summary.scorer.id === periodSummary?.scorer.id)const hasPartialHistory = !!trend && trend.page.count > trend.page.results.lengthconst scoredItemCount = periodSummary? periodSummary.pass_count != null && periodSummary.fail_count != null@@ -48,7 +48,7 @@ export function OfflineOverviewTrend(to={combineUrl(urls.aiObservabilityOfflineScorerHistory(props.scorerId), {...props.filters,- version: activeVersion?.id,+ version: periodSummary?.scorer.id,date_from: props.dateFrom || 'all',date_to: props.dateTo,}).url@@ -59,41 +59,44 @@ export function OfflineOverviewTrend(</Link></h3><LemonTag type="muted">{trend.definition.kind}</LemonTag>- {versions.length > 1 && activeVersion && (+ {periodSummary && (<div className="flex items-center gap-1 ml-auto">- <LemonButton- size="xsmall"- type="tertiary"- icon={<IconChevronLeft />}- aria-label="Older scorer version"- tooltip="Older version"- disabledReason={- versionIndex === versions.length - 1- ? hasPartialHistory- ? 'Oldest loaded version'- : 'Oldest version in this period'- : undefined- }- onClick={() => selectVersion(versions[versionIndex + 1].id)}- data-attr="offline-score-older-version"- />- <span className="text-xs text-muted tabular-nums">{`v${activeVersion.version}`}</span>- <LemonButton- size="xsmall"- type="tertiary"- icon={<IconChevronRight />}- aria-label="Newer scorer version"- tooltip="Newer version"- disabledReason={- versionIndex === 0- ? hasPartialHistory- ? 'Newest loaded version'- : 'Newest version in this period'- : undefined- }- onClick={() => selectVersion(versions[versionIndex - 1].id)}- data-attr="offline-score-newer-version"- />+ {versionSummaries.length > 1 && (+ <LemonButton+ size="xsmall"+ type="tertiary"+ icon={<IconChevronLeft />}+ aria-label="Older scorer version"+ tooltip="Show summary for older version"+ disabledReason={+ versionIndex === versionSummaries.length - 1+ ? 'Oldest version in this period'+ : undefined+ }+ onClick={() => selectVersion(versionSummaries[versionIndex + 1].scorer.id)}+ data-attr="offline-score-older-version"+ />+ )}+ <span+ className="text-xs text-muted tabular-nums"+ data-attr="offline-score-summary-version"+ >+ {`v${periodSummary.scorer.version}`}+ </span>+ {versionSummaries.length > 1 && (+ <LemonButton+ size="xsmall"+ type="tertiary"+ icon={<IconChevronRight />}+ aria-label="Newer scorer version"+ tooltip="Show summary for newer version"+ disabledReason={+ versionIndex === 0 ? 'Newest version in this period' : undefined+ }+ onClick={() => selectVersion(versionSummaries[versionIndex - 1].scorer.id)}+ data-attr="offline-score-newer-version"+ />+ )}</div>)}</div>@@ -109,10 +112,11 @@ export function OfflineOverviewTrend(<p className="mb-0">Earlier experiments and scorer versions may not be shown.</p></div>)}- {versionPoints.length ? (+ {points.length ? (<OfflineScoreTrendChartheightClassName="h-36"showHeading={false}+ combineVersionshoverLogic={overviewLogic}xDomain={props.xDomain}colorOffset={props.colorOffset}@@ -121,7 +125,7 @@ export function OfflineOverviewTrend({key: 'overview',label: 'Experiments',- points: versionPoints,+ points,dateFrom: props.dateFrom,dateTo: props.dateTo,},diff --git a/products/ai_observability/frontend/offline-evaluations/OfflineScoreTrendChart.tsx b/products/ai_observability/frontend/offline-evaluations/OfflineScoreTrendChart.tsxindex 83fa050eb874..c3b68a5a3127 100644--- a/products/ai_observability/frontend/offline-evaluations/OfflineScoreTrendChart.tsx+++ b/products/ai_observability/frontend/offline-evaluations/OfflineScoreTrendChart.tsx@@ -29,6 +29,7 @@ export interface OfflineScoreTrendChartProps {hoverLogic?: BuiltLogic<offlineExperimentsLogicType>xDomain?: [number, number]showHeading?: boolean+ combineVersions?: boolean}export function OfflineScoreTrendChart({@@ -40,6 +41,7 @@ export function OfflineScoreTrendChart({hoverLogic,xDomain,showHeading = true,+ combineVersions = false,}: OfflineScoreTrendChartProps): JSX.Element {const baseTheme = useChartTheme()const theme = useMemo(@@ -53,7 +55,7 @@ export function OfflineScoreTrendChart({)const panels = useMemo(() =>- buildOfflineTrendPanels(periods).map((panel) => {+ buildOfflineTrendPanels(periods, combineVersions).map((panel) => {const domain = !panel.elapsed && xDomain ? xDomain : panel.xDomainreturn {...panel,@@ -61,7 +63,7 @@ export function OfflineScoreTrendChart({tickFormatter: createOfflineScoreTrendTickFormatter(domain, panel.elapsed, timezone),}}),- [periods, xDomain, timezone]+ [periods, xDomain, timezone, combineVersions])if (panels.length === 0) {diff --git a/products/ai_observability/frontend/offline-evaluations/OfflineScorerHistory.tsx b/products/ai_observability/frontend/offline-evaluations/OfflineScorerHistory.tsxindex 689edd6cd43d..630b8a918b7d 100644--- a/products/ai_observability/frontend/offline-evaluations/OfflineScorerHistory.tsx+++ b/products/ai_observability/frontend/offline-evaluations/OfflineScorerHistory.tsx@@ -6,6 +6,7 @@ import { LemonBanner, LemonButton, LemonCard, LemonLabel, LemonSelect, LemonTag,import { AccessControlAction } from 'lib/components/AccessControlAction'import { DateFilter } from 'lib/components/DateFilter/DateFilter'+import { MemberSelect } from 'lib/components/MemberSelect'import { TZLabel } from 'lib/components/TZLabel'import { urls } from 'scenes/urls'@@ -139,6 +140,32 @@ export function OfflineScorerHistory(props: OfflineScorerHistoryProps): JSX.Elem<LemonLabel>Tags</LemonLabel><ResourceTagFilter filters={filters} onChange={setFilters} /></div>+ <div data-attr="offline-history-author-filter">+ <LemonLabel>Author</LemonLabel>+ <MemberSelect+ value={filters.created_by ?? null}+ size="medium"+ defaultLabel="Any author"+ extraOptions={[+ {+ label: 'No author',+ onClick: () =>+ setFilters({ created_by: undefined, created_by_is_null: true }),+ },+ ]}+ onChange={(user) =>+ setFilters({ created_by: user?.id, created_by_is_null: undefined })+ }+ >+ {filters.created_by_is_null+ ? () => (+ <LemonButton type="secondary" size="medium">+ No author+ </LemonButton>+ )+ : undefined}+ </MemberSelect>+ </div><div><LemonLabel>Version</LemonLabel><LemonSelectdiff --git a/products/ai_observability/frontend/offline-evaluations/offlineExperimentsLogic.ts b/products/ai_observability/frontend/offline-evaluations/offlineExperimentsLogic.tsindex 5e83509d3697..f5941af6f903 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineExperimentsLogic.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineExperimentsLogic.ts@@ -447,6 +447,8 @@ export const offlineExperimentsLogic: LogicWrapper<offlineExperimentsLogicType>(s) => [s.filters],(filters: OfflineExperimentFilters): OfflineOverviewTrendFilters => ({run_source: filters.run_source,+ created_by: filters.created_by,+ created_by_is_null: filters.created_by_is_null,statuses: filters.statuses || OFFLINE_ALL_UPLOAD_STATES,tags: JSON.stringify(filters.tags || []),tag_match: filters.tag_match || 'any',@@ -494,6 +496,8 @@ export const offlineExperimentsLogic: LogicWrapper<offlineExperimentsLogicType>trend.query.dateTo !== dateRange.dateTo ||trend.query.refreshKey !== refreshKey ||trend.query.filters?.run_source !== filters.run_source ||+ trend.query.filters?.created_by !== filters.created_by ||+ trend.query.filters?.created_by_is_null !== filters.created_by_is_null ||(trend.query.filters?.statuses || OFFLINE_ALL_UPLOAD_STATES) !== filters.statuses ||(trend.query.filters?.tags || '[]') !== filters.tags ||(trend.query.filters?.tag_match || 'any') !== filters.tag_matchdiff --git a/products/ai_observability/frontend/offline-evaluations/offlineOverviewFixtures.ts b/products/ai_observability/frontend/offline-evaluations/offlineOverviewFixtures.tsindex b32f36a60570..47223c9bf3c7 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineOverviewFixtures.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineOverviewFixtures.ts@@ -20,6 +20,7 @@ export const overviewScorers: ScoreDefinitionApi[] = ['Answer quality', 'Grounde},created_by: null,created_at: '2026-09-01T12:00:00Z',+ updated_by: null,updated_at: '2026-09-20T12:00:00Z',team: 997,})@@ -32,6 +33,7 @@ export const overviewExperiments: OfflineExperimentReadApi[] = Array.from({ lengrun_source: index % 3 === 0 ? 'ci' : index % 3 === 1 ? 'local' : null,status: index === 0 ? 'uploading' : index === 3 ? 'failed' : 'completed',started_at: `2026-09-${String(27 - index).padStart(2, '0')}T14:30:00Z`,+ created_by: null,created_at: `2026-09-${String(27 - index).padStart(2, '0')}T14:32:00Z`,finished_at: index === 0 ? null : `2026-09-${String(27 - index).padStart(2, '0')}T14:33:00Z`,expected_item_count: 100,diff --git a/products/ai_observability/frontend/offline-evaluations/offlineOverviewState.test.ts b/products/ai_observability/frontend/offline-evaluations/offlineOverviewState.test.tsindex e75f460c1abe..cc5957638a0d 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineOverviewState.test.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineOverviewState.test.ts@@ -51,8 +51,17 @@ describe('offline overview preferences', () => {})it.each(['00123', 'true', '[draft]'])('keeps the experiment search %p in shared URLs', (search) => {- const url = encodeParams(offlineFiltersToUrl({ search, date_from: '-7d' }), '?')- expect(offlineFiltersFromUrl(decodeParams(url, '?'))).toEqual({ search, date_from: '-7d' })+ const url = encodeParams(offlineFiltersToUrl({ search, date_from: '-7d', created_by: 42 }), '?')+ expect(offlineFiltersFromUrl(decodeParams(url, '?'))).toEqual({ search, date_from: '-7d', created_by: 42 })+ })++ it('keeps the no-author filter in shared URLs and clears it for any author', () => {+ const url = encodeParams(offlineFiltersToUrl({ created_by_is_null: true }), '?')+ expect(offlineFiltersFromUrl(decodeParams(url, '?'))).toEqual({ created_by_is_null: true })+ expect(offlineFiltersFromUrl({ created_by_is_null: false })).toEqual({})+ expect(offlineFiltersFromUrl({ created_by_is_null: true, created_by: 42 })).toEqual({+ created_by_is_null: true,+ })})it.each([diff --git a/products/ai_observability/frontend/offline-evaluations/offlineOverviewState.ts b/products/ai_observability/frontend/offline-evaluations/offlineOverviewState.tsindex 968d2a83ce06..940682b6b6de 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineOverviewState.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineOverviewState.ts@@ -8,13 +8,13 @@ import type {export type OfflineExperimentFilters = Pick<AiObservabilityOfflineExperimentsListParams,- 'search' | 'statuses' | 'run_source' | 'date_from' | 'date_to'+ 'search' | 'statuses' | 'run_source' | 'date_from' | 'date_to' | 'created_by' | 'created_by_is_null'> &Partial<ResourceTagFilters>export type OfflineOverviewTrendFilters = Pick<AiObservabilityOfflineScorersHistoryListParams,- 'run_source' | 'statuses' | 'tags' | 'tag_match'+ 'run_source' | 'statuses' | 'tags' | 'tag_match' | 'created_by' | 'created_by_is_null'>export const OFFLINE_ALL_UPLOAD_STATES = 'completed,uploading,failed'@@ -61,6 +61,7 @@ export function saveOfflineScorerPreferences(userId: number, teamId: number, sco}export function offlineFiltersFromUrl(search: Record<string, unknown>): OfflineExperimentFilters {+ const noAuthor = search.created_by_is_null === true || search.created_by_is_null === 'true'// Keep shared links from the separate trend controls usable with the unified filters.const shared: Record<string, unknown> = {...search,@@ -69,6 +70,10 @@ export function offlineFiltersFromUrl(search: Record<string, unknown>): OfflineErun_source: search.run_source ?? search.trend_run_source,}return {+ ...(noAuthor ? { created_by_is_null: true } : {}),+ ...(!noAuthor && Number.isSafeInteger(Number(search.created_by)) && Number(search.created_by) > 0+ ? { created_by: Number(search.created_by) }+ : {}),...('tags' in search || 'tag_match' in search ? cleanTagFilters(search) : {}),...Object.fromEntries(FILTER_KEYS.flatMap((key) => {diff --git a/products/ai_observability/frontend/offline-evaluations/offlineOverviewTrendLogic.test.ts b/products/ai_observability/frontend/offline-evaluations/offlineOverviewTrendLogic.test.tsindex ddf9b1a561e2..16c9405b0042 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineOverviewTrendLogic.test.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineOverviewTrendLogic.test.ts@@ -24,7 +24,7 @@ const props = {dateTo: '2026-09-28T00:00:00Z',refreshKey: 0,}-const page: OfflineHistoryPageApi = { results: overviewHistory(overviewScorers[0]), count: 100, next_cursor: 'older' }+const page: OfflineHistoryPageApi = { results: overviewHistory(overviewScorers[0]), count: 6, next_cursor: null }const retrieve = jest.mocked(api.llmAnalyticsScoreDefinitionsRetrieve)const history = jest.mocked(api.aiObservabilityOfflineScorersHistoryList)@@ -131,7 +131,7 @@ describe('offlineOverviewTrendLogic', () => {})- it('shows one version at a time and falls back when it has no results in the new window', async () => {+ it('loads every version for the graph while navigating summaries independently, defaulting to the latest', async () => {const overviewLogic = mountOverview()const trendProps = {...props,@@ -148,22 +148,26 @@ describe('offlineOverviewTrendLogic', () => {scorer: { ...point.summary.scorer, id: 'older-version', version: 1 },},}))- history.mockResolvedValueOnce({ ...page, results: [...olderPoints, ...page.results] })+ history+ .mockResolvedValueOnce({ ...page, count: 8, next_cursor: 'older' })+ .mockResolvedValueOnce({ results: olderPoints, count: 8, next_cursor: null })const logic = offlineOverviewTrendLogic(trendProps)logic.mount()await expectLogic(logic).toFinishAllListeners()- expect(logic.values.activeVersion?.version).toBe(2)- expect(logic.values.versionPoints).toEqual(page.results)- expect(logic.values.periodSummary?.experimentCount).toBe(6)+ expect(logic.values.points).toEqual([...page.results, ...olderPoints])+ expect(logic.values.versionSummaries.map((summary) => summary.scorer.version)).toEqual([2, 1])+ expect(logic.values.periodSummary?.scorer.version).toBe(2)expect(logic.values.periodSummary?.mean).toBeCloseTo(0.851667)- const sharedDomain = [Date.parse('2026-08-01T00:00:00Z'), Date.parse(props.dateTo)]- expect(overviewLogic.values.trendXDomain).toEqual(sharedDomain)logic.actions.selectVersion('older-version')- expect(logic.values.versionPoints).toEqual(olderPoints)- expect(logic.values.periodSummary?.experimentCount).toBe(2)+ expect(logic.values.periodSummary?.scorer.version).toBe(1)expect(logic.values.periodSummary?.mean).toBe(0.25)- expect(overviewLogic.values.trendXDomain).toEqual(sharedDomain)+ expect(logic.values.points).toEqual([...page.results, ...olderPoints])+ expect(history).toHaveBeenLastCalledWith('997', props.scorerId, expect.objectContaining({ cursor: 'older' }))+ expect(overviewLogic.values.trendXDomain).toEqual([+ Date.parse('2026-08-01T00:00:00Z'),+ Date.parse(props.dateTo),+ ])history.mockResolvedValueOnce({ results: page.results.slice(0, 1), count: 1, next_cursor: null })overviewLogic.actions.setFilters({ date_from: '2026-09-20T00:00:00Z' })@@ -172,17 +176,49 @@ describe('offlineOverviewTrendLogic', () => {dateFrom: '2026-09-20T00:00:00Z',})await expectLogic(logic).toFinishAllListeners()- expect(logic.values.activeVersion?.version).toBe(2)- expect(logic.values.versionPoints).toEqual(page.results.slice(0, 1))- expect(logic.values.periodSummary?.experimentCount).toBe(1)- expect(logic.values.periodSummary?.mean).toBe(0.64)+ expect(logic.values.versionSummaries.map((summary) => summary.scorer.version)).toEqual([2])+ expect(logic.values.periodSummary?.scorer.version).toBe(2)+ expect(logic.values.points).toEqual(page.results.slice(0, 1))+ expect(logic.values.versionSummaries[0]?.experimentCount).toBe(1)+ expect(logic.values.versionSummaries[0]?.mean).toBe(0.64)+ })++ it('bounds large histories and releases read slots for queued scorers', async () => {+ history.mockImplementation(async (_teamId, scorerId, query) => {+ const offset = Number(query?.cursor || 0)+ return {+ results: Array.from({ length: 100 }, (_, index) => ({+ ...page.results[0],+ experiment: { ...page.results[0].experiment, id: `${scorerId}-${offset + index}` },+ })),+ count: 1000,+ next_cursor: String(offset + 100),+ }+ })+ const logics = Array.from({ length: 4 }, (_, index) =>+ offlineOverviewTrendLogic({ ...props, scorerId: `busy-scorer-${index}`, dateFrom: undefined })+ )+ logics.forEach((logic) => logic.mount())+ await Promise.all(logics.map((logic) => expectLogic(logic).toFinishAllListeners()))++ for (const logic of logics) {+ expect(logic.values.trendLoading).toBe(false)+ expect(logic.values.points).toHaveLength(500)+ expect(logic.values.trend?.page).toMatchObject({ count: 1000, next_cursor: '500' })+ }})it('reloads shared filters including tag-only changes within the same frozen date range', async () => {const logic = offlineOverviewTrendLogic({ ...props, filters: { run_source: 'local' } })logic.mount()await expectLogic(logic).toFinishAllListeners()- const filters = { run_source: 'ci', statuses: 'failed', tags: '["quality"]', tag_match: 'any' as const }+ const filters = {+ run_source: 'ci',+ created_by_is_null: true,+ statuses: 'failed',+ tags: '["quality"]',+ tag_match: 'any' as const,+ }offlineOverviewTrendLogic({ ...props, filters })await expectLogic(logic).toFinishAllListeners()diff --git a/products/ai_observability/frontend/offline-evaluations/offlineOverviewTrendLogic.ts b/products/ai_observability/frontend/offline-evaluations/offlineOverviewTrendLogic.tsindex 21b4e4c82c40..0ccdfbb1d0b2 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineOverviewTrendLogic.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineOverviewTrendLogic.ts@@ -16,12 +16,7 @@ import { loaders } from 'kea-loaders'import { objectsEqual } from 'lib/utils/objects'import * as api from '../generated/api'-import type {- OfflineHistoryPageApi,- OfflineHistoryPointApi,- OfflineScorerVersionReadApi,- ScoreDefinitionApi,-} from '../generated/api.schemas'+import type { OfflineHistoryPageApi, OfflineHistoryPointApi, ScoreDefinitionApi } from '../generated/api.schemas'import {OFFLINE_ALL_UPLOAD_STATES,withOfflineTrendReadLimit,@@ -53,6 +48,7 @@ export interface OfflineOverviewTrendResult {export type OfflineOverviewTrendState = Pick<offlineOverviewTrendLogicValues, 'trend' | 'trendLoading' | 'trendError'>const EMPTY_TREND_STATES: Record<string, OfflineOverviewTrendState> = {}+const MAX_HISTORY_PAGES = 5export function getOfflineOverviewTrendKey({teamId,@@ -70,14 +66,13 @@ export function selectOfflineOverviewTrendStates(state: {// Generated by kea-typegen. Update if you're an agent, ignore if you're human.export interface offlineOverviewTrendLogicValues {- activeVersion: OfflineScorerVersionReadApi | nullperiodSummary: OfflineScoreHistorySummary | null+ points: OfflineHistoryPointApi[]selectedVersionId: string | nulltrend: OfflineOverviewTrendResult | nulltrendError: booleantrendLoading: boolean- versionPoints: OfflineHistoryPointApi[]- versions: OfflineScorerVersionReadApi[]+ versionSummaries: OfflineScoreHistorySummary[]}// Generated by kea-typegen. Update if you're an agent, ignore if you're human.@@ -106,16 +101,12 @@ export interface offlineOverviewTrendLogicActions {export interface offlineOverviewTrendLogicMeta {key: string__keaTypeGenInternalSelectorTypes: {- versions: (trend: OfflineOverviewTrendResult | null) => OfflineScorerVersionReadApi[]- activeVersion: (- versions: OfflineScorerVersionReadApi[],+ points: (trend: OfflineOverviewTrendResult | null) => OfflineHistoryPointApi[]+ versionSummaries: (points: OfflineHistoryPointApi[]) => OfflineScoreHistorySummary[]+ periodSummary: (+ versionSummaries: OfflineScoreHistorySummary[],selectedVersionId: string | null- ) => OfflineScorerVersionReadApi | null- versionPoints: (- trend: OfflineOverviewTrendResult | null,- activeVersion: OfflineScorerVersionReadApi | null- ) => OfflineHistoryPointApi[]- periodSummary: (versionPoints: OfflineHistoryPointApi[]) => OfflineScoreHistorySummary | null+ ) => OfflineScoreHistorySummary | null}}@@ -154,7 +145,7 @@ export const offlineOverviewTrendLogic: LogicWrapper<offlineOverviewTrendLogicTyprops.scorerId)breakpoint()- const page = await api.aiObservabilityOfflineScorersHistoryList(+ let page = await api.aiObservabilityOfflineScorersHistoryList(String(props.teamId),props.scorerId,{@@ -166,7 +157,28 @@ export const offlineOverviewTrendLogic: LogicWrapper<offlineOverviewTrendLogicTy})breakpoint()- return { definition, page, query }+ const results = [...page.results]+ for (+ let pagesLoaded = 1;+ page.next_cursor && pagesLoaded < MAX_HISTORY_PAGES;+ pagesLoaded+++ ) {+ page = await api.aiObservabilityOfflineScorersHistoryList(+ String(props.teamId),+ props.scorerId,+ {+ ...props.filters,+ date_from: props.dateFrom,+ date_to: props.dateTo,+ statuses: props.filters?.statuses || OFFLINE_ALL_UPLOAD_STATES,+ limit: 100,+ cursor: page.next_cursor,+ }+ )+ breakpoint()+ results.push(...page.results)+ }+ return { definition, page: { ...page, results }, query }} catch (error) {breakpoint()throw error@@ -177,47 +189,36 @@ export const offlineOverviewTrendLogic: LogicWrapper<offlineOverviewTrendLogicTy],})),reducers({- trendError: [false, { loadOfflineOverviewTrend: () => false, loadOfflineOverviewTrendFailure: () => true }],selectedVersionId: [null as string | null, { selectVersion: (_, { versionId }) => versionId }],+ trendError: [false, { loadOfflineOverviewTrend: () => false, loadOfflineOverviewTrendFailure: () => true }],}),selectors({- versions: [+ points: [(s) => [s.trend],- (- trend: {- definition: ScoreDefinitionApi- page: OfflineHistoryPageApi- } | null- ): OfflineScorerVersionReadApi[] =>- [- ...new Map(- trend?.page.results.map(({ summary }) => [summary.scorer.id, summary.scorer])- ).values(),- ].sort((a, b) => b.version - a.version),- ],- activeVersion: [- (s) => [s.versions, s.selectedVersionId],- (- versions: OfflineScorerVersionReadApi[],- selectedVersionId: string | null- ): OfflineScorerVersionReadApi | null =>- versions.find((version) => version.id === selectedVersionId) || versions[0] || null,+ (trend: OfflineOverviewTrendResult | null): OfflineHistoryPointApi[] => trend?.page.results || [],],- versionPoints: [- (s) => [s.trend, s.activeVersion],- (- trend: {- definition: ScoreDefinitionApi- page: OfflineHistoryPageApi- } | null,- version: OfflineScorerVersionReadApi | null- ): OfflineHistoryPointApi[] =>- trend?.page.results.filter(({ summary }) => summary.scorer.id === version?.id) || [],+ versionSummaries: [+ (s) => [s.points],+ (points: OfflineHistoryPointApi[]): OfflineScoreHistorySummary[] => {+ const byVersion = new Map<string, OfflineHistoryPointApi[]>()+ for (const point of points) {+ const versionPoints = byVersion.get(point.summary.scorer.id) || []+ versionPoints.push(point)+ byVersion.set(point.summary.scorer.id, versionPoints)+ }+ return [...byVersion.values()]+ .map(aggregateOfflineScoreHistory)+ .filter((summary): summary is OfflineScoreHistorySummary => summary !== null)+ .sort((a, b) => b.scorer.version - a.scorer.version)+ },],periodSummary: [- (s) => [s.versionPoints],- (points: OfflineHistoryPointApi[]): OfflineScoreHistorySummary | null =>- aggregateOfflineScoreHistory(points),+ (s) => [s.versionSummaries, s.selectedVersionId],+ (+ summaries: OfflineScoreHistorySummary[],+ selectedVersionId: string | null+ ): OfflineScoreHistorySummary | null =>+ summaries.find((summary) => summary.scorer.id === selectedVersionId) || summaries[0] || null,],}),afterMount(({ actions }) => actions.loadOfflineOverviewTrend()),diff --git a/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.fixtures.ts b/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.fixtures.tsindex a5ce2b5d72e7..eda76dff7471 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.fixtures.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.fixtures.ts@@ -12,6 +12,7 @@ export const OFFLINE_STORY_DEFINITION: ScoreDefinitionApi = {config: { min: 0, max: 5 },created_by: null,created_at: '2026-01-01T10:00:00Z',+ updated_by: null,updated_at: null,team: 1,}@@ -35,6 +36,7 @@ export function makeOfflineHistoryPoint(index: number, mean: number | null = 4.2run_source: index % 2 === 0 ? 'ci' : 'local',status: 'completed',started_at: `2026-01-${String(index).padStart(2, '0')}T10:00:00Z`,+ created_by: null,created_at: '2026-01-20T12:00:00Z',finished_at: '2026-01-20T12:05:00Z',expected_item_count: 100,diff --git a/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.test.ts b/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.test.tsindex 9e7a175989f5..2ca49f5f5507 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.test.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.test.ts@@ -256,6 +256,11 @@ describe('offline score trends', () => {expect(panels.every((panel) => !panel.elapsed)).toBe(true)expect(panels[0].yDomain).toEqual(panels[2].yDomain)expect(panels[0].series[0].points[0].x).toBe(Date.parse(first.experiment.started_at))+ const combined = buildOfflineTrendPanels([{ key: 'primary', label: 'Selected', points: [first, third] }], true)+ expect(combined).toHaveLength(1)+ expect(combined[0].series).toHaveLength(2)+ expect(combined[0].series.map((series) => series.points[0].y)).toEqual([2, 80])+ expect(combined[0].passingRule).toBeNull()})it('aligns equal windows by elapsed time without changing the actual execution date', () => {diff --git a/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.ts b/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.tsindex 293ff5652cc9..40a9f2d92d29 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineScoreTrends.ts@@ -241,7 +241,7 @@ export function getOfflineHistoryCoverage(page: OfflineHistoryPageApi, timezone:return `${page.results.length} of ${page.count} experiment/version results${span}${page.count > page.results.length ? ' · Partial history' : ''}`}-export function buildOfflineTrendPanels(periods: OfflineTrendPeriod[]): OfflineTrendPanel[] {+export function buildOfflineTrendPanels(periods: OfflineTrendPeriod[], combineVersions = false): OfflineTrendPanel[] {const durations = periods.map((period) =>period.dateFrom && period.dateTo ? Date.parse(period.dateTo) - Date.parse(period.dateFrom) : null)@@ -253,7 +253,9 @@ export function buildOfflineTrendPanels(periods: OfflineTrendPeriod[]): OfflineTfor (const point of period.points) {const { summary } = pointconst scorer = summary.scorer- const configuration = `${scorer.kind}:${JSON.stringify(scorer.config)}`+ const configuration = combineVersions+ ? `${scorer.definition_id}:${scorer.kind}`+ : `${scorer.kind}:${JSON.stringify(scorer.config)}`const panelKey = `${configuration}:${elapsed ? 'overlay' : period.key}`let panel = panels.get(panelKey)if (!panel) {@@ -272,6 +274,14 @@ export function buildOfflineTrendPanels(periods: OfflineTrendPeriod[]): OfflineT: undefined,}panels.set(panelKey, panel)+ } else if (+ combineVersions &&+ !(+ panel.passingRule?.operator === offlineNumericPassingRule(scorer)?.operator &&+ panel.passingRule?.threshold === offlineNumericPassingRule(scorer)?.threshold+ )+ ) {+ panel.passingRule = null}const metrics =scorer.kind === 'categorical'diff --git a/products/ai_observability/frontend/offline-evaluations/offlineScorerHistoryLogic.test.ts b/products/ai_observability/frontend/offline-evaluations/offlineScorerHistoryLogic.test.tsindex 5e45d06d83cf..7afe36046410 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineScorerHistoryLogic.test.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineScorerHistoryLogic.test.ts@@ -37,42 +37,64 @@ describe('offlineScorerHistoryLogic', () => {})})- it('shares tag filters across periods, persists them, and lets an explicit URL clear them', async () => {- const props = { scorerId: OFFLINE_STORY_DEFINITION.id, teamId: 1 }- router.actions.push(urls.aiObservabilityOfflineScorerHistory(props.scorerId))- const logic = offlineScorerHistoryLogic(props)- logic.mount()- await expectLogic(logic).toFinishAllListeners()- await expectLogic(logic, () => logic.actions.setFilters({ compare: 'previous' })).toFinishAllListeners()- await expectLogic(logic, () => logic.actions.changePage('primary', 'older')).toFinishAllListeners()- await expectLogic(logic, () => logic.actions.changePage('comparison', 'older')).toFinishAllListeners()- jest.mocked(api.aiObservabilityOfflineScorersHistoryList).mockClear()- await expectLogic(logic, () =>- logic.actions.setFilters({ tags: ['quality', 'production'], tag_match: 'all' })- ).toFinishAllListeners()- expect(logic.values.primaryCursors).toEqual([null])- expect(logic.values.comparisonCursors).toEqual([null])- expect(router.values.searchParams).toMatchObject({ tags: ['quality', 'production'], tag_match: 'all' })- const calls = jest.mocked(api.aiObservabilityOfflineScorersHistoryList).mock.calls- expect(calls).toHaveLength(2)- for (const [, , query] of calls) {- expect(query).toMatchObject({ tags: '["quality","production"]', tag_match: 'all' })- expect(query?.cursor).toBeUndefined()+ it.each([{ created_by: 42 }, { created_by_is_null: true }])(+ 'preserves author and tag filters across periods and clears them through the URL (%j)',+ async (authorFilters) => {+ const props = { scorerId: OFFLINE_STORY_DEFINITION.id, teamId: 1 }+ router.actions.push(urls.aiObservabilityOfflineScorerHistory(props.scorerId), authorFilters)+ const logic = offlineScorerHistoryLogic(props)+ logic.mount()+ await expectLogic(logic).toFinishAllListeners()+ await expectLogic(logic, () => logic.actions.setFilters({ compare: 'previous' })).toFinishAllListeners()+ await expectLogic(logic, () => logic.actions.changePage('primary', 'older')).toFinishAllListeners()+ await expectLogic(logic, () => logic.actions.changePage('comparison', 'older')).toFinishAllListeners()+ jest.mocked(api.aiObservabilityOfflineScorersHistoryList).mockClear()+ await expectLogic(logic, () =>+ logic.actions.setFilters({ tags: ['quality', 'production'], tag_match: 'all' })+ ).toFinishAllListeners()+ expect(logic.values.primaryCursors).toEqual([null])+ expect(logic.values.comparisonCursors).toEqual([null])+ expect(router.values.searchParams).toMatchObject({+ ...authorFilters,+ tags: ['quality', 'production'],+ tag_match: 'all',+ })+ const calls = jest.mocked(api.aiObservabilityOfflineScorersHistoryList).mock.calls+ expect(calls).toHaveLength(2)+ for (const [, , query] of calls) {+ expect(query).toMatchObject({+ ...authorFilters,+ tags: '["quality","production"]',+ tag_match: 'all',+ })+ expect(query?.cursor).toBeUndefined()+ }+ await expectLogic(logic, () =>+ logic.actions.setFilters({ created_by: undefined, created_by_is_null: undefined })+ ).toFinishAllListeners()+ expect(router.values.searchParams).not.toHaveProperty('created_by')+ expect(router.values.searchParams).not.toHaveProperty('created_by_is_null')+ expect(api.aiObservabilityOfflineScorersHistoryList).toHaveBeenLastCalledWith(+ '1',+ props.scorerId,+ expect.objectContaining({ created_by: undefined, created_by_is_null: undefined })+ )+ await expectLogic(logic, () => logic.actions.setFilters(authorFilters)).toFinishAllListeners()+ router.actions.push(urls.aiObservabilityScorers())+ router.actions.push(urls.aiObservabilityOfflineScorerHistory(props.scorerId))+ await expectLogic(logic).toFinishAllListeners()+ expect(logic.values.filters.tags).toEqual(['quality', 'production'])+ expect(router.values.searchParams).toMatchObject({ tags: ['quality', 'production'], tag_match: 'all' })+ router.actions.push(urls.aiObservabilityOfflineScorerHistory(props.scorerId), { tags: [] })+ await expectLogic(logic).toFinishAllListeners()+ expect(logic.values.filters.tags).toEqual([])+ expect(api.aiObservabilityOfflineScorersHistoryList).toHaveBeenLastCalledWith(+ '1',+ props.scorerId,+ expect.objectContaining({ tags: '[]', created_by: undefined, created_by_is_null: undefined })+ )}- router.actions.push(urls.aiObservabilityScorers())- router.actions.push(urls.aiObservabilityOfflineScorerHistory(props.scorerId))- await expectLogic(logic).toFinishAllListeners()- expect(logic.values.filters.tags).toEqual(['quality', 'production'])- expect(router.values.searchParams).toMatchObject({ tags: ['quality', 'production'], tag_match: 'all' })- router.actions.push(urls.aiObservabilityOfflineScorerHistory(props.scorerId), { tags: [] })- await expectLogic(logic).toFinishAllListeners()- expect(logic.values.filters.tags).toEqual([])- expect(api.aiObservabilityOfflineScorersHistoryList).toHaveBeenLastCalledWith(- '1',- props.scorerId,- expect.objectContaining({ tags: '[]' })- )- })+ )it('keeps the periods cursors independent and freezes both resolved windows while paging', async () => {const logic = offlineScorerHistoryLogic({ scorerId: OFFLINE_STORY_DEFINITION.id, teamId: 1 })diff --git a/products/ai_observability/frontend/offline-evaluations/offlineScorerHistoryLogic.ts b/products/ai_observability/frontend/offline-evaluations/offlineScorerHistoryLogic.tsindex b06fc1d38828..00d34bf374d3 100644--- a/products/ai_observability/frontend/offline-evaluations/offlineScorerHistoryLogic.ts+++ b/products/ai_observability/frontend/offline-evaluations/offlineScorerHistoryLogic.ts@@ -37,7 +37,7 @@ import type {ScoreDefinitionVersionApi,ScoreDefinitionVersionPageApi,} from '../generated/api.schemas'-import { OFFLINE_ALL_UPLOAD_STATES } from './offlineOverviewState'+import { OFFLINE_ALL_UPLOAD_STATES, offlineFiltersFromUrl } from './offlineOverviewState'import {previousOfflinePeriod,resolveOfflineDateRange,@@ -49,7 +49,10 @@ export interface OfflineScorerHistoryProps {scorerId: stringteamId: number}-export interface OfflineHistoryFilters extends ResourceTagFilters {+export interface OfflineHistoryFilters+ extends+ ResourceTagFilters,+ Pick<AiObservabilityOfflineScorersHistoryListParams, 'created_by' | 'created_by_is_null'> {version: stringdate_from: stringdate_to: string | null@@ -75,6 +78,7 @@ const DEFAULT_FILTERS: OfflineHistoryFilters = {function readFilters(search: Record<string, unknown>): OfflineHistoryFilters {const filters = { ...DEFAULT_FILTERS }+ const { created_by, created_by_is_null } = offlineFiltersFromUrl(search)for (const key of Object.keys(filters) as (keyof OfflineHistoryFilters)[]) {if (typeof search[key] === 'string' || ((key === 'date_to' || key === 'compare_to') && search[key] === null)) {Object.assign(filters, { [key]: search[key] })@@ -89,7 +93,7 @@ function readFilters(search: Record<string, unknown>): OfflineHistoryFilters {if (filters.date_from === 'all' && filters.compare === 'previous') {filters.compare = 'none'}- return { ...filters, ...cleanTagFilters(search) }+ return { ...filters, ...cleanTagFilters(search), created_by, created_by_is_null }}export function offlineScorerHistoryUrl(@@ -525,6 +529,8 @@ export const offlineScorerHistoryLogic = kea<offlineScorerHistoryLogicType>([limit: 50,statuses: filters.statuses,run_source: filters.run_source || undefined,+ created_by: filters.created_by,+ created_by_is_null: filters.created_by_is_null,tags: JSON.stringify(filters.tags),tag_match: filters.tag_match,}),diff --git a/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScoreDefinitions.tsx b/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScoreDefinitions.tsxindex 7d05df0e80c0..8b485636d7e7 100644--- a/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScoreDefinitions.tsx+++ b/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScoreDefinitions.tsx@@ -14,14 +14,16 @@ import {import { AccessControlAction } from 'lib/components/AccessControlAction'import { CopyToClipboardInline } from 'lib/components/CopyToClipboard'+import { MemberSelect } from 'lib/components/MemberSelect'import { FEATURE_FLAGS } from 'lib/constants'+import { ProfilePicture } from 'lib/lemon-ui/ProfilePicture'import { featureFlagLogic } from 'lib/logic/featureFlagLogic'import { getProductAccessDisabledReason } from 'lib/utils/accessControlUtils'import { Scene } from 'scenes/sceneTypes'import { urls } from 'scenes/urls'import { updatedAtColumn } from '~/lib/lemon-ui/LemonTable/columnUtils'-import { AccessControlLevel, AccessControlResourceType } from '~/types'+import { AccessControlLevel, AccessControlResourceType, UserBasicType } from '~/types'import { ResourceTagFilter } from '../components/ResourceTagFilter'import { ResourceTags } from '../components/ResourceTags'@@ -71,15 +73,15 @@ export function AIObservabilityScoreDefinitions(): JSX.Element {title: 'Name',dataIndex: 'name',key: 'name',- width: '25%',+ width: '18%',render: function renderName(_, scoreDefinition) {return (<div className="space-y-1">- <div className="font-semibold max-w-64 @max-[50rem]/scorers:max-w-32 truncate">+ <div className="font-semibold max-w-64 @max-[50rem]/scorers:max-w-32 @max-[40rem]/scorers:max-w-24 truncate"><Link to={urls.aiObservabilityScorer(scoreDefinition.id)}>{scoreDefinition.name}</Link></div>{scoreDefinition.description ? (- <div className="max-w-64 @max-[50rem]/scorers:max-w-32 truncate text-muted-alt">+ <div className="max-w-64 @max-[50rem]/scorers:max-w-32 @max-[40rem]/scorers:max-w-24 truncate text-muted-alt">{scoreDefinition.description}</div>) : (@@ -132,7 +134,8 @@ export function AIObservabilityScoreDefinitions(): JSX.Element {{title: 'Tags',key: 'tags',- width: '25%',+ width: '18%',+ className: '@max-[40rem]/scorers:hidden',render: (_, scoreDefinition) => (<ResourceTagsentity="scorers"@@ -143,6 +146,30 @@ export function AIObservabilityScoreDefinitions(): JSX.Element {/>),},+ {+ title: 'Created by',+ key: 'created_by',+ className:+ '[&_.profile-package]:max-w-32 @max-[40rem]/scorers:[&_.profile-package]:max-w-24 [&_.profile-name]:truncate',+ render: (_, scorer) =>+ scorer.created_by ? (+ <ProfilePicture user={scorer.created_by as UserBasicType} size="md" showName />+ ) : (+ <span className="text-muted">Unknown</span>+ ),+ },+ {+ title: <span className="whitespace-normal">Last updated by</span>,+ key: 'updated_by',+ className:+ '[&_.profile-package]:max-w-32 @max-[40rem]/scorers:[&_.profile-package]:max-w-24 [&_.profile-name]:truncate',+ render: (_, scorer) =>+ scorer.updated_by ? (+ <ProfilePicture user={scorer.updated_by as UserBasicType} size="md" showName />+ ) : (+ <span className="text-muted">Unknown</span>+ ),+ },{...(updatedAtColumn<ScoreDefinition>() as LemonTableColumn<ScoreDefinition,@@ -178,6 +205,14 @@ export function AIObservabilityScoreDefinitions(): JSX.Element {data-attr="llma-scorers-search-input"/><ResourceTagFilter filters={filters} onChange={(tags) => setFilters(tags, true, false)} />+ <div data-attr="llma-scorers-created-by-filter">+ <MemberSelect+ value={filters.created_by}+ size="medium"+ defaultLabel="Any creator"+ onChange={(user) => setFilters({ created_by: user?.id ?? null }, true, false)}+ />+ </div><LemonSelect<ScoreDefinitionKind | ''>value={filters.kind}onChange={(value) => setFilters({ kind: value || '' })}diff --git a/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScorerScene.stories.tsx b/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScorerScene.stories.tsxindex e65a7994ab55..27c544615e16 100644--- a/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScorerScene.stories.tsx+++ b/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScorerScene.stories.tsx@@ -20,6 +20,7 @@ const definition: ScoreDefinitionApi = {config: { min: 0, max: 1, passing_rule: { operator: 'gte', threshold: 0.8 } },created_by: null,created_at: '2026-01-01T00:00:00Z',+ updated_by: null,updated_at: '2026-01-02T00:00:00Z',team: 997,}diff --git a/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScorersScene.stories.tsx b/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScorersScene.stories.tsxindex 6146e68b4f80..354f9f4ee364 100644--- a/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScorersScene.stories.tsx+++ b/products/ai_observability/frontend/scoreDefinitions/AIObservabilityScorersScene.stories.tsx@@ -20,6 +20,7 @@ const definition: ScoreDefinitionApi = {config: { min: 0, max: 1 },created_by: null,created_at: '2026-01-01T00:00:00Z',+ updated_by: null,updated_at: '2026-01-02T00:00:00Z',team: 997,}diff --git a/products/ai_observability/frontend/scoreDefinitions/aiObservabilityScoreDefinitionsLogic.test.ts b/products/ai_observability/frontend/scoreDefinitions/aiObservabilityScoreDefinitionsLogic.test.tsindex d6811dc3ae6c..7e6270371756 100644--- a/products/ai_observability/frontend/scoreDefinitions/aiObservabilityScoreDefinitionsLogic.test.ts+++ b/products/ai_observability/frontend/scoreDefinitions/aiObservabilityScoreDefinitionsLogic.test.ts@@ -57,6 +57,7 @@ const mockScoreDefinition: ScoreDefinition = {hedgehog_config: null,},created_at: '2026-03-11T00:00:00Z',+ updated_by: null,updated_at: '2026-03-11T00:00:00Z',team: MOCK_DEFAULT_TEAM.id,}@@ -124,7 +125,7 @@ describe('aiObservabilityScoreDefinitionsLogic', () => {await expectLogic(logic, () => {logic.actions.setFilters({ page: 3 }, false)- logic.actions.setFilters({ search: 'quality', kind: 'categorical', archived: 'true' })+ logic.actions.setFilters({ search: 'quality', kind: 'categorical', archived: 'true', created_by: 42 })}).toFinishAllListeners()expect(logic.values.filters).toEqual({@@ -132,12 +133,14 @@ describe('aiObservabilityScoreDefinitionsLogic', () => {tag_match: 'any',page: 1,search: 'quality',+ created_by: 42,kind: 'categorical',archived: 'true',order_by: 'name',})expect(mockAIObservabilityScoreDefinitionsList).toHaveBeenLastCalledWith(String(MOCK_DEFAULT_TEAM.id), {search: 'quality',+ created_by: 42,kind: 'categorical',archived: true,order_by: 'name',diff --git a/products/ai_observability/frontend/scoreDefinitions/aiObservabilityScoreDefinitionsLogic.ts b/products/ai_observability/frontend/scoreDefinitions/aiObservabilityScoreDefinitionsLogic.tsindex 8b136a5c8ad9..1b88f4e5703c 100644--- a/products/ai_observability/frontend/scoreDefinitions/aiObservabilityScoreDefinitionsLogic.ts+++ b/products/ai_observability/frontend/scoreDefinitions/aiObservabilityScoreDefinitionsLogic.ts@@ -36,6 +36,7 @@ export const SCORE_DEFINITIONS_PER_PAGE = 30export interface ScoreDefinitionFilters extends ResourceTagFilters {page: numbersearch: string+ created_by: number | nullkind: ScoreDefinitionKind | ''archived: '' | 'true' | 'false'order_by: string@@ -65,6 +66,10 @@ function cleanFilters(values: ScoreDefinitionFilterInput): ScoreDefinitionFilter...cleanTagFilters(values),page: parseInt(String(values.page)) || 1,search: String(values.search || ''),+ created_by:+ Number.isSafeInteger(Number(values.created_by)) && Number(values.created_by) > 0+ ? Number(values.created_by)+ : null,kind:values.kind === 'categorical' || values.kind === 'numeric' || values.kind === 'boolean' ? values.kind : '',archived:@@ -87,6 +92,7 @@ function getUrlFilters(filters: ScoreDefinitionFilters): Record<string, unknown>tag_match: filters.tag_match,page: filters.page === 1 ? undefined : filters.page,search: filters.search || undefined,+ created_by: filters.created_by || undefined,kind: filters.kind || undefined,archived: filters.archived === 'false' ? undefined : filters.archived === '' ? 'all' : 'true',order_by: filters.order_by === 'name' ? undefined : filters.order_by,@@ -262,6 +268,7 @@ export const aiObservabilityScoreDefinitionsLogic = kea<aiObservabilityScoreDeficonst teamId = String(ApiConfig.getCurrentTeamId())const page = await aiObservabilityScoreDefinitionsList(teamId, {search: filters.search || undefined,+ created_by: filters.created_by || undefined,...(filters.tags.length? { tags: JSON.stringify(filters.tags), tag_match: filters.tag_match }: {}),diff --git a/products/ai_observability/frontend/scoreDefinitions/scoreDefinitionModalUtils.test.ts b/products/ai_observability/frontend/scoreDefinitions/scoreDefinitionModalUtils.test.tsindex e5ddf73a7dc1..10f8cb74f368 100644--- a/products/ai_observability/frontend/scoreDefinitions/scoreDefinitionModalUtils.test.ts+++ b/products/ai_observability/frontend/scoreDefinitions/scoreDefinitionModalUtils.test.ts@@ -14,6 +14,7 @@ const definition: ScoreDefinitionApi = {team: 1,created_by: null,created_at: '2026-01-01T00:00:00Z',+ updated_by: null,updated_at: '2026-01-01T00:00:00Z',}diff --git a/products/ai_observability/frontend/scoreDefinitions/scoreDefinitionNavigation.ts b/products/ai_observability/frontend/scoreDefinitions/scoreDefinitionNavigation.tsindex e975f8dc42ae..5641f17181ca 100644--- a/products/ai_observability/frontend/scoreDefinitions/scoreDefinitionNavigation.ts+++ b/products/ai_observability/frontend/scoreDefinitions/scoreDefinitionNavigation.ts@@ -1,6 +1,6 @@export function scorerFiltersFromSearchParams(searchParams: Record<string, unknown>): Record<string, unknown> {return Object.fromEntries(- ['search', 'page', 'kind', 'archived', 'order_by']+ ['search', 'page', 'kind', 'archived', 'order_by', 'created_by'].filter((key) => searchParams[key] !== undefined).map((key) => [key, searchParams[key]]))diff --git a/products/ai_observability/frontend/scoreDefinitions/scorerLogic.test.ts b/products/ai_observability/frontend/scoreDefinitions/scorerLogic.test.tsindex e1991edc0f49..4dde97d000ea 100644--- a/products/ai_observability/frontend/scoreDefinitions/scorerLogic.test.ts+++ b/products/ai_observability/frontend/scoreDefinitions/scorerLogic.test.ts@@ -41,6 +41,7 @@ const definition: ScoreDefinitionApi = {team: MOCK_DEFAULT_TEAM.id,created_by: null,created_at: '2026-01-01T00:00:00Z',+ updated_by: null,updated_at: null,}diff --git a/products/ai_observability/frontend/traceReviews/traceReviewModalLogic.test.ts b/products/ai_observability/frontend/traceReviews/traceReviewModalLogic.test.tsindex e824fe1e3ca6..ca41a48b58e7 100644--- a/products/ai_observability/frontend/traceReviews/traceReviewModalLogic.test.ts+++ b/products/ai_observability/frontend/traceReviews/traceReviewModalLogic.test.ts@@ -48,6 +48,7 @@ describe('traceReviewModalLogic', () => {},created_by: null,created_at: '2026-03-12T00:00:00Z',+ updated_by: null,updated_at: '2026-03-12T00:00:00Z',team: MOCK_DEFAULT_TEAM.id,}@@ -68,6 +69,7 @@ describe('traceReviewModalLogic', () => {},created_by: null,created_at: '2026-03-12T00:00:00Z',+ updated_by: null,updated_at: '2026-03-12T00:00:00Z',team: MOCK_DEFAULT_TEAM.id,}diff --git a/products/ai_observability/frontend/traceReviews/traceReviewModalLogic.ts b/products/ai_observability/frontend/traceReviews/traceReviewModalLogic.tsindex d45a618afbc8..ef79ef9fbd47 100644--- a/products/ai_observability/frontend/traceReviews/traceReviewModalLogic.ts+++ b/products/ai_observability/frontend/traceReviews/traceReviewModalLogic.ts@@ -104,6 +104,7 @@ function buildScoreDefinitionFromReviewScore(score: TraceReviewScore, teamId: nuconfig: score.definition_config,created_by: null,created_at: score.created_at,+ updated_by: null,updated_at: score.updated_at,team: teamId,}diff --git a/services/mcp/src/api/generated.ts b/services/mcp/src/api/generated.tsindex 0f91c1dffbc3..3087f3af9d7d 100644--- a/services/mcp/src/api/generated.ts+++ b/services/mcp/src/api/generated.ts@@ -70376,6 +70376,8 @@ export namespace Schemas {} as const;export interface OfflineExperimentRead {+ /** User who submitted the experiment, or null for service credentials. */+ readonly created_by: UserBasic | null;/** Project tag names assigned to this experiment. */tags: string[];/** Stable experiment UUID. */@@ -75113,6 +75115,8 @@ export namespace Schemas {readonly created_at: string;/** @nullable */readonly updated_at: string | null;+ /** User who last updated the scorer or created a version. */+ readonly updated_by: UserBasic | null;readonly team: number;}@@ -122923,6 +122927,15 @@ export namespace Schemas {* @maxLength 255*/application_version?: string;+ /**+ * Filter experiments by the author's user ID.+ * @minimum 1+ */+ created_by?: number;+ /**+ * Only include experiments without an author.+ */+ created_by_is_null?: boolean;/*** Continuation cursor returned by the previous page.* @minLength 1@@ -123122,6 +123135,15 @@ export namespace Schemas {* @maxLength 255*/application_version?: string;+ /**+ * Filter experiments by the author's user ID.+ * @minimum 1+ */+ created_by?: number;+ /**+ * Only include experiments without an author.+ */+ created_by_is_null?: boolean;/*** Continuation cursor returned by the previous page.* @minLength 1@@ -130370,6 +130392,10 @@ export namespace Schemas {* Filter by archived state.*/archived?: boolean;+ /**+ * Filter by the creator's user ID.+ */+ created_by?: number;/*** Filter by scorer kind.*/diff --git a/services/mcp/src/generated/ai_observability/api.ts b/services/mcp/src/generated/ai_observability/api.tsindex edd7a9e48735..2ece2aece355 100644--- a/services/mcp/src/generated/ai_observability/api.ts+++ b/services/mcp/src/generated/ai_observability/api.ts@@ -108,6 +108,8 @@ export const AiObservabilityOfflineExperimentsListQueryParams = () => zod.object.max(aiObservabilityOfflineExperimentsListQueryApplicationVersionMax).optional().describe('Exact application revision.'),+ created_by: zod.number().min(1).optional().describe("Filter experiments by the author's user ID."),+ created_by_is_null: zod.boolean().optional().describe('Only include experiments without an author.'),cursor: zod.string().min(1)@@ -737,6 +739,8 @@ export const AiObservabilityOfflineScorersHistoryListQueryParams = () => zod.obj.max(aiObservabilityOfflineScorersHistoryListQueryApplicationVersionMax).optional().describe('Exact application revision.'),+ created_by: zod.number().min(1).optional().describe("Filter experiments by the author's user ID."),+ created_by_is_null: zod.boolean().optional().describe('Only include experiments without an author.'),cursor: zod.string().min(1)@@ -2870,6 +2874,7 @@ export const llmAnalyticsScoreDefinitionsListQueryTagMatchDefault = `any`export const LlmAnalyticsScoreDefinitionsListQueryParams = () => zod.object({archived: zod.boolean().optional().describe('Filter by archived state.'),+ created_by: zod.number().optional().describe("Filter by the creator's user ID."),kind: zod.string().optional().describe('Filter by scorer kind.'),limit: zod.number().optional().describe('Number of results to return per page.'),offset: zod.number().optional().describe('The initial index from which to return the results.'),diff --git a/services/mcp/src/tools/generated/ai_observability.ts b/services/mcp/src/tools/generated/ai_observability.tsindex 5ec3ee898295..d92b87f0867c 100644--- a/services/mcp/src/tools/generated/ai_observability.ts+++ b/services/mcp/src/tools/generated/ai_observability.ts@@ -1846,6 +1846,8 @@ const llmaOfflineExperimentList = (): ToolBase<path: `/api/projects/${encodeURIComponent(String(projectId))}/ai_observability/offline_experiments/`,query: {application_version: params.application_version,+ created_by: params.created_by,+ created_by_is_null: params.created_by_is_null,cursor: params.cursor,dataset_identifier: params.dataset_identifier,dataset_revision_identifier: params.dataset_revision_identifier,@@ -2076,6 +2078,8 @@ const llmaOfflineScorerHistory = (): ToolBase<path: `/api/projects/${encodeURIComponent(String(projectId))}/ai_observability/offline_scorers/${encodeURIComponent(String(params.id))}/history/`,query: {application_version: params.application_version,+ created_by: params.created_by,+ created_by_is_null: params.created_by_is_null,cursor: params.cursor,dataset_identifier: params.dataset_identifier,dataset_revision_identifier: params.dataset_revision_identifier,@@ -2717,6 +2721,7 @@ const llmaScoreDefinitionList = (): ToolBase<path: `/api/projects/${encodeURIComponent(String(projectId))}/llm_analytics/score_definitions/`,query: {archived: params.archived,+ created_by: params.created_by,kind: params.kind,limit: params.limit,offset: params.offset,diff --git a/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-offline-experiment-list.json b/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-offline-experiment-list.jsonindex ba02f9e235b6..2c978f448b1b 100644--- a/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-offline-experiment-list.json+++ b/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-offline-experiment-list.json@@ -7,6 +7,15 @@"minLength": 1,"type": "string"},+ "created_by": {+ "description": "Filter experiments by the author's user ID.",+ "minimum": 1,+ "type": "number"+ },+ "created_by_is_null": {+ "description": "Only include experiments without an author.",+ "type": "boolean"+ },"cursor": {"description": "Continuation cursor returned by the previous page.","maxLength": 2048,diff --git a/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-offline-scorer-history.json b/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-offline-scorer-history.jsonindex 6ea054ae5daf..ac613c023cb0 100644--- a/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-offline-scorer-history.json+++ b/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-offline-scorer-history.json@@ -7,6 +7,15 @@"minLength": 1,"type": "string"},+ "created_by": {+ "description": "Filter experiments by the author's user ID.",+ "minimum": 1,+ "type": "number"+ },+ "created_by_is_null": {+ "description": "Only include experiments without an author.",+ "type": "boolean"+ },"cursor": {"description": "Continuation cursor returned by the previous page.","maxLength": 2048,diff --git a/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-score-definition-list.json b/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-score-definition-list.jsonindex e0e4ee065118..347acb78842e 100644--- a/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-score-definition-list.json+++ b/services/mcp/tests/unit/__snapshots__/tool-schemas/llma-score-definition-list.json@@ -5,6 +5,10 @@"description": "Filter by archived state.","type": "boolean"},+ "created_by": {+ "description": "Filter by the creator's user ID.",+ "type": "number"+ },"kind": {"description": "Filter by scorer kind.","type": "string"