Code graph and memory for your coding agents, in one Rust program. For Claude Code, Codex, Cursor and any MCP client.
Rust agent-memoryai-agentsclaude-codecode-analysiscode-graphcode-intelligencecode-searchcodexcoding-agentscontext-engineeringcursordeveloper-toolsgraphragknowledge-graphlocal-firstmcpmcp-servermodel-context-protocolrusttree-sitter
Graphicle 0.1.10: whole top files in packs and HTML kept as it is
VikramLex759b7b9392a6
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 44f7997..b9c6186 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -3,6 +3,189 @@Notable changes to Graphicle: the graph engine (`graphicle-graph`), the memorylibrary (`graphicle-memory`) and the `graphicle` program.+## 0.1.10 - 2026-10-30++Every crate is at 0.1.10, and `graphicle --version` prints+`graphicle 0.1.10 (core)`. The Python and TypeScript SDKs are at 0.1.10+too.++Everything new in 0.1.10 was written during Meta's Global AI Developer+Hackathon.+[HACKATHON.md](https://github.com/Graphicle-AI/graphicle/blob/v0.1.10/HACKATHON.md)+lists it with when it was written.++### After upgrading++- Run `graphicle sync` once in each project, as after 0.1.9. The saved+ graph and the query file are keyed to the program's build, so the first+ sync writes both again. Until then a question reads the code graph from+ the store, and on a project of 2,000 files or more the prompt hook gives+ only the files that define the code names a prompt gives.+- The first check of a folder that an earlier version synced finds its+ HTML files changed, though nothing on disk changed, so the next command+ that reads the project (such as `graphicle pack`, `ask`, `context` or+ `status`, or an MCP tool call) syncs them again as they are (see the+ first bullet of Fixes). A folder with more than 200 such files, or one+ whose sync is slow, gets a note to run `graphicle sync` instead; with+ `freshness` set to `off`, run `graphicle sync` yourself.+- A reviewed project memory that cites a folder's HTML file goes stale+ after that sync, because the page's stored text changes from its words+ to its markup. Review those memories in the app (`graphicle open`,+ under **Memory**).+- In the GitHub Action of `graphicle review`, set `graphicle-version` to+ 0.1.10, and `graphicle-sha256` to the SHA-256 of 0.1.10's archive for+ the runner (in the release's `SHA256SUMS`): the escaping under Fixes+ comes from the program the Action installs.++### Whole-repository packs++- Packs in the standard layout hold their top-ranked files whole more+ often. In a pack of 32,768 tokens or less, the first ranked file goes in+ whole when its estimated size fits in half the budget; in a pack of+ 131,072 tokens or more, the first two go in whole when each one's+ estimated size fits in a quarter of it. The estimate comes from a file's+ size in bytes, not from the tokenizer. This changes `graphicle pack`, the+ MCP server's `pack` tool (32,000 tokens by default), and the packs of+ `ask --pack`, `plan` and `fix`, which use the standard layout by default.+ The default budget of `graphicle pack`, 128,000 tokens, stays below the+ second tier, and so do the packs for a model with a 128K window, unless+ a calibration from earlier calls raises their budget past 131,071+ tokens. A pack with pinned passages (`fix --focus`, `review`) keeps the+ per-file caps for every file, so each pinned passage keeps its room.+ This rule leaves packs of 32,769 to 131,071 tokens, and the cache+ layout, as they were.+- Measured without a model, as the share of questions (tasks, on+ SWE-bench Pro) whose pack holds every line that the reference fix+ changes, with tokens counted by the Muse Spark Open tokenizer: 0.1.9+ against a candidate build of 0.1.10 with both changes (whole top files,+ and a folder's HTML files kept as they are, under Fixes), made before+ this release's last fixes, at budgets of 16K to 1M tokens (16,384 to+ 1,015,808; the 128K budget is 131,072 tokens, in the second tier). A+ build with those fixes, run again on the development questions, matched+ the candidate except for one question at 256K, whose pack left out one+ file the fix changed.+ - On the 90 held-out questions of the whole-repository benchmark+ (pytorch, vscode and elasticsearch, never tuned on): 26.7% to 34.4% at+ 32K, 41.1% to 48.9% at 128K, 47.8% to 52.2% at 256K, 53.3% to 58.9% at+ 512K and 58.9% to 64.4% at 1M; unchanged at 16K (21.1%) and 64K+ (33.3%). The mean share of the fix's files inside the pack (whole, or+ as excerpts or outlines) moved by +1.7 points at 16K, -0.3 at 128K and+ -1.1 at 512K, and not at the other budgets.+ - On 633 tasks of SWE-bench Pro's public set (at 1M, the 505 whose files+ hold more than 1M tokens): 10.3% to 15.0% at 16K, 16.7% to 20.4% at+ 32K, 29.1% to 29.2% at 64K, 40.8% to 42.3% at 128K, 51.5% to 52.8% at+ 256K and 66.5% to 68.3% at 1M, where file-level BM25 holds every+ changed line in 14.2%, 19.0%, 25.9%, 32.7%, 41.5% and 58.0% of tasks.+ The share of tasks with every file the fix changes inside the pack (any+ of its text) moved by -0.8 points at 16K and at 128K, -0.3 at 32K and+ -0.2 at 1M, and not at 64K and 256K. Counting only the files the pack+ holds as text, not as an outline, it fell by 2.1 points at 16K (95%+ interval -3.5 to -0.6) and by 0.3 points or less at the other budgets.+ A diagnosis of 0.1.9 on these tasks chose the directions of this+ change, though not its settings, so they are not an untouched test.+ - On the 200 development questions it was tuned on (kubernetes,+ home-assistant, angular, keycloak and godot): 32.0% to 36.0% at 16K,+ 48.0% to 51.0% at 32K, 70.0% to 72.0% at 128K, 76.0% to 77.5% at 256K,+ 79.5% to 81.0% at 512K and 81.0% to 82.5% at 1M; unchanged at 64K+ (57.5%). The mean share of the fix's files inside moved by -1.0 point+ at 32K and -0.5 at 1M, and by 0.2 points or less at the other budgets.++ The tables are in+ [bench/whole-repo/results-lines.md](https://github.com/Graphicle-AI/graphicle/blob/v0.1.10/bench/whole-repo/results-lines.md)+ and+ [bench/swe-bench-pro/results-e1l.md](https://github.com/Graphicle-AI/graphicle/blob/v0.1.10/bench/swe-bench-pro/results-e1l.md).++### Fixes++- A project folder's `.html` and `.htm` files are kept as they are on+ disk. Earlier versions stored the text that html2text extracted from+ them, so `graphicle pack` quoted that text under its own line numbers,+ not the file's, and a `graphicle fix` edit copied from that text could+ fail to match the file. Search and project memory read the same stored+ text, so they now see a page's markup as well as its words, and a hit or+ a quote points at the file's own line.+ - Office files, spreadsheets, PDF, EPUB and images are converted as+ before, and so is HTML that is uploaded or that the Confluence+ connector brings in. The GitHub and Google Drive connectors already+ kept `.html` files as they are.+ - A folder's HTML file that is not UTF-8, such as a Latin-1 or Shift-JIS+ page, or that is larger than `limits.file_bytes` (8 MiB by default), is+ still read as its extracted text, as before, up to+ `limits.document_bytes` (128 MiB by default).+ - An HTML file read as it is counts its whole markup, not just its words,+ toward `limits.project_bytes` (1 GiB by default), so a folder with many+ large pages comes closer to that limit; raise the limit if a sync is+ refused.+ - The notes-first ranking, which is off by default, no longer counts+ `.html` and `.htm` files as notes.+- `graphicle review --format github` and the GitHub Action escape `&`, `<`+ and `>` in the review's text outside code spans and code blocks, so+ markup in a model's comment (an `<img>` tag, or a `<!--` that would hide+ the rest of the review) shows as text in the posted review and in the job+ summary.+- `graphicle pack --format xml`: a file whose lines hold `</file` or+ `</section` (an HTML page's own `</section>`, for example) goes inside a+ CDATA section, so it no longer closes the pack's `<file>` or `<section>`+ element. Other files are unchanged, and the element names stay the same.++### Graph commands++- A `graphicle graph` command that reads the graph file, such as `query` or+ `affected`, now says how to build the file when it does not exist yet+ (reported by Thomas Thomsen,+ [#15](https://github.com/Graphicle-AI/graphicle/issues/15)). Before, it+ stopped with `graph file not found: <folder>/.graphicle/graph.json` and+ nothing more. Now, for the default graph file, the next line gives the+ command to run in that folder, `graphicle-graph extract . --code-only`+ (the same as `graphicle graph extract . --code-only`). The code graph+ that `graphicle setup` builds is in Graphicle's data folder, for the MCP+ server and `graphicle context`; `graphicle graph` reads its own file.++### Model profiles++- A model profile with an API key (`key_env`) can now use plain HTTP to a+ model server on your own network, such as a vLLM host without TLS, when+ you list that server's exact host in the new environment variable+ `GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS` (the same format as+ `GRAPHICLE_PROVIDER_HTTP_HOSTS`; a host listed there also counts as+ listed in the older variable). The key then crosses the network in clear+ text. The variable is unset by default, so such a profile is still+ refused until you list its host; Graphicle prints a one-line warning+ that names such a host when it accepts one, and connectors and sign-in+ still need HTTPS or loopback (asked in discussion #16).++### Benchmark kits++- `bench/swe-bench-pro/` measures, without a model, how often a context+ holds every file and every line that a fix changes, on 633 tasks of+ SWE-bench Pro's public set: the pack, file-level BM25 and the repository+ cut to the same budget (`e1.py`, `e1l.py`, their reports and+ comparisons). It also holds the scripts of the model runs (`e2.py`,+ answers on a sample of the tasks; `c4c.py`, a billed prompt-cache meter;+ `live.sh`), whose results are not in this release. Results:+ [results-e1.md](https://github.com/Graphicle-AI/graphicle/blob/v0.1.10/bench/swe-bench-pro/results-e1.md)+ (files, 0.1.9) and+ [results-e1l.md](https://github.com/Graphicle-AI/graphicle/blob/v0.1.10/bench/swe-bench-pro/results-e1l.md)+ (lines, 0.1.9 and the 0.1.10 candidate build).+- `bench/whole-repo/lines.py` counts the changed lines that each context+ holds for the whole-repository questions, from each question's pull+ request diff placed on its snapshot, and compares two builds question by+ question:+ [results-lines.md](https://github.com/Graphicle-AI/graphicle/blob/v0.1.10/bench/whole-repo/results-lines.md).+- `bench/whole-repo/` gains two arms for its model runs (file-level BM25,+ and the agent with a pack in its first message) and two settings for+ the agent (a cap on the input tokens of all its turns, and Meta's+ hosted tool search), and `score.py` reports the cost per correct answer+ and McNemar's test on hit@1. The model runs have not been made yet.++### Packaging++- `server.json` at the repository's root is the MCP Registry entry of+ 0.1.9, the latest listed release (it named 0.1.8). A release's entry is+ committed after its listing, as+ [packaging/mcpb/README.md](https://github.com/Graphicle-AI/graphicle/blob/v0.1.10/packaging/mcpb/README.md#steps-at-release-time)+ describes.+## 0.1.9 - 2026-10-28Every crate is at 0.1.9, and `graphicle --version` printsdiff --git a/HACKATHON.md b/HACKATHON.mdindex 6b80be1..2ccc32c 100644--- a/HACKATHON.md+++ b/HACKATHON.md@@ -15,7 +15,7 @@ Graphicle is entered in the startup track of Meta's Global AI Developer HackathoEverything below was started after the kickoff, at 26 October 2026, 16:00 UTC. Each item names the release it shipped in.-The commit ids are those of Graphicle's development repository, with the times they were committed (UTC); this public repository receives each release as one commit. The commands that call Meta's models were tested against stand-ins for the Meta Model API (the tests' local servers and [`demo/mock_meta.py`](demo/mock_meta.py)), not against the live API; the [0.1.9 notes](CHANGELOG.md#019---2026-10-28) say so feature by feature.+The commit ids are those of Graphicle's development repository, with the times they were committed (UTC); this public repository receives each release as one commit. From 0.1.10 on, items give times without ids. The commands that call Meta's models were tested against stand-ins for the Meta Model API (the tests' local servers and [`demo/mock_meta.py`](demo/mock_meta.py)), not against the live API; the [0.1.9 notes](CHANGELOG.md#019---2026-10-28) say so feature by feature.- **Cache-aware packs, the spend log and `graphicle fix`** (0.1.9). `graphicle pack --layout cache` puts first a repository part that is the same bytes for every question about a commit, so Meta's prompt cache can serve it. With `--layout cache`, `ask --pack`, `plan` and `fix` send a prompt cache key to the Meta Model API; they ask it for exact token counts near the input limit, log each call's tokens and cost (`graphicle usage`), and refuse a call past a profile's cost caps. `graphicle fix` makes a change for an issue on a new branch in a new worktree and runs your tests on it. Commits `3e0d7e8` (26 October, 17:08), `854c0cc` to `925f8c8` (5 commits, 26 October, 17:42 to 18:29), and two rounds of review fixes: `1e566f8` to `7ad616b` (2 commits, 26 October, 19:17) and `ad89536` to `4233438` (2 commits, 27 October, 01:20). `graphicle fix` packs in the standard layout by default, so the whole budget goes to the files the issue needs: `4578a5a` (27 October, 09:13).- **The whole-repository benchmark** (its kit and page, 0.1.9). The grid of model runs, fixed before any model call; the runner, with the prompt cache and spending limits; the cost of a question with the prompt cache, computed at list prices and not billed; and the held-out baseline of the pack written before the event. Commits `c5ca2ca` to `0883169` (11 commits, 26 October, 16:58 to 27 October, 01:00). Three development repositories for TypeScript, Java and C++ (angular, keycloak and godot): `a1f83cf` (27 October, 02:39). The benchmark's model runs have not been made yet.@@ -27,3 +27,10 @@ The commit ids are those of Graphicle's development repository, with the times t- **Setup where it cannot write a file** (0.1.9). As in Claude Code's sandbox, which does not let it write `.git/hooks` or `.mcp.json`: a file setup cannot write is skipped with its reason, and the summary gives the lines to add by hand. Reported by Thomas Thomsen in [#15](https://github.com/Graphicle-AI/graphicle/issues/15). Commit `f29a86b` (27 October, 08:55). Then the rest of the issue: a hooks file setup cannot write (Claude Code's `.claude/settings.local.json`, Codex's `~/.codex/hooks.json`) is skipped with its reason while the agent stays connected, and a read-only `.git` keeps its exclude file while the summary gives the lines to add: `e1c0788` to `66643b6` (4 commits, 27 October, 11:52 to 11:59).- **Also during the event** (0.1.9). The fix for four zstd advisories (`2f0ced3`, 27 October, 04:58); the README's section "Agent memory, compared" and its follow-ups (`7e1dd42`, `2b17d73`, `7c65015`, `7ac0c0b` and `b4ca138`, 27 October, 05:32 to 05:58), which describe memory comparisons run before the event; a test's formatting (`f20cb41`, 27 October, 06:54); and this page (`f7a67fd`, 26 October, 16:42).- **The 0.1.9 release** itself: the version numbers, the 0.1.9 notes and this list, on top of the work above.+- **Whole top files in standard packs** (0.1.10). A standard pack of 32,768 tokens or less holds its first ranked file whole when the file fits in half the budget, and one of 131,072 tokens or more its first two when each fits in a quarter; the settings were tuned on the development repositories, then measured once on the held-out ones and on SWE-bench Pro (where a diagnosis of 0.1.9 chose the change's directions, though not its settings), and the [0.1.10 notes](CHANGELOG.md#0110---2026-10-30) give the numbers. Written 27 October, 19:36 to 20:52 UTC.+- **A folder's HTML files kept as they are** (0.1.10). Packs, search and edits read a page's own lines instead of the text extracted from it. The code review's fixes: a page past the text-file limit or not in UTF-8 is converted as before, the pages an earlier version converted are synced again, `graphicle review` escapes markup in what it posts to GitHub, an XML pack keeps a page's closing tags inside CDATA, pinned passages keep their room, and HTML files no longer count as notes. Written 27 October, 17:44 to 19:36; the review's fixes 28 October, 03:40.+- **SWE-bench Pro and line-level recall** (0.1.10). A kit that measures without a model how often a context holds every file and every line a fix changes, on 633 tasks of SWE-bench Pro's public set, with the scripts of its model runs, whose results are not in this release, and new arms and scoring for the whole-repository runner. The same count at line level for the whole-repository questions. The public tables, the kits' settings and the entries of the 0.1.10 notes. Written 27 October, 06:04 to 21:02, and 28 October, 07:48 to 08:04.+- **Graph commands before the first extract** (0.1.10). A `graphicle graph` command that reads the graph file says how to build it when it does not exist yet, as Thomas Thomsen reported in [#15](https://github.com/Graphicle-AI/graphicle/issues/15). Written 28 October, 07:00.+- **The code review's fixes to the 0.1.10 notes, the kits, the benchmark pages and a sync error message** (0.1.10). Written 28 October, 08:56 to 09:02.+- **A key over plain HTTP to hosts you list** (0.1.10). A model profile with an API key may use plain HTTP to a server on your own network whose exact host is listed in `GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS`, which is off by default and sends the key in clear text, as asked in discussion #16. Written 30 October, 06:07 to 06:19 UTC.+- **The 0.1.10 release** itself: the version numbers, the 0.1.10 notes and this list, on top of the work above.diff --git a/README.md b/README.mdindex 5a1de3a..4d3bc38 100644--- a/README.md+++ b/README.md@@ -298,5 +298,5 @@ contributors, licensed under Apache-2.0, with portions that remain available und<p align="center"><br><b>If Graphicle is useful to you, star the repository so other developers find it.</b><br><sub><a href="#quick-start">Try it</a> · <a href="https://github.com/graphicle-ai/graphicle/issues">Report a bug</a> · <a href="CONTRIBUTING.md">Contribute</a> · <a href="https://discord.com/invite/rWuU7cWU4E">Discord</a></sub><br>- <sub>Built by <a href="https://www.karlexai.com">KarLex AI</a></sub>+ <sub>Built by <a href="https://www.karlex.ai"><img src="assets/karlex-ai-logo.png" width="16" height="16" align="absmiddle" alt="KarLex AI logo"></a> <a href="https://www.karlex.ai">KarLex AI, Inc.</a></sub></p>diff --git a/assets/karlex-ai-logo.png b/assets/karlex-ai-logo.pngnew file mode 100644index 0000000..cde2aafBinary files /dev/null and b/assets/karlex-ai-logo.png differdiff --git a/bench/.gitignore b/bench/.gitignoreindex 8fc1183..cb14d20 100644--- a/bench/.gitignore+++ b/bench/.gitignore@@ -30,6 +30,8 @@!*.css# The whole-repository benchmark's question sets: issue URLs, gold files and text hashes, no issue text.!/whole-repo/questions/*.jsonl+# SWE-bench Pro's task list: repositories, base commits, gold files and text hashes, no problem statements.+!/swe-bench-pro/tasks.jsonl# Run folders. Each run under results/ and competitors/ keeps its scripts,# README or methodology, inputs record, summaries, the results the documentsdiff --git a/bench/swe-bench-pro/README.md b/bench/swe-bench-pro/README.mdnew file mode 100644index 0000000..de1f77a--- /dev/null+++ b/bench/swe-bench-pro/README.md@@ -0,0 +1,104 @@+# SWE-bench Pro: gold-file recall and change localization++SWE-bench Pro's public set ([ScaleAI/SWE-bench_Pro](https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro),+V2: 642 tasks in 11 repositories) used as an external test of finding the files a fix changes. The method+was fixed before any number was measured. The settings of `graphicle pack` are tuned only on the development+repositories of the whole-repository benchmark (`../whole-repo`); SWE-bench Pro is only measured. One caveat:+the line-level diagnosis of 0.1.9 on SWE-bench Pro (`e1l.py`) chose the directions of 0.1.10's pack tuning+(whole files, excerpts, ranking and HTML files), though not its settings, so 0.1.10's results on it are not an+untouched test. The clean check is the whole-repository benchmark's held-out repositories, which are never+tuned on.++Results: [results-e1.md](results-e1.md) (gold files, Graphicle 0.1.9) and [results-e1l.md](results-e1l.md)+(gold lines, 0.1.9 and the 0.1.10 candidate build).++## The tasks++- **Data:** config `default`, split `test`, revision `2d52cb3df914a3fcf80c7f66738b3a88ae37fc50`+ (`data.py` checks the file's sha256). `tasks.jsonl` lists each task's repository, base commit, gold files,+ the files its reference patch creates, the sha256 of its problem statement and whether the statement names+ a gold path. The statements themselves are not in this folder; `data.py` rebuilds them.+- **The question** is the problem statement alone. The dataset's `requirements` and `interface` fields are not+ used, since they often name the files and functions to change.+- **Gold files** are the files the reference patch changes that exist at the base commit. Files it creates+ cannot be in any context and are not gold; the 9 tasks whose patch only creates files are left out (633+ remain).+- **The repository state** is the base commit, without the test patch.++## Recall without a model (`e1.py`)++For each task: check out the base commit, build Graphicle's index (timed), count every file with one+tokenizer, then fill each budget with three contexts and record which gold files are inside.++| Context | How it is built |+|---|---|+| pack | `graphicle pack "<problem statement>" --budget B --layout standard --tokenizer <tokenizer.json>`; a gold file is inside when the pack holds a passage of it (rows also count gold files held whole) |+| BM25 | file-level BM25, the SWE-bench paper's retrieval baseline (`../whole-repo/bm25.py`): whole files in score order, each if it still fits |+| truncation | the repository's files in a fixed order (source, tests, docs), each if it still fits |++Budgets are 16K, 32K, 64K, 128K and 256K tokens, plus 1M where a repository holds more than 1M tokens. BM25+and truncation read the same files: source, tests, docs and changelogs, without vendored, generated or binary+files (`../whole-repo/paths.py`). The report gives the share of tasks with every gold file inside (all-gold)+and with at least one (any-gold), with 95% bootstrap intervals over tasks.++## Line-level recall without a model (`e1l.py`)++Does a context hold the lines each fix changes, and not only some text of the files? `e1l.py gold` takes each+task's gold lines from its reference patch: the lines of the base commit that the patch removes or replaces (its+`-` lines) and, for a hunk that only adds lines, the line before each run it adds. Every gold line is checked+against the file at the base commit. `e1l.py run` then builds the three contexts at E1's budgets and records+which gold lines each holds: for the pack, the lines that its whole files and excerpts cover (lines shown only+in an outline never count); for BM25 and truncation, every line of a file they hold. `e1l_report.py` gives, per+budget, (a) the share of tasks with every gold line inside, (b) the mean share of gold lines inside and (c) the+share of gold files with all their gold lines inside, each against BM25 with intervals paired by task, and the+state of each gold file the pack misses. `e1l_compare.py` sets two builds side by side, paired by task, with E1's+file-level readings beside the line-level ones.++## Answers from Muse Spark (the answer runs)++100 tasks stratified by repository (`sample.py`, seed 20261027; `sample-e2.json`), three arms: no context,+BM25 at 64K and the pack at 64K, with the contexts measured above (`e2.py`). The prompt, the scorer (hit@1,+hit@5) and the paired tests are those of the whole-repository benchmark (`../whole-repo`). Every call is logged+with the tokens the API reports, and a run stops before a call that could pass its spending cap.++## The billed cache meter (`c4c.py`)++One kubernetes pack of 1M tokens in the cache layout: a question-independent prefix of 90% that every call+shares, then each question's own suffix. Muse Spark answers 20 questions on it and Muse Wonder 10, one call at a+time under one cache key. Each call's input, cached and output tokens are the API's own usage fields, and its+dollars are those fields at the published prices, so the first call can be compared with the follow-ups.++## Reproduce++Python 3.12 with `pyarrow` and `tokenizers`, git, and a Graphicle binary built with `local-inference`.+`node_setup.sh` makes the environment in a work folder (a virtual environment, the data, the binary and a bare+clone of each repository); it needs `WORK`, `BUILD` (a name for the build, such as its release version), for the+binary step `GRAPHICLE` (the program to copy), and for the g1 step `BENCH` (the whole-repository benchmark's work+folder) and `TOK` (the Muse Spark Open `tokenizer.json` that its manifests were counted with). Then:++```sh+python3 e1.py run --work WORK --graphicle graphicle --tokenizer tokenizer.json --ids sample-e2.json --contexts+python3 e1.py run --work WORK --graphicle graphicle --tokenizer tokenizer.json --order shuffled+python3 e1_report.py --work WORK --md e1.md+python3 e1l.py gold --work WORK --parquet WORK/raw/test-00000-of-00001.parquet+python3 e1l.py run --work WORK --graphicle graphicle --tokenizer tokenizer.json+python3 e1l_report.py --work WORK --md e1l.md+python3 e2.py --work WORK --arm noctx --out WORK/out/e2/noctx --key-file KEY # then --arm bm25, --arm pack+python3 c4c.py prepare --work WORK --graphicle graphicle --tokenizer tokenizer.json --texts TEXTS+python3 c4c.py run --work WORK --out WORK/out/c4c --texts TEXTS --key-file KEY+```++To measure another Graphicle build, `e1.py run ... --run NAME --reuse e1` builds every index and pack again+with it and takes the earlier run's BM25 and truncation rows as they are: those two arms never call Graphicle,+so a new build cannot change them. `e1_report.py --run NAME` gives its tables, and+`e1_compare.py --a e1 --b NAME` sets the two builds side by side. At line level, `e1l.py run ... --run NAME+--reuse e1l` measures the pack of another build in the same way, and `e1l_compare.py --base e1l --new NAME` sets+the two side by side.++`live.sh` runs the model runs (E2, the cache meter and the whole-repository grid) through one spend log with+caps; it needs `WORK`, `BUILD`, `TOK` (the Muse Spark Open `tokenizer.json`, which is not part of this+repository) and `KEY_FILE`, and for the `c4c`, `g1-pilot` and `g1` steps `TEXTS` (the whole-repository+benchmark's question texts).++`test_e1.py`, `test_e1l.py`, `test_e2.py` and `test_c4c.py` test them without a model (the last two on+`../whole-repo/mock_server.py`).diff --git a/bench/swe-bench-pro/c4c.py b/bench/swe-bench-pro/c4c.pynew file mode 100644index 0000000..b63de1a--- /dev/null+++ b/bench/swe-bench-pro/c4c.py@@ -0,0 +1,368 @@+#!/usr/bin/env python3+"""C4c: the billed cache meter. One 1M-token kubernetes pack, then Muse Spark and Muse Wonder follow-ups.++usage:+ c4c.py prepare --work WORK --graphicle BIN --tokenizer TOKENIZER.json --texts TEXTS [--budget 1015808]+ checks kubernetes out at its snapshot S (WORK/c4c/src/kubernetes, one shallow fetch), builds its index with+ BIN (WORK/c4c/data/kubernetes, timed), then the pack of each of the first 20 kubernetes questions:+ `graphicle pack "<issue>" --budget B --layout cache --prefix-share 0.9 --format xml|json --tokenizer ...`.+ Every pack must have the same prefix_sha256; writes WORK/c4c/packs/<id>.xml and WORK/c4c/packs.json.+ c4c.py run --work WORK --out OUT [--profile meta|mock] [--base-url URL] [--key-file FILE] [--spend-cap auto]+ [--spend-log FILE] [--caps caps.json] [--prices prices.json] [--tokenizer FILE] [--skip-count]+ the session: muse-spark-1.3 on questions 1-20, then muse-wonder-1.0 on questions 1-10, one call at a time+ in question order, each model's first call alone, all under one prompt_cache_key with 24-hour retention.+ Before the first billed call, POST /responses/input_tokens counts call 1's prompt; over 1,040,384 tokens+ the run stops and asks for packs built at 983,040 (prepare --budget 983040). If Spark's second call is+ served less than half from the cache, the session stops after Spark's third call. Writes OUT/calls.jsonl+ (tokens as Meta reports them, the cached share and the dollars those usage fields bill at prices.json),+ OUT/summary.json (the first call against the follow-ups, per model) and OUT/raw/.++The questions are the whole-repository benchmark's kubernetes questions (a development repository), in file+order; their answers are scored as a secondary. Every call goes through the spend log and caps of+../whole-repo/run.py.+"""+import argparse+import fcntl+import hashlib+import json+import math+import os+import statistics+import subprocess+import sys+import time++HERE = os.path.dirname(os.path.abspath(__file__))+WR = os.path.join(HERE, "..", "whole-repo")+sys.path.insert(0, WR)+from pack_arm import pack_command # noqa: E402+from run import (CACHE_RETENTION, PROMPT, PROFILES, CapReached, Client, Spend, logged_total, now_iso, # noqa: E402+ parse_files, text_of, usage_of, user_message)+from score import normalize_answer, score_answer # noqa: E402+from tokens import Counter # noqa: E402++N_SPARK, N_WONDER = 20, 10+SPARK, WONDER = "muse-spark-1.3", "muse-wonder-1.0"+BUDGET, SMALLER_BUDGET, SHARE = 1015808, 983040, 0.9+WINDOW, OUT_CAP = 1048576, 8192+OUT_TOKENS_ESTIMATE = 4000+++QUESTIONS = os.path.join(WR, "questions", "questions-kubernetes.jsonl")+++def questions(texts, path=QUESTIONS):+ qs = [json.loads(l) for l in open(path) if l.strip()]+ tx = {t["id"]: t["text"] for t in map(json.loads, open(os.path.join(texts, "texts-kubernetes.jsonl")))}+ for q in qs:+ if hashlib.sha256(tx[q["id"]].encode("utf-8")).hexdigest() != q["text_sha256"]:+ raise SystemExit(f"{q['id']}: the text does not match its text_sha256")+ return [(q, tx[q["id"]]) for q in qs[:N_SPARK]]+++def cmd_prepare(a):+ work = os.path.abspath(a.work)+ snap = json.load(open(os.path.join(WR, "snapshots.json")))["kubernetes"]["sha"]+ src = os.path.abspath(a.src or os.path.join(work, "c4c", "src", "kubernetes"))+ data = os.path.abspath(a.data or os.path.join(work, "c4c", "data", "kubernetes"))+ if a.data and os.path.isdir(a.data) and os.listdir(a.data):+ # An index the same binary built already (node_setup.sh g1): recorded, not rebuilt.+ os.makedirs(os.path.join(work, "c4c"), exist_ok=True)+ with open(os.path.join(work, "c4c", "index.json"), "w") as f:+ json.dump({"graphicle": subprocess.run([a.graphicle, "--version"], capture_output=True,+ text=True).stdout.strip(), "data": data, "reused": True}, f)+ if not os.path.exists(os.path.join(src, ".git")):+ os.makedirs(src, exist_ok=True)+ for cmd in (["git", "init", "-q"], ["git", "remote", "add", "origin", "https://github.com/kubernetes/kubernetes.git"],+ ["git", "fetch", "-q", "--depth", "1", "origin", snap], ["git", "checkout", "-q", "--detach", "FETCH_HEAD"]):+ subprocess.run(cmd, cwd=src, check=True)+ head = subprocess.run(["git", "rev-parse", "HEAD"], cwd=src, capture_output=True, text=True).stdout.strip()+ if head != snap:+ raise SystemExit(f"kubernetes is at {head}, not {snap}")+ version = subprocess.run([a.graphicle, "--version"], capture_output=True, text=True).stdout.strip()+ index_info = os.path.join(work, "c4c", "index.json")+ if not os.path.exists(index_info):+ os.makedirs(data, exist_ok=True)+ t0 = time.time()+ r = subprocess.run([a.graphicle, "sync", src, "--data-dir", data, "--json"], capture_output=True, text=True)+ if r.returncode != 0:+ raise SystemExit("graphicle sync: " + r.stderr[-300:])+ with open(index_info, "w") as f:+ json.dump({"graphicle": version, "seconds": round(time.time() - t0, 1)}, f)+ packs_dir = os.path.join(work, "c4c", "packs")+ os.makedirs(packs_dir, exist_ok=True)+ counter = Counter(a.tokenizer)+ manifest = {"graphicle": version, "S": snap, "budget": a.budget, "layout": "cache", "prefix_share": SHARE,+ "counter": counter.name, "packs": []}+ for q, text in questions(a.texts, a.questions):+ pj = None+ for fmt in ("json", "xml"):+ r = subprocess.run(pack_command(a.graphicle, src, data, text, a.budget, a.tokenizer, fmt, "cache", SHARE),+ capture_output=True, text=True, timeout=3600)+ if r.returncode != 0:+ raise SystemExit(f"{q['id']}: graphicle pack: {r.stderr[-300:]}")+ if fmt == "json":+ pj = json.loads(r.stdout)+ else:+ with open(os.path.join(packs_dir, q["id"] + ".xml"), "w", encoding="utf-8") as f:+ f.write(r.stdout)+ manifest["packs"].append({"id": q["id"], "tokens": pj.get("tokens"), "prefix_sha256": pj.get("prefix_sha256"),+ "prefix_tokens": pj.get("prefix_tokens"),+ "xml_sha256": hashlib.sha256(r.stdout.encode("utf-8")).hexdigest(),+ "xml_tokens": counter.count(r.stdout)})+ print(f"{q['id']}: {manifest['packs'][-1]['tokens']} tokens, prefix {str(pj.get('prefix_sha256'))[:12]}", flush=True)+ prefixes = {p["prefix_sha256"] for p in manifest["packs"]}+ manifest["one_prefix"] = len(prefixes) == 1 and None not in prefixes+ with open(os.path.join(work, "c4c", "packs.json"), "w") as f:+ json.dump(manifest, f, indent=1)+ if not manifest["one_prefix"]:+ raise SystemExit(f"the packs have {len(prefixes)} prefixes: the session would not share one; stopped")+ print(f"packs ready: one prefix {prefixes.pop()[:12]}, budget {a.budget}")+++def summarize(calls, models=(SPARK, WONDER)):+ out = {}+ for model in models:+ cs = [c for c in calls if c["model"] == model and not c.get("error")]+ if not cs:+ continue+ first, rest = cs[0], cs[1:]+ out[model] = {"calls": len(cs), "first": {k: first[k] for k in ("input_tokens", "cached_tokens", "cost_usd",+ "cached_share", "seconds")},+ "total_usd": sum(c["cost_usd"] for c in cs), "hit5": sum(c.get("hit5", 0) for c in cs)}+ if rest:+ costs = [c["cost_usd"] for c in rest]+ shares = [c["cached_share"] for c in rest]+ out[model]["follow_ups"] = {"n": len(rest), "cost_mean": statistics.mean(costs),+ "cost_median": statistics.median(costs), "cost_min": min(costs),+ "cost_max": max(costs), "cached_share_mean": statistics.mean(shares),+ "cached_share_min": min(shares)}+ return out+++def cmd_run(a):+ work = os.path.abspath(a.work)+ prof = PROFILES[a.profile]+ base_url = a.base_url or prof["base_url"]+ if not base_url:+ raise SystemExit(f"--base-url is needed with --profile {a.profile}")+ manifest = json.load(open(os.path.join(work, "c4c", "packs.json")))+ if not manifest.get("one_prefix"):+ raise SystemExit("the packs do not share one prefix")+ prices = json.load(open(a.prices))+ models = [(SPARK if a.profile != "mock" else "mock", N_SPARK), (WONDER if a.profile != "mock" else "mock-wonder", N_WONDER)]+ for m, _n in models:+ if m not in prices["models"]:+ raise SystemExit(f"no price for {m}")+ provider = prices["models"][models[0][0]].get("provider", a.profile)+ caps = json.load(open(a.caps))["usd"] if os.path.exists(a.caps) else {}+ global_cap = caps.get(provider)+ key = open(a.key_file).read().strip() if a.key_file else os.environ.get(prof["key_env"], "")+ if not key:+ raise SystemExit(f"no key: set {prof['key_env']} or pass --key-file")+ spend_log = os.path.abspath(a.spend_log or os.path.join(work, "spend", "spend-log.jsonl"))+ os.makedirs(os.path.join(a.out, "raw"), exist_ok=True)+ os.makedirs(os.path.dirname(spend_log), exist_ok=True)+ lock = open(spend_log + f".{provider}.lock", "w")+ try:+ fcntl.flock(lock, fcntl.LOCK_EX | fcntl.LOCK_NB)+ except OSError:+ sys.exit(f"REFUSED: another run for {provider} holds {lock.name}")+ counter = Counter(a.tokenizer)+ qs = questions(a.texts, a.questions)+ packs = {p["id"]: p for p in manifest["packs"]}+ prefix12 = manifest["packs"][0]["prefix_sha256"][:12]+ cache_key = f"c4c:kubernetes@{manifest['S'][:12]}:pack-cache@1M:{prefix12}"++ def prompt_of(q, text):+ body = open(os.path.join(work, "c4c", "packs", q["id"] + ".xml"), encoding="utf-8").read()+ if hashlib.sha256(body.encode("utf-8")).hexdigest() != packs[q["id"]]["xml_sha256"]:+ raise SystemExit(f"{q['id']}: the pack file changed since prepare")+ return PROMPT.format(context=body + "\n\n", repo=q["repo"], sha=q["S"], issue=text)++ def cost(price, tin, tcached, tout):+ return ((tin - tcached) * price["input"] + tcached * price.get("cached_input", price["input"])+ + tout * price["output"]) / 1e6++ # The estimate: each model's first call uncached, the others with the 90% prefix from the cache.+ est = 0.0+ for m, n in models:+ p = prices["models"][m]+ for i, (q, text) in enumerate(qs[:n]):+ tin = counter.count(prompt_of(q, text)) if a.tokenizer else packs[q["id"]]["tokens"] + 1000+ shared = packs[q["id"]].get("prefix_tokens") or int(SHARE * packs[q["id"]]["tokens"])+ est += cost(p, tin, 0 if i == 0 else min(tin, shared), OUT_TOKENS_ESTIMATE)+ calls_path = os.path.join(a.out, "calls.jsonl")+ done = [json.loads(l) for l in open(calls_path)] if os.path.exists(calls_path) else []+ logged = logged_total(spend_log, provider)+ print(f"c4c: estimate ${est:.2f}; {provider} log total ${logged:.2f}"+ + (f", cap ${global_cap:.2f}" if global_cap is not None else ""), flush=True)+ if not done and global_cap is not None and logged + est > global_cap:+ sys.exit(f"REFUSED: the {provider} log total ${logged:.2f} plus the estimate ${est:.2f} would pass the cap")+ spent_before = json.load(open(os.path.join(a.out, "spend.json")))["spent_usd"] \+ if os.path.exists(os.path.join(a.out, "spend.json")) else 0.0+ cap = spent_before + math.ceil(1.5 * est) if str(a.spend_cap).lower() == "auto" else float(a.spend_cap)+ if global_cap is not None:+ cap = min(cap, spent_before + global_cap - logged)+ spend = Spend(os.path.join(a.out, "spend.json"), cap, prices["models"][models[0][0]], spend_log, provider, global_cap)+ client = Client(base_url, key, "responses")+ run_meta = {"session": "c4c", "cache_key": cache_key, "budget": manifest["budget"], "graphicle": manifest["graphicle"],+ "S": manifest["S"], "models": [m for m, _n in models], "estimate_usd": est, "spend_cap_usd": cap,+ "global_cap_usd": global_cap, "spend_log": spend_log, "started": now_iso()}++ if not done and not a.skip_count:+ q, text = qs[0]+ t0 = time.time()+ r = client.post("/responses/input_tokens", {"model": models[0][0], "input": [user_message(prompt_of(q, text))]})+ n = r.get("input_tokens")+ # Into the ledger too; Meta's pages do not say whether counting is billed, so it is logged at $0.+ spend.settle(0.0, 0.0, {"time": now_iso(), "provider": provider, "model": models[0][0], "api": "input_tokens",+ "arm": "c4c window check", "budget": "1M", "run": os.path.abspath(a.out),+ "cache_key": None, "repo": "kubernetes", "question": q["id"], "turn": 0,+ "benchmark": "c4c", "status": "ok", "input_tokens": n or 0, "cached_tokens": 0,+ "output_tokens": 0, "reasoning_tokens": 0, "seconds": round(time.time() - t0, 3),+ "cost_usd": 0.0})+ run_meta["window_check"] = {"input_tokens": n, "limit": WINDOW - OUT_CAP}+ print(f"window check: call 1 counts {n} input tokens (limit {WINDOW - OUT_CAP})", flush=True)+ if n is not None and n > WINDOW - OUT_CAP:+ with open(os.path.join(a.out, "run.json"), "w") as f:+ json.dump(run_meta, f, indent=1)+ sys.exit(f"STOP: call 1 would pass the window; build the packs at {SMALLER_BUDGET} "+ f"(c4c.py prepare --budget {SMALLER_BUDGET}) and run again")+ with open(os.path.join(a.out, "run.json"), "w") as f:+ json.dump(run_meta, f, indent=1)+ have = {(c["model"], c["id"]) for c in done if not c.get("error")}+ stopped = None+ for m, n in models:+ price = prices["models"][m]+ for i, (q, text) in enumerate(qs[:n], 1):+ if (m, q["id"]) in have:+ continue+ spark_calls = [c for c in done if c["model"] == models[0][0] and not c.get("error")]+ if m == models[0][0] and i > 3 and len(spark_calls) >= 2 and \+ spark_calls[1]["cached_tokens"] < 0.5 * spark_calls[1]["input_tokens"]:+ stopped = "Spark's second call was served less than half from the cache: stopped after its third call"+ break+ prompt = prompt_of(q, text)+ spend.price = price+ row = {"n": i, "model": m, "id": q["id"], "cache_key": cache_key, "pack_tokens": packs[q["id"]]["tokens"],+ "error": None}+ body = {"model": m, "input": [user_message(prompt)], "store": False, "reasoning": {"effort": "medium"},+ "max_output_tokens": OUT_CAP, "prompt_cache_key": cache_key,+ "prompt_cache_retention": CACHE_RETENTION}+ rec = {"time": now_iso(), "provider": provider, "model": m, "api": "responses", "arm": "c4c pack-cache@1M",+ "budget": "1M", "run": os.path.abspath(a.out), "cache_key": cache_key, "repo": "kubernetes",+ "question": q["id"], "turn": 1, "benchmark": "c4c"}+ try:+ worst = spend.reserve(counter.count(prompt), OUT_CAP)+ except CapReached as e:+ stopped = f"cap: {e}"+ break+ t0 = time.time()+ try:+ resp = client.post("/responses", body)+ except Exception as e:+ spend.settle(worst, 0.0, dict(rec, status="error", error=str(e)[:200], input_tokens=0, cached_tokens=0,+ output_tokens=0, reasoning_tokens=0, seconds=round(time.time() - t0, 3),+ cost_usd=0.0))+ row["error"] = str(e)[:300]+ with open(calls_path, "a") as f:+ f.write(json.dumps(row, sort_keys=True) + "\n")+ done.append(row)+ continue+ tin, tcached, tout, treason = usage_of(resp, "responses")+ c = cost(price, tin, tcached, tout)+ secs = round(time.time() - t0, 3)+ spend.settle(worst, c, dict(rec, status="ok", input_tokens=tin, cached_tokens=tcached, output_tokens=tout,+ reasoning_tokens=treason, seconds=secs, cost_usd=c))+ answer = text_of(resp, "responses")+ files = parse_files(answer)+ row.update(score_answer(normalize_answer(files) if files is not None else [], q["gold"]))+ row.update({"input_tokens": tin, "cached_tokens": tcached, "output_tokens": tout, "reasoning_tokens": treason,+ "seconds": secs, "cost_usd": c, "cached_share": (tcached / tin) if tin else 0.0,+ "answer_parsed": files is not None, "usage": resp.get("usage")})+ with open(os.path.join(a.out, "raw", f"{m}-{q['id']}.json"), "w") as f:+ json.dump({"response": resp, "answer": answer}, f)+ with open(calls_path, "a") as f:+ f.write(json.dumps(row, sort_keys=True) + "\n")+ done.append(row)+ print(f"{m} {i:2d} {q['id']}: in {tin:,} cached {tcached:,} ({row['cached_share']:.1%}) out {tout:,} "+ f"${c:.4f}", flush=True)+ if stopped:+ break+ summary = summarize(done, [m for m, _n in models])+ summary["stopped"] = stopped+ with open(os.path.join(a.out, "summary.json"), "w") as f:+ json.dump(summary, f, indent=1)+ run_meta.update({"finished": now_iso(), "spend_usd": spend.spent, "stopped": stopped})+ with open(os.path.join(a.out, "run.json"), "w") as f:+ json.dump(run_meta, f, indent=1)+ print(json.dumps(summary, indent=1)[:3000])+++def cmd_check(a):+ """The first question's pack built again by another binary, compared with the session's."""+ work = os.path.abspath(a.work)+ manifest = json.load(open(os.path.join(work, "c4c", "packs.json")))+ q, text = questions(a.texts, a.questions)[0]+ want = next(p for p in manifest["packs"] if p["id"] == q["id"])+ out = {"id": q["id"], "session_graphicle": manifest["graphicle"], "session_xml_sha256": want["xml_sha256"],+ "session_prefix_sha256": want["prefix_sha256"], "budget": manifest["budget"],+ "check_binary": os.path.abspath(a.graphicle)}+ for fmt in ("json", "xml"):+ r = subprocess.run(pack_command(a.graphicle, os.path.abspath(a.src), os.path.abspath(a.data), text,+ manifest["budget"], a.tokenizer, fmt, "cache", SHARE),+ capture_output=True, text=True, timeout=3600)+ if r.returncode != 0:+ raise SystemExit(f"graphicle pack: {r.stderr[-300:]}")+ if fmt == "json":+ out["check_prefix_sha256"] = json.loads(r.stdout).get("prefix_sha256")+ else:+ out["check_xml_sha256"] = hashlib.sha256(r.stdout.encode("utf-8")).hexdigest()+ out["same"] = out["check_xml_sha256"] == want["xml_sha256"] and out["check_prefix_sha256"] == want["prefix_sha256"]+ with open(os.path.join(work, "c4c", "check-" + a.name + ".json"), "w") as f:+ json.dump(out, f, indent=1)+ print(json.dumps(out, indent=1))+++def main():+ ap = argparse.ArgumentParser()+ sub = ap.add_subparsers(dest="cmd", required=True)+ c = sub.add_parser("check")+ c.add_argument("--work", required=True)+ c.add_argument("--graphicle", required=True)+ c.add_argument("--tokenizer", required=True)+ c.add_argument("--texts", required=True)+ c.add_argument("--questions", default=QUESTIONS)+ c.add_argument("--src", required=True)+ c.add_argument("--data", required=True, help="an index of --src built by --graphicle")+ c.add_argument("--name", required=True, help="names the result file WORK/c4c/check-NAME.json")+ p = sub.add_parser("prepare")+ p.add_argument("--work", required=True)+ p.add_argument("--graphicle", required=True)+ p.add_argument("--tokenizer", required=True)+ p.add_argument("--texts", required=True)+ p.add_argument("--budget", type=int, default=BUDGET)+ p.add_argument("--questions", default=QUESTIONS)+ p.add_argument("--src", help="a kubernetes checkout at S to use (default WORK/c4c/src/kubernetes, fetched)")+ p.add_argument("--data", help="its index, built by the same binary (default WORK/c4c/data/kubernetes)")+ r = sub.add_parser("run")+ r.add_argument("--work", required=True)+ r.add_argument("--out", required=True)+ r.add_argument("--texts", required=True)+ r.add_argument("--questions", default=QUESTIONS)+ r.add_argument("--profile", default="meta", choices=["meta", "mock"])+ r.add_argument("--base-url")+ r.add_argument("--key-file")+ r.add_argument("--spend-cap", default="auto")+ r.add_argument("--spend-log")+ r.add_argument("--caps", default=os.path.join(WR, "caps.json"))+ r.add_argument("--prices", default=os.path.join(WR, "prices.json"))+ r.add_argument("--tokenizer")+ r.add_argument("--skip-count", action="store_true", help="do not count call 1 with /responses/input_tokens")+ a = ap.parse_args()+ {"prepare": cmd_prepare, "run": cmd_run, "check": cmd_check}[a.cmd](a)+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/data.py b/bench/swe-bench-pro/data.pynew file mode 100644index 0000000..72bc997--- /dev/null+++ b/bench/swe-bench-pro/data.py@@ -0,0 +1,120 @@+#!/usr/bin/env python3+"""SWE-bench Pro (public set, V2: 642 tasks) as a change-localization benchmark.++usage:+ data.py fetch --out DIR+ downloads the pinned dataset file (Hugging Face ScaleAI/SWE-bench_Pro, config "default", split+ "test", revision REVISION) into DIR and checks its sha256+ data.py tasks --parquet FILE --tasks OUT.jsonl --texts DIR+ writes one line per task to OUT.jsonl and each task's problem statement to DIR/<instance_id>.txt+ (the texts are not committed; `fetch` and `tasks` rebuild them and text_sha256 checks them)++A task's line: instance_id, repo, base_commit, language, gold, added, text_sha256, names_gold_path, hard.+- gold: the files the reference patch (the dataset's `patch`, without the test patch) changes and that+ exist at the base commit: modified, deleted, or the old side of a rename. These are what a context can+ hold; e1.py checks that each one exists at the base commit.+- added: the files the reference patch creates. No context can hold them, so they are not gold.+- names_gold_path: the problem statement names a gold file by a path of at least two parts.+The question text is the problem statement alone, as the dataset gives it; the dataset's `requirements`+and `interface` fields are not used, since they often name the files and functions to change.+"""+import argparse+import hashlib+import json+import os+import sys+import urllib.request++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, os.path.join(HERE, "..", "whole-repo"))+from mine import names_gold_path, parse_diff # noqa: E402++DATASET = "ScaleAI/SWE-bench_Pro"+REVISION = "2d52cb3df914a3fcf80c7f66738b3a88ae37fc50" # V2 (2026-09-22), 642 tasks+FILE = "data/default/test-00000-of-00001.parquet"+FILE_SHA256 = "1067f72c1f43bbc578276888625db3b836cebb535546c9eaf824c5d5dd104a7f"+++def sha256_bytes(b):+ return hashlib.sha256(b).hexdigest()+++def cmd_fetch(a):+ os.makedirs(a.out, exist_ok=True)+ url = f"https://huggingface.co/datasets/{DATASET}/resolve/{REVISION}/{FILE}"+ dest = os.path.join(a.out, os.path.basename(FILE))+ with urllib.request.urlopen(url, timeout=120) as r:+ data = r.read()+ got = sha256_bytes(data)+ if got != FILE_SHA256:+ raise SystemExit(f"sha256 mismatch: {got} (expected {FILE_SHA256})")+ with open(dest, "wb") as f:+ f.write(data)+ print(f"{dest}: {len(data)} bytes, sha256 ok")+++def gold_of(patch):+ gold, added = [], []+ for s in parse_diff(patch):+ if s["status"] == "added":+ if s["new"] and s["new"] not in added:+ added.append(s["new"])+ elif s["old"] and s["old"] not in gold:+ gold.append(s["old"])+ return gold, added+++def cmd_tasks(a):+ import pyarrow.parquet as pq+ with open(a.parquet, "rb") as f:+ if sha256_bytes(f.read()) != FILE_SHA256:+ raise SystemExit("the parquet file is not the pinned revision")+ rows = pq.read_table(a.parquet).to_pylist()+ os.makedirs(a.texts, exist_ok=True)+ out = []+ for r in sorted(rows, key=lambda r: r["instance_id"]):+ text = r["problem_statement"] or ""+ gold, added = gold_of(r["patch"] or "")+ with open(os.path.join(a.texts, r["instance_id"] + ".txt"), "w", encoding="utf-8") as f:+ f.write(text)+ out.append({"instance_id": r["instance_id"], "repo": r["repo"], "base_commit": r["base_commit"],+ "language": r["repo_language"], "gold": gold, "added": added,+ "text_sha256": sha256_bytes(text.encode("utf-8")),+ "names_gold_path": names_gold_path(text, gold), "hard": bool(r.get("hard"))})+ with open(a.tasks, "w") as f:+ for t in out:+ f.write(json.dumps(t, sort_keys=True) + "\n")+ by_repo = {}+ for t in out:+ d = by_repo.setdefault(t["repo"], {"tasks": 0, "commits": set(), "no_gold": 0, "gold": 0, "added": 0,+ "named": 0, "lang": set()})+ d["tasks"] += 1+ d["commits"].add(t["base_commit"])+ d["no_gold"] += int(not t["gold"])+ d["gold"] += len(t["gold"])+ d["added"] += len(t["added"])+ d["named"] += int(t["names_gold_path"])+ d["lang"].add(t["language"])+ print("repo\ttasks\tbase_commits\tgold_files\tadded_files\tno_gold\tnames_gold\tlanguages")+ for k in sorted(by_repo):+ d = by_repo[k]+ print(f"{k}\t{d['tasks']}\t{len(d['commits'])}\t{d['gold']}\t{d['added']}\t{d['no_gold']}\t{d['named']}\t"+ f"{','.join(sorted(d['lang']))}")+ print(f"total\t{len(out)}")+++def main():+ ap = argparse.ArgumentParser()+ sub = ap.add_subparsers(dest="cmd", required=True)+ f = sub.add_parser("fetch")+ f.add_argument("--out", required=True)+ t = sub.add_parser("tasks")+ t.add_argument("--parquet", required=True)+ t.add_argument("--tasks", required=True)+ t.add_argument("--texts", required=True)+ a = ap.parse_args()+ {"fetch": cmd_fetch, "tasks": cmd_tasks}[a.cmd](a)+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/e1.py b/bench/swe-bench-pro/e1.pynew file mode 100644index 0000000..4fc0ebe--- /dev/null+++ b/bench/swe-bench-pro/e1.py@@ -0,0 +1,376 @@+#!/usr/bin/env python3+"""E1: gold-file recall on SWE-bench Pro without a model: the pack, file-level BM25 and truncation.++usage:+ e1.py run --work WORK --graphicle BIN --tokenizer TOKENIZER.json [--ids FILE] [--order sample|shuffled]+ [--jobs 6] [--threads 6] [--keep]+ runs every task of WORK/tasks.jsonl (or the ids in FILE: a JSON list, or an object with "ids") that has+ no rows yet, each in its own process; --order shuffled runs them in random.Random(20261027) order+ e1.py task --work WORK --graphicle BIN --tokenizer TOKENIZER.json --id INSTANCE_ID [--contexts] [--keep]+ one task: check out the repository at the base commit (WORK/mirror holds a bare clone of each+ repository), build its Graphicle index (timed), count every file with the tokenizer (tokens.py),+ then measure the three arms at every budget and write WORK/out/e1/rows/<id>.jsonl and+ WORK/out/e1/tasks/<id>.json (sizes, index time and size, seconds per arm). --contexts also saves the+ 64K pack (xml) and BM25 contexts under WORK/contexts/<id>/ for the answer runs.+ --reuse RUN (run and task) measures the pack again with another build and takes the BM25 and truncation+ rows of an earlier run as they are: those two arms are this script's own code and read the checkout and+ the token counts, never Graphicle, so a new build cannot change them. The task's budgets, file counts and+ tokens come from RUN's record of it (no tokenizer pass), the index is built again by BIN, and the+ record notes the reuse. Only tasks RUN measured are run; --contexts is refused (it needs BM25's text).++The budgets are 16K, 32K, 64K, 128K and 256K tokens, plus 1M (1,015,808) when truncation's file set holds+more than that. A row: id, repo, arm, budget, gold_n, inside (gold files inside the context), share,+all_gold, any_gold, context_tokens, context_files, fits_whole (truncation's file set fits in the budget),+names_gold_path, seconds. A gold file is inside the pack when the pack holds at least one passage of it (its+`included` list, which names every file whose text the pack holds); pack rows also give inside_whole, the gold+files the pack holds whole, and inside_outline_only, the gold files inside whose only text in the pack is an+outline (the first line of each symbol). Both are counts within inside, for separate columns: they never change+it. BM25 and truncation hold whole files only.+"""+import argparse+import hashlib+import json+import os+import random+import shutil+import subprocess+import sys+import tempfile+import time+from concurrent.futures import ThreadPoolExecutor++HERE = os.path.dirname(os.path.abspath(__file__))+WR = os.path.join(HERE, "..", "whole-repo")+sys.path.insert(0, WR)+from bm25 import build_bm25 # noqa: E402+from pack_arm import pack_command # noqa: E402+from tokens import Counter, build_manifest, build_truncation, truncation_order # noqa: E402++BUDGETS = [("16K", 16384), ("32K", 32768), ("64K", 65536), ("128K", 131072), ("256K", 262144)]+BIG = ("1M", 1015808)+CONTEXT_BUDGET = "64K"+ORDER_SEED = 20261027+MAX_ATTEMPTS = 2+++def measured(cmd, timeout):+ """(exit code, stdout, stderr, wall seconds, CPU seconds, peak resident MiB) of one process."""+ with tempfile.TemporaryFile() as out, tempfile.TemporaryFile() as err:+ t0 = time.time()+ p = subprocess.Popen(cmd, stdout=out, stderr=err)+ try:+ _pid, status, ru = os.wait4(p.pid, 0) if timeout is None else _wait(p, timeout)+ except subprocess.TimeoutExpired:+ p.kill()+ _pid, status, ru = os.wait4(p.pid, 0)+ raise+ out.seek(0)+ err.seek(0)+ return (os.waitstatus_to_exitcode(status), out.read().decode("utf-8", "replace"),+ err.read().decode("utf-8", "replace"), time.time() - t0, ru.ru_utime + ru.ru_stime, ru.ru_maxrss / 1024)+++def _wait(p, timeout):+ deadline = time.time() + timeout+ while True:+ pid, status, ru = os.wait4(p.pid, os.WNOHANG)+ if pid:+ return pid, status, ru+ if time.time() > deadline:+ raise subprocess.TimeoutExpired(p.args, timeout)+ time.sleep(0.2)+++def du_bytes(path):+ total = 0+ for root, _dirs, files in os.walk(path):+ for f in files:+ try:+ total += os.lstat(os.path.join(root, f)).st_size+ except OSError:+ pass+ return total+++def load_tasks(work):+ return {t["instance_id"]: t for t in map(json.loads, open(os.path.join(work, "tasks.jsonl"))) if t}+++def git(src, *args, check=True):+ return subprocess.run(["git", "-C", src, *args], capture_output=True, text=True, check=check)+++def run_paths(work, run):+ """(scratch root of the checkouts, indexes and manifests; output folder; contexts folder; logs folder). The+ first run, "e1", keeps the original layout; a later run (another build) has its own of each, so two runs can+ go at once."""+ if run == "e1":+ return work, os.path.join(work, "out", "e1"), os.path.join(work, "contexts"), os.path.join(work, "logs", "e1")+ return (os.path.join(work, "runs", run), os.path.join(work, "out", run), os.path.join(work, "contexts-" + run),+ os.path.join(work, "logs", run))+++def checkout(work, scratch, t):+ mirror = os.path.join(work, "mirror", t["repo"].replace("/", "__") + ".git")+ src = os.path.join(scratch, "src", t["instance_id"])+ if os.path.exists(src):+ shutil.rmtree(src)+ os.makedirs(os.path.dirname(src), exist_ok=True)+ subprocess.run(["git", "clone", "-q", "--shared", "--no-checkout", mirror, src], check=True)+ git(src, "-c", "advice.detachedHead=false", "checkout", "-q", "--detach", t["base_commit"])+ head = git(src, "rev-parse", "HEAD").stdout.strip()+ if head != t["base_commit"]:+ raise RuntimeError(f"checkout gave {head}, not {t['base_commit']}")+ return src+++def row(t, arm, label, budget, included, tokens, secs, gold, fits):+ inc = set(included)+ inside = sum(1 for g in gold if g in inc)+ return {"id": t["instance_id"], "repo": t["repo"], "arm": arm, "budget": label, "budget_tokens": budget,+ "gold_n": len(gold), "inside": inside, "share": inside / len(gold), "all_gold": int(inside == len(gold)),+ "any_gold": int(inside > 0), "context_tokens": tokens, "context_files": len(included),+ "fits_whole": fits, "names_gold_path": t["names_gold_path"], "seconds": round(secs, 3)}+++REUSED_ARMS = ("bm25", "trunc")+++def outline_only(pj):+ """The files a pack holds only as outlines (the first line of each symbol: a chunk whose `why` says outline)."""+ kinds = {}+ for sec in pj.get("sections") or []:+ for c in sec.get("chunks") or []:+ if c.get("path"):+ outline = not c.get("whole") and "(outline" in (c.get("why") or "")+ kinds.setdefault(c["path"], set()).add(outline)+ return {p for p, k in kinds.items() if k == {True}}+++def reused_task(work, run, iid):+ """The record and rows of task iid in an earlier run (--reuse), or None when that run did not measure it."""+ _s, outdir, _c, _l = run_paths(work, run)+ rows_p, task_p = os.path.join(outdir, "rows", iid + ".jsonl"), os.path.join(outdir, "tasks", iid + ".json")+ if not (os.path.exists(rows_p) and os.path.exists(task_p)):+ return None+ rows = {(r["arm"], r["budget"]): r for r in map(json.loads, open(rows_p))}+ return {"info": json.load(open(task_p)), "rows": rows}+++def cmd_task(a):+ work = os.path.abspath(a.work)+ t = load_tasks(work)[a.id]+ iid = t["instance_id"]+ scratch, outdir, ctx_root, _logs = run_paths(work, a.run)+ out_rows = os.path.join(outdir, "rows", iid + ".jsonl")+ out_task = os.path.join(outdir, "tasks", iid + ".json")+ if os.path.exists(out_rows):+ print(f"{iid}: done already")+ return+ reuse = None+ if a.reuse:+ if a.contexts:+ raise SystemExit("--contexts needs BM25's context text, so it does not go with --reuse")+ if a.reuse == a.run:+ raise SystemExit("--reuse names this run itself")+ reuse = reused_task(work, a.reuse, iid)+ if reuse is None:+ raise SystemExit(f"{iid}: run {a.reuse} has no rows for this task")+ text = open(os.path.join(work, "texts", iid + ".txt"), encoding="utf-8").read()+ if hashlib.sha256(text.encode("utf-8")).hexdigest() != t["text_sha256"]:+ raise SystemExit(f"{iid}: the problem statement does not match text_sha256")+ t0 = time.time()+ src = checkout(work, scratch, t)+ data = os.path.join(scratch, "data", iid)+ info = {"id": iid, "repo": t["repo"], "base_commit": t["base_commit"], "graphicle": None}+ try:+ missing = [g for g in t["gold"] if git(src, "cat-file", "-e", "HEAD:" + g, check=False).returncode != 0]+ gold = [g for g in t["gold"] if g not in missing]+ info.update({"gold_n": len(gold), "gold_missing_at_base": missing, "checkout_seconds": round(time.time() - t0, 1)})+ if not gold:+ raise RuntimeError("no gold file exists at the base commit")+ if reuse:+ ri = reuse["info"]+ if ri.get("gold_n") != len(gold) or ri.get("gold_missing_at_base") != missing:+ raise RuntimeError(f"the gold files differ from run {a.reuse}'s")+ info.update({k: ri[k] for k in ("files", "tokens_all", "tokens_eligible", "counter")})+ info["reused"] = {"run": a.reuse, "arms": list(REUSED_ARMS), "graphicle": ri.get("graphicle")}+ elig = ri["tokens_eligible"]+ budgets = [(lb, b) for lb, b in BUDGETS + [BIG] if lb in ri["budgets"]]+ if [lb for lb, _b in budgets] != ri["budgets"]:+ raise RuntimeError(f"unknown budgets in run {a.reuse}: {ri['budgets']}")+ else:+ counter = Counter(a.tokenizer)+ t1 = time.time()+ rows_m = build_manifest(scratch, iid, counter)+ info["manifest_seconds"] = round(time.time() - t1, 1)+ elig = sum(c + w for _r, _p, c, w in truncation_order(iid, rows_m))+ info.update({"files": len(rows_m), "tokens_all": sum(c for _p, _cls, _b, c, _w in rows_m if c > 0),+ "tokens_eligible": elig, "counter": counter.name})+ budgets = BUDGETS + ([BIG] if elig > BIG[1] else [])+ info["graphicle"] = subprocess.run([a.graphicle, "--version"], capture_output=True, text=True).stdout.strip()+ os.makedirs(data, exist_ok=True)+ code, out, err, wall, cpu, peak = measured([a.graphicle, "sync", src, "--data-dir", data, "--json"], 3600)+ if code != 0:+ raise RuntimeError("graphicle sync: " + err.strip()[-300:])+ info["index"] = {"wall_seconds": round(wall, 1), "cpu_seconds": round(cpu, 1), "peak_rss_mib": round(peak, 1),+ "data_bytes": du_bytes(data)}+ rows, secs = [], {"pack": 0.0, "bm25": 0.0, "trunc": 0.0}+ cache = {}+ ctx_dir = os.path.join(ctx_root, iid)+ for label, b in budgets:+ fits = elig <= b+ s = time.time()+ code, out, err, _w, _c, peak = measured(+ pack_command(a.graphicle, src, data, text, b, a.tokenizer, "json", layout="standard"), 1800)+ if code != 0:+ raise RuntimeError("graphicle pack: " + err.strip()[-300:])+ pj = json.loads(out)+ secs["pack"] += time.time() - s+ if pj.get("layout") not in (None, "standard"):+ raise RuntimeError(f"pack layout {pj.get('layout')!r}, not standard")+ pinc = [f["path"] for f in pj.get("included") or []]+ whole = {c.get("path") for sec in pj.get("sections") or [] for c in sec.get("chunks") or [] if c.get("whole")}+ outline = outline_only(pj)+ r = row(t, "pack", label, b, pinc, pj.get("tokens"), time.time() - s, gold, fits)+ r.update({"inside_whole": sum(1 for g in gold if g in whole),+ "inside_outline_only": sum(1 for g in gold if g in outline and g in pinc),+ "peak_mib": round(peak, 1), "tokenizer": pj.get("tokenizer")})+ rows.append(r)+ if reuse:+ for arm in REUSED_ARMS:+ old = reuse["rows"].get((arm, label))+ if old is None or old["fits_whole"] != fits or old["gold_n"] != len(gold):+ raise RuntimeError(f"run {a.reuse} has no matching {arm} row at {label}")+ rows.append(old)+ continue+ s = time.time()+ btext, binc, btok = build_bm25(scratch, iid, text, b, counter, cache)+ secs["bm25"] += time.time() - s+ rows.append(row(t, "bm25", label, b, binc, btok, time.time() - s, gold, fits))+ s = time.time()+ _tt, tinc, ttok = build_truncation(scratch, iid, b, counter)+ secs["trunc"] += time.time() - s+ rows.append(row(t, "trunc", label, b, tinc, ttok, time.time() - s, gold, fits))+ if a.contexts and label == CONTEXT_BUDGET:+ os.makedirs(ctx_dir, exist_ok=True)+ code, xml, err, _w, _c, _p = measured(+ pack_command(a.graphicle, src, data, text, b, a.tokenizer, "xml", layout="standard"), 1800)+ if code != 0:+ raise RuntimeError("graphicle pack (xml): " + err.strip()[-300:])+ for fname, body, inc in (("pack-64K.xml", xml, pinc), ("bm25-64K.txt", btext, binc)):+ with open(os.path.join(ctx_dir, fname), "w", encoding="utf-8") as f:+ f.write(body)+ info.setdefault("contexts", {})[fname] = {+ "sha256": hashlib.sha256(body.encode("utf-8")).hexdigest(), "tokens": counter.count(body),+ "files": len(inc)}+ info["arm_seconds"] = {k: round(v, 1) for k, v in secs.items() if not (reuse and k in REUSED_ARMS)}+ info["budgets"] = [lb for lb, _b in budgets]+ info["seconds"] = round(time.time() - t0, 1)+ os.makedirs(os.path.dirname(out_rows), exist_ok=True)+ os.makedirs(os.path.dirname(out_task), exist_ok=True)+ with open(out_task, "w") as f:+ json.dump(info, f, indent=1, sort_keys=True)+ with open(out_rows + ".tmp", "w") as f:+ for r in rows:+ f.write(json.dumps(r, sort_keys=True) + "\n")+ os.replace(out_rows + ".tmp", out_rows)+ print(f"{iid}: {len(rows)} rows, index {info['index']['wall_seconds']} s, total {info['seconds']} s", flush=True)+ except Exception as e:+ info["error"] = f"{type(e).__name__}: {str(e)[:400]}"+ os.makedirs(os.path.dirname(out_task), exist_ok=True)+ with open(out_task + ".failed", "w") as f:+ json.dump(info, f, indent=1, sort_keys=True)+ with open(out_task + ".attempts", "a") as f: # one line per failed attempt+ f.write(json.dumps({"time": time.strftime("%Y-%m-%dT%H:%M:%SZ", time.gmtime()), "error": info["error"]}) + "\n")+ raise+ finally:+ if not a.keep:+ shutil.rmtree(src, ignore_errors=True)+ shutil.rmtree(data, ignore_errors=True)+ try:+ os.remove(os.path.join(scratch, "manifest", iid + ".tsv"))+ except OSError:+ pass+++def cmd_run(a):+ work = os.path.abspath(a.work)+ tasks = load_tasks(work)+ if a.ids:+ d = json.load(open(a.ids))+ ids = d["ids"] if isinstance(d, dict) else d+ else:+ ids = sorted(i for i, t in tasks.items() if t["gold"])+ if a.order == "shuffled":+ ids = sorted(ids)+ random.Random(ORDER_SEED).shuffle(ids)+ if a.reuse:+ if a.contexts:+ raise SystemExit("--contexts needs BM25's context text, so it does not go with --reuse")+ _s, rdir, _c, _l = run_paths(work, a.reuse)+ have = [i for i in ids if os.path.exists(os.path.join(rdir, "rows", i + ".jsonl"))]+ print(f"{a.run}: the pack again; BM25 and truncation rows from {a.reuse}, which measured {len(have)} of "+ f"these {len(ids)} tasks", flush=True)+ ids = have+ _scratch, outdir, _ctx, logs = run_paths(work, a.run)++ def attempts(i):+ p = os.path.join(outdir, "tasks", i + ".json.attempts")+ return sum(1 for _ in open(p)) if os.path.exists(p) else 0++ # A task is tried at most twice; one that failed twice is reported as failed.+ todo = [i for i in ids if not os.path.exists(os.path.join(outdir, "rows", i + ".jsonl"))+ and attempts(i) < MAX_ATTEMPTS]+ print(f"{a.run}: {len(ids)} tasks, {len(todo)} to run, {a.jobs} at once", flush=True)+ os.makedirs(logs, exist_ok=True)+ env = dict(os.environ, RAYON_NUM_THREADS=str(a.threads), TOKENIZERS_PARALLELISM="true")++ def one(iid):+ cmd = [sys.executable, os.path.abspath(__file__), "task", "--work", work, "--graphicle", a.graphicle,+ "--tokenizer", a.tokenizer, "--id", iid, "--run", a.run] + (["--contexts"] if a.contexts else []) + \+ (["--keep"] if a.keep else []) + (["--reuse", a.reuse] if a.reuse else [])+ with open(os.path.join(logs, iid + ".log"), "w") as log:+ r = subprocess.run(cmd, stdout=log, stderr=subprocess.STDOUT, env=env)+ print(f"{time.strftime('%H:%M:%S')} {iid}: exit {r.returncode}", flush=True)+ return r.returncode++ with ThreadPoolExecutor(a.jobs) as ex:+ codes = list(ex.map(one, todo))+ print(f"done: {sum(1 for c in codes if c == 0)} ok, {sum(1 for c in codes if c != 0)} failed", flush=True)+ again = [i for i in todo if not os.path.exists(os.path.join(outdir, "rows", i + ".jsonl"))+ and attempts(i) < MAX_ATTEMPTS]+ if again:+ print(f"trying {len(again)} failed tasks once more", flush=True)+ with ThreadPoolExecutor(a.jobs) as ex:+ codes = list(ex.map(one, again))+ print(f"second try: {sum(1 for c in codes if c == 0)} ok, {sum(1 for c in codes if c != 0)} failed", flush=True)+++def main():+ ap = argparse.ArgumentParser()+ sub = ap.add_subparsers(dest="cmd", required=True)+ for name in ("run", "task"):+ p = sub.add_parser(name)+ p.add_argument("--work", required=True)+ p.add_argument("--graphicle", required=True)+ p.add_argument("--tokenizer", required=True)+ p.add_argument("--contexts", action="store_true")+ p.add_argument("--keep", action="store_true")+ p.add_argument("--run", default="e1", help="the run's name: e1 (the first build) keeps the original "+ "layout, another name gets its own folders (run_paths)")+ p.add_argument("--reuse", help="an earlier run: measure only the pack, and take that run's BM25 and "+ "truncation rows, budgets and token counts")+ if name == "run":+ p.add_argument("--ids")+ p.add_argument("--order", choices=["sample", "shuffled"], default="sample")+ p.add_argument("--jobs", type=int, default=6)+ p.add_argument("--threads", type=int, default=6)+ else:+ p.add_argument("--id", required=True)+ a = ap.parse_args()+ {"run": cmd_run, "task": cmd_task}[a.cmd](a)+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/e1_compare.py b/bench/swe-bench-pro/e1_compare.pynew file mode 100644index 0000000..1008de0--- /dev/null+++ b/bench/swe-bench-pro/e1_compare.py@@ -0,0 +1,90 @@+#!/usr/bin/env python3+"""E1 for two builds side by side: coverage, the rows both measured, and all-gold recall per budget.++usage: e1_compare.py --work WORK [--a e1] --b RUN [--ids FILE] [--json OUT.json] [--md OUT.md]++Runs are e1.py's run names (folders under WORK/out): e1 by default, and a later build's --run name, such as+e1-0.1.10.++- Coverage: the tasks each run measured and the tasks each left out (failed twice).+- Identity: for the tasks both measured, each (task, arm, budget) row compared on inside, all_gold, any_gold,+ context_tokens and context_files. BM25 and truncation do not depend on the Graphicle build, so they must+ match; the pack's rows show what the build changed.+- All-gold recall, % of tasks, per arm and budget: run A on its tasks, run B on its tasks, and run B on the+ tasks run A left out.+"""+import argparse+import json+import os+import sys++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, HERE)+from e1_report import ARMS, BUDGETS, load, mean # noqa: E402++KEYS = ("inside", "all_gold", "any_gold", "context_tokens", "context_files")+++def main():+ ap = argparse.ArgumentParser()+ ap.add_argument("--work", required=True)+ ap.add_argument("--a", default="e1", help="the first E1 run (e1.py --run)")+ ap.add_argument("--b", required=True, help="the other E1 run, such as a later build's --run name")+ ap.add_argument("--ids")+ ap.add_argument("--json")+ ap.add_argument("--md")+ a = ap.parse_args()+ ids = None+ if a.ids:+ d = json.load(open(a.ids))+ ids = set(d["ids"] if isinstance(d, dict) else d)+ ra, _ta, fa = load(a.work, ids, a.a)+ rb, _tb, fb = load(a.work, ids, a.b)+ tasks_a = {t for t, _x, _y in ra}+ tasks_b = {t for t, _x, _y in rb}+ common = sorted(tasks_a & tasks_b)+ only_b = sorted(tasks_b - tasks_a)+ out = {"a": a.a, "b": a.b, "measured_a": len(tasks_a), "measured_b": len(tasks_b), "failed_a": sorted(fa),+ "failed_b": sorted(fb), "common": len(common), "only_b": only_b, "identity": {}, "all_gold": {}}+ for arm in ARMS:+ same = diff = 0+ for k in ra:+ if k[0] in tasks_b and k[1] == arm and k in rb:+ if all(ra[k].get(x) == rb[k].get(x) for x in KEYS):+ same += 1+ else:+ diff += 1+ out["identity"][arm] = {"same": same, "different": diff}+ for bud in BUDGETS:+ row = {}+ for arm in ARMS:+ for name, rows, ts in (("a", ra, sorted(tasks_a)), ("b", rb, sorted(tasks_b)), ("b_only", rb, only_b)):+ xs = [rows[(t, arm, bud)]["all_gold"] for t in ts if (t, arm, bud) in rows]+ row[f"{name}_{arm}"] = (mean(xs), len(xs))+ out["all_gold"][bud] = row+ md = [f"E1, build A ({a.a}) beside build B ({a.b}).", "",+ f"- Measured: A {len(tasks_a)} tasks (left out {len(fa)}), B {len(tasks_b)} (left out {len(fb)}); "+ f"both {len(common)}; only B {len(only_b)}.",+ "- Rows on the tasks both measured, the same in both builds: " + "; ".join(+ f"{arm} {v['same']} of {v['same'] + v['different']}" for arm, v in out["identity"].items()) + ".", "",+ "| Budget | A pack | A BM25 | B pack | B BM25 | B pack, tasks only B measured | B BM25, same tasks |",+ "|---|---|---|---|---|---|---|"]++ def f(v):+ return "" if v[0] is None else f"{100 * v[0]:.1f} (n={v[1]})"+ for bud, r in out["all_gold"].items():+ if r["a_pack"][1] or r["b_pack"][1]:+ md.append(f"| {bud} | {f(r['a_pack'])} | {f(r['a_bm25'])} | {f(r['b_pack'])} | {f(r['b_bm25'])} | "+ f"{f(r['b_only_pack'])} | {f(r['b_only_bm25'])} |")+ text = "\n".join(md) + "\n"+ if a.json:+ with open(a.json, "w") as fh:+ json.dump(out, fh, indent=1, sort_keys=True)+ if a.md:+ with open(a.md, "w") as fh:+ fh.write(text)+ print(text)+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/e1_report.py b/bench/swe-bench-pro/e1_report.pynew file mode 100644index 0000000..4011286--- /dev/null+++ b/bench/swe-bench-pro/e1_report.py@@ -0,0 +1,181 @@+#!/usr/bin/env python3+"""E1's tables: gold-file recall of the pack, BM25 and truncation on SWE-bench Pro, with bootstrap intervals.++usage: e1_report.py --work WORK [--ids FILE] [--json OUT.json] [--md OUT.md]++Reads WORK/out/e1/rows/*.jsonl and WORK/out/e1/tasks/*.json (--ids limits it to a list of task ids, such as+sample-e2.json). Per budget and arm: all-gold, any-gold and the mean share of gold files inside, pooled over+tasks and per repository, with and without the tasks whose statement names a gold path; 95% bootstrap+percentile intervals over tasks (2,000 resamples, seed 1); the paired differences pack minus BM25 and pack+minus truncation with paired intervals; McNemar's exact test on all-gold, pack against BM25; the share of+tasks whose whole file set fits the budget; and the index time per repository.+"""+import argparse+import glob+import json+import math+import os+import random+import statistics++BUDGETS = ["16K", "32K", "64K", "128K", "256K", "1M"]+ARMS = ["pack", "bm25", "trunc"]+METRICS = ["all_gold", "any_gold", "share"]+NBOOT = 2000+++def mean(xs):+ return sum(xs) / len(xs) if xs else None+++def boot_ci(xs, rng, n=NBOOT):+ if not xs:+ return None+ ms = sorted(mean([xs[rng.randrange(len(xs))] for _ in xs]) for _ in range(n))+ return [ms[int(0.025 * n)], ms[min(n - 1, int(0.975 * n))]]+++def mcnemar_exact(b, c):+ n = b + c+ if n == 0:+ return 1.0+ return min(1.0, 2 * sum(math.comb(n, i) for i in range(0, min(b, c) + 1)) / 2 ** n)+++def load(work, ids=None, run="e1"):+ rows = {}+ for p in sorted(glob.glob(os.path.join(work, "out", run, "rows", "*.jsonl"))):+ tid = os.path.basename(p)[:-len(".jsonl")]+ if ids is not None and tid not in ids:+ continue+ for r in map(json.loads, open(p)):+ rows[(tid, r["arm"], r["budget"])] = r+ tasks = {}+ for p in glob.glob(os.path.join(work, "out", run, "tasks", "*.json")):+ tid = os.path.basename(p)[:-len(".json")]+ if ids is None or tid in ids:+ tasks[tid] = json.load(open(p))+ failed = [os.path.basename(p)[:-len(".json.failed")]+ for p in glob.glob(os.path.join(work, "out", run, "tasks", "*.json.failed"))+ if (ids is None or os.path.basename(p)[:-len(".json.failed")] in ids)+ and not os.path.exists(p[:-len(".failed")])]+ return rows, tasks, failed+++def cell(rows, tids, budget, rng):+ """The statistics of one budget over the tasks tids (paired: every arm's row exists for each task)."""+ have = [t for t in tids if all((t, a, budget) in rows for a in ARMS)]+ out = {"n": len(have)}+ if not have:+ return out+ out["fits_whole"] = mean([1.0 if rows[(t, "trunc", budget)]["fits_whole"] else 0.0 for t in have])+ for a in ARMS:+ for m in METRICS:+ xs = [float(rows[(t, a, budget)][m]) for t in have]+ out[f"{a}_{m}"] = mean(xs)+ out[f"{a}_{m}_ci"] = boot_ci(xs, rng)+ out[f"{a}_tokens"] = mean([rows[(t, a, budget)]["context_tokens"] or 0 for t in have])+ out["pack_whole_share"] = mean([rows[(t, "pack", budget)].get("inside_whole", 0) / rows[(t, "pack", budget)]["gold_n"]+ for t in have])+ for other in ("bm25", "trunc"):+ for m in METRICS:+ d = [float(rows[(t, "pack", budget)][m]) - float(rows[(t, other, budget)][m]) for t in have]+ out[f"pack_minus_{other}_{m}"] = mean(d)+ out[f"pack_minus_{other}_{m}_ci"] = boot_ci(d, rng)+ b = sum(1 for t in have if rows[(t, "pack", budget)]["all_gold"] and not rows[(t, "bm25", budget)]["all_gold"])+ c = sum(1 for t in have if rows[(t, "bm25", budget)]["all_gold"] and not rows[(t, "pack", budget)]["all_gold"])+ out["all_gold_pack_only"], out["all_gold_bm25_only"], out["all_gold_mcnemar_p"] = b, c, mcnemar_exact(b, c)+ return out+++def pct(x):+ return "" if x is None else f"{100 * x:.1f}"+++def ci(x):+ return "" if not x else f"{100 * x[0]:.1f}-{100 * x[1]:.1f}"+++def table(scope_rows, title):+ lines = [f"### {title}", "",+ "| Budget | Tasks | Fits whole | pack all-gold | BM25 all-gold | truncation all-gold | pack - BM25 | "+ "pack any-gold | BM25 any-gold | truncation any-gold |",+ "|---|---|---|---|---|---|---|---|---|---|"]+ for bud in BUDGETS:+ c = scope_rows.get(bud) or {}+ if not c.get("n"):+ continue+ lines.append(+ f"| {bud} | {c['n']} | {pct(c['fits_whole'])}% | {pct(c['pack_all_gold'])} ({ci(c['pack_all_gold_ci'])}) | "+ f"{pct(c['bm25_all_gold'])} ({ci(c['bm25_all_gold_ci'])}) | {pct(c['trunc_all_gold'])} | "+ f"{pct(c['pack_minus_bm25_all_gold'])} ({ci(c['pack_minus_bm25_all_gold_ci'])}) | "+ f"{pct(c['pack_any_gold'])} ({ci(c['pack_any_gold_ci'])}) | {pct(c['bm25_any_gold'])} "+ f"({ci(c['bm25_any_gold_ci'])}) | {pct(c['trunc_any_gold'])} |")+ return lines+++def main():+ ap = argparse.ArgumentParser()+ ap.add_argument("--work", required=True)+ ap.add_argument("--ids")+ ap.add_argument("--run", default="e1", help="the E1 run: e1.py's --run name (a folder under WORK/out)")+ ap.add_argument("--json")+ ap.add_argument("--md")+ a = ap.parse_args()+ ids = None+ if a.ids:+ d = json.load(open(a.ids))+ ids = set(d["ids"] if isinstance(d, dict) else d)+ rows, tasks, failed = load(a.work, ids, a.run)+ tids = sorted({t for t, _a, _b in rows})+ repo_of = {t: tasks[t]["repo"] for t in tids if t in tasks}+ named = {t for (t, _a, _b), r in rows.items() if r["names_gold_path"]}+ rng = random.Random(1)+ scopes = {"all": tids, "without_named": [t for t in tids if t not in named]}+ for r in sorted(set(repo_of.values())):+ scopes["repo:" + r] = [t for t in tids if repo_of.get(t) == r]+ out = {"tasks": len(tids), "failed": sorted(failed), "named": len(named), "scopes": {}}+ for s, ts in scopes.items():+ out["scopes"][s] = {b: cell(rows, ts, b, rng) for b in BUDGETS}+ index = {}+ for t, info in tasks.items():+ ix = info.get("index") or {}+ index.setdefault(info["repo"], []).append((ix.get("wall_seconds"), ix.get("cpu_seconds"), ix.get("data_bytes"),+ info.get("tokens_eligible"), info.get("seconds")))+ out["index"] = {r: {"tasks": len(v), "index_wall_median_s": statistics.median(x[0] for x in v),+ "index_wall_max_s": max(x[0] for x in v), "index_cpu_median_s": statistics.median(x[1] for x in v),+ "index_mib_median": round(statistics.median(x[2] for x in v) / 2 ** 20),+ "tokens_eligible_median": statistics.median(x[3] for x in v),+ "task_seconds_median": statistics.median(x[4] for x in v)} for r, v in sorted(index.items())}+ if a.json:+ with open(a.json, "w") as f:+ json.dump(out, f, indent=1, sort_keys=True)+ md = [f"Tasks measured: {len(tids)} (failed: {len(failed)}); statements naming a gold path: {len(named)}.", ""]+ md += table(out["scopes"]["all"], "All measured tasks: % of tasks (95% bootstrap interval)") + [""]+ md += table(out["scopes"]["without_named"], "Without the tasks whose statement names a gold path") + [""]+ for bud in ("64K", "256K"):+ md += [f"### Per repository at {bud}: all-gold % (95% bootstrap interval)", "",+ "| Repository | Tasks | pack | BM25 | truncation | pack - BM25 |", "|---|---|---|---|---|---|"]+ for s in sorted(k for k in out["scopes"] if k.startswith("repo:")):+ c = out["scopes"][s].get(bud) or {}+ if c.get("n"):+ md.append(f"| {s[5:]} | {c['n']} | {pct(c['pack_all_gold'])} ({ci(c['pack_all_gold_ci'])}) | "+ f"{pct(c['bm25_all_gold'])} ({ci(c['bm25_all_gold_ci'])}) | {pct(c['trunc_all_gold'])} | "+ f"{pct(c['pack_minus_bm25_all_gold'])} ({ci(c['pack_minus_bm25_all_gold_ci'])}) |")+ md.append("")+ md += ["### Index time and size per repository", "",+ "| Repository | Tasks | Index s (median) | Index s (max) | Index CPU s (median) | Index MiB (median) | "+ "Tokens in the file set (median) | Task s (median) |", "|---|---|---|---|---|---|---|---|"]+ for r, v in out["index"].items():+ md.append(f"| {r} | {v['tasks']} | {v['index_wall_median_s']:.0f} | {v['index_wall_max_s']:.0f} | "+ f"{v['index_cpu_median_s']:.0f} | {v['index_mib_median']} | {v['tokens_eligible_median']:,.0f} | "+ f"{v['task_seconds_median']:.0f} |")+ text = "\n".join(md) + "\n"+ if a.md:+ with open(a.md, "w") as f:+ f.write(text)+ print(text)+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/e1l.py b/bench/swe-bench-pro/e1l.pynew file mode 100644index 0000000..e940e2b--- /dev/null+++ b/bench/swe-bench-pro/e1l.py@@ -0,0 +1,414 @@+#!/usr/bin/env python3+"""E1L: line-level recall on SWE-bench Pro, no model: do the contexts hold the lines each fix changes?++usage:+ e1l.py gold --work WORK --parquet FILE+ writes WORK/e1l/gold.jsonl: for every task in WORK/tasks.jsonl with gold files, each gold file's gold lines,+ the pre-image line numbers of the reference patch: its '-' lines; for a hunk without '-' lines, the+ pre-image line just before each run of '+' lines (line 1 when the run opens the file). A gold file whose+ section has no hunk (a pure rename, a mode change, a binary file) has no gold lines.+ e1l.py run --work WORK --graphicle BIN --tokenizer T [--run e1l] [--jobs 6] [--threads 6]+ every task in gold.jsonl that has no rows yet, in e1.py's shuffled order, each in its own process+ e1l.py task --work WORK --graphicle BIN --tokenizer T --id ID [--run e1l]+ one task: check out the base commit (WORK/mirror), check every gold line against the file there, count+ tokens (tokens.py), build the index, then at each of E1's budgets write what each context holds of each+ gold file to WORK/out/RUN/rows/ID.jsonl, one line per arm and budget:+ - pack (`graphicle pack --format json`, standard layout, as e1.py): the line ranges of its text chunks+ (start_line-end_line: whole files and excerpts, every line between them verbatim), the gold lines it+ shows only in an outline (the numbered lines of a chunk whose `why` says outline), whether one chunk+ holds the file whole, and the file's rank and tokens in `included`, or its rank in `omitted` (the+ top 50 ranked files left out);+ - BM25 and truncation (whole files only): whether the file is in, and BM25's rank of it.+ A gold line is inside the pack when a text chunk's range covers it; outline lines never count as inside.+ --reuse RUN (run and task) measures the pack again with another build and takes the BM25 and truncation rows of+ the earlier E1L run RUN as they are (those arms are this kit's own code: a build cannot change them), with the+ task's budgets, eligible tokens and gold file sizes from RUN's record of it (no tokenizer pass); the index is+ built again by BIN, every gold line is checked again, and the record notes the reuse. Only tasks RUN measured+ are run.+"""+import argparse+import hashlib+import json+import os+import random+import re+import shutil+import subprocess+import sys+import time+from concurrent.futures import ThreadPoolExecutor++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, HERE)+import e1 # noqa: E402 (also puts ../whole-repo on the path)+from bm25 import build_bm25 # noqa: E402+from mine import parse_diff # noqa: E402+from pack_arm import pack_command # noqa: E402+from tokens import Counter, build_manifest, build_truncation, truncation_order # noqa: E402++HUNK = re.compile(r"^@@ -(\d+)(?:,(\d+))? \+(\d+)(?:,(\d+))? @@")+OUTLINE_LINE = re.compile(r"^(\d+)\t")+++def file_sections(patch):+ """[(old path, status, lines)] of a git diff, split on '\\n' only (old, new and status as data.py reads them)."""+ out, cur = [], None+ for line in patch.split("\n"):+ if line.startswith("diff --git "):+ cur = [line]+ out.append(cur)+ elif cur is not None:+ cur.append(line)+ res = []+ for lines in out:+ s = parse_diff("\n".join(lines) + "\n")[0]+ res.append((s["old"], s["status"], lines))+ return res+++def gold_lines(lines):+ """(sorted gold line numbers, {line: text of its '-' line}, hunks) of one file section."""+ gold, minus_text, hunks, i, n = set(), {}, 0, 0, len(lines)+ while i < n:+ m = HUNK.match(lines[i])+ if not m:+ i += 1+ continue+ hunks += 1+ a, alen = int(m.group(1)), 1 if m.group(2) is None else int(m.group(2))+ blen = 1 if m.group(4) is None else int(m.group(4))+ cur = a if alen > 0 else a + 1 # the next pre-image line+ old_left, new_left, body = alen, blen, []+ i += 1+ while i < n and (old_left > 0 or new_left > 0):+ line = lines[i]+ if line.startswith("\\"): # "\ No newline at end of file"+ i += 1+ continue+ tag = line[:1]+ if tag == " " or line == "":+ body.append((" ", cur, None))+ cur, old_left, new_left = cur + 1, old_left - 1, new_left - 1+ elif tag == "-":+ body.append(("-", cur, line[1:]))+ cur, old_left = cur + 1, old_left - 1+ elif tag == "+":+ body.append(("+", cur, None))+ new_left -= 1+ else:+ break+ i += 1+ minus = [(ln, t) for tag, ln, t in body if tag == "-"]+ if minus:+ for ln, t in minus:+ gold.add(ln)+ minus_text[ln] = t+ else:+ prev = None+ for tag, ln, _t in body:+ if tag == "+" and prev != "+":+ gold.add(max(ln - 1, 1))+ prev = tag+ return sorted(gold), minus_text, hunks+++def cmd_gold(a):+ import pyarrow.parquet as pq+ work = os.path.abspath(a.work)+ tasks = e1.load_tasks(work)+ rows = {r["instance_id"]: r for r in pq.read_table(a.parquet, columns=["instance_id", "patch"]).to_pylist()}+ os.makedirs(os.path.join(work, "e1l"), exist_ok=True)+ n_files = n_lines = no_lines = 0+ with open(os.path.join(work, "e1l", "gold.jsonl"), "w") as f:+ for iid in sorted(tasks):+ t = tasks[iid]+ if not t["gold"]:+ continue+ files = {}+ for old, status, lines in file_sections(rows[iid]["patch"] or ""):+ if old not in t["gold"] or status == "added":+ continue+ g, minus, hunks = gold_lines(lines)+ prev = files.get(old)+ if prev: # a path in two sections: join them+ g = sorted(set(prev["lines"]) | set(g))+ minus = {**{int(k): v for k, v in prev["minus"].items()}, **minus}+ hunks += prev["hunks"]+ files[old] = {"lines": g, "minus": {str(k): v for k, v in minus.items()}, "hunks": hunks,+ "status": status}+ for p in t["gold"]:+ files.setdefault(p, {"lines": [], "minus": {}, "hunks": 0, "status": "missing"})+ n_files += len(files)+ n_lines += sum(len(v["lines"]) for v in files.values())+ no_lines += sum(1 for v in files.values() if not v["lines"])+ f.write(json.dumps({"id": iid, "files": files}, sort_keys=True) + "\n")+ print(f"gold.jsonl: {n_files} gold files, {n_lines} gold lines, {no_lines} files without gold lines")+++def file_lines(path):+ """The file's lines as `str::lines()` splits them: on '\\n', one trailing '\\r' dropped, no last empty line."""+ with open(path, "rb") as fh:+ text = fh.read().decode("utf-8", "replace")+ lines = text.split("\n")+ if lines and lines[-1] == "":+ lines.pop()+ return [ln[:-1] if ln.endswith("\r") else ln for ln in lines], len(text.encode("utf-8"))+++def merge(ranges):+ out = []+ for s, e in sorted(ranges):+ if out and s <= out[-1][1] + 1:+ out[-1][1] = max(out[-1][1], e)+ else:+ out.append([s, e])+ return out+++def covered(line, ranges):+ return any(s <= line <= e for s, e in ranges)+++def pack_view(pj, gold):+ """{gold path: text ranges (merged), outline lines, whole} of one pack's JSON."""+ view = {p: {"ranges": [], "outline": set(), "whole": False} for p in gold}+ for sec in pj.get("sections") or []:+ for c in sec.get("chunks") or []:+ p = c.get("path")+ if p not in view:+ continue+ if not c.get("whole") and "(outline" in (c.get("why") or ""):+ for ln in (c.get("text") or "").split("\n"):+ m = OUTLINE_LINE.match(ln)+ if m:+ view[p]["outline"].add(int(m.group(1)))+ else:+ view[p]["ranges"].append((int(c["start_line"]), int(c["end_line"])))+ view[p]["whole"] = view[p]["whole"] or bool(c.get("whole"))+ for v in view.values():+ v["ranges"] = merge(v["ranges"])+ return view+++def summarize(t, arm, label, budget, tokens, nfiles, per_file):+ have = [f for f in per_file if f["n_lines"]]+ total = sum(f["n_lines"] for f in have)+ inside = sum(f["inside_lines"] for f in have)+ return {"id": t["instance_id"], "repo": t["repo"], "arm": arm, "budget": label, "budget_tokens": budget,+ "context_tokens": tokens, "context_files": nfiles, "gold_n": len(per_file),+ "file_inside": sum(1 for f in per_file if f["in_context"]),+ "gold_lines": total, "lines_inside": inside, "line_share": inside / total if total else None,+ "all_lines": int(inside == total) if total else None,+ "files_all_lines": sum(1 for f in have if f["inside_lines"] == f["n_lines"]), "files_with_lines": len(have),+ "names_gold_path": t["names_gold_path"], "files": per_file}+++def cmd_task(a):+ work = os.path.abspath(a.work)+ t = e1.load_tasks(work)[a.id]+ iid = t["instance_id"]+ gold_rec = next(r for r in map(json.loads, open(os.path.join(work, "e1l", "gold.jsonl"))) if r["id"] == iid)+ scratch, outdir, _ctx, _logs = e1.run_paths(work, a.run)+ out_rows = os.path.join(outdir, "rows", iid + ".jsonl")+ out_task = os.path.join(outdir, "tasks", iid + ".json")+ if os.path.exists(out_rows):+ print(f"{iid}: done already")+ return+ text = open(os.path.join(work, "texts", iid + ".txt"), encoding="utf-8").read()+ if hashlib.sha256(text.encode("utf-8")).hexdigest() != t["text_sha256"]:+ raise SystemExit(f"{iid}: the problem statement does not match text_sha256")+ t0 = time.time()+ src = e1.checkout(work, scratch, t)+ data = os.path.join(scratch, "data", iid)+ info = {"id": iid, "repo": t["repo"], "base_commit": t["base_commit"], "graphicle": None}+ try:+ missing = [g for g in t["gold"] if e1.git(src, "cat-file", "-e", "HEAD:" + g, check=False).returncode != 0]+ gold = [g for g in t["gold"] if g not in missing]+ if not gold:+ raise RuntimeError("no gold file exists at the base commit")+ reused = None+ if a.reuse:+ _rs, rdir, _rc, _rl = e1.run_paths(work, a.reuse)+ rec = json.load(open(os.path.join(rdir, "tasks", iid + ".json")))+ reused = {(r["arm"], r["budget"]): r+ for r in map(json.loads, open(os.path.join(rdir, "rows", iid + ".jsonl")))+ if r["arm"] in ("bm25", "trunc")}+ label_of = dict(e1.BUDGETS + [e1.BIG])+ budgets = [(lb, label_of[lb]) for lb in rec["budgets"]]+ elig = rec["tokens_eligible"]+ tok_of = {g: (rec["sizes"].get(g) or {}).get("tokens") for g in gold}+ counter_name = rec["counter"]+ else:+ counter = Counter(a.tokenizer)+ rows_m = build_manifest(scratch, iid, counter)+ tok_of = {p: c for p, _cls, _b, c, _w in rows_m}+ elig = sum(c + w for _r, _p, c, w in truncation_order(iid, rows_m))+ budgets = e1.BUDGETS + ([e1.BIG] if elig > e1.BIG[1] else [])+ counter_name = counter.name+ sizes, check = {}, {"minus_checked": 0, "minus_mismatch": [], "point_out_of_range": []}+ for g in gold:+ lines, nbytes = file_lines(os.path.join(src, g))+ rec = gold_rec["files"][g]+ for k, txt in rec["minus"].items():+ ln = int(k)+ check["minus_checked"] += 1+ want = txt[:-1] if txt.endswith("\r") else txt+ if ln > len(lines) or lines[ln - 1] != want:+ check["minus_mismatch"].append([g, ln])+ for ln in rec["lines"]:+ if str(ln) not in rec["minus"] and not 1 <= ln <= max(len(lines), 1):+ check["point_out_of_range"].append([g, ln])+ sizes[g] = {"tokens": tok_of.get(g), "bytes": nbytes, "lines": len(lines),+ "minified": bool(lines) and nbytes // len(lines) >= 300}+ info.update({"gold_n": len(gold), "gold_missing_at_base": missing, "budgets": [lb for lb, _b in budgets],+ "tokens_eligible": elig, "sizes": sizes, "check": check, "counter": counter_name,+ "reuse": a.reuse})+ info["graphicle"] = subprocess.run([a.graphicle, "--version"], capture_output=True, text=True).stdout.strip()+ os.makedirs(data, exist_ok=True)+ code, _out, err, wall, cpu, peak = e1.measured([a.graphicle, "sync", src, "--data-dir", data, "--json"], 3600)+ if code != 0:+ raise RuntimeError("graphicle sync: " + err.strip()[-300:])+ info["index"] = {"wall_seconds": round(wall, 1), "cpu_seconds": round(cpu, 1), "peak_rss_mib": round(peak, 1)}+ rows, cache, bm25_rank = [], {}, None+ for label, b in budgets:+ code, out, err, _w, _c, _p = e1.measured(+ pack_command(a.graphicle, src, data, text, b, a.tokenizer, "json", layout="standard"), 1800)+ if code != 0:+ raise RuntimeError("graphicle pack: " + err.strip()[-300:])+ pj = json.loads(out)+ view = pack_view(pj, gold)+ inc = {f["path"]: f for f in pj.get("included") or []}+ om = {f["path"]: f for f in pj.get("omitted") or []}+ per = []+ for g in gold:+ gl, v = gold_rec["files"][g]["lines"], view[g]+ ins = [ln for ln in gl if covered(ln, v["ranges"])]+ f = {"path": g, "n_lines": len(gl), "inside_lines": len(ins),+ "outline_lines": sum(1 for ln in gl if ln in v["outline"] and ln not in ins),+ "in_context": g in inc, "whole": v["whole"], "ranges": v["ranges"],+ "text": bool(v["ranges"]), "outline": bool(v["outline"]),+ "rank": (inc.get(g) or om.get(g) or {}).get("rank"),+ "pack_tokens": (inc.get(g) or {}).get("tokens"), "omitted_listed": g in om}+ if v["ranges"] and len(ins) < len(gl):+ f["min_dist"] = min(min(abs(ln - s), abs(ln - e)) for ln in gl if ln not in ins+ for s, e in v["ranges"])+ per.append(f)+ rows.append(summarize(t, "pack", label, b, pj.get("tokens"), len(inc), per))+ if reused is not None:+ for arm in ("bm25", "trunc"):+ r = reused.get((arm, label))+ if r is None:+ raise RuntimeError(f"{a.reuse} has no {arm} row at {label}")+ rows.append(r)+ continue+ _bt, binc, btok = build_bm25(scratch, iid, text, b, counter, cache)+ if bm25_rank is None:+ bm25_rank = {p: i + 1 for i, (p, _s) in enumerate(next(iter(cache.values()))[0])}+ bset = set(binc)+ per = [{"path": g, "n_lines": len(gold_rec["files"][g]["lines"]),+ "inside_lines": len(gold_rec["files"][g]["lines"]) if g in bset else 0,+ "in_context": g in bset, "whole": g in bset, "rank": bm25_rank.get(g)} for g in gold]+ rows.append(summarize(t, "bm25", label, b, btok, len(binc), per))+ _tt, tinc, ttok = build_truncation(scratch, iid, b, counter)+ tset = set(tinc)+ per = [{"path": g, "n_lines": len(gold_rec["files"][g]["lines"]),+ "inside_lines": len(gold_rec["files"][g]["lines"]) if g in tset else 0,+ "in_context": g in tset, "whole": g in tset} for g in gold]+ rows.append(summarize(t, "trunc", label, b, ttok, len(tinc), per))+ info["seconds"] = round(time.time() - t0, 1)+ os.makedirs(os.path.dirname(out_rows), exist_ok=True)+ os.makedirs(os.path.dirname(out_task), exist_ok=True)+ with open(out_task, "w") as fh:+ json.dump(info, fh, indent=1, sort_keys=True)+ with open(out_rows + ".tmp", "w") as fh:+ for r in rows:+ fh.write(json.dumps(r, sort_keys=True) + "\n")+ os.replace(out_rows + ".tmp", out_rows)+ print(f"{iid}: {len(rows)} rows, total {info['seconds']} s", flush=True)+ except Exception as ex:+ info["error"] = f"{type(ex).__name__}: {str(ex)[:400]}"+ os.makedirs(os.path.dirname(out_task), exist_ok=True)+ with open(out_task + ".failed", "w") as fh:+ json.dump(info, fh, indent=1, sort_keys=True)+ with open(out_task + ".attempts", "a") as fh:+ fh.write(json.dumps({"time": time.strftime("%Y-%m-%dT%H:%M:%SZ", time.gmtime()), "error": info["error"]})+ + "\n")+ raise+ finally:+ shutil.rmtree(src, ignore_errors=True)+ shutil.rmtree(data, ignore_errors=True)+ try:+ os.remove(os.path.join(scratch, "manifest", iid + ".tsv"))+ except OSError:+ pass+++def cmd_run(a):+ work = os.path.abspath(a.work)+ ids = sorted(r["id"] for r in map(json.loads, open(os.path.join(work, "e1l", "gold.jsonl"))))+ if a.ids:+ d = json.load(open(a.ids))+ keep = set(d["ids"] if isinstance(d, dict) else d)+ ids = [i for i in ids if i in keep]+ if a.reuse:+ _rs, rdir, _rc, _rl = e1.run_paths(work, a.reuse)+ ids = [i for i in ids if os.path.exists(os.path.join(rdir, "rows", i + ".jsonl"))]+ random.Random(e1.ORDER_SEED).shuffle(ids)+ _s, outdir, _c, logs = e1.run_paths(work, a.run)++ def attempts(i):+ p = os.path.join(outdir, "tasks", i + ".json.attempts")+ return sum(1 for _ in open(p)) if os.path.exists(p) else 0++ def todo_of(ids_):+ return [i for i in ids_ if not os.path.exists(os.path.join(outdir, "rows", i + ".jsonl"))+ and attempts(i) < e1.MAX_ATTEMPTS]+ todo = todo_of(ids)+ print(f"{a.run}: {len(ids)} tasks, {len(todo)} to run, {a.jobs} at once", flush=True)+ os.makedirs(logs, exist_ok=True)+ env = dict(os.environ, RAYON_NUM_THREADS=str(a.threads), TOKENIZERS_PARALLELISM="true")++ def one(iid):+ cmd = [sys.executable, os.path.abspath(__file__), "task", "--work", work, "--graphicle", a.graphicle,+ "--tokenizer", a.tokenizer, "--id", iid, "--run", a.run] + (["--reuse", a.reuse] if a.reuse else [])+ with open(os.path.join(logs, iid + ".log"), "w") as log:+ r = subprocess.run(cmd, stdout=log, stderr=subprocess.STDOUT, env=env)+ print(f"{time.strftime('%H:%M:%S')} {iid}: exit {r.returncode}", flush=True)+ return r.returncode+ for attempt in (1, 2):+ if attempt == 2:+ todo = todo_of(todo)+ if not todo:+ break+ print(f"trying {len(todo)} failed tasks once more", flush=True)+ with ThreadPoolExecutor(a.jobs) as ex:+ codes = list(ex.map(one, todo))+ print(f"pass {attempt}: {sum(1 for c in codes if c == 0)} ok, {sum(1 for c in codes if c != 0)} failed",+ flush=True)+++def main():+ ap = argparse.ArgumentParser()+ sub = ap.add_subparsers(dest="cmd", required=True)+ g = sub.add_parser("gold")+ g.add_argument("--work", required=True)+ g.add_argument("--parquet", required=True)+ for name in ("run", "task"):+ p = sub.add_parser(name)+ p.add_argument("--work", required=True)+ p.add_argument("--graphicle", required=True)+ p.add_argument("--tokenizer", required=True)+ p.add_argument("--run", default="e1l")+ p.add_argument("--reuse")+ if name == "run":+ p.add_argument("--ids")+ p.add_argument("--jobs", type=int, default=6)+ p.add_argument("--threads", type=int, default=6)+ else:+ p.add_argument("--id", required=True)+ a = ap.parse_args()+ {"gold": cmd_gold, "run": cmd_run, "task": cmd_task}[a.cmd](a)+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/e1l_compare.py b/bench/swe-bench-pro/e1l_compare.pynew file mode 100644index 0000000..4282638--- /dev/null+++ b/bench/swe-bench-pro/e1l_compare.py@@ -0,0 +1,168 @@+#!/usr/bin/env python3+"""Two E1L runs side by side (a pack build against another, the same tasks): E1's file-level readings and E1L's+line-level metrics per budget, each build's value, the change paired by task with its 95% interval, and each+build's gap against BM25.++usage: e1l_compare.py --work WORK --base RUN --new RUN [--e1-run RUN] [--json OUT] [--md OUT]++Over the tasks both runs measured (and, for --e1-run, E1's own rows of the base build as a check):+ E1 registered: every gold file inside, a gold file inside when the pack holds some of its text (`included`);+ E1 text only: every gold file inside with text (a whole file or an excerpt; an outline alone does not count);+ E1 whole files: every gold file held whole (BM25 and truncation hold whole files only);+ (a) every gold line inside; (b) the mean share of gold lines inside; (c) the gold files with all their gold+ lines inside, pooled (tasks with gold lines).+Intervals: 95% bootstrap percentiles, 2,000 resamples of tasks, seed 1 per cell, paired by task.+"""+import argparse+import glob+import json+import os+import random++BUDGETS = ["16K", "32K", "64K", "128K", "256K", "1M"]+NBOOT = 2000+++def load(work, run):+ rows = {}+ for p in sorted(glob.glob(os.path.join(work, "out", run, "rows", "*.jsonl"))):+ for r in map(json.loads, open(p)):+ rows[(r["id"], r["arm"], r["budget"])] = r+ return rows+++def mean(xs):+ return sum(xs) / len(xs) if xs else None+++def boot(xs, rng):+ if not xs:+ return None+ n, vals = len(xs), []+ for _ in range(NBOOT):+ vals.append(sum(xs[rng.randrange(n)] for _ in range(n)) / n)+ vals.sort()+ return [vals[int(0.025 * NBOOT)], vals[min(NBOOT - 1, int(0.975 * NBOOT))]]+++def ratio_boot(pairs, rng):+ if not pairs:+ return None+ n, vals = len(pairs), []+ for _ in range(NBOOT):+ s = [pairs[rng.randrange(n)] for _ in range(n)]+ d = sum(b for _a, b in s)+ vals.append(sum(a for a, _b in s) / d if d else 0.0)+ vals.sort()+ return [vals[int(0.025 * NBOOT)], vals[min(NBOOT - 1, int(0.975 * NBOOT))]]+++def readings(r):+ """E1's three file-level readings and E1L's metrics of one pack (or BM25) row."""+ files = r["files"]+ with_lines = [f for f in files if f["n_lines"]]+ return {"registered": float(r["file_inside"] == r["gold_n"]),+ "text_only": float(all(f["in_context"] and f.get("text", f.get("whole")) for f in files)),+ "whole": float(all(f.get("whole") for f in files)),+ "a": None if r["all_lines"] is None else float(r["all_lines"]),+ "b": r["line_share"],+ "c": (r["files_all_lines"], r["files_with_lines"]) if with_lines else None}+++def main():+ ap = argparse.ArgumentParser()+ ap.add_argument("--work", required=True)+ ap.add_argument("--base", required=True, help="the earlier E1L run (a folder under WORK/out), such as e1l-0.1.9")+ ap.add_argument("--new", required=True)+ ap.add_argument("--e1-run", help="E1's run of the base build (e1.py rows), for its registered all-gold")+ ap.add_argument("--json")+ ap.add_argument("--md")+ a = ap.parse_args()+ base, new = load(a.work, a.base), load(a.work, a.new)+ e1 = load(a.work, a.e1_run) if a.e1_run else {}+ tids_b = {t for t, _a, _b in base}+ tids_n = {t for t, _a, _b in new}+ both = sorted(tids_b & tids_n)+ out = {"base": a.base, "new": a.new, "tasks_base": len(tids_b), "tasks_new": len(tids_n), "tasks_both": len(both),+ "only_base": len(tids_b - tids_n), "only_new": len(tids_n - tids_b), "budgets": {}}+ for bud in BUDGETS:+ ts = [t for t in both if (t, "pack", bud) in base and (t, "pack", bud) in new and (t, "bm25", bud) in new]+ if not ts:+ continue+ cell = {"n": len(ts)}+ rb = {t: readings(base[(t, "pack", bud)]) for t in ts}+ rn = {t: readings(new[(t, "pack", bud)]) for t in ts}+ bm = {t: readings(new[(t, "bm25", bud)]) for t in ts}+ for key in ("registered", "text_only", "whole", "a", "b"):+ tk = [t for t in ts if rb[t][key] is not None and rn[t][key] is not None]+ xb, xn, xm = [rb[t][key] for t in tk], [rn[t][key] for t in tk], [bm[t][key] for t in tk]+ rng = random.Random(1)+ cell[key] = {"n": len(tk), "base": mean(xb), "base_ci": boot(xb, rng), "new": mean(xn),+ "new_ci": boot(xn, rng), "bm25": mean(xm),+ "change": mean([y - x for x, y in zip(xb, xn)]),+ "change_ci": boot([y - x for x, y in zip(xb, xn)], rng),+ "gap_base": mean([x - z for x, z in zip(xb, xm)]),+ "gap_base_ci": boot([x - z for x, z in zip(xb, xm)], rng),+ "gap_new": mean([y - z for y, z in zip(xn, xm)]),+ "gap_new_ci": boot([y - z for y, z in zip(xn, xm)], rng)}+ tk = [t for t in ts if rb[t]["c"] and rn[t]["c"]]+ pb, pn, pm = [rb[t]["c"] for t in tk], [rn[t]["c"] for t in tk], [bm[t]["c"] for t in tk]+ rng = random.Random(1)+ tot = sum(d for _x, d in pb)+ cell["c"] = {"n": len(tk), "base": sum(x for x, _d in pb) / tot if tot else None, "base_ci": ratio_boot(pb, rng),+ "new": sum(x for x, _d in pn) / tot if tot else None, "new_ci": ratio_boot(pn, rng),+ "bm25": sum(x for x, _d in pm) / tot if tot else None,+ "change": (sum(x for x, _d in pn) - sum(x for x, _d in pb)) / tot if tot else None,+ "change_ci": ratio_boot([(y[0] - x[0], x[1]) for x, y in zip(pb, pn)], rng)}+ if e1:+ xs = [float(e1[(t, "pack", bud)]["inside"] == e1[(t, "pack", bud)]["gold_n"]) for t in ts+ if (t, "pack", bud) in e1]+ cell["e1_base_registered"] = {"n": len(xs), "value": mean(xs)}+ out["budgets"][bud] = cell+ if a.json:+ json.dump(out, open(a.json, "w"), indent=1, sort_keys=True)++ def pc(x):+ return "-" if x is None else f"{100 * x:.1f}"++ def sg(x): # a change or a gap, in points, with its sign+ return "-" if x is None else f"{100 * x:+.1f}"++ def ci(x):+ return "" if not x else f" ({100 * x[0]:+.1f} to {100 * x[1]:+.1f})"+ md = [f"Tasks: {a.base} {out['tasks_base']}, {a.new} {out['tasks_new']}, both {out['tasks_both']} "+ f"(only {a.base}: {out['only_base']}, only {a.new}: {out['only_new']}).", ""]+ titles = [("registered", "E1 registered: every gold file inside (any of its text), %"),+ ("text_only", "E1 text only: every gold file inside as text (an outline alone does not count), %"),+ ("whole", "E1 whole files: every gold file held whole, %"),+ ("a", "E1L (a): every gold line inside, %"),+ ("b", "E1L (b): mean share of gold lines inside, %"),+ ("c", "E1L (c): gold files with all their gold lines inside, % (pooled)")]+ for key, title in titles:+ # (c) is pooled over tasks, so it has no paired gap against BM25: its table leaves those columns out.+ gaps = key != "c"+ head = f"| Budget | Tasks | {a.base} | {a.new} | change (paired 95% interval) | BM25 |"+ md += [f"### {title}", "", head + (f" {a.base} - BM25 | {a.new} - BM25 |" if gaps else ""),+ "|---|---|---|---|---|---|" + ("---|---|" if gaps else "")]+ for bud in BUDGETS:+ c = out["budgets"].get(bud, {}).get(key)+ if not c:+ continue+ row = (f"| {bud} | {c['n']} | {pc(c['base'])} | {pc(c['new'])} | {sg(c['change'])}{ci(c['change_ci'])} | "+ f"{pc(c['bm25'])} |")+ if gaps:+ row += (f" {sg(c['gap_base'])}{ci(c['gap_base_ci'])} | {sg(c['gap_new'])}{ci(c['gap_new_ci'])} |")+ md.append(row)+ md.append("")+ if e1:+ md += [f"E1's own rows of the base build ({a.e1_run}), registered all-gold on the same tasks: " + "; ".join(+ f"{bud} {pc(out['budgets'][bud]['e1_base_registered']['value'])}" for bud in BUDGETS+ if bud in out["budgets"] and "e1_base_registered" in out["budgets"][bud]) + "."]+ text = "\n".join(md) + "\n"+ if a.md:+ open(a.md, "w").write(text)+ print(text)+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/e1l_report.py b/bench/swe-bench-pro/e1l_report.pynew file mode 100644index 0000000..7272e4e--- /dev/null+++ b/bench/swe-bench-pro/e1l_report.py@@ -0,0 +1,295 @@+#!/usr/bin/env python3+"""E1L's tables: line-level recall of the pack, BM25 and truncation on SWE-bench Pro, and why the pack misses.++usage: e1l_report.py --work WORK [--run e1l] [--e1-run e1] [--json OUT.json] [--md OUT.md]++Metrics per arm and budget, over the tasks with gold lines (95% bootstrap percentile intervals over tasks, 2,000+resamples, seed 1 per cell; gaps are pack minus BM25, paired by task):+ (a) all lines: the share of tasks with every gold line inside;+ (b) line share: the mean over tasks of the share of gold lines inside;+ (c) files: the share of gold files (with gold lines) whose gold lines are all inside, pooled over tasks (the+ interval resamples tasks).+Diagnosis at 16K, 64K and 256K: each gold file's state in the pack (absent, outline only, excerpt with none of its+gold lines, some, all, whole), file sizes against the pack's per-file caps, the ranks of absent files, and the+tasks where BM25 holds every gold line and the pack does not (by ranking: a gold file absent from the pack; by+holding: every gold file in the pack, some without all their lines). Also: E1's file-level rows against the+run named by --e1-run.+"""+import argparse+import glob+import json+import os+import random+import statistics+import sys++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, HERE)+from e1_report import boot_ci, mean # noqa: E402++BUDGETS = ["16K", "32K", "64K", "128K", "256K", "1M"]+TOKENS = {"16K": 16384, "32K": 32768, "64K": 65536, "128K": 131072, "256K": 262144, "1M": 1015808}+ARMS = ["pack", "bm25", "trunc"]+DIAG = ["16K", "64K", "256K"]+STATES = ["absent", "outline only", "excerpt, no gold lines", "excerpt, some gold lines", "excerpt, all gold lines",+ "whole"]+NBOOT = 2000+++def caps(label, rank):+ """The pack's per-file caps at a budget (code_pack.rs Sizing, 0.1.9): (focus whole cap, per-file cap)."""+ b = TOKENS[label]+ small = b <= 256_000+ per_file = max(b // (10 if small else 8), 2_000)+ whole_limit = min(max(b // 16, 1_500), 16_000)+ cap = 1_500 if (small and rank is not None and rank > 15) else whole_limit+ return min(cap, per_file), per_file+++def state(f):+ if not f["in_context"]:+ return "absent"+ if f.get("whole"):+ return "whole"+ if not f.get("text"):+ return "outline only" if f.get("outline") else "absent"+ if f["inside_lines"] == 0:+ return "excerpt, no gold lines"+ if f["inside_lines"] < f["n_lines"]:+ return "excerpt, some gold lines"+ return "excerpt, all gold lines"+++def ratio_ci(pairs, rng):+ """95% interval of sum(x)/sum(n) over tasks, resampling tasks."""+ if not pairs:+ return None+ vals = []+ for _ in range(NBOOT):+ s = [pairs[rng.randrange(len(pairs))] for _ in pairs]+ n = sum(b for _a, b in s)+ vals.append(sum(a for a, _b in s) / n if n else 0.0)+ vals.sort()+ return [vals[int(0.025 * NBOOT)], vals[min(NBOOT - 1, int(0.975 * NBOOT))]]+++def ratio_gap_ci(trip, rng):+ """95% interval of the paired gap of two pooled shares (x1/n - x2/n) over tasks."""+ vals = []+ for _ in range(NBOOT):+ s = [trip[rng.randrange(len(trip))] for _ in trip]+ n = sum(c for _a, _b, c in s)+ vals.append((sum(a for a, _b, _c in s) - sum(b for _a, b, _c in s)) / n if n else 0.0)+ vals.sort()+ return [vals[int(0.025 * NBOOT)], vals[min(NBOOT - 1, int(0.975 * NBOOT))]]+++def cell(rows, tids, bud):+ have = [t for t in tids if all((t, a, bud) in rows for a in ARMS) and rows[(t, "pack", bud)]["gold_lines"]]+ out = {"n": len(have)}+ if not have:+ return out+ for arm in ARMS:+ rng = random.Random(1)+ xa = [float(rows[(t, arm, bud)]["all_lines"]) for t in have]+ xb = [rows[(t, arm, bud)]["line_share"] for t in have]+ pc = [(rows[(t, arm, bud)]["files_all_lines"], rows[(t, arm, bud)]["files_with_lines"]) for t in have]+ xf = [float(rows[(t, arm, bud)]["file_inside"] == rows[(t, arm, bud)]["gold_n"]) for t in have]+ out[arm] = {"all_lines": mean(xa), "all_lines_ci": boot_ci(xa, rng), "line_share": mean(xb),+ "line_share_ci": boot_ci(xb, rng), "files": sum(a for a, _ in pc) / sum(b for _, b in pc),+ "files_ci": ratio_ci(pc, rng), "all_files": mean(xf)}+ for other in ("bm25", "trunc"):+ rng = random.Random(1)+ da = [float(rows[(t, "pack", bud)]["all_lines"]) - float(rows[(t, other, bud)]["all_lines"]) for t in have]+ db = [rows[(t, "pack", bud)]["line_share"] - rows[(t, other, bud)]["line_share"] for t in have]+ tr = [(rows[(t, "pack", bud)]["files_all_lines"], rows[(t, other, bud)]["files_all_lines"],+ rows[(t, "pack", bud)]["files_with_lines"]) for t in have]+ out[f"gap_{other}"] = {"all_lines": mean(da), "all_lines_ci": boot_ci(da, rng), "line_share": mean(db),+ "line_share_ci": boot_ci(db, rng),+ "files": out["pack"]["files"] - out[other]["files"],+ "files_ci": ratio_gap_ci(tr, rng)}+ return out+++def pc(x):+ return "" if x is None else f"{100 * x:.1f}"+++def ci(x):+ return "" if not x else f"{100 * x[0]:.1f} to {100 * x[1]:.1f}"+++def main():+ ap = argparse.ArgumentParser()+ ap.add_argument("--work", required=True)+ ap.add_argument("--run", default="e1l")+ ap.add_argument("--e1-run", default="e1",+ help="E1's run of the same build (e1.py rows), checked against these rows")+ ap.add_argument("--json")+ ap.add_argument("--md")+ a = ap.parse_args()+ rows, tasks = {}, {}+ for p in sorted(glob.glob(os.path.join(a.work, "out", a.run, "rows", "*.jsonl"))):+ for r in map(json.loads, open(p)):+ rows[(r["id"], r["arm"], r["budget"])] = r+ for p in glob.glob(os.path.join(a.work, "out", a.run, "tasks", "*.json")):+ info = json.load(open(p))+ tasks[info["id"]] = info+ failed = sorted(os.path.basename(p)[:-len(".json.failed")]+ for p in glob.glob(os.path.join(a.work, "out", a.run, "tasks", "*.json.failed"))+ if not os.path.exists(p[:-len(".failed")]))+ tids = sorted({t for t, _a, _b in rows})+ repos = sorted({tasks[t]["repo"] for t in tids})+ out = {"tasks": len(tids), "failed": failed, "scopes": {}}+ # The gold lines and their check against the files at the base commit.+ gold = {r["id"]: r for r in map(json.loads, open(os.path.join(a.work, "e1l", "gold.jsonl")))}+ nfiles = sum(len(gold[t]["files"]) for t in tids)+ nlines = sum(len(f["lines"]) for t in tids for f in gold[t]["files"].values())+ nolines = sum(1 for t in tids for f in gold[t]["files"].values() if not f["lines"])+ out["gold"] = {"files": nfiles, "lines": nlines, "files_without_lines": nolines,+ "minus_checked": sum(tasks[t]["check"]["minus_checked"] for t in tids),+ "minus_mismatch": sum(len(tasks[t]["check"]["minus_mismatch"]) for t in tids),+ "point_out_of_range": sum(len(tasks[t]["check"]["point_out_of_range"]) for t in tids),+ "tasks_without_lines": sum(1 for t in tids if not any(f["lines"] for f in gold[t]["files"].values()))}+ scopes = {"all": tids, "without_named": [t for t in tids if not rows[(t, "pack", "16K")]["names_gold_path"]]}+ for r in repos:+ scopes["repo:" + r] = [t for t in tids if tasks[t]["repo"] == r]+ for s, ts in scopes.items():+ out["scopes"][s] = {b: cell(rows, ts, b) for b in BUDGETS}+ # Diagnosis.+ diag = {}+ for bud in DIAG:+ files = []+ for t in tids:+ if (t, "pack", bud) not in rows:+ continue+ bm = {f["path"]: f for f in rows[(t, "bm25", bud)]["files"]}+ for f in rows[(t, "pack", bud)]["files"]:+ if not f["n_lines"]:+ continue+ size = tasks[t]["sizes"][f["path"]]+ whole_cap, per_file = caps(bud, f.get("rank"))+ files.append({"id": t, "repo": tasks[t]["repo"], "path": f["path"], "state": state(f),+ "tokens": size["tokens"], "lines": size["lines"], "minified": size["minified"],+ "rank": f.get("rank"), "omitted_listed": f.get("omitted_listed"),+ "n_lines": f["n_lines"], "inside_lines": f["inside_lines"],+ "outline_lines": f.get("outline_lines", 0), "min_dist": f.get("min_dist"),+ "over_whole_cap": size["tokens"] is not None and size["tokens"] > whole_cap,+ "over_per_file": size["tokens"] is not None and size["tokens"] > per_file,+ "bm25_in": bm[f["path"]]["in_context"], "bm25_rank": bm[f["path"]].get("rank"),+ "ranges": f.get("ranges", [])[:6]})+ d = {"files": len(files), "states": {}}+ for st in STATES:+ fs = [f for f in files if f["state"] == st]+ toks = [f["tokens"] for f in fs if f["tokens"] is not None and f["tokens"] >= 0]+ d["states"][st] = {+ "files": len(fs), "share": len(fs) / len(files) if files else None,+ "tokens_median": statistics.median(toks) if toks else None,+ "over_whole_cap": sum(1 for f in fs if f["over_whole_cap"]),+ "over_per_file": sum(1 for f in fs if f["over_per_file"]),+ "minified": sum(1 for f in fs if f["minified"]),+ "bm25_holds": sum(1 for f in fs if f["bm25_in"]),+ "outline_lines": sum(f["outline_lines"] for f in fs),+ "rank_median": statistics.median([f["rank"] for f in fs if f["rank"] is not None])+ if any(f["rank"] is not None for f in fs) else None,+ "rank_listed": sum(1 for f in fs if f["rank"] is not None),+ "rank_le_15": sum(1 for f in fs if f["rank"] is not None and f["rank"] <= 15),+ "min_dist_median": statistics.median([f["min_dist"] for f in fs if f["min_dist"] is not None])+ if any(f["min_dist"] is not None for f in fs) else None}+ # BM25 holds every gold line, the pack does not: by ranking or by holding?+ wins = {"bm25_only": 0, "pack_only": 0, "by_ranking": 0, "by_holding": 0}+ for t in tids:+ p, b = rows.get((t, "pack", bud)), rows.get((t, "bm25", bud))+ if not p or not p["gold_lines"]:+ continue+ if b["all_lines"] and not p["all_lines"]:+ wins["bm25_only"] += 1+ absent = any(not f["in_context"] for f in p["files"] if f["n_lines"])+ wins["by_ranking" if absent else "by_holding"] += 1+ elif p["all_lines"] and not b["all_lines"]:+ wins["pack_only"] += 1+ d["bm25_wins"] = wins+ rng = random.Random(20261028)+ d["examples"] = {}+ for st in STATES[:4]:+ fs = sorted((f for f in files if f["state"] == st), key=lambda f: (f["id"], f["path"]))+ d["examples"][st] = rng.sample(fs, min(3, len(fs)))+ diag[bud] = d+ out["diagnosis"] = diag+ # E1's file-level rows against the E1 run.+ ident = {}+ for arm in ARMS:+ same = diff = 0+ for t in tids:+ for bud in BUDGETS:+ r, p = rows.get((t, arm, bud)), os.path.join(a.work, "out", a.e1_run, "rows", t + ".jsonl")+ if r is None or not os.path.exists(p):+ continue+ e = {(x["arm"], x["budget"]): x for x in map(json.loads, open(p))}.get((arm, bud))+ if e is None:+ continue+ ok = (e["inside"] == r["file_inside"] and e["context_tokens"] == r["context_tokens"]+ and e["context_files"] == r["context_files"])+ same, diff = same + ok, diff + (not ok)+ ident[arm] = [same, same + diff]+ out["identity_vs_e1"] = ident+ if a.json:+ with open(a.json, "w") as f:+ json.dump(out, f, indent=1, sort_keys=True)+ # Markdown.+ g = out["gold"]+ md = [f"Tasks measured: {len(tids)} (failed: {len(failed)}). Gold files {g['files']}, gold lines {g['lines']}, "+ f"files without gold lines {g['files_without_lines']}, tasks without gold lines {g['tasks_without_lines']}. "+ f"'-' lines checked against the base commit: {g['minus_checked']}, mismatched {g['minus_mismatch']}; "+ f"insertion points out of range {g['point_out_of_range']}.",+ "File-level rows against " + a.e1_run + " (inside, context tokens and files): " + "; ".join(+ f"{arm} {v[0]} of {v[1]}" for arm, v in ident.items()) + ".", ""]+ for key, title in (("all_lines", "(a) Tasks with every gold line inside, %"),+ ("line_share", "(b) Mean share of gold lines inside, %"),+ ("files", "(c) Gold files with all their gold lines inside, % (pooled)")):+ md += [f"### {title} (95% interval; gap = pack minus BM25, paired)", "",+ "| Budget | Tasks | pack | BM25 | truncation | pack - BM25 |", "|---|---|---|---|---|---|"]+ for bud in BUDGETS:+ c = out["scopes"]["all"][bud]+ if c.get("n"):+ md.append(f"| {bud} | {c['n']} | {pc(c['pack'][key])} ({ci(c['pack'][key + '_ci'])}) | "+ f"{pc(c['bm25'][key])} ({ci(c['bm25'][key + '_ci'])}) | {pc(c['trunc'][key])} | "+ f"{pc(c['gap_bm25'][key])} ({ci(c['gap_bm25'][key + '_ci'])}) |")+ md.append("")+ md += ["### File level from the same run (E1's rule for the pack: any text of the file)", "",+ "| Budget | pack all-gold | BM25 all-gold |", "|---|---|---|"]+ for bud in BUDGETS:+ c = out["scopes"]["all"][bud]+ if c.get("n"):+ md.append(f"| {bud} | {pc(c['pack']['all_files'])} | {pc(c['bm25']['all_files'])} |")+ for bud in ("64K", "256K"):+ md += ["", f"### Per repository at {bud}: (a) / (b) / (c), % (gap in (a), paired 95% interval)", "",+ "| Repository | Tasks | pack (a) | BM25 (a) | gap (a) | pack (b) | BM25 (b) | pack (c) | BM25 (c) |",+ "|---|---|---|---|---|---|---|---|---|"]+ for s in sorted(k for k in out["scopes"] if k.startswith("repo:")):+ c = out["scopes"][s].get(bud) or {}+ if c.get("n"):+ md.append(f"| {s[5:]} | {c['n']} | {pc(c['pack']['all_lines'])} | {pc(c['bm25']['all_lines'])} | "+ f"{pc(c['gap_bm25']['all_lines'])} ({ci(c['gap_bm25']['all_lines_ci'])}) | "+ f"{pc(c['pack']['line_share'])} | {pc(c['bm25']['line_share'])} | {pc(c['pack']['files'])} | "+ f"{pc(c['bm25']['files'])} |")+ for bud, d in diag.items():+ md += ["", f"### Diagnosis at {bud}: the pack's state for each gold file with gold lines ({d['files']} files)",+ "", "| State | Files | % | Median tokens | Over whole cap | Over per-file cap | Minified | BM25 holds it | "+ "Rank listed (<= 15) | Median rank | Median distance to an excerpt (lines) |",+ "|---|---|---|---|---|---|---|---|---|---|---|"]+ for st, v in d["states"].items():+ md.append(f"| {st} | {v['files']} | {pc(v['share'])} | {v['tokens_median']} | {v['over_whole_cap']} | "+ f"{v['over_per_file']} | {v['minified']} | {v['bm25_holds']} | {v['rank_listed']} "+ f"({v['rank_le_15']}) | {v['rank_median']} | {v['min_dist_median']} |")+ w = d["bm25_wins"]+ md += ["", f"BM25 holds every gold line and the pack does not: {w['bm25_only']} tasks ({w['by_ranking']} by "+ f"ranking: a gold file absent from the pack; {w['by_holding']} by holding: every gold file in the pack, "+ f"some without all their lines). The pack holds every gold line and BM25 does not: {w['pack_only']}."]+ with open(a.md, "w") if a.md else open(os.devnull, "w") as f:+ f.write("\n".join(md) + "\n")+ print("\n".join(md))+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/e2.py b/bench/swe-bench-pro/e2.pynew file mode 100644index 0000000..545920d--- /dev/null+++ b/bench/swe-bench-pro/e2.py@@ -0,0 +1,256 @@+#!/usr/bin/env python3+"""E2: Muse Spark's answers on the SWE-bench Pro sample, with no context, BM25 at 64K or the pack at 64K.++usage: e2.py --work WORK --arm noctx|bm25|pack --out OUT [--ids sample-e2.json] [--profile meta|mock]+ [--base-url URL] [--model muse-spark-1.3] [--key-file FILE] [--spend-cap auto|DOLLARS]+ [--spend-log FILE] [--caps caps.json] [--prices prices.json] [--jobs 4] [--limit N]+ [--tokenizer FILE] [--reasoning-effort medium] [--max-output-tokens 8192]++The contexts are the files e1.py saved for the sample (WORK/contexts/<id>/pack-64K.xml and bm25-64K.txt),+checked against the sha256 that E1 recorded. The prompt is the whole-repository benchmark's (whole-repo-v1),+with the task's repository, base commit and problem statement; the answer is scored with its scorer against+the task's gold files, paths normalised against the files at the base commit. Every call goes through the+spend log and caps of ../whole-repo/run.py: the run refuses to start when the provider's logged total plus its+estimate would pass the provider's cap (caps.json), and a call is not sent when its worst case would pass the+run's cap or what is left of the provider's. Writes OUT/run.json, OUT/rows.jsonl (score.py reads them) and+OUT/raw/ (responses, not for publishing). Tasks already in rows.jsonl are skipped; a failed call is tried once+more at the end of the run.+"""+import argparse+import fcntl+import hashlib+import json+import math+import os+import subprocess+import sys+import threading+import time+from concurrent.futures import ThreadPoolExecutor++HERE = os.path.dirname(os.path.abspath(__file__))+WR = os.path.join(HERE, "..", "whole-repo")+sys.path.insert(0, WR)+from run import (CACHE_RETENTION, PROMPT, PROMPT_VERSION, PROFILES, CapReached, Client, Spend, logged_total, # noqa: E402+ now_iso, parse_files, text_of, usage_of, user_message)+from score import normalize_answer, score_answer # noqa: E402+from tokens import Counter # noqa: E402++sys.path.insert(0, HERE)+from e1 import run_paths # noqa: E402++CONTEXT_FILES = {"pack": "pack-64K.xml", "bm25": "bm25-64K.txt"}+BUDGET = "64K"+OUT_TOKENS_ESTIMATE = 4000+++def load(work, ids_file, limit):+ tasks = {t["instance_id"]: t for t in map(json.loads, open(os.path.join(work, "tasks.jsonl")))}+ d = json.load(open(ids_file))+ ids = d["ids"] if isinstance(d, dict) else d+ return [tasks[i] for i in (ids[:limit] if limit else ids)]+++def context_of(work, arm, iid, run="e1"):+ """(text, sha256, tokens recorded by E1) of a task's saved context from E1's run `run`; '' for noctx."""+ if arm == "noctx":+ return "", hashlib.sha256(PROMPT.encode()).hexdigest(), 0+ _scratch, outdir, ctx_root, _logs = run_paths(work, run)+ info = json.load(open(os.path.join(outdir, "tasks", iid + ".json")))+ rec = info["contexts"][CONTEXT_FILES[arm]]+ text = open(os.path.join(ctx_root, iid, CONTEXT_FILES[arm]), encoding="utf-8").read()+ sha = hashlib.sha256(text.encode("utf-8")).hexdigest()+ if sha != rec["sha256"]:+ raise SystemExit(f"{iid}: the saved {arm} context does not match E1's sha256")+ return text, sha, rec["tokens"]+++def files_at(work, t):+ mirror = os.path.join(work, "mirror", t["repo"].replace("/", "__") + ".git")+ out = subprocess.run(["git", "-C", mirror, "ls-tree", "-r", "--name-only", "-z", t["base_commit"]],+ capture_output=True, text=True, check=True).stdout+ return {p for p in out.split("\0") if p}+++def main():+ ap = argparse.ArgumentParser()+ ap.add_argument("--work", required=True)+ ap.add_argument("--arm", required=True, choices=["noctx", "bm25", "pack"])+ ap.add_argument("--out", required=True)+ ap.add_argument("--ids", default=os.path.join(HERE, "sample-e2.json"))+ ap.add_argument("--e1-run", default="e1", help="the E1 run whose saved contexts are used")+ ap.add_argument("--profile", default="meta", choices=["meta", "mock"])+ ap.add_argument("--base-url")+ ap.add_argument("--model")+ ap.add_argument("--key-file")+ ap.add_argument("--spend-cap", default="auto")+ ap.add_argument("--spend-log")+ ap.add_argument("--caps", default=os.path.join(WR, "caps.json"))+ ap.add_argument("--prices", default=os.path.join(WR, "prices.json"))+ ap.add_argument("--jobs", type=int, default=4)+ ap.add_argument("--limit", type=int, default=0)+ ap.add_argument("--tokenizer")+ ap.add_argument("--reasoning-effort", default="medium")+ ap.add_argument("--max-output-tokens", type=int, default=8192)+ a = ap.parse_args()+ prof = PROFILES[a.profile]+ base_url = a.base_url or prof["base_url"]+ model = a.model or prof["model"]+ if not base_url:+ raise SystemExit(f"--base-url is needed with --profile {a.profile}")+ work = os.path.abspath(a.work)+ spend_log = os.path.abspath(a.spend_log or os.path.join(work, "spend", "spend-log.jsonl"))+ prices = json.load(open(a.prices))+ if model not in prices["models"]:+ raise SystemExit(f"no price for {model} in {a.prices}")+ price = prices["models"][model]+ provider = price.get("provider", a.profile)+ caps = json.load(open(a.caps))["usd"] if os.path.exists(a.caps) else {}+ global_cap = caps.get(provider)+ key = open(a.key_file).read().strip() if a.key_file else os.environ.get(prof["key_env"], "")+ if not key:+ raise SystemExit(f"no key: set {prof['key_env']} or pass --key-file")+ os.makedirs(os.path.join(a.out, "raw"), exist_ok=True)+ os.makedirs(os.path.dirname(spend_log), exist_ok=True)+ lock = open(spend_log + f".{provider}.lock", "w")+ try:+ fcntl.flock(lock, fcntl.LOCK_EX | fcntl.LOCK_NB)+ except OSError:+ sys.exit(f"REFUSED: another run for {provider} holds {lock.name}")++ counter = Counter(a.tokenizer)+ label = a.arm if a.arm == "noctx" else f"{a.arm}@{BUDGET}"+ tasks = load(work, a.ids, a.limit)+ rows_path = os.path.join(a.out, "rows.jsonl")+ done = {json.loads(l)["id"] for l in open(rows_path)} if os.path.exists(rows_path) else set()+ todo, left_out = [], []+ for t in tasks:+ if t["instance_id"] in done:+ continue+ if not os.path.exists(os.path.join(run_paths(work, a.e1_run)[1], "tasks", t["instance_id"] + ".json")):+ # E1 failed on it twice: such a task is left out of every arm, noctx included.+ left_out.append(t["instance_id"])+ continue+ text = open(os.path.join(work, "texts", t["instance_id"] + ".txt"), encoding="utf-8").read()+ ctx, sha, ctx_tokens = context_of(work, a.arm, t["instance_id"], a.e1_run)+ prompt = PROMPT.format(context=ctx + "\n\n" if ctx else "", repo=t["repo"], sha=t["base_commit"], issue=text)+ todo.append((t, prompt, sha, ctx_tokens))++ def cost(tin, tcached, tout):+ return ((tin - tcached) * price["input"] + tcached * price.get("cached_input", price["input"])+ + tout * price["output"]) / 1e6++ est = sum(cost(counter.count(p), 0, OUT_TOKENS_ESTIMATE) for _t, p, _s, _n in todo)+ logged = logged_total(spend_log, provider)+ print(f"{label}: {len(todo)} of {len(tasks)} tasks to do ({len(left_out)} left out: E1 failed on them); "+ f"estimate ${est:.2f} (no cache reuse across tasks); {provider} log total ${logged:.2f}"+ + (f", cap ${global_cap:.2f}" if global_cap is not None else ""), flush=True)+ if global_cap is not None and logged + est > global_cap:+ sys.exit(f"REFUSED: the {provider} log total ${logged:.2f} plus this run's estimate ${est:.2f} would pass "+ f"the cap ${global_cap:.2f}")+ spent_before = json.load(open(os.path.join(a.out, "spend.json")))["spent_usd"] \+ if os.path.exists(os.path.join(a.out, "spend.json")) else 0.0+ if str(a.spend_cap).lower() == "auto":+ cap = spent_before + math.ceil(1.5 * est)+ if global_cap is not None:+ cap = min(cap, spent_before + global_cap - logged)+ else:+ cap = float(a.spend_cap)+ spend = Spend(os.path.join(a.out, "spend.json"), cap, price, spend_log, provider, global_cap)+ client = Client(base_url, key, "responses")+ meta = {"label": label, "arm": a.arm, "budget": None if a.arm == "noctx" else BUDGET,+ "budget_tokens": None if a.arm == "noctx" else 65536, "model": model, "api": "responses",+ "profile": a.profile, "provider": provider, "base_url": base_url, "reasoning_effort": a.reasoning_effort,+ "max_output_tokens": a.max_output_tokens, "prompt_version": PROMPT_VERSION, "counter": counter.name,+ "context_source": f"E1 run {a.e1_run}'s saved contexts (graphicle pack, bm25.py)" if a.arm != "noctx"+ else "noctx", "e1_run": a.e1_run,+ "cache_retention": CACHE_RETENTION, "spend_cap_usd": cap, "global_cap_usd": global_cap,+ "spend_log": spend_log, "estimate_usd": est, "benchmark": "swe-bench-pro e2", "ids": a.ids,+ "left_out_e1_failed": left_out, "started": now_iso()}+ with open(os.path.join(a.out, "run.json"), "w") as f:+ json.dump(meta, f, indent=1, sort_keys=True)+ write_lock, stop = threading.Lock(), threading.Event()++ def one(item):+ t, prompt, sha, ctx_tokens = item+ iid = t["instance_id"]+ key_ = f"swepro:{iid}:{label}:{sha[:12]}"+ row = {"id": iid, "repo": t["repo"], "arm": a.arm, "label": label, "model": model, "gold": t["gold"],+ "names_gold_path": t["names_gold_path"], "cache_key": key_, "context_sha256": sha,+ "context_tokens": ctx_tokens, "error": None, "turns": 1}+ t0 = time.time()+ try:+ body = {"model": model, "input": [user_message(prompt)], "store": False,+ "reasoning": {"effort": a.reasoning_effort}, "max_output_tokens": a.max_output_tokens,+ "prompt_cache_key": key_, "prompt_cache_retention": CACHE_RETENTION}+ worst = spend.reserve(counter.count(prompt), a.max_output_tokens)+ rec = {"time": now_iso(), "provider": provider, "model": model, "api": "responses", "arm": label,+ "budget": meta["budget"], "run": os.path.abspath(a.out), "cache_key": key_, "repo": t["repo"],+ "question": iid, "turn": 1, "benchmark": "swe-bench-pro e2"}+ s0 = time.time()+ try:+ resp = client.post("/responses", body)+ except Exception as e:+ spend.settle(worst, 0.0, dict(rec, status="error", error=str(e)[:200], input_tokens=0, cached_tokens=0,+ output_tokens=0, reasoning_tokens=0, seconds=round(time.time() - s0, 3),+ cost_usd=0.0))+ raise+ tin, tcached, tout, treason = usage_of(resp, "responses")+ c = cost(tin, tcached, tout)+ spend.settle(worst, c, dict(rec, status="ok", input_tokens=tin, cached_tokens=tcached, output_tokens=tout,+ reasoning_tokens=treason, seconds=round(time.time() - s0, 3), cost_usd=c))+ answer = text_of(resp, "responses")+ files = parse_files(answer)+ norm = normalize_answer(files, files_at(work, t)) if files is not None else []+ row.update(score_answer(norm, t["gold"]))+ row.update({"files": norm, "answer_parsed": files is not None, "tokens_in": tin, "tokens_cached": tcached,+ "tokens_out": tout, "tokens_reasoning": treason, "cost_usd": c,+ "prompt_tokens_counted": counter.count(prompt)})+ with open(os.path.join(a.out, "raw", iid + ".json"), "w") as f:+ json.dump({"response": resp, "answer": answer}, f)+ except CapReached as e:+ stop.set()+ print(f"STOPPED: {e}", flush=True)+ return None+ except Exception as e:+ row["error"] = f"{type(e).__name__}: {str(e)[:300]}"+ row["wall_seconds"] = round(time.time() - t0, 2)+ return row++ def run(items):+ failed = []+ if not items:+ return failed++ def keep(row):+ if row is None:+ return+ if row["error"]:+ failed.append(row)+ return+ with write_lock, open(rows_path, "a") as f:+ f.write(json.dumps(row, sort_keys=True) + "\n")+ print(f"{row['id']}: hit@5 {row['hit5']}, ${row['cost_usd']:.4f}", flush=True)++ keep(one(items[0])) # the first call alone+ with ThreadPoolExecutor(a.jobs) as ex:+ for row in ex.map(lambda it: None if stop.is_set() else one(it), items[1:]):+ keep(row)+ return failed++ failed = run(todo)+ if failed and not stop.is_set():+ again = [it for it in todo if it[0]["instance_id"] in {r["id"] for r in failed}]+ print(f"retrying {len(again)} failed tasks once", flush=True)+ failed = run(again)+ with open(rows_path, "a") as f:+ for row in failed:+ f.write(json.dumps(row, sort_keys=True) + "\n")+ meta.update({"finished": now_iso(), "spend_usd": spend.spent, "stopped_by_cap": stop.is_set()})+ with open(os.path.join(a.out, "run.json"), "w") as f:+ json.dump(meta, f, indent=1, sort_keys=True)+ print(f"{label}: done, ${spend.spent:.2f} spent" + (" (stopped by a cap)" if stop.is_set() else ""), flush=True)+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/live.sh b/bench/swe-bench-pro/live.shnew file mode 100644index 0000000..80c0971--- /dev/null+++ b/bench/swe-bench-pro/live.sh@@ -0,0 +1,85 @@+#!/usr/bin/env bash+# The model runs, one step per call, all through one spend log with caps.+#+# WORK=... BUILD=... TOK=... KEY_FILE=/path/to/0600-key [TEXTS=...] bash live.sh STEP+#+# STEP: e2 (noctx, then BM25 at 64K, then the pack at 64K; Standard) | c4c (the cache session; Standard) |+# g1-pilot (at most 3 kubernetes questions per G1c arm, $0.14 per arm; Contributor) |+# g1 (the G1c arms in their registered order; Contributor; record the build before the first call)+# WORK: the folder node_setup.sh fills. BUILD: the name of the Graphicle build in WORK/bin (graphicle-BUILD),+# such as its release version. TOK: the Muse Spark Open tokenizer.json. E1RUN: the E1 run whose saved contexts+# E2 uses (default e1). TEXTS (c4c, g1-pilot, g1): the whole-repository benchmark's question texts.+# TOOL_SEARCH=1 runs the agent arms with Meta's tool search. The runs go at nice 19; CPUS=LIST also pins them to+# those CPUs (taskset -c LIST).+# The key is read from KEY_FILE by the runners and never printed.+set -euo pipefail+: "${WORK:?set WORK to the folder node_setup.sh fills}"+: "${BUILD:?set BUILD to the name of the Graphicle build in WORK/bin, such as its release version}"+: "${TOK:?set TOK to the Muse Spark Open tokenizer.json}"+E1RUN=${E1RUN:-e1}+: "${KEY_FILE:?set KEY_FILE to the key file path}"+[ -r "$KEY_FILE" ] || { echo "KEY_FILE is not readable" >&2; exit 2; }+CODE=$WORK/code+PY=$WORK/venv/bin/python+LOG=$WORK/spend/spend-log.jsonl+BIN=$WORK/bin/graphicle-$BUILD+RUN="nice -n 19"+if [ -n "${CPUS:-}" ]; then RUN="taskset -c $CPUS $RUN"; fi+mkdir -p "$WORK/spend" "$WORK/out"++e2() {+ for arm in noctx bm25 pack; do+ $RUN "$PY" "$CODE/swe-bench-pro/e2.py" --work "$WORK" --arm "$arm" --out "$WORK/out/e2/$arm" \+ --e1-run "$E1RUN" --key-file "$KEY_FILE" --tokenizer "$TOK" --spend-log "$LOG" --spend-cap auto --jobs 4+ done+ $RUN "$PY" "$CODE/whole-repo/score.py" --runs "$WORK/out/e2/noctx" "$WORK/out/e2/bm25" "$WORK/out/e2/pack" \+ --out "$WORK/out/e2/score.json"+}++c4c() {+ : "${TEXTS:?set TEXTS to the question texts of the whole-repository benchmark}"+ $RUN "$PY" "$CODE/swe-bench-pro/c4c.py" run --work "$WORK" --out "$WORK/out/c4c" --texts "$TEXTS" \+ --key-file "$KEY_FILE" --tokenizer "$TOK" --spend-log "$LOG" --spend-cap auto+}++g1_arm() { # g1_arm OUT ARM [BUDGET] [extra run.py options]+ local out=$1 arm=$2 budget=${3:-}+ : "${TEXTS:?set TEXTS to the question texts of the whole-repository benchmark}"+ shift 3 || shift $#+ local b=(); [ -n "$budget" ] && b=(--budget "$budget")+ local ts=(); case "$arm" in agent|agent-pack) [ "${TOOL_SEARCH:-0}" = 1 ] && ts=(--tool-search) ;; esac+ $RUN "$PY" "$CODE/whole-repo/run.py" --arm "$arm" "${b[@]}" --work "$WORK/g1-$BUILD" \+ --questions "$CODE/whole-repo/questions" --texts "$TEXTS" --out "$out" --profile meta \+ --model muse-spark-1.3-contributor --key-file "$KEY_FILE" --spend-log "$LOG" --tokenizer "$TOK" \+ --graphicle "$BIN" --redact "${ts[@]}" "$@"+}++g1_pilot() {+ local d=$WORK/g1-$BUILD/runs/pilot+ g1_arm "$d/noctx" noctx "" --repos kubernetes --limit 3 --spend-cap 0.14+ g1_arm "$d/trunc" trunc 128K --repos kubernetes --limit 3 --spend-cap 0.14+ g1_arm "$d/pack" pack 128K --repos kubernetes --limit 3 --spend-cap 0.14+ g1_arm "$d/pack-cache" pack-cache 128K --repos kubernetes --limit 3 --spend-cap 0.14+ g1_arm "$d/bm25" bm25 128K --repos kubernetes --limit 3 --spend-cap 0.14+ g1_arm "$d/agent" agent "" --repos kubernetes --limit 3 --spend-cap 0.14+ g1_arm "$d/agent-pack" agent-pack 32K --repos kubernetes --limit 3 --spend-cap 0.14+}++g1() {+ local d=$WORK/g1-$BUILD/runs/g1c h=pytorch,vscode,elasticsearch+ g1_arm "$d/noctx" noctx "" --repos "$h" --spend-cap auto+ g1_arm "$d/trunc" trunc 128K --repos "$h" --spend-cap auto+ g1_arm "$d/pack" pack 128K --repos "$h" --spend-cap auto+ g1_arm "$d/pack-cache" pack-cache 128K --repos "$h" --spend-cap auto+ g1_arm "$d/bm25" bm25 128K --repos "$h" --spend-cap auto+ g1_arm "$d/agent" agent "" --repos "$h" --spend-cap auto+ g1_arm "$d/agent-pack" agent-pack 32K --repos "$h" --spend-cap auto+}++case "${1:-}" in+ e2) e2 ;;+ c4c) c4c ;;+ g1-pilot) g1_pilot ;;+ g1) g1 ;;+ *) echo "usage: WORK=... BUILD=... TOK=... KEY_FILE=... [TEXTS=...] bash live.sh e2|c4c|g1-pilot|g1 (TEXTS for c4c, g1-pilot and g1)" >&2; exit 2 ;;+esacdiff --git a/bench/swe-bench-pro/node_setup.sh b/bench/swe-bench-pro/node_setup.shnew file mode 100644index 0000000..828970a--- /dev/null+++ b/bench/swe-bench-pro/node_setup.sh@@ -0,0 +1,102 @@+#!/usr/bin/env bash+# Setup for the SWE-bench Pro runs. Re-runnable: each step skips what already exists.+#+# WORK=... BUILD=... bash node_setup.sh STEP... STEP: venv | data | binary | clones | all | g1+#+# WORK holds everything: venv/, raw/ (the pinned dataset file), tasks.jsonl, texts/ (problem statements),+# bin/ (the Graphicle build), mirror/ (one bare clone per repository) and code/ (a copy of this folder and+# ../whole-repo). BUILD names the Graphicle build, such as its release version (0.1.9). The binary step copies+# GRAPHICLE, a `graphicle` program built with `cargo build --release --locked --features local-inference`, to+# WORK/bin/graphicle-BUILD. The g1 step reads BENCH, the whole-repository benchmark's work folder (src/, manifest/+# and mine/), and TOK, the Muse Spark Open tokenizer.json its manifests were counted with. The steps run at+# nice 19; CPUS=LIST also pins them to those CPUs (taskset -c LIST). UV names the uv program (default uv).+set -euo pipefail+: "${WORK:?set WORK to the work folder}"+: "${BUILD:?set BUILD to a name for the Graphicle build, such as its release version}"+CODE=$WORK/code/swe-bench-pro+PY=$WORK/venv/bin/python+RUN="nice -n 19"+if [ -n "${CPUS:-}" ]; then RUN="taskset -c $CPUS $RUN"; fi+UV=${UV:-uv}+mkdir -p "$WORK/logs"++step_venv() {+ [ -x "$PY" ] && "$PY" -c 'import pyarrow, tokenizers, numpy' 2>/dev/null && { echo "venv: ok"; return; }+ "$UV" venv -q --python 3.12 "$WORK/venv"+ VIRTUAL_ENV=$WORK/venv "$UV" pip install -q pyarrow==26.0.0 tokenizers==0.23.3 numpy==2.5.4+ echo "venv: built"+}++step_data() {+ [ -s "$WORK/tasks.jsonl" ] && { echo "data: ok"; return; }+ $RUN "$PY" "$CODE/data.py" fetch --out "$WORK/raw"+ $RUN "$PY" "$CODE/data.py" tasks --parquet "$WORK/raw/test-00000-of-00001.parquet" \+ --tasks "$WORK/tasks.jsonl" --texts "$WORK/texts"+}++step_binary() {+ local bin=$WORK/bin/graphicle-$BUILD+ [ -x "$bin" ] && { echo "binary: ok ($("$bin" --version))"; return; }+ : "${GRAPHICLE:?set GRAPHICLE to a graphicle program built with --features local-inference}"+ mkdir -p "$WORK/bin"+ cp "$GRAPHICLE" "$bin.tmp"+ mv "$bin.tmp" "$bin"+ "$bin" --version+}++clone_one() {+ local repo=$1 dest=$WORK/mirror/${1/\//__}.git+ if [ -d "$dest" ]; then echo "clone $repo: ok"; return; fi+ $RUN git clone -q --bare "https://github.com/$repo.git" "$dest.tmp" && mv "$dest.tmp" "$dest"+ echo "clone $repo: done"+}++step_clones() {+ mkdir -p "$WORK/mirror"+ "$PY" -c 'import json,sys; print("\n".join(sorted({json.loads(l)["repo"] for l in open(sys.argv[1])})))' \+ "$WORK/tasks.jsonl" > "$WORK/repos.txt"+ local pids=()+ while read -r repo; do clone_one "$repo" & pids+=($!); done < "$WORK/repos.txt"+ local fail=0+ for p in "${pids[@]}"; do wait "$p" || fail=1; done+ [ "$fail" = 0 ] || { echo "clones: some failed" >&2; return 1; }+ # Every base commit must be in its mirror; fetch the missing ones by sha.+ "$PY" -c 'import json,sys; [print(t["repo"], t["base_commit"]) for t in map(json.loads, open(sys.argv[1]))]' \+ "$WORK/tasks.jsonl" | while read -r repo sha; do+ local m=$WORK/mirror/${repo/\//__}.git+ git -C "$m" cat-file -e "$sha^{commit}" 2>/dev/null || $RUN git -C "$m" fetch -q origin "$sha" || echo "missing $repo $sha"+ done+ echo "clones: ok"+}++# G1 (the whole-repository benchmark) and the cache meter: WORK/g1-BUILD holds the shared checkouts at S (read only,+# by symlink), their manifests (counted with the Muse tokenizer) copied, and indexes built by this build.+step_g1() {+ : "${BENCH:?set BENCH to the work folder of the whole-repository benchmark}"+ : "${TOK:?set TOK to the Muse Spark Open tokenizer.json}"+ local g1=$WORK/g1-$BUILD bench=$BENCH+ # tokens.py names an exact counter by the tokenizer's folder and file name.+ local want="exact:$(basename "$(cd "$(dirname "$TOK")" && pwd)")/$(basename "$TOK")"+ mkdir -p "$g1/src" "$g1/manifest" "$g1/data"+ for n in kubernetes pytorch vscode elasticsearch; do+ ln -sfn "$bench/src/$n" "$g1/src/$n"+ head -1 "$bench/manifest/$n.tsv" | grep -qF "$want" \+ || { echo "g1: the $n manifest was not counted with $TOK" >&2; return 1; }+ cp --update=none "$bench/manifest/$n.tsv" "$g1/manifest/$n.tsv"+ ln -sfn "$bench/mine" "$g1/mine"+ done+ $RUN "$PY" "$WORK/code/whole-repo/index.py" --binary "$WORK/bin/graphicle-$BUILD" --work "$g1" \+ kubernetes pytorch vscode elasticsearch+}++for s in "$@"; do+ case "$s" in+ venv) step_venv ;;+ data) step_data ;;+ binary) step_binary ;;+ clones) step_clones ;;+ g1) step_g1 ;;+ all) step_venv; step_data; step_binary; step_clones ;;+ *) echo "unknown step $s" >&2; exit 2 ;;+ esac+donediff --git a/bench/swe-bench-pro/results-e1.md b/bench/swe-bench-pro/results-e1.mdnew file mode 100644index 0000000..c30fa6c--- /dev/null+++ b/bench/swe-bench-pro/results-e1.md@@ -0,0 +1,94 @@+# SWE-bench Pro: gold-file recall without a model++**Build, date and tasks.** Graphicle 0.1.9, measured on 27 Oct 2026, on SWE-bench Pro's public set (V2, 642 tasks in 11 repositories). 633 tasks remain after leaving out the 9 whose reference patch only creates files.++**What was counted.** For each task, three contexts of the same token budget were built from the repository at the task's base commit. Each table counts the tasks whose context holds every file the reference patch changes ("all gold files"), or at least one of them. No model is involved. One tokenizer counts all three contexts: the Muse Spark Open tokenizer.++**When it was fixed.** The method, the tasks and the sample were committed before any number was measured, at 06:04 UTC on 27 Oct 2026. The settings of 0.1.9's `graphicle pack` were not tuned on SWE-bench Pro: they were tuned on the whole-repository benchmark's development repositories. After this run, a line-level diagnosis of 0.1.9 on SWE-bench Pro chose the directions of 0.1.10's pack tuning, though not its settings ([results-e1l.md](results-e1l.md)).++## What "inside" means for each context++| Context | How it is built | When a gold file counts as inside |+|---|---|---|+| pack | `graphicle pack` from Graphicle 0.1.9, standard layout, with the problem statement as the question, on an index `graphicle sync` builds at the base commit | Registered rule: the pack holds some of the file's text. That can be the whole file, excerpts (the symbols around the ranked passages), or an outline (the first line of each symbol, for a file too large to go in whole). |+| BM25 | File-level BM25 over the same files, the SWE-bench paper's retrieval baseline (`../whole-repo/bm25.py`): whole files in score order; a file that does not fit is skipped, never cut | The whole file is in the context. |+| truncation | The repository's files in a fixed order (source, then tests, then docs), each if it still fits, never cut. Shown for reference | The whole file is in the context. |++BM25 and truncation can only hold whole files, so the tables also read the pack's rows two stricter ways. **Code lines**: the registered rule without the gold files the pack holds only as an outline. **Whole files**: every gold file is held whole, the rule BM25 and truncation meet by construction, and the only reading that judges all three contexts alike.++## All gold files inside, % of tasks++95% bootstrap intervals over tasks (2,000 resamples); each gap is pack minus BM25 in points, with an interval paired by task.++| Budget (tokens) | Tasks | BM25 | pack, registered | gap | pack, code lines | gap | pack, whole files | gap | truncation |+|---|---|---|---|---|---|---|---|---|---|+| 16K | 633 | 14.2 (11.4-17.1) | 30.3 (27.0-33.8) | +16.1 (13.3 to 19.3) | 29.5 | +15.3 (12.3 to 18.3) | 4.7 | -9.5 (-12.2 to -6.8) | 0.2 |+| 32K | 633 | 19.0 (16.0-22.0) | 34.6 (31.0-38.2) | +15.6 (12.5 to 19.0) | 32.2 | +13.3 (10.4 to 16.3) | 9.2 | -9.8 (-12.6 to -6.8) | 0.2 |+| 64K | 633 | 25.9 (22.6-29.4) | 42.8 (38.9-46.8) | +16.9 (13.6 to 20.1) | 41.1 | +15.2 (12.0 to 18.6) | 19.0 | -7.0 (-10.4 to -3.3) | 1.3 |+| 128K | 633 | 32.7 (29.1-36.3) | 50.6 (46.8-54.2) | +17.9 (14.4 to 21.5) | 48.8 | +16.1 (12.6 to 19.7) | 31.3 | -1.4 (-5.1 to 2.4) | 4.6 |+| 256K | 633 | 41.5 (37.6-45.5) | 56.4 (52.4-60.3) | +14.8 (11.4 to 18.3) | 55.6 | +14.1 (10.6 to 17.9) | 47.7 | +6.2 (2.4 to 10.0) | 14.2 |+| 1M | 505 | 58.0 (53.7-62.6) | 74.1 (70.1-77.8) | +16.0 (12.1 to 20.0) | 73.9 | +15.8 (11.9 to 20.2) | 56.8 | -1.2 (-5.9 to 3.6) | 31.1 |++- The 1M row covers only the 505 tasks whose files hold more than 1M tokens (1,015,808).+- **Code lines against registered:** leaving out outline-only gold files lowers the gap by 0.2 to 2.4 points; every interval stays above zero. Of the gold files inside the pack at 64K, 57 of 1,608 are held only as an outline.+- **Whole files:** BM25 leads at 16K to 64K, the two are level at 128K and 1M (the intervals include zero), and the pack leads at 256K.+- **A quarter of the tokens.** The pack at 64K holds all gold files in 42.8% of tasks (registered) or 41.1% (code lines); BM25 at 256K, with four times the tokens, does so in 41.5% (paired gaps +1.3, interval -2.2 to 4.9, and -0.5, interval -3.9 to 3.3). Counting whole files, the pack at 64K reaches 19.0%.++## At least one gold file inside, % of tasks++| Budget (tokens) | BM25 | pack, registered | pack, code lines | pack, whole files | truncation |+|---|---|---|---|---|---|+| 16K | 63.8 (60.0-67.3) | 87.0 (84.4-89.6) | 86.7 | 36.0 | 8.2 |+| 32K | 73.5 (70.0-76.6) | 89.4 (87.0-91.8) | 88.0 | 51.7 | 11.1 |+| 64K | 79.3 (76.1-82.5) | 93.0 (91.0-94.9) | 92.3 | 72.2 | 21.6 |+| 128K | 85.9 (83.3-88.5) | 95.3 (93.5-96.8) | 94.6 | 84.5 | 31.3 |+| 256K | 89.7 (87.2-92.1) | 96.7 (95.3-98.1) | 96.5 | 93.8 | 42.5 |+| 1M (505 tasks) | 94.1 (91.9-96.0) | 98.6 (97.4-99.6) | 98.4 | 97.2 | 68.1 |++**Statements that name a gold path.** In 26 tasks the problem statement names a gold file's path. Without them (607 tasks), all gold files are inside as follows, pack (registered) against BM25: 16K 29.8% against 13.8%; 64K 42.3% against 25.4%; 256K 55.5% against 41.0%.++## Per repository: all gold files inside, % of tasks++| Repository | Tasks | 64K BM25 | 64K pack, registered | 64K pack, code lines | 64K pack, whole files | 256K BM25 | 256K pack, registered | 256K pack, code lines | 256K pack, whole files |+|---|---|---|---|---|---|---|---|---|---|+| NodeBB/NodeBB | 38 | 18.4 | 31.6 | 28.9 | 15.8 | 23.7 | 44.7 | 42.1 | 39.5 |+| ansible/ansible | 77 | 45.5 | 62.3 | 59.7 | 14.3 | 61.0 | 67.5 | 67.5 | 55.8 |+| element-hq/element-web | 52 | 21.2 | 38.5 | 36.5 | 23.1 | 21.2 | 55.8 | 55.8 | 42.3 |+| flipt-io/flipt | 78 | 20.5 | 34.6 | 33.3 | 15.4 | 46.2 | 48.7 | 47.4 | 42.3 |+| future-architect/vuls | 58 | 29.3 | 39.7 | 37.9 | 13.8 | 39.7 | 58.6 | 56.9 | 51.7 |+| gravitational/teleport | 65 | 12.3 | 32.3 | 29.2 | 13.8 | 21.5 | 44.6 | 44.6 | 26.2 |+| internetarchive/openlibrary | 81 | 28.4 | 46.9 | 44.4 | 14.8 | 34.6 | 61.7 | 61.7 | 60.5 |+| navidrome/navidrome | 52 | 42.3 | 46.2 | 46.2 | 44.2 | 73.1 | 71.2 | 71.2 | 71.2 |+| protonmail/webclients | 55 | 12.7 | 32.7 | 32.7 | 20.0 | 14.5 | 36.4 | 36.4 | 36.4 |+| qutebrowser/qutebrowser | 73 | 24.7 | 52.1 | 50.7 | 19.2 | 67.1 | 67.1 | 64.4 | 46.6 |+| tutao/tutanota | 4 | 0.0 | 50.0 | 50.0 | 50.0 | 0.0 | 50.0 | 50.0 | 50.0 |++Where BM25 is level or ahead (paired 95% intervals of pack minus BM25):+- **Registered:** at 256K, BM25 is ahead in navidrome (73.1% against 71.2%) and level in qutebrowser (67.1% both); the intervals include zero in ansible and flipt at 256K and in navidrome at 16K to 128K. At 1M, BM25 is ahead in flipt (66.7% against 61.7%), level in NodeBB (60.5% both), and the interval includes zero in ansible.+- **Code lines:** as registered; in addition, at 256K BM25 is ahead in qutebrowser (67.1% against 64.4%), at 32K it is level in navidrome, and the intervals include zero in vuls at 64K and 128K, in NodeBB at 32K and in element-web at 16K.+- **Whole files:** at 64K BM25 leads in ansible, vuls and openlibrary (intervals below zero), and the intervals include zero in the other repositories. At 256K BM25 leads in qutebrowser (67.1% against 46.6%), the pack leads in NodeBB, element-web, vuls, openlibrary and webclients (intervals above zero), and the intervals include zero elsewhere.+- tutanota has 4 tasks; every interval there includes zero.++## Index time per repository (Graphicle 0.1.9)++Median per base commit, six tasks at once on 48 CPU cores (Intel Xeon Platinum 8480C).++| Repository | Index, seconds | Index, MiB | Tokens in the file set |+|---|---|---|---|+| future-architect/vuls | 2 | 39 | 648,508 |+| navidrome/navidrome | 4 | 73 | 652,022 |+| flipt-io/flipt | 5 | 99 | 1,261,214 |+| internetarchive/openlibrary | 7 | 133 | 2,281,734 |+| qutebrowser/qutebrowser | 8 | 147 | 1,918,697 |+| NodeBB/NodeBB | 9 | 148 | 3,457,001 |+| ansible/ansible | 15 | 314 | 4,687,455 |+| tutao/tutanota | 15 | 286 | 6,404,918 |+| element-hq/element-web | 16 | 323 | 5,946,027 |+| protonmail/webclients | 49 | 637 | 12,683,824 |+| gravitational/teleport | 148 | 1,570 | 9,895,845 |++## Notes and limits++- **The registered run.** The registered run used a pre-release build of 0.1.9 (27 Oct 2026). The 0.1.9 release changes how the pack reads an issue's environment sections (version and system information) before ranking. On the same 633 tasks it changes 19 tasks: 4 hold more gold files (none fewer) and 15 differ only in context size. No all-gold or any-gold share moves by more than 0.3 points, and BM25 and truncation are unchanged. An earlier pre-release build could not pack 18 of the 633 tasks.+- **The question.** It is the problem statement alone. SWE-bench Pro's requirements and interface fields often name the files to change, so they are not used.+- **What this does not measure.** It counts what a context holds, not whether a model then names the right files or fixes the issue. Whether an excerpt holds the lines a fix changes is not checked here; [results-e1l.md](results-e1l.md) checks it. SWE-bench Pro's own grading (running the tests) is not part of it.diff --git a/bench/swe-bench-pro/results-e1l.md b/bench/swe-bench-pro/results-e1l.mdnew file mode 100644index 0000000..760ab72--- /dev/null+++ b/bench/swe-bench-pro/results-e1l.md@@ -0,0 +1,78 @@+# SWE-bench Pro: gold lines and gold files without a model, Graphicle 0.1.9 and the 0.1.10 candidate build++**Builds, dates and tasks.** 0.1.9 is the release build. The 0.1.10 candidate is a build of 0.1.10's pack and HTML changes, made before the fixes of its code review. Both were measured on 27 Oct 2026, each on indexes it built itself at every base commit. The tasks are the 633 of [results-e1.md](results-e1.md): SWE-bench Pro's public set (V2, 642 tasks in 11 repositories) without the 9 whose reference patch only creates files. The 1M rows cover the 505 tasks whose files hold more than 1M tokens (1,015,808).++**What was counted** (`e1l.py`; no model is involved). Each task's gold lines come from its reference patch: the lines of the base commit that it removes or replaces (its `-` lines) and, for a hunk that only adds lines, the line before each run it adds. Every `-` line matched the file at the base commit. A gold line is inside the pack when a whole file or an excerpt covers it with the file's own line numbers; a line shown only in an outline does not count. BM25 (file-level, whole files in score order) and truncation hold whole files, so every line of a file they hold is inside. They do not depend on the Graphicle build: the candidate's run took 0.1.9's BM25 and truncation rows as they are. Tokens are counted with the Muse Spark Open tokenizer.++**What was tuned on.** The settings of 0.1.10's pack changes were chosen on the whole-repository benchmark's development repositories, and SWE-bench Pro was only measured. But a diagnosis of 0.1.9's misses on these tasks chose the directions of that tuning (whole files, excerpts, ranking and HTML files), so this is not an untouched test of 0.1.10. The clean check is the whole-repository benchmark's held-out repositories ([results-lines.md](../whole-repo/results-lines.md)).++**Readings.** E1's three file-level readings, as in [results-e1.md](results-e1.md), where the text-only reading is called code lines: registered (every gold file inside, a file counting when the pack holds any of its text), text only (every gold file inside as a whole file or an excerpt; an outline alone does not count) and whole files (every gold file held whole). E1L's line-level readings: (a) every gold line inside, (b) the mean share of gold lines inside, (c) the gold files with all their gold lines inside, pooled over tasks. Changes and gaps against BM25 are paired by task, with 95% bootstrap intervals (2,000 resamples of tasks, seed 1). These are this report's own resamples, so an interval can differ by a few tenths of a point from the same one in results-e1.md: the 0.1.9 whole-files gap at 128K, for example, is -5.4 to +2.4 here and -5.1 to 2.4 there. Made with `e1l_compare.py --base 0.1.9 --new 0.1.10-candidate`.++Tasks: 0.1.9 633, 0.1.10-candidate 633, both 633 (only 0.1.9: 0, only 0.1.10-candidate: 0).++### E1 registered: every gold file inside (any of its text), %++| Budget | Tasks | 0.1.9 | 0.1.10-candidate | change (paired 95% interval) | BM25 | 0.1.9 - BM25 | 0.1.10-candidate - BM25 |+|---|---|---|---|---|---|---|---|+| 16K | 633 | 30.3 | 29.5 | -0.8 (-1.9 to +0.3) | 14.2 | +16.1 (+13.1 to +19.1) | +15.3 (+12.3 to +18.5) |+| 32K | 633 | 34.6 | 34.3 | -0.3 (-1.4 to +0.8) | 19.0 | +15.6 (+12.6 to +18.8) | +15.3 (+12.2 to +18.5) |+| 64K | 633 | 42.8 | 42.8 | +0.0 (-0.5 to +0.5) | 25.9 | +16.9 (+13.7 to +20.1) | +16.9 (+13.7 to +20.2) |+| 128K | 633 | 50.6 | 49.8 | -0.8 (-1.6 to -0.2) | 32.7 | +17.9 (+14.5 to +21.3) | +17.1 (+13.6 to +20.7) |+| 256K | 633 | 56.4 | 56.4 | +0.0 (+0.0 to +0.0) | 41.5 | +14.8 (+11.4 to +18.5) | +14.8 (+11.4 to +18.6) |+| 1M | 505 | 74.1 | 73.9 | -0.2 (-0.6 to +0.0) | 58.0 | +16.0 (+11.9 to +20.2) | +15.8 (+11.7 to +20.0) |++### E1 text only: every gold file inside as text (an outline alone does not count), %++| Budget | Tasks | 0.1.9 | 0.1.10-candidate | change (paired 95% interval) | BM25 | 0.1.9 - BM25 | 0.1.10-candidate - BM25 |+|---|---|---|---|---|---|---|---|+| 16K | 633 | 29.5 | 27.5 | -2.1 (-3.5 to -0.6) | 14.2 | +15.3 (+12.3 to +18.5) | +13.3 (+10.3 to +16.3) |+| 32K | 633 | 32.2 | 32.1 | -0.2 (-0.9 to +0.6) | 19.0 | +13.3 (+10.3 to +16.3) | +13.1 (+10.1 to +16.1) |+| 64K | 633 | 41.1 | 40.9 | -0.2 (-0.8 to +0.5) | 25.9 | +15.2 (+12.0 to +18.5) | +15.0 (+11.8 to +18.5) |+| 128K | 633 | 48.8 | 48.5 | -0.3 (-0.8 to +0.0) | 32.7 | +16.1 (+12.6 to +19.3) | +15.8 (+12.3 to +19.4) |+| 256K | 633 | 55.6 | 55.5 | -0.2 (-0.5 to +0.0) | 41.5 | +14.1 (+10.4 to +17.9) | +13.9 (+10.3 to +17.5) |+| 1M | 505 | 73.9 | 73.9 | +0.0 (+0.0 to +0.0) | 58.0 | +15.8 (+11.7 to +20.0) | +15.8 (+11.7 to +20.0) |++### E1 whole files: every gold file held whole, %++| Budget | Tasks | 0.1.9 | 0.1.10-candidate | change (paired 95% interval) | BM25 | 0.1.9 - BM25 | 0.1.10-candidate - BM25 |+|---|---|---|---|---|---|---|---|+| 16K | 633 | 4.7 | 11.5 | +6.8 (+4.7 to +8.8) | 14.2 | -9.5 (-12.2 to -6.8) | -2.7 (-5.2 to -0.3) |+| 32K | 633 | 9.2 | 15.5 | +6.3 (+4.4 to +8.4) | 19.0 | -9.8 (-12.8 to -6.8) | -3.5 (-6.2 to -0.6) |+| 64K | 633 | 19.0 | 18.6 | -0.3 (-0.8 to +0.0) | 25.9 | -7.0 (-10.6 to -3.3) | -7.3 (-10.6 to -3.8) |+| 128K | 633 | 31.3 | 34.3 | +3.0 (+1.6 to +4.4) | 32.7 | -1.4 (-5.4 to +2.4) | +1.6 (-1.9 to +5.4) |+| 256K | 633 | 47.7 | 49.0 | +1.3 (+0.5 to +2.2) | 41.5 | +6.2 (+2.5 to +10.1) | +7.4 (+3.8 to +11.4) |+| 1M | 505 | 56.8 | 58.6 | +1.8 (+0.8 to +3.0) | 58.0 | -1.2 (-5.7 to +3.4) | +0.6 (-4.2 to +5.1) |++### E1L (a): every gold line inside, %++| Budget | Tasks | 0.1.9 | 0.1.10-candidate | change (paired 95% interval) | BM25 | 0.1.9 - BM25 | 0.1.10-candidate - BM25 |+|---|---|---|---|---|---|---|---|+| 16K | 633 | 10.3 | 15.0 | +4.7 (+3.0 to +6.6) | 14.2 | -3.9 (-6.5 to -1.3) | +0.8 (-1.9 to +3.3) |+| 32K | 633 | 16.7 | 20.4 | +3.6 (+2.2 to +5.2) | 19.0 | -2.2 (-5.4 to +0.8) | +1.4 (-1.4 to +4.4) |+| 64K | 633 | 29.1 | 29.2 | +0.2 (-0.5 to +0.9) | 25.9 | +3.2 (+0.0 to +6.3) | +3.3 (+0.2 to +6.6) |+| 128K | 633 | 40.8 | 42.3 | +1.6 (+0.5 to +2.8) | 32.7 | +8.1 (+4.6 to +11.5) | +9.6 (+6.5 to +13.0) |+| 256K | 633 | 51.5 | 52.8 | +1.3 (+0.3 to +2.2) | 41.5 | +10.0 (+6.3 to +13.7) | +11.2 (+7.7 to +15.0) |+| 1M | 505 | 66.5 | 68.3 | +1.8 (+0.8 to +3.2) | 58.0 | +8.5 (+4.0 to +13.1) | +10.3 (+5.9 to +14.7) |++### E1L (b): mean share of gold lines inside, %++| Budget | Tasks | 0.1.9 | 0.1.10-candidate | change (paired 95% interval) | BM25 | 0.1.9 - BM25 | 0.1.10-candidate - BM25 |+|---|---|---|---|---|---|---|---|+| 16K | 633 | 42.0 | 45.5 | +3.5 (+2.3 to +4.9) | 37.7 | +4.3 (+1.2 to +7.5) | +7.8 (+4.9 to +10.8) |+| 32K | 633 | 52.5 | 55.0 | +2.4 (+1.3 to +3.6) | 48.3 | +4.2 (+1.1 to +7.4) | +6.7 (+3.6 to +9.7) |+| 64K | 633 | 64.6 | 64.6 | +0.1 (-0.4 to +0.5) | 55.0 | +9.5 (+6.7 to +12.5) | +9.6 (+6.7 to +12.5) |+| 128K | 633 | 74.0 | 74.6 | +0.6 (+0.3 to +1.0) | 62.8 | +11.2 (+8.5 to +13.8) | +11.8 (+9.2 to +14.5) |+| 256K | 633 | 80.9 | 81.4 | +0.5 (+0.2 to +1.0) | 69.8 | +11.0 (+8.7 to +13.7) | +11.6 (+9.1 to +14.1) |+| 1M | 505 | 90.5 | 91.2 | +0.7 (+0.3 to +1.1) | 80.8 | +9.8 (+7.2 to +12.3) | +10.4 (+7.8 to +13.1) |++### E1L (c): gold files with all their gold lines inside, % (pooled)++| Budget | Tasks | 0.1.9 | 0.1.10-candidate | change (paired 95% interval) | BM25 |+|---|---|---|---|---|---|+| 16K | 633 | 22.7 | 25.2 | +2.5 (+1.6 to +3.4) | 22.9 |+| 32K | 633 | 31.8 | 33.9 | +2.0 (+1.3 to +2.8) | 31.9 |+| 64K | 633 | 45.0 | 45.2 | +0.2 (-0.2 to +0.5) | 39.1 |+| 128K | 633 | 57.9 | 58.7 | +0.8 (+0.3 to +1.3) | 47.6 |+| 256K | 633 | 67.9 | 68.6 | +0.6 (+0.3 to +1.0) | 54.5 |+| 1M | 505 | 80.2 | 81.2 | +0.9 (+0.5 to +1.4) | 65.5 |+diff --git a/bench/swe-bench-pro/sample-e2.json b/bench/swe-bench-pro/sample-e2.jsonnew file mode 100644index 0000000..a593688--- /dev/null+++ b/bench/swe-bench-pro/sample-e2.json@@ -0,0 +1,134 @@+{+ "seed": 20261027,+ "n": 100,+ "population": 633,+ "excluded_no_gold": 9,+ "allocation": {+ "NodeBB/NodeBB": 6,+ "ansible/ansible": 12,+ "element-hq/element-web": 8,+ "flipt-io/flipt": 12,+ "future-architect/vuls": 9,+ "gravitational/teleport": 10,+ "internetarchive/openlibrary": 13,+ "navidrome/navidrome": 8,+ "protonmail/webclients": 9,+ "qutebrowser/qutebrowser": 12,+ "tutao/tutanota": 1+ },+ "population_by_repo": {+ "NodeBB/NodeBB": 38,+ "ansible/ansible": 77,+ "element-hq/element-web": 52,+ "flipt-io/flipt": 78,+ "future-architect/vuls": 58,+ "gravitational/teleport": 65,+ "internetarchive/openlibrary": 81,+ "navidrome/navidrome": 52,+ "protonmail/webclients": 55,+ "qutebrowser/qutebrowser": 73,+ "tutao/tutanota": 4+ },+ "ids": [+ "instance_NodeBB__NodeBB-087e6020e490b4a1759f38c1ad03869511928263-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e",+ "instance_NodeBB__NodeBB-2657804c1fb6b84dc76ad3b18ecf061aaab5f29f-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e",+ "instance_NodeBB__NodeBB-397835a05a8e2897324e566b41c5e616e172b4af-v89631a1cdb318276acb48860c5d78077211397c6",+ "instance_NodeBB__NodeBB-445b70deda20201b7d9a68f7224da751b3db728c-v4fbcfae8b15e4ce5d132c408bca69ebb9cf146ed",+ "instance_NodeBB__NodeBB-a5afad27e52fd336163063ba40dcadc80233ae10-vd59a5728dfc977f44533186ace531248c2917516",+ "instance_NodeBB__NodeBB-f1a80d48cc45877fcbadf34c2345dd9709722c7f-v4fbcfae8b15e4ce5d132c408bca69ebb9cf146ed",+ "instance_ansible__ansible-0ea40e09d1b35bcb69ff4d9cecf3d0defa4b36e8-v30a923fb5c164d6cd18280c02422f75e611e8fb2",+ "instance_ansible__ansible-12734fa21c08a0ce8c84e533abdc560db2eb1955-v7eee2454f617569fd6889f2211f75bc02a35f9f8",+ "instance_ansible__ansible-164881d871964aa64e0f911d03ae270acbad253c-v390e508d27db7a51eece36bb6d9698b63a5b638a",+ "instance_ansible__ansible-3db08adbb1cc6aa9941be5e0fc810132c6e1fa4b-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5",+ "instance_ansible__ansible-5f4e332e3762999d94af27746db29ff1729252c1-v0f01c69f1e2528b935359cfe578530722bca2c59",+ "instance_ansible__ansible-709484969c8a4ffd74b839a673431a8c5caa6457-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5",+ "instance_ansible__ansible-83fb24b923064d3576d473747ebbe62e4535c9e3-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5",+ "instance_ansible__ansible-d58e69c82d7edd0583dd8e78d76b075c33c3151e-v173091e2e36d38c978002990795f66cfc0af30ad",+ "instance_ansible__ansible-de01db08d00c8d2438e1ba5989c313ba16a145b0-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5",+ "instance_ansible__ansible-ea04e0048dbb3b63f876aad7020e1de8eee9f362-v1055803c3a812189a1133297f7f5468579283f86",+ "instance_ansible__ansible-ed6581e4db2f1bec5a772213c3e186081adc162d-v0f01c69f1e2528b935359cfe578530722bca2c59",+ "instance_ansible__ansible-f86c58e2d235d8b96029d102c71ee2dfafd57997-v0f01c69f1e2528b935359cfe578530722bca2c59",+ "instance_element-hq__element-web-4c6b0d35add7ae8d58f71ea1711587e31081444b-vnan",+ "instance_element-hq__element-web-53b42e321777a598aaf2bb3eab22d710569f83a8-vnan",+ "instance_element-hq__element-web-5e8488c2838ff4268f39db4a8cca7d74eecf5a7e-vnan",+ "instance_element-hq__element-web-71fe08ea0f159ccb707904d87f0a4aef205a167c-vnan",+ "instance_element-hq__element-web-8f3c8b35153d2227af45f32e46bd1e15bd60b71f-vnan",+ "instance_element-hq__element-web-923ad4323b2006b2b180544429455ffe7d4a6cc3-vnan",+ "instance_element-hq__element-web-aeabf3b18896ac1eb7ae9757e66ce886120f8309-vnan",+ "instance_element-hq__element-web-cf3c899dd1f221aa1a1f4c5a80dffc05b9c21c85-vnan",+ "instance_flipt-io__flipt-15b76cada1ef29cfa56b0fba36754be36243dded",+ "instance_flipt-io__flipt-3d5a345f94c2adc8a0eaa102c189c08ad4c0f8e8",+ "instance_flipt-io__flipt-7161f7b876773a911afdd804b281e52681cb7321",+ "instance_flipt-io__flipt-8bd3604dc54b681f1f0f7dd52cbc70b3024184b6",+ "instance_flipt-io__flipt-967855b429f749c28c112b8cb1b15bc79157f973",+ "instance_flipt-io__flipt-9f8127f225a86245fa35dca4885c2daef824ee55",+ "instance_flipt-io__flipt-b2170346dc37cf42fda1386cd630f24821ad2ac5",+ "instance_flipt-io__flipt-b22f5f02e40b225b6b93fff472914973422e97c6",+ "instance_flipt-io__flipt-c154dd1a3590954dfd3b901555fc6267f646a289",+ "instance_flipt-io__flipt-e50808c03e4b9d25a6a78af9c61a3b1616ea356b",+ "instance_flipt-io__flipt-e88e93990e3ec1e7697754b423decc510d5dd5fe",+ "instance_flipt-io__flipt-ea9a2663b176da329b3f574da2ce2a664fc5b4a1",+ "instance_future-architect__vuls-0ec945d0510cdebf92cdd8999f94610772689f14",+ "instance_future-architect__vuls-1832b4ee3a20177ad313d806983127cb6e53f5cf",+ "instance_future-architect__vuls-4c04acbd9ea5b073efe999e33381fa9f399d6f27",+ "instance_future-architect__vuls-54e73c2f5466ef5daec3fb30922b9ac654e4ed25",+ "instance_future-architect__vuls-6eff6a9329a65cc412e79b8f82444dfa3d0f0b5a",+ "instance_future-architect__vuls-8659668177f1feb65963db7a967347a79c5f9c40",+ "instance_future-architect__vuls-aaea15e516ece43978cf98e09e52080478b1d39f",+ "instance_future-architect__vuls-e1fab805afcfc92a2a615371d0ec1e667503c254-v264a82e2f4818e30f5a25e4da53b27ba119f62b5",+ "instance_future-architect__vuls-e4728e388120b311c4ed469e4f942e0347a2689b-v264a82e2f4818e30f5a25e4da53b27ba119f62b5",+ "instance_gravitational__teleport-0415e422f12454db0c22316cf3eaa5088d6b6322",+ "instance_gravitational__teleport-10123c046e21e1826098e485a4c2212865a49d9f",+ "instance_gravitational__teleport-1330415d33a27594c948a36d9d7701f496229e9f",+ "instance_gravitational__teleport-1b08e7d0dbe68fe530a0f08ad408ec198b7c53fc-vee9b09fb20c43af7e520f57e9239bbcf46b7113d",+ "instance_gravitational__teleport-53814a2d600ccd74c1e9810a567563432b98386e-vce94f93ad1030e3136852817f2423c1b3ac37bc4",+ "instance_gravitational__teleport-65438e6e44b6ce51458d09b7bb028a2797cfb0ea-vce94f93ad1030e3136852817f2423c1b3ac37bc4",+ "instance_gravitational__teleport-82185f232ae8974258397e121b3bc2ed0c3729ed-v626ec2a48416b10a88641359a169d99e935ff037",+ "instance_gravitational__teleport-96019ce0be7a2c8e36363f359eb7c943b41dde70",+ "instance_gravitational__teleport-a95b3ae0667f9e4b2404bf61f51113e6d83f01cd",+ "instance_gravitational__teleport-b5d8169fc0a5e43fee2616c905c6d32164654dc6",+ "instance_internetarchive__openlibrary-1894cb48d6e7fb498295a5d3ed0596f6f603b784-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4",+ "instance_internetarchive__openlibrary-1be7de788a444f6255e89c10ef6aa608550604a8-v29f82c9cf21d57b242f8d8b0e541525d259e2d63",+ "instance_internetarchive__openlibrary-3c48b4bb782189e0858e6c3fc7956046cf3e1cfb-v2d9a6c849c60ed19fd0858ce9e40b7cc8e097e59",+ "instance_internetarchive__openlibrary-60725705782832a2cb22e17c49697948a42a9d03-v298a7a812ceed28c4c18355a091f1b268fe56d86",+ "instance_internetarchive__openlibrary-6e889f4a733c9f8ce9a9bd2ec6a934413adcedb9-ve8c8d62a2b60610a3c4631f5f23ed866bada9818",+ "instance_internetarchive__openlibrary-798055d1a19b8fa0983153b709f460be97e33064-v13642507b4fc1f8d234172bf8129942da2c2ca26",+ "instance_internetarchive__openlibrary-798a582540019363d14b2090755cc7b89a350788-v430f20c722405e462d9ef44dee7d34c41e76fe7a",+ "instance_internetarchive__openlibrary-9c392b60e2c6fa1d68cb68084b4b4ff04d0cb35c-v2d9a6c849c60ed19fd0858ce9e40b7cc8e097e59",+ "instance_internetarchive__openlibrary-9cd47f4dc21e273320d9e30d889c864f8cb20ccf-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4",+ "instance_internetarchive__openlibrary-dbbd9d539c6d4fd45d5be9662aa19b6d664b5137-v08d8e8889ec945ab821fb156c04c7d2e2810debb",+ "instance_internetarchive__openlibrary-e010b2a13697de70170033902ba2e27a1e1acbe9-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4",+ "instance_internetarchive__openlibrary-e8084193a895d8ee81200f49093389a3887479ce-ve8c8d62a2b60610a3c4631f5f23ed866bada9818",+ "instance_internetarchive__openlibrary-f0341c0ba81c790241b782f5103ce5c9a6edf8e3-ve8fc82d8aae8463b752a211156c5b7b59f349237",+ "instance_navidrome__navidrome-1e96b858a91c640fe64e84c5e5ad8cc0954ea38d",+ "instance_navidrome__navidrome-3853c3318f67b41a9e4cb768618315ff77846fdb",+ "instance_navidrome__navidrome-3982ba725883e71d4e3e618c61d5140eeb8d850a",+ "instance_navidrome__navidrome-3bc9e75b2843f91f6a1e9b604e321c2bd4fd442a",+ "instance_navidrome__navidrome-55730514ea59d5f1d0b8e3f8745569c29bdbf7b4",+ "instance_navidrome__navidrome-66b74c81f115c78cb69910b0472eeb376750efc4",+ "instance_navidrome__navidrome-b3980532237e57ab15b2b93c49d5cd5b2d050013",+ "instance_navidrome__navidrome-d613b1930688422122796b43acb3caf2538c8fd1",+ "instance_protonmail__webclients-01ea5214d11e0df8b7170d91bafd34f23cb0f2b1",+ "instance_protonmail__webclients-2f66db85455f4b22a47ffd853738f679b439593c",+ "instance_protonmail__webclients-32ff10999a06455cb2147f6873d627456924ae13",+ "instance_protonmail__webclients-708ed4a299711f0fa79a907cc5847cfd39c0fc71",+ "instance_protonmail__webclients-8be4f6cb9380fcd2e67bcb18cef931ae0d4b869c",+ "instance_protonmail__webclients-c5a2089ca2bfe9aa1d85a664b8ad87ef843a1c9c",+ "instance_protonmail__webclients-d8ff92b414775565f496b830c9eb6cc5fa9620e6",+ "instance_protonmail__webclients-e7f3f20c8ad86089967498632ace73c1157a9d51",+ "instance_protonmail__webclients-e9677f6c46d5ea7d277a4532a4bf90074f125f31",+ "instance_qutebrowser__qutebrowser-0833b5f6f140d04200ec91605f88704dd18e2970-v059c6fdc75567943479b23ebca7c07b5e9a7f34c",+ "instance_qutebrowser__qutebrowser-0d2afd58f3d0e34af21cee7d8a3fc9d855594e9f-vnan",+ "instance_qutebrowser__qutebrowser-305e7c96d5e2fdb3b248b27dfb21042fb2b7e0b8-v2ef375ac784985212b1805e1d0431dc8f1b3c171",+ "instance_qutebrowser__qutebrowser-3e21c8214a998cb1058defd15aabb24617a76402-v5fc38aaf22415ab0b70567368332beee7955b367",+ "instance_qutebrowser__qutebrowser-44e64199ed38003253f0296badd4a447645067b6-v2ef375ac784985212b1805e1d0431dc8f1b3c171",+ "instance_qutebrowser__qutebrowser-50efac08f623644a85441bbe02ab9347d2b71a9d-v9f8e9d96c85c85a605e382f1510bd08563afc566",+ "instance_qutebrowser__qutebrowser-9b71c1ea67a9e7eb70dd83214d881c2031db6541-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d",+ "instance_qutebrowser__qutebrowser-c0be28ebee3e1837aaf3f30ec534ccd6d038f129-v9f8e9d96c85c85a605e382f1510bd08563afc566",+ "instance_qutebrowser__qutebrowser-e15d26630934d0b6415ed2295ac42fd570a57620-va0fd88aac89cde702ec1ba84877234da33adce8a",+ "instance_qutebrowser__qutebrowser-e57b6e0eeeb656eb2c84d6547d5a0a7333ecee85-v2ef375ac784985212b1805e1d0431dc8f1b3c171",+ "instance_qutebrowser__qutebrowser-ed19d7f58b2664bb310c7cb6b52c5b9a06ea60b2-v059c6fdc75567943479b23ebca7c07b5e9a7f34c",+ "instance_qutebrowser__qutebrowser-f91ace96223cac8161c16dd061907e138fe85111-v059c6fdc75567943479b23ebca7c07b5e9a7f34c",+ "instance_tutao__tutanota-f3ffe17af6e8ab007e8d461355057ad237846d9d-vbc0d9ba8f0071fbe982809910959a6ff8884dbbf"+ ]+}diff --git a/bench/swe-bench-pro/sample.py b/bench/swe-bench-pro/sample.pynew file mode 100644index 0000000..be49390--- /dev/null+++ b/bench/swe-bench-pro/sample.py@@ -0,0 +1,63 @@+#!/usr/bin/env python3+"""The answer-run sample: 100 SWE-bench Pro tasks, stratified by repository.++usage: sample.py --tasks tasks.jsonl --out sample.json [--n 100] [--seed 20261027]++- Population: the tasks with at least one gold file (data.py).+- Allocation: proportional to each repository's share of the population, by largest remainder (ties+ broken by repository name), with at least one task per repository (allocate()).+- Draw: for the i-th repository in name order, random.Random(seed + i).sample(its task ids in sorted+ order, k).+"""+import argparse+import json+import random+++def allocate(counts, n):+ """Largest remainder: each repository gets the whole part of its quota, the remaining places go to the+ largest fractional parts (ties by name); then a repository left with none takes one from the largest+ allocation (ties by name)."""+ total = sum(counts.values())+ quota = {r: n * c / total for r, c in counts.items()}+ alloc = {r: int(q) for r, q in quota.items()}+ left = n - sum(alloc.values())+ for r in sorted(counts, key=lambda r: (-(quota[r] - int(quota[r])), r))[:left]:+ alloc[r] += 1+ for r in sorted(counts):+ if alloc[r] == 0:+ big = min(alloc, key=lambda k: (-alloc[k], k))+ alloc[big] -= 1+ alloc[r] = 1+ return alloc+++def main():+ ap = argparse.ArgumentParser()+ ap.add_argument("--tasks", required=True)+ ap.add_argument("--out", required=True)+ ap.add_argument("--n", type=int, default=100)+ ap.add_argument("--seed", type=int, default=20261027)+ a = ap.parse_args()+ tasks = [json.loads(l) for l in open(a.tasks) if l.strip()]+ by_repo = {}+ for t in tasks:+ if t["gold"]:+ by_repo.setdefault(t["repo"], []).append(t["instance_id"])+ counts = {r: len(v) for r, v in by_repo.items()}+ alloc = allocate(counts, a.n)+ ids = []+ for i, r in enumerate(sorted(by_repo)):+ ids += random.Random(a.seed + i).sample(sorted(by_repo[r]), alloc[r])+ out = {"seed": a.seed, "n": len(ids), "population": sum(counts.values()),+ "excluded_no_gold": sum(1 for t in tasks if not t["gold"]),+ "allocation": {r: alloc[r] for r in sorted(alloc)}, "population_by_repo": dict(sorted(counts.items())),+ "ids": sorted(ids)}+ with open(a.out, "w") as f:+ json.dump(out, f, indent=1)+ f.write("\n")+ print(json.dumps({k: out[k] for k in ("seed", "n", "population", "excluded_no_gold", "allocation")}))+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/tasks.jsonl b/bench/swe-bench-pro/tasks.jsonlnew file mode 100644index 0000000..4fb081e--- /dev/null+++ b/bench/swe-bench-pro/tasks.jsonl@@ -0,0 +1,642 @@+{"added": [], "base_commit": "ae3fa85f40db0dca83d19dda1afb96064dffcc83", "gold": ["src/controllers/admin/cache.js", "src/meta/index.js", "src/posts/cache.js", "src/posts/parse.js", "src/socket.io/admin/cache.js", "src/socket.io/admin/plugins.js", "src/user/index.js", "src/webserver.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-00c70ce7b0541cfc94afe567921d7668cdc8f4ac-vnan", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "435ecee6577dfea3b9baa11aa0f498396535f84818474126715f5b54a793d8eb"}+{"added": [], "base_commit": "1e137b07052bc3ea0da44ed201702c94055b8ad2", "gold": ["public/language/en-GB/admin/manage/users.json", "public/language/en-GB/error.json", "public/openapi/components/schemas/UserObject.yaml", "src/controllers/admin/users.js", "src/database/mongo/main.js", "src/database/postgres/main.js", "src/database/redis/main.js", "src/socket.io/admin/user.js", "src/user/delete.js", "src/user/email.js", "src/views/admin/manage/users.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-04998908ba6721d64eba79ae3b65a351dcfbc5b5-vnan", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "2bbc8f9dbffee5705b961bb7a00fee9d0fa51a7d4e9c2fa76fd8e1919c2ea629"}+{"added": [], "base_commit": "c5ae8a70e1b0305af324ad7b1b0911d4023f1338", "gold": ["src/topics/sorted.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-05f2236193f407cf8e2072757fbd6bb170bc13f0-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "9cfea0b03759db7a33bbcd4eef3fdaa372158da5a261381a5ed140c814de1830"}+{"added": [], "base_commit": "50517020a28f11a8748e4de66a646e82bb3050e7", "gold": ["src/middleware/header.js", "src/user/email.js", "src/user/profile.js", "src/user/reset.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-087e6020e490b4a1759f38c1ad03869511928263-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "9e9f800367d257e44de172a93b51598b82203f2136c573a2590f9f7b4fc34c24"}+{"added": [], "base_commit": "03a98f4de484f16d038892a0a9d2317a45e79df1", "gold": ["src/posts/queue.js", "src/socket.io/posts.js", "src/topics/merge.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-0c81642997ea1d827dbd02c311db9d4976112cd4-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "efaecbda6bd2b6df1d526a378b9b9ad96fc7d53d868a5c08de12302ea2a4a259"}+{"added": [], "base_commit": "bbaaead09c5e3c852d243b113724d2048e1c175a", "gold": ["install/data/defaults.json", "public/language/en-GB/admin/settings/tags.json", "public/language/en-GB/error.json", "src/posts/edit.js", "src/posts/queue.js", "src/socket.io/topics/tags.js", "src/topics/create.js", "src/topics/tags.js", "src/views/admin/settings/tags.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-0e07f3c9bace416cbab078a30eae972868c0a8a3-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "17c258afe44fc78bfbcd75168c88f1ff48a0256f10bd6b25cf92c7c8d5edf7c8"}+{"added": [], "base_commit": "606808760edd7f0bf73715ae71a3d365a9c6ae95", "gold": ["src/topics/delete.js", "src/topics/thumbs.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-0f788b8eaa4bba3c142d171fd941d015c53b65fc-v0ec6d6c2baf3cb4797482ce4829bc25cd5716649", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "c8b327560c3f78b61cadff4763f0d28025f00d4239f86cb1bb93847442c39dfa"}+{"added": [], "base_commit": "bbaf26cedc3462ef928906dc90db5cb98a3ec22e", "gold": ["public/language/en-GB/error.json", "src/controllers/write/topics.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-1ea9481af6125ffd6da0592ed439aa62af0bca11-vd59a5728dfc977f44533186ace531248c2917516", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "25d19db8c1f559e1df7ca097efa5ee02e61d376eae4c94261b4b23fe34ef52b6"}+{"added": [], "base_commit": "3ecbb624d892b9fce078304cf89c0fe94f8ab3be", "gold": ["public/src/client/category/tools.js", "src/socket.io/topics/tools.js", "src/topics/tools.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-2657804c1fb6b84dc76ad3b18ecf061aaab5f29f-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "c355436c28c56ef97f782cc86022c41fce2f28dbef67534ff1e36c179280b89f"}+{"added": [], "base_commit": "7f48edc02aa68c547d96ad7d6432ff8c1e359742", "gold": ["src/database/mongo/list.js", "src/database/postgres/list.js", "src/database/redis/list.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-397835a05a8e2897324e566b41c5e616e172b4af-v89631a1cdb318276acb48860c5d78077211397c6", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "1ca36144b4536c96273ddbcece671f152bf5449020dcdefdfb636fb801c4233b"}+{"added": [], "base_commit": "b94bb1bf93390e5204551bfc647049c6f8c5a60d", "gold": ["install/data/defaults.json", "public/language/en-GB/admin/settings/advanced.json", "src/controllers/admin/settings.js", "src/groups/update.js", "src/middleware/maintenance.js", "src/routes/admin.js", "src/views/admin/settings/advanced.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-3c85b944e30a0ba8b3ec9e1f441c74f383625a15-v4fbcfae8b15e4ce5d132c408bca69ebb9cf146ed", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "add4591b38f15f70bf7b8c4321a3a42a5e4f15677928dd10d93285d852827e6b"}+{"added": [], "base_commit": "754965b572f33bfd864e98e4805e1182c1960080", "gold": ["src/categories/data.js", "src/database/mongo/hash.js", "src/database/postgres/hash.js", "src/database/redis/hash.js", "src/groups/data.js", "src/messaging/data.js", "src/posts/data.js", "src/topics/data.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-4327a09d76f10a79109da9d91c22120428d3bdb9-vnan", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "10ce9abc2da30d28b1d17debe04e78b5f2186c6b1f6d1b86b583e9d41f3b3dc4"}+{"added": [], "base_commit": "565ca3cc3b78d6e5177b7834d496927b96b6c88c", "gold": ["src/api/chats.js", "src/api/users.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-445b70deda20201b7d9a68f7224da751b3db728c-v4fbcfae8b15e4ce5d132c408bca69ebb9cf146ed", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "49328019c5c2efdf3cdba7063b61432d2c2b247f99dbd1ca10b5d1470196ddf0"}+{"added": ["src/upgrades/1.19.3/rename_post_upload_hashes.js"], "base_commit": "84dfda59e6a0e8a77240f939a7cb8757e6eaf945", "gold": ["src/controllers/uploads.js", "src/posts/uploads.js", "src/topics/thumbs.js", "src/user/uploads.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-6489e9fd9ed16ea743cc5627f4d86c72fbdb3a8a-v2c59007b1005cd5cd14cbb523ca5229db1fd2dd8", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "fbdc008f63b2f85af6fa0aa62694c33c27ed79b1679866cee2d24b328aee8323"}+{"added": [], "base_commit": "d9c42c000cd6c624794722fd55a741aff9d18823", "gold": ["src/database/mongo/sorted.js", "src/database/postgres/sorted.js", "src/database/redis/sorted.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-6ea3b51f128dd270281db576a1b59270d5e45db0-vnan", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "1bee388fcd6e2dfe98770b7f5cbf183f929312861f94237ea2816f6d0630da87"}+{"added": [], "base_commit": "6bbe3d1c4cefe56f81629dfa3343fd0a875d9cf1", "gold": ["src/controllers/accounts/helpers.js", "src/database/mongo/sorted.js", "src/database/postgres/sorted.js", "src/database/redis/sorted.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-70b4a0e2aebebe8f2f559de6680093d96a697b2f-vnan", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "5d93f121da0b5eeba5db6679265fe7cc0ddc07f7023bcc1a99131ff0402f6488"}+{"added": [], "base_commit": "a2ebf53b6098635c3abcab3fd9144c766e32b350", "gold": ["src/database/mongo/hash.js", "src/database/postgres/hash.js", "src/database/redis/hash.js", "src/notifications.js", "src/plugins/hooks.js", "src/posts/delete.js", "src/topics/delete.js", "src/user/delete.js", "src/user/posts.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-767973717be700f46f06f3e7f4fc550c63509046-vnan", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "a68001ef2a5ef6ca2d3dd9dca66703e47bd5d77a133f58d442ef1dae4103937e"}+{"added": [], "base_commit": "a3e1a666b876e0b3ccbb5284dd826c8c90c113b4", "gold": ["install/data/defaults.json", "install/package.json", "public/language/ar/admin/settings/reputation.json", "public/language/ar/error.json", "public/language/bg/admin/settings/reputation.json", "public/language/bg/error.json", "public/language/bn/admin/settings/reputation.json", "public/language/bn/error.json", "public/language/cs/admin/settings/reputation.json", "public/language/cs/error.json", "public/language/da/admin/settings/reputation.json", "public/language/da/error.json", "public/language/de/admin/settings/reputation.json", "public/language/de/error.json", "public/language/el/admin/settings/reputation.json", "public/language/el/error.json", "public/language/en-GB/admin/settings/reputation.json", "public/language/en-GB/error.json", "public/language/en-US/admin/settings/reputation.json", "public/language/en-US/error.json", "public/language/en-x-pirate/admin/settings/reputation.json", "public/language/en-x-pirate/error.json", "public/language/es/admin/settings/reputation.json", "public/language/es/error.json", "public/language/et/admin/settings/reputation.json", "public/language/et/error.json", "public/language/fa-IR/admin/settings/reputation.json", "public/language/fa-IR/error.json", "public/language/fi/admin/settings/reputation.json", "public/language/fi/error.json", "public/language/fr/admin/settings/reputation.json", "public/language/fr/error.json", "public/language/gl/admin/settings/reputation.json", "public/language/gl/error.json", "public/language/he/admin/settings/reputation.json", "public/language/he/error.json", "public/language/hr/admin/settings/reputation.json", "public/language/hr/error.json", "public/language/hu/admin/settings/reputation.json", "public/language/hu/error.json", "public/language/hy/admin/settings/reputation.json", "public/language/hy/error.json", "public/language/id/admin/settings/reputation.json", "public/language/id/error.json", "public/language/it/admin/settings/reputation.json", "public/language/it/error.json", "public/language/ja/admin/settings/reputation.json", "public/language/ja/error.json", "public/language/ko/admin/settings/reputation.json", "public/language/ko/error.json", "public/language/lt/admin/settings/reputation.json", "public/language/lt/error.json", "public/language/lv/admin/settings/reputation.json", "public/language/lv/error.json", "public/language/ms/admin/settings/reputation.json", "public/language/ms/error.json", "public/language/nb/admin/settings/reputation.json", "public/language/nb/category.json", "public/language/nb/error.json", "public/language/nb/global.json", "public/language/nb/modules.json", "public/language/nb/user.json", "public/language/nl/admin/settings/reputation.json", "public/language/nl/error.json", "public/language/pl/admin/settings/reputation.json", "public/language/pl/error.json", "public/language/pt-BR/admin/settings/reputation.json", "public/language/pt-BR/error.json", "public/language/pt-PT/admin/settings/reputation.json", "public/language/pt-PT/error.json", "public/language/ro/admin/settings/reputation.json", "public/language/ro/error.json", "public/language/ru/admin/settings/reputation.json", "public/language/ru/error.json", "public/language/rw/admin/settings/reputation.json", "public/language/rw/error.json", "public/language/sc/admin/settings/reputation.json", "public/language/sc/error.json", "public/language/sk/admin/settings/reputation.json", "public/language/sk/error.json", "public/language/sl/admin/settings/reputation.json", "public/language/sl/error.json", "public/language/sq-AL/admin/settings/reputation.json", "public/language/sq-AL/error.json", "public/language/sr/admin/settings/reputation.json", "public/language/sr/error.json", "public/language/sv/admin/settings/reputation.json", "public/language/sv/error.json", "public/language/th/admin/settings/reputation.json", "public/language/th/error.json", "public/language/tr/admin/admin.json", "public/language/tr/admin/settings/reputation.json", "public/language/tr/error.json", "public/language/uk/admin/settings/reputation.json", "public/language/uk/error.json", "public/language/vi/admin/settings/reputation.json", "public/language/vi/error.json", "public/language/zh-CN/admin/settings/reputation.json", "public/language/zh-CN/error.json", "public/language/zh-TW/admin/settings/reputation.json", "public/language/zh-TW/error.json", "public/src/client/topic.js", "src/flags.js", "src/plugins/install.js", "src/views/admin/settings/reputation.tpl", "src/views/partials/data/topic.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-76c6e30282906ac664f2c9278fc90999b27b1f48-vd59a5728dfc977f44533186ace531248c2917516", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "c60566dba570d05bceee32e6ae524302083d850f72ecf7014d452cba36ef1fc1"}+{"added": [], "base_commit": "e0149462b3f4e7c843d89701ad9edd2e744d7593", "gold": ["src/api/utils.js", "src/controllers/admin/settings.js", "src/middleware/index.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-7b8bffd763e2155cf88f3ebc258fa68ebe18188d-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "3290907311e81555937a387a1b833bdbdc7c2b59b0dd6cf9e365855181ab2c1e"}+{"added": [], "base_commit": "ab5e2a416324ec56cea44b79067ba798f8394de1", "gold": ["src/groups/cover.js", "src/socket.io/user/picture.js", "src/socket.io/user/profile.js", "src/user/delete.js", "src/user/picture.js"], "hard": true, "instance_id": "instance_NodeBB__NodeBB-8168c6c40707478f71b8af60300830fe554c778c-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "c9d2c0653de86c913b5b334822f10e9b71c653c659912ce33d9e2b3f8d3cedfe"}+{"added": [], "base_commit": "779c73eadea5d4246a60ab60486d5e49164884db", "gold": ["public/src/client/topic/votes.js", "src/socket.io/posts/votes.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-82562bec444940608052f3e4149e0c61ec80bf3f-vd59a5728dfc977f44533186ace531248c2917516", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "b53b34e71f45903c925c9e3cb5e844784941fe6052c0f41879f3d528b5affa71"}+{"added": [], "base_commit": "aad0c5fd5138a31dfd766d2e6808a35b7dfb4a74", "gold": ["public/language/en-GB/admin/settings/uploads.json", "src/posts/uploads.js", "src/views/admin/settings/uploads.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-84dfda59e6a0e8a77240f939a7cb8757e6eaf945-v2c59007b1005cd5cd14cbb523ca5229db1fd2dd8", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "410cca7df2421ca0e6fd9284b8f17370339a213a9ca58b2e5d5733d1c5774a6f"}+{"added": [], "base_commit": "50e1a1a7ca1d95cbf82187ff685bea8cf3966cd0", "gold": ["public/language/en-GB/error.json", "src/posts/edit.js", "src/socket.io/topics/tags.js", "src/topics/tags.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-84e065752f6d7fbe5c08cbf50cb173ffb866b8fa-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "d34eb13df4e08e6d4257ff03972deef2bb1e8f59d78b423a8d2170f5a03a4937"}+{"added": [], "base_commit": "f2c0c18879ffdeea8d643ffa05a188e43f14afee", "gold": ["public/src/modules/uploader.js", "src/controllers/admin/uploads.js", "src/views/modals/upload-file.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-8ca65b0c78c67c1653487c02d1135e1b702185e1-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "f2495273e77ce87b98242f91da0381fc4d26030627e0be926cfd32857a5a2dc7"}+{"added": [], "base_commit": "d9e2190a6b4b6bef2d8d2558524dd124be33760f", "gold": ["src/controllers/write/users.js", "src/user/data.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-97c8569a798075c50e93e585ac741ab55cb7c28b-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "e8a10105c6936486ec8b8701b5bb7a1b7daa730bafa4e5df0dea0acacb8c474b"}+{"added": [], "base_commit": "09f3ac6574b3192497df0403306aff8d6f20448b", "gold": ["install/data/defaults.json", "public/language/en-GB/admin/settings/email.json", "public/src/modules/messages.js", "src/socket.io/user.js", "src/user/email.js", "src/user/interstitials.js", "src/views/admin/settings/email.tpl", "src/views/admin/settings/user.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-9c576a0758690f45a6ca03b5884c601e473bf2c1-vd59a5728dfc977f44533186ace531248c2917516", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "0bbc2ae970cd2fb46a3a2b657ef1ae23f3fda511b3406b38adf58d0cb8b3a85c"}+{"added": ["src/upgrades/4.3.0/chat_allow_list.js"], "base_commit": "7800016f2f1b89d2d3cfea6a7da7c77096b7b927", "gold": ["install/package.json", "public/language/el/error.json", "public/language/en-GB/admin/settings/user.json", "public/language/en-GB/user.json", "public/openapi/components/schemas/SettingsObj.yaml", "public/src/client/account/settings.js", "public/src/modules/autocomplete.js", "src/controllers/accounts/settings.js", "src/messaging/index.js", "src/user/settings.js", "src/views/admin/settings/user.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-a5afad27e52fd336163063ba40dcadc80233ae10-vd59a5728dfc977f44533186ace531248c2917516", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "8041d9a5018f898e2b9a18dae0e9f8d71e6eb5746718dbb95a34ca6bfe8d13ac"}+{"added": [], "base_commit": "6ecc791db9bfbb2a22e113e4630071da87ce3c1e", "gold": ["public/openapi/read/topic/topic_id.yaml", "public/src/client/topic/votes.js", "src/controllers/accounts/helpers.js", "src/controllers/topics.js", "src/database/mongo/sorted.js", "src/database/postgres/sorted.js", "src/database/redis/sorted.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-b1f9ad5534bb3a44dab5364f659876a4b7fe34c1-vnan", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "9fbdbca39eb43acab556ee7e804f664aee3035f44a8b480ef802aaad7aa7df47"}+{"added": [], "base_commit": "47910d708d8d6c18fdc3e57a0933b6d2a1d881bd", "gold": ["public/language/en-GB/admin/manage/privileges.json", "public/openapi/components/schemas/UserObject.yaml", "src/api/chats.js", "src/controllers/accounts/chats.js", "src/controllers/accounts/helpers.js", "src/messaging/edit.js", "src/messaging/index.js", "src/messaging/rooms.js", "src/middleware/headers.js", "src/middleware/user.js", "src/privileges/global.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-b398321a5eb913666f903a794219833926881a8f-vd59a5728dfc977f44533186ace531248c2917516", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "15d1baec2ea74cc34c2cb32e0b1b42a736abb0ec3303bd71b137ce74235e6b1a"}+{"added": [], "base_commit": "be86d8efc7fb019e707754b8b64dd6cf3517e8c7", "gold": ["src/meta/index.js", "src/user/index.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-bad15643013ca15affe408b75eba9e47cc604bb2-vd59a5728dfc977f44533186ace531248c2917516", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "93d12c4c47ffab6225dab5c4a84b9338b339a56879f93fcf7a8c4742a33a4436"}+{"added": [], "base_commit": "88e891fcc66d79c3fbc19379c12dc6225630251e", "gold": ["CHANGELOG.md", "install/package.json", "src/controllers/index.js", "src/middleware/user.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-bd80d36e0dcf78cd4360791a82966078b3a07712-v4fbcfae8b15e4ce5d132c408bca69ebb9cf146ed", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "49742e740347c8fcb0c6ffebe8172b0621999b0e4ead571518dc639c440ad3bf"}+{"added": [], "base_commit": "f24b630e1afcb8135144be66d67a09a61b21753e", "gold": ["install/data/defaults.json", "public/language/en-GB/admin/settings/post.json", "public/language/en-GB/topic.json", "public/src/modules/helpers.js", "src/posts/edit.js", "src/topics/create.js", "src/topics/events.js", "src/topics/posts.js", "src/views/admin/settings/post.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-be43cd25974681c9743d424238b7536c357dc8d3-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "1e66b90efb31e3f2fbee78afd92a619e82facdfa9cef8ad66dc29eb24f0ba628"}+{"added": [], "base_commit": "f8cfe64c7e5243ac394695293d7517b0b509a4b3", "gold": ["src/controllers/activitypub/actors.js", "src/controllers/well-known.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-da0211b1a001d45d73b4c84c6417a4f1b0312575-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "c8ffd8cd0fb5bea5d39c398275f8d0c5805f9fc870800374cb296d5676ea6c11"}+{"added": [], "base_commit": "163c977d2f4891fa7c4372b9f6a686b1fa34350f", "gold": ["src/database/mongo/sorted.js", "src/database/postgres.js", "src/database/postgres/sorted.js", "src/database/redis/sorted.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-f083cd559d69c16481376868c8da65172729c0ca-vnan", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "f86734d5c5dad36731a36cca2ccc6aa45e01b0cd708fe9c686a0b78fc50c59e4"}+{"added": [], "base_commit": "c1f873b302b47548a508c7fcc403942db43ea690", "gold": ["public/openapi/read/admin/manage/privileges/cid.yaml", "public/openapi/write/categories/cid/moderator/uid.yaml", "public/openapi/write/categories/cid/privileges.yaml", "public/openapi/write/categories/cid/privileges/privilege.yaml", "public/src/admin/manage/privileges.js", "public/src/modules/helpers.common.js", "src/categories/create.js", "src/plugins/hooks.js", "src/privileges/admin.js", "src/privileges/categories.js", "src/privileges/global.js", "src/privileges/helpers.js", "src/views/admin/partials/privileges/category.tpl", "src/views/admin/partials/privileges/global.tpl"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-f1a80d48cc45877fcbadf34c2345dd9709722c7f-v4fbcfae8b15e4ce5d132c408bca69ebb9cf146ed", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "83e34388598b240907b58c7455e33b5333b49f09e91973f10be889c484b327e1"}+{"added": [], "base_commit": "f0d989e4ba5b0dccff6e56022fc6d378d05ab404", "gold": ["public/src/client/topic.js", "public/src/client/topic/postTools.js", "src/api/posts.js", "src/controllers/write/posts.js", "src/routes/write/posts.js", "src/socket.io/posts.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-f2082d7de85eb62a70819f4f3396dd85626a0c0a-vd59a5728dfc977f44533186ace531248c2917516", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "a0ed21771867f872ed711770fd7e827cc05ecb4f235ac799ea71a1273053ff2e"}+{"added": [], "base_commit": "140f9d2481f7a97941593eb6c158013deeb0c0d4", "gold": ["public/language/en-GB/error.json", "public/src/client/chats/messages.js", "src/controllers/write/chats.js", "src/messaging/edit.js", "src/messaging/index.js", "src/routes/write/chats.js", "src/socket.io/modules.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-f48ed3658aab7be0f1165d4c1f89af48d7865189-v0495b863a912fbff5749c67e860612b91825407c", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "376ec73bca49cdf71df3df3656fea7177591ed3cf8963a56d3254edb2a2faebe"}+{"added": [], "base_commit": "61d17c95e573f91ab5c65d25218451e9afd07d77", "gold": ["src/controllers/admin/uploads.js"], "hard": false, "instance_id": "instance_NodeBB__NodeBB-f9ce92df988db7c1ae55d9ef96d247d27478bc70-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e", "language": "js", "names_gold_path": false, "repo": "NodeBB/NodeBB", "text_sha256": "39f924a56739359535aa536c17cd6b61c6b3ba9001c65437348b17d63284b7ac"}+{"added": ["changelogs/fragments/81659_varswithsources.yml"], "base_commit": "f7234968d241d7171aadb1e873a67510753f3163", "gold": ["lib/ansible/utils/vars.py", "lib/ansible/vars/manager.py"], "hard": false, "instance_id": "instance_ansible__ansible-0ea40e09d1b35bcb69ff4d9cecf3d0defa4b36e8-v30a923fb5c164d6cd18280c02422f75e611e8fb2", "language": "python", "names_gold_path": true, "repo": "ansible/ansible", "text_sha256": "53648f4ef06635e1ef7b4e0e020a260f699457054a687f4877239dfc0addc294"}+{"added": [], "base_commit": "016b7f71b10539c90ddbb3246f19f9cbf0e65428", "gold": ["lib/ansible/plugins/lookup/password.py", "lib/ansible/utils/encrypt.py"], "hard": false, "instance_id": "instance_ansible__ansible-0fd88717c953b92ed8a50495d55e630eb5d59166-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "6ddb84c75ee280003a7717965b9003e39284b61e423a172cdb56bab98649f175"}+{"added": ["changelogs/fragments/feature-uri-add-option-multipart-encoding.yml"], "base_commit": "3fffddc18305f4d910774b57bc90e14456e7a15b", "gold": ["lib/ansible/module_utils/urls.py", "lib/ansible/modules/uri.py"], "hard": false, "instance_id": "instance_ansible__ansible-106909db8b730480615f4a33de0eb5b710944e78-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "b4a6e1fb2b39c781d4ec5f66e273ea2bab7a63eeadc947334ef6a0000dcfd66f"}+{"added": [], "base_commit": "e1daaae42af1a4e465edbdad4bb3c6dd7e7110d5", "gold": ["lib/ansible/module_utils/facts/network/linux.py"], "hard": false, "instance_id": "instance_ansible__ansible-11c1777d56664b1acb56b387a1ad6aeadef1391d-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "e8810f2318a98939cabe05677176f7e186a2a3d064a253a5af3b5a28bbfc7f9c"}+{"added": ["changelogs/fragments/75072_undefined_yaml.yml"], "base_commit": "de01db08d00c8d2438e1ba5989c313ba16a145b0", "gold": ["lib/ansible/parsing/yaml/dumper.py", "lib/ansible/plugins/filter/core.py"], "hard": false, "instance_id": "instance_ansible__ansible-12734fa21c08a0ce8c84e533abdc560db2eb1955-v7eee2454f617569fd6889f2211f75bc02a35f9f8", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "b553921e65980c8c29c47b16e14dddc3e8bb0db6c7d5f6584158967817996b32"}+{"added": [], "base_commit": "e80f8048ee027ab0c7c8b5912fb6c69c44fb877a", "gold": ["lib/ansible/executor/task_executor.py", "lib/ansible/template/__init__.py", "lib/ansible/utils/unsafe_proxy.py"], "hard": false, "instance_id": "instance_ansible__ansible-164881d871964aa64e0f911d03ae270acbad253c-v390e508d27db7a51eece36bb6d9698b63a5b638a", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "742dea49fcbea2882b3f68295986368da5c1d267a9fb329fffcf087bfc95d5a5"}+{"added": ["changelogs/fragments/73814-host_label.yaml"], "base_commit": "a7c8093ce49145966c3af21e40fad9ee8912d297", "gold": ["lib/ansible/plugins/callback/__init__.py", "lib/ansible/plugins/callback/default.py"], "hard": false, "instance_id": "instance_ansible__ansible-185d41031660a676c43fbb781cd1335902024bfe-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "1d4bdb5ceb8bb3102171290d88f72ee9abff6e3f1dbd50b94013ceb3f79ba500"}+{"added": ["lib/ansible/modules/net_tools/nios/nios_fixed_address.py"], "base_commit": "bc6cd138740bd927b5c52c3b9c18c7812179835e", "gold": ["lib/ansible/module_utils/net_tools/nios/api.py"], "hard": false, "instance_id": "instance_ansible__ansible-189fcb37f973f0b1d52b555728208eeb9a6fce83-v906c969b551b346ef54a2c0b41e04f632b7b73c2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "221ff429dd0e260e9bc248179d871d03b951713ccc9eb29ce39e047239191727"}+{"added": ["changelogs/fragments/blowfish_ident.yml"], "base_commit": "20ef733ee02ba688757998404c1926381356b031", "gold": ["docs/docsite/rst/user_guide/playbooks_filters.rst", "lib/ansible/plugins/filter/core.py", "lib/ansible/plugins/lookup/password.py", "lib/ansible/utils/encrypt.py"], "hard": false, "instance_id": "instance_ansible__ansible-1bd7dcf339dd8b6c50bc16670be2448a206f4fdb-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "d9cc95aeccc46616ec4ebee948f447016ad4148288feb30ae8b179626c4b9044"}+{"added": [], "base_commit": "6198c7377f545207218fe8eb2e3cfa9673ff8f5e", "gold": ["lib/ansible/_internal/_yaml/_constructor.py", "lib/ansible/_internal/_yaml/_dumper.py", "lib/ansible/module_utils/_internal/__init__.py", "lib/ansible/plugins/filter/core.py"], "hard": false, "instance_id": "instance_ansible__ansible-1c06c46cc14324df35ac4f39a45fb3ccd602195d-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "9ae11047271940d37ee9dbd4740d829890cba8a01f18978587bcd27a2191ee17"}+{"added": [], "base_commit": "9281148b623d4e2e8302778d91af3e84ab9579a9", "gold": ["lib/ansible/utils/vars.py"], "hard": false, "instance_id": "instance_ansible__ansible-1ee70fc272aff6bf3415357c6e13c5de5b928d9b-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "9a81305f28d0e14587f7efcbbf612d119901903f4f117667d2e0743fa9131ff6"}+{"added": ["changelogs/fragments/74005-keyed_groups-specific-options-for-empty-value.yml"], "base_commit": "270f109bb3af5c2498725b384f77ddc26da2fb73", "gold": ["lib/ansible/plugins/doc_fragments/constructed.py", "lib/ansible/plugins/inventory/__init__.py"], "hard": false, "instance_id": "instance_ansible__ansible-29aea9ff3466e4cd2ed00524b9e56738d568ce8b-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "925dd23599c57fb1f27ded331fee277e1886f642cd2773dff4adb9bac56c33fb"}+{"added": ["changelogs/fragments/66569-introduce-fact-ansible_processor_nproc.yml"], "base_commit": "d63a71e3f83fc23defb97393367859634881b8da", "gold": ["docs/docsite/rst/porting_guides/porting_guide_2.10.rst", "docs/docsite/rst/user_guide/playbooks_variables.rst", "lib/ansible/module_utils/facts/hardware/linux.py"], "hard": false, "instance_id": "instance_ansible__ansible-34db57a47f875d11c4068567b9ec7ace174ec4cf-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "9900dc5fecb4ecfbd209ae369c8f714ee76e1f5fe478092cf0da789f745a96c1"}+{"added": ["changelogs/fragments/update-collections-abc-imports.yml"], "base_commit": "e658995760ac1209cb12df97027a2e282b4536ae", "gold": ["lib/ansible/module_utils/basic.py", "lib/ansible/module_utils/common/_collections_compat.py", "lib/ansible/module_utils/common/collections.py", "lib/ansible/module_utils/common/dict_transformations.py", "lib/ansible/module_utils/common/json.py", "lib/ansible/module_utils/common/parameters.py", "lib/ansible/module_utils/common/text/converters.py", "lib/ansible/module_utils/compat/_selectors2.py", "lib/ansible/modules/uri.py", "lib/ansible/plugins/shell/__init__.py"], "hard": false, "instance_id": "instance_ansible__ansible-379058e10f3dbc0fdcaf80394bd09b18927e7d33-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": true, "repo": "ansible/ansible", "text_sha256": "c3cac8406c5fe44e146bb3afe23a5ff9027014344b8b377a2a86d283322d6a4f"}+{"added": ["changelogs/fragments/76378-iptables-chain-management.yml"], "base_commit": "d5a740ddca57ed344d1d023383d4aff563657424", "gold": ["lib/ansible/modules/iptables.py"], "hard": false, "instance_id": "instance_ansible__ansible-3889ddeb4b780ab4bac9ca2e75f8c1991bcabe83-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "35cad7bf1d7c1dad0072ecaec3554382a89aaaeb697e1447ff7740d62196fa96"}+{"added": ["changelogs/fragments/74511-PlayIterator-states-enums.yml"], "base_commit": "cd64e0b070f8630e1dcc021e594ed42ea7afe304", "gold": ["lib/ansible/executor/play_iterator.py", "lib/ansible/plugins/strategy/__init__.py", "lib/ansible/plugins/strategy/linear.py"], "hard": false, "instance_id": "instance_ansible__ansible-395e5e20fab9cad517243372fa3c3c5d9e09ab2a-v7eee2454f617569fd6889f2211f75bc02a35f9f8", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "7d53d3989caa940bf7700a90d2803918ffe2528555f5dcc5582c697c2623f3e5"}+{"added": ["changelogs/fragments/async_wrapper_reporting.yml"], "base_commit": "8502c2302871e35e59fb7092b4b01b937c934031", "gold": ["lib/ansible/modules/async_wrapper.py"], "hard": false, "instance_id": "instance_ansible__ansible-39bd8b99ec8c6624207bf3556ac7f9626dad9173-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "7b0bd7a971035a54a1d2bcb511f40c4858bb4f6c5800117ff96a7eb0fc8666dd"}+{"added": ["changelogs/fragments/81995-enable_file_cache.yml"], "base_commit": "92df66480613d0f3c1f11ab27146e3162d2a5bd5", "gold": ["lib/ansible/parsing/dataloader.py", "lib/ansible/plugins/inventory/__init__.py", "lib/ansible/plugins/inventory/auto.py", "lib/ansible/plugins/inventory/yaml.py", "lib/ansible/plugins/vars/host_group_vars.py", "lib/ansible/vars/manager.py"], "hard": false, "instance_id": "instance_ansible__ansible-3b823d908e8a5d17674f8c26d337d3114b7493b1-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "7730f2d82b6cc920d2be1fc57aad1d7d7a2afa9c8dead85c5d660b153d075999"}+{"added": ["changelogs/fragments/50909-min-max-attrs.yml"], "base_commit": "709484969c8a4ffd74b839a673431a8c5caa6457", "gold": ["docs/docsite/rst/user_guide/playbooks_filters.rst", "lib/ansible/plugins/filter/mathstuff.py"], "hard": false, "instance_id": "instance_ansible__ansible-3db08adbb1cc6aa9941be5e0fc810132c6e1fa4b-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "39db71a78416218183711ecbde0b53feee4002f59fce9d9499497bc1bbb7b15c"}+{"added": ["changelogs/fragments/83508_mount_facts.yml", "lib/ansible/modules/mount_facts.py"], "base_commit": "9ab63986ad528a6ad5bf4c59fe104d5106d6ef9b", "gold": [], "hard": true, "instance_id": "instance_ansible__ansible-40ade1f84b8bb10a63576b0ac320c13f57c87d34-v6382ea168a93d80a64aab1fbd8c4f02dc5ada5bf", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "360dca66dc7859a1df507b98e7b43bd78266d3df37b6de0a3af1ec0c6dc4a2d6"}+{"added": ["changelogs/fragments/parseable_locale.yml", "lib/ansible/module_utils/common/locale.py"], "base_commit": "f05bcf569367904985c0e5796a4c14ce0b7d4be9", "gold": ["lib/ansible/module_utils/basic.py"], "hard": false, "instance_id": "instance_ansible__ansible-415e08c2970757472314e515cb63a51ad825c45e-v7eee2454f617569fd6889f2211f75bc02a35f9f8", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "11e3425ffa1cf2f1847a3fa9e5a080e3804c73792bcb8584fa7df3f56ab2c589"}+{"added": ["changelogs/fragments/no-double-loop-delegate-to-calc.yml"], "base_commit": "fafb23094e77a619066a92a7fa99a7045292e473", "gold": ["lib/ansible/executor/process/worker.py", "lib/ansible/executor/task_executor.py", "lib/ansible/playbook/delegatable.py", "lib/ansible/playbook/task.py", "lib/ansible/vars/manager.py"], "hard": false, "instance_id": "instance_ansible__ansible-42355d181a11b51ebfc56f6f4b3d9c74e01cb13b-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "715578e13f49120d2cb2a61605977807abc86401188c2705af303cc1a5720fd4"}+{"added": ["changelogs/fragments/meraki-rate-limit.yml"], "base_commit": "5ee81338fcf7adbc1a8eda26dd8105a07825cb08", "gold": ["lib/ansible/module_utils/network/meraki/meraki.py", "lib/ansible/plugins/doc_fragments/meraki.py"], "hard": false, "instance_id": "instance_ansible__ansible-489156378c8e97374a75a544c7c9c2c0dd8146d1-v390e508d27db7a51eece36bb6d9698b63a5b638a", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "b162d4d3f9d3be2b405b062e92b6e80208d29e241cc53c3d8b17ad0097988be8"}+{"added": ["changelogs/fragments/67794-atomic_move-default-perms.yml"], "base_commit": "bf98f031f3f5af31a2d78dc2f0a58fe92ebae0bb", "gold": ["docs/docsite/rst/porting_guides/porting_guide_2.11.rst", "lib/ansible/module_utils/basic.py", "lib/ansible/module_utils/common/file.py"], "hard": false, "instance_id": "instance_ansible__ansible-5260527c4a71bfed99d803e687dd19619423b134-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "650550eff1f1a48db93b979ac9b4404fefcb54c8617ac1047a8b059776583bb6"}+{"added": ["changelogs/fragments/73864-action-plugin-module-defaults.yml"], "base_commit": "a5a13246ce02fd4c4ce997627b4f42152e59d288", "gold": ["lib/ansible/executor/module_common.py", "lib/ansible/plugins/action/gather_facts.py", "lib/ansible/plugins/action/package.py", "lib/ansible/plugins/action/service.py"], "hard": false, "instance_id": "instance_ansible__ansible-5640093f1ca63fd6af231cc8a7fb7d40e1907b8c-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "07640eafa44c8507fb9f451087fe7f4f01f7b48a6435ec8e4b5da50ab5fa6045"}+{"added": ["changelogs/fragments/74416-PlayIterator-_host_states-setters.yml"], "base_commit": "d7fbb209b403e782c6e2b7883a106e6dca15b330", "gold": ["lib/ansible/executor/play_iterator.py", "lib/ansible/plugins/strategy/__init__.py"], "hard": false, "instance_id": "instance_ansible__ansible-5c225dc0f5bfa677addeac100a8018df3f3a9db1-v173091e2e36d38c978002990795f66cfc0af30ad", "language": "python", "names_gold_path": true, "repo": "ansible/ansible", "text_sha256": "0e3b46c79d8bc876e88b172ca9f3cbfb7251a273181555c76f767343b86180f8"}+{"added": [], "base_commit": "14e7f05318ddc421330209eece0e891d0eaef10d", "gold": ["lib/ansible/plugins/lookup/password.py"], "hard": false, "instance_id": "instance_ansible__ansible-5d253a13807e884b7ce0b6b57a963a45e2f0322c-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "b924227203e4ac0be195a86c56493a7b5dfef39292ec1aa450a3ee5158b37fb5"}+{"added": ["changelogs/fragments/forked-display-via-queue.yml"], "base_commit": "0fae2383dafba38cdd0f02bcc4da1b89f414bf93", "gold": ["lib/ansible/executor/process/worker.py", "lib/ansible/executor/task_queue_manager.py", "lib/ansible/plugins/strategy/__init__.py", "lib/ansible/utils/display.py"], "hard": false, "instance_id": "instance_ansible__ansible-5e369604e1930b1a2e071fecd7ec5276ebd12cb1-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": true, "repo": "ansible/ansible", "text_sha256": "de400d5a9d2d0378bcadbcac40b2176aeef8223201ff64611fa0ccfc9e9c3068"}+{"added": ["lib/ansible/modules/network/netvisor/pn_user.py"], "base_commit": "5fa2d29c9a06baa8cc5d271c41e23b1f99b3814a", "gold": [], "hard": false, "instance_id": "instance_ansible__ansible-5e88cd9972f10b66dd97e1ee684c910c6a2dd25e-v906c969b551b346ef54a2c0b41e04f632b7b73c2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "98a2883b29520f8dc319d538c1ebfe37cc6b72b96ebc4ac1f643f58ea5f136a5"}+{"added": ["changelogs/fragments/82387-unquote-strings-from-ini-files.yml"], "base_commit": "a870e7d0c6368dbc4c8f1f088f540e8be07223e1", "gold": ["lib/ansible/config/manager.py"], "hard": false, "instance_id": "instance_ansible__ansible-5f4e332e3762999d94af27746db29ff1729252c1-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "b1d73363dc2ff028b797a0046ac12c3675d88ce24efcf61bc913fe6dbc922790"}+{"added": ["lib/ansible/modules/network/icx/icx_ping.py"], "base_commit": "f4502a8f1ce71d88cc90f4b4f6c2899943441ebf", "gold": [], "hard": false, "instance_id": "instance_ansible__ansible-622a493ae03bd5e5cf517d336fc426e9d12208c7-v906c969b551b346ef54a2c0b41e04f632b7b73c2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "04eec3f29d86e66b15254d6e12ae7b1d68373dc5d0ee82dbc0ae005f0ea0e082"}+{"added": [], "base_commit": "e094d48b1bdd93cbc189f416543e810c19b2e561", "gold": ["lib/ansible/_internal/_templating/_jinja_plugins.py", "lib/ansible/cli/__init__.py", "lib/ansible/module_utils/basic.py", "lib/ansible/module_utils/common/warnings.py", "lib/ansible/parsing/yaml/objects.py", "lib/ansible/template/__init__.py", "lib/ansible/utils/display.py"], "hard": false, "instance_id": "instance_ansible__ansible-6cc97447aac5816745278f3735af128afb255c81-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "e11e584d52ff5f1a37e4c0e29f7c88b7822f7989bd62fa1ed838abf6309002d9"}+{"added": ["changelogs/fragments/facts_fixes.yml"], "base_commit": "35809806d3ab5d66fbb9696dc6a0009383e50673", "gold": ["lib/ansible/module_utils/facts/hardware/openbsd.py", "lib/ansible/module_utils/facts/sysctl.py"], "hard": false, "instance_id": "instance_ansible__ansible-709484969c8a4ffd74b839a673431a8c5caa6457-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "ed9d88f9d2b7f203a9e175326098395b8a6e94375705f88b8d97e06d8476f017"}+{"added": ["changelogs/fragments/pkg_mgr-default-dnf.yml"], "base_commit": "68e270d4cc2579e4659ed53aecbc5a3358b85985", "gold": ["lib/ansible/module_utils/facts/system/pkg_mgr.py"], "hard": false, "instance_id": "instance_ansible__ansible-748f534312f2073a25a87871f5bd05882891b8c4-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "a1f7de895643dd9b2460e829e12b3aecf09f19649c6507bda3d12f9b26d27935"}+{"added": [], "base_commit": "db2d5b09eff918e981c9e10787a5f2c500d1784f", "gold": ["lib/ansible/modules/network/nxos/nxos_vrf_af.py"], "hard": false, "instance_id": "instance_ansible__ansible-77658704217d5f166404fc67997203c25381cb6e-v390e508d27db7a51eece36bb6d9698b63a5b638a", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "b5e78ca693e9f5114f749ebef5249da429a954749bb8f117d1fe0b278e73c233"}+{"added": ["lib/ansible/modules/network/icx/icx_linkagg.py"], "base_commit": "20ec92728004bc94729ffc08cbc483b7496c0c1f", "gold": [], "hard": false, "instance_id": "instance_ansible__ansible-7e1a347695c7987ae56ef1b6919156d9254010ad-v390e508d27db7a51eece36bb6d9698b63a5b638a", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "51eae9c0ecc2ced84054dc4ad4b8c9fe27573402f2ff97c21839c7e8712a7019"}+{"added": ["changelogs/fragments/no-inherit-stdio.yml"], "base_commit": "3684b4824d367f866d038c5373f975503580d49e", "gold": ["lib/ansible/executor/process/worker.py", "lib/ansible/executor/task_executor.py", "lib/ansible/executor/task_queue_manager.py", "lib/ansible/plugins/connection/__init__.py", "lib/ansible/plugins/loader.py", "lib/ansible/plugins/strategy/__init__.py"], "hard": false, "instance_id": "instance_ansible__ansible-8127abbc298cabf04aaa89a478fc5e5e3432a6fc-v30a923fb5c164d6cd18280c02422f75e611e8fb2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "6c1a2026576e96dd47daaf1d2e32a1fb5c160488ff18c76414c7cca77de947f9"}+{"added": ["changelogs/fragments/72928_adding_multiport_support.yml"], "base_commit": "0044091a055dd9cd448f7639a65b7e8cc3dacbf1", "gold": ["lib/ansible/modules/iptables.py"], "hard": false, "instance_id": "instance_ansible__ansible-83fb24b923064d3576d473747ebbe62e4535c9e3-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "5a7b19a7914871316b369bbfec4290986b18bbb836d74437c446fba7b44743ca"}+{"added": ["changelogs/fragments/restore_python_shebang_adherence.yml"], "base_commit": "7fff4086523678f3c6533da4c500f86f6fb47efa", "gold": ["lib/ansible/executor/module_common.py"], "hard": false, "instance_id": "instance_ansible__ansible-9142be2f6cabbe6597c9254c5bb9186d17036d55-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "0a724620acceceb67eaccc7bb89e53bbf2c62dcc51f310ee68f4016ed79f84f7"}+{"added": ["changelogs/fragments/ssh_connection_fixes.yml"], "base_commit": "43300e22798e4c9bd8ec2e321d28c5e8d2018aeb", "gold": ["lib/ansible/cli/arguments/option_helpers.py", "lib/ansible/config/base.yml", "lib/ansible/config/manager.py", "lib/ansible/playbook/play_context.py", "lib/ansible/plugins/connection/ssh.py", "lib/ansible/plugins/strategy/__init__.py", "lib/ansible/utils/ssh_functions.py"], "hard": false, "instance_id": "instance_ansible__ansible-935528e22e5283ee3f63a8772830d3d01f55ed8c-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "c20ffca8e169f220c6db29bfa1527f4c06bd0eddbecef62acbcff217c6585882"}+{"added": ["changelogs/fragments/winrm-timeout.yml"], "base_commit": "dd44449b6ec454a46426a020608fe3763287101f", "gold": ["lib/ansible/plugins/connection/winrm.py"], "hard": false, "instance_id": "instance_ansible__ansible-942424e10b2095a173dbd78e7128f52f7995849b-v30a923fb5c164d6cd18280c02422f75e611e8fb2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "546de38aaacffd060d03647015b704137ca2fe8b099bb85a238eacd60d1376e7"}+{"added": [], "base_commit": "375d3889de9f437bc120ade623c170198629375d", "gold": ["lib/ansible/cli/config.py", "lib/ansible/cli/galaxy.py", "lib/ansible/config/manager.py", "lib/ansible/errors/__init__.py"], "hard": false, "instance_id": "instance_ansible__ansible-949c503f2ef4b2c5d668af0492a5c0db1ab86140-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "1a316eac14898a83b1265d07b0097e9f22a134d6d9a854cdc8b6ea0478f538fe"}+{"added": ["changelogs/fragments/73336-ansible-galaxy_collection_install_upgrade.yaml"], "base_commit": "fce22529c4f5a7293f12979e7cb45f5ed9f6e9f7", "gold": ["docs/docsite/rst/shared_snippets/installing_collections.txt", "lib/ansible/cli/galaxy.py", "lib/ansible/galaxy/collection/__init__.py", "lib/ansible/galaxy/dependency_resolution/__init__.py", "lib/ansible/galaxy/dependency_resolution/providers.py"], "hard": false, "instance_id": "instance_ansible__ansible-9759e0ca494de1fd5fc2df2c5d11c57adbe6007c-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "1c8b7b800027ec4fee6d3083836eb4724322204b1e18b1ed61cf47bc7d19dfec"}+{"added": [], "base_commit": "d79b23910a1a16931885c5b3056179e72e0e6466", "gold": ["lib/ansible/config/ansible_builtin_runtime.yml", "lib/ansible/errors/__init__.py", "lib/ansible/executor/task_executor.py", "lib/ansible/plugins/action/__init__.py", "lib/ansible/plugins/loader.py", "lib/ansible/template/__init__.py", "lib/ansible/utils/collection_loader/_collection_finder.py", "lib/ansible/utils/display.py"], "hard": false, "instance_id": "instance_ansible__ansible-984216f52e76b904e5b0fa0fb956ab4f1e0a7751-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "968984d61b5abde367bc433a74e47dd525007b72f5299fd9085d6d4124d68f72"}+{"added": ["changelogs/fragments/17587-get-distribution-more-distros.yml"], "base_commit": "4c8c40fd3d4a58defdc80e7d22aa8d26b731353e", "gold": ["lib/ansible/module_utils/common/sys_info.py"], "hard": false, "instance_id": "instance_ansible__ansible-9a21e247786ebd294dafafca1105fcd770ff46c6-v67cdaa49f89b34e42b69d5b7830b3c3ad3d8803f", "language": "python", "names_gold_path": true, "repo": "ansible/ansible", "text_sha256": "229e8bd36947f1cfe315765a2e62c966bef990b7e6b195a6908f4301721a619e"}+{"added": ["changelogs/fragments/78678-add-a-g-install-offline.yml"], "base_commit": "813c25eed1e4832a8ae363455a2f40bb3de33c7f", "gold": ["lib/ansible/cli/galaxy.py", "lib/ansible/galaxy/collection/__init__.py", "lib/ansible/galaxy/collection/galaxy_api_proxy.py", "lib/ansible/galaxy/dependency_resolution/__init__.py"], "hard": false, "instance_id": "instance_ansible__ansible-a02e22e902a69aeb465f16bf03f7f5a91b2cb828-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "ef4c70fc5b0d1855ce5cc15b58c7abd27ed5dd78809c763a752e2effc4c13aa3"}+{"added": ["changelogs/fragments/80257-iptables-chain-creation-does-not-populate-a-rule.yml"], "base_commit": "f10d11bcdc54c9b7edc0111eb38c59a88e396d0a", "gold": ["lib/ansible/modules/iptables.py"], "hard": false, "instance_id": "instance_ansible__ansible-a1569ea4ca6af5480cf0b7b3135f5e12add28a44-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "825f06977f32e57af62b2b54db2cfbb1959161140c2c124faff83372a3e8167b"}+{"added": ["changelogs/fragments/galaxy-install-tar-path-traversal.yaml"], "base_commit": "8c044b846d1ea9e2a9c8870b1eaf6db3775e8e2c", "gold": ["lib/ansible/galaxy/collection.py"], "hard": false, "instance_id": "instance_ansible__ansible-a20a52701402a12f91396549df04ac55809f68e9-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "321edb642f74b8c31404d7332f640731d54a1297bd5eb5e3e4599c562b4f2a46"}+{"added": ["changelogs/fragments/78223_aix_fix_processor_facts.yml"], "base_commit": "1f59bbf4f39504c8f2087f8132f2475a6ac38dcb", "gold": ["lib/ansible/module_utils/facts/hardware/aix.py"], "hard": false, "instance_id": "instance_ansible__ansible-a6e671db25381ed111bbad0ab3e7d97366395d05-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "ecd462b548443aba60d3c69995f357d66673d3395b6b9750295793f737200ec2"}+{"added": ["changelogs/fragments/display_proxy.yml"], "base_commit": "38067860e271ce2f68d6d5d743d70286e5209623", "gold": ["lib/ansible/executor/task_queue_manager.py", "lib/ansible/plugins/strategy/__init__.py", "lib/ansible/utils/display.py"], "hard": false, "instance_id": "instance_ansible__ansible-a7d2a4e03209cff1e97e59fd54bb2b05fdbdbec6-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "ed1ea9666a7072b08c5a7807894e07bc59b2eaba807e04bd1e511e456f46e6bc"}+{"added": ["changelogs/fragments/remove-python3.10-controller-support.yml"], "base_commit": "6382ea168a93d80a64aab1fbd8c4f02dc5ada5bf", "gold": [".azure-pipelines/azure-pipelines.yml", "hacking/README.md", "lib/ansible/cli/__init__.py", "lib/ansible/galaxy/api.py", "lib/ansible/galaxy/collection/__init__.py", "lib/ansible/utils/collection_loader/_collection_finder.py", "packaging/release.py", "setup.cfg"], "hard": false, "instance_id": "instance_ansible__ansible-b2a289dcbb702003377221e25f62c8a3608f0e89-v173091e2e36d38c978002990795f66cfc0af30ad", "language": "python", "names_gold_path": true, "repo": "ansible/ansible", "text_sha256": "cc6337a47267ec4338b4f38bc75cccc58421d4237fb2ae442b231f08b8e70cbf"}+{"added": ["changelogs/fragments/multipart.yml"], "base_commit": "08da8f49b83adec1427abb350d734e6c0569410e", "gold": ["lib/ansible/galaxy/api.py", "lib/ansible/module_utils/urls.py", "lib/ansible/modules/uri.py", "lib/ansible/plugins/action/uri.py"], "hard": true, "instance_id": "instance_ansible__ansible-b748edea457a4576847a10275678127895d2f02f-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "d96b4e9f4c2f5cb5adeed3a8723f0b75c3bbcdfc897ed98b606a8d9d6fc09133"}+{"added": ["changelogs/fragments/72754-extract-emb-func.yaml"], "base_commit": "034e9b0252b9aafe27804ba72320ad99b3344090", "gold": ["lib/ansible/cli/doc.py"], "hard": false, "instance_id": "instance_ansible__ansible-be2c376ab87e3e872ca21697508f12c6909cf85a-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "aecf1ef415f8c0dbb63ff60aa87dd71ae9e8ec075d647a47ba95bc92d9a77565"}+{"added": ["changelogs/fragments/72984_adding_set_support.yml"], "base_commit": "98726ad86c27b4cbd607f7be97ae0f56461fcc03", "gold": ["lib/ansible/modules/iptables.py"], "hard": false, "instance_id": "instance_ansible__ansible-be59caa59bf47ca78a4760eb7ff38568372a8260-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "be392a26fdb074f889f776f9b1e0e21f60f4e4c687474624fe3719cfda457793"}+{"added": ["changelogs/fragments/prettydoc.yml"], "base_commit": "6d34eb88d95c02013d781a29dfffaaf2901cd81f", "gold": ["lib/ansible/cli/doc.py", "lib/ansible/config/manager.py", "lib/ansible/modules/copy.py", "lib/ansible/plugins/filter/strftime.yml", "lib/ansible/plugins/loader.py", "lib/ansible/utils/plugin_docs.py"], "hard": false, "instance_id": "instance_ansible__ansible-bec27fb4c0a40c5f8bbcf26a475704227d65ee73-v30a923fb5c164d6cd18280c02422f75e611e8fb2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "225af34ac0cf74f72e16d0750a6d87cb81bf9c6d91671fa808223d98c225c670"}+{"added": ["changelogs/fragments/70762-sanitize-uri-keys.yml"], "base_commit": "17332532973343248297e3d3c746738d1f3b2f56", "gold": ["docs/docsite/rst/dev_guide/developing_modules_best_practices.rst", "lib/ansible/module_utils/basic.py", "lib/ansible/modules/uri.py"], "hard": false, "instance_id": "instance_ansible__ansible-bf98f031f3f5af31a2d78dc2f0a58fe92ebae0bb-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "779ee267939d9baa6b674b4058cd4ff33ac194e653ded25c57a2cb89abcf1c17"}+{"added": ["lib/ansible/modules/network/f5/bigip_message_routing_route.py"], "base_commit": "57596edcca0ef3bc4d0d90a55d33ac433b407abb", "gold": [], "hard": true, "instance_id": "instance_ansible__ansible-c1f2df47538b884a43320f53e787197793b105e8-v906c969b551b346ef54a2c0b41e04f632b7b73c2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "f6a77c680b9b630a5797efe0b6148c2dcf90c46eabfbd3addfdb4e6e69f016bc"}+{"added": ["changelogs/fragments/module_utils_finder_refactor.yml"], "base_commit": "b479adddce8fe46a2df5469f130cf7b6ad70fdc4", "gold": ["lib/ansible/config/ansible_builtin_runtime.yml", "lib/ansible/executor/module_common.py", "lib/ansible/utils/collection_loader/_collection_finder.py"], "hard": false, "instance_id": "instance_ansible__ansible-c616e54a6e23fa5616a1d56d243f69576164ef9b-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "e8c035970bafef88cbca7bb27e3b7a4db8e164194bb9b6f76f80f7e1b79225b8"}+{"added": ["changelogs/fragments/65386-validate-hosts.yml"], "base_commit": "e8ae7211dabbd07093f50d6dfb383da3bb14f13d", "gold": ["lib/ansible/playbook/play.py"], "hard": false, "instance_id": "instance_ansible__ansible-cd473dfb2fdbc97acf3293c134b21cbbcfa89ec3-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "7ea9416bb3159fa57fa7a3a776eac3a9ade4054c44a20143d8b0dfe2d2ee3f5f"}+{"added": ["changelogs/fragments/gather-s390-sysinfo.yml"], "base_commit": "585ef6c55e87c10c1ce7d59ebe9c33dd6dbe5afb", "gold": ["lib/ansible/module_utils/facts/hardware/linux.py"], "hard": false, "instance_id": "instance_ansible__ansible-cd9c4eb5a6b2bfaf4a6709f001ce3d0c92c1eed2-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "98602e3d16822ec582a9cf1817301029dc406802e257b6b2d8f774d253f96fa5"}+{"added": ["changelogs/fragments/collection-build-manifest.yml"], "base_commit": "f9a450551de47ac2b9d1d7e66a103cbf8f05c37f", "gold": ["docs/docsite/rst/dev_guide/developing_collections_distributing.rst", "lib/ansible/galaxy/collection/__init__.py", "lib/ansible/galaxy/data/collections_galaxy_meta.yml"], "hard": false, "instance_id": "instance_ansible__ansible-d2f80991180337e2be23d6883064a67dcbaeb662-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "eaa1e259c25c1cd98f77e8d62690a8df4164779ad82015351983fa2a8a6c587e"}+{"added": ["changelogs/fragments/galaxy-symlinks.yaml"], "base_commit": "a58fcde3a0d7a93c363ae7af4e6ee03001b96d82", "gold": ["lib/ansible/galaxy/collection.py"], "hard": false, "instance_id": "instance_ansible__ansible-d30fc6c0b359f631130b0e979d9a78a7b3747d48-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "16ca4c7323d32d631945ec3eceed0755098a4b8dbf7ce38866b15ca515b57f10"}+{"added": ["changelogs/fragments/ensure_type.yml"], "base_commit": "dcc5dac1846be3bf6e948a2950b93477b9193076", "gold": ["lib/ansible/config/base.yml", "lib/ansible/config/manager.py", "lib/ansible/constants.py", "lib/ansible/module_utils/parsing/convert_bool.py", "lib/ansible/plugins/loader.py", "lib/ansible/utils/display.py"], "hard": true, "instance_id": "instance_ansible__ansible-d33bedc48fdd933b5abd65a77c081876298e2f07-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "8cb26bed2644bd45fbaa6f8b9193eb3ab82ae36fc8edb68b8ba9bef149965d14"}+{"added": [], "base_commit": "a6e671db25381ed111bbad0ab3e7d97366395d05", "gold": ["lib/ansible/module_utils/urls.py", "lib/ansible/modules/get_url.py", "lib/ansible/modules/uri.py"], "hard": false, "instance_id": "instance_ansible__ansible-d58e69c82d7edd0583dd8e78d76b075c33c3151e-v173091e2e36d38c978002990795f66cfc0af30ad", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "ccbe2b453f65a9bdfc0d44448e19d1a55937b400053c5a7d0ac7365a34a27156"}+{"added": ["changelogs/fragments/82075.yml"], "base_commit": "df29852f3a48160e1a60635692c202531dd8b14a", "gold": ["lib/ansible/module_utils/common/text/formatters.py", "lib/ansible/plugins/filter/human_to_bytes.yml"], "hard": true, "instance_id": "instance_ansible__ansible-d62496fe416623e88b90139dc7917080cb04ce70-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "753e70bd9b2b26d2c9bf42ce2a871a2bc548d58ec25152139e753894e847ac87"}+{"added": ["changelogs/fragments/skip-implicit-flush_handlers-no-notify.yml"], "base_commit": "02e00aba3fd7b646a4f6d6af72159c2b366536bf", "gold": ["lib/ansible/executor/play_iterator.py", "lib/ansible/plugins/strategy/__init__.py", "lib/ansible/plugins/strategy/linear.py"], "hard": false, "instance_id": "instance_ansible__ansible-d6d2251929c84c3aa883bad7db0f19cc9ff0339e-v30a923fb5c164d6cd18280c02422f75e611e8fb2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "f39be7ce297141b253c4198823d5bf27b7e1b10202a4af4af7fc774a9ad8b6da"}+{"added": [], "base_commit": "ea164fdde79a3e624c28f90c74f57f06360d2333", "gold": ["lib/ansible/module_utils/network/nxos/argspec/interfaces/interfaces.py", "lib/ansible/module_utils/network/nxos/config/interfaces/interfaces.py", "lib/ansible/module_utils/network/nxos/facts/interfaces/interfaces.py", "lib/ansible/module_utils/network/nxos/nxos.py", "lib/ansible/modules/network/nxos/nxos_interfaces.py"], "hard": true, "instance_id": "instance_ansible__ansible-d72025be751c894673ba85caa063d835a0ad3a8c-v390e508d27db7a51eece36bb6d9698b63a5b638a", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "0178c60f461e69d2f35f6119749a39cf508be4c9a97ca0298ffeeb1b0cb625f5"}+{"added": ["changelogs/fragments/deprecate-safe-evals.yml"], "base_commit": "59ca05b70994b07a9507f61a0871146a4991b262", "gold": ["lib/ansible/module_utils/basic.py", "lib/ansible/module_utils/common/validation.py"], "hard": false, "instance_id": "instance_ansible__ansible-d9f1866249756efc264b00ff7497e92c11a9885f-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "010414f00eaf259460c4604a5854c843a1e7174d90945a7c9a6d229ebdd64727"}+{"added": ["changelogs/fragments/pip-entry-point.yml"], "base_commit": "fc8197e32675dd0343939f107b5f017993e36f62", "gold": ["docs/docsite/rst/porting_guides/porting_guide_core_2.12.rst", "lib/ansible/modules/pip.py"], "hard": false, "instance_id": "instance_ansible__ansible-de01db08d00c8d2438e1ba5989c313ba16a145b0-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "869f5fb7473749cb38c044b86cdfd0030965302ab1d060585c3858f6a5d13c52"}+{"added": ["changelogs/fragments/galaxy-cache.yml"], "base_commit": "a1730af91f94552e8aaff4bedfb8dcae00bd284d", "gold": ["lib/ansible/cli/galaxy.py", "lib/ansible/config/base.yml", "lib/ansible/galaxy/api.py"], "hard": true, "instance_id": "instance_ansible__ansible-de5858f48dc9e1ce9117034e0d7e76806f420ca8-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "ceadf3fca88d905743121fa457a04b9b78dad66d150699c73a78a29caf0fd314"}+{"added": ["changelogs/fragments/rm-compat-environ.yml"], "base_commit": "5d15af3a9563271615fa1d0f5a99a175bfe41a9f", "gold": ["lib/ansible/config/manager.py", "lib/ansible/plugins/lookup/env.py", "lib/ansible/utils/py3compat.py"], "hard": false, "instance_id": "instance_ansible__ansible-e0c91af45fa9af575d10fd3e724ebc59d2b2d6ac-v30a923fb5c164d6cd18280c02422f75e611e8fb2", "language": "python", "names_gold_path": true, "repo": "ansible/ansible", "text_sha256": "249dda0cf77ef90c5bec7b163eeb0d250ed1e2cb17abf97efb1cb8d4f637b069"}+{"added": ["changelogs/fragments/winrm_kinit_args.yaml"], "base_commit": "a77dbf08663e002198d0fa2af502d5cde8009454", "gold": ["lib/ansible/plugins/connection/winrm.py"], "hard": false, "instance_id": "instance_ansible__ansible-e22e103cdf8edc56ff7d9b848a58f94f1471a263-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "55d7e766a57089bc4cfcee22ca216e43dba4acf05b29f3725ad4af75a83999ac"}+{"added": ["changelogs/fragments/unarchive_timestamp.yml"], "base_commit": "a0aad17912da687a3b0b5a573ab6ed0394b569ad", "gold": ["lib/ansible/modules/unarchive.py"], "hard": false, "instance_id": "instance_ansible__ansible-e64c6c1ca50d7d26a8e7747d8eb87642e767cd74-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": true, "repo": "ansible/ansible", "text_sha256": "bcaf4668716ddb19f0ca8f491dbcf8660b04a0b8a4e04b096e7ad1f2a005e981"}+{"added": ["changelogs/fragments/winrm-kinit-pexpect.yml"], "base_commit": "bddb9a7490b5e9475d0d01a8d906332e81789cde", "gold": ["lib/ansible/plugins/connection/winrm.py"], "hard": true, "instance_id": "instance_ansible__ansible-e9e6001263f51103e96e58ad382660df0f3d0e39-v30a923fb5c164d6cd18280c02422f75e611e8fb2", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "673c849a2798ccc8d7c0a06b36936f9abdaf5acee4acfc74c4df0646c5cf2664"}+{"added": [], "base_commit": "341a6be78d7fc1701b0b120fc9df1c913a12948c", "gold": ["docs/docsite/rst/dev_guide/testing_validate-modules.rst", "lib/ansible/module_utils/basic.py", "lib/ansible/module_utils/common/parameters.py", "lib/ansible/module_utils/common/warnings.py", "lib/ansible/module_utils/csharp/Ansible.Basic.cs", "lib/ansible/utils/display.py"], "hard": false, "instance_id": "instance_ansible__ansible-ea04e0048dbb3b63f876aad7020e1de8eee9f362-v1055803c3a812189a1133297f7f5468579283f86", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "b4537e75032fd31170ef71b69b8c0da3eeb16badf9b41cc0d6c82c5c62326306"}+{"added": ["changelogs/fragments/ansible-galaxy-install.yaml"], "base_commit": "01e7915b0a9778a934a0f0e9e9d110dbef7e31ec", "gold": ["docs/docsite/rst/shared_snippets/installing_multiple_collections.txt", "lib/ansible/cli/galaxy.py"], "hard": false, "instance_id": "instance_ansible__ansible-ecea15c508f0e081525be036cf76bbb56dbcdd9d-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "a29dd3b349d84b978b0ded1871a8d4697c609e69e1038787cf423a737f42a314"}+{"added": [], "base_commit": "c819c1725de510fb41e8bdc38e68c2ac1df81ced", "gold": ["lib/ansible/utils/collection_loader/_collection_finder.py"], "hard": false, "instance_id": "instance_ansible__ansible-ed6581e4db2f1bec5a772213c3e186081adc162d-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "54e7137722a433d156bca96fc08f2415976f1ab4f3b7ad6e1d7fc87bb028b1d1"}+{"added": ["docs/docsite/rst/network/user_guide/platform_eric_eccli.rst", "lib/ansible/module_utils/network/eric_eccli/__init__.py", "lib/ansible/module_utils/network/eric_eccli/eric_eccli.py", "lib/ansible/modules/network/eric_eccli/__init__.py", "lib/ansible/modules/network/eric_eccli/eric_eccli_command.py", "lib/ansible/plugins/cliconf/eric_eccli.py", "lib/ansible/plugins/terminal/eric_eccli.py"], "base_commit": "07e7b69c04116f598ed2376616cbb46343d9a0e9", "gold": [".github/BOTMETA.yml", "docs/docsite/rst/network/user_guide/platform_index.rst"], "hard": false, "instance_id": "instance_ansible__ansible-eea46a0d1b99a6dadedbb6a3502d599235fa7ec3-v390e508d27db7a51eece36bb6d9698b63a5b638a", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "278f1ec4b7b982fe411b0c684abbcf63f6dc72f326ad621fceacad079427101f"}+{"added": [], "base_commit": "f533d46572113655a0a698beab4b38671744a458", "gold": ["lib/ansible/galaxy/dependency_resolution/dataclasses.py", "lib/ansible/utils/collection_loader/_collection_finder.py"], "hard": false, "instance_id": "instance_ansible__ansible-f327e65d11bb905ed9f15996024f857a95592629-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "220f5e6d199203140ffd10071f900acd199ee5087894715d7106c18a317e7bb7"}+{"added": ["changelogs/fragments/ssh-clixml.yml"], "base_commit": "3398c102b5c41d48d0cbc2d81f9c004f07ac3fcb", "gold": ["lib/ansible/plugins/connection/ssh.py", "lib/ansible/plugins/shell/powershell.py"], "hard": false, "instance_id": "instance_ansible__ansible-f86c58e2d235d8b96029d102c71ee2dfafd57997-v0f01c69f1e2528b935359cfe578530722bca2c59", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "a04862ce7d1e9544ca217a2dc97e1964d4cb389a5b4973ccd7562d2d377a870f"}+{"added": ["changelogs/fragments/72276-provide-better-vault-error.yml"], "base_commit": "e889b1063f60f6b99f5d031f7e903f7be5f58900", "gold": ["lib/ansible/errors/__init__.py", "lib/ansible/parsing/vault/__init__.py", "lib/ansible/parsing/yaml/constructor.py", "lib/ansible/parsing/yaml/objects.py", "lib/ansible/playbook/helpers.py", "lib/ansible/playbook/task.py"], "hard": false, "instance_id": "instance_ansible__ansible-f8ef34672b961a95ec7282643679492862c688ec-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "0b7453c302e2a6913f62032110583840819fafc36c918b73c034aae18fd521d9"}+{"added": ["changelogs/fragments/ansible-doc-formats.yml"], "base_commit": "662d34b9a7a1b3ab1d4847eeaef201a005826aef", "gold": ["docs/docsite/rst/dev_guide/developing_modules_documenting.rst", "lib/ansible/cli/__init__.py", "lib/ansible/cli/doc.py"], "hard": false, "instance_id": "instance_ansible__ansible-fb144c44144f8bd3542e71f5db62b6d322c7bd85-vba6da65a0f3baefda7a058ebbd0a8dcafb8512f5", "language": "python", "names_gold_path": false, "repo": "ansible/ansible", "text_sha256": "adae74426b6a89841b3dbf9cf3e74ee41836ad3ec2aef21c5b3016e9a0c7dbbe"}+{"added": [], "base_commit": "4f32727829c1087e9d3d9955785d8a6255457c7d", "gold": ["src/components/viewmodels/roomlist/useStickyRoomList.tsx", "src/stores/spaces/SpaceStore.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-1077729a19c0ce902e713cf6fab42c91fb7907f1-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "cc21f664348e5143d133c31f536cd748c524a527487a25d4ac7dfa62640b4804"}+{"added": ["res/css/views/elements/_ExternalLink.scss", "src/components/views/elements/ExternalLink.tsx"], "base_commit": "d7a6e3ec65cf28d2454ccb357874828bc8147eb0", "gold": ["res/css/_components.scss", "res/css/views/settings/_ProfileSettings.scss", "src/components/views/dialogs/ShareDialog.tsx", "src/components/views/settings/ProfileSettings.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-1216285ed2e82e62f8780b6702aa0f9abdda0b34-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "b669aa17928c9df1b920af065bbf45c37e7f0836a9b5347d19869d1709701da6"}+{"added": [], "base_commit": "212233cb0b9127c95966492175a730d5b954690f", "gold": ["src/Markdown.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-18c03daa865d3c5b10e52b669cd50be34c67b2e5-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "709a795a76d3a41550885e4003d205b374fb8963b8919c828ef2d6afb2ba45fc"}+{"added": ["src/components/views/rooms/wysiwyg_composer/utils/selection.ts"], "base_commit": "29f9ccfb633dd2bac9082fff9016b90945a77b53", "gold": ["src/components/views/rooms/wysiwyg_composer/hooks/useSelection.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-27139ca68eb075a4438c18fca184887002a4ffbc-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "766ca3da32911959b18f7cf9eebf50c2c17527767d903ec3cbd1c9c88080c040"}+{"added": [], "base_commit": "cdffd1ca1f7b60334a8ca3bba64d0a4e6d2b68d0", "gold": ["src/components/views/right_panel/UserInfo.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-2760bfc8369f1bee640d6d7a7e910783143d4c5f-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "fe466cc9c357d8387fa22096cb1587c7a6c38ff1ddcddd6afacb25fd8a4218a2"}+{"added": ["src/KeyBindingsDefaults.ts", "src/KeyBindingsManager.ts"], "base_commit": "83612dd4adeb2a4dad77655ec8969fcb1c555e6f", "gold": ["src/components/structures/LoggedInView.tsx", "src/components/structures/RoomSearch.tsx", "src/components/structures/RoomView.tsx", "src/components/views/rooms/BasicMessageComposer.tsx", "src/components/views/rooms/EditMessageComposer.js", "src/components/views/rooms/RoomSublist.tsx", "src/components/views/rooms/SendMessageComposer.js"], "hard": false, "instance_id": "instance_element-hq__element-web-33e8edb3d508d6eefb354819ca693b7accc695e7", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "5df180a1059d3b5e86c6ad384fb8eac9c6ed2002cb243063d947401d766c1841"}+{"added": [], "base_commit": "f152613f830ec32a3de3d7f442816a63a4c732c5", "gold": ["src/MatrixClientPeg.ts", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-404c412bcb694f04ba0c4d5479541203d701bca0-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "920546ff18822db501ac7e9ed3341bade62e44e853d256466274c2e957d792d5"}+{"added": [], "base_commit": "d5d1ec775caf2d3c9132122c1243898e99fdb2da", "gold": ["src/utils/AutoDiscoveryUtils.tsx", "src/utils/ValidatedServerConfig.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-41dfec20bfe9b62cddbbbf621bef2e9aa9685157-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "c641a8f678bc31d657f3ec0751d46579069cab63683bcbbfb2dfa38972296af0"}+{"added": [], "base_commit": "19f9f9856451a8e4cce6d313d19ca8aed4b5d6b4", "gold": ["src/components/views/settings/SetIntegrationManager.tsx", "src/components/views/settings/tabs/user/GeneralUserSettingsTab.tsx", "src/components/views/settings/tabs/user/SecurityUserSettingsTab.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-44b98896a79ede48f5ad7ff22619a39d5f6ff03c-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "f7ce51b49cf69731597f68c654ac4023a570a5d31674195791602c4a19459dce"}+{"added": [], "base_commit": "dd91250111dcf4f398e125e14c686803315ebf5d", "gold": ["src/components/views/rooms/MessageComposer.tsx", "src/components/views/voip/PipView.tsx", "src/voice-broadcast/models/VoiceBroadcastPreRecording.ts", "src/voice-broadcast/utils/setUpVoiceBroadcastPreRecording.ts", "src/voice-broadcast/utils/startNewVoiceBroadcastRecording.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-459df4583e01e4744a52d45446e34183385442d6-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "815446a9d95a2f6a86d05a9b20fcdf31c727db3b19e027c899adb1f27c50a853"}+{"added": [], "base_commit": "28f7aac9a5970d27ff3757875b464a5a58a1eb1a", "gold": ["src/components/structures/RoomView.tsx", "src/dispatcher/actions.ts", "src/stores/RoomViewStore.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-494d9de6f0a94ffb491e74744d2735bce02dc0ab-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "31cfa8d228bea7159073e33c0c8fdec6a120b635c63f0e6359ecd2606f2b05e3"}+{"added": [], "base_commit": "6da3cc8ca1baf268d768ed63e4b9cb16e40ce33d", "gold": ["src/PosthogAnalytics.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-4c6b0d35add7ae8d58f71ea1711587e31081444b-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "1b292ea7867cbc9577f83f8b841f7b90b528ae2a37deca21f5d971befee3ff8f"}+{"added": ["res/css/components/views/settings/devices/_DeviceDetailHeading.pcss", "src/components/views/settings/devices/DeviceDetailHeading.tsx"], "base_commit": "b8bb8f163a89cb6f2af0ac1cfc97e89deb938368", "gold": ["res/css/_components.pcss", "res/css/components/views/settings/devices/_DeviceDetails.pcss", "src/components/views/settings/devices/CurrentDeviceSection.tsx", "src/components/views/settings/devices/DeviceDetails.tsx", "src/components/views/settings/devices/FilteredDeviceList.tsx", "src/components/views/settings/devices/useOwnDevices.ts", "src/components/views/settings/tabs/user/SessionManagerTab.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-4fec436883b601a3cac2d4a58067e597f737b817-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "64a6f0d653a505b7f301302975eb698b7cf3711890822fc482c5d3441ca72343"}+{"added": [], "base_commit": "97f6431d60ff5e3f9168948a306036402c316fa1", "gold": ["src/utils/MessageDiffUtils.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-53a9b6447bd7e6110ee4a63e2ec0322c250f08d1-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "dcdb64145272a897f3baa548527bb4acaa31ff0a07f859051644ecb2324369c3"}+{"added": [], "base_commit": "53415bfdfeb9f25e6755dde2bc41e9dbca4fa791", "gold": ["src/components/views/dialogs/spotlight/RoomResultContextMenus.tsx", "src/components/views/rooms/RoomHeader.tsx", "src/components/views/rooms/RoomTile.tsx", "src/settings/UIFeature.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-53b42e321777a598aaf2bb3eab22d710569f83a8-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "aac2834dc2948281526f4ec2e12e2edcbb583b4fd61392223acac7db75c855cd"}+{"added": ["res/css/views/settings/encryption/_ResetIdentityPanel.pcss"], "base_commit": "9d8efacede71e3057383684446df3bde21e7bb1a", "gold": ["res/css/_components.pcss", "src/components/views/settings/encryption/ResetIdentityPanel.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-56c7fc1948923b4b3f3507799e725ac16bcf8018-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "9085446f50e916dd8924b6c3137c27cb713a783d94eca3743c16be1036c7c910"}+{"added": [], "base_commit": "ec6bb880682286216458d73560aa91746d4f099b", "gold": ["src/DecryptionFailureTracker.ts", "src/components/structures/MatrixChat.tsx", "src/components/views/rooms/EventTile.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-582a1b093fc0b77538052f45cbb9c7295f991b51-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "8a5c56c3ad0b3cf047188dc945825dfe5a64303aaf9c42e4135b20d899bee1e4"}+{"added": [], "base_commit": "f97cef80aed8ee6011543f08bee8b1745a33a7db", "gold": ["docs/icons.md", "src/components/views/settings/devices/useOwnDevices.ts", "src/i18n/strings/en_EN.json", "src/utils/device/clientInformation.ts", "src/voice-broadcast/models/VoiceBroadcastRecording.ts", "src/voice-broadcast/utils/checkVoiceBroadcastPreConditions.tsx"], "hard": true, "instance_id": "instance_element-hq__element-web-5dfde12c1c1c0b6e48f17e3405468593e39d9492-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "648099573a35a13eddff2c2061f30280884da835a64cc7f4c5a46a8ffa843af9"}+{"added": [], "base_commit": "339e7dab18df52b7fb3e5a86a195eab2adafe36a", "gold": ["src/DeviceListener.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-5e8488c2838ff4268f39db4a8cca7d74eecf5a7e-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "988499b0a161b1df9bb8cce0ffd236e9bf4c04d628183fa64219790ed674973f"}+{"added": ["src/voice-broadcast/utils/determineVoiceBroadcastLiveness.ts"], "base_commit": "6bc4523cf7c2c48bdf76b7a22e12e078f2c53f7f", "gold": ["src/voice-broadcast/models/VoiceBroadcastPlayback.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-6205c70462e0ce2e1e77afb3a70b55d0fdfe1b31-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "16cbcf9afad10b15f6cd30aedcb7dfe456404cb66e3e398bc494231093f6ace1"}+{"added": [], "base_commit": "04bc8fb71c4a1ee1eb1f0c4a1de1641d353e9f2c", "gold": ["res/css/voice-broadcast/molecules/_VoiceBroadcastBody.pcss", "src/audio/Playback.ts", "src/voice-broadcast/components/molecules/VoiceBroadcastPlaybackBody.tsx", "src/voice-broadcast/hooks/useVoiceBroadcastPlayback.ts", "src/voice-broadcast/models/VoiceBroadcastPlayback.ts", "src/voice-broadcast/utils/VoiceBroadcastChunkEvents.ts"], "hard": true, "instance_id": "instance_element-hq__element-web-66d0b318bc6fee0d17b54c1781d6ab5d5d323135-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "5df9c0c7652ba90ef17dd4815e7c85caf456687fb621c95ad6b2925d25af8eef"}+{"added": [], "base_commit": "29c193210fc5297f0839f02eddea36aa63977516", "gold": ["src/components/views/auth/InteractiveAuthEntryComponents.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-6961c256035bed0b7640a6e5907652c806968478-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "73db4ba7f238187a631fbfb0784962e0867c8b56c10c203beeba73e176863c8b"}+{"added": [], "base_commit": "c153a4d3885b6359f8bfe2b056f56db23ab4c9d8", "gold": ["src/SlashCommands.tsx", "src/components/views/avatars/BaseAvatar.tsx", "src/components/views/avatars/MemberAvatar.tsx", "src/components/views/elements/AppPermission.tsx", "src/components/views/elements/EventListSummary.tsx", "src/components/views/messages/EncryptionEvent.tsx", "src/i18n/strings/en_EN.json", "src/settings/Settings.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-71fe08ea0f159ccb707904d87f0a4aef205a167c-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "a1d2c29ed6ca2f9ed6256f04c8ddc28813b6878e867458663a642b330597f024"}+{"added": ["src/hooks/useWindowWidth.ts"], "base_commit": "650b9cb0cf9bb10674057e232f4792acf83f2e46", "gold": ["src/components/structures/TabbedView.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-72a8f8f03b1a01bb70ef8a5bb61759416991b32c-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "f1fadd91151de086079cc81174c2fa4047a2545faa02bac3fcffd8954bef3e97"}+{"added": [], "base_commit": "7a33818bd7ec89c21054691afcb6db2fb2631e14", "gold": ["res/css/components/views/settings/devices/_FilteredDeviceList.pcss", "res/css/components/views/settings/devices/_FilteredDeviceListHeader.pcss", "res/css/views/elements/_AccessibleButton.pcss", "src/components/views/elements/AccessibleButton.tsx", "src/components/views/settings/devices/DeviceTile.tsx", "src/components/views/settings/devices/FilteredDeviceList.tsx", "src/components/views/settings/devices/SelectableDeviceTile.tsx", "src/components/views/settings/tabs/user/SessionManagerTab.tsx", "src/i18n/strings/en_EN.json"], "hard": true, "instance_id": "instance_element-hq__element-web-772df3021201d9c73835a626df8dcb6334ad9a3e-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "6d490547bc2d628e9226b84bbba1c77fee3606b3512a4fdfa591eb430255bf55"}+{"added": ["res/css/components/views/context_menus/_KebabContextMenu.pcss", "src/components/views/context_menus/KebabContextMenu.tsx"], "base_commit": "8b54be6f48631083cb853cda5def60d438daa14f", "gold": ["res/css/_components.pcss", "res/css/views/context_menus/_IconizedContextMenu.pcss", "src/components/structures/ContextMenu.tsx", "src/components/views/context_menus/IconizedContextMenu.tsx", "src/components/views/settings/devices/CurrentDeviceSection.tsx", "src/components/views/settings/tabs/user/SessionManagerTab.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-776ffa47641c7ec6d142ab4a47691c30ebf83c2e", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "887bf84bf980a8a94dd1f7d2e274211312f91cdc1ad9d9eef8f8ff753f1efb69"}+{"added": [], "base_commit": "8b8d24c24c1387210ad1826552126c724c49ee42", "gold": ["res/css/views/rooms/wysiwyg_composer/components/_Editor.pcss", "src/components/views/rooms/MessageComposer.tsx", "src/components/views/rooms/wysiwyg_composer/SendWysiwygComposer.tsx", "src/components/views/rooms/wysiwyg_composer/components/Editor.tsx", "src/components/views/rooms/wysiwyg_composer/components/PlainTextComposer.tsx", "src/components/views/rooms/wysiwyg_composer/components/WysiwygComposer.tsx", "src/components/views/rooms/wysiwyg_composer/hooks/usePlainTextListeners.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-7c63d52500e145d6fff6de41dd717f61ab88d02f-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "c4f56bdc1378cc8076f1f15ef0abe2368453a26c224dc108637c08d1b36b4c89"}+{"added": ["src/components/views/settings/devices/DeviceMetaData.tsx", "src/utils/device/isDeviceVerified.ts"], "base_commit": "e6fe7b7ea8aad2672854b96b5eb7fb863e19cf92", "gold": ["src/components/views/settings/DevicesPanel.tsx", "src/components/views/settings/devices/DeviceTile.tsx", "src/i18n/strings/en_EN.json", "src/toasts/UnverifiedSessionToast.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-880428ab94c6ea98d3d18dcaeb17e8767adcb461-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "225188f66f4fc61a42890266fccef07ebc8acccdbaf4b769a9c750b97ef707df"}+{"added": [], "base_commit": "2d0319ec1b0298fdb0e02afc3109c40cd0cebe65", "gold": ["src/accessibility/RovingTabIndex.tsx", "src/accessibility/roving/RovingAccessibleTooltipButton.tsx", "src/components/structures/UserMenu.tsx", "src/components/views/messages/DownloadActionButton.tsx", "src/components/views/messages/MessageActionBar.tsx", "src/components/views/pips/WidgetPip.tsx", "src/components/views/rooms/EventTile/EventTileThreadToolbar.tsx", "src/components/views/rooms/ExtraTile.tsx", "src/components/views/rooms/MessageComposerFormatBar.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-8f3c8b35153d2227af45f32e46bd1e15bd60b71f-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "a342fcf4b962157f9e2835fa319a7290604676b88a8fa431bea59f10461c89b4"}+{"added": ["src/components/views/dialogs/polls/PollHistoryDialog.tsx"], "base_commit": "19b81d257f7b8b134bf5d7e555c9d5fca3570f69", "gold": ["res/css/views/right_panel/_RoomSummaryCard.pcss", "src/components/views/right_panel/RoomSummaryCard.tsx", "src/i18n/strings/en_EN.json", "src/settings/Settings.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-923ad4323b2006b2b180544429455ffe7d4a6cc3-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "7d5bf3bf5409802aed9c5fa9390fd6e91a6f635f7276287b2552513469dca963"}+{"added": [], "base_commit": "b03433ef8b83a4c82b9d879946fb1ab5afaca522", "gold": ["src/components/views/dialogs/RoomUpgradeWarningDialog.tsx", "src/components/views/settings/JoinRuleSettings.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-9a31cd0fa849da810b4fac6c6c015145e850b282-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "0966106739781b21779876d7d315c0c0189a1969043511513b6be0f4d6c3c5fd"}+{"added": ["src/components/views/settings/devices/DeviceVerificationStatusCard.tsx"], "base_commit": "ba171f1fe5814a1b9ee88f792afaf05ce5aa507b", "gold": ["res/css/components/views/settings/devices/_DeviceSecurityCard.pcss", "src/components/views/settings/devices/CurrentDeviceSection.tsx", "src/components/views/settings/devices/DeviceDetails.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-9bf77963ee5e036d54b2a3ca202fbf6378464a5e-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "57950bf2fdcc91ef094ccb5860c145a36d6ab422c2236959053d1410d48213e6"}+{"added": ["src/utils/room/shouldForceDisableEncryption.ts"], "base_commit": "9d9c55d92e98f5302a316ee5cd8170de052c13da", "gold": ["src/components/views/dialogs/CreateRoomDialog.tsx", "src/createRoom.ts", "src/utils/WellKnownUtils.ts", "src/utils/rooms.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-a692fe21811f88d92e8f7047fc615e4f1f986b0f-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "f033742bcf6aa69b8e6a7b8247a4b0e2eb3ee71d5af7939715051c255a447717"}+{"added": ["src/hooks/usePermalink.tsx"], "base_commit": "c0e40217f35e2d2a067bbb881c3871565eaf54b2", "gold": ["src/components/views/elements/Pill.tsx", "src/components/views/elements/ReplyChain.tsx", "src/components/views/settings/BridgeTile.tsx", "src/utils/pillify.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-ad26925bb6628260cfe0fcf90ec0a8cba381f4a4-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "7904152082726847653baa39ea38c661f4aeecd4a68cdd9bdaade0c01cabdf93"}+{"added": ["res/css/views/rooms/_EventPreview.pcss", "src/components/views/rooms/EventPreview.tsx"], "base_commit": "c9d9c421bc7e3f2a9d5d5ed05679cb3e8e06a388", "gold": ["res/css/_components.pcss", "res/css/views/rooms/_PinnedMessageBanner.pcss", "src/components/views/rooms/EventTile.tsx", "src/components/views/rooms/PinnedMessageBanner.tsx", "src/components/views/rooms/ThreadSummary.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-aeabf3b18896ac1eb7ae9757e66ce886120f8309-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "dd8f33dfd5a08747105033cdc13a216e2477aa13d8cad189ced9d08fbc354d1d"}+{"added": ["src/stores/UserProfilesStore.ts", "src/utils/LruCache.ts"], "base_commit": "1c039fcd3880ef4fefa58812d375104d2d70fe6c", "gold": ["src/components/structures/MatrixChat.tsx", "src/contexts/SDKContext.ts", "src/hooks/usePermalinkMember.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-aec454dd6feeb93000380523cbb0b3681c0275fd-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "a16e2e196f0e1a59b2650b4ca2ae5652633bd0e6fbda6b4edfedcc9f84139efe"}+{"added": [], "base_commit": "c2ae6c279b8c80ea5bd58f3354e5949a9fa5ee41", "gold": ["src/utils/arrays.ts", "src/voice/Playback.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-b007ea81b2ccd001b00f332bee65070aa7fc00f9-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "f2aac84af8827b6e6de5d3c96821ff680d9050e4d4a4cea3b2cd8adf44e6c946"}+{"added": ["src/components/views/settings/encryption/EncryptionCardButtons.tsx"], "base_commit": "90801eb38bd0bcca067c02ccc7434b6b9309c03c", "gold": ["res/css/views/settings/encryption/_ChangeRecoveryKey.pcss", "res/css/views/settings/encryption/_EncryptionCard.pcss", "res/css/views/settings/encryption/_ResetIdentityPanel.pcss", "src/components/views/settings/encryption/ChangeRecoveryKey.tsx", "src/components/views/settings/encryption/ResetIdentityPanel.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-b7fea97bb68c6628a644580076f840109132f074-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "60126f05894845919dceec38453a545deda98343941408908ec11fe4b7728fc6"}+{"added": [], "base_commit": "5583d07f25071ceb4f84462150717b68a244f166", "gold": ["src/LegacyCallHandler.tsx", "src/settings/Settings.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-ca58617cee8aa91c93553449bfdf9b3465a5119b-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "cc416ad4b5301b58f5612d641b5d5e40bf5abd29945a97d4113f657090ee1148"}+{"added": [], "base_commit": "16e92a4d8cb66c10c46eb9d94d9e2b82d612108a", "gold": ["src/voice-broadcast/components/molecules/VoiceBroadcastPreRecordingPip.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-ce554276db97b9969073369fefa4950ca8e54f84-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "c8cf71221e46b55b4b0723c9cb102a7c4c14814ff88a1b977a744718c815e01f"}+{"added": [], "base_commit": "973513cc758030917cb339ba35d6436bc2c7d5dd", "gold": ["res/css/voice-broadcast/atoms/_LiveBadge.pcss", "src/voice-broadcast/components/atoms/LiveBadge.tsx", "src/voice-broadcast/components/atoms/VoiceBroadcastHeader.tsx", "src/voice-broadcast/components/molecules/VoiceBroadcastPlaybackBody.tsx", "src/voice-broadcast/components/molecules/VoiceBroadcastRecordingBody.tsx", "src/voice-broadcast/components/molecules/VoiceBroadcastRecordingPip.tsx", "src/voice-broadcast/hooks/useVoiceBroadcastPlayback.ts", "src/voice-broadcast/hooks/useVoiceBroadcastRecording.tsx", "src/voice-broadcast/index.ts", "src/voice-broadcast/models/VoiceBroadcastPlayback.ts", "src/voice-broadcast/utils/VoiceBroadcastChunkEvents.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-cf3c899dd1f221aa1a1f4c5a80dffc05b9c21c85-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "acd74096a5a234d66149d780092022d5feaccb06f11ee56f3a207cf39b427619"}+{"added": ["src/utils/react.tsx"], "base_commit": "2f8e98242c6de16cbfb6ebb6bc29cfe404b343cb", "gold": ["src/components/views/elements/PersistedElement.tsx", "src/components/views/messages/EditHistoryMessage.tsx", "src/components/views/messages/TextualBody.tsx", "src/utils/exportUtils/HtmlExport.tsx", "src/utils/pillify.tsx", "src/utils/tooltipify.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-d06cf09bf0b3d4a0fbe6bd32e4115caea2083168-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "14167f697523c6afb44e59fa4bce1512d3a6736408eb4473cf37360d53af8147"}+{"added": [], "base_commit": "b0317e67523f46f81fc214afd6014d7105d726cc", "gold": ["src/async-components/views/dialogs/security/ExportE2eKeysDialog.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-d405160080bbe804f7e9294067d004a7d4dad9d6-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "6769620ae553772dab8525918dff505a87f353ab5e784cf3cea61467e66f13c8"}+{"added": [], "base_commit": "526645c79160ab1ad4b4c3845de27d51263a405e", "gold": ["src/Unread.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-dae13ac8522fc6d41e64d1ac6e3174486fdcce0c-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "fc2efe93861e5f6ce99d6bbe3237d576c2205350cf9d95e39b8460400a8d30b6"}+{"added": ["src/utils/FixedRollingArray.ts"], "base_commit": "1b39dbdb53f8374094a767c02ad81c46043f3116", "gold": ["src/voice/RecorderWorklet.ts", "src/voice/VoiceRecording.ts", "src/voice/consts.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-ec0f940ef0e8e3b61078f145f34dc40d1938e6c5-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "3893ebef43770ce45dd6a6d2dddcbe049e0aafbe0b308a5570e68354cf65c5d9"}+{"added": [], "base_commit": "f34c1609c3c42f095b59bc068620f342894f94ed", "gold": ["src/components/structures/RoomSearchView.tsx", "src/components/views/rooms/SearchResultTile.tsx"], "hard": true, "instance_id": "instance_element-hq__element-web-ecfd1736e5dd9808e87911fc264e6c816653e1a9-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "d27013a90cf693f46d9c337a794114bdb7d08f470a263431db633f3c21a511ae"}+{"added": [], "base_commit": "8ebdcab7d92f90422776c4390363338dcfd98ba5", "gold": ["src/components/views/right_panel/RoomHeaderButtons.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-ee13e23b156fbad9369d6a656c827b6444343d4f-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "df3e3615557e76c59dcc50c4d676ad2eea22a6cae97fc56b109716b5033b1209"}+{"added": [], "base_commit": "a3a2a0f9141d8ee6e12cb4a8ab2ecf3211b71829", "gold": ["src/components/views/settings/devices/LoginWithQRSection.tsx", "src/components/views/settings/tabs/user/SecurityUserSettingsTab.tsx", "src/components/views/settings/tabs/user/SessionManagerTab.tsx", "src/i18n/strings/en_EN.json", "src/settings/Settings.tsx"], "hard": false, "instance_id": "instance_element-hq__element-web-f0359a5c180b8fec4329c77adcf967c8d3b7b787-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "e9195f7e34b4a6d846ee281203bed96ce3ae89d9f23931dfd46412515866976f"}+{"added": ["res/css/views/buttons/_Cancel.scss", "src/components/views/buttons/Cancel.tsx"], "base_commit": "8c13a0f8d48441eccdd69e41e76251478bdeab8c", "gold": ["res/css/_components.scss", "res/css/structures/_RoomView.scss", "res/css/views/rooms/_MessageComposer.scss", "res/css/views/rooms/_ReplyPreview.scss", "res/css/views/rooms/_SendMessageComposer.scss", "res/img/cancel.svg", "res/img/element-icons/room/message-bar/reply.svg", "res/img/element-icons/room/room-summary.svg", "res/img/element-icons/x-8px.svg", "src/components/views/messages/DisambiguatedProfile.tsx", "src/components/views/messages/SenderProfile.tsx", "src/components/views/rooms/MessageComposer.tsx", "src/components/views/rooms/ReplyPreview.tsx", "src/components/views/rooms/ReplyTile.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-f14374a51c153f64f313243f2df6ea4971db4e15", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "111e0a1021d938b7f6654ad81b804ef62d208e7832371bea1a7612ae33aee7e6"}+{"added": [], "base_commit": "64733e59822c91e1d0a72fbe000532fac6f40bf4", "gold": ["src/TextForEvent.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-f3534b42df3dcfe36dc48bddbf14034085af6d30-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "759b9241963334a2d8395c360c9cd490be67ecb17ca8601edc21bd4a718ae65d"}+{"added": [], "base_commit": "5a4355059d15053b89eae9d82a2506146c7832c0", "gold": ["src/components/views/messages/MKeyVerificationRequest.tsx", "src/events/EventTileFactory.tsx", "src/i18n/strings/en_EN.json"], "hard": false, "instance_id": "instance_element-hq__element-web-f63160f38459fb552d00fcc60d4064977a9095a6-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "d2db14a34d06ed5b2636fc399871bad82e88886ebfb6343ce18491c62681af68"}+{"added": ["src/voice-broadcast/models/VoiceBroadcastRecording.ts", "src/voice-broadcast/models/index.ts", "src/voice-broadcast/stores/VoiceBroadcastRecordingsStore.ts", "src/voice-broadcast/stores/index.ts", "src/voice-broadcast/utils/startNewVoiceBroadcastRecording.ts"], "base_commit": "ad9cbe93994888e8f8ba88ce3614dc041a698930", "gold": ["src/components/views/rooms/MessageComposer.tsx", "src/voice-broadcast/components/VoiceBroadcastBody.tsx", "src/voice-broadcast/index.ts", "src/voice-broadcast/utils/index.ts"], "hard": false, "instance_id": "instance_element-hq__element-web-fe14847bb9bb07cab1b9c6c54335ff22ca5e516a-vnan", "language": "js", "names_gold_path": false, "repo": "element-hq/element-web", "text_sha256": "1372cc82f924e3160e6ddb1a34a4c82f3e1b6a7dad5c3df75b4c777d4fa3e6fb"}+{"added": ["internal/cache/redis/client.go"], "base_commit": "85bb23a3571794c7ba01e61904bac6913c3d9729", "gold": ["config/flipt.schema.cue", "config/flipt.schema.json", "internal/cmd/grpc.go", "internal/config/cache.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-02e21636c58e86c51119b63e0fb5ca7b813b07b1", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "f8dd27877728dab030788ccda1d63622f1d1a9ddf4bc58a438d696c7e13ccf7d"}+{"added": [], "base_commit": "b64891e57df74861e89ebcfa81394e4bc096f8c7", "gold": ["go.work.sum", "internal/common/store_mock.go", "internal/ext/common.go", "internal/storage/fs/git/store.go", "internal/storage/fs/object/file.go", "internal/storage/fs/object/fileinfo.go", "internal/storage/fs/object/store.go", "internal/storage/fs/oci/store.go", "internal/storage/fs/snapshot.go", "internal/storage/fs/store.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-05d7234fa582df632f70a7cd10194d61bd7043b9", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "e093f9d87ca4d83ff6ff37d163c3ef7747168b8b0c003d910423475907abfcad"}+{"added": [], "base_commit": "7620fe8bb64c0d875f419137acc5da24ca8e6031", "gold": ["internal/cleanup/cleanup.go", "internal/cmd/authn.go", "internal/config/authentication.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-0b119520afca1cf25c470ff4288c464d4510b944", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "a12b4cb87b778675c997b33a7852aa57de0acf0af5e3bf9e161ef3c05dd5951e"}+{"added": ["internal/config/testdata/authentication/kubernetes.yml"], "base_commit": "3ddd2d16f10a3a0c55c135bdcfa0d1a0307929f4", "gold": ["internal/config/authentication.go", "internal/config/testdata/advanced.yml", "rpc/flipt/auth/auth.pb.go", "rpc/flipt/auth/auth.proto"], "hard": false, "instance_id": "instance_flipt-io__flipt-0fd09def402258834b9d6c0eaa6d3b4ab93b4446", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "0c89662636d2d814e19b557ad2fdb6487f5712acde15320366d6f622ad26343d"}+{"added": [], "base_commit": "77e21fd62a00c6d2d4fd55a7501e6a8a95404e2e", "gold": ["internal/storage/cache/cache.go", "internal/storage/storage.go", "ui/src/app/flags/rollouts/Rollouts.tsx", "ui/src/app/flags/rules/Rules.tsx"], "hard": false, "instance_id": "instance_flipt-io__flipt-15b76cada1ef29cfa56b0fba36754be36243dded", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "01f4533949b1a0469bb89f444a5b06614fb1a7c2702fa2c8fc02a4c2f82eacf3"}+{"added": [], "base_commit": "1f6255dda6648ecafd94826cda3fac2486af4b0f", "gold": ["internal/ext/encoding.go", "internal/ext/importer.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-1737085488ecdcd3299c8e61af45a8976d457b7e", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "5f605a5663b8b36bbac74421b3ae416652d4877a5d52c162e4817aa5fe2acfc0"}+{"added": [], "base_commit": "eafbf82dbc497801453f91bc991421d7491d4e15", "gold": ["go.work.sum", "internal/server/audit/types.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-1dceb5edf3fa8f39495b939ef9cc0c3dd38fa17d", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "b46c439adf601dffafeb7bb3862659113faff6b4d70d006e7dbfae2ae2752d9a"}+{"added": [], "base_commit": "4e1cd36398ee73acf7d9235b517f05178651c464", "gold": ["cmd/flipt/main.go", "config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-21a935ad7886cc50c46852be21b37f363a926af0", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "f6ee03a254d409de3daaa695f7038d68738ddc99b8b1843a93e390022ed704a5"}+{"added": [], "base_commit": "2cdbe9ca09b33520c1b19059571163ea6d8435ea", "gold": ["config/default.yml", "config/flipt.schema.cue", "config/flipt.schema.json", "config/local.yml", "config/production.yml", "internal/config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-292fdaca9be39e6a921aaa8874c011d0fdd3e874", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "a644453d8ce4e41a8971707580e6967cda43af966e0749392319b2f2bdc3cf43"}+{"added": [], "base_commit": "018129e08535e0a7ec725680a1e8b2c969a832e9", "gold": ["go.work.sum", "internal/telemetry/telemetry.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-29d3f9db40c83434d0e3cc082af8baec64c391a9", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "f882848cf9f1fe1e16e079be840a7cd8c2d92e9806a53b8d2eb58222914d0ff0"}+{"added": ["internal/config/metrics.go"], "base_commit": "168f61194a4cd0f515a589511183bb1bd4f87507", "gold": ["config/flipt.schema.cue", "config/flipt.schema.json", "go.mod", "go.sum", "go.work.sum", "internal/cmd/grpc.go", "internal/config/config.go", "internal/metrics/metrics.go"], "hard": true, "instance_id": "instance_flipt-io__flipt-2ca5dfb3513e4e786d2b037075617cccc286d5c3", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "3de9fbc863dd00fed6560fbeef49f696fd3ec9a8e0c696c4ee22080efb31a4f5"}+{"added": [], "base_commit": "f3421c143953d2a2e3f4373f8ec366e0904f9bdd", "gold": ["go.work.sum", "internal/cmd/grpc.go", "internal/server/evaluation/data/server.go", "internal/server/middleware/grpc/middleware.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-2ce8a0331e8a8f63f2c1b555db8277ffe5aa2e63", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "f1e5e9057e9699c60fb011e165fed180e99122c0a53d635cda5f818218146e65"}+{"added": [], "base_commit": "01f583bb025dbd60e4210eb9a31a6f859ed150e8", "gold": ["internal/config/analytics.go", "internal/telemetry/telemetry.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-2eac0df47b5ecc8bb05002d80383ceb08ab3620a", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "a6589f87fed6ad96d56789e8434f5c1ac6c680cc3ce54de5cee69bf55877a862"}+{"added": [], "base_commit": "0ed96dc5d33768c4b145d68d52e80e7bce3790d0", "gold": ["config/flipt.schema.cue", "config/flipt.schema.json", "internal/cmd/http.go", "internal/config/config.go", "internal/config/cors.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-381b90f718435c4694380b5fcd0d5cf8e3b5a25a", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "b664960ceff5aaaade931cff47f06bed778b3dbd8c5c815a4e641d58c4a622c5"}+{"added": [], "base_commit": "8d72418bf67cec833da7f59beeecb5abfd48cb05", "gold": ["internal/cmd/grpc.go", "internal/common/store_mock.go", "internal/server/ofrep/errors.go", "internal/server/ofrep/evaluation.go", "internal/server/ofrep/server.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-3b2c25ee8a3ac247c3fad13ad8d64ace34ec8ee7", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "ff63d6fb699f9d0892ad301b82d6145d67046b5d634394efc01f831be2e4240e"}+{"added": ["internal/config/testdata/tracing/wrong_propagator.yml", "internal/config/testdata/tracing/wrong_sampling_ratio.yml"], "base_commit": "91cc1b9fc38280a53a36e1e9543d87d7306144b2", "gold": ["config/flipt.schema.cue", "config/flipt.schema.json", "examples/openfeature/main.go", "go.mod", "go.sum", "internal/cmd/grpc.go", "internal/config/config.go", "internal/config/testdata/tracing/otlp.yml", "internal/config/tracing.go", "internal/server/evaluation/evaluation.go", "internal/server/evaluator.go", "internal/server/otel/attributes.go", "internal/storage/sql/db.go", "internal/tracing/tracing.go"], "hard": true, "instance_id": "instance_flipt-io__flipt-3d5a345f94c2adc8a0eaa102c189c08ad4c0f8e8", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "3745ba5660591643bdd87a70358e84ba04dc376b3a49cb996eaa5a8f158324ef"}+{"added": [], "base_commit": "0c6e9b3f3cd2a42b577a7d84710b6e2470754739", "gold": [".gitignore", "CHANGELOG.md", "Dockerfile", "cmd/flipt/config.go", "cmd/flipt/main.go", "config/default.yml", "config/local.yml", "config/production.yml", "docs/configuration.md", "go.mod"], "hard": false, "instance_id": "instance_flipt-io__flipt-406f9396ad65696d58865b3a6283109cd4eaf40e", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "d86ab357f1fcd4bebbcc710f07442e3546a400fc39a44c52e77097b186359c54"}+{"added": [], "base_commit": "d38a357b67ced2c3eba83e7a4aa71a1b2af019ae", "gold": ["config/flipt.schema.cue", "config/flipt.schema.json", "internal/cmd/grpc.go", "internal/config/cache.go", "internal/config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-492cc0b158200089dceede3b1aba0ed28df3fb1d", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "2241a16fb32a3b807990044afe3fb94f8658d1efdcc9059d04e9e8f34d8d7f15"}+{"added": ["internal/server/authz/engine/ext/extentions.go"], "base_commit": "5c6de423ccaad9eda072d951c4fc34e779308e95", "gold": ["internal/server/authz/engine/bundle/engine.go", "internal/server/authz/engine/rego/engine.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-507170da0f7f4da330f6732bffdf11c4df7fc192", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "f9f3657e111d92771a526bed88b121c156e3bb1ece81d26700a3a6d47b0fb432"}+{"added": [], "base_commit": "0018c5df774444117b107dfe3fe503d4c7126d73", "gold": ["internal/config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-518ec324b66a07fdd95464a5e9ca5fe7681ad8f9", "language": "go", "names_gold_path": true, "repo": "flipt-io/flipt", "text_sha256": "74c4ba918dd3fe21b7008de4f6092c67e4bc666d864cb1732c6c52f57a605586"}+{"added": [], "base_commit": "190b3cdc8e354d1b4d1d2811cb8a29f62cab8488", "gold": ["build/internal/cmd/generate/main.go", "internal/ext/common.go", "internal/ext/exporter.go", "internal/ext/importer.go", "internal/storage/fs/snapshot.go", "internal/storage/sql/common/rollout.go", "internal/storage/sql/common/rule.go"], "hard": true, "instance_id": "instance_flipt-io__flipt-524f277313606f8cd29b299617d6565c01642e15", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "f0e22c4abf2a4d3eabf6e0214896c9449165d692c553095ff5a221ef016517eb"}+{"added": ["internal/config/testdata/audit/invalid_webhook_url_not_provided.yml", "internal/server/audit/webhook/client.go", "internal/server/audit/webhook/webhook.go"], "base_commit": "32864671f44b7bbd9edc8e2bc1d6255906c31f5b", "gold": ["config/flipt.schema.cue", "config/flipt.schema.json", "go.mod", "go.work.sum", "internal/cmd/grpc.go", "internal/config/audit.go", "internal/server/audit/audit.go", "internal/server/audit/logfile/logfile.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-56a620b8fc9ef7a0819b47709aa541cdfdbba00b", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "d2b13449ffd420393145c674abb4e01d9e96301a5a79ea19ca7e17007e6ee815"}+{"added": [], "base_commit": "3e8ab3fdbd7b3bf14e1db6443d78bc530743d8d0", "gold": ["config/flipt.schema.cue", "config/flipt.schema.json", "internal/cmd/grpc.go", "internal/config/storage.go", "internal/storage/fs/git/source.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-5aef5a14890aa145c22d864a834694bae3a6f112", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "37f0843347981b71160f0613f984f9168f2a99a5c18afbcb87d2fa3f1adc6957"}+{"added": [], "base_commit": "d94448d3351ee69fd384b55f329003097951fe07", "gold": ["internal/config/authentication.go", "internal/server/auth/method/oidc/http.go", "internal/server/auth/method/oidc/server.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-5af0757e96dec4962a076376d1bedc79de0d4249", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "201bf928daa28c3a306bb758580d7d3c23f75d902a3ed7fff13e2df850cf8331"}+{"added": [], "base_commit": "4914fdf32b09e3a9ffffab9a7f4f007561cc13d0", "gold": ["Taskfile.yml", "cmd/flipt/main.go", "config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-5c7037ececb0bead0a8eb56054e224bcd7ac5922", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "92c439637ef519f663a5aa5b68230f97ce0c470e0045ffe0338f5ff2875b9079"}+{"added": [], "base_commit": "02f5a1f8ef79565d6f4efed09259e7bf6541437a", "gold": ["cmd/flipt/flipt.go", "config/config.go", "config/default.yml"], "hard": false, "instance_id": "instance_flipt-io__flipt-5ffba3406a7993d97ced4cc13658bee66150fcca", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "37552c8df197a30f67143a0858cb64f2b935256153e200717bbad68ea5dcb7f7"}+{"added": ["internal/tracing/tracing.go"], "base_commit": "6da20eb7afb693a1cbee2482272e3aee2fbd43ee", "gold": ["internal/cmd/grpc.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-690672523398c2b6f6e4562f0bf9868664ab894f", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "e4927938a716be70894c6853146eeb30c9b28d0f17655ba4580b77fbf73795c0"}+{"added": [], "base_commit": "edc61fb357077d0384391cdfefae4411d8a1848e", "gold": ["internal/server/auth/middleware.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-6fe76d024ee0c50ddb09c86f4ae0bd4c208fd65f", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "13ac6c3b7d2f6b6859b91c542cd479f37d4e099fc8f86c3898af31ffcfce89ab"}+{"added": [], "base_commit": "11775ea830dd27bccd3e28152309df91d754a11b", "gold": ["cmd/flipt/main.go", "go.work.sum", "internal/config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-7161f7b876773a911afdd804b281e52681cb7321", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "5ac49f137de1643c1cee344ae476ccdc6e4caea30681ae3aa6636227932a79d6"}+{"added": [], "base_commit": "b6edc5e46af598a3c187d917ad42b2d013e4dfee", "gold": ["README.md", "examples/audit/README.md", "internal/server/audit/logfile/logfile.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-72d06db14d58692bfb4d07b1aa745a37b35956f3", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "4aadb70f357b9a467176546bf5334d29c3139e0c88a1fe8c4a036d9c281f629f"}+{"added": [], "base_commit": "266e5e143e87519047b9be3202a0aba273b83de3", "gold": ["CHANGELOG.md", "DEPRECATIONS.md", "cmd/flipt/main.go", "internal/config/cache.go", "internal/config/config.go", "internal/config/ui.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-756f00f79ba8abf9fe53f3c6c818123b42eb7355", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "78f960c47cb5b6baebd429ccdf07bc5b4fc6c670a847e56d4ac5382b205054ff"}+{"added": [], "base_commit": "b22f5f02e40b225b6b93fff472914973422e97c6", "gold": ["cmd/flipt/bundle.go", "config/flipt.schema.cue", "config/flipt.schema.json", "internal/cmd/grpc.go", "internal/config/storage.go", "internal/oci/file.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-84806a178447e766380cc66b14dee9c6eeb534f4", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "3ba7fa00220e208fc00c5cbb4571ee0471a8fef49f009ba6f4feb09fa35d622b"}+{"added": [], "base_commit": "358e13bf5748bba4418ffdcdd913bcbfdedc9d3f", "gold": [".gitignore", "config/flipt.schema.cue", "config/flipt.schema.json", "go.work.sum", "internal/cmd/http.go", "internal/config/authentication.go", "internal/config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-86906cbfc3a5d3629a583f98e6301142f5f14bdb-v6bea0cc3a6fc532d7da914314f2944fc1cd04dee", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "1c52404f452ed068f06c2a61ca61f1171341f2c40d4c1026b1c38c07eaa0ab6d"}+{"added": ["internal/server/audit/template/leveled_logger.go"], "base_commit": "25a5f278e1116ca22f86d86b4a5259ca05ef2623", "gold": ["internal/cmd/grpc.go", "internal/server/audit/template/executer.go", "internal/server/audit/webhook/client.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-8bd3604dc54b681f1f0f7dd52cbc70b3024184b6", "language": "go", "names_gold_path": true, "repo": "flipt-io/flipt", "text_sha256": "9d372195dac094a4d35ecd14c9152c6a741c76ba1ceafbfa8c70ccd099633302"}+{"added": [], "base_commit": "3c6bd20465f0c801ebbcdadaf998e46b37b98e6b", "gold": ["CHANGELOG.md", "internal/server/evaluator.go", "rpc/flipt/flipt.pb.go", "rpc/flipt/flipt.proto", "swagger/flipt.swagger.json"], "hard": false, "instance_id": "instance_flipt-io__flipt-967855b429f749c28c112b8cb1b15bc79157f973", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "c6d6b22dc862958d18917839687499362a184e77195ab0d7dbcb9a9c1b5bdf1f"}+{"added": ["internal/server/evaluation/ofrep_bridge.go", "internal/server/ofrep/bridge_mock.go", "internal/server/ofrep/errors.go", "internal/server/ofrep/evaluation.go"], "base_commit": "fa8f302adcde48b4a94bf45726fe4da73de5e5ab", "gold": ["go.work.sum", "internal/cmd/grpc.go", "internal/server/ofrep/server.go", "rpc/flipt/flipt.yaml", "rpc/flipt/ofrep/ofrep.pb.go", "rpc/flipt/ofrep/ofrep.pb.gw.go", "rpc/flipt/ofrep/ofrep.proto", "rpc/flipt/ofrep/ofrep_grpc.pb.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-9d25c18b79bc7829a6fb08ec9e8793d5d17e2868", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "cd695a6498f29bc38b895f43cd43284d713a3439815473409ab8b24cf6bcda01"}+{"added": ["config/migrations/cockroachdb/0_initial.down.sql", "config/migrations/cockroachdb/0_initial.up.sql", "examples/cockroachdb/Dockerfile", "examples/cockroachdb/README.md", "examples/cockroachdb/docker-compose.yml", "logos/cockroachdb.svg"], "base_commit": "2d0ff0c91a63a1165f5ca528faa1f0785b1f730c", "gold": [".gitignore", "README.md", "Taskfile.yml", "cmd/flipt/export.go", "cmd/flipt/import.go", "cmd/flipt/main.go", "go.mod", "go.sum", "internal/config/database.go", "internal/storage/sql/db.go", "internal/storage/sql/migrator.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-9f8127f225a86245fa35dca4885c2daef824ee55", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "d3e3ecec30ded3616641a9471d72b6263f1c247956d7d168122614caabca9b62"}+{"added": [], "base_commit": "fee220d0a20adfb21686685bef2a1d6c2ff6fc17", "gold": ["internal/config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-a0cbc0cb65ae601270bdbe3f5313e2dfd49c80e4", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "65f972d4a5934e189012ab310036737db10ee75f43cee07bf0d00d9d3f96077b"}+{"added": [".gitleaksignore"], "base_commit": "ee02b164f6728d3227c42671028c67a4afd36918", "gold": ["go.mod", "go.sum", "internal/cmd/http.go", "internal/config/authentication.go", "ui/src/services/api.js", "ui/src/store/index.js"], "hard": false, "instance_id": "instance_flipt-io__flipt-a42d38a1bb1df267c53d9d4a706cf34825ae3da9", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "0e0d5ea06c501f89a580574ebe10cb20b1a11d08eea10fdb8852d797dde7eb37"}+{"added": [], "base_commit": "fddcf20f9e79532db9feade40395883565f6eb57", "gold": ["internal/cmd/auth.go", "internal/config/storage.go", "ui/src/app/meta/metaSlice.ts", "ui/src/components/Header.tsx", "ui/src/types/Meta.ts"], "hard": false, "instance_id": "instance_flipt-io__flipt-abaa5953795afb9c621605bb18cb32ac48b4508c", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "0079d8998f306c9eebab87ee98a073397df5965d8de06bf5e878153387a407e9"}+{"added": [], "base_commit": "1d550f0c0d693844b6f4b44fd7859254ef3569c0", "gold": ["go.work.sum", "internal/storage/fs/cache.go", "internal/storage/fs/git/store.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-aebaecd026f752b187f11328b0d464761b15d2ab", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "d745976011bc065262274b8520ba389eadc051f675c63c92d9dc9b84d63abbd9"}+{"added": [], "base_commit": "165ba79a44732208147f516fa6fa4d1dc72b7008", "gold": ["DEPRECATIONS.md", "config/default.yml", "config/flipt.schema.cue", "config/flipt.schema.json", "internal/cmd/grpc.go", "internal/config/cache.go", "internal/config/config.go", "internal/config/deprecations.go", "internal/config/tracing.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-af7a0be46d15f0b63f16a868d13f3b48a838e7ce", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "5861cbe3c913f5742f8eea15deefe33aebbf3a37189fc73751ac1231ac60096d"}+{"added": [], "base_commit": "5d544c9172ccf6c445c16ed333409930d2a1f0ad", "gold": ["internal/cmd/auth.go", "internal/cmd/grpc.go", "internal/server/audit/README.md", "internal/server/audit/checker.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b2170346dc37cf42fda1386cd630f24821ad2ac5", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "3fa81f9cfdd93440128b933ce035111a696fd500639f8a89723ea679ae2738c6"}+{"added": [], "base_commit": "08213a50b2cb54709aeb44125f33d55364ea6237", "gold": ["cmd/flipt/bundle.go", "internal/oci/file.go", "internal/oci/oci.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b22f5f02e40b225b6b93fff472914973422e97c6", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "c4c168bf32a0ef82fea52de2eeb20f248aedd5689ce4a1c8dcd5846ec61eab03"}+{"added": ["config/migrations/cockroachdb/13_segment_foreign_keys.up.sql", "config/migrations/mysql/15_segment_foreign_keys.up.sql", "config/migrations/postgres/16_segment_foreign_keys.up.sql", "config/migrations/sqlite3/15_segment_foreign_keys.up.sql"], "base_commit": "19fe7a3e92fc128acc75d0c5ececdc6d9a4e64e5", "gold": ["go.work.sum", "internal/storage/sql/migrator.go", "internal/storage/sql/mysql/mysql.go", "internal/storage/sql/postgres/postgres.go", "internal/storage/sql/sqlite/sqlite.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b2393f07d893024ab1e47ea2081e0289e1f9d56f", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "eb856137c039355261a28ed2a78808cbcdbd9d6169955fc201d2f666d6eab579"}+{"added": [], "base_commit": "d52e03fd5781eabad08e9a5b33c9283b8ffdb1ce", "gold": ["cmd/flipt/main.go", "go.mod", "internal/telemetry/telemetry.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b2cd6a6dd73ca91b519015fd5924fde8d17f3f06", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "d4f3b91d8d226f2041c7722398247195c6b34e1ef380dc2843b755c3294b42ac"}+{"added": [], "base_commit": "490cc12996575ec353e9755ca1c21e222a4e5191", "gold": ["cmd/flipt/export.go", "internal/ext/exporter.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b3cd920bbb25e01fdb2dab66a5a913363bc62f6c", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "74cdb5892bd52647745a3c3fe265a12e6b00b362812fcaf9755855779f05d7e8"}+{"added": ["examples/images/opentelemetry.svg", "examples/tracing/otlp/README.md", "examples/tracing/otlp/docker-compose.yml", "examples/tracing/otlp/otel-collector-config.yaml"], "base_commit": "4e066b8b836ceac716b6f63db41a341fb4df1375", "gold": ["DEPRECATIONS.md", "README.md", "config/default.yml", "config/flipt.schema.cue", "config/flipt.schema.json", "examples/authentication/dex/docker-compose.yml", "examples/authentication/proxy/docker-compose.yml", "examples/cockroachdb/docker-compose.yml", "examples/mysql/docker-compose.yml", "examples/openfeature/docker-compose.yml", "examples/openfeature/main.go", "examples/postgres/docker-compose.yml", "examples/prometheus/docker-compose.yml", "examples/redis/docker-compose.yml", "examples/tracing/README.md", "examples/tracing/jaeger/docker-compose.yml", "examples/tracing/zipkin/docker-compose.yml", "go.mod", "go.sum", "internal/cmd/grpc.go", "internal/config/config.go", "internal/config/deprecations.go", "internal/config/testdata/tracing/zipkin.yml", "internal/config/tracing.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b433bd05ce405837804693bebd5f4b88d87133c8", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "b76c228ffbd06eb6ae1411d92351683f98e6405f4d6b27f74e51de1a49047b35"}+{"added": [], "base_commit": "c2c0f7761620a8348be46e2f1a3cedca84577eeb", "gold": ["cmd/flipt/bundle.go", "config/flipt.schema.cue", "config/flipt.schema.json", "internal/config/storage.go", "internal/oci/file.go", "internal/storage/fs/store/store.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b4bb5e13006a729bc0eed8fe6ea18cff54acdacb", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "0db89209326807209ab3db43e581fa13ddb3e7a7d0bf7f152806b9d2eb123e87"}+{"added": ["internal/storage/unmodifiable/store.go"], "base_commit": "324b9ed54747624c488d7123c38e9420c3750368", "gold": ["internal/cmd/grpc.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b68b8960b8a08540d5198d78c665a7eb0bea4008", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "1b2af3620f572eade8e5aeba4c61dd78f32457c3d9d680bd756ef66307caf5a2"}+{"added": [], "base_commit": "1bd9924b177927fa51d016a71a4353ab9c0d32e7", "gold": ["internal/cmd/auth.go", "internal/server/auth/http.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-b6cef5cdc0daff3ee99e5974ed60a1dc6b4b0d67", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "3ed5b5ed37cfc855433dc4c856ed09e84cd4ddc7696f59ce55a09d802aef7766"}+{"added": [], "base_commit": "3bf3255a7b7e2cbe9f71ec167f16a5449a357a5e", "gold": ["internal/cmd/grpc.go", "internal/server/auth/middleware.go", "internal/server/middleware/grpc/middleware.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-c12967bc73fdf02054cf3ef8498c05e25f0a18c0", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "892ca1659f2b3f50932b7d587838796ff94c5dbe477ba191c6621872a22a83e6"}+{"added": [".github/workflows/snapshot.yml"], "base_commit": "e432032cf2d11e3bb6f558748a5ee41a90640daa", "gold": [".github/workflows/benchmark.yml", ".github/workflows/codeql-analysis.yml", ".golangci.yml", ".goreleaser.yml", "CHANGELOG.md", "Makefile", "README.md", "build/Dockerfile", "build/build", "cmd/flipt/flipt.go", "config/config.go", "go.mod", "go.sum"], "hard": false, "instance_id": "instance_flipt-io__flipt-c154dd1a3590954dfd3b901555fc6267f646a289", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "0ef768d161332adca9cbbdd8f4ca4e54843d7d39d2f9e17a82b5970cb1c34717"}+{"added": ["cmd/flipt/validate.go", "internal/cue/fixtures/invalid.yaml", "internal/cue/fixtures/valid.yaml", "internal/cue/flipt.cue", "internal/cue/validate.go"], "base_commit": "775da4fe5fcbc163ab01fd9a809fdbddd9a87ebd", "gold": ["cmd/flipt/main.go", "go.mod", "go.sum"], "hard": true, "instance_id": "instance_flipt-io__flipt-c1728053367c753688f114ec26e703c8fdeda125", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "0824798137251d2f80b34cd3a506b0f52525718f908945ab024c8f840b0c65a7"}+{"added": ["internal/config/testdata/storage/oci_provided_aws_ecr.yml", "internal/config/testdata/storage/oci_provided_invalid_auth.yml", "internal/config/testdata/storage/oci_provided_no_auth.yml", "internal/oci/ecr/ecr.go", "internal/oci/ecr/mock_client.go", "internal/oci/options.go"], "base_commit": "47499077ce785f0eee0e3940ef6c074e29a664fc", "gold": ["cmd/flipt/bundle.go", "config/flipt.schema.cue", "config/flipt.schema.json", "go.mod", "go.sum", "go.work.sum", "internal/config/storage.go", "internal/oci/file.go", "internal/storage/fs/store/store.go"], "hard": true, "instance_id": "instance_flipt-io__flipt-c188284ff0c094a4ee281afebebd849555ebee59", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "e2a39daedc64bac22c59274ffc59e27c17986a295a8f39bea3fdbe9e56328f8b"}+{"added": [], "base_commit": "dbe263961b187e1c5d7fe34c65b000985a2da5a0", "gold": ["go.work.sum", "internal/config/authentication.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-c1fd7a81ef9f23e742501bfb26d914eb683262aa", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "1956ae1a0ec53775bc7414633cc0c051f96f498570a1ee2026fc873d803e60e0"}+{"added": ["rpc/flipt/flipt.go"], "base_commit": "dc07fbbd64b05a6f14cc16aa5bcbade2863f9d53", "gold": ["cmd/flipt/export.go", "cmd/flipt/import.go", "internal/ext/common.go", "internal/ext/exporter.go", "internal/ext/importer.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-c6a7b1fd933e763b1675281b30077e161fa115a1", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "4a700e167093468a54e766e330e31a68cc6c54fac1ca52892a4dda0310bf4459"}+{"added": [], "base_commit": "29d3f9db40c83434d0e3cc082af8baec64c391a9", "gold": ["cmd/flipt/validate.go", "internal/cue/flipt.cue", "internal/cue/validate.go", "internal/storage/fs/snapshot.go", "internal/storage/fs/store.go", "internal/storage/fs/sync.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-c8d71ad7ea98d97546f01cce4ccb451dbcf37d3b", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "dfe47f4e43dc54ac885145abea6418c9460fbe8c713d0973e07211ce0aa671d6"}+{"added": [], "base_commit": "9e469bf851c6519616c2b220f946138b71fab047", "gold": ["config/flipt.schema.cue", "internal/config/authentication.go", "internal/config/config.go", "internal/config/database.go", "internal/config/storage.go", "internal/config/testdata/advanced.yml"], "hard": true, "instance_id": "instance_flipt-io__flipt-cd18e54a0371fa222304742c6312e9ac37ea86c1", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "7db303bbffdd10dcfa49f27932ba62695bb92627db116dd4cdb64fe2f6c38e63"}+{"added": [], "base_commit": "a91a0258e72c0f0aac3d33ae5c226a85c80ecdf8", "gold": ["internal/server/evaluation/legacy_evaluator.go", "rpc/flipt/operators.go", "rpc/flipt/validation.go", "ui/src/app/segments/Segment.tsx", "ui/src/components/segments/ConstraintForm.tsx", "ui/src/data/validations.ts", "ui/src/types/Constraint.ts"], "hard": false, "instance_id": "instance_flipt-io__flipt-cd2f3b0a9d4d8b8a6d3d56afab65851ecdc408e8", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "cfa3411670c50f6dd9b9c56404ae1791ad082c778249f2041f4e17922e5bca9f"}+{"added": [], "base_commit": "962f8d028e1a2e1dd8a87035d7d8d85eb6665eaf", "gold": ["rpc/flipt.pb.go", "rpc/flipt.proto", "rpc/flipt_grpc.pb.go", "server/evaluator.go", "swagger/flipt.swagger.json"], "hard": false, "instance_id": "instance_flipt-io__flipt-cf06f4ebfab7fa21eed3e5838592e8e44566957f", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "17de8a3e00bfbf6dcd9f6cb04ffd1735d273132dbf2bf80d0d1d1fe19dfbf22e"}+{"added": [], "base_commit": "16e240cc4b24e051ff7c1cb0b430cca67768f4bb", "gold": ["cmd/flipt/bundle.go", "cmd/flipt/export.go", "cmd/flipt/import.go", "cmd/flipt/main.go", "cmd/flipt/migrate.go", "cmd/flipt/validate.go", "internal/config/config.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-d966559200183b713cdf3ea5007a7e0ba86a5afb", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "83edc038860504199306cfd8ee9fa9d668587394aa3a007b0263c6aff870c8fa"}+{"added": [], "base_commit": "879520526664656ad9f93925cd0b1f2220c0c3f2", "gold": ["cmd/flipt/import.go", "internal/ext/importer.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-dae029cba7cdb98dfb1a6b416c00d324241e6063", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "6f417fb378dabe3c452a4091d44b3a7975824d174324f9cd113458070555ae37"}+{"added": [], "base_commit": "6c91b1ad50c452d90c484888690eb6257ee2c20a", "gold": ["internal/server/evaluation/legacy_evaluator.go", "rpc/flipt/operators.go", "ui/src/types/Constraint.ts"], "hard": false, "instance_id": "instance_flipt-io__flipt-db1c3b100e231c62f0c90c2ab037614f20a2a63b", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "c2204f01b930432135d3279ce73a7ea0962c4cecf88e40577f9c34226d5fdcd3"}+{"added": [], "base_commit": "8ba3ab7d7ac8f552e61204103f5632ab8843a721", "gold": ["go.work.sum", "internal/config/config.go", "internal/config/database.go", "internal/storage/fs/git/store.go", "internal/storage/fs/local/store.go", "internal/storage/fs/object/azblob/store.go", "internal/storage/fs/object/s3/store.go", "internal/storage/fs/oci/store.go", "internal/storage/fs/poll.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-dbe263961b187e1c5d7fe34c65b000985a2da5a0", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "92fff80bcb490e5d53123853a9a0fd6c9f1a0096529af8ea0c239aecb773adfd"}+{"added": [], "base_commit": "0eaf98f050d86247bfe9bd7e41178865cb585060", "gold": ["build/hack/loadtest.go", "internal/cache/cache.go", "internal/cmd/grpc.go", "internal/cmd/http.go", "internal/server/middleware/grpc/middleware.go", "internal/storage/auth/cache/cache.go", "internal/storage/cache/cache.go"], "hard": true, "instance_id": "instance_flipt-io__flipt-e2bd19dafa7166c96b082fb2a59eb54b4be0d778", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "a93c7641ebf1d03f1b2ad41659be29cbb4e991e763bc3f637136415d2d5d8c0a"}+{"added": ["internal/config/audit.go", "internal/config/testdata/audit/invalid_buffer_capacity.yml", "internal/config/testdata/audit/invalid_enable_without_file.yml", "internal/config/testdata/audit/invalid_flush_period.yml", "internal/server/audit/README.md", "internal/server/audit/audit.go", "internal/server/audit/logfile/logfile.go"], "base_commit": "5069ba6fa22fbbf208352ff341ea7a85d6eca29f", "gold": ["go.mod", "internal/cmd/grpc.go", "internal/config/config.go", "internal/server/middleware/grpc/middleware.go", "internal/server/otel/noop_provider.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-e50808c03e4b9d25a6a78af9c61a3b1616ea356b", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "e030f1f8abd6117586a6bba814c4aed9f39399b350775fa5af1ab51b8f19c6fe"}+{"added": ["internal/cue/extended.cue"], "base_commit": "f9855c1e6110ab7ff24d3d278229a45776e891ae", "gold": ["internal/cue/validate.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-e594593dae52badf80ffd27878d2275c7f0b20e9", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "c421772bd474ba93788edf2be11aaf8d07349af69bbdcc4bdfd880ed9546000c"}+{"added": ["internal/storage/fs/oci/source.go"], "base_commit": "6fd0f9e2587f14ac1fdd1c229f0bcae0468c8daa", "gold": ["internal/oci/file.go", "internal/storage/fs/git/source.go", "internal/storage/fs/local/source.go", "internal/storage/fs/s3/source.go", "internal/storage/fs/store.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-e5fe37c379e1eec2dd3492c5737c0be761050b26", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "1492877404e629fbbb50d1c6a5fbe0cc1402b1c381cf277a0420ff034b5c16f1"}+{"added": [], "base_commit": "7ee465fe8dbcf9b319c70ef7f3bfd00b3aaab6ca", "gold": ["internal/server/evaluation/evaluation.go", "rpc/flipt/evaluation/evaluation.pb.go", "rpc/flipt/evaluation/evaluation.proto"], "hard": false, "instance_id": "instance_flipt-io__flipt-e88e93990e3ec1e7697754b423decc510d5dd5fe", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "c13e74ba5443c7601b2c7f0ad430d28368a34c72dda450d64cb4be3e5586c54b"}+{"added": ["internal/ext/common.go", "internal/ext/exporter.go", "internal/ext/importer.go", "internal/ext/testdata/export.yml", "internal/ext/testdata/import.yml", "internal/ext/testdata/import_no_attachment.yml"], "base_commit": "bdf53a4ec2288975416f9292634bb120ac47eef3", "gold": [".dockerignore", "CHANGELOG.md", "Dockerfile", "cmd/flipt/export.go", "cmd/flipt/import.go", "cmd/flipt/main.go", "storage/storage.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-e91615cf07966da41756017a7d571f9fc0fdbe80", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "ef1ce349d3c96d633c34dfb808ed0c7888f3cc93059bb27e68416f1ac7204c4f"}+{"added": [], "base_commit": "866ba43dd49c238c97831362cdab50630b0b9aa7", "gold": ["internal/server/authz/authz.go", "internal/server/authz/engine/bundle/engine.go", "internal/server/authz/engine/rego/engine.go", "internal/server/authz/middleware/grpc/middleware.go", "internal/server/namespace.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-ea9a2663b176da329b3f574da2ce2a664fc5b4a1", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "fc7ecfb77672316c75d6afe8af54d799893ce55f5300f7f927f43480fceab10d"}+{"added": [], "base_commit": "9c3cab439846ad339a0a9aa73574f0d05849246e", "gold": ["config/flipt.schema.cue", "config/flipt.schema.json", "internal/cmd/auth.go", "internal/config/authentication.go", "internal/storage/auth/auth.go", "internal/storage/auth/bootstrap.go", "internal/storage/auth/memory/store.go", "internal/storage/auth/sql/store.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-ebb3f84c74d61eee4d8c6875140b990eee62e146", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "fe3dbd2d2e4ab5dad530ce067bd9e220ae1abb0e0f0a8a284578a20dabd7c8f9"}+{"added": ["internal/release/check.go"], "base_commit": "e38e41543f08b762904ed8a08969d0b6aba67166", "gold": ["cmd/flipt/main.go", "go.mod"], "hard": false, "instance_id": "instance_flipt-io__flipt-ee02b164f6728d3227c42671028c67a4afd36918", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "fa56ff5d59a91a018ff481645b795f8a9f482f7b620a91ef50b41c6f21ced51e"}+{"added": ["server/evaluator.go", "storage/evaluator.go"], "base_commit": "56d261e7c28e47faf537061e6ad3b306459a3e93", "gold": ["server/rule.go", "server/server.go", "storage/rule.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-f1bc91a1b999656dbdb2495ccb57bf2105b84920", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "39381b0ff8c5a38bfe61ab590b92ce58c8f759a344cc49fc731e24fe7b46208f"}+{"added": [], "base_commit": "54e188b64f0dda5a1ab9caf8425f94dac3d08f40", "gold": ["cmd/flipt/validate.go", "internal/cue/fixtures/invalid.yaml", "internal/cue/validate.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-f36bd61fb1cee4669de1f00e59da462bfeae8765", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "76dfc2633557911b972aaca2db695439c364cba852b65bfb4d6e6ab9274374fa"}+{"added": ["cmd/flipt/default.go", "cmd/flipt/default_linux.go"], "base_commit": "820f90fd26c5f8651217f2edee0e5770d5f5f011", "gold": ["cmd/flipt/main.go", "internal/config/config.go", "ui/src/app/preferences/preferencesSlice.ts"], "hard": false, "instance_id": "instance_flipt-io__flipt-f743945d599b178293e89e784b3b2374b1026430", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "5675e1bbe94c8d3b9a0a523040e6997d8813d9cf9da5ca43497d970cf9bc4897"}+{"added": ["config/testdata/config/database.yml"], "base_commit": "d26eba77ddd985eb621c79642b55b607cf125941", "gold": ["cmd/flipt/flipt.go", "cmd/flipt/import.go", "config/config.go", "go.mod", "go.sum", "storage/db/db.go", "storage/db/migrator.go"], "hard": false, "instance_id": "instance_flipt-io__flipt-f808b4dd6e36b9dc8b011eb26b196f4e2cc64c41", "language": "go", "names_gold_path": false, "repo": "flipt-io/flipt", "text_sha256": "b239398ce16d913527582182dc880d5873454a737865b921271d1b1c7e981164"}+{"added": [], "base_commit": "4a28722e4aa14f1d125ae789b9966c658d60c0ed", "gold": ["contrib/snmp2cpe/pkg/cpe/cpe.go"], "hard": false, "instance_id": "instance_future-architect__vuls-01441351c3407abfc21c48a38e28828e1b504e0c", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "d84a291f42f3b1feeadbeace37a7a489f09c87d65e446c80d721034d269bbb1a"}+{"added": [], "base_commit": "2c51bcf4764b7e0fd151a1ceb5cde0640a971fb1", "gold": ["config/os.go", "scanner/windows.go"], "hard": false, "instance_id": "instance_future-architect__vuls-030b2e03525d68d74cb749959aac2d7f3fc0effa", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "0a849fccf2b9e7a918eeed79bbcb2c014e169f3aae65c8ba693d25947abef626"}+{"added": [], "base_commit": "d3bf2a6f26e8e549c0732c26fdcc82725d3c6633", "gold": ["scanner/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-0ec945d0510cdebf92cdd8999f94610772689f14", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "d3426fa5e32797d05ee5297cf1ff2a733cbe05516c112efb656dd24ef0305e99"}+{"added": [], "base_commit": "2d369d0cfe61ca06294b186eecb348104e9c98ae", "gold": ["oval/util.go"], "hard": false, "instance_id": "instance_future-architect__vuls-17ae386d1e185ba742eea4668ca77642e22b54c4", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "47c6574e626abe9111c779402f88ec7534ae5205a2c248ca1bfc4562d91e0ab3"}+{"added": ["scanner/macos.go"], "base_commit": "78b52d6a7f480bd610b692de9bf0c86f57332f23", "gold": [".goreleaser.yml", "README.md", "config/os.go", "constant/constant.go", "detector/detector.go", "scanner/base.go", "scanner/freebsd.go", "scanner/scanner.go"], "hard": false, "instance_id": "instance_future-architect__vuls-1832b4ee3a20177ad313d806983127cb6e53f5cf", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "82e1c48efd00aca86efaf852fb00048ef78b5663f287f8d2cacdbaddd065e2ac"}+{"added": [], "base_commit": "7c209cc9dc71e30bf762677d6a380ddc93d551ec", "gold": ["config/config.go", "config/os.go", "gost/redhat.go", "oval/oval.go", "oval/util.go", "scanner/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-2923cbc645fbc7a37d50398eb2ab8febda8c3264", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "fa57223b7c128432a4ae39275dd6b10173360962af503080cc0df51ba1e0488a"}+{"added": [], "base_commit": "4c598bb9726d68b6fdef264b26fc700591b303f6", "gold": ["scanner/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-2c84be80b65d022c262956cd26fc79d8bb2f7010", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "833e63a9a28ebc30f826d054bdf8475ad8d1f894b33eb76cc2a840b2b7b4a3d4"}+{"added": [], "base_commit": "4ae87cc36cb1b1dbc7fd49680d553c8bb47fa8b6", "gold": ["report/report.go", "wordpress/wordpress.go"], "hard": false, "instance_id": "instance_future-architect__vuls-36456cb151894964ba1683ce7da5c35ada789970", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "d37e20aca0a1f9abf6c9e73e9a15f1a6a4f78507ecc19eb71c2fa2f40784c2e3"}+{"added": [], "base_commit": "e4f1e03f6234bbe88564bdfc2d23f120db3c67a6", "gold": ["models/scanresults.go", "models/vulninfos.go", "report/slack.go", "report/syslog.go", "report/tui.go", "report/util.go"], "hard": false, "instance_id": "instance_future-architect__vuls-3c1489e588dacea455ccf4c352a3b1006902e2d4", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "d3628776e43ec3232af1cd598dbd09d2b569dfe4890419620f645b3252fb9245"}+{"added": [], "base_commit": "d02535d053e724cb7ac6f8c192aba353509076ae", "gold": ["models/packages.go", "report/report.go", "report/tui.go", "report/util.go", "scan/base.go", "scan/debian.go", "scan/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-3f8de0268376e1f0fa6d9d61abb0d9d3d580ea7d", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "49a54508208ce2bba2b36514939ec0e39829e13380626c6f29456ce15bf9f6cd"}+{"added": [], "base_commit": "2cd2d1a9a21e29c51f63c5dab938b9efc09bb862", "gold": ["config/os.go", "scanner/windows.go"], "hard": false, "instance_id": "instance_future-architect__vuls-436341a4a522dc83eb8bddd1164b764c8dd6bc45", "language": "go", "names_gold_path": true, "repo": "future-architect/vuls", "text_sha256": "606242cc275162b6df936c5729ce429e7e2a25af49d59b8e0936b16a58317b32"}+{"added": [], "base_commit": "4253550c999d27fac802f616dbe50dd884e93f51", "gold": ["scanner/windows.go"], "hard": false, "instance_id": "instance_future-architect__vuls-457a3a9627fb9a0800d0aecf1d4713fb634a9011", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "a3b702ea0cb38524cdaf97a06b4f4d0b935a743c12c76a25352567f26a878f23"}+{"added": [], "base_commit": "8a8ab8cb18161244ee6f078b43a89b3588d99a4d", "gold": ["models/scanresults.go", "report/stdout.go", "scan/freebsd.go"], "hard": false, "instance_id": "instance_future-architect__vuls-4b680b996061044e93ef5977a081661665d3360a", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "384821ce57c6cb1f17208b248a8f5dcc71ab3b1724f9ad15c2948c632afa6a68"}+{"added": [], "base_commit": "1c4f2315727ae4370177b9c1a540fc8b0c0a7c91", "gold": ["config/config.go", "models/scanresults.go", "models/vulninfos.go", "report/localfile.go", "report/report.go", "report/slack.go", "report/tui.go", "report/util.go", "subcmds/report.go", "subcmds/tui.go"], "hard": false, "instance_id": "instance_future-architect__vuls-4c04acbd9ea5b073efe999e33381fa9f399d6f27", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "850440724845d9d592d0bfa8c0cd45f135a3f88c4b436726d50d697e4f45cd21"}+{"added": [], "base_commit": "472df0e1b6ab9b50f8605af957ad054c7a732938", "gold": ["detector/wordpress.go"], "hard": false, "instance_id": "instance_future-architect__vuls-50580f6e98eeb36f53f27222f7f4fdfea0b21e8d", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "558a6e6268ba432efa2b350e66b8a457bad3f9b66b6ec1b9e3267e5efd7a8626"}+{"added": [], "base_commit": "2d075079f112658b02e67b409958d5872477aad6", "gold": ["NOTICE", "detector/detector.go", "detector/wordpress.go", "models/scanresults.go", "models/vulninfos.go"], "hard": false, "instance_id": "instance_future-architect__vuls-54e73c2f5466ef5daec3fb30922b9ac654e4ed25", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "b3bc8aa7f1594ce31d1d8d9c655686eaceaccfa71b680261aa1ebf9c97975f41"}+{"added": [], "base_commit": "053306944695e6616f320393f865f667e984481d", "gold": ["oval/redhat.go", "oval/util.go", "scanner/redhatbase.go", "scanner/utils.go"], "hard": true, "instance_id": "instance_future-architect__vuls-5af1a227339e46c7abf3f2815e4c636a0c01098e", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "9f1211b7840f00d7c8c8da3051e0c9bb228dd17e936bbe2c4d8ad882ecd0c643"}+{"added": [], "base_commit": "f1c384812a1541f7c859488daeff03a008bce7fc", "gold": ["models/packages.go", "oval/util.go", "scanner/base.go", "scanner/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-61c39637f2f3809e1b5dad05f0c57c799dce1587", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "e9adc4415cb7b0f70270d98d7b32fc84a28028bc1cdd168fc6abde4e6c55c3ee"}+{"added": [], "base_commit": "984debe929fad8e248489e2a1d691b0635e6b120", "gold": ["config/os.go", "oval/redhat.go", "oval/util.go", "scanner/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-6682232b5c8a9d08c0e9f15bd90d41bff3875adc", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "a3894f4d74c90e931d60d4abe63f9d495f9c3d923ccc5af5bf060ab7b29a2b22"}+{"added": ["config/os.go"], "base_commit": "69d32d45116aefd871327b9254977015a57995b8", "gold": ["config/config.go", "oval/debian.go", "oval/util.go", "report/util.go", "scan/serverapi.go", "subcmds/scan.go", "util/util.go"], "hard": false, "instance_id": "instance_future-architect__vuls-6eff6a9329a65cc412e79b8f82444dfa3d0f0b5a", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "0092857f7c581b0c859e33beef13517ad608b6409c23f49751088e52ffa3c86c"}+{"added": [], "base_commit": "048e204b330494643a3b6859a68c31b4b2126f59", "gold": ["detector/cve_client.go", "detector/detector.go", "go.mod", "go.sum", "models/cvecontents.go", "models/utils.go", "models/vulninfos.go", "server/server.go"], "hard": false, "instance_id": "instance_future-architect__vuls-78b52d6a7f480bd610b692de9bf0c86f57332f23", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "92dba0eaaa34204e6074e37f901898c1b5d8a7c930bdf90a05887203534e28bd"}+{"added": [], "base_commit": "76267a54fcb1cb1aea83e34e2673d88bf8987f05", "gold": ["contrib/trivy/pkg/converter.go", "models/packages.go"], "hard": false, "instance_id": "instance_future-architect__vuls-7e91f5ef7e5712b1a3d7d5066ad6607e9debc21c", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "28541c9ba1b9170da1e9ac9ed7860f436b6a8b8dfb4418d09cc153b1f474b818"}+{"added": ["config/portscan.go"], "base_commit": "e1152352999e04f347aaaee64b5b4e361631e7ac", "gold": ["Dockerfile", "config/config.go", "config/tomlloader.go", "go.mod", "go.sum", "scanner/base.go", "subcmds/discover.go"], "hard": false, "instance_id": "instance_future-architect__vuls-7eb77f5b5127c847481bcf600b4dca2b7a85cf3e", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "1a38a542870cc0c2c3892f90605d52418bd1bda89695aeab9c6153f5a518836c"}+{"added": [], "base_commit": "a124518d78779cd9daefd92bb66b25da37516363", "gold": ["models/packages.go", "report/tui.go", "report/util.go", "scan/base.go", "scan/debian.go", "scan/redhatbase.go", "scan/serverapi.go"], "hard": false, "instance_id": "instance_future-architect__vuls-83bcca6e669ba2e4102f26c4a2b52f78c7861f1a", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "3ede86487fe9b99d058d93a58774848af338cb81b7dddb8f84eb390ed309dd53"}+{"added": [], "base_commit": "e07b6a916080426af5ad92e13383ca72c31330d1", "gold": ["detector/detector.go", "go.mod", "go.sum", "models/vulninfos.go"], "hard": false, "instance_id": "instance_future-architect__vuls-8659668177f1feb65963db7a967347a79c5f9c40", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "38c443922219cabf8f3ffdd5462568e88105024e67e77f17bd80b592c4a66e08"}+{"added": [], "base_commit": "42fdc08933d2b60adc555972b32ae599386b0b9c", "gold": ["config/config.go", "config/tomlloader.go", "go.mod", "go.sum", "subcmds/configtest.go", "subcmds/discover.go", "subcmds/scan.go"], "hard": false, "instance_id": "instance_future-architect__vuls-86b60e1478e44d28b1aff6b9ac7e95ceb05bc5fc", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "797fb3813e1233724d28fd0c21c6d419645051726eec30f2392460bac1ee9d24"}+{"added": [], "base_commit": "e4728e388120b311c4ed469e4f942e0347a2689b", "gold": ["contrib/trivy/pkg/converter.go", "detector/library.go", "models/cvecontents.go", "models/vulninfos.go", "tui/tui.go"], "hard": false, "instance_id": "instance_future-architect__vuls-878c25bf5a9c9fd88ac32eb843f5636834d5712d", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "971c7f58941159bd818450f7d310b7130106d5f0ba1a6182f055a9e00748ff13"}+{"added": [], "base_commit": "835dc080491a080c8b68979fb4efc38c4de2ce3f", "gold": ["commands/report.go", "config/config.go", "go.mod", "go.sum", "wordpress/wordpress.go"], "hard": false, "instance_id": "instance_future-architect__vuls-8d5ea98e50cf616847f4e5a2df300395d1f719e9", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "cded133273147886aed99e2b8e5573d0fe457a03273d1409bc33f2b2bc9f9157"}+{"added": [], "base_commit": "847d820af7fb48131086afe43f79ce79f61122c7", "gold": ["scanner/scanner.go"], "hard": false, "instance_id": "instance_future-architect__vuls-999529a05b202b0fd29c6fca5039a4c47a3766bb", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "7b02f53711d5d992f65dc6a6b1fe8471111d181f686abc87a0f628700c859651"}+{"added": [], "base_commit": "2534098509025989abe9b69bebb6fba6e9c5488b", "gold": ["gost/debian.go", "models/packages.go", "models/scanresults.go", "oval/oval.go", "report/report.go", "scan/base.go", "scan/serverapi.go"], "hard": false, "instance_id": "instance_future-architect__vuls-9a32a94806b54141b7ff12503c48da680ebcf199", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "f02cd8223fc3b31397386b0a58badf7b409fdc272308ab3a38c9a1d784ad6063"}+{"added": [], "base_commit": "fe3f1b99245266e848f7b8f240f1f81ae3ff04df", "gold": ["config/config.go", "config/tomlloader.go", "models/scanresults.go", "report/report.go", "scan/base.go", "scan/container.go", "scan/serverapi.go"], "hard": false, "instance_id": "instance_future-architect__vuls-9aa0d87a21bede91c2b45c32187456bb69455e92", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "31980d2cd5995545e183143cd5f62b68522dda61b6f79af3572cf77698b0e96e"}+{"added": [], "base_commit": "d8173cdd422ec9f7dfc6a43f75e905dca151a6d9", "gold": ["go.mod", "go.sum", "models/utils.go", "models/vulninfos.go"], "hard": false, "instance_id": "instance_future-architect__vuls-a76302c11174ca081f656c63a000ffa746e350af", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "14d45ff9b2ac88687ac8b81d9efd2438077fe4107823833c719d6fbc652a7d27"}+{"added": [], "base_commit": "83d1f80959307f189bb0e4571f22f2dd0d669354", "gold": ["config/config.go", "report/report.go", "subcmds/configtest.go", "subcmds/saas.go", "subcmds/scan.go", "wordpress/wordpress.go"], "hard": false, "instance_id": "instance_future-architect__vuls-aaea15e516ece43978cf98e09e52080478b1d39f", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "b9f92e911140b50629e0d8e986be209e2cc3bec7ac42a705046181c99eeaa3d4"}+{"added": [], "base_commit": "847c6438e7604bf45a6a4efda0925f41b4f14d7f", "gold": ["scan/base.go", "scan/debian.go", "scan/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-abd80417728b16c6502067914d27989ee575f0ee", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "a5c08fa07850acad8b027e6bdf107d253d26b2c1f65dfaaaf21b79715f7239c2"}+{"added": [], "base_commit": "bfe0db77b4e16e3099a1e58b8db8f18120a11117", "gold": ["config/os.go", "detector/detector.go", "go.mod", "go.sum", "gost/redhat.go", "gost/ubuntu.go", "gost/util.go", "oval/debian.go"], "hard": false, "instance_id": "instance_future-architect__vuls-ad2edbb8448e2c41a097f1c0b52696c0f6c5924d", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "aabd7cdbc907a29d7a560837d29640b5dad5342d88a381b2633f4b2de5ca64b1"}+{"added": [], "base_commit": "43b46cb324f64076e4d9e807c0b60c4b9ce11a82", "gold": ["detector/detector.go", "gost/debian.go", "gost/gost.go", "gost/microsoft.go", "gost/pseudo.go", "gost/redhat.go", "gost/util.go", "models/scanresults.go", "oval/debian.go"], "hard": false, "instance_id": "instance_future-architect__vuls-b8db2e0b74f60cb7d45f710f255e061f054b6afc", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "75c1770fb1768f9910412fecfa30ca39d8aac76ff85386bf58e26afd183c56d2"}+{"added": [], "base_commit": "bf14b5f61f7a65cb64cf762c71885a413a9fcb66", "gold": ["contrib/trivy/pkg/converter.go", "models/library.go", "scanner/library.go"], "hard": false, "instance_id": "instance_future-architect__vuls-be7b9114cc9545e68fb0ee7bc63d7ec53d1a00ad", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "957e85afb054ccd51db04b68f0df36ea83eba936b614a3bafdb26ac45962e9ce"}+{"added": [], "base_commit": "6fca8d97c145fbe50a247dd222947a240639fd50", "gold": ["scanner/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-bff6b7552370b55ff76d474860eead4ab5de785a-v1151a6325649aaf997cd541ebe533b53fddf1b07", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "b941ee05422d84c7ab4204679dea3517ffa030880fe55409fc4f0ff0d3e5a47a"}+{"added": [], "base_commit": "8a611f9ba6d470cbaa3b781c92c96f5fc9f0b3ba", "gold": ["go.mod", "go.sum", "libmanager/libManager.go", "models/library.go", "report/tui.go", "report/util.go", "scan/base.go"], "hard": false, "instance_id": "instance_future-architect__vuls-c11ba27509f733d7d280bdf661cbbe2e7a99df4c", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "5040ffb9adf40299e1a11f1732327b1bed742f841b60eb859a77e96c655fac06"}+{"added": [], "base_commit": "f1c78e42a22aaefe3aa816c0ebd47a845850b856", "gold": ["config/os.go", "go.mod", "go.sum", "oval/util.go", "scanner/redhatbase.go"], "hard": true, "instance_id": "instance_future-architect__vuls-ca3f6b1dbf2cd24d1537bfda43e788443ce03a0c", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "77f6424f78c7968348c73c701dd25af39d2c4324e01b4a4943578800c21dd7d8"}+{"added": [], "base_commit": "fd18df1dd4e4360f8932bc4b894bd8b40d654e7c", "gold": ["config/os.go", "go.mod", "go.sum", "gost/ubuntu.go", "oval/debian.go"], "hard": false, "instance_id": "instance_future-architect__vuls-cc63a0eccfdd318e67c0a6edeffc7bf09b6025c0", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "9bfdcd6bb51ef202425990d3414ba24105ef7e66f55cbf547b0222887b32b395"}+{"added": ["contrib/future-vuls/README.md", "contrib/future-vuls/cmd/main.go", "contrib/trivy/README.md", "contrib/trivy/cmd/main.go", "contrib/trivy/parser/parser.go"], "base_commit": "8d5ea98e50cf616847f4e5a2df300395d1f719e9", "gold": [".gitignore", "GNUmakefile", "config/config.go", "go.mod", "go.sum", "report/saas.go"], "hard": false, "instance_id": "instance_future-architect__vuls-d18e7a751d07260d75ce3ba0cd67c4a6aebfd967", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "24534154458f3747d5da6fdb259e7739f1ac1f19d53ed5e42699c3728e116a0e"}+{"added": [], "base_commit": "514eb71482ee6541dd0151dfc7d2c7c7c78b6e44", "gold": ["config/config.go", "libmanager/libManager.go", "oval/debian.go", "oval/util.go", "report/db_client.go", "report/report.go", "report/util.go", "server/server.go"], "hard": false, "instance_id": "instance_future-architect__vuls-d576b6c6c15e56c47cc3e26f5878867677d4a9ea", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "80e5e5ee53afbd57b57e7805e16d70432f64ac5ed1a1bbef44b4f17ed971a89a"}+{"added": [".github/workflows/build.yml", "config/syslog/syslogconf_windows.go", "config/syslog/types.go"], "base_commit": "54dae08f54aade659d1733e9bc1b2674e7526f29", "gold": ["config/config.go", "config/config_windows.go", "config/syslogconf.go", "reporter/syslog.go"], "hard": false, "instance_id": "instance_future-architect__vuls-dc496468b9e9fb73371f9606cdcdb0f8e12e70ca", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "aec0b3894153b74aabdc426b741057e2d2b96417b6393e2a5f0807d6a9d914a5"}+{"added": [], "base_commit": "dce837950529084d34c6815fa66e59a4f68fa8e4", "gold": ["README.md", "detector/kevuln.go", "go.mod", "go.sum", "models/scanresults.go", "models/vulninfos.go", "reporter/util.go", "tui/tui.go"], "hard": false, "instance_id": "instance_future-architect__vuls-e049df50fa1eecdccc5348e27845b5c783ed7c76-v73dc95f6b90883d8a87e01e5e9bb6d3cc32add6d", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "593106ecc68091f57f00075c0d7412612db9276053c96ed6abf81486a2a185dc"}+{"added": [], "base_commit": "426eb53af546eea10d44699b225ade095f4f5c03", "gold": ["config/os.go", "oval/oval.go", "oval/util.go", "scanner/redhatbase.go"], "hard": false, "instance_id": "instance_future-architect__vuls-e1df74cbc1a1d1889428b3333a3b2405c4651993", "language": "go", "names_gold_path": true, "repo": "future-architect/vuls", "text_sha256": "3dc0ee394182f8358211aa2d9132a4596108998bfc5336626d573300b5d4aa53"}+{"added": [], "base_commit": "5af1a227339e46c7abf3f2815e4c636a0c01098e", "gold": ["gost/debian.go", "gost/ubuntu.go", "gost/util.go", "models/packages.go", "scanner/debian.go"], "hard": true, "instance_id": "instance_future-architect__vuls-e1fab805afcfc92a2a615371d0ec1e667503c254-v264a82e2f4818e30f5a25e4da53b27ba119f62b5", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "76464c87499cc5aed7ada0564987e0ecdb8b6765e0729786c97ecf3978df92b0"}+{"added": [], "base_commit": "aeaf3086799a04924a81b47b031c1c39c949f924", "gold": ["saas/saas.go", "saas/uuid.go", "subcmds/saas.go"], "hard": false, "instance_id": "instance_future-architect__vuls-e3c27e1817d68248043bd09d63cc31f3344a6f2c", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "f37e69fb0b37ac93852289185d7ee8b8184411fe8ee686641fc8598fc62fd588"}+{"added": [], "base_commit": "61c39637f2f3809e1b5dad05f0c57c799dce1587", "gold": ["gost/debian.go", "models/vulninfos.go"], "hard": false, "instance_id": "instance_future-architect__vuls-e4728e388120b311c4ed469e4f942e0347a2689b-v264a82e2f4818e30f5a25e4da53b27ba119f62b5", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "7f1e1e6bf369cec74e4fc28bafa20f5a3b832b1d4f3672d0d1a09786019900fc"}+{"added": [], "base_commit": "854821eb5489ac7448551f213f49bcf8159a110a", "gold": ["detector/vuls2/db.go"], "hard": false, "instance_id": "instance_future-architect__vuls-e52fa8d6ed1d23e36f2a86e5d3efe9aa057a1b0d", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "113d0fbf78393ee095b57c294fb9c052e245f6bb7bf9643bcf2bdbe08bbd86cc"}+{"added": [], "base_commit": "98cbe6ed837ce5983ddcb138f5c1577b9b7cf2bf", "gold": ["oval/util.go", "scanner/alpine.go", "scanner/scanner.go"], "hard": false, "instance_id": "instance_future-architect__vuls-e6c0da61324a0c04026ffd1c031436ee2be9503a", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "9e058cb1bd96cf632df740f7a9df53cf1befb2dc4bae9988d8f16aca359b3f29"}+{"added": [], "base_commit": "83bcca6e669ba2e4102f26c4a2b52f78c7861f1a", "gold": ["scan/base.go", "scan/serverapi.go"], "hard": false, "instance_id": "instance_future-architect__vuls-edb324c3d9ec3b107bf947f00e38af99d05b3e16", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "a66083b1d077c5cbbb24b3025b74bc9426d228d814e96d1610225f9388bd4cbe"}+{"added": [], "base_commit": "827f2cb8d86509c4455b2df2fe79b9d59533d3b0", "gold": ["go.mod", "go.sum", "gost/gost.go", "gost/redhat.go", "oval/redhat.go", "oval/util.go"], "hard": true, "instance_id": "instance_future-architect__vuls-ef2be3d6ea4c0a13674aaab08b182eca4e2b9a17-v264a82e2f4818e30f5a25e4da53b27ba119f62b5", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "8ff9fb68701831bb50776b530ba0342484758e557850344ed810bd1bdbd248b3"}+{"added": [], "base_commit": "0b9ec05181360e3fdb4a314152927f6f3ccb746d", "gold": ["detector/detector.go", "go.mod", "go.sum", "models/vulninfos.go", "scanner/base.go", "tui/tui.go"], "hard": false, "instance_id": "instance_future-architect__vuls-f0b3a8b1db98eb1bd32685f1c36c41a99c3452ed", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "206c84586fb35715d3b857bb085c93d605455bbd969b76c0046daa5fdf5ed921"}+{"added": ["config/config_v1.go"], "base_commit": "80b48fcbaab5ad307beb69e73b30aabc1b6f033c", "gold": ["GNUmakefile", "config/config.go", "config/tomlloader.go", "saas/uuid.go", "scanner/scanner.go"], "hard": false, "instance_id": "instance_future-architect__vuls-f6509a537660ea2bce0e57958db762edd3a36702", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "1f78ca993815d0a6cf9031d5d172b2aeaeee32fd44d9ed7253b85ba12a436d94"}+{"added": ["reporter/sbom/purl.go"], "base_commit": "fa3c08bd3cc47c37c08e64e9868b2a17851e4818", "gold": ["reporter/localfile.go", "reporter/sbom/cyclonedx.go"], "hard": false, "instance_id": "instance_future-architect__vuls-f6cc8c263dc00329786fa516049c60d4779c4a07", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "96672e593b9da92f17b081a45b51a9e58dc3d000e22724d653d3b3f944c2e188"}+{"added": [], "base_commit": "8775b5efdfc5811bc11da51dbfb66c6f09476423", "gold": ["contrib/trivy/parser/v2/parser.go", "detector/detector.go", "detector/util.go", "go.mod", "go.sum"], "hard": false, "instance_id": "instance_future-architect__vuls-fd18df1dd4e4360f8932bc4b894bd8b40d654e7c", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "f66a68b3a04f8ecd3b80fa8f8fdcc1d43744e80465f66a30fc3aeb8071fd5051"}+{"added": [], "base_commit": "0cdc7a3af55e323b86d4e76e17fdc90112b42a63", "gold": ["gost/debian.go", "oval/debian.go", "scanner/base.go", "scanner/serverapi.go"], "hard": false, "instance_id": "instance_future-architect__vuls-fe8d252c51114e922e6836055ef86a15f79ad042", "language": "go", "names_gold_path": false, "repo": "future-architect/vuls", "text_sha256": "172728181bbc3addfc31181a680b3b784f5e6e3ae07c15fe686ae4fe75188102"}+{"added": ["lib/backend/pgbk/wal2json.go"], "base_commit": "4d7c51b4f535cecfd139625e6af1746c46abc712", "gold": ["lib/backend/pgbk/background.go", "lib/backend/pgbk/pgbk.go", "lib/backend/pgbk/utils.go"], "hard": false, "instance_id": "instance_gravitational__teleport-005dcb16bacc6a5d5890c4cd302ccfd4298e275d-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "60aa9c5f477f0f74ac48b144c029c3e98eae14ecec4986a3c067fd61d7e3b5d3"}+{"added": [], "base_commit": "2e7b253d55a1b6da5673ea5846503c43fa53cf37", "gold": ["lib/client/api.go", "lib/sshutils/scp/scp.go"], "hard": false, "instance_id": "instance_gravitational__teleport-007235446f85b1cbaef92664c3b3867517250f21", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "552cb3b68cdc91a59631d667b848d6e91347ee72f3c0e3dc53ea791289e3c05c"}+{"added": [], "base_commit": "6f2f17a7f6749418d0bb329169b9181dba446845", "gold": ["lib/reversetunnel/localsite.go", "lib/reversetunnel/srv.go"], "hard": false, "instance_id": "instance_gravitational__teleport-02d1efb8560a1aa1c72cfb1c08edd8b84a9511b4-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "88140d3bdc6ba82c255862137b10550693775f2ee9088aec4cc186cd3b46ddb8"}+{"added": [], "base_commit": "8ee8122b10b3a0a53cb369503ed64d25a6ad1f34", "gold": ["docs/5.0/admin-guide.md", "lib/auth/auth.go", "lib/auth/auth_with_roles.go", "lib/auth/clt.go", "lib/client/api.go", "lib/client/weblogin.go", "lib/utils/prompt/confirmation.go", "lib/web/sessions.go", "tool/tsh/mfa.go"], "hard": false, "instance_id": "instance_gravitational__teleport-0415e422f12454db0c22316cf3eaa5088d6b6322", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "66b2453c34c95add926e93d0e0e2d3b9ad19e778805050bec0ae0515b2cee1d0"}+{"added": [], "base_commit": "42beccb27e0e5797a10db05bf126e529273d2d95", "gold": ["api/types/databaseserver.go", "lib/reversetunnel/fake.go", "lib/srv/db/proxyserver.go", "tool/tsh/db.go"], "hard": false, "instance_id": "instance_gravitational__teleport-0ac7334939981cf85b9591ac295c3816954e287e", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "4bbcb38cef86d1caeea127b51a16c2d1ef75d094bea39e98aa0be56cee1c015f"}+{"added": [], "base_commit": "2839d2aa27c8cdcd9bc3a78d7bd831fee8e9ab65", "gold": ["roles.go"], "hard": false, "instance_id": "instance_gravitational__teleport-0cb341c926713bdfcbb490c69659a9b101df99eb", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "2427ca619ccb276ee3f6e4dd9970146b669b56ecf10a549b6400aae1c8b3d7f7"}+{"added": [], "base_commit": "b1da3b3054e2394b81f8c14a274e64fb43136602", "gold": ["lib/utils/prompt/context_reader.go", "lib/utils/prompt/stdin.go", "tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-0ecf31de0e98b272a6a2610abe1bbedd379a38a3-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "87395298819153108c6245e85edb3776db1875efc2ed87d88e5789d974dc94dd"}+{"added": [], "base_commit": "43fc9f6de6e22bf617b9973ffac6097c5d16982f", "gold": ["tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-10123c046e21e1826098e485a4c2212865a49d9f", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "ac481fd252999774fcf9fcaf25b9ee4e2cb20d30cf72c28002b95bbb625c21fa"}+{"added": [], "base_commit": "2f51af0e04d6022b1d6475c5637980f64b113658", "gold": ["CHANGELOG.md", "lib/events/dynamoevents/dynamoevents.go", "rfd/0024-dynamo-event-overflow.md"], "hard": true, "instance_id": "instance_gravitational__teleport-1316e6728a3ee2fc124e2ea0cc6a02044c87a144-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "3a07ea8f043b2508bfaa9a9b429b2ea3e7016b8011eeedb9b28e37e65c351e56"}+{"added": [], "base_commit": "bb69574e02bd62e5ccd3cebb25e1c992641afb2a", "gold": ["lib/utils/parse/parse.go"], "hard": false, "instance_id": "instance_gravitational__teleport-1330415d33a27594c948a36d9d7701f496229e9f", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "1214251b3d52cbc045d884a0f2073d2831e0f046a6188859b200bf8d561ac68e"}+{"added": [], "base_commit": "5157a38cadfcaca25a94a6cf380828cbe6e47fe7", "gold": ["lib/sshutils/x11/display.go"], "hard": false, "instance_id": "instance_gravitational__teleport-1b08e7d0dbe68fe530a0f08ad408ec198b7c53fc-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "30ec350389edf5895521a189e54be018ef8d527adfd64561ad6ab541a43784c5"}+{"added": [], "base_commit": "6e16ad6627ca17789a12c53fec627260002bbed0", "gold": ["lib/srv/db/sqlserver/protocol/login7.go"], "hard": false, "instance_id": "instance_gravitational__teleport-24cafecd8721891092210afc55f6413ab46ca211-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "d95fd4da0a15ef04eec63225a30bdaba7399dcecfc06d321c246900139798801"}+{"added": [], "base_commit": "dafcf377a004506ff840d713bfd7359848ef7b8b", "gold": ["api/client/proto/authservice.pb.go", "api/client/proto/authservice.proto", "docs/pages/database-access/reference/cli.mdx", "lib/auth/db.go", "tool/tctl/common/auth_command.go"], "hard": false, "instance_id": "instance_gravitational__teleport-288c5519ce0dec9622361a5e5d6cd36aa2d9e348", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "622ebd21a552af2d1de3523b0cc3f92719670a3b1c519de4fdfdd308085454fb"}+{"added": ["lib/ai/model/tokencount.go"], "base_commit": "189d41a956ebf5b90b6cf5829d60be46c1df992e", "gold": ["lib/ai/chat.go", "lib/ai/model/agent.go", "lib/ai/model/messages.go", "lib/ai/model/tool.go", "lib/assist/assist.go", "lib/web/assistant.go"], "hard": true, "instance_id": "instance_gravitational__teleport-2b15263e49da5625922581569834eec4838a9257-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "ee326b0cbdeb3955503b2e1b32246d955e646f961a4a6a8762debe1b02f4a14a"}+{"added": [], "base_commit": "040ec6d3b264d152a674718eb5a0864debb68470", "gold": ["lib/backend/dynamo/dynamodbbk.go"], "hard": false, "instance_id": "instance_gravitational__teleport-2bb3bbbd8aff1164a2353381cb79e1dc93b90d28-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "197615cd7a3d889de82f1c50be287acbaa7747ae9415edfbd23251c6bf290daf"}+{"added": [], "base_commit": "c2a8ff3e78b0e89c060719123caa153993d8bb46", "gold": ["lib/auth/auth.go", "lib/auth/native/native.go", "lib/reversetunnel/cache.go", "lib/service/service.go"], "hard": false, "instance_id": "instance_gravitational__teleport-2be514d3c33b0ae9188e11ac9975485c853d98bb-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "92d28b7c135679d275e62810463bef3da8aa061a17534d310aea5d461d4a6441"}+{"added": [], "base_commit": "b1e4f1e0324f7e89d1c3c49070a05a243bfddf99", "gold": ["lib/client/api.go", "tool/tsh/db.go", "tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-326fd1d7be87b03998dbc53bc706fdef90f5065c-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "d7e2291db3c72c18f1c7117901200913ce6de3c0f7882c68fdb67642b7b118a9"}+{"added": [], "base_commit": "601c9525b7e146e1b2e2ce989b10697d0f4f8abb", "gold": ["lib/devicetrust/enroll/enroll.go", "lib/devicetrust/testenv/fake_device_service.go", "lib/devicetrust/testenv/testenv.go", "tool/tsh/common/device.go"], "hard": false, "instance_id": "instance_gravitational__teleport-32bcd71591c234f0d8b091ec01f1f5cbfdc0f13c-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "35c749063f283618db1e25985dec54dba22ef1379a362209782555278125229e"}+{"added": ["vendor/github.com/hashicorp/golang-lru/.gitignore", "vendor/github.com/hashicorp/golang-lru/2q.go", "vendor/github.com/hashicorp/golang-lru/LICENSE", "vendor/github.com/hashicorp/golang-lru/README.md", "vendor/github.com/hashicorp/golang-lru/arc.go", "vendor/github.com/hashicorp/golang-lru/doc.go", "vendor/github.com/hashicorp/golang-lru/go.mod", "vendor/github.com/hashicorp/golang-lru/lru.go", "vendor/github.com/hashicorp/golang-lru/simplelru/lru.go", "vendor/github.com/hashicorp/golang-lru/simplelru/lru_interface.go"], "base_commit": "2308160e4e16359f8fd3ad24cd251b9cd80fae23", "gold": ["go.mod", "go.sum", "lib/backend/report.go", "lib/service/service.go", "vendor/modules.txt"], "hard": false, "instance_id": "instance_gravitational__teleport-3587cca7840f636489449113969a5066025dd5bf", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "bdfc140e1d0e93039543260ceae1587c2a59f3d454bdf8dee914f3e0eb5fd775"}+{"added": ["examples/chart/teleport-kube-agent/templates/delete_hook.yaml", "tool/teleport/common/kube_state.go"], "base_commit": "12cdaed68d9445f88a540778d2e13443e0011ebb", "gold": ["examples/chart/teleport-kube-agent/templates/hook.yaml", "lib/backend/kubernetes/kubernetes.go", "tool/teleport/common/teleport.go"], "hard": false, "instance_id": "instance_gravitational__teleport-3a5c1e26394df2cb4fb3f01147fb9979662972c5-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "086c2130e0761d5408cbf31179d56bc8456d1702fb6962455a4533c041ddffe0"}+{"added": [], "base_commit": "481158d6310e36e3c1115e25ab3fdf1c1ed45e60", "gold": ["lib/kube/proxy/forwarder.go", "lib/kube/proxy/server.go", "lib/service/kubernetes.go", "lib/service/service.go"], "hard": false, "instance_id": "instance_gravitational__teleport-3fa6904377c006497169945428e8197158667910-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "705717bfa647cce946c8cbda217f5d1de2c6f99e810d230261732fc80ca89eae"}+{"added": [], "base_commit": "e3a8fb7a0fa7e32504a714c370c3a8dbf71b1d6f", "gold": ["lib/multiplexer/multiplexer.go", "lib/multiplexer/proxyline.go"], "hard": false, "instance_id": "instance_gravitational__teleport-3ff19cf7c41f396ae468797d3aeb61515517edc9-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "0dc9b48e121f8e949611efbf574bf7c0496ea1b0e234f85bde21b6e24763fec9"}+{"added": [], "base_commit": "4b11dc4a8e02ec5620b27f9ecb28f3180a5e67f7", "gold": ["lib/auth/grpcserver.go"], "hard": false, "instance_id": "instance_gravitational__teleport-3ff75e29fb2153a2637fe7f83e49dc04b1c99c9f", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "c26cf1badae053ea035130329fdcd77d619641b1600e559e89180afb7227913f"}+{"added": [], "base_commit": "63da43245e2cf491cb48fb4ee3278395930d4d97", "gold": ["lib/service/cfg.go", "tool/tctl/common/auth_command.go"], "hard": false, "instance_id": "instance_gravitational__teleport-46a13210519461c7cec8d643bfbe750265775b41", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "4b91c01a32b05431c4cc92c8e00218137022e5d6ea861467a8f0b37a1d580270"}+{"added": [], "base_commit": "f958e03439735473578485ff01d720c06324a716", "gold": ["lib/asciitable/table.go", "tool/tctl/common/access_request_command.go"], "hard": false, "instance_id": "instance_gravitational__teleport-46aa81b1ce96ebb4ebed2ae53fd78cd44a05da6c-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "b6bf88be0ae638323de159271f2ebdea9d8486ed5f4cdf677c4285f191ba01a1"}+{"added": [], "base_commit": "883cf1aeda25ae67262a9cb255db170937100987", "gold": ["lib/utils/replace.go"], "hard": false, "instance_id": "instance_gravitational__teleport-47530e1fd8bfb84ec096ebcbbc29990f30829655-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "18b3912ff4982e00464778e036e8ffef568f4c6e756fb19e3d937cabb0682817"}+{"added": [], "base_commit": "b8394b3bd388d81a5007d3671e3248d3542f6a22", "gold": ["lib/auth/init.go", "lib/services/watcher.go"], "hard": false, "instance_id": "instance_gravitational__teleport-53814a2d600ccd74c1e9810a567563432b98386e-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "f1133e2acd46d7009a544b4d192fae3c99db876c8485ba31e128bc28947424a9"}+{"added": ["lib/srv/db/ca.go"], "base_commit": "79f7d4b1e761a6133a8d844dda14274ac39362e1", "gold": ["lib/service/cfg.go", "lib/srv/db/aws.go", "lib/srv/db/server.go"], "hard": false, "instance_id": "instance_gravitational__teleport-59d39dee5a8a66e5b8a18a9085a199d369b1fba8-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "590809b207276c7e55f5da2c54660f85f1afecbb0019f92784f5f70ab78c0a04"}+{"added": ["lib/utils/concurrentqueue/queue.go"], "base_commit": "c12ce90636425daef82da2a7fe2a495e9064d1f8", "gold": [], "hard": false, "instance_id": "instance_gravitational__teleport-629dc432eb191ca479588a8c49205debb83e80e2", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "a34376f4290495fe472f3e7805ed8081fe2a629cbdfe8a06f3d974c29dc67c43"}+{"added": [], "base_commit": "ec6c5eafcec27adb503ff9ead7e42d2be4374fac", "gold": ["lib/utils/ec2.go"], "hard": false, "instance_id": "instance_gravitational__teleport-645afa051b65d137654fd0d2d878a700152b305a-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "776f8c98249d7a07d2198f1e0c78abb797606eff36b38ca422912e7d2bea9222"}+{"added": [], "base_commit": "39cd6e2e750c7700de1e158af9cabc478b2a5110", "gold": ["lib/auth/touchid/api.go", "lib/auth/touchid/api_darwin.go", "lib/auth/touchid/api_other.go", "lib/auth/touchid/credential_info.h", "lib/auth/touchid/credentials.h", "lib/auth/touchid/credentials.m", "tool/tsh/mfa.go", "tool/tsh/touchid.go"], "hard": true, "instance_id": "instance_gravitational__teleport-65438e6e44b6ce51458d09b7bb028a2797cfb0ea-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "d67b46f3c96200fd13ab3573e88cc7085e93e17f26aa05caa5dcec2035416a1b"}+{"added": [], "base_commit": "9c041361f9ff3270d252609d5aa92eb1251cd8d7", "gold": ["lib/auth/auth_with_roles.go", "lib/auth/clt.go", "lib/auth/trustedcluster.go", "lib/services/local/presence.go", "lib/services/presence.go"], "hard": false, "instance_id": "instance_gravitational__teleport-6a14edcf1ff010172fdbac622d0a474ed6af46de", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "82a5c77fba3dfde2417fb12f408388387050a7b9f28eab6c68233f809497fa66"}+{"added": ["examples/bench/README.md", "examples/bench/example.go", "lib/benchmark/benchmark.go", "lib/benchmark/linear.go"], "base_commit": "a51596d8d779935e1dfa8d0fabce39d9edd91457", "gold": ["lib/client/bench.go", "tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-6eaaf3a27e64f4ef4ef855bd35d7ec338cf17460-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "33cc62611f68a5a896b9937a91c56438980f7cfef0df7928be2dcb28e3cd1d9d"}+{"added": [], "base_commit": "31b8f1571759ebf5fe082a18a2efd1e8ee6148e7", "gold": ["lib/tlsca/ca.go"], "hard": false, "instance_id": "instance_gravitational__teleport-73cc189b0e9636d418c4470ecce0d9af5dae2f02-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "06d2ebf7110dd64bc28f9fb3e9b7031d9353d04d200015459107458a3856c6a4"}+{"added": [], "base_commit": "1879807d3c30626ec02a730133ac5592cece310c", "gold": ["integration/helpers.go", "lib/client/api.go", "lib/client/session.go", "lib/web/terminal.go", "tool/tsh/options.go", "tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-769b4b5eec7286b7b14e179f2cc52e6b15d2d9f3-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "01aa66f5566221b59da6bdd4f2e59e4b819b271653876eb7b99894caf8ec2c79"}+{"added": ["lib/auditd/auditd.go", "lib/auditd/auditd_linux.go", "lib/auditd/common.go"], "base_commit": "44b89c75c07c34c4026beaeab494fef1ad67e5e5", "gold": ["go.mod", "go.sum", "lib/service/service.go", "lib/srv/authhandlers.go", "lib/srv/ctx.go", "lib/srv/reexec.go", "lib/srv/termhandlers.go", "lib/sshutils/server.go"], "hard": true, "instance_id": "instance_gravitational__teleport-7744f72c6eb631791434b648ba41083b5f6d2278-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "0d86b2e612d0d69216622575b2b14e54c5477e022859305986a0115d47708930"}+{"added": ["lib/cache/fncache.go"], "base_commit": "19c5768873a50f1f84f0906add418c29c68f4bc2", "gold": ["api/types/audit.go", "api/types/clustername.go", "api/types/networking.go", "api/types/remotecluster.go", "lib/cache/cache.go"], "hard": false, "instance_id": "instance_gravitational__teleport-78b0d8c72637df1129fb6ff84fc49ef4b5ab1288", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "271d1bdcd29484ba8df4c39982be84c861d26b15cac93cc2392190c81f9744b4"}+{"added": [], "base_commit": "ad00c6c789bdac9b04403889d7ed426242205d64", "gold": ["CHANGELOG.md", "lib/kube/kubeconfig/kubeconfig.go", "tool/tsh/kube.go", "tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-82185f232ae8974258397e121b3bc2ed0c3729ed-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "d09219a4f650f413792a97b7748869b19a6afc8c00e364caca483d2a8b5928a2"}+{"added": ["lib/auth/touchid/diag.h", "lib/auth/touchid/diag.m"], "base_commit": "c2ace99b1c8bc141c43730352107f6848cd4ca4c", "gold": ["build.assets/macos/tsh/tsh.app/Contents/Info.plist", "build.assets/macos/tshdev/tsh.app/Contents/Info.plist", "lib/auth/touchid/api.go", "lib/auth/touchid/api_darwin.go", "lib/auth/touchid/api_other.go", "lib/auth/touchid/register.m", "tool/tsh/touchid.go", "tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-8302d467d160f869b77184e262adbe2fbc95d9ba-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "ae9e78bfb94e54969a83856641f5e6b50dbd4d16bd4ca3ec335949b7789cb4e5"}+{"added": ["lib/client/conntest/database/sqlserver.go"], "base_commit": "49ab2a7bfd935317818b20a5bd0b59ac4d5289c9", "gold": ["lib/client/conntest/database.go"], "hard": false, "instance_id": "instance_gravitational__teleport-87a593518b6ce94624f6c28516ce38cc30cbea5a", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "cb0ab7fd8fc1272c6a798ea062ce5bea19820907b8e12302e23ca45dff5569f4"}+{"added": [], "base_commit": "85244157b056985dd5289f6cbf92f60b35ffad8a", "gold": ["constants.go", "lib/auth/github.go", "lib/auth/oidc.go", "lib/httplib/httplib.go", "lib/services/saml.go", "lib/utils/utils.go"], "hard": false, "instance_id": "instance_gravitational__teleport-89f0432ad5dc70f1f6a30ec3a8363d548371a718", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "8ab4215e07cbf8c7e9bb70b731832a51264f4402556e1d7160d63547c9ebcfbd"}+{"added": [], "base_commit": "d05df372ce37abd7c190f9fbb68192a773330e63", "gold": ["lib/httplib/httplib.go", "lib/kube/proxy/forwarder.go"], "hard": false, "instance_id": "instance_gravitational__teleport-96019ce0be7a2c8e36363f359eb7c943b41dde70", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "2f7f050023c96875f1cd139ff642fb232d9eacdd0511f818c38a641c7f365859"}+{"added": [], "base_commit": "91449219e798e1440f1553738a224d50b5ac9ba1", "gold": ["tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-a95b3ae0667f9e4b2404bf61f51113e6d83f01cd", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "91d71d329124a0eb8539a259a92d37d59b77e700ce11db9c53758d70b303008e"}+{"added": [], "base_commit": "7b8bfe4f609a40c5a4d592b91c91d2921ed24e64", "gold": ["lib/backend/dynamo/shards.go", "lib/events/emitter.go", "lib/events/multilog.go", "lib/service/service.go"], "hard": false, "instance_id": "instance_gravitational__teleport-ac2fb2f9b4fd1896b554d3011df23d3d71295779", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "b96cea6f9d160d854ea67eb3b29e115f1cfd639d743b22e5d79b1e996db55441"}+{"added": [], "base_commit": "cdae4e3ee28eedb6b58c1989676c6523ba6dadcc", "gold": ["api/types/app.go", "lib/asciitable/table.go", "tool/tctl/common/collection.go", "tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-ad41b3c15414b28a6cec8c25424a19bfa7abd0e9-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "64578442908ead9980854ee079c05473eea3d71ac78f42cbfa255a137c88317f"}+{"added": [], "base_commit": "a60d1c0f43d5b1baaa3ed98ec19d69181b294f94", "gold": ["api/utils/sshutils/ssh.go", "lib/multiplexer/multiplexer.go", "lib/service/service.go", "lib/sshutils/server.go"], "hard": false, "instance_id": "instance_gravitational__teleport-af5e2517de7d18406b614e413aca61c319312171-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "9a2280f4aa574a1a86e60fafc3d74c6150c1f665a91ef7b1c883ac97839d7a0d"}+{"added": [], "base_commit": "b054261bc1cce536d307cbdad358f7c6c941b851", "gold": ["lib/srv/ingress/reporter.go"], "hard": false, "instance_id": "instance_gravitational__teleport-b1bcd8b90c474a35bb11cc3ef4cc8941e1f8eab2-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "da69513bcee020dcb7d84b27bd72617043514ebc4b3620485069732f1bb1bc78"}+{"added": [], "base_commit": "85addfbd36943a4b655e1a4241979789e8b4ff22", "gold": ["lib/auth/auth.go", "lib/auth/trustedcluster.go", "lib/backend/backend.go", "lib/backend/report.go", "lib/services/local/provisioning.go", "lib/services/local/usertoken.go"], "hard": false, "instance_id": "instance_gravitational__teleport-b4e7cd3a5e246736d3fe8d6886af55030b232277", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "399e2c840ef579514a13ed3304ee6e41b33a49108e3e43ab2d41663616ffbd5d"}+{"added": [], "base_commit": "103f3de22f3986d4f73d931b1e433e011b26a488", "gold": ["constants.go", "lib/auth/auth_with_roles.go", "lib/auth/init.go", "lib/services/role.go", "tool/tctl/common/user_command.go"], "hard": false, "instance_id": "instance_gravitational__teleport-b5d8169fc0a5e43fee2616c905c6d32164654dc6", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "9fe8e7bf8917fa9dd15d45ba1c678ea39663463dc06d034522bfd458fc6ea7d4"}+{"added": ["lib/utils/prompt/stdin.go"], "base_commit": "9c25440e8d6de54447215934d4c4fae81067eb97", "gold": ["lib/client/identityfile/identity.go", "lib/client/keyagent.go", "lib/client/mfa.go", "lib/utils/prompt/confirmation.go", "tool/tsh/mfa.go"], "hard": false, "instance_id": "instance_gravitational__teleport-b8fbb2d1e90ffcde88ed5fe9920015c1be075788-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "1e2e56ba530a667c409781ef32a4a224b922cae6abee17645167b189f5343736"}+{"added": [], "base_commit": "396812cebff3ebfd075bbed04acefc65e787a537", "gold": ["lib/service/connect.go", "lib/service/service.go", "lib/service/state.go", "lib/srv/heartbeat.go", "lib/srv/regular/sshserver.go"], "hard": false, "instance_id": "instance_gravitational__teleport-ba6c4a135412c4296dd5551bd94042f0dc024504-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "551b745ea2debc9aabe17ed0d50659034f15629143fddc3a8a6a5bd4ae51fd39"}+{"added": ["lib/utils/fanoutbuffer/buffer.go"], "base_commit": "e0c9b35a5567c186760e10b3a51a8f74f0dabea1", "gold": [], "hard": false, "instance_id": "instance_gravitational__teleport-bb562408da4adeae16e025be65e170959d1ec492-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "29331dc1ce22054e444422b6875778d172ff4783ce398cd4261c8de97915aaec"}+{"added": [], "base_commit": "e9b7a25d6a5bb89eff86349d7e695afec04be7d0", "gold": ["lib/services/role.go", "lib/services/user.go", "lib/utils/parse/parse.go"], "hard": false, "instance_id": "instance_gravitational__teleport-bb69574e02bd62e5ccd3cebb25e1c992641afb2a", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "95c7e27ef8730d7faac00a80307f27850c6cb91c9eebd7ba6b5d98010cec68cf"}+{"added": [], "base_commit": "b37b02cd6203f1e32d471acfcec8a7675c0a8664", "gold": [".drone.yml", "Makefile", "lib/events/auditlog.go", "lib/events/complete.go", "lib/events/filesessions/fileasync.go", "lib/events/filesessions/filestream.go", "lib/events/stream.go", "lib/multiplexer/ping.proto", "lib/utils/fs_unix.go"], "hard": false, "instance_id": "instance_gravitational__teleport-c1b1c6a1541c478d7777a48fca993cc8206c73b9", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "70dc7eae9f4c365440059faa25be0b0fc116bd5482fa5e428f25ecaca9d6ba2b"}+{"added": [], "base_commit": "cc3c38d7805e007b25afe751d3690f4e51ba0a0f", "gold": ["lib/client/keyagent.go", "lib/srv/alpnproxy/local_proxy.go", "tool/tsh/proxy.go"], "hard": false, "instance_id": "instance_gravitational__teleport-c335534e02de143508ebebc7341021d7f8656e8f", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "57736c8fd1b5a7cde230abb6c119ee7799840dc61098f9933859999fce496d62"}+{"added": [], "base_commit": "d96ea00a00c897ce2fed9f8dca92ca17932d8d02", "gold": ["api/types/clusterconfig.go", "lib/cache/cache.go", "lib/cache/collections.go", "lib/reversetunnel/srv.go", "lib/service/service.go", "lib/services/clusterconfig.go"], "hard": false, "instance_id": "instance_gravitational__teleport-c782838c3a174fdff80cafd8cd3b1aa4dae8beb2", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "49cb5791791323f939c85c8dda8a24c6c8065009b0e60e33881d75b31f6c14e0"}+{"added": [], "base_commit": "8bca6e20c6c7374080180f7a5b5ea62bb15c136c", "gold": ["api/client/inventory.go", "lib/auth/grpcserver.go", "lib/inventory/controller.go"], "hard": false, "instance_id": "instance_gravitational__teleport-cb712e3f0b06dadc679f895daef8072cae400c26-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "2cd90aa0309b73aa6892f8b1c25f9aa5891e553b491b071ebc7924b047cdd928"}+{"added": ["lib/utils/parse/ast.go"], "base_commit": "69a9dbf3a27c6a6da4eaafb89d69849c34beed1b", "gold": ["lib/services/role.go", "lib/srv/ctx.go", "lib/utils/parse/parse.go"], "hard": false, "instance_id": "instance_gravitational__teleport-d6ffe82aaf2af1057b69c61bf9df777f5ab5635a-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "5d334dff3ccded52c495a10452c2e3f97e721cf5f5b9a2b7c6404a9740c216d3"}+{"added": [], "base_commit": "08775e34c7463c7aec7d852bb255cb0c3709ca08", "gold": ["lib/client/api.go", "lib/service/service.go", "tool/tsh/db.go", "tool/tsh/tsh.go"], "hard": false, "instance_id": "instance_gravitational__teleport-db89206db6c2969266e664c7c0fb51b70e958b64", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "1ea7df777afbb00472bb32edd2a8f33115764ff3bd0978ec51890c70be5af8d1"}+{"added": [], "base_commit": "e7683826a909e3db7d2fb32e631ea75636ff25ca", "gold": ["lib/auth/permissions.go", "lib/kube/proxy/server.go", "lib/service/kubernetes.go", "lib/service/service.go"], "hard": false, "instance_id": "instance_gravitational__teleport-dd3977957a67bedaf604ad6ca255ba8c7b6704e9", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "717d4730706cc36502d1449b2063acc60cc4f50fb85d35158d760ebb9425eb1e"}+{"added": [], "base_commit": "be52cd325af38f53fa6b6f869bc10b88160e06e2", "gold": ["lib/defaults/defaults.go", "lib/events/auditwriter.go", "lib/events/emitter.go", "lib/events/stream.go", "lib/kube/proxy/forwarder.go", "lib/service/kubernetes.go", "lib/service/service.go", "lib/srv/sess.go"], "hard": false, "instance_id": "instance_gravitational__teleport-e6681abe6a7113cfd2da507f05581b7bdf398540-v626ec2a48416b10a88641359a169d99e935ff037", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "efe74933c5e0123f5827f65d41c778c372b2c8e04c24e0d5262bb1f56c21b534"}+{"added": [], "base_commit": "19081df863165c67a8570dde690dd92c38c8926e", "gold": ["lib/config/database.go", "tool/teleport/common/teleport.go"], "hard": false, "instance_id": "instance_gravitational__teleport-e6895d8934f6e484341034869901145fbc025e72-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "c37a49499fb00c1a36eaef6230322a06718d5c61746af520090589975ca20cf9"}+{"added": [], "base_commit": "ea02952f53663a6a068ac70088ad5a044f54a094", "gold": ["lib/auth/apiserver.go", "lib/auth/auth.go", "lib/web/apiserver.go", "lib/web/sessions.go"], "hard": false, "instance_id": "instance_gravitational__teleport-e6d86299a855687b21970504fbf06f52a8f80c74-vce94f93ad1030e3136852817f2423c1b3ac37bc4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "2789e6bf533ef3da9dc34c1e6d5dcb2c8ab4ddfd27356f2a53fba147734d6988"}+{"added": [], "base_commit": "4f6f52f86d65f506d1884a9f56bcd919a8744734", "gold": ["lib/kube/proxy/forwarder.go"], "hard": true, "instance_id": "instance_gravitational__teleport-eda668c30d9d3b56d9c69197b120b01013611186", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "6a76cb6072881cb03c14648885d97aa58080c4c32d0e190bc7f5245ce0fc5cc4"}+{"added": ["lib/linux/dmi_sysfs.go", "lib/linux/os_release.go"], "base_commit": "eca1d01746c031f95e8df1ef3eea36d31416633d", "gold": ["lib/inventory/metadata/metadata_linux.go"], "hard": false, "instance_id": "instance_gravitational__teleport-eefac60a350930e5f295f94a2d55b94c1988c04e-vee9b09fb20c43af7e520f57e9239bbcf46b7113d", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "ed549d51c46f7cdf30e29d131f3675af5feff8831e5081a0334706046310bf05"}+{"added": ["lib/auth/keystore/keystore.go", "lib/auth/keystore/raw.go"], "base_commit": "a4a6a3e42d90918341224dd7f2ba45856b1b6c70", "gold": [], "hard": true, "instance_id": "instance_gravitational__teleport-f432a71a13e698b6e1c4672a2e9e9c1f32d35c12", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "1c998451e791240300575595b380bcb412f0c8793b95baaaa177fa459d3c52cb"}+{"added": ["lib/utils/circular_buffer.go"], "base_commit": "b58ad484649e51b439ba11df387e25e23e8296d1", "gold": ["lib/auth/grpcserver.go", "lib/srv/authhandlers.go", "metrics.go", "tool/tctl/common/top_command.go"], "hard": false, "instance_id": "instance_gravitational__teleport-fb0ab2b9b771377a689fd0d0374777c251e58bbf", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "0f41b3a47e6da10882175befb751f64339c3f009d5027d317bea6893484c4a11"}+{"added": [], "base_commit": "025143d85654c604656571c363d0c7b9a6579f62", "gold": ["lib/client/api.go", "lib/config/configuration.go", "lib/config/fileconf.go", "lib/service/cfg.go"], "hard": false, "instance_id": "instance_gravitational__teleport-fd2959260ef56463ad8afa4c973f47a50306edd4", "language": "go", "names_gold_path": false, "repo": "gravitational/teleport", "text_sha256": "35972f870670c3b03237264b8a69e00dd68ac67396f87851530e00b89e6704c1"}+{"added": [], "base_commit": "02f647f7d525286b6e3a661133c3772649e585cd", "gold": ["openlibrary/plugins/importapi/code.py", "openlibrary/plugins/importapi/import_validator.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-00bec1e7c8f3272c469a58e1377df03f955ed478-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "a831507e59086934a9c4cd3bbce6f350a97ab7ec38f02dee1499398cef5e2b18"}+{"added": [], "base_commit": "46bcf7c30178f53ef427a5840c4b24717ed79fb0", "gold": ["scripts/new-solr-updater.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-03095f2680f7516fca35a58e665bf2a41f006273-v8717e18970bcdc4e0d2cea3b1527752b21e74866", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "4b06c56f31908fae71c0f89730bf7f01234f321e23951fa8728046462515f60d"}+{"added": [], "base_commit": "1e32ae3ec085dc3ab8611b88b56baf6354fa0762", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/marc/parse.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-08ac40d050a64e1d2646ece4959af0c42bf6b7b5-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "3243a31d265d565467e7f20408f46ed4a34fb280f382cb61e48c75e784e3bb65"}+{"added": ["static/css/components/ol-message.less"], "base_commit": "50350d0432e2edf3429552bd9b50e78e662df8eb", "gold": ["openlibrary/i18n/messages.pot", "openlibrary/macros/TableOfContents.html", "openlibrary/plugins/upstream/table_of_contents.py", "openlibrary/templates/books/edit/edition.html", "static/css/page-user.less"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-09865f5fb549694d969f0a8e49b9d204ef1853ca-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "445f76d54cd6c93bf2c0ac055110de393807da8fbf09b5572f5554888cb15a25"}+{"added": [], "base_commit": "5c6c22f3d2edf2f1b10f5dc335e32cb6a5f40341", "gold": ["openlibrary/plugins/importapi/code.py", "openlibrary/plugins/upstream/utils.py", "openlibrary/utils/isbn.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-0a90f9f0256e4f933523e9842799e39f95ae29ce-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "441f27c6d122ec0214b9adebd33c44e6a5068bea0e2feda4f0af17381833c1f8"}+{"added": [], "base_commit": "fe6c160d3f2afd9fd70bea62195337fad15c6535", "gold": ["openlibrary/catalog/add_book/load_book.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-0d13e6b4bf80bced6c0946b969b9a1b6963f6bce-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "299ea7a9b75b7c4695f699b56458a744e8c6001386eaedd4a8aecf3ecff474d3"}+{"added": [], "base_commit": "bd9d2a04efbbaec1575faa02a02eea995badf7f0", "gold": ["openlibrary/catalog/marc/parse.py"], "hard": true, "instance_id": "instance_internetarchive__openlibrary-0dc5b20fa186f9714f8a838178597e69f549d026-v2d9a6c849c60ed19fd0858ce9e40b7cc8e097e59", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "a48e53d24383a3cd33736f3d6badb8cc092b4cbe7fa02e063f7cfb058b76de33"}+{"added": [], "base_commit": "c9795319b19c60e884f34df3eaf7e3e7f2bfd58c", "gold": ["openlibrary/catalog/marc/get_subjects.py", "openlibrary/catalog/marc/marc_base.py", "openlibrary/catalog/marc/marc_binary.py", "openlibrary/catalog/marc/marc_xml.py", "openlibrary/catalog/marc/parse.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-111347e9583372e8ef91c82e0612ea437ae3a9c9-v2d9a6c849c60ed19fd0858ce9e40b7cc8e097e59", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "9424de65f51a8bf4d33deda8566fa84966b3596d6205fb87ddbe6700a31a9faa"}+{"added": [], "base_commit": "115079a6a07b6341bb487f954e50384273b56a98", "gold": ["openlibrary/core/vendors.py", "scripts/affiliate_server.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-123e6e5e1c85b9c07d1e98f70bfc480bc8016890-v2733ff199fb72f0d033a30dc62cb0a4742e3a7f4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "180cd989e2fd8029204e80e7ade75803e460172b80f71ae5df4afebd799289a3"}+{"added": [], "base_commit": "ddbbdd64ecde64f314b9083953af63d07305f640", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/add_book/match.py", "openlibrary/catalog/utils/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-1351c59fd43689753de1fca32c78d539a116ffc1-v29f82c9cf21d57b242f8d8b0e541525d259e2d63", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "ad9726672fd602f1b5196363c5b210999dc33e6efa8c35803099da9992ef0a72"}+{"added": [], "base_commit": "88da48a8faf5d6864c6ceea4a3e4a305550318e2", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/add_book/match.py", "openlibrary/plugins/upstream/models.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-1894cb48d6e7fb498295a5d3ed0596f6f603b784-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "37d370424a12db5c73a22fb0984dd9c2fc083e587aa31e1a694c39df9d85ad28"}+{"added": [], "base_commit": "8b933806b52d3785f98d2c397032c8b97a88feb2", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/add_book/match.py", "openlibrary/catalog/merge/merge_marc.py", "openlibrary/catalog/utils/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-1be7de788a444f6255e89c10ef6aa608550604a8-v29f82c9cf21d57b242f8d8b0e541525d259e2d63", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "a1135a2c0439313975135b74c3fa5a5cb5e139e55b2aeec79a3a83d43acd7400"}+{"added": ["openlibrary/solr/utils.py"], "base_commit": "322d7a46cdc965bfabbf9500e98fde098c9d95b2", "gold": ["openlibrary/solr/update_edition.py", "openlibrary/solr/update_work.py", "scripts/solr_builder/solr_builder/index_subjects.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-25858f9f0c165df25742acf8309ce909773f0cdd-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": true, "repo": "internetarchive/openlibrary", "text_sha256": "ddff2b9f3c9a94ffd3cda0133271f5f3253247a49cf3a220b36bc04f2f20c552"}+{"added": [], "base_commit": "eb8da9e755f4bf59f8f0bd2b021d3e49a87ccf4e", "gold": ["openlibrary/core/vendors.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-2abe28b472ffed563a87cfe83685b161b35263b0-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "722c635fe0e116c8ee6012441ae7f0960ac44899fa0c5a9a5ffdbd9b019731ef"}+{"added": [], "base_commit": "4315bbe27c111e85712899901fde689d0eac18bd", "gold": ["openlibrary/core/vendors.py", "scripts/affiliate_server.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-2fe532a33635aab7a9bfea5d977f6a72b280a30c-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "b63d9b67ae6bbd5e932a9f02bc57b8aacce8f92adc16ac9cc394aea6c180a8d4"}+{"added": [], "base_commit": "cb6c053eba49facef557ee95d587f6d6c93caf3a", "gold": ["openlibrary/core/lists/model.py", "openlibrary/core/models.py", "openlibrary/plugins/openlibrary/code.py", "openlibrary/plugins/openlibrary/lists.py", "openlibrary/plugins/upstream/models.py", "openlibrary/plugins/upstream/utils.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-308a35d6999427c02b1dbf5211c033ad3b352556-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": true, "repo": "internetarchive/openlibrary", "text_sha256": "cff8dbcd7052d2679bc00cbe6f3296f8d381bc7b65db06896562980433d28705"}+{"added": [], "base_commit": "540853735859789920caf9ee78a762ebe14f6103", "gold": ["openlibrary/coverstore/README.md", "openlibrary/coverstore/archive.py", "openlibrary/coverstore/code.py", "openlibrary/coverstore/schema.sql"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-30bc73a1395fba2300087c7f307e54bb5372b60a-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "8e7528cbae5ea6f3204102d88bc19f08316ddad9df050955350efbcd5a7ca6a0"}+{"added": [], "base_commit": "0d5acead6fdfb5e41a1d29a076a6e89ad1a39027", "gold": ["openlibrary/solr/update_work.py", "scripts/solr_updater.py"], "hard": true, "instance_id": "instance_internetarchive__openlibrary-322d7a46cdc965bfabbf9500e98fde098c9d95b2-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "e0c592b9807bdd2bc9887acdf44c5c2759f1e51684c0b0eb50ca532f5a2267a2"}+{"added": [], "base_commit": "b36762b27e11d2bdf1ef556a8c5588294bb7deb7", "gold": ["openlibrary/core/wikidata.py", "openlibrary/templates/authors/infobox.html"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-3aeec6afed9198d734b7ee1293f03ca94ff970e1-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "9369d69d236fab2976c9cf582533da2f61e95b697e2f87169cfed9bcb29e0477"}+{"added": [], "base_commit": "d38cb5a4162aa2942cdb5037dd679f37687b9d4f", "gold": ["openlibrary/catalog/marc/parse.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-3c48b4bb782189e0858e6c3fc7956046cf3e1cfb-v2d9a6c849c60ed19fd0858ce9e40b7cc8e097e59", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "61fe16d2c946d1ea2c27ec4fdb8afc06511380ec53f0303fa6636542bbf1b7db"}+{"added": [], "base_commit": "46d7d325e6ed4b4de998d69c0e89893274ad5d60", "gold": ["openlibrary/core/bookshelves.py", "openlibrary/core/edits.py", "openlibrary/plugins/worksearch/autocomplete.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-3f580a5f244c299d936d73d9e327ba873b6401d9-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "eb80c64b24ffbfd9a5484da09c4e98424e526ffb8168e0026257303b51a573e6"}+{"added": ["scripts/providers/isbndb.py"], "base_commit": "c46e5170e93bbfac133dd1e2e1e3b56882f2519f", "gold": ["openlibrary/core/imports.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-3f7db6bbbcc7c418b3db72d157c6aed1d45b2ccf-v430f20c722405e462d9ef44dee7d34c41e76fe7a", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "0cf009d251ac116b85051f5b0550a7ba41007d2cc2a6218eab99eba8fa734699"}+{"added": [], "base_commit": "8c988af810a451a2bda2dd080852c81f662aee1e", "gold": ["conf/solr/conf/solrconfig.xml", "openlibrary/plugins/worksearch/schemes/works.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-427f1f4eddfc54735ca451779d4f95bf683d1b0e-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "ce2d8601cf2761c961a0970eee0dedfcdfe604c667c8a7cd4b669d8d5abaf6a9"}+{"added": [], "base_commit": "188a76779dbd2368d73313ad15cae639c295eb21", "gold": ["openlibrary/plugins/worksearch/schemes/works.py", "openlibrary/solr/query_utils.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-431442c92887a3aece3f8aa771dd029738a80eb1-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "19fe768ff8068e7caaa2d7285b4ad26b6d07531e872d8a064367ec8bca8e3d68"}+{"added": [], "base_commit": "de903b9535d53122d655590f238a78e217a6c770", "gold": ["openlibrary/catalog/add_book/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-43f9e7e0d56a4f1d487533543c17040a029ac501-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "93dc410fe711a00b1a2bc83d58c92ff15cb7aec5acb9bfbeef8e2c8d2d46fb3f"}+{"added": [], "base_commit": "90475fb6c168e8317e22bd5fbe057d98e570a715", "gold": ["openlibrary/core/wikidata.py", "openlibrary/i18n/messages.pot", "openlibrary/templates/authors/infobox.html"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-4a5d2a7d24c9e4c11d3069220c0685b736d5ecde-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "46ed50882a93be5797e7db4ea4a230b8c3000c55359c6aaabfa81f06bfc52afe"}+{"added": ["requirements_scripts.txt"], "base_commit": "86d9b8a203cab5bc446614f3cbffd77b4751084a", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/add_book/load_book.py", "openlibrary/core/models.py", "openlibrary/plugins/importapi/import_edition_builder.py", "openlibrary/plugins/importapi/import_validator.py", "requirements.txt", "scripts/providers/import_wikisource.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-4b7ea2977be2747496ba792a678940baa985f7ea-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "9e68a344950bf761631875a78fe2be8c9419868fae94b166f43fbbcae5a0c18a"}+{"added": [], "base_commit": "facafbe7339ca48a33e0d07e089e99b2cf6235df", "gold": ["openlibrary/core/booknotes.py", "openlibrary/core/bookshelves.py", "openlibrary/core/db.py", "openlibrary/core/observations.py", "openlibrary/core/ratings.py", "openlibrary/plugins/admin/code.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-5069b09e5f64428dce59b33455c8bb17fe577070-v8717e18970bcdc4e0d2cea3b1527752b21e74866", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "7b43bcaca995646f5b56182322603dcbc6b53551866bdda2918f03c690be921c"}+{"added": [], "base_commit": "0d13e6b4bf80bced6c0946b969b9a1b6963f6bce", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/add_book/load_book.py", "openlibrary/catalog/utils/__init__.py", "openlibrary/mocks/mock_infobase.py"], "hard": true, "instance_id": "instance_internetarchive__openlibrary-53d376b148897466bb86d5accb51912bbbe9a8ed-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "a44ced4457fc2c71f70d2870b25c86a33057a24a508f39c08e61cea6ca17f063"}+{"added": [], "base_commit": "2e2140e23dde91a233a91e9a7d04648450387721", "gold": ["conf/openlibrary.yml", "openlibrary/plugins/books/readlinks.py", "openlibrary/plugins/worksearch/code.py", "openlibrary/plugins/worksearch/search.py", "openlibrary/solr/update_work.py", "scripts/ol-solr-indexer.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-53e02a22972e9253aeded0e1981e6845e1e521fe-vfa6ff903cb27f336e17654595dd900fa943dcd91", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "256b611d56599357a4193d38b50df85d887a89582fdc70c0e31544bf83d86b58"}+{"added": [], "base_commit": "6e5fa4b4afcbbf022aff88732f1d458be31fc086", "gold": ["openlibrary/core/bookshelves_events.py", "openlibrary/plugins/upstream/checkins.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-58999808a17a26b387f8237860a7a524d1e2d262-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "97a323832d19ff753d6a74c1f0320d8bb11ebb684f637c67e9067debbb36bc51"}+{"added": [], "base_commit": "31d6ecf3c04c8e365e557f2a9a6a65df2b8d01a3", "gold": ["openlibrary/plugins/importapi/code.py", "openlibrary/plugins/upstream/utils.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-5c6c22f3d2edf2f1b10f5dc335e32cb6a5f40341-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "72ff9c2055930c56eaa74f970fdb8dff94b434f1a7fb5b7c4fd0b5304e5dfebe"}+{"added": [], "base_commit": "5f7d8d190e2f0d837545e582fd5db99aae51a979", "gold": ["openlibrary/core/models.py", "openlibrary/plugins/books/dynlinks.py", "openlibrary/plugins/openlibrary/code.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-5de7de19211e71b29b2f2ba3b1dff2fe065d660f-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": true, "repo": "internetarchive/openlibrary", "text_sha256": "783a6a0fc9ac1ffbf8b3b0254c0611290f4f6b21a3e9bdb2a3a2eeec8d791ffe"}+{"added": ["static/images/identifier_icons/google_scholar.svg", "static/images/identifier_icons/wikidata.svg", "static/images/identifier_icons/wikipedia.svg"], "base_commit": "7549c413a901a640aa351933392f503648d345cc", "gold": ["openlibrary/core/models.py", "openlibrary/core/wikidata.py", "openlibrary/i18n/messages.pot", "openlibrary/templates/authors/infobox.html", "static/css/components/author-infobox.less"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-5fb312632097be7e9ac6ab657964af115224d15d-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "6f28c1a7a6f7ea2cab2b5925c13a72ff2d47de197aa237b7f845010d0b50faf2"}+{"added": [], "base_commit": "73e4b70aa3adafbbf44e7942b5bf9efabce70447", "gold": ["openlibrary/plugins/upstream/account.py", "openlibrary/plugins/upstream/models.py", "openlibrary/templates/account.html", "openlibrary/templates/account/privacy.html"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-60725705782832a2cb22e17c49697948a42a9d03-v298a7a812ceed28c4c18355a091f1b268fe56d86", "language": "python", "names_gold_path": true, "repo": "internetarchive/openlibrary", "text_sha256": "63c0c606cec54b3fe182d63f893096b51b9d41dbeb9253f03bbb0fe7bb1abb9a"}+{"added": ["openlibrary/core/bestbook.py"], "base_commit": "247986f00311d9ee34009b0bb02d0d3bd7497ebd", "gold": ["openlibrary/accounts/model.py", "openlibrary/core/bookshelves.py", "openlibrary/core/models.py", "openlibrary/core/schema.sql", "openlibrary/plugins/openlibrary/api.py"], "hard": true, "instance_id": "instance_internetarchive__openlibrary-630221ab686c64e75a2ce253c893c033e4814b2e-v93c53c13d5f9b383ebb411ee7750b49dcd1a34c6", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "bb1239ed5e8db1c48965192b8ddb0111d930b8bd399d8dd6231bf1671f5e20a3"}+{"added": [], "base_commit": "1a3fab3f0b319e0df49dd742ce2ffa0d747d1b44", "gold": ["scripts/solr_builder/solr_builder/fn_to_cli.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-6afdb09df692223c3a31df65cfa92f15e5614c01-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "47b2542684a23eacb5cc48beb6025221bc3213f0eded99862feab06b32b004c7"}+{"added": [], "base_commit": "9a9204b43f9ab94601e8664340eb1dd0fca33517", "gold": ["openlibrary/plugins/importapi/code.py", "openlibrary/plugins/upstream/utils.py"], "hard": true, "instance_id": "instance_internetarchive__openlibrary-6e889f4a733c9f8ce9a9bd2ec6a934413adcedb9-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "0b909c355ecc4a5107438f2700abb8ed79ad0b3b08f617654eb9311dfdd985f1"}+{"added": [], "base_commit": "71b18af1fa3b1e0ea6acb368037736be759a8bca", "gold": ["openlibrary/accounts/model.py", "openlibrary/core/helpers.py", "openlibrary/core/lists/model.py", "openlibrary/core/models.py", "openlibrary/plugins/openlibrary/lists.py", "openlibrary/plugins/upstream/models.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-6fdbbeee4c0a7e976ff3e46fb1d36f4eb110c428-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "f3850aa0eb61e011de4baea99bc5b07bd0b1ad73f9039557d6aeede203779ee3"}+{"added": [], "base_commit": "72593efe54e9ee0579798f418d7b823fa5d91834", "gold": ["openlibrary/plugins/worksearch/schemes/works.py", "openlibrary/solr/query_utils.py", "openlibrary/solr/updater/edition.py", "openlibrary/solr/updater/work.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-72321288ea790a3ace9e36f1c05b68c93f7eec43-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": true, "repo": "internetarchive/openlibrary", "text_sha256": "e103ae2247533dd40f62991a10b295cf0f7a07a866326f8cdc4aabd9c1ae3d0b"}+{"added": [], "base_commit": "7b1ec94b425e4032a8c1b66a5219b4262af49484", "gold": ["scripts/import_standard_ebooks.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-798055d1a19b8fa0983153b709f460be97e33064-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "070b2a651fa6cabf8da8513dc9e37defcd0cadee4fc48072cd351c5d2b219ad6"}+{"added": [], "base_commit": "a8db93460b49a39fc3bd8639e34abfca9303236f", "gold": ["openlibrary/core/lists/model.py", "openlibrary/core/models.py", "openlibrary/plugins/openlibrary/code.py", "openlibrary/plugins/openlibrary/lists.py", "openlibrary/plugins/upstream/models.py", "openlibrary/plugins/upstream/utils.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-798a582540019363d14b2090755cc7b89a350788-v430f20c722405e462d9ef44dee7d34c41e76fe7a", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "7e52e001ef8e89591950175373c09a12aa0132355a16c69734dec3e68fcb89d7"}+{"added": [], "base_commit": "0c5d154db9a199adc4be35be84390368693b2144", "gold": ["conf/solr/conf/managed-schema", "openlibrary/core/bookshelves.py", "openlibrary/plugins/openlibrary/api.py", "openlibrary/solr/data_provider.py", "openlibrary/solr/solr_types.py", "openlibrary/solr/update_work.py", "scripts/solr_builder/Jenkinsfile", "scripts/solr_builder/solr_builder/solr_builder.py", "scripts/solr_builder/sql/create-dump-table.sql"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-7bf3238533070f2d24bafbb26eedf675d51941f6-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "cf1b041f5a9fb7b2f846aa89b5405834e2bb03e0bec9b4bfb8cfef8ddc2f857a"}+{"added": [], "base_commit": "a797a05d077f8896c5d8f480b3620eb1ee398f8c", "gold": ["openlibrary/catalog/marc/get_subjects.py", "openlibrary/catalog/marc/marc_binary.py", "openlibrary/catalog/utils/__init__.py", "pyproject.toml"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-7c8dc180281491ccaa1b4b43518506323750d1e4-v298a7a812ceed28c4c18355a091f1b268fe56d86", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "4e9a5787444a6ebe5ee3f3b2faf733a6ca7f30c1c8ae8709b31cabf0a8276154"}+{"added": [], "base_commit": "20e8fee0e879ca47c0a1259fec0a5ab1e292aa1f", "gold": ["conf/openlibrary.yml", "openlibrary/core/observations.py", "openlibrary/core/schema.sql", "openlibrary/plugins/openlibrary/api.py", "openlibrary/plugins/openlibrary/js/patron-metadata/index.js"], "hard": true, "instance_id": "instance_internetarchive__openlibrary-7cbfb812ef0e1f9716e2d6e85d538a96fcb79d13-vfa6ff903cb27f336e17654595dd900fa943dcd91", "language": "python", "names_gold_path": true, "repo": "internetarchive/openlibrary", "text_sha256": "32656f779fc02c2ed369afa8e645b9946099ba08ad6d8eb269cd9d983d5b0a90"}+{"added": [], "base_commit": "1d2cbffd8cbda42d71d50a045a8d2b9ebfe1f781", "gold": ["openlibrary/plugins/worksearch/autocomplete.py", "openlibrary/utils/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-7edd1ef09d91fe0b435707633c5cc9af41dedddf-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "7d846910153ebc0d77ec48012d8f1cd8fdeb5dcf36e8d8b269d4e826488315d8"}+{"added": ["openlibrary/plugins/worksearch/schemes/__init__.py", "openlibrary/plugins/worksearch/schemes/authors.py", "openlibrary/plugins/worksearch/schemes/subjects.py", "openlibrary/plugins/worksearch/schemes/works.py"], "base_commit": "febda3f008cb4d4e4e0568ab4d671992ceea07cf", "gold": ["openlibrary/core/bookshelves.py", "openlibrary/plugins/worksearch/code.py", "openlibrary/plugins/worksearch/subjects.py", "openlibrary/solr/query_utils.py", "openlibrary/templates/authors/index.html", "openlibrary/templates/search/authors.html", "openlibrary/templates/search/subjects.html", "openlibrary/templates/work_search.html", "openlibrary/utils/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-7f6b722a10f822171501d027cad60afe53337732-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "e16ed636804c0abfd94031b416fbbc77c1c53b93d6ab67da63ff85f89a2378a2"}+{"added": [], "base_commit": "630221ab686c64e75a2ce253c893c033e4814b2e", "gold": ["openlibrary/catalog/utils/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-7f7e53aa4cf74a4f8549a5bcd4810c527e2f6d7e-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "a1649084be73cbcea3fba20ee873ed026ecb2a234cc5a0c3471881de222aecdf"}+{"added": [], "base_commit": "64c18604714c0672f272ee1e620ad62e9a248312", "gold": ["openlibrary/plugins/upstream/addbook.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-89e4b4431fe7506c365a6f6eb6f6d048d04c044c-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "599bded128724ce292664ebd646e4b34989a59e92bb9b16485c623868249f0bd"}+{"added": ["scripts/monitoring/haproxy_monitor.py"], "base_commit": "9d9f3a19983876522bcfd17c9079c46a17986cb3", "gold": ["compose.production.yaml", "scripts/monitoring/monitor.py", "scripts/monitoring/requirements.txt", "scripts/monitoring/utils.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-8a5a63af6e0be406aa6c8c9b6d5f28b2f1b6af5a-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "20a8056a7e33d68ad1139ddc67ac7eb831d02783ec07cff0cc958172afe76706"}+{"added": [], "base_commit": "9db365285453fb388757aa65ae06226e7c0f64cf", "gold": ["openlibrary/templates/history/comment.html", "openlibrary/templates/history/sources.html", "scripts/providers/isbndb.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-8a9d9d323dfcf2a5b4f38d70b1108b030b20ebf3-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "c65cc8e566f2d1b25ccb28e202d5896b7731d9e2ef5de42d87e23ea9d14522cf"}+{"added": ["openlibrary/templates/showgoogle_books.html"], "base_commit": "e9e9d8be33f09cd487b905f339ec3e76ad75e0bb", "gold": ["openlibrary/core/imports.py", "openlibrary/core/vendors.py", "openlibrary/i18n/messages.pot", "openlibrary/plugins/importapi/code.py", "openlibrary/templates/history/sources.html", "openlibrary/views/showmarc.py", "scripts/affiliate_server.py", "scripts/promise_batch_imports.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-910b08570210509f3bcfebf35c093a48243fe754-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "018ef5da568e5b86121b8e4e32989513e07829e0e60395c42f3fbff74e2ddd36"}+{"added": [], "base_commit": "ab62fa4d63d15b7bc1b9a856ae9acd74df1f1f93", "gold": ["openlibrary/templates/account/books.html", "openlibrary/utils/dateutil.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-91efee627df01e32007abf2d6ebf73f9d9053076-vbee42ad1b72fb23c6a1c874868a720b370983ed2", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "d288c4890c43541854dfb2a98ae6f8d61e6d042d80e1a46cf61dd2410e676052"}+{"added": [], "base_commit": "4d2c696773853ee7fb4ec0ceb773351a52257447", "gold": ["docker-compose.yml", "openlibrary/core/bookshelves.py", "openlibrary/core/models.py", "openlibrary/core/ratings.py", "openlibrary/macros/SearchResultsWork.html", "openlibrary/macros/StarRatings.html", "openlibrary/plugins/upstream/mybooks.py", "openlibrary/plugins/worksearch/code.py", "openlibrary/templates/account/books.html", "openlibrary/templates/account/reading_log.html", "openlibrary/utils/solr.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-92db3454aeaa02f89b4cdbc3103f7e95c9759f92-v2c55207218fb8a0138425cbf7d9675272e240b90", "language": "python", "names_gold_path": true, "repo": "internetarchive/openlibrary", "text_sha256": "e6e7d00b5103109b96782e001e33e22a01dce094829f98240a6a5ceb98c601b7"}+{"added": [], "base_commit": "b2086f9bf54a3a8289e558a8f542673e3d01b376", "gold": ["openlibrary/plugins/worksearch/code.py", "openlibrary/solr/query_utils.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-9bdfd29fac883e77dcbc4208cab28c06fd963ab2-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "068048c4421d211cbd91b71b7e0a7e5920581e862d3ace1314c6fbb6ac9aefc8"}+{"added": [], "base_commit": "bf5511b4348e89a143ffc99553cd7e4e2a6b0485", "gold": ["openlibrary/catalog/marc/marc_base.py", "openlibrary/catalog/marc/marc_binary.py", "openlibrary/catalog/marc/marc_xml.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-9c392b60e2c6fa1d68cb68084b4b4ff04d0cb35c-v2d9a6c849c60ed19fd0858ce9e40b7cc8e097e59", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "6170f43646e41a6822044fa3cefb270d912a69c3455c21d50d044a554723a17d"}+{"added": [], "base_commit": "7fab050b6a99923d9d2efcc2f79311580b88f8a9", "gold": ["openlibrary/catalog/add_book/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-9cd47f4dc21e273320d9e30d889c864f8cb20ccf-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "15988e3bb674f18121927afaab94622a4a01dbb780cc772c0eca61a0fa810f51"}+{"added": [], "base_commit": "5e9872c8e19487fbeac11873549275184ce9b817", "gold": ["openlibrary/plugins/worksearch/code.py"], "hard": true, "instance_id": "instance_internetarchive__openlibrary-a48fd6ba9482c527602bc081491d9e8ae6e8226c-vfa6ff903cb27f336e17654595dd900fa943dcd91", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "8ca1d5fc92f77b3e702184bf3ca8dafa6158a276b7bd930c12a5ec2b19b5f3e4"}+{"added": [], "base_commit": "4825ff66e84545216c35d7a0bb01c177f5591b96", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/core/stats.py", "openlibrary/plugins/importapi/code.py", "openlibrary/plugins/importapi/import_validator.py", "scripts/promise_batch_imports.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-b112069e31e0553b2d374abb5f9c5e05e8f3dbbe-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "fb476ded80c5ae3eef700bc8712e302191473cf146b8b1f85087f01c3fc055f5"}+{"added": [], "base_commit": "0b2e93f2d150770f6ecbfd1931ef56ad876d2c4c", "gold": ["openlibrary/solr/update_work.py", "openlibrary/solr/utils.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-b4f7c185ae5f1824ac7f3a18e8adf6a4b468459c-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "0c8eb0c9067488bfff1c3a49c9e02507a63d55f71ada3b163c3c53951a4cd9d9"}+{"added": [], "base_commit": "d8518f64d954113c9363335eb25201befa2de6f2", "gold": ["openlibrary/catalog/marc/get_subjects.py", "openlibrary/catalog/marc/marc_base.py", "openlibrary/catalog/marc/marc_binary.py", "openlibrary/catalog/marc/marc_xml.py", "openlibrary/catalog/marc/parse.py", "openlibrary/catalog/marc/parse_xml.py"], "hard": true, "instance_id": "instance_internetarchive__openlibrary-b67138b316b1e9c11df8a4a8391fe5cc8e75ff9f-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "7cbfb5daa84fde6d84594f80d51168517f622e59797988454f809a1dcab05f9e"}+{"added": [], "base_commit": "2edaf7283cf5d934e0d60aac0cc89eff7ceb6e43", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/utils/__init__.py", "openlibrary/plugins/importapi/code.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-ba3abfb6af6e722185d3715929ab0f3e5a134eed-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "277faac64862afa1439e2709a17f8832a971bc0e952c42a34074f16bef78520b"}+{"added": [], "base_commit": "4a17636ae04cf6039ccb6b91f2ed13ce589358d4", "gold": ["openlibrary/templates/account/books.html", "openlibrary/utils/dateutil.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-bdba0af0f6cbaca8b5fc3be2a3080f38156d9c92-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "33478f01b4e3a6452d97312f09234bac2788d1631c1411ac2676810e2d9581e9"}+{"added": [], "base_commit": "0180e2ca33a152e69bdbc97047cf6961787c947d", "gold": ["openlibrary/catalog/utils/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-c05ccf2cd8baa81609434e0e35c4a63bc0da5a25-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "dd5d42fef20f2d9e1ea8bc0586636348c2ca06cc6fc49bf7af222281f751d37b"}+{"added": ["openlibrary/utils/lccn.py"], "base_commit": "d55e8868085c70c2b9f2ef859ebacbb50fff85fe", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/plugins/upstream/models.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-c12943be1db80cf1114bc267ddf4f9933aca9b28-v2c55207218fb8a0138425cbf7d9675272e240b90", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "83f42f449ac51f132f3c1becd0642245a0737e40c5c74e7ed582e31fe7841db3"}+{"added": [], "base_commit": "84cc4ed5697b83a849e9106a09bfed501169cc20", "gold": ["openlibrary/core/imports.py", "openlibrary/core/models.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-c4eebe6677acc4629cb541a98d5e91311444f5d4-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "4f195032e03fd21cc8e8d5d72c3122d2f585683d7d014dc1b1917040a4476122"}+{"added": ["openlibrary/utils/open_syllabus_project.py", "scripts/open_syllabus_project_parser.py"], "base_commit": "2f590171b1d95cc124c44fb6ec647c85f1ca9581", "gold": ["Makefile", "conf/solr/conf/managed-schema.xml", "docker/ol-solr-updater-start.sh", "openlibrary/solr/solr_types.py", "openlibrary/solr/update.py", "openlibrary/solr/updater/work.py", "pyproject.toml", "scripts/solr_builder/Jenkinsfile", "scripts/solr_builder/index-type.sh", "scripts/solr_builder/solr_builder/fn_to_cli.py", "scripts/solr_builder/solr_builder/solr_builder.py", "scripts/solr_updater.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-c506c1b0b678892af5cb22c1c1dbc35d96787a0a-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "b2cdca49c7cce31338ce81e187d36ca9788c034bd4361b03ae765908fc18c8e0"}+{"added": [], "base_commit": "f0341c0ba81c790241b782f5103ce5c9a6edf8e3", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/utils/__init__.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-c8996ecc40803b9155935fd7ff3b8e7be6c1437c-ve8fc82d8aae8463b752a211156c5b7b59f349237", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "98bf8542988d2bd50761657024d2d95ebff0aad32df969bdf5b141011275f2b9"}+{"added": [], "base_commit": "daf93507208f2206f8950e3bb5fffac7caf80520", "gold": ["openlibrary/core/lists/model.py", "openlibrary/macros/SearchResultsWork.html", "openlibrary/plugins/openlibrary/lists.py", "openlibrary/plugins/upstream/utils.py", "openlibrary/plugins/worksearch/code.py", "openlibrary/solr/updater/list.py", "openlibrary/templates/lists/feed_updates.html", "openlibrary/templates/type/list/edit.html", "openlibrary/templates/type/list/view_body.html", "static/css/components/search-result-item.less"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-d109cc7e6e161170391f98f9a6fa1d02534c18e4-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "5dc5dc85b06c971917641752184b0d98ffa88f87f762f2b38f9de0c41b854f84"}+{"added": [], "base_commit": "cbfef314d45fe04e8bf7ebb239f1699606378634", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/add_book/load_book.py", "openlibrary/plugins/importapi/code.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-d40ec88713dc95ea791b252f92d2f7b75e107440-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "d3c1f44cf5cb7e0c683c7eaa59c32684b5c778ff0acaf9bcc448a7d4e32d43e6"}+{"added": [], "base_commit": "5de7de19211e71b29b2f2ba3b1dff2fe065d660f", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/utils/__init__.py", "scripts/promise_batch_imports.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-d8162c226a9d576f094dc1830c4c1ffd0be2dd17-v76304ecdb3a5954fcf13feb710e8c40fcf24b73c", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "2f9e766495c78e2838fa197d2ebf8abac79b10c6266bbe6adfc0c6ab48d8ca20"}+{"added": [], "base_commit": "409914bf541b32b2160200b7623060f2b5fab6c0", "gold": ["openlibrary/plugins/openlibrary/lists.py", "openlibrary/plugins/upstream/utils.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-dbbd9d539c6d4fd45d5be9662aa19b6d664b5137-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "190a5d47d0ac78e7c1d62c3ffaf2ae72e1fc011a7c693fb353b5b1965a4a97a8"}+{"added": ["openlibrary/templates/book_providers/runeberg_download_options.html", "openlibrary/templates/book_providers/runeberg_read_button.html"], "base_commit": "b70f9abab445676042e5c300dcf5dd8eac4afd18", "gold": ["openlibrary/book_providers.py", "openlibrary/i18n/messages.pot", "openlibrary/macros/RawQueryCarousel.html", "openlibrary/plugins/worksearch/code.py", "openlibrary/plugins/worksearch/schemes/works.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-e010b2a13697de70170033902ba2e27a1e1acbe9-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "9dcc32f3a040a96d03f5f090e6b040bb112d3247c1584f2a2a9b9be01b1c67ae"}+{"added": ["static/css/components/ol-message.less"], "base_commit": "77c16d530b4d5c0f33d68bead2c6b329aee9b996", "gold": ["openlibrary/i18n/messages.pot", "openlibrary/macros/TableOfContents.html", "openlibrary/plugins/upstream/table_of_contents.py", "openlibrary/templates/books/edit/edition.html", "static/css/page-user.less"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-e1e502986a3b003899a8347ac8a7ff7b08cbfc39-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "f036b2dba967b939697c4e3b493b723b07139d2b2a6f9b9276aa7c8fa7b5a1b6"}+{"added": [], "base_commit": "a08e565962ccbbd2931c7e2821bd37067a97f339", "gold": ["openlibrary/solr/update_work.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-e390c1212055dd84a262a798e53487e771d3fb64-v8717e18970bcdc4e0d2cea3b1527752b21e74866", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "779798792f25a37ee5e6f0a8289d6c87775934be4b9ce1a8c50c775032e08cd2"}+{"added": [], "base_commit": "8d41b319745228044947e039f629c44a5da08a09", "gold": ["openlibrary/catalog/marc/parse.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-e8084193a895d8ee81200f49093389a3887479ce-ve8c8d62a2b60610a3c4631f5f23ed866bada9818", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "ec5d8f9d5515526e86fd6c9bb351304ba5d5e68647256949b8ea58666e07c933"}+{"added": [], "base_commit": "ba3abfb6af6e722185d3715929ab0f3e5a134eed", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/catalog/utils/__init__.py", "openlibrary/plugins/importapi/code.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-f0341c0ba81c790241b782f5103ce5c9a6edf8e3-ve8fc82d8aae8463b752a211156c5b7b59f349237", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "a654dcc5dec1b538b95a01941c771c31a5178fd8066260a932af743e37f562bf"}+{"added": [], "base_commit": "53d376b148897466bb86d5accb51912bbbe9a8ed", "gold": ["openlibrary/catalog/add_book/load_book.py", "openlibrary/core/helpers.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-f343c08f89c772f7ba6c0246f384b9e6c3dc0add-v08d8e8889ec945ab821fb156c04c7d2e2810debb", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "a1330f9b924d6fe73f19ed9f653559949df9d121074f3dae096772a2ee7ceffe"}+{"added": [], "base_commit": "471ffcf05c6b9ceaf879eb95d3a86ccf8232123b", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/plugins/importapi/import_validator.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-f3b26c2c0721f8713353fe4b341230332e30008d-v0f5aece3601a5b4419f7ccec1dbda2071be28ee4", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "4aeec1f6ee5638a496efba2196b55c3e946c846298b845fe0ff558b995268f20"}+{"added": ["scripts/import_open_textbook_library.py"], "base_commit": "3677dd20bcdd17aa0fa0f202f4ea50c46936bdc5", "gold": [], "hard": false, "instance_id": "instance_internetarchive__openlibrary-f8cc11d9c1575fdba5ac66aee0befca970da8d64-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "6d8c212a2dc92d78d47838eb730a8c86bce7980a872766de1b29e0609d3c06a9"}+{"added": [], "base_commit": "afb819f8166c6dff4295c6802cc0b55b67f05731", "gold": ["openlibrary/catalog/get_ia.py", "openlibrary/catalog/marc/marc_subject.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-fad4a40acf5ff5f06cd7441a5c7baf41a7d81fe4-vfa6ff903cb27f336e17654595dd900fa943dcd91", "language": "python", "names_gold_path": true, "repo": "internetarchive/openlibrary", "text_sha256": "c97647e026d4dcd2aed0486f0ab8b4c5866b23459c25f56a98e19665073df338"}+{"added": [], "base_commit": "69cb6f271d8eb461baf163260f8e43e7420793e7", "gold": ["openlibrary/catalog/add_book/__init__.py", "openlibrary/core/imports.py", "openlibrary/core/models.py", "openlibrary/plugins/importapi/code.py"], "hard": false, "instance_id": "instance_internetarchive__openlibrary-fdbc0d8f418333c7e575c40b661b582c301ef7ac-v13642507b4fc1f8d234172bf8129942da2c2ca26", "language": "python", "names_gold_path": false, "repo": "internetarchive/openlibrary", "text_sha256": "b1aa8f97d19a0b22061aed7eb0c88dd8bb63c06b95e92fd38b0b6d88217cf73b"}+{"added": ["db/migration/20221219112733_add_album_image_paths.go"], "base_commit": "2f90fc9bd40e24afd900b5ee85426f32684b960b", "gold": ["model/album.go", "model/mediafile.go", "scanner/refresher.go", "scanner/tag_scanner.go", "scanner/walk_dir_tree.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-0130c6dc13438b48cf0fdfab08a89e357b5517c9", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "9c51d50847e9b66f39412a2a3b405bb298ce491ea6500b3b4cdf9dd98f886a55"}+{"added": [], "base_commit": "61903facdf5d56277bf57c7aa83bce7fb35b597a", "gold": ["core/artwork/artwork.go", "core/artwork/cache_warmer.go", "core/artwork/reader_resized.go", "core/artwork/sources.go", "server/public/handle_images.go", "server/subsonic/media_retrieval.go", "ui/src/album/AlbumGridView.js", "ui/src/subsonic/index.js"], "hard": false, "instance_id": "instance_navidrome__navidrome-0488fb92cb02a82924fb1181bf1642f2e87096db", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "2f60996925bdbbf2c7dd71a859fabd5f71c8b80089209030b60ec3d340bfeaea"}+{"added": [], "base_commit": "70487a09f4e202dce34b3d0253137f25402495d4", "gold": ["persistence/user_repository.go", "server/auth.go", "server/subsonic/middlewares.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-09ae41a2da66264c60ef307882362d2e2d8d8b89", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "a01be1979400e897fb9b3d27bcec945b7b1f250fae0195c588124985ddf9010d"}+{"added": [], "base_commit": "9c3b4561652a15846993d477003e111f0df0c585", "gold": ["server/subsonic/browsing.go", "server/subsonic/helpers.go", "server/subsonic/responses/responses.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-0a650de357babdcc8ce910fe37fee84acf4ed2fe", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "78afd3681b9df5f03c804cf8b0e99653d7e86ce93145403e95f011866ec9ee48"}+{"added": [], "base_commit": "aac6e2cb0774aa256c00098b2d88bf8af288da79", "gold": ["conf/configuration.go", "server/middlewares.go", "server/public/public_endpoints.go", "server/serve_index.go", "server/server.go", "server/subsonic/middlewares.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-10108c63c9b5bdf2966ffb3239bbfd89683e37b7", "language": "go", "names_gold_path": true, "repo": "navidrome/navidrome", "text_sha256": "4c8b9b71459e057c49e44d27bcd65bae1e764b2ca7dd64101ac9593ad13bd5cd"}+{"added": [], "base_commit": "aafd5a952c2cf19868b681c52400b395c33273a0", "gold": ["server/subsonic/middlewares.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-1e96b858a91c640fe64e84c5e5ad8cc0954ea38d", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "a40a187ec1312c93eee3caa9a6410815c86e55a19686c7055384c93a13b454fd"}+{"added": [], "base_commit": "8808eadddaa517ab58ce33a70d08f37b0ffdef0e", "gold": ["server/subsonic/api.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-23bebe4e06124becf1000e88472ae71a6ca7de4c", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "7ade28c680fb1a1e26ac180058308e4355bf2d251db992f34c02eaa71de5f635"}+{"added": ["conf/mime/mime_types.go", "resources/mime_types.yaml"], "base_commit": "28f7ef43c1083fab4f7eabbade6a5bab83615e73", "gold": ["consts/mime_types.go", "server/serve_index.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-27875ba2dd1673ddf8affca526b0664c12c3b98b", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "dac80ec9d5902fcf7c3a085753c1bfbfa5cb852a586c89bb5ab723558c13bbcf"}+{"added": ["cmd/pls.go"], "base_commit": "5d8318f7b362c5b044f892f775d264a5d40e4e24", "gold": ["conf/configuration.go", "core/auth/auth.go", "core/playlists.go", "log/log.go", "model/playlist.go", "scanner/playlist_importer.go", "scanner/tag_scanner.go", "scanner/walk_dir_tree.go", "server/nativeapi/playlists.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-28389fb05e1523564dfc61fa43ed8eb8a10f938c", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "bc7a2d2c5e599f2b247e6b734b6172e5768b2e37358cbc72ccc51ac8406903c8"}+{"added": [], "base_commit": "29bc17acd71596ae92131aca728716baf5af9906", "gold": ["utils/cache/cached_http_client.go", "utils/cache/simple_cache.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-29b7b740ce469201af0a0510f3024adc93ef4c8e", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "3f58dab74bb46a71a29f07528d6a66039788b482e39dda3cf7b7c76fd5bdbf74"}+{"added": ["utils/cache/simple_cache.go"], "base_commit": "4044642abf5a7147c3ed3076c045e0e3b2520171", "gold": ["core/scrobbler/play_tracker.go", "scanner/cached_genre_repository.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-29bc17acd71596ae92131aca728716baf5af9906", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "8ecdf79bddec1c28600ab8758426daa4f33396d01a05dd24e13e21cb6fa15ee0"}+{"added": [], "base_commit": "537e2fc033b71a4a69190b74f755ebc352bb4196", "gold": ["cmd/root.go", "cmd/wire_gen.go", "cmd/wire_injectors.go", "conf/configuration.go", "consts/consts.go", "core/metrics/prometheus.go", "scanner/scanner.go", "server/auth.go", "server/server.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-31799662706fedddf5bcc1a76b50409d1f91d327", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "818fd870ad109c0c58817564be218f233acc2013641f89fb619f38bfc9ec7141"}+{"added": [], "base_commit": "257ccc5f4323bb2f39e09fa903546edf7cdf370a", "gold": ["scanner/tag_scanner.go", "scanner/walk_dir_tree.go", "utils/paths.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-3853c3318f67b41a9e4cb768618315ff77846fdb", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "2ba986c4bcf6a442c4b8e1e8f40b1b3827d6edab89329d19bb0d55dd9dca7778"}+{"added": [], "base_commit": "653b4d97f959df49ddf6ac9c76939d2fbbfc9bf1", "gold": ["model/datastore.go", "persistence/sql_base_repository.go", "persistence/sql_restful.go", "ui/src/album/AlbumList.js", "utils/hasher/hasher.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-3977ef6e0f287f598b6e4009876239d6f13b686d", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "23ca58f912d30c5b7cb002f99bc2a8c09172ed64a3af8ad38c93f56e6c48d7c1"}+{"added": [], "base_commit": "1bf94531fdb3599ccfbc5aca574152b8802bf5eb", "gold": ["cmd/backup.go", "cmd/root.go", "consts/consts.go", "db/backup.go", "db/db.go", "persistence/dbx_builder.go", "persistence/persistence.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-3982ba725883e71d4e3e618c61d5140eeb8d850a", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "42633baf59756688816604c76ac7981624f619e47b61c682cffd193a27b20af5"}+{"added": [], "base_commit": "3993c4d17fd4b25db867c06b817d3fc146e67d60", "gold": ["core/scrobbler/play_tracker.go", "utils/cache/simple_cache.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-3bc9e75b2843f91f6a1e9b604e321c2bd4fd442a", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "efed2e6fba363d620b3cd14b1b7dda58633dbcff5f181ca9e9cd10ca654b9b28"}+{"added": [], "base_commit": "cbe3adf9873af6d255c5476d2fde54116968f01c", "gold": ["cmd/wire_gen.go", "consts/consts.go", "core/artwork/artwork.go", "core/artwork/reader_artist.go", "core/external_metadata.go", "scanner/refresher.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-3f2d24695e9382125dfe5e6d6c8bbeb4a313a4f9", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "614e887f0c2f7df6a1186e80a312471e942f38b46b99e0ed34adf0195982b7d3"}+{"added": ["core/agents/lastfm/session_keys.go", "db/migration/20210623155401_add_user_prefs_player_scrobbler_enabled.go", "model/user_props.go", "persistence/user_props_repository.go"], "base_commit": "265f33ed9da106cd2c926a243d564ad93c04df0e", "gold": ["core/agents/lastfm/agent.go", "core/agents/lastfm/auth_router.go", "model/datastore.go", "model/properties.go", "persistence/persistence.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-5001518260732e36d9a42fb8d4c054b28afab310", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "6e993c87ef4586ed7464d3e1a597773157966562734fa47f96fdf1b15b307604"}+{"added": ["cmd/backup.go", "db/backup.go"], "base_commit": "768160b05e9929bf5d82359b7768e67ffffeb9b6", "gold": ["cmd/root.go", "conf/configuration.go", "db/db.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-55730514ea59d5f1d0b8e3f8745569c29bdbf7b4", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "30e5ad84e04d8ee54aedd75482b36eb8c4d1cbf89e4d4185363ef618c3a85953"}+{"added": ["persistence/dbx_builder.go"], "base_commit": "68f03d01672a868f86e0fd73dde3957df8bf0dab", "gold": ["cmd/wire_gen.go", "consts/consts.go", "core/scrobbler/play_tracker.go", "db/db.go", "persistence/persistence.go", "server/initial_setup.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-55bff343cdaad1f04496f724eda4b55d422d7f17", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "d0aee0a9802f70c19e62d238335889f291e10cbf1f2b44f8efa1f1e6a6e91a57"}+{"added": [], "base_commit": "e434ca937255be6e12f11300648b3486de0aa9c2", "gold": ["scanner/metadata/metadata.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-56303cde23a4122d2447cbb266f942601a78d7e4", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "375a8cd5fbe64607fcc41e386b95ea716e9f194aa7f51894d93fccacde1ff093"}+{"added": [], "base_commit": "39da741a807498a01a31435a097b98fe6021c902", "gold": ["model/album.go", "model/artist.go", "model/mediafile.go", "persistence/album_repository.go", "persistence/artist_repository.go", "persistence/genre_repository.go", "persistence/mediafile_repository.go", "persistence/sql_genres.go", "server/subsonic/album_lists.go", "server/subsonic/filter/filters.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-5e549255201e622c911621a7b770477b1f5a89be", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "4c3fbcb4ead6a98e507f6be9332dcd95c6240592aa8a72a72b298ad81dddc715"}+{"added": [], "base_commit": "3910e77a7a6ff747487b5ef484a67dbab5826f6a", "gold": ["core/playlists.go", "persistence/playlist_repository.go", "persistence/playqueue_repository.go", "persistence/sql_genres.go", "scanner/refresher.go", "scanner/tag_scanner.go", "utils/slice/slice.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-669c8f4c49a7ef51ac9a53c725097943f67219eb", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "83c0783a50f191c412ea1a8e348af298b25810684794cff1eab8e399ae3d3e6a"}+{"added": ["db/migration/20210616150710_encrypt_all_passwords.go", "utils/encrypt.go"], "base_commit": "d42dfafad4c556a5c84147c8c3789575ae77c5ae", "gold": ["conf/configuration.go", "consts/consts.go", "log/log.go", "model/user.go", "persistence/user_repository.go", "server/auth.go", "server/subsonic/middlewares.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-66b74c81f115c78cb69910b0472eeb376750efc4", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "988980f78116506debec57ddad49992d39494a511370301141ecd719134a1b3e"}+{"added": [], "base_commit": "a0290587b92cf29a3f8af6ea9f93551b28d1ce75", "gold": ["cmd/root.go", "cmd/wire_gen.go", "cmd/wire_injectors.go", "core/playback/playbackserver.go", "core/wire_providers.go", "scanner/scanner.go", "server/subsonic/api.go", "server/subsonic/jukebox.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-677d9947f302c9f7bba8c08c788c3dc99f235f39", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "1cb1f8594b0080e8c63c8deadd6995043dff417353917324af7cb3b567163fe4"}+{"added": [], "base_commit": "8f0d002922272432f5f6fed869c02480147cea6e", "gold": ["core/artwork/artwork.go", "core/artwork/reader_resized.go", "server/public/public_endpoints.go", "server/server.go", "server/subsonic/browsing.go", "server/subsonic/helpers.go", "server/subsonic/searching.go"], "hard": true, "instance_id": "instance_navidrome__navidrome-69e0a266f48bae24a11312e9efbe495a337e4c84", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "9287d8375f9ab3ac697ee955930d9a95b86b9313cd1464a7bac4b1a1c38e11e5"}+{"added": ["utils/paths.go"], "base_commit": "3853c3318f67b41a9e4cb768618315ff77846fdb", "gold": ["scanner/tag_scanner.go", "scanner/walk_dir_tree.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-6b3b4d83ffcf273b01985709c8bc5df12bbb8286", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "3a5cc83a5d94ffa8ea7fc7f22afc213c819c0ccf174cf1d5534d6156c3e8dc5f"}+{"added": [], "base_commit": "b445cdd64166fb679103464c2e7ba7c890f97cb1", "gold": ["conf/configuration.go", "log/log.go", "log/redactrus.go", "server/app/auth.go", "server/app/serve_index.go", "ui/src/authProvider.js"], "hard": false, "instance_id": "instance_navidrome__navidrome-6bd4c0f6bfa653e9b8b27cfdc2955762d371d6e9", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "d1b9c8500993491f0614e48299336e13fe1f4214e5d635c99c5633136249ec2b"}+{"added": [], "base_commit": "6ff7ab52f4a62e65d59b6c6eb9b9f47eb976c43b", "gold": ["core/media_streamer.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-6c6223f2f9db2c8c253e0d40a192e3519c9037d1", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "881fd3b6e9b3507cbed19f5228f34f34372c74e3434f6ba3df3157afd680ee83"}+{"added": [], "base_commit": "a9cf54afef34f980985c76ae3a5e1b7441098831", "gold": ["consts/consts.go", "core/archiver.go", "core/ffmpeg/ffmpeg.go", "core/media_streamer.go", "server/public/handle_streams.go", "server/subsonic/opensubsonic.go", "server/subsonic/stream.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-812dc2090f20ac4f8ac271b6ed95be5889d1a3ca", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "73879128edd6f1909444555edd0c7438746998786adb4a13f99815a0c49bf7fb"}+{"added": [], "base_commit": "8a56584aedcb810f586a8917e98517cde0834628", "gold": ["server/events/events.go", "server/subsonic/media_annotation.go", "ui/src/common/useResourceRefresh.js", "ui/src/reducers/activityReducer.js"], "hard": false, "instance_id": "instance_navidrome__navidrome-8383527aaba1ae8fa9765e995a71a86c129ef626", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "3703a9cc66b436fb4a8ba83c1bd86d8a9329ad404a0eb73c83497cc5b855503a"}+{"added": [], "base_commit": "5808b9fb718eaec4d0e72f02bebb811ca7bc8ca0", "gold": ["go.mod", "go.sum", "model/user.go", "persistence/user_repository.go", "resources/i18n/pt.json", "ui/src/authProvider.js", "ui/src/i18n/en.json", "ui/src/user/UserEdit.js"], "hard": true, "instance_id": "instance_navidrome__navidrome-874b17b8f614056df0ef021b5d4f977341084185", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "e269ac7d56e2dfcb8f81d23b1e9663776ac5c18c8fbe2bceea89fb1c62b2f37b"}+{"added": [], "base_commit": "213ceeca7893d3c85eb688e6e99c09dd6cd7e453", "gold": ["core/artwork.go", "model/mediafile.go", "ui/src/reducers/playerReducer.js"], "hard": false, "instance_id": "instance_navidrome__navidrome-87d4db7638b37eeb754b217440ab7a372f669205", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "36be68b9a45f2e757a8018638363541cc7e3eacc4ea11429f5581076c5b46d61"}+{"added": [], "base_commit": "4e0177ee5340b888126092d1146c1c7b6a92fed8", "gold": ["core/agents/lastfm.go", "utils/lastfm/client.go", "utils/lastfm/responses.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-89b12b34bea5687c70e4de2109fd1e7330bb2ba2", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "61bd0473f0a3f4728f702f55cc6fd603879368547de8413541b5f469d0249d9b"}+{"added": [], "base_commit": "5064cb2a46e4b7ca6a834b3c48a409eec8ca1830", "gold": ["persistence/album_repository.go", "scanner/mapping.go", "server/subsonic/helpers.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-8d56ec898e776e7e53e352cb9b25677975787ffc", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "954248796f222977499dfe9e83dbcd5c2edb071919669bfd5f1024696da2ccf1"}+{"added": [], "base_commit": "bce7b163bae6e0a377a3fde66b3aea2cfdce841b", "gold": ["model/album.go", "model/artist.go", "model/mediafile.go", "persistence/artist_repository.go", "persistence/helpers.go", "scanner/refresher.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-8e640bb8580affb7e0ea6225c0bbe240186b6b08", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "42f8deb40d11d62ce4c7d2afa8b7c5d3deaef2283fe1872a20d59244db89b426"}+{"added": ["db/migration/20210619231716_drop_player_name_unique_constraint.go"], "base_commit": "f8ee6db72a015f33b41879d1ba253eeff8884bfd", "gold": ["core/players.go", "core/scrobbler/scrobbler.go", "go.mod", "go.sum", "model/player.go", "persistence/player_repository.go", "server/subsonic/album_lists.go", "server/subsonic/api.go", "server/subsonic/media_annotation.go", "server/subsonic/middlewares.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-97434c1789a6444b30aae5ff5aa124a96a88f504", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "dc82ae21595272a20da2379acf2d0273806d1777263ab269dc9d8f2425a55ad6"}+{"added": ["release/wix/build_msi.sh", "release/wix/msitools.dockerfile"], "base_commit": "23bebe4e06124becf1000e88472ae71a6ca7de4c", "gold": [".dockerignore", ".github/workflows/pipeline.yml", "Makefile", "cmd/root.go", "cmd/svc.go", "conf/configuration.go", "log/formatters.go", "log/log.go", "wix/Navidrome_UI_Flow.wxs", "wix/SettingsDlg.wxs", "wix/bmp/banner.bmp", "wix/bmp/dialogue.bmp", "wix/navidrome.wxs", "wix/convertIniToToml.vbs"], "hard": false, "instance_id": "instance_navidrome__navidrome-9c3b4561652a15846993d477003e111f0df0c585", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "c00244753959c1297c7c585b99b5d5a1eaf68d2d48739a439d0f05828978f569"}+{"added": [], "base_commit": "db11b6b8f8ab9a8557f5783846cc881cc50b627b", "gold": ["conf/configuration.go", "core/agents/lastfm.go", "core/agents/spotify.go", "server/initial_setup.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-b3980532237e57ab15b2b93c49d5cd5b2d050013", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "c711b69addc26ba1d8b7284b65881a9ce2325e330d7fa65bf5aa0a79acb55ac3"}+{"added": [], "base_commit": "5f6f74ff2dde934aae2f2def911506d8c4ba66e1", "gold": ["consts/consts.go", "model/request/request.go", "scanner/scanner.go", "server/events/diode.go", "server/events/sse.go", "server/middlewares.go", "server/server.go", "server/subsonic/media_annotation.go", "server/subsonic/middlewares.go", "ui/src/dataProvider/httpClient.js"], "hard": false, "instance_id": "instance_navidrome__navidrome-b65e76293a917ee2dfc5d4b373b1c62e054d0dca", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "ed0f68b2d40a609403a773c8c7932bdf6a4987eecb0694b16d87e8f449c90b56"}+{"added": ["db/migration/20240122223340_add_default_values_to_null_columns.go.go"], "base_commit": "ac4ceab14342bbcb42a6d57bba99e5f933023839", "gold": ["core/external_metadata.go", "core/share.go", "model/album.go", "model/artist.go", "model/share.go", "scanner/refresher.go", "server/public/encode_id.go", "server/subsonic/sharing.go", "utils/gg/gg.go"], "hard": true, "instance_id": "instance_navidrome__navidrome-bf2bcb12799b21069f137749e0c331f761d1f693", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "ae79ba3579db38eaeedcd68b9c631e412922cf755daf9e88965095c917340b7d"}+{"added": ["db/migration/20230112111457_add_album_paths.go"], "base_commit": "69e0a266f48bae24a11312e9efbe495a337e4c84", "gold": ["core/artwork/reader_artist.go", "core/artwork/sources.go", "model/album.go", "model/mediafile.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-c90468b895f6171e33e937ff20dc915c995274f0", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "e44ec55065b0cceec423cd769107f59ce210941c78de8fcd787653f7f60d94aa"}+{"added": [], "base_commit": "c72add516a0f260e83a289c2355b2e74071311e0", "gold": ["model/playlist.go", "persistence/playlist_repository.go", "persistence/playlist_track_repository.go", "persistence/sql_smartplaylist.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-d21932bd1b2379b0ebca2d19e5d8bae91040268a", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "070b729acc52145f681425e369c41ad52cda9bfd5e7f2569cdc4cfb7f68c82ee"}+{"added": [], "base_commit": "20271df4fb0b94e201ed5e4b6501d591aa8cd813", "gold": ["core/auth/auth.go", "core/share.go", "server/subsonic/api.go", "server/subsonic/sharing.go", "utils/request_helpers.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-d5df102f9f97c21715c756069c9e141da2a422dc", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "38fb5658b5e7432a4c4fc2bfbae8cffb03939fc561fabcd5ef78141fd0d935c5"}+{"added": [], "base_commit": "a2d9aaeff8774115cd1d911c23a74e319d72ce62", "gold": ["core/scrobbler/play_tracker.go", "db/db.go", "scheduler/scheduler.go", "server/events/sse.go", "utils/singleton/singleton.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-d613b1930688422122796b43acb3caf2538c8fd1", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "842d71070fe4ff5ea1ef7cefdcfd1b60bdf335b37c5f855ca32470562af54731"}+{"added": [], "base_commit": "128b626ec9330a7693ec6bbc9788d75eb2ef55e6", "gold": ["core/artwork/artwork.go", "core/artwork/cache_warmer.go", "core/artwork/reader_album.go", "core/artwork/reader_artist.go", "core/artwork/reader_emptyid.go", "core/artwork/reader_resized.go", "core/artwork/sources.go", "server/public/handle_images.go", "server/subsonic/media_retrieval.go", "ui/src/playlist/PlaylistSongs.js"], "hard": false, "instance_id": "instance_navidrome__navidrome-d8e794317f788198227e10fb667e10496b3eb99a", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "46e1ed9788666b15a5dc162200356c3039ad64341695e89b97bf9c354be37eef"}+{"added": [], "base_commit": "27875ba2dd1673ddf8affca526b0664c12c3b98b", "gold": ["persistence/album_repository.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-de90152a7173039677ac808f5bfb1e644d761336", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "b751a2abd86db51f623ce5ac257b64bfa7f032c0aaf670197e975c21bbca3b7c"}+{"added": [], "base_commit": "8f03454312f28213293da7fec7f63508985f0eeb", "gold": ["model/criteria/json.go", "model/criteria/operators.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-dfa453cc4ab772928686838dc73d0130740f054e", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "b5bf743449ed621c079b42de4707b0e796643dacb714756c35c1cc4b9cea0930"}+{"added": ["db/migration/20210821212604_add_mediafile_channels.go"], "base_commit": "0079a9b93873621fa0bed5439a0f753f48e081b5", "gold": ["model/mediafile.go", "scanner/mapping.go", "scanner/metadata/ffmpeg/ffmpeg.go", "scanner/metadata/metadata.go", "scanner/metadata/taglib/taglib_wrapper.cpp", "ui/src/album/AlbumSongs.js", "ui/src/common/SongDetails.js", "ui/src/i18n/en.json", "ui/src/playlist/PlaylistSongs.js", "ui/src/song/SongList.js"], "hard": false, "instance_id": "instance_navidrome__navidrome-e12a14a87d392ac70ee4cc8079e3c3e0103dbcb2", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "72bea39c24cbbb0dbd8100ab02c58e2a5608a4e894aa4ca2372526763cc0f6b8"}+{"added": [], "base_commit": "a1551074bbabbf0a71c2201e1938a31e678e82cf", "gold": ["core/agents/lastfm/agent.go", "core/agents/lastfm/auth_router.go", "core/agents/lastfm/session_keys.go", "model/user_props.go", "persistence/user_props_repository.go", "reflex.conf"], "hard": false, "instance_id": "instance_navidrome__navidrome-ee21f3957e0de91624427e93c62b8ee390de72e3", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "1e19c87fcea5b40eda68600f535da192ccbe83fa0382637cce9c8b10a43ea973"}+{"added": [], "base_commit": "a5dfd2d4a14ac5a5b87fc6016e57b94d2b964a69", "gold": ["scanner/tag_scanner.go", "scanner/walk_dir_tree.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-eebfbc5381a1e506ff17b5f1371d1ad83d5fd642", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "16cd7751195700fd77c1635db28a9316222ea80e8dd313563034351377665e9d"}+{"added": ["db/migrations/20240802044339_player_use_user_id_over_username.go"], "base_commit": "5360283bb0368c5226b301f99b7095a54407b053", "gold": ["core/players.go", "core/scrobbler/play_tracker.go", "model/player.go", "persistence/player_repository.go"], "hard": false, "instance_id": "instance_navidrome__navidrome-fa85e2a7816a6fe3829a4c0d8e893e982b0985da", "language": "go", "names_gold_path": false, "repo": "navidrome/navidrome", "text_sha256": "34a9c0e894e78652c7709b0cfe3969749958e75a7bd1ceb0e6cccb7bbc39a751"}+{"added": [], "base_commit": "a118161e912592cc084945157b713050ca7ea4ba", "gold": ["applications/drive/src/app/store/_uploads/mimeTypeParser/mimeTypeParser.ts", "packages/shared/lib/drive/constants.ts", "packages/shared/lib/helpers/mimetype.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-01b519cd49e6a24d9a05d2eb97f54e420740072e", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "1f857edd66fed466c96821b1057f2c01c1d246ab38d50f74daf7fe907dd24b35"}+{"added": [], "base_commit": "24c785b20c23f614eeb9df7073247aeb244c4329", "gold": ["applications/mail/src/app/components/conversation/ConversationView.tsx", "applications/mail/src/app/components/message/MessageOnlyView.tsx", "applications/mail/src/app/containers/mailbox/MailboxContainer.tsx", "applications/mail/src/app/hooks/useShouldMoveOut.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-01ea5214d11e0df8b7170d91bafd34f23cb0f2b1", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "4ed25971e62c66139aba121cb959d72a5cbecbf7a42545688928ff5b404964ed"}+{"added": [], "base_commit": "373580e2fc209cdf010f5f14d08bed546adb8a92", "gold": ["packages/components/containers/payments/subscription/InAppPurchaseModal.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-0200ce0fc1d4dbd35178c10d440a284c82ecc858", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "3be1b997f357edd3c267b33d4dcdfa96b05a65cd7fca0468fb800b401c319c03"}+{"added": ["applications/storybook/src/stories/components/TotpInput.mdx", "applications/storybook/src/stories/components/TotpInput.stories.tsx"], "base_commit": "cc7976723b05683d80720fc9a352445e5dbb4c85", "gold": ["packages/components/components/v2/input/TotpInput.tsx", "packages/components/containers/account/totp/TotpInputs.tsx"], "hard": true, "instance_id": "instance_protonmail__webclients-08bb09914d0d37b0cd6376d4cab5b77728a43e7b", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "d4eb6ef34591772344a3f6cb60f50e669902cc2cc1d1e17290f3cb651b387a8f"}+{"added": ["applications/mail/src/app/components/list/VerifiedBadge.tsx"], "base_commit": "41f29d1c8dad68d693d2e3e10e5c65b6fb780142", "gold": ["applications/mail/src/app/components/list/Item.tsx", "applications/mail/src/app/components/list/ItemColumnLayout.tsx", "applications/mail/src/app/components/list/ItemRowLayout.tsx", "applications/mail/src/app/constants.ts", "applications/mail/src/app/helpers/elements.ts", "applications/mail/src/app/helpers/encryptedSearch/esBuild.ts", "applications/mail/src/app/models/conversation.ts", "applications/mail/src/app/models/encryptedSearch.ts", "packages/components/containers/features/FeaturesContext.ts", "packages/shared/lib/interfaces/mail/Message.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-09fcf0dbdb87fa4f4a27700800ee4a3caed8b413", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "bbf34305615aa2dfb37d505a741c46f384554e68617385213cd33eb944e49d4d"}+{"added": ["applications/drive/src/app/store/_views/useShareURLView.tsx"], "base_commit": "782d01551257eb0a373db3b2d5c39612b87fa7e9", "gold": ["applications/drive/src/app/components/modals/ShareLinkModal/ErrorState.tsx", "applications/drive/src/app/components/modals/ShareLinkModal/GeneratedLinkState.tsx", "applications/drive/src/app/components/modals/ShareLinkModal/ShareLinkModal.tsx", "applications/drive/src/app/store/_api/transformers.ts", "applications/drive/src/app/store/_api/usePublicSession.tsx", "applications/drive/src/app/store/_shares/interface.ts", "applications/drive/src/app/store/_shares/shareUrl.ts", "applications/drive/src/app/store/_shares/useShareUrl.ts", "applications/drive/src/app/store/_views/index.ts", "applications/drive/src/app/store/_views/useLinkView.tsx", "applications/drive/src/app/store/index.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-0d0267c4438cf378bda90bc85eed3a3615871ac4", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "ae846c191d22fddf91be6271bcadd6ff53f6c2e7a9fbdce9984a733e6673d3d3"}+{"added": [], "base_commit": "bf575a521f3789c0b7e99969ad22a15c78165991", "gold": ["applications/mail/src/app/components/message/modals/CustomExpirationModal.tsx", "applications/mail/src/app/helpers/expiration.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-0ec14e36ceb01ba45602a563e12352af8171ed39", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "02e3a8441083bc925eda5120bb2768f8d3f21816e0998b6ade0bd02a64a0504c"}+{"added": ["packages/components/components/smartBanner/types.d.ts"], "base_commit": "9b35b414f77c6165550550fdda8b25bbc74aac7b", "gold": ["applications/calendar/src/app.ejs", "applications/calendar/src/app/containers/calendar/CalendarContainerView.tsx", "applications/mail/src/app.ejs", "applications/mail/src/app/components/layout/PrivateLayout.tsx", "packages/components/components/smartBanner/SmartBanner.tsx", "packages/components/components/smartBanner/useSmartBanner.ts", "packages/components/components/smartBanner/useSmartBannerTelemetry.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-1501eb765873b2884b6f1944fd242ecfc9d6b103", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "e61565b9d276d3d89136d5af4533d1f1325cb5b9bae0573e47fa9071cc082640"}+{"added": [], "base_commit": "78e30c07b399db1aac8608275fe101e9d349534f", "gold": ["applications/mail/src/app/components/message/MessageBodyIframe.tsx", "applications/mail/src/app/components/message/MessageBodyImage.tsx", "applications/mail/src/app/components/message/MessageBodyImages.tsx", "applications/mail/src/app/helpers/message/messageImages.ts", "applications/mail/src/app/hooks/message/useInitializeMessage.tsx", "applications/mail/src/app/hooks/message/useLoadImages.ts", "applications/mail/src/app/logic/messages/images/messagesImagesActions.ts", "applications/mail/src/app/logic/messages/images/messagesImagesReducers.ts", "applications/mail/src/app/logic/messages/messagesSlice.ts", "applications/mail/src/app/logic/messages/messagesTypes.ts", "packages/shared/lib/api/images.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-1917e37f5d9941a3459ce4b0177e201e2d94a622", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "16d1557ee48b8f8cc77f9cc5e433317c7931245429603da102ff43a6a6290ca6"}+{"added": ["applications/mail/src/app/components/list/ItemSenders.tsx", "applications/mail/src/app/components/list/ProtonBadge.tsx", "applications/mail/src/app/components/list/ProtonBadgeType.tsx", "applications/mail/src/app/helpers/recipients.ts"], "base_commit": "5fe4a7bd9e222cf7a525f42e369174f9244eb176", "gold": ["applications/mail/src/app/components/list/Item.tsx", "applications/mail/src/app/components/list/ItemColumnLayout.tsx", "applications/mail/src/app/components/list/ItemRowLayout.tsx", "applications/mail/src/app/components/list/VerifiedBadge.tsx", "applications/mail/src/app/components/message/header/HeaderCollapsed.tsx", "applications/mail/src/app/components/message/header/HeaderExpanded.tsx", "applications/mail/src/app/components/message/modals/MessageDetailsModal.tsx", "applications/mail/src/app/components/message/recipients/MailRecipientItemSingle.tsx", "applications/mail/src/app/components/message/recipients/RecipientItem.tsx", "applications/mail/src/app/components/message/recipients/RecipientItemLayout.tsx", "applications/mail/src/app/components/message/recipients/RecipientItemSingle.tsx", "applications/mail/src/app/helpers/elements.ts", "applications/mail/src/app/models/conversation.ts", "packages/shared/lib/interfaces/Address.ts", "packages/shared/lib/interfaces/mail/Message.ts", "packages/styles/assets/img/illustrations/verified-badge.svg"], "hard": false, "instance_id": "instance_protonmail__webclients-2dce79ea4451ad88d6bfe94da22e7f2f988efa60", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "bd57e8610ef92096223150b1898156910fb410303e32ed5d0a956d430f73939d"}+{"added": [], "base_commit": "4d0ef1ed136e80692723f148dc0390dcf28ba9dc", "gold": ["applications/drive/src/app/containers/MainContainer.tsx", "applications/drive/src/app/store/_links/useLink.ts", "applications/drive/src/app/store/_shares/useShareActions.ts", "packages/shared/lib/api/drive/share.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-2f2f6c311c6128fe86976950d3c0c2db07b03921", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "e92a33e3e04770b055ba6d250095cb3f4ab9e7ca3856a1b0ec380d1618821bb3"}+{"added": [], "base_commit": "85560278585cd2d6f6f022112c912d03a79b2da7", "gold": ["applications/mail/src/app/helpers/message/messageBlockquote.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-2f66db85455f4b22a47ffd853738f679b439593c", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "3a35b38d1dfd71bfad4347ff65d273cbdabd803570c3cfd1ab7b20e22597c4e4"}+{"added": [], "base_commit": "c40dccc34870418e29f51861a38647bc1cbdf0a8", "gold": ["applications/mail/src/app/components/message/recipients/RecipientItemGroup.tsx", "applications/mail/src/app/components/message/recipients/RecipientItemSingle.tsx", "packages/components/components/drawer/views/DrawerContactView.tsx", "packages/components/components/modalTwo/ModalHeader.tsx", "packages/components/containers/contacts/group/ContactGroupDetailsModal.tsx", "packages/components/containers/contacts/group/ContactGroupLabels.tsx", "packages/components/containers/contacts/hooks/useContactModals.tsx", "packages/components/containers/contacts/merge/ContactMergeDetailsModal.tsx", "packages/components/containers/contacts/view/ContactDetailsModal.tsx", "packages/components/containers/contacts/view/ContactView.tsx", "applications/mail/src/app/components/message/recipients/RecipientDropdownItem.tsx", "packages/components/containers/contacts/view/properties/ContactViewEmails.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-32ff10999a06455cb2147f6873d627456924ae13", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "d4d2f8ce7d6c936d67505182f3c1f1359e83986ac5b2e40328849391271affb3"}+{"added": ["applications/drive/src/app/components/useSpotlight.tsx", "packages/styles/assets/img/onboarding/drive-search-spotlight.svg"], "base_commit": "e131cde781c398b38f649501cae5f03cf77e75bd", "gold": ["applications/drive/src/app/components/layout/search/SearchField.scss", "applications/drive/src/app/components/layout/search/SearchField.tsx", "applications/drive/src/app/components/sections/Drive/Drive.tsx", "applications/drive/src/app/components/useOpenModal.tsx", "applications/drive/src/app/store/links/useLinksListing.tsx", "applications/drive/src/app/store/search/index.tsx", "packages/components/components/spotlight/Spotlight.tsx", "packages/components/containers/features/FeaturesContext.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-3a6790f480309130b5d6332dce6c9d5ccca13ee3", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "3f4faea3d088bf1e0c0e0b9b35fa6ef4ac63c28d44a86b6d2f6d92caeef74ec9"}+{"added": [], "base_commit": "8f58c5dd5ea6e1b87a8ea6786d99f3eb7014a7b6", "gold": ["applications/drive/src/app/store/_api/usePublicSession.tsx", "applications/drive/src/app/store/_user/usePublicSessionUser.ts", "applications/drive/src/app/utils/lastActivePersistedUserSession.ts", "applications/drive/src/app/utils/telemetry.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-3f22e2172cbdfd7b9abb2b1d8fd80c16d38b4bbe", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "a608fa07d975c488eb0ca7df1bc8551ec105681925c4b57f92630ee89b3ea61c"}+{"added": ["applications/drive/src/app/utils/type/DeepPartial.ts"], "base_commit": "e7f4e98ce40bb0a3275feb145a713989cc78804a", "gold": ["applications/drive/src/app/store/_links/extendedAttributes.ts", "applications/drive/src/app/store/_uploads/worker/worker.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-4feccbc9990980aee26ea29035f8f931d6089895", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "1be9700a5dd4bd0f04b7c78065750d7a9b58645fbfd4b5dfbc4e6e4dc4873706"}+{"added": [], "base_commit": "8472bc64099be00753167dbb516a1187e0ce9b69", "gold": ["packages/components/helpers/url.ts", "packages/components/hooks/useLinkHandler.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-51742625834d3bd0d10fe0c7e76b8739a59c6b9f", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "00ab5fee32c419cd61420d4aa3b0703fe9ae8171fdfe8e6ba46777e9254d3ad0"}+{"added": [], "base_commit": "7d863f89768bf19207c19af1b2e0c78d0b56a716", "gold": ["applications/drive/src/app/store/_uploads/UploadProvider/useUploadFile.ts", "applications/drive/src/app/store/_uploads/constants.ts", "applications/drive/src/app/store/_uploads/initUploadFileWorker.ts", "applications/drive/src/app/store/_uploads/worker/encryption.ts", "applications/drive/src/app/store/_uploads/worker/worker.ts", "applications/drive/src/app/store/_uploads/workerController.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-5d2576632037d655c3b6a28e98cd157f7e9a5ce1", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "e413cea83911bf3951ccec5b6b3fc90c2e1e49b9eaf766f59a49673a33a12543"}+{"added": ["packages/testing/lib/event-manager.ts", "packages/testing/lib/hocs.ts", "packages/testing/lib/providers.tsx"], "base_commit": "bf70473d724be9664974c0bc6b04458f6123ead2", "gold": ["packages/components/containers/payments/RenewToggle.tsx", "packages/components/containers/payments/SubscriptionsSection.spec.tsx", "packages/components/containers/payments/SubscriptionsSection.tsx", "packages/testing/index.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-5e815cfa518b223a088fa9bb232a5fc90ab15691", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "81a39c6ac1ff6fe3b8594b27f31e618f8a71c4172a5d00d479299f5703cb56cc"}+{"added": ["packages/components/containers/payments/BitcoinInfoMessage.tsx", "packages/components/containers/payments/BitcoinQRCode.scss", "packages/testing/lib/flush-promises.ts"], "base_commit": "12381540293c55229fd3d0d15bd9a14f98385aea", "gold": ["packages/components/containers/paymentMethods/getPaymentMethodOptions.ts", "packages/components/containers/payments/Bitcoin.tsx", "packages/components/containers/payments/BitcoinDetails.tsx", "packages/components/containers/payments/BitcoinQRCode.tsx", "packages/components/containers/payments/CreditsModal.tsx", "packages/components/containers/payments/Payment.tsx", "packages/components/containers/payments/subscription/SubscriptionModal.tsx", "packages/components/containers/payments/subscription/SubscriptionSubmitButton.tsx", "packages/shared/lib/constants.ts", "packages/testing/index.ts"], "hard": true, "instance_id": "instance_protonmail__webclients-5f0745dd6993bb1430a951c62a49807c6635cd77", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "e442516026317d21bc8ad6ee52f27ba5d3f66656db7f3ffccb8b3f846205d733"}+{"added": ["packages/components/components/drawer/views/SecurityCenter/PassAliases/PassAliasesProvider.helpers.ts", "packages/components/components/drawer/views/SecurityCenter/PassAliases/usePassAliasesProviderSetup.ts"], "base_commit": "473d37b9dc0ab4fb4935b1ee59e3ab2d6ea6b9c2", "gold": ["packages/components/components/drawer/views/SecurityCenter/PassAliases/PassAliasesProvider.tsx", "packages/components/components/drawer/views/SecurityCenter/PassAliases/interface.ts", "packages/pass/lib/bridge/PassBridgeFactory.ts", "packages/pass/lib/bridge/types.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-6dcf0d0b0f7965ad94be3f84971afeb437f25b02", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "93b26a66cfd115d3eaec0a801ca98f7ad2706b4fcad25baf15014f37a3eb1c3c"}+{"added": ["applications/mail/src/app/components/composer/actions/ComposerMoreActions.tsx", "applications/mail/src/app/components/composer/actions/ComposerPasswordActions.tsx", "applications/mail/src/app/components/composer/modals/PasswordInnerModal.scss", "applications/mail/src/app/components/composer/modals/PasswordInnerModalForm.tsx", "applications/mail/src/app/hooks/composer/useExternalExpiration.ts"], "base_commit": "2ea4c94b420367d482a72cff1471d40568d2b7a3", "gold": ["applications/mail/src/app/components/composer/Composer.tsx", "applications/mail/src/app/components/composer/ComposerActions.tsx", "applications/mail/src/app/components/composer/editor/ComposerMoreOptionsDropdown.tsx", "applications/mail/src/app/components/composer/editor/EditorToolbarExtension.tsx", "applications/mail/src/app/components/composer/modals/ComposerExpirationModal.tsx", "applications/mail/src/app/components/composer/modals/ComposerInnerModals.tsx", "applications/mail/src/app/components/composer/modals/ComposerPasswordModal.tsx", "applications/mail/src/app/constants.ts", "applications/mail/src/app/hooks/useExpiration.ts", "packages/components/containers/features/FeaturesContext.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-6e1873b06df6529a469599aa1d69d3b18f7d9d37", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "b1184088ee428301a2ccdcf136c3f3ff5c1ab88cd155578f7d4325643ee1f1d4"}+{"added": [], "base_commit": "2099c5070b15ba5984cd386f63811e4321a27611", "gold": ["applications/drive/src/app/containers/FolderContainer.tsx", "applications/drive/src/app/store/_shares/useDefaultShare.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-6f8916fbadf1d1f4a26640f53b5cf7f55e8bedb7", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "c63abfe14764395502608b29be4d69ffea491df3ef6013641793fda78e75fac8"}+{"added": [], "base_commit": "3f9771dd682247118e66e9e27bc6ef677ef5214d", "gold": ["packages/components/containers/offers/components/shared/deal/DealsWithCycleSelector.tsx", "packages/components/containers/offers/operations/summer2023/Layout.tsx", "packages/components/containers/offers/operations/summer2023/configuration.ts", "packages/components/containers/offers/operations/summer2023/eligibility.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-708ed4a299711f0fa79a907cc5847cfd39c0fc71", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "780d46f4f2bbd40c3506f4f097688e3a47dadc611ca85ee6e9f0903f275fc697"}+{"added": [], "base_commit": "aba05b2f451b2f8765207846b11dc67190cb9930", "gold": ["packages/components/containers/contacts/email/ContactEmailSettingsModal.tsx", "packages/components/containers/contacts/email/ContactPGPSettings.tsx", "packages/shared/lib/contacts/constants.ts", "packages/shared/lib/contacts/keyProperties.ts", "packages/shared/lib/contacts/vcard.ts", "packages/shared/lib/interfaces/EncryptionPreferences.ts", "packages/shared/lib/interfaces/contacts/VCard.ts", "packages/shared/lib/keys/publicKeys.ts", "packages/shared/lib/mail/encryptionPreferences.ts"], "hard": true, "instance_id": "instance_protonmail__webclients-715dbd4e6999499cd2a576a532d8214f75189116", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "405b168e57cfa5b16f98f5f89853893cf94a7c326e64cb998440bdd7667b0b24"}+{"added": [], "base_commit": "7264c6bd7f515ae4609be9a5f0c3032ae6fe486a", "gold": ["applications/drive/src/app/store/downloads/useDownload.ts", "applications/drive/src/app/store/links/useLinksListing.tsx", "applications/drive/src/app/store/uploads/UploadProvider/useUploadHelper.ts", "applications/drive/src/app/store/views/useFileView.tsx", "applications/drive/src/app/store/views/useFolderView.tsx", "applications/drive/src/app/store/views/useIsEmptyTrashButtonAvailable.ts", "applications/drive/src/app/store/views/useSearchView.tsx", "applications/drive/src/app/store/views/useSharedLinksView.ts", "applications/drive/src/app/store/views/useTrashView.ts", "applications/drive/src/app/store/views/useTree.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-7b833df125859e5eb98a826e5b83efe0f93a347b", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "4f27e9811e7c239b2b3b5059d5346dcf1f91c80ac8e86a0e1d31a5e5a24c355b"}+{"added": ["packages/shared/lib/helpers/size.ts"], "base_commit": "9962092e576b71effbd99523da503148691bb3a6", "gold": ["packages/components/containers/members/MemberStorageSelector.tsx", "packages/components/containers/members/SubUserCreateModal.tsx", "packages/components/containers/members/SubUserEditModal.tsx", "packages/components/containers/members/UserInviteOrEditModal.tsx", "packages/components/containers/members/multipleUserCreation/constants.ts", "packages/components/containers/members/multipleUserCreation/csv.ts", "packages/components/containers/organization/SetupOrganizationModal.tsx", "packages/shared/lib/calendar/constants.ts", "packages/shared/lib/constants.ts", "packages/shared/lib/contacts/constants.ts", "packages/shared/lib/helpers/humanSize.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-7e54526774e577c0ebb58ced7ba8bef349a69fec", "language": "js", "names_gold_path": true, "repo": "protonmail/webclients", "text_sha256": "3e0578f2c1fc6671342a3a6af1206ef6966a36d84c3a9d84fd7d8dbd934489fd"}+{"added": [], "base_commit": "b63f2ef3157bdfb8b3ff46d9097f9e65b00a4c3a", "gold": ["applications/calendar/src/app/containers/calendar/CalendarSidebar.tsx", "applications/calendar/src/app/containers/calendar/ShareCalendarInvitationModal.tsx", "applications/mail/src/app/helpers/calendar/inviteApi.ts", "packages/components/containers/calendar/CalendarLimitReachedModal.tsx", "packages/components/containers/calendar/calendarModal/calendarModalState.ts", "packages/shared/lib/calendar/api.ts", "packages/shared/lib/calendar/calendar.ts", "packages/shared/lib/calendar/constants.ts", "packages/shared/lib/calendar/getSettings.ts", "packages/shared/lib/calendar/subscribe/helpers.ts", "packages/shared/lib/interfaces/calendar/Api.ts", "packages/shared/lib/interfaces/calendar/Calendar.ts", "packages/shared/lib/interfaces/calendar/CalendarMember.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-8142704f447df6e108d53cab25451c8a94976b92", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "558a24ac0803e4c594e6ce274163b858ab129f39e520c97f9b3cfc2216a26586"}+{"added": ["packages/util/chunk.ts"], "base_commit": "21b45bd4378834403ad9e69dc91605c21f43438b", "gold": ["applications/calendar/src/app/components/calendar/DayGrid.tsx", "applications/drive/src/app/store/_links/useLinksActions.ts", "applications/drive/src/app/store/_links/useLinksListing.tsx", "applications/drive/src/app/store/_shares/useShareUrl.ts", "packages/components/containers/contacts/import/encryptAndSubmit.ts", "packages/components/containers/contacts/merge/MergingModalContent.tsx", "packages/components/hooks/useGetCanonicalEmailsMap.ts", "packages/components/hooks/useGetVtimezonesMap.ts", "packages/shared/lib/api/helpers/queryPages.ts", "packages/shared/lib/calendar/import/encryptAndSubmit.ts", "packages/util/array.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-815695401137dac2975400fc610149a16db8214b", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "444661941b4c52935d7f22894f577316758284d05e9fea66cb59f8d2185d62e5"}+{"added": [], "base_commit": "464a02f3da87d165d1bfc330e5310c7c6e5e9734", "gold": ["packages/components/containers/paymentMethods/PaymentMethodsSection.tsx", "packages/components/containers/paymentMethods/PaymentMethodsTable.tsx", "packages/components/containers/payments/EditCardModal.tsx", "packages/components/containers/payments/PayPalModal.tsx", "packages/components/payments/client-extensions/usePollEvents.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-863d524b5717b9d33ce08a0f0535e3fd8e8d1ed8", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "7bec848f4389ba733ee04d04a63ebbec7b71d9517a58ceaf659911160a301402"}+{"added": [], "base_commit": "7ff95b70115415f47b89c81a40e90b60bcf3dbd8", "gold": ["applications/drive/src/app/components/FileBrowser/GridView/GridHeader.tsx", "applications/drive/src/app/components/FileBrowser/ListView/Cells/CheckboxCell.tsx", "applications/drive/src/app/components/FileBrowser/ListView/ListHeader.tsx", "applications/drive/src/app/components/FileBrowser/hooks/useSelectionControls.ts", "applications/drive/src/app/components/FileBrowser/state/useSelection.tsx", "applications/drive/src/app/components/sections/FileBrowser/GridViewItem.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-8afd9ce04c8dde9e150e1c2b50d32e7ee2efa3e7", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "44ed273b63bf9a25fad748c4f2374dc447ccafa85150bffa8f700dd16c2ab4b1"}+{"added": ["packages/components/components/dropdown/interface.ts", "packages/components/components/dropdown/utils.ts"], "base_commit": "57f1225f76db015f914c010d2c840c12184b587e", "gold": ["applications/account/src/app/signup/AccountStep.tsx", "applications/drive/src/app/components/layout/search/SearchDropdown.tsx", "applications/drive/src/app/components/sections/ContextMenu/ItemContextMenu.tsx", "applications/mail/src/app/components/composer/actions/ComposerMoreOptionsDropdown.tsx", "applications/mail/src/app/components/composer/addresses/SelectSender.tsx", "applications/mail/src/app/components/header/search/SearchOverlay.tsx", "applications/mail/src/app/components/list/ItemContextMenu.tsx", "applications/mail/src/app/components/message/header/HeaderDropdown.tsx", "applications/mail/src/app/components/message/header/HeaderMoreDropdown.tsx", "applications/mail/src/app/components/message/recipients/RecipientItemGroup.tsx", "applications/mail/src/app/components/message/recipients/RecipientItemSingle.tsx", "applications/mail/src/app/components/toolbar/LabelsAndFolders.tsx", "applications/mail/src/app/components/toolbar/PagingControls.tsx", "applications/mail/src/app/components/toolbar/ToolbarDropdown.tsx", "packages/components/components/autocomplete/AutocompleteList.tsx", "packages/components/components/contextMenu/ContextMenu.tsx", "packages/components/components/dropdown/Dropdown.tsx", "packages/components/components/dropdown/DropdownButton.tsx", "packages/components/components/dropdown/index.ts", "packages/components/components/editor/toolbar/ToolbarColorsDropdown.tsx", "packages/components/components/editor/toolbar/ToolbarDropdown.tsx", "packages/components/components/editor/toolbar/ToolbarEmojiDropdown.tsx", "packages/components/components/input/ColorPicker.tsx", "packages/components/components/selectTwo/SearchableSelect.tsx", "packages/components/components/selectTwo/SelectTwo.tsx", "packages/components/components/v2/phone/CountrySelect.tsx", "packages/components/containers/addresses/AddressModal.tsx", "packages/components/containers/contacts/ContactGroupDropdown.tsx", "packages/components/containers/contacts/widget/TopNavbarListItemContactsDropdown.tsx", "packages/components/containers/heading/UserDropdown.tsx", "packages/components/containers/members/MemberModal.tsx", "packages/styles/scss/components/_dropdown.scss"], "hard": false, "instance_id": "instance_protonmail__webclients-8be4f6cb9380fcd2e67bcb18cef931ae0d4b869c", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "e092fc3a59c8f45fecb74cefd1c4b741e833d94ef9f0c0348828d6c23757522d"}+{"added": ["packages/metrics/lib/observeApiError.ts"], "base_commit": "7c7e668956cf9df0f51d401dbb00b7e1d445198b", "gold": ["packages/metrics/index.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-944adbfe06644be0789f59b78395bdd8567d8547", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "0b12c52afa55cde8f938ce6bba2e10ce839786bdb7111d48f44e7133f55c627d"}+{"added": [], "base_commit": "8b68951e795c21134273225efbd64e5999ffba0f", "gold": ["packages/components/containers/payments/subscription/cancellationFlow/CancelRedirectionModal.tsx", "packages/components/containers/payments/subscription/cancellationFlow/config/b2bCommonConfig.tsx", "packages/components/containers/payments/subscription/cancellationFlow/config/b2cCommonConfig.tsx", "packages/components/containers/payments/subscription/helpers/payment.ts", "packages/shared/lib/interfaces/Subscription.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-ac23d1efa1a6ab7e62724779317ba44c28d78cfd", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "b66617effe80edfd102901f8cbbd2f876ddf0856db33fa29da450d09debe3771"}+{"added": ["applications/mail/src/app/containers/onboardingChecklist/hooks/useCanCheckItem.ts"], "base_commit": "32394eda944448efcd48d2487c2878cd402e612c", "gold": ["applications/mail/src/app/containers/onboardingChecklist/provider/GetStartedChecklistProvider.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-b530a3db50cb33e5064464addbcbef1465856ce6", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "d3366e2a5481aa19dce6b17e05199d264504625c7f4b197c3cec109e7c4813d0"}+{"added": ["packages/metrics/types/web_drive_download_mechanism_success_rate_total_v1.schema.d.ts", "packages/metrics/types/web_mail_performance_email_content_render_time_histogram_v1.schema.d.ts"], "base_commit": "e2bd7656728f18cfc201a1078e10f23365dd06b5", "gold": ["applications/drive/src/app/store/_downloads/DownloadProvider/useDownloadMetrics.ts", "applications/drive/src/app/store/_downloads/fileSaver/fileSaver.ts", "applications/drive/src/app/store/_downloads/useDownload.ts", "packages/metrics/Metrics.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-b9387af4cdf79c2cb2a221dea33d665ef789512e", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "5d08b7e679d81e0c17f37ba707d6567801060129677d0c843b359aab1ed4ab8d"}+{"added": [], "base_commit": "a5e37d3fe77abd2279bea864bf57f8d641e1777b", "gold": ["packages/components/containers/calendar/settings/CalendarEventDefaultsSection.tsx", "packages/components/containers/calendar/settings/CalendarMemberAndInvitationList.tsx", "packages/components/containers/calendar/settings/CalendarMemberRow.tsx", "packages/components/containers/calendar/settings/CalendarShareSection.tsx", "packages/components/containers/calendar/settings/CalendarSubpage.tsx", "packages/components/containers/calendar/settings/CalendarSubpageHeaderSection.tsx", "packages/components/containers/calendar/shareURL/CalendarShareUrlSection.tsx", "packages/shared/lib/calendar/permissions.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-bf2e89c0c488ae1a87d503e5b09fe9dd2f2a635f", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "efd23c79bb4728c5bd8cfce95b809b64afe490756eaffe2398a292945131a316"}+{"added": [], "base_commit": "83c2b47478a5224db61c6557ad326c2bbda18645", "gold": ["applications/drive/src/app/store/_links/useLink.ts"], "hard": true, "instance_id": "instance_protonmail__webclients-c5a2089ca2bfe9aa1d85a664b8ad87ef843a1c9c", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "a523bbaba7b51593983b2491d7fe6a500ef2aa7a904aa522b3874fe69e24aec7"}+{"added": [], "base_commit": "4aeaf4a64578fe82cdee4a01636121ba0c03ac97", "gold": ["applications/mail/src/app/components/attachment/AttachmentItem.tsx", "applications/mail/src/app/components/attachment/AttachmentList.tsx", "applications/mail/src/app/components/conversation/ConversationErrorBanner.tsx", "applications/mail/src/app/components/conversation/TrashWarning.tsx", "applications/mail/src/app/components/conversation/UnreadMessages.tsx", "applications/mail/src/app/components/list/ItemDate.tsx", "applications/mail/src/app/components/list/ItemLocation.tsx", "applications/mail/src/app/components/message/MessageView.tsx", "applications/mail/src/app/components/message/extras/ExtraAskResign.tsx", "applications/mail/src/app/components/message/extras/ExtraAutoReply.tsx", "applications/mail/src/app/components/message/extras/ExtraErrors.tsx", "applications/mail/src/app/components/message/extras/ExtraImages.tsx", "applications/mail/src/app/components/message/extras/ExtraPinKey.tsx", "applications/mail/src/app/components/message/extras/ExtraSpamScore.tsx", "applications/mail/src/app/components/message/header/HeaderCollapsed.tsx", "applications/mail/src/app/components/message/header/HeaderDropdown.tsx", "applications/mail/src/app/components/message/header/HeaderExpanded.tsx", "applications/mail/src/app/components/message/header/HeaderMoreDropdown.tsx", "applications/mail/src/app/components/message/recipients/MailRecipientItemSingle.tsx", "applications/mail/src/app/components/message/recipients/RecipientDropdownItem.tsx", "applications/mail/src/app/components/message/recipients/RecipientItem.tsx", "applications/mail/src/app/components/message/recipients/RecipientItemGroup.tsx", "applications/mail/src/app/components/message/recipients/RecipientItemLayout.tsx", "applications/mail/src/app/components/message/recipients/RecipientItemSingle.tsx", "applications/mail/src/app/components/message/recipients/RecipientSimple.tsx", "applications/mail/src/app/components/message/recipients/RecipientsDetails.tsx", "applications/mail/src/app/components/message/recipients/RecipientsList.tsx", "packages/components/components/labelStack/LabelStack.tsx", "packages/components/components/labelStack/LabelStackItem.tsx", "packages/components/containers/contacts/ContactImage.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-c6f65d205c401350a226bb005f42fac1754b0b5b", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "f1a62a3f3517d6610e0104fe48610c742d9fc3a16a437ff4720ddc8d9e63b33a"}+{"added": [], "base_commit": "fc4c6e035e04f1bb44d57b3094f074b16ef2a0b2", "gold": ["applications/drive/src/app/store/_api/usePublicSession.tsx", "applications/drive/src/app/store/_views/useBookmarksPublicView.ts", "applications/drive/src/app/utils/lastActivePersistedUserSession.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-c8117f446c3d1d7e117adc6e0e46b0ece9b0b90e", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "da3f98a874a043240e2717c4c401751a2dc645024857a22602d0c4b957c1c045"}+{"added": ["packages/shared/lib/calendar/apiModels.ts", "packages/shared/lib/calendar/recurrence/getRecurrenceIdValueFromTimestamp.ts"], "base_commit": "8ae1b7f17822e5121f7394d03192e283904579ad", "gold": ["applications/calendar/src/app/components/eventModal/eventForm/getFrequencyModelChange.ts", "applications/calendar/src/app/components/eventModal/eventForm/getValarmTrigger.spec.js", "applications/calendar/src/app/components/eventModal/eventForm/i18n.tsx", "applications/calendar/src/app/components/eventModal/eventForm/modelToFrequencyProperties.ts", "applications/calendar/src/app/components/eventModal/eventForm/modelToValarm.ts", "applications/calendar/src/app/components/eventModal/eventForm/propertiesToFrequencyModel.tsx", "applications/calendar/src/app/components/eventModal/inputs/SelectMonthlyType.tsx", "applications/calendar/src/app/components/events/EventPopover.tsx", "applications/calendar/src/app/components/events/PopoverNotification.tsx", "applications/calendar/src/app/components/events/getEventInformation.ts", "applications/calendar/src/app/containers/calendar/InteractiveCalendarView.tsx", "applications/calendar/src/app/containers/calendar/confirmationModals/SendWithErrorsConfirmationModal.tsx", "applications/calendar/src/app/containers/calendar/event/getSingleEditRecurringData.ts", "applications/calendar/src/app/containers/calendar/eventActions/dtstamp.ts", "applications/calendar/src/app/containers/calendar/eventActions/getDeleteEventActions.ts", "applications/calendar/src/app/containers/calendar/eventActions/getDeleteRecurringEventActions.ts", "applications/calendar/src/app/containers/calendar/eventActions/getRecurringDeleteType.ts", "applications/calendar/src/app/containers/calendar/eventActions/getRecurringSaveType.ts", "applications/calendar/src/app/containers/calendar/eventActions/getRecurringUpdateAllPossibilities.ts", "applications/calendar/src/app/containers/calendar/eventActions/getSaveEventActions.ts", "applications/calendar/src/app/containers/calendar/eventActions/getSaveRecurringEventActions.ts", "applications/calendar/src/app/containers/calendar/eventActions/getSaveSingleEventActions.ts", "applications/calendar/src/app/containers/calendar/eventActions/inviteActions.ts", "applications/calendar/src/app/containers/calendar/eventActions/recurringHelper.ts", "applications/calendar/src/app/containers/calendar/eventActions/sequence.ts", "applications/calendar/src/app/containers/calendar/eventStore/cache/getComponentFromCalendarEventWithoutBlob.ts", "applications/calendar/src/app/containers/calendar/eventStore/cache/getRecurringEvents.ts", "applications/calendar/src/app/containers/calendar/eventStore/interface.ts", "applications/calendar/src/app/containers/calendar/getSyncMultipleEventsPayload.spec.ts", "applications/calendar/src/app/containers/calendar/getSyncMultipleEventsPayload.ts", "applications/calendar/src/app/hooks/useOpenEvent.ts", "applications/drive/src/app/store/_shares/useShareActions.ts", "applications/mail/src/app/components/message/extras/calendar/EmailReminderWidget.tsx", "applications/mail/src/app/components/message/extras/calendar/ExtraEventAddParticipantButton.tsx", "applications/mail/src/app/components/message/extras/calendar/ExtraEventAttendeeButtons.tsx", "applications/mail/src/app/components/message/extras/calendar/ExtraEventDetails.tsx", "applications/mail/src/app/components/message/extras/calendar/ExtraEventImportButton.tsx", "applications/mail/src/app/helpers/calendar/invite.ts", "applications/mail/src/app/helpers/calendar/inviteApi.ts", "applications/mail/src/app/hooks/useInviteButtons.ts", "packages/components/containers/calendar/hooks/useAddAttendees.tsx", "packages/components/containers/calendar/importModal/ImportingModalContent.tsx", "packages/components/containers/calendar/shareModal/ShareCalendarModal.tsx", "packages/components/containers/payments/subscription/SubscriptionModal.tsx", "packages/components/containers/payments/subscription/UnsubscribeButton.tsx", "packages/shared/lib/calendar/alarms.ts", "packages/shared/lib/calendar/getAlarmMessageText.ts", "packages/shared/lib/calendar/getNotificationString.ts", "packages/shared/lib/calendar/getValarmTrigger.ts", "packages/shared/lib/calendar/trigger.ts", "packages/shared/lib/calendar/integration/getPaginatedEventsByUID.ts", "packages/shared/lib/calendar/decrypt.ts", "packages/shared/lib/calendar/encrypt.ts", "packages/shared/lib/calendar/integration/getCreationKeys.ts", "packages/shared/lib/calendar/deserialize.ts", "packages/shared/lib/calendar/export/export.ts", "packages/shared/lib/calendar/getRecurrenceIdValueFromTimestamp.ts", "packages/shared/lib/calendar/helper.ts", "packages/shared/lib/calendar/icsSurgery/valarm.ts", "packages/shared/lib/calendar/icsSurgery/vevent.ts", "packages/shared/lib/calendar/import/encryptAndSubmit.ts", "packages/shared/lib/calendar/integration/AddAttendeeError.ts", "packages/shared/lib/calendar/support.ts", "packages/shared/lib/calendar/integration/invite.ts", "packages/shared/lib/calendar/modelToNotifications.ts", "packages/shared/lib/calendar/notificationModel.ts", "packages/shared/lib/calendar/subscription.ts", "packages/shared/lib/calendar/integration/getFrequencyString.ts", "packages/shared/lib/calendar/recurring.ts", "packages/shared/lib/calendar/rrule.ts", "packages/shared/lib/calendar/rruleEqual.ts", "packages/shared/lib/calendar/integration/rruleProperties.ts", "packages/shared/lib/calendar/rruleSubset.ts", "packages/shared/lib/calendar/rruleUntil.ts", "packages/shared/lib/calendar/rruleWkst.ts", "packages/shared/lib/calendar/serialize.ts", "packages/shared/lib/calendar/sync/reencrypt.ts", "packages/shared/lib/calendar/utcTimestampToTimezone.ts", "packages/shared/lib/calendar/veventHelper.ts", "packages/shared/lib/date/timezone.ts", "packages/shared/lib/keys/calendarKeys.ts", "packages/shared/lib/keys/driveKeys.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-caf10ba9ab2677761c88522d1ba8ad025779c492", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "2a9d67518a3c609304dabb2ddc23694e0a10f8bb91de44d6bb58ea55ebb89bfe"}+{"added": ["applications/drive/src/app/utils/replaceLocalURL.ts"], "base_commit": "3b48b60689a8403f25c6e475106652f299338ed9", "gold": ["applications/drive/src/app/store/_downloads/download/downloadBlock.ts", "applications/drive/src/app/store/_shares/shareUrl.ts", "applications/drive/src/app/store/_uploads/UploadProvider/useUploadFile.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-cb8cc309c6968b0a2a5fe4288d0ae0a969ff31e1", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "b373fc93fd3aebef4ec223b0747869038aea8693a37304fcf6f9472f47e132c4"}+{"added": [], "base_commit": "369593a83c05f81cd7c69b69c2a4bfc96b0d8783", "gold": ["applications/drive/src/app/components/modals/RenameDeviceModal/RenameDeviceModal.tsx", "applications/drive/src/app/components/sections/Devices/Devices.tsx", "applications/drive/src/app/store/_actions/useActions.tsx", "applications/drive/src/app/store/_api/transformers.ts", "applications/drive/src/app/store/_devices/interface.ts", "applications/drive/src/app/store/_devices/useDevicesActions.ts", "applications/drive/src/app/store/_devices/useDevicesListing.tsx", "applications/drive/src/app/store/_links/interface.ts", "applications/drive/src/app/store/_links/useLinkActions.ts", "applications/drive/src/app/store/_shares/usePublicShare.ts", "packages/shared/lib/api/drive/share.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-cba6ebbd0707caa524ffee51c62b197f6122c902", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "9f09f1c2e9eb7ef4ccfae2472eaf6979fc26dd8e6749cd1365620bea2eac93ef"}+{"added": ["packages/components/components/v2/addressesAutomplete/AddressesAutocomplete.helper.ts"], "base_commit": "1346a7d3e1a27c544f891ba5130655720a34d22a", "gold": ["packages/components/components/v2/addressesAutomplete/AddressesAutocomplete.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-cfd7571485186049c10c822f214d474f1edde8d1", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "f9d626b873bb4410f3fe43e95d8693c778ead729c4c88456c89a1fc3c6da08da"}+{"added": ["applications/mail/src/app/metrics/mailMetricsHelper.ts", "applications/mail/src/app/metrics/useMailECRTMetric.tsx"], "base_commit": "738b22f1e8efbb8a0420db86af89fb630a6c9f58", "gold": ["applications/mail/package.json", "applications/mail/src/app/components/message/MessageView.tsx", "applications/mail/src/app/containers/mailbox/MailboxContainer.tsx", "packages/unleash/UnleashFeatureFlags.ts", "yarn.lock"], "hard": false, "instance_id": "instance_protonmail__webclients-d3e513044d299d04e509bf8c0f4e73d812030246", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "178de45de63792b4232b9af95f453cb5ebe68483044c71bd52e8a43c11990113"}+{"added": [], "base_commit": "94dc494bae131e6577f795cb5fa3ca66a09757e3", "gold": ["applications/calendar/jest.setup.js", "packages/components/containers/calendar/subscribeCalendarModal/SubscribeCalendarModal.tsx", "packages/components/jest.setup.js", "packages/shared/lib/calendar/constants.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-d494a66038112b239a381f49b3914caf8d2ef3b4", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "f6d8668d3dd3848e2cf220f46c387781f4a441df35de0b26e43ca78ebb22ccff"}+{"added": [], "base_commit": "7fb29b60c6b33fab16fd5464786f74427c9eb16e", "gold": ["applications/drive/src/app/store/_views/useShareMemberViewZustand.tsx", "applications/drive/src/app/zustand/share/invitations.store.ts", "applications/drive/src/app/zustand/share/members.store.ts", "applications/drive/src/app/zustand/share/types.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-d8ff92b414775565f496b830c9eb6cc5fa9620e6", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "e7d8542cfc635cdfc7365a6ef800e8416685a4ca24e652105c8195332211ac80"}+{"added": [], "base_commit": "fd6d7f6479dd2ab0c3318e2680d677b9e61189cd", "gold": ["packages/components/containers/api/ApiProvider.js", "packages/components/containers/notifications/interfaces.ts", "packages/components/containers/notifications/manager.tsx", "packages/components/containers/payments/paymentTokenHelper.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-da91f084c0f532d9cc8ca385a701274d598057b8", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "596f56ffa87342841b5b79b151321e36d2738e128b0579bfcc4115d2e551b2f7"}+{"added": ["applications/mail/src/app/helpers/moveToFolder.ts"], "base_commit": "ebf2993b7bdc187ec2f3e84c76e0584689202a68", "gold": ["applications/mail/src/app/hooks/actions/useMoveToFolder.tsx"], "hard": false, "instance_id": "instance_protonmail__webclients-dfe5604193d63bfcb91ce60d62db2f805c43bf11", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "38c02d1d502f7e469a774a7dd00524036fa8e18d5c543044cc79e6772cc89594"}+{"added": [], "base_commit": "bd293dcc05b75ecca4a648edd7ae237ec48c1454", "gold": ["applications/mail/src/app/hooks/mailbox/useElements.ts", "applications/mail/src/app/hooks/useApplyLabels.tsx", "applications/mail/src/app/hooks/useEmptyLabel.tsx", "applications/mail/src/app/hooks/useMarkAs.tsx", "applications/mail/src/app/hooks/usePermanentDelete.tsx", "applications/mail/src/app/logic/elements/elementsActions.ts", "applications/mail/src/app/logic/elements/elementsReducers.ts", "applications/mail/src/app/logic/elements/elementsSelectors.ts", "applications/mail/src/app/logic/elements/elementsSlice.ts", "applications/mail/src/app/logic/elements/elementsTypes.ts", "applications/mail/src/app/logic/elements/helpers/elementQuery.ts"], "hard": true, "instance_id": "instance_protonmail__webclients-e65cc5f33719e02e1c378146fb981d27bc24bdf4", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "f114a758264d9fad7899294ede3951ae50bb8d4c1c4029714317a0b877118203"}+{"added": [], "base_commit": "4377e82755826b2e09e943a07da0b964aff529cf", "gold": ["packages/components/components/popper/usePopper.ts", "packages/components/components/popper/utils.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-e7f3f20c8ad86089967498632ace73c1157a9d51", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "b7fa0bcdccbe901a3f00e47b8b6bb4d7c184be61a620dbe8f52dd06d653c2364"}+{"added": ["packages/components/components/dialog/Dialog.tsx"], "base_commit": "078178de4df1ffb606f1fc5a46bebe6c31d06b4a", "gold": ["packages/components/components/modalTwo/Modal.tsx", "packages/components/jest.setup.js"], "hard": false, "instance_id": "instance_protonmail__webclients-e9677f6c46d5ea7d277a4532a4bf90074f125f31", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "76376956b0e6687a2363d147e942010bd06eb7b6c9f9aaa24ddd5fa1398abf6d"}+{"added": [], "base_commit": "01b4c82697b2901299ccda53294d7cba95794647", "gold": ["applications/account/src/app/content/AccountSidebar.tsx", "applications/account/src/app/content/MainContainer.tsx", "applications/calendar/src/app/containers/calendar/CalendarContainerView.tsx", "applications/calendar/src/app/containers/calendar/CalendarSidebar.tsx", "applications/drive/src/app/components/layout/DriveHeader.tsx", "applications/drive/src/app/components/layout/DriveSidebar/DriveSidebar.tsx", "applications/drive/src/app/components/layout/DriveWindow.tsx", "applications/drive/src/app/containers/DriveContainerBlurred.tsx", "applications/mail/src/app/components/header/MailHeader.tsx", "applications/mail/src/app/components/sidebar/MailSidebar.tsx", "applications/vpn-settings/src/app/MainContainer.tsx", "packages/components/components/sidebar/Sidebar.tsx", "packages/components/containers/app/PrivateAppContainer.tsx", "packages/components/containers/heading/PrivateHeader.tsx", "packages/styles/scss/layout/_structure.scss"], "hard": false, "instance_id": "instance_protonmail__webclients-f080ffc38e2ad7bddf2e93e5193e82c20c7a11e7", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "63e25531541a7cb3e0f56d682419edf5e7a5757fff13879adb421696f314929c"}+{"added": [], "base_commit": "52ada0340f0ae0869ef1e3b92e1cc4c799b637cf", "gold": ["packages/shared/lib/contacts/helpers/csvFormat.ts", "packages/shared/lib/contacts/property.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-f161c10cf7d31abf82e8d64d7a99c9fac5acfa18", "language": "js", "names_gold_path": true, "repo": "protonmail/webclients", "text_sha256": "9400166cd1c70e14ae25efef9ef6cfb619377ecccefc115473644960fc927305"}+{"added": [], "base_commit": "ebed8ea9f69216d3ce996dd88457046c0a033caf", "gold": ["applications/mail/src/app/PrivateApp.tsx", "applications/mail/src/app/components/sidebar/MailSidebarSystemFolders.tsx", "applications/mail/src/app/constants.ts", "applications/mail/src/app/hooks/useMoveSystemFolders.helpers.ts", "applications/mail/src/app/hooks/useMoveSystemFolders.ts", "packages/components/containers/features/FeaturesContext.ts", "packages/shared/lib/constants.ts"], "hard": false, "instance_id": "instance_protonmail__webclients-fc9d535e9beb3ae30a52a7146398cadfd6e30606", "language": "js", "names_gold_path": false, "repo": "protonmail/webclients", "text_sha256": "62f77d797979c0736f6f417fab345b4caf47a7a854c8c2ba2939341b13ce3669"}+{"added": [], "base_commit": "71451483f4f380c2f70f6e5b28025af79b1168e5", "gold": ["qutebrowser/components/braveadblock.py", "qutebrowser/utils/version.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-01d1d1494411380d97cac14614a829d3a69cecaf-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "987c6b1302bda44c822adf66f150d92e5b8b1978c96e5b8caba46e32d183752f"}+{"added": [], "base_commit": "def864adc8b19bdbc506919270d8ff1408b4faac", "gold": ["qutebrowser/browser/qtnetworkdownloads.py", "qutebrowser/browser/webkit/network/networkreply.py", "qutebrowser/misc/ipc.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-0833b5f6f140d04200ec91605f88704dd18e2970-v059c6fdc75567943479b23ebca7c07b5e9a7f34c", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "2ce0721d0d47ff3cc104e2472f2c17d61f70c98f5e0a0ae11f0e1b716d588069"}+{"added": [], "base_commit": "e8a7c6b257478bd39810f19c412f484ada6a3dc6", "gold": ["doc/help/settings.asciidoc", "qutebrowser/browser/webengine/darkmode.py", "qutebrowser/config/configdata.yml"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-0aa57e4f7243024fa4bba8853306691b5dbd77b3-v5149fcda2a9a6fe1d35dfed1bade1444a11ef271", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "151fb9967bfcc49c5754f97488d3d2f197f67b5baa9c238c7fdf81ef9da06252"}+{"added": [], "base_commit": "df2b817aa418ea7a83c5cbe523aab58ef26a2b20", "gold": ["qutebrowser/misc/guiprocess.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-0b621cb0ce2b54d3f93d8d41d8ff4257888a87e5-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "8a0d6fc611bc5307db5010bf5b09f5cf0e0f585d5b230524e17847364e1fa77b"}+{"added": [], "base_commit": "8e152aaa0ac40a5200658d2b283cdf11b9d7ca0d", "gold": ["qutebrowser/app.py", "qutebrowser/browser/eventfilter.py", "qutebrowser/keyinput/modeman.py", "qutebrowser/utils/qtutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-0d2afd58f3d0e34af21cee7d8a3fc9d855594e9f-vnan", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "625e25173d9cb21eb137514cbb08aaaacb1c34364f17cc62b62d48cda091809b"}+{"added": ["qutebrowser/completion/models/filepathcategory.py"], "base_commit": "21b20116f5872490bfbba4cf9cbdc8410a8a1d7d", "gold": ["doc/help/settings.asciidoc", "qutebrowser/completion/models/urlmodel.py", "qutebrowser/config/configdata.yml"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-0fc6d1109d041c69a68a896db87cf1b8c194cef7-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "5171e443162222a6ef9192d285b1628205d7ad279d07013fc03753d5adc17881"}+{"added": [], "base_commit": "744cd94469de77f52905bebb123597c040ac07b6", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/config/configdata.yml", "qutebrowser/config/qtargs.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-16de05407111ddd82fa12e54389d532362489da9-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "6dc7d95a13eb81eff58e866bc8053375bd44a1548ea4b9dbbbadb076d048dc61"}+{"added": [], "base_commit": "1e473c4bc01da1d7f1c4386d8b7b887e00fbf385", "gold": ["qutebrowser/browser/browsertab.py", "qutebrowser/browser/commands.py", "qutebrowser/mainwindow/tabbedbrowser.py", "qutebrowser/mainwindow/tabwidget.py", "qutebrowser/misc/sessions.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-1943fa072ec3df5a87e18a23b0916f134c131016-vafb3e8e01b31319c66c4e666b8a3b1d8ba55db24", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "7a29bfbb5a5a58afb57b5cf5241e838edc14121907a0fdf1aeb3c0052b4929e3"}+{"added": [], "base_commit": "ebf4b987ecb6c239af91bb44235567c30e288d71", "gold": ["qutebrowser/config/qtargs.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-1a9e74bfaf9a9db2a510dc14572d33ded6040a57-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "1dd7581a416cce70f7e9698a428c00d81def771e5f2321be492d9863dd198b81"}+{"added": [], "base_commit": "ab65c542a0551abf105eeb58803cd08bd040753b", "gold": ["doc/changelog.asciidoc", "qutebrowser/components/readlinecommands.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-1af602b258b97aaba69d2585ed499d95e2303ac2-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "49a58223f3a0d75f6203969c823f9ebe2ebb4233299fb0a6de105ef478a07bda"}+{"added": [], "base_commit": "08604f5a871e7bf2332f24552895a11b7295cee9", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "pytest.ini", "qutebrowser/browser/shared.py", "qutebrowser/config/configdata.yml", "qutebrowser/config/configfiles.py", "qutebrowser/config/configinit.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-233cb1cc48635130e5602549856a6fa4ab4c087f-v35616345bb8052ea303186706cec663146f0f184", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "5db597e1bbf086439324f9b849a3df4a45f92c599bbde1005a4e1b5b0bd36358"}+{"added": [], "base_commit": "6c653125d95a26db53471dba1bc331aee3b0477e", "gold": ["qutebrowser/browser/webkit/webview.py", "qutebrowser/config/configdata.yml", "qutebrowser/mainwindow/tabwidget.py", "qutebrowser/utils/jinja.py", "qutebrowser/utils/qtutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-2dd8966fdcf11972062c540b7a787e4d0de8d372-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "68551ec75700614e8aeb418e041f8c3579691ca34745fe8da65a32ba9820cf4a"}+{"added": [], "base_commit": "1aec789f4d010dfebae3cceac2c71ebeafe81e08", "gold": ["doc/changelog.asciidoc", "qutebrowser/browser/commands.py", "qutebrowser/completion/models/miscmodels.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-305e7c96d5e2fdb3b248b27dfb21042fb2b7e0b8-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "fe682259f4d63da0b1c7eb955b67877fcb96fc6ff4c2c588a1e1f9f0853799f8"}+{"added": [], "base_commit": "7691556ea171c241eabb76e65c64c90dfc354327", "gold": ["qutebrowser/misc/earlyinit.py", "qutebrowser/qt/machinery.py", "qutebrowser/qutebrowser.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-322834d0e6bf17e5661145c9f085b41215c280e8-v488d33dd1b2540b234cbb0468af6b6614941ce8f", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "acf12b5196f8c75ec081a90529a50b180e8ca655680e571bfdf0ee1b859beb21"}+{"added": [], "base_commit": "f8692cb141776c3567e35f9032e9892bf0a7cfc9", "gold": ["qutebrowser/misc/elf.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-34a13afd36b5e529d553892b1cd8b9d5ce8881c4-vafb3e8e01b31319c66c4e666b8a3b1d8ba55db24", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "cb102e56bcb796af59776dfce5a3187b11e14104aa6746ac20e9c8b1ff1b792e"}+{"added": [], "base_commit": "04c65bb2b72542b239de2491c9242d8f641636db", "gold": ["qutebrowser/config/config.py", "qutebrowser/utils/jinja.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-35168ade46184d7e5b91dfa04ca42fe2abd82717-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "62929c6019b7dede2981bd60adbd9412865ec6cbaa193e19053d3a5613de3f07"}+{"added": [], "base_commit": "73f93008f6c8104dcb317b10bae2c6d156674b33", "gold": ["qutebrowser/config/qtargs.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-36ade4bba504eb96f05d32ceab9972df7eb17bcc-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "e067cdf46ed26acf5823d2cad06ddfb0ba9e57494fb2bbfcae76a6b7dfd6e2bf"}+{"added": ["qutebrowser/misc/elf.py"], "base_commit": "d1164925c55f2417f1c3130b0196830bc2a3d25d", "gold": ["qutebrowser/browser/webengine/darkmode.py", "qutebrowser/config/websettings.py", "qutebrowser/utils/utils.py", "qutebrowser/utils/version.py", "scripts/dev/run_vulture.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-394bfaed6544c952c6b3463751abab3176ad4997-vafb3e8e01b31319c66c4e666b8a3b1d8ba55db24", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "46fb672e0438e8a7389193153dba75f6fc03845a24d239c0fe6e6347ae2e8a61"}+{"added": [], "base_commit": "6d9c28ce10832aa727de1a326d9459a035ff3aba", "gold": ["qutebrowser/app.py", "qutebrowser/utils/resources.py", "scripts/dev/check_coverage.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-3d01c201b8aa54dd71d4f801b1dd12feb4c0a08a-v5fc38aaf22415ab0b70567368332beee7955b367", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "a5cf1de5881b10e298796a6ca15196c2064f7f8a305cf2310f4d099a10cdfa7e"}+{"added": [], "base_commit": "fce306d5f184f185b660f35ec2808b6745d57520", "gold": ["qutebrowser/keyinput/keyutils.py"], "hard": true, "instance_id": "instance_qutebrowser__qutebrowser-3e21c8214a998cb1058defd15aabb24617a76402-v5fc38aaf22415ab0b70567368332beee7955b367", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "d7177fc3d7a2678d1e4fea4e38945f7f9f80b44e7c7f5d345856d1b1419d50c5"}+{"added": [], "base_commit": "a19634474246739027f826968ea34e720c0ec987", "gold": ["doc/help/commands.asciidoc", "qutebrowser/browser/hints.py", "qutebrowser/components/scrollcommands.py", "qutebrowser/mainwindow/statusbar/command.py", "qutebrowser/misc/utilcmds.py", "scripts/dev/build_release.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-3fd8e12949b8feda401930574facf09dd4180bba", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "3821d51bf6fc048a882c7b1e2251d7d35ec4c874b0458348c955ec60a7191a4f"}+{"added": [], "base_commit": "22a3fd479accc3b9a0c0e2e5c2f1841324c3ab3d", "gold": ["qutebrowser/utils/version.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-44e64199ed38003253f0296badd4a447645067b6-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "4ae7e063e037fa9e7bf0175c4d11bd8fbd9a22e732c7843224104c1dae804f57"}+{"added": [], "base_commit": "e46adf32bdf880385319cb701d926fec6899046d", "gold": ["qutebrowser/misc/crashdialog.py", "qutebrowser/misc/earlyinit.py", "qutebrowser/utils/qtutils.py", "qutebrowser/utils/utils.py", "qutebrowser/utils/version.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-46e6839e21d9ff72abb6c5d49d5abaa5a8da8a81-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "47114822ffd06a260ac5f052cd0d2342f9957853f795c748861697b72d2092f1"}+{"added": [], "base_commit": "8e08f046aeffb38445cc659050f7a083b4a9649c", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/config/configdata.yml", "qutebrowser/config/qtargs.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-473a15f7908f2bb6d670b0e908ab34a28d8cf7e2-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "dee4521c01c315012596d0e35ab4309765cf4af71624eec9e12300d1f6329dc1"}+{"added": [], "base_commit": "34db7a1ef4139f30f5b6289ea114c44e1a7b33a6", "gold": ["qutebrowser/misc/elf.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-479aa075ac79dc975e2e949e188a328e95bf78ff-vc2f56a753b62a190ddb23cd330c257b9cf560d12", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "d21b11e0421adaafb07b40845d1feb5853fe31846aa665c1634c53e01e6da2b5"}+{"added": [], "base_commit": "434f6906f9088172494fa7e219a856d893ed55ba", "gold": ["qutebrowser/browser/webengine/darkmode.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-50efac08f623644a85441bbe02ab9347d2b71a9d-v9f8e9d96c85c85a605e382f1510bd08563afc566", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "40605c0a01fcf4dc4bde960730b99bf0f66d041cbfd782a70a5900b325f3c285"}+{"added": [], "base_commit": "a0710124a1790237aa4f2a17e2f7011a074143b4", "gold": ["doc/help/settings.asciidoc", "qutebrowser/config/configdata.yml", "qutebrowser/config/configtypes.py", "qutebrowser/mainwindow/statusbar/bar.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-52708364b5f91e198defb022d1a5b4b3ebd9b563-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "711b2d9cbec0011b8fa1995ab8721957aac19abd4b5650cca9048fa4b1338ab0"}+{"added": [], "base_commit": "0df0985292b79e54c062b7fd8b3f5220b444b429", "gold": ["qutebrowser/utils/utils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-54bcdc1eefa86cc20790973d6997b60c3bba884c-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "0b352635cfa0216d7a64026c9de46d493aea573d76e14a83470149264b318604"}+{"added": [], "base_commit": "c41f152fa5b0bc44e15779e99706d7fb8431de85", "gold": ["doc/changelog.asciidoc", "qutebrowser/misc/guiprocess.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-5cef49ff3074f9eab1da6937a141a39a20828502-v02ad04386d5238fe2d1a1be450df257370de4b6a", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "cf4d9f6e119e231ab0594faa50ca4d4c443a1a682912df3518fcba788c351c54"}+{"added": ["qutebrowser/javascript/quirks/array_at.user.js"], "base_commit": "4df7aedf2b2e1f844e8f0ba55bb6fdcafcfa8ec8", "gold": ["qutebrowser/browser/webengine/webenginetab.py", "qutebrowser/config/configdata.yml", "qutebrowser/javascript/.eslintrc.yaml"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-5e0d6dc1483cb3336ea0e3dcbd4fe4aa00fc1742-v5149fcda2a9a6fe1d35dfed1bade1444a11ef271", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "e90e5cd53af665bda94c5267c20124634fcf3897886f4828e5cd6470f5ed59b4"}+{"added": [], "base_commit": "cb59619327e7fa941087d62b83459750c1b7c579", "gold": ["qutebrowser/config/configfiles.py", "qutebrowser/config/configtypes.py", "qutebrowser/config/configutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-5fdc83e5da6222fe61163395baaad7ae57fa2cb4-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "46feef83bcd04797f68fbaa18413f543c95c6dc828b351c8807b818042226e60"}+{"added": [], "base_commit": "6d0b7cb12b206f400f8b44041a86c1a93cd78c7f", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/config/configdata.yml", "qutebrowser/config/qtargs.py", "scripts/dev/misc_checks.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-66cfa15c372fa9e613ea5a82d3b03e4609399fb6-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "aeb0e03282a4d94c800c8ad8cdc282bbcdd96aa9609fbcd948a488e61c9c50a0"}+{"added": [], "base_commit": "d283e2250fcc533838fbac1078acd5883c77e2e3", "gold": ["qutebrowser/config/configtypes.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-6b320dc18662580e1313d2548fdd6231d2a97e6d-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "7808cc1d61ff7a99cbd6e655ad6c542875481a114f5d51903f92167d21162df4"}+{"added": [], "base_commit": "d6a3d1fe608bae2afedd3019e46de3476ac18ff6", "gold": ["qutebrowser/components/braveadblock.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-6dd402c0d0f7665d32a74c43c5b4cf5dc8aff28d-v5fc38aaf22415ab0b70567368332beee7955b367", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "cd0d9036ef4fd6996c2d5a3c58e74950ceb0829d0e5513eb57d740fdad658c07"}+{"added": [], "base_commit": "bf65a1db0f3f49977de77d7d61eeaaecd022185c", "gold": ["qutebrowser/misc/utilcmds.py", "qutebrowser/utils/utils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-70248f256f93ed9b1984494d0a1a919ddd774892-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "981fd5f04276fd9fd2ca3b13fc4c6e07b9ad42e28d69569b03b98694f8d16a1a"}+{"added": [], "base_commit": "1799b7926a0202497a88e4ee1fdb232f06ab8e3a", "gold": ["qutebrowser/config/configutils.py", "scripts/dev/run_vulture.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-77c3557995704a683cdb67e2a3055f7547fa22c3-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "222d030514c4048cd65cd18d62357cb5165f8fcf124156ce3aee09c4af7dc1c5"}+{"added": [], "base_commit": "a67832ba311fdb0e9d57190d1671241a369b5b0a", "gold": ["qutebrowser/browser/webengine/webview.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-7b603dd6bf195e3e723ce08ff64a82b406e3f6b6-v9f8e9d96c85c85a605e382f1510bd08563afc566", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "40402b43c4f2176b2936741d131c44a17599dd1eadc6acd2f29d116d0ba69d50"}+{"added": [], "base_commit": "142f019c7a262e95eb1957ad0766c7a51621109b", "gold": ["doc/changelog.asciidoc", "qutebrowser/browser/webengine/webview.py", "qutebrowser/utils/qtutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-7f9713b20f623fc40473b7167a082d6db0f0fd40-va0fd88aac89cde702ec1ba84877234da33adce8a", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "22da75c69a837c699fe4bb7e4be1273f1b1e6ecf7479db7d0dba8ebf51979abf"}+{"added": [], "base_commit": "c97257cac01d9f7d67fb42d0344cb4332c7a0833", "gold": ["doc/help/commands.asciidoc", "qutebrowser/components/misccommands.py", "qutebrowser/utils/utils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-85b867fe8d4378c8e371f055c70452f546055854-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "6016dded191c000ea7a2d790a7dd8abef719a910a8db30101448d708d6cbbe74"}+{"added": [], "base_commit": "2a10461ca473838cbc3bf6b92501324470d4f521", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/browser/webengine/darkmode.py", "qutebrowser/config/configdata.yml"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-8cd06741bb56cdca49f5cdc0542da97681154315-v5149fcda2a9a6fe1d35dfed1bade1444a11ef271", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "571978230d90908abd452597d73b85bd6ecf1b5134297043e64a05b8ca2dd700"}+{"added": [], "base_commit": "190bab127d9e8421940f5f3fdc738d1c7ec02193", "gold": ["qutebrowser/config/configfiles.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-8d05f0282a271bfd45e614238bd1b555c58b3fc1-v35616345bb8052ea303186706cec663146f0f184", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "e86c0234e0efd25b63e87cd42c9384966e7a80d6f4ba8bee62980f6ba358dea5"}+{"added": [], "base_commit": "1547a48e6f1a8af8dc618d5afe858084ebfd317f", "gold": ["misc/nsis/install.nsh", "misc/org.qutebrowser.qutebrowser.desktop", "qutebrowser/qutebrowser.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-8f46ba3f6dc7b18375f7aa63c48a1fe461190430-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "6e47593a12e20ceffff0efc45f8bea5222f0a80806723dd17f348d7c91007081"}+{"added": [], "base_commit": "2e65f731b1b615b5cd60417c00b6993c2295e9f8", "gold": ["qutebrowser/misc/utilcmds.py", "qutebrowser/utils/utils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-96b997802e942937e81d2b8a32d08f00d3f4bc4e-v5fc38aaf22415ab0b70567368332beee7955b367", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "b0b2d3afaffc0a2b615dabfb888439b9f73813dc909fd032b089b9fc844d6d42"}+{"added": [], "base_commit": "ef62208ce998797c9a1f0110a528bbd11c402357", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/browser/webengine/darkmode.py", "qutebrowser/browser/webengine/webenginesettings.py", "qutebrowser/config/configdata.yml"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-99029144b5109bb1b2a53964a7c129e009980cd9-va0fd88aac89cde702ec1ba84877234da33adce8a", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "25bf34eac57447ae2bfe7090d20230e1b9f2db8fc6301e64757465579425d7cd"}+{"added": [], "base_commit": "03fa9383833c6262b08a5f7c4930143e39327173", "gold": ["qutebrowser/config/configdata.yml", "qutebrowser/config/configtypes.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-996487c43e4fcc265b541f9eca1e7930e3c5cf05-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "3087755741dc768b2dfec36dabeb604e0e736f81f8edde27580ab0c4aacfab48"}+{"added": [], "base_commit": "b84ef9b299ec1639ddf79ab900b670a96d71d9f2", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/config/configdata.yml", "qutebrowser/config/qtargs.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-9b71c1ea67a9e7eb70dd83214d881c2031db6541-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "042cff64c36bcfa94edc3892b9d5cff424bb70734c2cce89b7429eac5fb5e78d"}+{"added": [], "base_commit": "30250d8e680041a15e440aa7441a224d670c3862", "gold": ["qutebrowser/config/configtypes.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-9ed748effa8f3bcd804612d9291da017b514e12f-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "8fd20d0b36dbd11ad58717d8477ac02e3c029d4e44c845db8da14bf8468dbe3f"}+{"added": [], "base_commit": "83bef2ad4bdc10113bb9e5ed12c32d92bc1247af", "gold": ["qutebrowser/qt/machinery.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-a25e8a09873838ca9efefd36ea8a45170bbeb95c-vc2f56a753b62a190ddb23cd330c257b9cf560d12", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "fcbe1ded5ef8ba0e7da17019de0980d6ea502ae4c437a57c849be168fbd2f749"}+{"added": [], "base_commit": "c9380605a1240748769c012403520323b4d2c3be", "gold": ["qutebrowser/commands/cmdexc.py", "qutebrowser/commands/parser.py", "qutebrowser/commands/runners.py", "qutebrowser/mainwindow/mainwindow.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-a84ecfb80a00f8ab7e341372560458e3f9cfffa2-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "491ca5989c5a7214da985e65279cf06d22303efc3594f1cbc6eb4ec3cf551950"}+{"added": [], "base_commit": "0e624e64695e8f566c7391f65f737311aeb6b2eb", "gold": ["qutebrowser/browser/downloads.py", "qutebrowser/mainwindow/tabbedbrowser.py", "qutebrowser/utils/qtutils.py", "qutebrowser/utils/utils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-bedc9f7fadf93f83d8dee95feeecb9922b6f063f-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": true, "repo": "qutebrowser/qutebrowser", "text_sha256": "6fa9fa1cc4083ccd58d940aeea389e76e80bf94dbe48bbd619bc11fc31929a08"}+{"added": [], "base_commit": "ea60bcfc2ae1e018559031a4c8a26b29caec1c59", "gold": ["doc/help/commands.asciidoc", "qutebrowser/browser/qutescheme.py", "qutebrowser/completion/models/miscmodels.py", "qutebrowser/misc/guiprocess.py"], "hard": true, "instance_id": "instance_qutebrowser__qutebrowser-c09e1439f145c66ee3af574386e277dd2388d094-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "037856d70b046adb89b91f7bd01e09fc3b3a4defabd68d8c421deba950d75786"}+{"added": [], "base_commit": "690813e1b10fee83660a6740ab3aabc575a9b125", "gold": ["qutebrowser/browser/webengine/webview.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-c0be28ebee3e1837aaf3f30ec534ccd6d038f129-v9f8e9d96c85c85a605e382f1510bd08563afc566", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "f434133a31f6fbe134072caa87489f4fa67e3dafcd09b1c9c6813ea5a6730316"}+{"added": [], "base_commit": "0b8cc812fd0b73e296a3f93db02ce5d0b35714fc", "gold": ["qutebrowser/components/hostblock.py", "qutebrowser/config/configutils.py", "qutebrowser/utils/urlutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-c580ebf0801e5a3ecabc54f327498bb753c6d5f2-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "58b1be64755a694fa1bc99f79e6e8a93e149c94fffbcdf27425c5edaaca1f234"}+{"added": [], "base_commit": "96b997802e942937e81d2b8a32d08f00d3f4bc4e", "gold": ["qutebrowser/misc/utilcmds.py", "qutebrowser/utils/utils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-cc360cd4a34a126274c7b51f3b63afbaf3e05a02-v5fc38aaf22415ab0b70567368332beee7955b367", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "8c59a98cd7a239bdbb8eed33ea55f755b48a3afe76b3659ca6752e242a11f2ed"}+{"added": [], "base_commit": "61ff98d395c39d57bbbae1b941150ca11b7671e1", "gold": ["qutebrowser/misc/guiprocess.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-cf06f4e3708f886032d4d2a30108c2fddb042d81-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "7fc66e3d6f3d135bb63bafee8e159b24085781f2befd8b1799a135f24bc2125d"}+{"added": ["qutebrowser/config/qtargs.py"], "base_commit": "6e7bb038fdab304eb3b93dfbb57a49a48ccca287", "gold": ["qutebrowser/app.py", "qutebrowser/config/configinit.py", "scripts/dev/check_coverage.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-de4a1c1a2839b5b49c3d4ce21d39de48d24e2091-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "4dd4f81d0b8190b31bca5b72f7f8230b26c0ad840e9865a613fbc9d9f6a041f3"}+{"added": [], "base_commit": "3ae5cc96aecb12008345f45bd7d06dbc52e48fa7", "gold": ["qutebrowser/utils/urlutils.py"], "hard": true, "instance_id": "instance_qutebrowser__qutebrowser-deeb15d6f009b3ca0c3bd503a7cef07462bd16b4-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": true, "repo": "qutebrowser/qutebrowser", "text_sha256": "9e4458aa940af6ade4a77e73e7b28f0a7bd556fddf40f3a92fd915ed6dfd8c94"}+{"added": [], "base_commit": "e158a480f52185c77ee07a52bc022f021d9789fe", "gold": ["doc/changelog.asciidoc", "qutebrowser/browser/shared.py", "qutebrowser/browser/webengine/interceptor.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-e15d26630934d0b6415ed2295ac42fd570a57620-va0fd88aac89cde702ec1ba84877234da33adce8a", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "54309a2ec1ff2ba3a4879dfe74785a7bbb9f053af8f7a9aef3057142971bcc41"}+{"added": [], "base_commit": "c984983bc4cf6f9148e16ea17369597f67774ff9", "gold": ["qutebrowser/utils/urlutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-e34dfc68647d087ca3175d9ad3f023c30d8c9746-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "3a727569c0484a2c409ea26609716ac27ac7c6184866c72d7c9dd0fb5bcfde3e"}+{"added": [], "base_commit": "ae910113a7a52a81c4574a18937b7feba48b387d", "gold": ["qutebrowser/browser/shared.py", "qutebrowser/browser/webengine/certificateerror.py", "qutebrowser/browser/webengine/webenginetab.py", "qutebrowser/browser/webengine/webview.py", "qutebrowser/browser/webkit/certificateerror.py", "qutebrowser/browser/webkit/network/networkmanager.py", "qutebrowser/utils/usertypes.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-e5340c449f23608803c286da0563b62f58ba25b0-v059c6fdc75567943479b23ebca7c07b5e9a7f34c", "language": "python", "names_gold_path": true, "repo": "qutebrowser/qutebrowser", "text_sha256": "9404f802f592262569f9a08b1c355edbd5668b6ccba7e776b0656d2e57421b6e"}+{"added": [], "base_commit": "5a7f64ea219f3f008a4b61546ae18820e6780d8e", "gold": ["qutebrowser/components/adblock.py", "qutebrowser/components/braveadblock.py", "qutebrowser/components/utils/blockutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-e57b6e0eeeb656eb2c84d6547d5a0a7333ecee85-v2ef375ac784985212b1805e1d0431dc8f1b3c171", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "bc65091a7008be40180f1189fb27f157c594c0f5e6c44ff78df8ff0c37121d0f"}+{"added": [], "base_commit": "09925f74817cf7a970f166342f81886a1d27ee35", "gold": ["qutebrowser/utils/debug.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-e64622cd2df5b521342cf4a62e0d4cb8f8c9ae5a-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "3230010076342458514998cfd21ade48f30aa62d95e534398b9f1e054df6e3ec"}+{"added": [], "base_commit": "d7d1293569cd71200758068cabc54e1e2596d606", "gold": ["doc/changelog.asciidoc", "qutebrowser/misc/guiprocess.py"], "hard": true, "instance_id": "instance_qutebrowser__qutebrowser-e70f5b03187bdd40e8bf70f5f3ead840f52d1f42-v02ad04386d5238fe2d1a1be450df257370de4b6a", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "bdf09381905f6dd1d77a46bc5da4b675e8b4a0f217f00723ae2838452c302d78"}+{"added": [], "base_commit": "30570a5cad1a3e7f648f066b4a1df8158d6b1189", "gold": ["qutebrowser/utils/log.py", "qutebrowser/utils/qtlog.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-ebfe9b7aa0c4ba9d451f993e08955004aaec4345-v059c6fdc75567943479b23ebca7c07b5e9a7f34c", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "0b7d721b36b5ef953d8ae7beb1d830a116e56ad373d316c8186ddd8824dcc62e"}+{"added": [], "base_commit": "b9920503db6482f0d3af7e95b3cf3c71fbbd7d4f", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/browser/shared.py", "qutebrowser/config/configdata.yml"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-ec2dcfce9eee9f808efc17a1b99e227fc4421dea-v5149fcda2a9a6fe1d35dfed1bade1444a11ef271", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "9ebc666eccfaab9fabfdd8f3b74a7abdd3f5f055ff7df209b74ed5af455df338"}+{"added": [], "base_commit": "836221ecaf2bad121c741b0c41dff508049e8ca5", "gold": ["doc/help/commands.asciidoc", "qutebrowser/browser/qutescheme.py", "qutebrowser/config/config.py", "qutebrowser/config/configcommands.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-ed19d7f58b2664bb310c7cb6b52c5b9a06ea60b2-v059c6fdc75567943479b23ebca7c07b5e9a7f34c", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "3c91f3d5a8d8b3d538d423539ba1453389f45c87ca59b89c3c221a71d17aaf6c"}+{"added": [], "base_commit": "9c056f288aefebbb95734fa3dc46a2405862405b", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/config/configdata.yml", "qutebrowser/config/qtargs.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-ef5ba1a0360b39f9eff027fbdc57f363597c3c3b-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "c18ce0573e8960f0f0d6071b1a0a0997b6d53b5e833b1ec029874b5222b633a0"}+{"added": [], "base_commit": "5ee28105ad972dd635fcdc0ea56e5f82de478fb1", "gold": ["doc/changelog.asciidoc", "doc/help/settings.asciidoc", "qutebrowser/app.py", "qutebrowser/config/configdata.yml", "qutebrowser/config/configfiles.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-f631cd4422744160d9dcf7a0455da532ce973315-v35616345bb8052ea303186706cec663146f0f184", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "4361f9db455542f6d28b4e338bd3a4967ef52ad6906dced422b569bbd7821c21"}+{"added": [], "base_commit": "ebfe9b7aa0c4ba9d451f993e08955004aaec4345", "gold": ["qutebrowser/browser/qtnetworkdownloads.py", "qutebrowser/utils/log.py", "qutebrowser/utils/qtlog.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-f91ace96223cac8161c16dd061907e138fe85111-v059c6fdc75567943479b23ebca7c07b5e9a7f34c", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "b86adfe51374539c3eb95fa709f259a62cda68058ef0674e7565ec5132ad1abc"}+{"added": [], "base_commit": "74671c167f6f18a5494ffe44809e6a0e1c6ea8e9", "gold": ["qutebrowser/misc/sql.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-fcfa069a06ade76d91bac38127f3235c13d78eb1-v5fc38aaf22415ab0b70567368332beee7955b367", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "42a7e54b732dae7286d6dd64a918150dcea34f32a0ea4fddc4faf1d1d893b93d"}+{"added": [], "base_commit": "54c0c493b3e560f478c3898627c582cab11fbc2b", "gold": ["qutebrowser/browser/webengine/webview.py", "qutebrowser/utils/qtutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-fea33d607fde83cf505b228238cf365936437a63-v9f8e9d96c85c85a605e382f1510bd08563afc566", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "d1fb77ce6ba5abce1dc42f3a72f909b0f68be0b83de233502a2e5f2079543163"}+{"added": [], "base_commit": "a55f4db26b4b1caa304dd4b842a4103445fdccc7", "gold": ["qutebrowser/utils/urlutils.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-fec187c2cb53d769c2682b35ca77858a811414a8-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "2d6068404f3b5dbfe32ea370dfda8ccf32e8aa11b13ca992ab27e04748fed057"}+{"added": [], "base_commit": "e545faaf7b18d451c082f697675f0ab0e7599ed1", "gold": ["doc/changelog.asciidoc", "qutebrowser/config/configdata.yml", "qutebrowser/config/configinit.py", "qutebrowser/config/configtypes.py"], "hard": false, "instance_id": "instance_qutebrowser__qutebrowser-ff1c025ad3210506fc76e1f604d8c8c27637d88e-v363c8a7e5ccdf6968fc7ab84a2053ac78036691d", "language": "python", "names_gold_path": false, "repo": "qutebrowser/qutebrowser", "text_sha256": "5198a8158f174fc60e67aaaf4a922aaf8f07aa4f7efc78a9a38d7c7238a6d8a5"}+{"added": [], "base_commit": "dac77208814de95c4018bcf13137324153cc9a3a", "gold": ["src/desktop/DesktopDownloadManager.ts", "src/desktop/DesktopNetworkClient.ts"], "hard": false, "instance_id": "instance_tutao__tutanota-51818218c6ae33de00cbea3a4d30daac8c34142e-vc4e41fd0029957297843cb9dec4a25c7c756f029", "language": "ts", "names_gold_path": false, "repo": "tutao/tutanota", "text_sha256": "58702d57247d57501870ff8996212ca518c1743ac9558108ec67c60b4f397041"}+{"added": [], "base_commit": "cf4bcf0b4c5ecc970715c4ca59e57cfa2c4246af", "gold": ["src/api/worker/facades/DeviceEncryptionFacade.ts", "src/misc/credentials/NativeCredentialsEncryption.ts"], "hard": false, "instance_id": "instance_tutao__tutanota-de49d486feef842101506adf040a0f00ded59519-v10a26bfb45a064b93f4fc044a0254925037b88f1", "language": "ts", "names_gold_path": false, "repo": "tutao/tutanota", "text_sha256": "aa36b1cbfb2c54f2ab2f8b06c06f8176914d7497603940326cbf8a7f5cb3d0d2"}+{"added": [], "base_commit": "a834bd49d148888778075a3a48d3b92d832c4eed", "gold": ["doc/HACKING.md", "src/api/common/EntityClient.ts", "src/api/worker/crypto/CryptoFacade.ts", "src/api/worker/facades/lazy/MailFacade.ts", "src/api/worker/rest/DefaultEntityRestCache.ts", "src/api/worker/rest/EntityRestClient.ts", "src/api/worker/search/MailIndexer.ts", "src/mail/model/InboxRuleHandler.ts", "src/mail/model/MailUtils.ts"], "hard": true, "instance_id": "instance_tutao__tutanota-f373ac3808deefce8183dad8d16729839cc330c1-v2939aa9f4356f0dc9f523ee5ce19d09e08ab979b", "language": "ts", "names_gold_path": false, "repo": "tutao/tutanota", "text_sha256": "258bdea8f62265d9ee1dde5d7b76c078f903a469a86eb08594587df3a35a9142"}+{"added": ["src/api/worker/facades/EntropyFacade.ts"], "base_commit": "376d4f298af944bda3e3207ab03de0fcbfc13b2f", "gold": ["src/api/main/EntropyCollector.ts", "src/api/main/MainLocator.ts", "src/api/main/WorkerClient.ts", "src/api/worker/WorkerImpl.ts", "src/api/worker/WorkerLocator.ts", "src/api/worker/facades/LoginFacade.ts", "src/api/worker/worker.ts", "src/types.d.ts"], "hard": false, "instance_id": "instance_tutao__tutanota-f3ffe17af6e8ab007e8d461355057ad237846d9d-vbc0d9ba8f0071fbe982809910959a6ff8884dbbf", "language": "ts", "names_gold_path": false, "repo": "tutao/tutanota", "text_sha256": "d09c529291d864159f9a607219499d5fb81e0bccfdaa27826166ff4e6f561610"}diff --git a/bench/swe-bench-pro/test_c4c.py b/bench/swe-bench-pro/test_c4c.pynew file mode 100644index 0000000..a7dec56--- /dev/null+++ b/bench/swe-bench-pro/test_c4c.py@@ -0,0 +1,105 @@+#!/usr/bin/env python3+"""Tests of the cache meter's session (c4c.py run) on the mock server: no model, no key, no spend.++usage: test_c4c.py [-v] (MOCK_HOST as in ../whole-repo/test_runner.py)+Writes 20 synthetic packs (a shared 90% prefix and a question's own suffix, or no shared text at all), their+manifest and questions, serves mock_server.py in a thread and runs the session.+"""+import hashlib+import json+import os+import shutil+import subprocess+import sys+import tempfile+import threading+import unittest++HERE = os.path.dirname(os.path.abspath(__file__))+WR = os.path.join(HERE, "..", "whole-repo")+sys.path.insert(0, WR)+import mock_server # noqa: E402+from test_runner import mock_host, read_jsonl # noqa: E402++PREFIX = "".join(f'<file path="pkg/kubelet/f{i}.go" lines="1-1">\nfunc F{i}() {{ return }}\n</file>\n' for i in range(900))+++def make_session(root, shared):+ work = os.path.join(root, "work")+ packs = os.path.join(work, "c4c", "packs")+ os.makedirs(packs)+ qfile, tdir = os.path.join(root, "questions-kubernetes.jsonl"), os.path.join(root, "texts")+ os.makedirs(tdir)+ manifest = {"graphicle": "test", "S": "d5cbb79be916" + "0" * 28, "budget": 1015808, "layout": "cache",+ "prefix_share": 0.9, "counter": "estimate", "packs": [], "one_prefix": True}+ with open(qfile, "w") as qf, open(os.path.join(tdir, "texts-kubernetes.jsonl"), "w") as tf:+ for i in range(1, 21):+ qid, text = f"kubernetes-{i}", f"kubelet handler {i} fails"+ qf.write(json.dumps({"id": qid, "repo": "kubernetes/kubernetes", "S": manifest["S"],+ "gold": [f"pkg/kubelet/f{i}.go"], "names_gold_path": False,+ "text_sha256": hashlib.sha256(text.encode()).hexdigest()}) + "\n")+ tf.write(json.dumps({"id": qid, "text": text}) + "\n")+ body = (PREFIX if shared else PREFIX.replace("func", f"func{i}x")) + \+ f'<file path="pkg/kubelet/f{i}.go" lines="1-1">\nfunc Q{i}() {{}}\n</file>\n'+ with open(os.path.join(packs, qid + ".xml"), "w") as f:+ f.write(body)+ manifest["packs"].append({"id": qid, "tokens": len(body) // 4, "prefix_sha256": "ab" * 32,+ "xml_sha256": hashlib.sha256(body.encode()).hexdigest()})+ with open(os.path.join(work, "c4c", "packs.json"), "w") as f:+ json.dump(manifest, f)+ return work, qfile, tdir+++class C4cTest(unittest.TestCase):+ @classmethod+ def setUpClass(cls):+ cls.tmp = tempfile.mkdtemp(prefix="c4c-test-")+ cls.record = os.path.join(cls.tmp, "mock-requests.jsonl")+ cls.srv = mock_server.make_server(mock_host(), 0, record=cls.record)+ threading.Thread(target=cls.srv.serve_forever, daemon=True).start()+ cls.url = f"http://{cls.srv.server_address[0]}:{cls.srv.server_address[1]}/v1"+ cls.caps = os.path.join(cls.tmp, "caps.json")+ with open(cls.caps, "w") as f:+ json.dump({"usd": {"mock": 50.0}}, f)++ @classmethod+ def tearDownClass(cls):+ cls.srv.shutdown()+ cls.srv.server_close()+ shutil.rmtree(cls.tmp, ignore_errors=True)++ def session(self, name, shared):+ root = os.path.join(self.tmp, name)+ work, qfile, tdir = make_session(root, shared)+ out = os.path.join(root, "out")+ r = subprocess.run([sys.executable, os.path.join(HERE, "c4c.py"), "run", "--work", work, "--out", out,+ "--texts", tdir, "--questions", qfile, "--profile", "mock", "--base-url", self.url,+ "--caps", self.caps, "--spend-log", os.path.join(root, "spend-log.jsonl")],+ capture_output=True, text=True, timeout=600, env=dict(os.environ, MODEL_API_KEY="mock-key"))+ self.assertEqual(r.returncode, 0, r.stderr[-2000:] + r.stdout[-1000:])+ calls_path = os.path.join(out, "calls.jsonl")+ self.assertTrue(os.path.exists(calls_path), r.stdout[-1500:])+ return read_jsonl(calls_path), json.load(open(os.path.join(out, "summary.json"))), \+ read_jsonl(os.path.join(root, "spend-log.jsonl"))++ def test_1_follow_ups_read_the_shared_prefix(self):+ calls, summary, log = self.session("shared", True)+ self.assertEqual([c["model"] for c in calls], ["mock"] * 20 + ["mock-wonder"] * 10)+ self.assertEqual(calls[0]["cached_tokens"], 0, "the first call pays in full")+ self.assertTrue(all(c["cached_share"] > 0.8 for c in calls[1:20]), [c["cached_share"] for c in calls[:20]])+ self.assertEqual(len({c["cache_key"] for c in calls}), 1)+ self.assertIsNone(summary["stopped"])+ fu = summary["mock"]["follow_ups"]+ self.assertEqual(fu["n"], 19)+ self.assertLess(fu["cost_mean"], summary["mock"]["first"]["cost_usd"])+ self.assertEqual(len(log), 31, "30 calls and the window check, all in the ledger")+ self.assertEqual(log[0]["api"], "input_tokens")++ def test_2_the_session_stops_when_the_cache_does_not_serve(self):+ calls, summary, _log = self.session("unshared", False)+ self.assertEqual(len(calls), 3)+ self.assertIn("less than half", summary["stopped"])+++if __name__ == "__main__":+ unittest.main()diff --git a/bench/swe-bench-pro/test_e1.py b/bench/swe-bench-pro/test_e1.pynew file mode 100644index 0000000..5355696--- /dev/null+++ b/bench/swe-bench-pro/test_e1.py@@ -0,0 +1,160 @@+#!/usr/bin/env python3+"""End-to-end test of e1.py and bm25.py on a small synthetic repository (no SWE-bench Pro data).++usage: test_e1.py --graphicle BIN --tokenizer TOKENIZER.json+Builds a git repository with a few files, a bare clone of it as the mirror, one task whose gold file is+known, runs `e1.py task --contexts` and checks the rows: three arms at the five budgets, the gold file+inside BM25's context, budgets kept, and the 64K contexts saved. Then a named run in its own folders, and+pack-only runs (--reuse) that take the first run's BM25 and truncation rows as they are.+"""+import argparse+import hashlib+import json+import os+import subprocess+import sys+import tempfile++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, os.path.join(HERE, "..", "whole-repo"))+sys.path.insert(0, HERE)+from bm25 import Index, analyze, rank # noqa: E402+import e1 as e1mod # noqa: E402++FILES = {+ "src/billing/invoice_total.py": "def invoice_total(lines):\n \"\"\"Sum the invoice lines, rounding each tax.\"\"\"\n"+ " return sum(round(l.amount * (1 + l.tax_rate), 2) for l in lines)\n",+ "src/billing/currency.py": "CURRENCIES = {'EUR': 2, 'JPY': 0}\n\ndef minor_units(code):\n return CURRENCIES[code]\n",+ "src/web/routes.py": "from billing.invoice_total import invoice_total\n\ndef get_invoice(req):\n"+ " return {'total': invoice_total(req.lines)}\n",+ "tests/test_invoice_total.py": "from billing.invoice_total import invoice_total\n\ndef test_empty():\n"+ " assert invoice_total([]) == 0\n",+ "docs/billing.md": "# Billing\n\nInvoices are summed line by line.\n",+}+QUESTION = "Invoice total is wrong when the tax rate has three decimals: invoice_total rounds each line."+++def sh(*cmd, cwd=None):+ subprocess.run(cmd, cwd=cwd, check=True, capture_output=True)+++def test_analyzer():+ c = analyze("getUserName HTTPServer snake_case the a x")+ for t in ("getusername", "get", "user", "name", "httpserver", "http", "server", "snake_case", "snake", "case"):+ assert c[t] >= 1, t+ assert "the" not in c and "a" not in c and "x" not in c+ docs = [("a.py", "invoice total invoice"), ("b.py", "unrelated text"), ("c.py", "total"),+ ("d/getUserTotal.py", "def getUserTotal(invoice_lines): return sum(invoice_lines)")]+ r = rank("invoice total rounding", docs)+ ranked = [p for p, _s in r]+ assert ranked[0] == "a.py" and "b.py" not in ranked and set(ranked) == {"a.py", "c.py", "d/getUserTotal.py"}, r+ # The inverted index scores like rank(), up to the order floating-point terms are added.+ idx = Index(docs)+ for query in ("invoice total rounding", "getUserTotal of the invoice lines", "nothing matches here"):+ a, b = rank(query, docs), idx.rank(query)+ assert [p for p, _s in a] == [p for p, _s in b], (query, a, b)+ assert all(abs(x[1] - y[1]) < 1e-9 for x, y in zip(a, b)), (query, a, b)+++def main():+ ap = argparse.ArgumentParser()+ ap.add_argument("--graphicle", required=True)+ ap.add_argument("--tokenizer", required=True)+ a = ap.parse_args()+ test_analyzer()+ with tempfile.TemporaryDirectory() as tmp:+ repo = os.path.join(tmp, "upstream")+ os.makedirs(repo)+ for p, t in FILES.items():+ os.makedirs(os.path.dirname(os.path.join(repo, p)), exist_ok=True)+ with open(os.path.join(repo, p), "w") as f:+ f.write(t)+ sh("git", "init", "-q", cwd=repo)+ sh("git", "add", "-A", cwd=repo)+ sh("git", "-c", "user.name=t", "-c", "user.email=t@t", "commit", "-q", "-m", "base", cwd=repo)+ base = subprocess.run(["git", "rev-parse", "HEAD"], cwd=repo, capture_output=True, text=True).stdout.strip()+ work = os.path.join(tmp, "work")+ os.makedirs(os.path.join(work, "mirror"))+ os.makedirs(os.path.join(work, "texts"))+ sh("git", "clone", "-q", "--bare", repo, os.path.join(work, "mirror", "acme__shop.git"))+ task = {"instance_id": "t1", "repo": "acme/shop", "base_commit": base, "language": "python",+ "gold": ["src/billing/invoice_total.py"], "added": [],+ "text_sha256": hashlib.sha256(QUESTION.encode()).hexdigest(), "names_gold_path": False, "hard": False}+ with open(os.path.join(work, "tasks.jsonl"), "w") as f:+ f.write(json.dumps(task) + "\n")+ with open(os.path.join(work, "texts", "t1.txt"), "w") as f:+ f.write(QUESTION)+ r = subprocess.run([sys.executable, os.path.join(HERE, "e1.py"), "task", "--work", work, "--graphicle",+ a.graphicle, "--tokenizer", a.tokenizer, "--id", "t1", "--contexts"],+ capture_output=True, text=True)+ assert r.returncode == 0, r.stdout[-2000:] + r.stderr[-2000:]+ rows = [json.loads(l) for l in open(os.path.join(work, "out", "e1", "rows", "t1.jsonl"))]+ info = json.load(open(os.path.join(work, "out", "e1", "tasks", "t1.json")))+ assert sorted({(x["arm"], x["budget"]) for x in rows}) == sorted(+ (arm, b) for arm in ("pack", "bm25", "trunc") for b in ("16K", "32K", "64K", "128K", "256K")), rows+ for x in rows:+ assert x["context_tokens"] is not None and x["context_tokens"] <= x["budget_tokens"], x+ assert x["fits_whole"] is True, x+ if x["arm"] in ("bm25", "trunc"):+ assert x["all_gold"] == 1, x+ else:+ assert 0 <= x["inside_outline_only"] + x["inside_whole"] <= x["inside"], x+ pj = {"sections": [{"chunks": [{"path": "a.py", "whole": False, "why": "map (outline: the first line of each "+ "symbol)"}, {"path": "b.py", "whole": True, "why": "focus"},+ {"path": "c.py", "whole": False, "why": "x (outline: the first line)"}]},+ {"chunks": [{"path": "c.py", "whole": False, "why": "focus: rank 2"}, {"path": None}]}]}+ assert e1mod.outline_only(pj) == {"a.py"}, e1mod.outline_only(pj)+ assert info["index"]["wall_seconds"] >= 0 and info["tokens_eligible"] > 0, info+ assert set(info["contexts"]) == {"pack-64K.xml", "bm25-64K.txt"}, info+ for fname in info["contexts"]:+ assert os.path.getsize(os.path.join(work, "contexts", "t1", fname)) > 0+ assert not os.path.exists(os.path.join(work, "src", "t1")), "the checkout is removed after the task"+ # A second, named run (another build) keeps its own folders and, with the same binary, the same rows.+ r = subprocess.run([sys.executable, os.path.join(HERE, "e1.py"), "task", "--work", work, "--graphicle",+ a.graphicle, "--tokenizer", a.tokenizer, "--id", "t1", "--contexts", "--run", "e1-two"],+ capture_output=True, text=True)+ assert r.returncode == 0, r.stdout[-2000:] + r.stderr[-2000:]+ rows2 = [json.loads(l) for l in open(os.path.join(work, "out", "e1-two", "rows", "t1.jsonl"))]+ key = lambda x: (x["arm"], x["budget"], x["inside"], x["context_tokens"], x["context_files"]) # noqa: E731+ assert sorted(map(key, rows)) == sorted(map(key, rows2)), "the same binary gives the same rows"+ assert os.path.exists(os.path.join(work, "contexts-e1-two", "t1", "pack-64K.xml"))+ assert not os.path.exists(os.path.join(work, "runs", "e1-two", "src", "t1"))+ cmp = subprocess.run([sys.executable, os.path.join(HERE, "e1_compare.py"), "--work", work, "--a", "e1",+ "--b", "e1-two"], capture_output=True, text=True)+ assert cmp.returncode == 0 and "pack 5 of 5; bm25 5 of 5; trunc 5 of 5" in cmp.stdout, cmp.stdout + cmp.stderr+ # --reuse: the pack measured again (index built again), BM25 and truncation taken from run e1 as they are.+ e1 = [sys.executable, os.path.join(HERE, "e1.py")]+ opts = ["--work", work, "--graphicle", a.graphicle, "--tokenizer", a.tokenizer]+ r = subprocess.run(e1 + ["task"] + opts + ["--id", "t1", "--run", "e1-pack", "--reuse", "e1"],+ capture_output=True, text=True)+ assert r.returncode == 0, r.stdout[-2000:] + r.stderr[-2000:]+ rows3 = [json.loads(l) for l in open(os.path.join(work, "out", "e1-pack", "rows", "t1.jsonl"))]+ info3 = json.load(open(os.path.join(work, "out", "e1-pack", "tasks", "t1.json")))+ assert [x for x in rows3 if x["arm"] != "pack"] == [x for x in rows if x["arm"] != "pack"], rows3+ assert [(x["arm"], x["budget"]) for x in rows3] == [(x["arm"], x["budget"]) for x in rows], rows3+ assert sorted(map(key, rows3)) == sorted(map(key, rows)), "the same binary gives the same pack rows"+ assert info3["reused"] == {"run": "e1", "arms": ["bm25", "trunc"], "graphicle": info["graphicle"]}, info3+ assert "manifest_seconds" not in info3 and set(info3["arm_seconds"]) == {"pack"}, info3+ assert info3["tokens_eligible"] == info["tokens_eligible"] and info3["index"]["data_bytes"] > 0, info3+ assert not os.path.exists(os.path.join(work, "runs", "e1-pack", "src", "t1"))+ r = subprocess.run(e1 + ["task"] + opts + ["--id", "t1", "--run", "e1-ctx", "--reuse", "e1", "--contexts"],+ capture_output=True, text=True)+ assert r.returncode != 0 and "--contexts" in r.stderr, r.stdout + r.stderr+ r = subprocess.run(e1 + ["task"] + opts + ["--id", "t1", "--run", "e1-none", "--reuse", "e1-missing"],+ capture_output=True, text=True)+ assert r.returncode != 0 and "has no rows" in r.stderr, r.stdout + r.stderr+ # The run command passes --reuse on and runs only the tasks the earlier run measured.+ r = subprocess.run(e1 + ["run"] + opts + ["--run", "e1-pack2", "--reuse", "e1", "--jobs", "1", "--threads", "2"],+ capture_output=True, text=True)+ assert r.returncode == 0 and "which measured 1 of these 1 tasks" in r.stdout, r.stdout + r.stderr+ rows4 = [json.loads(l) for l in open(os.path.join(work, "out", "e1-pack2", "rows", "t1.jsonl"))]+ assert sorted(map(key, rows4)) == sorted(map(key, rows)), rows4+ cmp = subprocess.run([sys.executable, os.path.join(HERE, "e1_compare.py"), "--work", work, "--a", "e1",+ "--b", "e1-pack"], capture_output=True, text=True)+ assert cmp.returncode == 0 and "pack 5 of 5; bm25 5 of 5; trunc 5 of 5" in cmp.stdout, cmp.stdout + cmp.stderr+ print("test_e1: ok;", {x["arm"]: x["share"] for x in rows if x["budget"] == "16K"},+ "index", info["index"]["wall_seconds"], "s")+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/test_e1l.py b/bench/swe-bench-pro/test_e1l.pynew file mode 100644index 0000000..36b38d2--- /dev/null+++ b/bench/swe-bench-pro/test_e1l.py@@ -0,0 +1,179 @@+#!/usr/bin/env python3+"""Tests of e1l.py: the gold-line rules on hand-made diffs, the pack's text and outline lines, and one task end to+end on a small synthetic repository (no SWE-bench Pro data).++usage: test_e1l.py --graphicle BIN --tokenizer TOKENIZER.json+"""+import argparse+import hashlib+import json+import os+import subprocess+import sys+import tempfile++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, HERE)+import e1l # noqa: E402+++def lines_of(diff):+ return diff.split("\n")+++def test_gold_lines():+ # '-' lines are gold; context and '+' lines are not.+ g, minus, h = e1l.gold_lines(lines_of("@@ -10,5 +10,5 @@\n a\n b\n-c\n+C\n d\n e"))+ assert (g, minus, h) == ([12], {12: "c"}, 1), (g, minus, h)+ # A hunk without '-' lines: the pre-image line just before each run of '+' lines.+ g, _m, _h = e1l.gold_lines(lines_of("@@ -10,6 +10,9 @@\n a\n b\n c\n+x\n+y\n d\n+z\n e\n f"))+ assert g == [12, 13], g+ # A run that opens the file: line 1. A -U0 insertion after line 7 (-7,0): line 7.+ assert e1l.gold_lines(lines_of("@@ -1,2 +1,3 @@\n+x\n a\n b"))[0] == [1]+ assert e1l.gold_lines(lines_of("@@ -7,0 +8,2 @@\n+x\n+y"))[0] == [7]+ assert e1l.gold_lines(lines_of("@@ -0,0 +1 @@\n+x"))[0] == [1]+ # Content that looks like a header, counted by the hunk's lengths; "\ No newline" is skipped.+ g, minus, _h = e1l.gold_lines(lines_of("@@ -1,3 +1,3 @@\n--- old comment\n+++ new comment\n a\n-b\n\\ No newline at end of file\n+B\n\\ No newline at end of file"))+ assert g == [1, 3] and minus == {1: "-- old comment", 3: "b"}, (g, minus)+ # Two hunks; the second starts after the first's lines.+ g, _m, h = e1l.gold_lines(lines_of("@@ -1,2 +1,2 @@\n-a\n+A\n b\n@@ -20,2 +20,3 @@\n x\n+y\n z"))+ assert (g, h) == ([1, 20], 2), (g, h)+++def test_sections():+ patch = ("diff --git a/src/a.py b/src/a.py\nindex 1..2 100644\n--- a/src/a.py\n+++ b/src/a.py\n"+ "@@ -2,2 +2,2 @@\n x\n-y\n+Y\n"+ "diff --git a/old.py b/new.py\nsimilarity index 100%\nrename from old.py\nrename to new.py\n"+ "diff --git a/gone.py b/gone.py\ndeleted file mode 100644\n--- a/gone.py\n+++ /dev/null\n"+ "@@ -1,2 +0,0 @@\n-p\n-q\n"+ "diff --git a/added.py b/added.py\nnew file mode 100644\n--- /dev/null\n+++ b/added.py\n"+ "@@ -0,0 +1 @@\n+n\n")+ secs = {old: (status, e1l.gold_lines(lines)[0]) for old, status, lines in e1l.file_sections(patch)}+ assert secs["src/a.py"] == ("modified", [3]), secs+ assert secs["old.py"] == ("renamed", []), secs+ assert secs["gone.py"] == ("deleted", [1, 2]), secs+ assert secs["added.py"][0] == "added", secs+++def test_pack_view():+ pj = {"sections": [+ {"chunks": [{"path": "a.py", "start_line": 1, "end_line": 9, "whole": True, "why": "focus: rank 1"},+ {"path": "b.py", "start_line": 3, "end_line": 40, "whole": False,+ "why": "x (outline: the first line of each symbol)",+ "text": "### b.py lines 3-40 (outline)\nwhy: x\n```python\n3\tdef f():\n40\tdef g():\n```\n"},+ {"path": "c.py", "start_line": 10, "end_line": 20, "whole": False, "why": "focus: rank 2"},+ {"path": "c.py", "start_line": 21, "end_line": 25, "whole": False, "why": "call paths"},+ {"path": None, "start_line": None, "end_line": None, "whole": False, "why": "map"}]}]}+ v = e1l.pack_view(pj, ["a.py", "b.py", "c.py", "d.py"])+ assert v["a.py"]["whole"] and v["a.py"]["ranges"] == [[1, 9]], v+ assert v["b.py"]["ranges"] == [] and v["b.py"]["outline"] == {3, 40}, v+ assert v["c.py"]["ranges"] == [[10, 25]] and not v["c.py"]["whole"], v+ assert v["d.py"] == {"ranges": [], "outline": set(), "whole": False}, v+ assert e1l.covered(12, v["c.py"]["ranges"]) and not e1l.covered(26, v["c.py"]["ranges"])+++FILES = {+ "src/billing/invoice_total.py": "".join(f"# line {i}\n" for i in range(1, 6)) ++ "def invoice_total(lines):\n return sum(round(l.amount * (1 + l.tax_rate), 2) for l in lines)\n",+ "src/billing/currency.py": "CURRENCIES = {'EUR': 2, 'JPY': 0}\n\ndef minor_units(code):\n return CURRENCIES[code]\n",+ "tests/test_invoice_total.py": "from billing.invoice_total import invoice_total\n\ndef test_empty():\n"+ " assert invoice_total([]) == 0\n",+}+QUESTION = "Invoice total is wrong when the tax rate has three decimals: invoice_total rounds each line."+PATCH = ("diff --git a/src/billing/invoice_total.py b/src/billing/invoice_total.py\n--- a/src/billing/invoice_total.py\n"+ "+++ b/src/billing/invoice_total.py\n@@ -5,3 +5,3 @@\n # line 5\n def invoice_total(lines):\n"+ "- return sum(round(l.amount * (1 + l.tax_rate), 2) for l in lines)\n"+ "+ return round(sum(l.amount * (1 + l.tax_rate) for l in lines), 2)\n")+++def sh(*cmd, cwd=None):+ subprocess.run(cmd, cwd=cwd, check=True, capture_output=True)+++def test_task(graphicle, tokenizer):+ import pyarrow as pa+ import pyarrow.parquet as pq+ with tempfile.TemporaryDirectory() as tmp:+ repo = os.path.join(tmp, "upstream")+ for p, t in FILES.items():+ os.makedirs(os.path.dirname(os.path.join(repo, p)), exist_ok=True)+ with open(os.path.join(repo, p), "w") as f:+ f.write(t)+ sh("git", "init", "-q", cwd=repo)+ sh("git", "add", "-A", cwd=repo)+ sh("git", "-c", "user.name=t", "-c", "user.email=t@t", "commit", "-q", "-m", "base", cwd=repo)+ base = subprocess.run(["git", "rev-parse", "HEAD"], cwd=repo, capture_output=True, text=True).stdout.strip()+ work = os.path.join(tmp, "work")+ os.makedirs(os.path.join(work, "mirror"))+ os.makedirs(os.path.join(work, "texts"))+ sh("git", "clone", "-q", "--bare", repo, os.path.join(work, "mirror", "acme__shop.git"))+ task = {"instance_id": "t1", "repo": "acme/shop", "base_commit": base, "language": "python",+ "gold": ["src/billing/invoice_total.py"], "added": [],+ "text_sha256": hashlib.sha256(QUESTION.encode()).hexdigest(), "names_gold_path": False, "hard": False}+ with open(os.path.join(work, "tasks.jsonl"), "w") as f:+ f.write(json.dumps(task) + "\n")+ with open(os.path.join(work, "texts", "t1.txt"), "w") as f:+ f.write(QUESTION)+ pq.write_table(pa.table({"instance_id": ["t1"], "patch": [PATCH]}), os.path.join(tmp, "d.parquet"))+ e1l_py = os.path.join(HERE, "e1l.py")+ r = subprocess.run([sys.executable, e1l_py, "gold", "--work", work, "--parquet", os.path.join(tmp, "d.parquet")],+ capture_output=True, text=True)+ assert r.returncode == 0 and "1 gold lines" in r.stdout, r.stdout + r.stderr+ g = json.loads(open(os.path.join(work, "e1l", "gold.jsonl")).readline())+ assert g["files"]["src/billing/invoice_total.py"]["lines"] == [7], g+ r = subprocess.run([sys.executable, e1l_py, "task", "--work", work, "--graphicle", graphicle, "--tokenizer",+ tokenizer, "--id", "t1", "--run", "e1l-t"], capture_output=True, text=True)+ assert r.returncode == 0, r.stdout[-2000:] + r.stderr[-2000:]+ rows = [json.loads(l) for l in open(os.path.join(work, "out", "e1l-t", "rows", "t1.jsonl"))]+ info = json.load(open(os.path.join(work, "out", "e1l-t", "tasks", "t1.json")))+ assert info["check"] == {"minus_checked": 1, "minus_mismatch": [], "point_out_of_range": []}, info["check"]+ assert sorted({(x["arm"], x["budget"]) for x in rows}) == sorted(+ (arm, b) for arm in ("pack", "bm25", "trunc") for b in ("16K", "32K", "64K", "128K", "256K")), rows+ for x in rows:+ assert x["gold_lines"] == 1 and x["files_with_lines"] == 1, x+ if x["arm"] in ("bm25", "trunc"):+ assert x["all_lines"] == 1 and x["files"][0]["whole"], x+ else:+ f = x["files"][0]+ assert f["in_context"] and f["text"] and x["all_lines"] == 1 and x["line_share"] == 1.0, x+ assert not os.path.exists(os.path.join(work, "runs", "e1l-t", "src", "t1"))+ # --reuse: the pack measured again, BM25 and truncation rows taken as they are.+ r = subprocess.run([sys.executable, e1l_py, "run", "--work", work, "--graphicle", graphicle, "--tokenizer",+ tokenizer, "--run", "e1l-r", "--reuse", "e1l-t", "--jobs", "1"], capture_output=True,+ text=True)+ assert r.returncode == 0, r.stdout[-2000:] + r.stderr[-2000:]+ again = [json.loads(l) for l in open(os.path.join(work, "out", "e1l-r", "rows", "t1.jsonl"))]+ key = lambda x: (x["arm"], x["budget"]) # noqa: E731+ assert sorted(map(key, again)) == sorted(map(key, rows)), again+ for x, y in zip(sorted(rows, key=key), sorted(again, key=key)):+ if x["arm"] == "pack":+ assert (x["lines_inside"], x["file_inside"]) == (y["lines_inside"], y["file_inside"]), (x, y)+ else:+ assert x == y, (x, y)+ rinfo = json.load(open(os.path.join(work, "out", "e1l-r", "tasks", "t1.json")))+ assert rinfo["reuse"] == "e1l-t" and rinfo["budgets"] == info["budgets"], rinfo+ assert rinfo["check"] == info["check"] and rinfo["sizes"] == info["sizes"], rinfo+ r = subprocess.run([sys.executable, os.path.join(HERE, "e1l_compare.py"), "--work", work, "--base", "e1l-t",+ "--new", "e1l-r", "--json", os.path.join(tmp, "cmp.json")], capture_output=True, text=True)+ assert r.returncode == 0 and "E1L (a): every gold line inside" in r.stdout, r.stdout + r.stderr+ cmp_ = json.load(open(os.path.join(tmp, "cmp.json")))+ assert cmp_["tasks_both"] == 1 and cmp_["budgets"]["64K"]["a"]["change"] == 0.0, cmp_+ r = subprocess.run([sys.executable, os.path.join(HERE, "e1l_report.py"), "--work", work, "--run", "e1l-t",+ "--e1-run", "none"], capture_output=True, text=True)+ assert r.returncode == 0 and "(a) Tasks with every gold line inside" in r.stdout, r.stdout + r.stderr+++def main():+ ap = argparse.ArgumentParser()+ ap.add_argument("--graphicle", required=True)+ ap.add_argument("--tokenizer", required=True)+ a = ap.parse_args()+ test_gold_lines()+ test_sections()+ test_pack_view()+ test_task(a.graphicle, a.tokenizer)+ print("test_e1l: ok")+++if __name__ == "__main__":+ main()diff --git a/bench/swe-bench-pro/test_e2.py b/bench/swe-bench-pro/test_e2.pynew file mode 100644index 0000000..e59ac16--- /dev/null+++ b/bench/swe-bench-pro/test_e2.py@@ -0,0 +1,138 @@+#!/usr/bin/env python3+"""Tests of e2.py on the mock server: no model, no key, no spend.++usage: test_e2.py [-v] (MOCK_HOST as in ../whole-repo/test_runner.py)+Builds a work folder with two synthetic tasks (a bare repository as the mirror, problem statements, the+contexts E1 would save and their records), serves mock_server.py in a thread and runs e2.py per arm.+"""+import hashlib+import json+import os+import shutil+import subprocess+import sys+import tempfile+import threading+import unittest++HERE = os.path.dirname(os.path.abspath(__file__))+WR = os.path.join(HERE, "..", "whole-repo")+sys.path.insert(0, WR)+import mock_server # noqa: E402+from test_runner import make_repo, mock_host, read_jsonl # noqa: E402++FILES = {"pkg/cart/total.go": "package cart\n// Total sums the cart lines with tax.\nfunc Total() {}\n",+ "pkg/cart/tax.go": "package cart\nfunc Tax() {}\n", "pkg/web/routes.go": "package web\nfunc Routes() {}\n"}+++class E2Test(unittest.TestCase):+ @classmethod+ def setUpClass(cls):+ cls.tmp = tempfile.mkdtemp(prefix="e2-test-")+ work = cls.work = os.path.join(cls.tmp, "work")+ sha = make_repo(os.path.join(cls.tmp, "upstream"), FILES)+ os.makedirs(os.path.join(work, "mirror"))+ subprocess.run(["git", "clone", "-q", "--bare", os.path.join(cls.tmp, "upstream"),+ os.path.join(work, "mirror", "acme__cart.git")], check=True)+ tasks, ids = [], []+ for i, (gold, text) in enumerate([("pkg/cart/total.go", "Cart total ignores the tax"),+ ("pkg/web/routes.go", "Routes are registered twice")], 1):+ iid = f"instance_acme__cart-{i}"+ ids.append(iid)+ tasks.append({"instance_id": iid, "repo": "acme/cart", "base_commit": sha, "language": "go", "gold": [gold],+ "added": [], "text_sha256": hashlib.sha256(text.encode()).hexdigest(),+ "names_gold_path": False, "hard": False})+ os.makedirs(os.path.join(work, "texts"), exist_ok=True)+ with open(os.path.join(work, "texts", iid + ".txt"), "w") as f:+ f.write(text)+ ctx_dir = os.path.join(work, "contexts", iid)+ os.makedirs(ctx_dir)+ rec = {}+ for fname in ("pack-64K.xml", "bm25-64K.txt"):+ body = "".join(f'<file path="{p}" lines="1-3">\n{t}</file>\n' for p, t in FILES.items())+ with open(os.path.join(ctx_dir, fname), "w") as f:+ f.write(body)+ rec[fname] = {"sha256": hashlib.sha256(body.encode()).hexdigest(), "tokens": len(body) // 4, "files": 3}+ os.makedirs(os.path.join(work, "out", "e1", "tasks"), exist_ok=True)+ with open(os.path.join(work, "out", "e1", "tasks", iid + ".json"), "w") as f:+ json.dump({"id": iid, "repo": "acme/cart", "contexts": rec}, f)+ # A third task on which E1 failed: no saved contexts, only a .failed record. Every arm leaves it out.+ tasks.append(dict(tasks[0], instance_id="instance_acme__cart-3"))+ ids.append("instance_acme__cart-3")+ with open(os.path.join(work, "out", "e1", "tasks", "instance_acme__cart-3.json.failed"), "w") as f:+ json.dump({"id": "instance_acme__cart-3", "error": "RuntimeError: graphicle pack: ..."}, f)+ with open(os.path.join(work, "tasks.jsonl"), "w") as f:+ f.write("".join(json.dumps(t) + "\n" for t in tasks))+ cls.ids = os.path.join(cls.tmp, "sample.json")+ with open(cls.ids, "w") as f:+ json.dump({"ids": ids}, f)+ cls.record = os.path.join(cls.tmp, "mock-requests.jsonl")+ cls.srv = mock_server.make_server(mock_host(), 0, record=cls.record)+ threading.Thread(target=cls.srv.serve_forever, daemon=True).start()+ cls.url = f"http://{cls.srv.server_address[0]}:{cls.srv.server_address[1]}/v1"+ cls.caps = os.path.join(cls.tmp, "caps.json")+ with open(cls.caps, "w") as f:+ json.dump({"usd": {"mock": 5.0}}, f)+ cls.log = os.path.join(cls.tmp, "spend", "spend-log.jsonl")++ @classmethod+ def tearDownClass(cls):+ cls.srv.shutdown()+ cls.srv.server_close()+ shutil.rmtree(cls.tmp, ignore_errors=True)++ def e2(self, arm, out, *extra, caps=None):+ return subprocess.run([sys.executable, os.path.join(HERE, "e2.py"), "--work", self.work, "--arm", arm,+ "--out", os.path.join(self.tmp, out), "--ids", self.ids, "--profile", "mock",+ "--base-url", self.url, "--model", "mock", "--caps", caps or self.caps,+ "--spend-log", self.log, *extra],+ capture_output=True, text=True, timeout=300, env=dict(os.environ, MODEL_API_KEY="mock-key"))++ def test_1_arms_score_and_log_every_call(self):+ for arm in ("noctx", "bm25", "pack"):+ r = self.e2(arm, "e2-" + arm)+ self.assertEqual(r.returncode, 0, r.stderr[-1500:])+ rows = read_jsonl(os.path.join(self.tmp, "e2-" + arm, "rows.jsonl"))+ self.assertEqual(len(rows), 2)+ self.assertFalse(any(x["error"] for x in rows))+ for x in rows:+ self.assertIn("hit5", x)+ self.assertTrue(x["cache_key"].startswith(f"swepro:{x['id']}:"), x["cache_key"])+ self.assertEqual(x["context_tokens"] > 0, arm != "noctx")+ reqs = read_jsonl(self.record)+ self.assertEqual({q["prompt_cache_retention"] for q in reqs}, {"24h"})+ self.assertEqual({q["reasoning_effort"] for q in reqs}, {"medium"})+ self.assertEqual({q["store"] for q in reqs}, {False})+ log = read_jsonl(self.log)+ self.assertEqual(len(log), 6)+ self.assertTrue(all(x["benchmark"] == "swe-bench-pro e2" and x["status"] == "ok" for x in log))+ r = self.e2("pack", "e2-pack") # a second run skips what is done+ self.assertIn("0 of 3 tasks to do (1 left out", r.stdout)+ meta = json.load(open(os.path.join(self.tmp, "e2-noctx", "run.json")))+ self.assertEqual(meta["left_out_e1_failed"], ["instance_acme__cart-3"], "noctx leaves it out too")++ def test_2_the_cap_refuses_to_start(self):+ caps = os.path.join(self.tmp, "tiny-caps.json")+ with open(caps, "w") as f:+ json.dump({"usd": {"mock": 0.000001}}, f)+ r = self.e2("pack", "e2-refused", caps=caps)+ self.assertNotEqual(r.returncode, 0)+ self.assertIn("REFUSED", r.stderr + r.stdout)++ def test_3_a_changed_context_is_refused(self):+ iid = "instance_acme__cart-1"+ p = os.path.join(self.work, "contexts", iid, "bm25-64K.txt")+ keep = open(p).read()+ try:+ with open(p, "a") as f:+ f.write("changed\n")+ r = self.e2("bm25", "e2-changed")+ self.assertNotEqual(r.returncode, 0)+ self.assertIn("does not match", r.stderr + r.stdout)+ finally:+ with open(p, "w") as f:+ f.write(keep)+++if __name__ == "__main__":+ unittest.main()diff --git a/bench/whole-repo/README.md b/bench/whole-repo/README.mdindex 1486528..8b43a00 100644--- a/bench/whole-repo/README.md+++ b/bench/whole-repo/README.md@@ -4,7 +4,8 @@ A benchmark of finding the files a real fix changed, in eight public repositoriethan a 1M-token context window. It compares Graphicle's `graphicle pack` with truncation of the repository,with the same model searching the repository through tools (the search-only agent), and with no repositorycontext. The method, the questions and the scorer were fixed before any model result was seen. The report is-[docs/benchmarks/whole-repo.md](../../docs/benchmarks/whole-repo.md).+[docs/benchmarks/whole-repo.md](../../docs/benchmarks/whole-repo.md). Line-level recall without a model (`lines.py`),+0.1.9 against the 0.1.10 candidate build: [results-lines.md](results-lines.md).| Role | Repository ||---|---|@@ -45,12 +46,14 @@ checks each against its hash. `questions/funnel.json` counts what each selection| `index.py` | `graphicle sync` of each checkout, with its time and size || `tokens.py` | the token counter shared by every budgeted arm, repository sizes, truncation || `pack_arm.py` | the pack arm's context (`graphicle pack`, in the standard or the cache layout) |-| `agent_tools.py` | the search-only agent's tools: grep, find, list_dir, read |+| `bm25.py` | file-level BM25, the SWE-bench paper's retrieval baseline: whole files in score order up to a budget |+| `agent_tools.py` | the search-only agent's tools: grep, find, list_dir, read (also as one deferred namespace for Meta's tool search) || `run.py` | runs one arm against an OpenAI-compatible API (Meta's Responses API or chat completions), with the cache key, a global spend log and hard spend caps || `mock_server.py` | a mock OpenAI-compatible server (chat completions and responses, with prompt caching per cache key) for testing without a model || `test_runner.py` | end-to-end tests of the runner, the caps, the spend log and the estimate on the mock || `score.py` | hit@k, all-gold@5, MRR, context recall, tokens, cost; McNemar tests and bootstrap intervals || `recall.py` | context recall without a model, for every question and budget |+| `lines.py` | line-level recall without a model: each question's pull request diff placed on S, then the share of the changed lines each context holds (the pack, truncation, BM25), and two builds compared question by question || `estimate.py` | a planned grid's tokens and cost with and without the prompt cache, before any run; the registered grids || `report.py` | the report's data file and page; the chart is `docs/benchmarks/whole_repo_chart.py` || `prices.json` | the model prices used for cost, with their date and source |@@ -75,6 +78,10 @@ python3 run.py --arm pack --budget 128K --work WORK --questions questions --textpython3 run.py --arm trunc --budget 128K ... # and --arm agent, --arm noctx, --arm pack-cachepython3 score.py --runs WORK/runs/* --out WORK/score.jsonpython3 recall.py --work WORK --questions questions --texts WORK/texts --graphicle graphicle --out WORK/recall+python3 lines.py gold --work WORK --questions questions --diffs WORK/diffs --out WORK/gold-lines.jsonl --fetch+python3 lines.py run --work WORK --questions questions --texts WORK/texts --gold WORK/gold-lines.jsonl \+ --graphicle graphicle --data WORK/data --out WORK/lines --tokenizer tokenizer.json --arms pack,trunc+python3 lines.py report --rows WORK/lines/lines-rows.jsonlpython3 report.py --sizes WORK/sizes.json --index-dir WORK/index --score WORK/score.json \--recall WORK/recall/recall-summary.json --json ../../docs/benchmarks/whole-repo.json \--md ../../docs/benchmarks/whole-repo.mddiff --git a/bench/whole-repo/agent_tools.py b/bench/whole-repo/agent_tools.pyindex 7be2419..3a4f9b0 100644--- a/bench/whole-repo/agent_tools.py+++ b/bench/whole-repo/agent_tools.py@@ -39,6 +39,19 @@ def responses_tools():return [{"type": "function", "name": n, "description": d, "parameters": p} for n, d, p in SCHEMAS]+NAMESPACE = "repo"+++def responses_tools_deferred():+ """The same tools for Meta's hosted tool search (https://dev.meta.ai/docs/tool-search.md): one namespace+ whose functions are deferred (their names and descriptions are visible, their schemas load on a search+ and are appended at the end of the context, so the cached prefix of earlier turns stays the same)."""+ return [{"type": "namespace", "name": NAMESPACE,+ "description": "Read-only tools over the repository at the snapshot commit: search, list and read files.",+ "tools": [dict(t, defer_loading=True) for t in responses_tools()]},+ {"type": "tool_search"}]++def cut(line):return line if len(line) <= MAX_LINE else line[:MAX_LINE] + " [cut]"diff --git a/bench/whole-repo/bm25.py b/bench/whole-repo/bm25.pynew file mode 100644index 0000000..77e74ec--- /dev/null+++ b/bench/whole-repo/bm25.py@@ -0,0 +1,207 @@+#!/usr/bin/env python3+"""File-level BM25: the retrieval baseline of the SWE-bench paper, over whole files, filled to a token budget.++The documents are the files truncation may read (tokens.truncation_order: source, test, docs and changelog+files; vendored, generated and binary files left out). A document is the file's path, a newline and its text.++Analyzer: words are maximal runs of [A-Za-z0-9_]. Each word, lowercased and with underscores trimmed at its+ends, is a term; when the word splits into more than one part at underscores and at camelCase and digit+boundaries, each part is a term too (getUserName gives getusername, get, user and name). Terms shorter than+two characters and the 33 English stop words of Lucene's default English analyzer are dropped; no stemming.++Scoring: Okapi BM25 with k1 = 0.9 and b = 0.4 (the Pyserini defaults that the paper's retrieval used) and+Lucene's idf, log(1 + (N - df + 0.5) / (df + 0.5)), summed over the query's terms with their multiplicity.+Files with a positive score are ranked by score, ties by path.++Filling a budget: in rank order, each file goes in whole, wrapped as truncation wraps it, if it still fits;+otherwise the next one is tried (the paper's rule, here over the whole ranking rather than its top 20). The+joined text is then counted again, and files are removed from the end while it passes the budget.++usage: bm25.py rank --work WORKDIR --name NAME --query-file FILE [--top 20]+"""+import argparse+import math+import os+import re+import sys+import threading+from collections import Counter+from functools import lru_cache++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, HERE)+from tokens import load_manifest, read_text, truncation_order, wrap # noqa: E402++K1, B = 0.9, 0.4+STOP = frozenset("a an and are as at be but by for if in into is it no not of on or such that the their then "+ "there these they this to was will with".split())+WORD = re.compile(r"[A-Za-z0-9_]+")+PART = re.compile(r"[A-Z]+(?![a-z])|[A-Z]?[a-z]+|[0-9]+")+++@lru_cache(maxsize=1 << 20)+def terms_of_word(word):+ out = []+ w = word.strip("_").lower()+ if len(w) >= 2 and w not in STOP:+ out.append(w)+ parts = PART.findall(word)+ if len(parts) > 1:+ out += [p.lower() for p in parts if len(p) >= 2 and p.lower() not in STOP]+ return tuple(out)+++def analyze(text):+ """Counter of the text's terms."""+ c = Counter()+ for word, n in Counter(WORD.findall(text)).items():+ for t in terms_of_word(word):+ c[t] += n+ return c+++def rank(query, docs):+ """docs: iterable of (path, text). Returns [(path, score)] for the files with a positive score."""+ q = analyze(query)+ qset = set(q)+ stats, total = [], 0+ for path, text in docs:+ tc = analyze(path + "\n" + text)+ dl = sum(tc.values())+ total += dl+ stats.append((path, dl, {t: tc[t] for t in qset if t in tc}))+ n = len(stats)+ if not n or not q:+ return []+ avgdl = total / n+ df = Counter(t for _p, _dl, tf in stats for t in tf)+ idf = {t: math.log(1 + (n - df[t] + 0.5) / (df[t] + 0.5)) for t in qset}+ scored = []+ for path, dl, tf in stats:+ if not tf:+ continue+ norm = K1 * (1 - B + B * dl / avgdl) if avgdl else K1+ s = sum(q[t] * idf[t] * f * (K1 + 1) / (f + norm) for t, f in tf.items())+ if s > 0:+ scored.append((path, s))+ scored.sort(key=lambda x: (-x[1], x[0]))+ return scored+++class Index:+ """The same scoring as rank() over an inverted index built once, for many questions on one snapshot (the+ whole-repository benchmark asks up to 40 per repository). Scores equal rank()'s up to the order in which+ floating-point terms are added (here: the query's terms in sorted order)."""++ def __init__(self, docs):+ self.paths, self.dl, self.post = [], [], {}+ for path, text in docs:+ i = len(self.paths)+ tc = analyze(path + "\n" + text)+ self.paths.append(path)+ self.dl.append(sum(tc.values()))+ for t, f in tc.items():+ self.post.setdefault(t, []).append((i, f))+ self.n = len(self.paths)+ self.avgdl = sum(self.dl) / self.n if self.n else 0.0++ def rank(self, query):+ q = analyze(query)+ scores = {}+ for t in sorted(q):+ plist = self.post.get(t)+ if not plist:+ continue+ df = len(plist)+ w = q[t] * math.log(1 + (self.n - df + 0.5) / (df + 0.5))+ for i, f in plist:+ norm = K1 * (1 - B + B * self.dl[i] / self.avgdl) if self.avgdl else K1+ scores[i] = scores.get(i, 0.0) + w * f * (K1 + 1) / (f + norm)+ out = [(self.paths[i], s) for i, s in scores.items() if s > 0]+ out.sort(key=lambda x: (-x[1], x[0]))+ return out+++_INDEXES, _LOCK = {}, threading.Lock()+++def eligible(work, name):+ """[(path, tokens of the text plus its wrapper tags)] in truncation's file set, from the manifest."""+ rows, counter_name = load_manifest(work, name)+ return [(p, c + w) for _r, p, c, w in truncation_order(name, rows)], counter_name+++def ranking(work, name, query, reuse=False):+ """(ranked files, {path: tokens}, the manifest's counter). reuse=True keeps an Index of the snapshot in+ memory for later questions on it (one per process, built under a lock)."""+ files, counter_name = eligible(work, name)+ src = os.path.join(work, "src", name)++ def docs():+ for p, _n in files:+ t = read_text(os.path.join(src, p))+ if t is not None:+ yield p, t+ if not reuse:+ return rank(query, docs()), dict(files), counter_name+ key = (os.path.abspath(work), name)+ with _LOCK:+ if key not in _INDEXES:+ _INDEXES[key] = Index(docs())+ return _INDEXES[key].rank(query), dict(files), counter_name+++def fill(ranked, sizes, budget, src, counter, verify=True):+ """(text, included paths, tokens): whole files in rank order, each if it still fits."""+ used, parts, included = 0, [], []+ for p, _s in ranked:+ n = sizes.get(p)+ if n is None or used + n > budget:+ continue+ t = read_text(os.path.join(src, p))+ if t is None:+ continue+ parts.append(wrap(p, t))+ included.append(p)+ used += n+ text = "".join(parts)+ total = counter.count(text) if verify else used+ while total > budget and parts: # joins can tokenize differently from the parts; trim from the end+ parts.pop()+ included.pop()+ text = "".join(parts)+ total = counter.count(text)+ return text, included, total+++def build_bm25(work, name, query, budget, counter, cache=None, reuse=False):+ """The BM25 context of at most `budget` tokens for one question; `cache` (a dict) keeps the ranking+ of (name, query) across budgets; reuse=True ranks with an Index kept for the snapshot's later questions."""+ key = (name, query)+ if cache is not None and key in cache:+ ranked, sizes, counter_name = cache[key]+ else:+ ranked, sizes, counter_name = ranking(work, name, query, reuse=reuse)+ if cache is not None:+ cache[key] = (ranked, sizes, counter_name)+ if counter_name != counter.name:+ raise SystemExit(f"{name}: the manifest was counted with {counter_name}, not {counter.name}")+ return fill(ranked, sizes, budget, os.path.join(work, "src", name), counter)+++def main():+ ap = argparse.ArgumentParser()+ sub = ap.add_subparsers(dest="cmd", required=True)+ r = sub.add_parser("rank")+ r.add_argument("--work", required=True)+ r.add_argument("--name", required=True)+ r.add_argument("--query-file", required=True)+ r.add_argument("--top", type=int, default=20)+ a = ap.parse_args()+ ranked, _sizes, _c = ranking(a.work, a.name, open(a.query_file, encoding="utf-8").read())+ for p, s in ranked[:a.top]:+ print(f"{s:.3f}\t{p}")+++if __name__ == "__main__":+ main()diff --git a/bench/whole-repo/caps.json b/bench/whole-repo/caps.jsonindex c95e1cc..7dc2f3a 100644--- a/bench/whole-repo/caps.json+++ b/bench/whole-repo/caps.json@@ -1,5 +1,5 @@{"unit": "US dollars, at the prices in prices.json","note": "Global spend caps per provider for the benchmark's model answers, summed over every run in the global spend log. A run refuses to start when the logged total plus its own estimate would pass its provider's cap, and stops when a call's worst case would pass it.",- "usd": {"meta": 45.0, "baseten": 100.0}+ "usd": {"meta": 45.0, "meta-contributor": 10.0, "baseten": 100.0}}diff --git a/bench/whole-repo/estimate.py b/bench/whole-repo/estimate.pyindex 60e6c80..e83a92d 100644--- a/bench/whole-repo/estimate.py+++ b/bench/whole-repo/estimate.py@@ -8,7 +8,8 @@ usage: estimate.py --questions DIR [--texts DIR] [--grid GRID] [--model muse-spaGRID is a comma-separated list of ARM[@BUDGET]:REPOS[:N]:ARM noctx, pack, pack-cache (prefix share 0.9), pack-cacheF (prefix share F, such as- pack-cache0.95), pack-stable (prefix share 1.0), trunc or agent+ pack-cache0.95), pack-stable (prefix share 1.0), trunc, bm25, agent or agent-pack (the agent+ with a pack of BUDGET in its first message)REPOS a '+'-joined list of names, or held-out, development or allN the first N questions of each repository, in file order (default: all of them)The default grid is the registered grid G1 (REGISTERED). --registered prints every registered grid,@@ -28,8 +29,9 @@ prefix from the cache:pack-stable the whole pack (only the question after it is new)pack-cache[F] F x B, the pack's question-independent prefixpack --standard-prefix tokens (the standard layout's question-independent head; 0 here)- noctx nothing+ noctx, bm25 nothing (BM25's files depend on the question)agent within one question, each turn's earlier turns+ agent-pack the same, with the seed pack in every turn's earlier turnsThe "cached" columns bill the first question of a group at the input price and every later one atthe cached-input price on the shared prefix; "uncached" is the worst case, with no cache hit at all.Whether a call is served from the cache is up to the API, so both are shown.@@ -46,10 +48,14 @@ HERE = os.path.dirname(os.path.abspath(__file__))sys.path.insert(0, HERE)from run import BUDGETS, PROMPT # noqa: E402-# The pre-registered hosted grids (bench-results PREREG-2026-10-26.md), in their priority order.+# The hosted grids, registered before any model run, in their priority order. On 27 Oct 2026, before any model+# call, G1c replaced G1 (Standard: noctx, trunc@128K, pack@128K, agent): Contributor mode, and the cache layout+# at 128K, BM25 at 128K and the agent seeded with a 32K pack added.REGISTERED = [- ("G1", "Meta, grid C: the 128K arms on the 90 held-out questions", "muse-spark-1.3",- "noctx:held-out,trunc@128K:held-out,pack@128K:held-out,agent:held-out"),+ ("G1c", "Meta, Contributor mode: the 128K arms, BM25, the agent and the agent seeded with a 32K pack, on the "+ "90 held-out questions", "muse-spark-1.3-contributor",+ "noctx:held-out,trunc@128K:held-out,pack@128K:held-out,pack-cache@128K:held-out,bm25@128K:held-out,"+ "agent:held-out,agent-pack@32K:held-out"),("G2", "Meta, the cache-aware pack at 1M on the first 10 held-out questions of each repository","muse-spark-1.3", "pack-cache@1M:held-out:10"),("G3", "Baseten, Muse Spark Open: the 1M answer arms on the held-out questions",@@ -68,7 +74,7 @@ def arm_parts(arm):return "pack", float(m.group("share")) if m.group("share") else 0.9if arm == "pack-stable":return "pack", 1.0- if arm in ("pack", "trunc", "noctx", "agent"):+ if arm in ("pack", "trunc", "noctx", "agent", "bm25", "agent-pack"):return arm, Noneraise SystemExit(f"unknown arm {arm!r}")@@ -95,13 +101,14 @@ def group_tokens(arm, budget, q, base, out_tokens, agent, standard_prefix=0):if q <= 0:return 0, 0, 0, 0kind, _share = arm_parts(arm)- if kind == "agent":- if agent.get("measured"):+ if kind in ("agent", "agent-pack"):+ seed = BUDGETS[budget] if kind == "agent-pack" else 0 # the pack in the first message, sent every turn+ if agent.get("measured") and kind == "agent":m = agent["measured"]return q * m["turns"], q * m["tokens_in"], q * m["tokens_cached"], q * m["tokens_out"]t, tt = agent["turns"], agent["turn_tokens"]- qin = t * base + tt * t * (t + 1) / 2- return q * t, q * qin, q * (qin - base - tt * t), q * t * agent["out_per_turn"]+ qin = t * (base + seed) + tt * t * (t + 1) / 2+ return q * t, q * qin, q * (qin - base - seed - tt * t), q * t * agent["out_per_turn"]if kind == "noctx":return q, q * base, 0, q * out_tokensb = BUDGETS[budget]diff --git a/bench/whole-repo/lines.py b/bench/whole-repo/lines.pynew file mode 100644index 0000000..900290e--- /dev/null+++ b/bench/whole-repo/lines.py@@ -0,0 +1,595 @@+#!/usr/bin/env python3+"""Line-level recall on the whole-repository questions: does the context hold the lines each fix changes?++usage:+ lines.py gold --work WORK --questions DIR --diffs DIR --out FILE [--repos a,b] [--fetch] [--heldout]+ every question's gold lines, from its pull request's diff placed on the snapshot S: DIR/<repo>/<pr>.diff+ (fetched from github.com when missing and --fetch is given), restricted to the question's gold files.+ Each hunk is placed where its pre-image (context and '-' lines) matches the file at S exactly, at the+ offset nearest its header's line (after the previous hunk's offset), as `git apply` places a hunk+ without fuzz; then E1L's rule (e1l.py gold_lines) gives the gold lines on S: every '-' line, and for a+ hunk without '-' lines the line before each run of '+' lines. Every '-' line is checked against S.+ A question with a hunk that does not place, or without its diff, is dropped, with the reason.+ The held-out repositories are refused unless --heldout is given: they are measured, never tuned on.+ lines.py run --work WORK --questions DIR --texts DIR --gold FILE --graphicle BIN --data ROOT --out DIR+ [--tokenizer T] [--budgets 16K,...] [--repos a,b] [--arms pack,trunc,bm25] [--jobs 8]+ [--env NAME=VALUE ...] [--heldout]+ every question at every budget, one row per arm: `graphicle pack` (standard layout, JSON) on the index+ in ROOT/<repo>, truncation (tokens.py's order, whole files) and BM25 (bm25.py, whole files). For each+ gold file: inside at file level (the pack's `included` list, as recall.py counts it), and its gold lines+ inside: for the pack those a text chunk's line range covers (whole files and excerpts; lines shown only+ in an outline are counted apart, never inside), for truncation and BM25 all of them when the file is in.+ --env passes settings to the pack process (development switches of a development build).+ lines.py compare --base FILE --new FILE [--md OUT] [--json OUT] [--arm pack]+ two builds' rows on the same questions: per budget, pooled and per repository, file recall and (a), (b), (c)+ for each build and the change, paired by question, with 95% bootstrap percentile intervals (2,000 resamples+ of questions, seed 1 per cell; (c) resamples questions and pools their files).+ lines.py report --rows FILE [--base FILE] [--md OUT] [--json OUT] [--arm pack]+ per repository and budget, and pooled: file recall (the mean share of gold files inside, recall.py's+ number), and over the questions with gold lines (a) the share with every gold line inside, (b) the mean+ share of gold lines inside, (c) the share of gold files whose gold lines are all inside. With --base,+ each cell's change against the base rows and the keep rule that tuned 0.1.10's pack (keep_rule).+"""+import argparse+import json+import os+import re+import subprocess+import sys+import time+from concurrent.futures import ThreadPoolExecutor++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, HERE)+sys.path.insert(0, os.path.join(HERE, "..", "swe-bench-pro"))+from e1l import HUNK, covered, file_lines, file_sections, gold_lines, pack_view # noqa: E402+from mine import fetch_diff # noqa: E402+from pack_arm import pack_command, run_measured # noqa: E402+from tokens import Counter, load_manifest, truncation_order # noqa: E402++DEV = ["kubernetes", "home-assistant", "angular", "keycloak", "godot"]+HELDOUT = ["pytorch", "vscode", "elasticsearch"]+BUDGETS = {"16K": 16384, "32K": 32768, "64K": 65536, "128K": 131072, "256K": 262144, "512K": 524288,+ "1M": 1015808}+SLUG = {"kubernetes": "kubernetes/kubernetes", "home-assistant": "home-assistant/core", "angular": "angular/angular",+ "keycloak": "keycloak/keycloak", "godot": "godotengine/godot", "pytorch": "pytorch/pytorch",+ "vscode": "microsoft/vscode", "elasticsearch": "elastic/elasticsearch"}+++def allowed(repos, heldout):+ for r in repos:+ if r in HELDOUT and not heldout:+ raise SystemExit(f"{r} is held out: its gold is read only with --heldout, to measure it, never to tune")+ if r not in DEV and r not in HELDOUT:+ raise SystemExit(f"unknown repository {r}")+++def questions(qdir, name):+ return [json.loads(x) for x in open(os.path.join(qdir, f"questions-{name}.jsonl")) if x.strip()]+++def strip_cr(s):+ return s[:-1] if s.endswith("\r") else s+++def place(lines, at_s):+ """The section's lines with each hunk header's old start moved to where its pre-image matches `at_s` (the+ file's lines at S), and the offsets; None and the reason when a hunk does not match anywhere."""+ out, offsets, i, n, shift, floor = [], [], 0, len(lines), 0, 0+ while i < n:+ m = HUNK.match(lines[i])+ if not m:+ out.append(lines[i])+ i += 1+ continue+ a, alen = int(m.group(1)), 1 if m.group(2) is None else int(m.group(2))+ blen = 1 if m.group(4) is None else int(m.group(4))+ j, old_left, new_left, pre = i + 1, alen, blen, []+ while j < n and (old_left > 0 or new_left > 0):+ line = lines[j]+ if line.startswith("\\"):+ j += 1+ continue+ tag = line[:1]+ if tag == " " or line == "":+ pre.append(strip_cr(line[1:]))+ old_left, new_left = old_left - 1, new_left - 1+ elif tag == "-":+ pre.append(strip_cr(line[1:]))+ old_left -= 1+ elif tag == "+":+ new_left -= 1+ else:+ break+ j += 1+ if not pre: # an insertion without context: it stays where its header puts it+ off = shift+ if a + off > len(at_s) or a + off < 0:+ return None, f"insertion point {a} outside the file"+ else:+ want, k, found = a - 1 + shift, len(pre), None+ for d in range(0, len(at_s) + 1):+ for pos in ((want - d, want + d) if d else (want,)):+ if floor <= pos <= len(at_s) - k and at_s[pos:pos + k] == pre:+ found = pos+ break+ if found is not None:+ break+ if found is None:+ return None, f"hunk at line {a} does not match the file at S"+ off = found - (a - 1)+ floor = found + k+ shift = off+ offsets.append(off)+ hdr = lines[i]+ out.append(f"@@ -{a + off},{alen} +{m.group(3)},{blen} @@" + hdr[m.end():])+ out.extend(lines[i + 1:j])+ i = j+ return out, offsets+++def cmd_gold(a):+ repos = a.repos.split(",")+ allowed(repos, a.heldout)+ work = os.path.abspath(a.work)+ counts, rows = {}, []+ for name in repos:+ c = counts.setdefault(name, {"questions": 0, "placed": 0, "dropped": {}, "gold_files": 0, "gold_lines": 0,+ "files_without_lines": 0, "minus_checked": 0, "minus_mismatch": 0,+ "hunks": 0, "hunks_moved": 0})+ src = os.path.join(work, "src", name)+ for q in questions(a.questions, name):+ c["questions"] += 1+ pr = int(q["pr_url"].rstrip("/").rsplit("/", 1)[1])+ d = os.path.join(a.diffs, name)+ os.makedirs(d, exist_ok=True)+ path = os.path.join(d, f"{pr}.diff")+ if not os.path.exists(path) and a.fetch:+ fetch_diff(SLUG[name], pr, path)+ rec = {"id": q["id"], "repo": name, "pr": pr, "files": {}, "drop": None}+ if not os.path.exists(path):+ rec["drop"] = "no diff"+ else:+ text = open(path, encoding="utf-8", errors="replace").read()+ secs = {}+ for old, status, lines in file_sections(text):+ if old in q["gold"] and status != "added":+ secs.setdefault(old, []).append((status, lines))+ for g in q["gold"]:+ at_s, _nb = file_lines(os.path.join(src, g)) if os.path.exists(os.path.join(src, g)) else (None, 0)+ if at_s is None:+ rec["drop"] = f"{g} is not at S"+ break+ if g not in secs:+ rec["drop"] = f"{g} has no section in the diff"+ break+ glines, minus, hunks, offs = set(), {}, 0, []+ for _status, lines in secs[g]:+ placed, info = place(lines, at_s)+ if placed is None:+ rec["drop"] = f"{g}: {info}"+ break+ gl, mt, h = gold_lines(placed)+ glines |= set(gl)+ minus.update(mt)+ hunks += h+ offs += info+ if rec["drop"]:+ break+ mism = [ln for ln, t in minus.items() if ln > len(at_s) or at_s[ln - 1] != strip_cr(t)]+ rec["files"][g] = {"lines": sorted(glines), "hunks": hunks, "offsets": offs,+ "minus": len(minus), "mismatch": mism}+ if rec["drop"]:+ why = ("no diff" if rec["drop"] == "no diff" else "not at S" if "is not at S" in rec["drop"]+ else "no section" if "has no section" in rec["drop"] else "not placed")+ c["dropped"][why] = c["dropped"].get(why, 0) + 1+ rec["files"] = {}+ else:+ c["placed"] += 1+ for f in rec["files"].values():+ c["gold_files"] += 1+ c["gold_lines"] += len(f["lines"])+ c["files_without_lines"] += 0 if f["lines"] else 1+ c["minus_checked"] += f["minus"]+ c["minus_mismatch"] += len(f["mismatch"])+ c["hunks"] += f["hunks"]+ c["hunks_moved"] += sum(1 for o in f["offsets"] if o)+ rows.append(rec)+ with open(a.out, "w") as f:+ for r in rows:+ f.write(json.dumps(r, sort_keys=True) + "\n")+ with open(a.out + ".counts.json", "w") as f:+ json.dump(counts, f, indent=1, sort_keys=True)+ for name, c in counts.items():+ print(f"{name}: {json.dumps(c, sort_keys=True)}")+++def truncation_sets(work, name, budgets):+ rows, counter = load_manifest(work, name)+ order = truncation_order(name, rows)+ out = {}+ for b in budgets:+ used, inc = 0, set()+ for _r, p, c, w in order:+ if used + c + w <= BUDGETS[b]:+ inc.add(p)+ used += c + w+ out[b] = (inc, used)+ return out, counter+++def row_of(q, name, arm, b, per, tokens, nfiles, placed, extra=None):+ """One row: file-level inside (recall.py's recall and all) and, for a placed question, its line metrics."""+ have = [f for f in per if f["n_lines"]]+ total = sum(f["n_lines"] for f in have)+ inside = sum(f["inside_lines"] for f in have)+ nin = sum(1 for f in per if f["in_context"])+ lined = placed and total > 0+ r = {"id": q["id"], "repo": name, "arm": arm, "budget": b, "budget_tokens": BUDGETS[b], "tokens": tokens,+ "files_in_context": nfiles, "gold_n": len(q["gold"]), "file_inside": nin, "recall": nin / len(q["gold"]),+ "all": int(nin == len(q["gold"])), "names_gold_path": q["names_gold_path"], "placed": placed,+ "gold_lines": total if lined else None, "lines_inside": inside if lined else None,+ "line_share": inside / total if lined else None, "all_lines": int(inside == total) if lined else None,+ "files_all_lines": sum(1 for f in have if f["inside_lines"] == f["n_lines"]) if lined else 0,+ "files_with_lines": len(have) if lined else 0, "files": per}+ if extra:+ r.update(extra)+ return r+++def cmd_run(a):+ repos = a.repos.split(",")+ allowed(repos, a.heldout)+ work = os.path.abspath(a.work)+ budgets = a.budgets.split(",")+ arms = a.arms.split(",")+ os.makedirs(a.out, exist_ok=True)+ gold = {r["id"]: r for r in map(json.loads, open(a.gold))}+ env = dict(os.environ, RAYON_NUM_THREADS=os.environ.get("RAYON_NUM_THREADS", "6"))+ for kv in a.env or []:+ k, v = kv.split("=", 1)+ env[k] = v+ out_rows = []+ for name in repos:+ qs = questions(a.questions, name)+ texts = {json.loads(x)["id"]: json.loads(x)["text"] for x in open(os.path.join(a.texts, f"texts-{name}.jsonl"))}++ def gold_of(q):+ g = gold.get(q["id"])+ placed = bool(g and not g["drop"])+ return {p: (g["files"][p]["lines"] if placed else []) for p in q["gold"]}, placed+ if "trunc" in arms:+ tsets, _c = truncation_sets(work, name, budgets)+ for q in qs:+ gl, placed = gold_of(q)+ for b in budgets:+ inc, used = tsets[b]+ per = [{"path": p, "n_lines": len(gl[p]), "inside_lines": len(gl[p]) if p in inc else 0,+ "in_context": p in inc, "whole": p in inc} for p in q["gold"]]+ out_rows.append(row_of(q, name, "trunc", b, per, used, len(inc), placed))+ if "bm25" in arms:+ from bm25 import build_bm25+ counter = Counter(a.tokenizer)+ cache = {}+ for q in qs:+ gl, placed = gold_of(q)+ text = texts[q["id"]]+ for b in budgets:+ _t, inc, used = build_bm25(work, name, text, BUDGETS[b], counter, cache, reuse=True)+ ranked = cache[(name, text)][0]+ rk = {p: i + 1 for i, (p, _s) in enumerate(ranked[:5000])}+ inc = set(inc)+ per = [{"path": p, "n_lines": len(gl[p]), "inside_lines": len(gl[p]) if p in inc else 0,+ "in_context": p in inc, "whole": p in inc, "rank": rk.get(p)}+ for p in q["gold"]]+ out_rows.append(row_of(q, name, "bm25", b, per, used, len(inc), placed))+ cache.clear()+ print(f"{name} bm25: done", flush=True)+ if "pack" in arms:+ data = os.path.join(a.data, name)+ src = os.path.join(work, "src", name)++ def one(job):+ q, b = job+ cmd = pack_command(a.graphicle, src, data, texts[q["id"]], BUDGETS[b], a.tokenizer, "json",+ "standard")+ t0 = time.time()+ for attempt in (1, 2):+ try:+ p = subprocess.run(cmd, capture_output=True, text=True, timeout=1800, env=env)+ except subprocess.TimeoutExpired:+ p = None+ if p is not None and p.returncode == 0:+ return job, json.loads(p.stdout), time.time() - t0+ return job, {"error": (p.stderr.strip()[-300:] if p is not None else "timeout")}, time.time() - t0+ jobs = [(q, b) for q in qs for b in budgets]+ with ThreadPoolExecutor(a.jobs) as ex:+ got = list(ex.map(one, jobs))+ for (q, b), pj, secs in got:+ gl, placed = gold_of(q)+ if pj.get("error"):+ out_rows.append({"id": q["id"], "repo": name, "arm": "pack", "budget": b, "error": pj["error"]})+ continue+ view = pack_view(pj, q["gold"])+ inc = {f["path"]: f for f in pj.get("included") or []}+ om = {f["path"]: f for f in pj.get("omitted") or []}+ per = []+ for p in q["gold"]:+ v = view[p]+ ins = [ln for ln in gl[p] if covered(ln, v["ranges"])]+ f = {"path": p, "n_lines": len(gl[p]), "inside_lines": len(ins),+ "outline_lines": sum(1 for ln in gl[p] if ln in v["outline"] and ln not in ins),+ "in_context": p in inc, "whole": v["whole"], "ranges": v["ranges"], "text": bool(v["ranges"]),+ "outline": bool(v["outline"]), "rank": (inc.get(p) or om.get(p) or {}).get("rank"),+ "pack_tokens": (inc.get(p) or {}).get("tokens"), "omitted_listed": p in om}+ if v["ranges"] and len(ins) < len(gl[p]):+ f["min_dist"] = min(min(abs(ln - s), abs(ln - e)) for ln in gl[p] if ln not in ins+ for s, e in v["ranges"])+ per.append(f)+ out_rows.append(row_of(q, name, "pack", b, per, pj.get("tokens"), len(inc), placed,+ {"seconds": round(secs, 2), "sections": {s.get("name"): s.get("tokens")+ for s in pj.get("sections") or []}}))+ print(f"{name} pack: {len(jobs)} packs, "+ f"{sum(1 for x in got if x[1].get('error'))} errors", flush=True)+ with open(os.path.join(a.out, "lines-rows.jsonl"), "w") as f:+ for r in out_rows:+ f.write(json.dumps(r, sort_keys=True) + "\n")+ print(f"rows: {len(out_rows)}, errors: {sum(1 for r in out_rows if r.get('error'))}")+++def cells(rows, arm):+ """{(repo or 'pooled', budget): metrics} of one arm's rows."""+ out = {}+ for r in rows:+ if r.get("arm") != arm or r.get("error"):+ continue+ for scope in (r["repo"], "pooled"):+ c = out.setdefault((scope, r["budget"]), {"n": 0, "recall": 0.0, "all": 0, "nl": 0, "all_lines": 0,+ "line_share": 0.0, "files_all": 0, "files_lines": 0, "ids": {}})+ c["n"] += 1+ c["recall"] += r["recall"]+ c["all"] += r["all"]+ if r.get("gold_lines"):+ c["nl"] += 1+ c["all_lines"] += r["all_lines"]+ c["line_share"] += r["line_share"]+ c["files_all"] += r["files_all_lines"]+ c["files_lines"] += r["files_with_lines"]+ c["ids"][r["id"]] = (r["recall"], r.get("all_lines"))+ for c in out.values():+ n, nl = c["n"], c["nl"]+ c["recall"] = 100 * c["recall"] / n if n else None+ c["all"] = 100 * c["all"] / n if n else None+ c["a"] = 100 * c["all_lines"] / nl if nl else None+ c["b"] = 100 * c["line_share"] / nl if nl else None+ c["c"] = 100 * c["files_all"] / c["files_lines"] if c["files_lines"] else None+ return out+++def order_budgets(keys):+ return sorted({b for _s, b in keys}, key=lambda b: BUDGETS[b])+++def fmt(x, d=1):+ return "-" if x is None else f"{x:.{d}f}"+++EPS = 1e-9 # a change exactly at a bound meets it (shares are sums of floats)+++def keep_rule(cur, base, budgets):+ """The keep rule that tuned 0.1.10's pack, on the pack arm (cells of cur and base). A change is kept when the+ pooled (a) rises by 0.5 points or more on the mean over the budgets, falls by no more than 1.0 point at any+ budget, pooled file recall falls by no more than 1.0 point at 16K and 32K and 0.5 points from 64K, and no+ repository's file recall falls by more than 2.5 points from 64K. Returns (kept, reasons, mean change)."""+ reasons, ok = [], True+ gain = [cur[("pooled", b)]["a"] - base[("pooled", b)]["a"] for b in budgets]+ mean_gain = sum(gain) / len(gain)+ if mean_gain < 0.5 - EPS:+ ok = False+ reasons.append(f"line (a) mean change {mean_gain:+.2f} < +0.5")+ for b, g in zip(budgets, gain):+ if g < -1.0 - EPS:+ ok = False+ reasons.append(f"line (a) at {b} {g:+.1f} < -1.0")+ for b in budgets:+ d = cur[("pooled", b)]["recall"] - base[("pooled", b)]["recall"]+ tol = 1.0 if b in ("16K", "32K") else 0.5+ if d < -tol - EPS:+ ok = False+ reasons.append(f"file recall pooled at {b} {d:+.2f} < -{tol}")+ for (scope, b), c in cur.items():+ if scope == "pooled" or b in ("16K", "32K"):+ continue+ d = c["recall"] - base[(scope, b)]["recall"]+ if d < -2.5 - EPS:+ ok = False+ reasons.append(f"file recall {scope} at {b} {d:+.2f} < -2.5")+ return ok, reasons, mean_gain+++def cmd_report(a):+ rows = [json.loads(x) for x in open(a.rows)]+ cur = cells(rows, a.arm)+ base = cells([json.loads(x) for x in open(a.base)], a.arm) if a.base else None+ budgets = order_budgets(cur.keys())+ scopes = [s for s in DEV + HELDOUT if any(k[0] == s for k in cur)] + ["pooled"]+ lines = []+ errs = sum(1 for r in rows if r.get("error") and r.get("arm") == a.arm)+ lines.append(f"rows: {a.rows} (arm {a.arm}; errors {errs})" + (f"; base {a.base}" if a.base else ""))+ for metric, title in (("recall", "file recall (mean share of gold files inside)"),+ ("a", "(a) questions with every gold line inside"),+ ("b", "(b) mean share of gold lines inside"),+ ("c", "(c) gold files with all their gold lines inside")):+ lines.append("")+ lines.append(f"**{title}**" + (" (change against the base)" if base else ""))+ lines.append("")+ lines.append("| | " + " | ".join(budgets) + " |")+ lines.append("|---|" + "---|" * len(budgets))+ for s in scopes:+ vals = []+ for b in budgets:+ c = cur.get((s, b))+ v = c[metric] if c else None+ if base and c and (s, b) in base and base[(s, b)][metric] is not None and v is not None:+ vals.append(f"{fmt(v)} ({v - base[(s, b)][metric]:+.1f})")+ else:+ vals.append(fmt(v))+ n = cur.get((s, budgets[0]), {})+ lines.append(f"| {s} (n={n.get('n')}, lines {n.get('nl')}) | " + " | ".join(vals) + " |")+ out = {"rows": a.rows, "base": a.base, "cells": {f"{s}|{b}": {k: v for k, v in c.items() if k != "ids"}+ for (s, b), c in cur.items()}}+ if base:+ kept, reasons, mean_gain = keep_rule(cur, base, budgets)+ moved = {}+ for b in budgets:+ ids = cur[("pooled", b)]["ids"]+ bids = base[("pooled", b)]["ids"]+ up = sum(1 for i, (_r, al) in ids.items() if al == 1 and bids.get(i, (0, None))[1] == 0)+ down = sum(1 for i, (_r, al) in ids.items() if al == 0 and bids.get(i, (0, None))[1] == 1)+ fup = sum(1 for i, (r, _al) in ids.items() if r > bids.get(i, (r, None))[0])+ fdown = sum(1 for i, (r, _al) in ids.items() if r < bids.get(i, (r, None))[0])+ moved[b] = {"lines_up": up, "lines_down": down, "files_up": fup, "files_down": fdown}+ lines.append("")+ lines.append(f"**Keep rule:** {'KEEP' if kept else 'not kept'}; mean (a) change {mean_gain:+.2f}"+ + ("" if kept else "; " + "; ".join(reasons)))+ lines.append("")+ lines.append("Questions that changed (pooled): " + "; ".join(+ f"{b} lines +{m['lines_up']}/-{m['lines_down']}, files +{m['files_up']}/-{m['files_down']}"+ for b, m in moved.items()))+ out.update({"kept": kept, "reasons": reasons, "mean_a_change": mean_gain, "moved": moved})+ text = "\n".join(lines) + "\n"+ print(text)+ if a.md:+ open(a.md, "w").write(text)+ if a.json:+ json.dump(out, open(a.json, "w"), indent=1, sort_keys=True)+++def boot(xs, rng, n=2000):+ if not xs:+ return None+ vals = sorted(sum(xs[rng.randrange(len(xs))] for _ in xs) / len(xs) for _ in range(n))+ return [vals[int(0.025 * n)], vals[min(n - 1, int(0.975 * n))]]+++def boot_ratio(pairs, rng, n=2000):+ """95% interval of sum(x)/sum(d) over resampled questions; pairs (x, d)."""+ if not pairs:+ return None+ vals = []+ for _ in range(n):+ s = [pairs[rng.randrange(len(pairs))] for _ in pairs]+ d = sum(y for _x, y in s)+ vals.append(sum(x for x, _y in s) / d if d else 0.0)+ vals.sort()+ return [vals[int(0.025 * n)], vals[min(n - 1, int(0.975 * n))]]+++def cmd_compare(a):+ import random+ base = {(r["id"], r["budget"]): r for r in map(json.loads, open(a.base))+ if r.get("arm") == a.arm and not r.get("error")}+ new = {(r["id"], r["budget"]): r for r in map(json.loads, open(a.new))+ if r.get("arm") == a.arm and not r.get("error")}+ keys = sorted(set(base) & set(new))+ budgets = sorted({b for _i, b in keys}, key=lambda b: BUDGETS[b])+ repos = [x for x in DEV + HELDOUT if any(new[k]["repo"] == x for k in keys)]+ out, md = {"base": a.base, "new": a.new, "cells": {}}, []+ md.append(f"base {a.base}; new {a.new}; question-budget pairs in both: {len(keys)} (base only "+ f"{len(set(base) - set(new))}, new only {len(set(new) - set(base))})")+ for scope in ["pooled"] + repos:+ for b in budgets:+ ks = [k for k in keys if k[1] == b and (scope == "pooled" or new[k]["repo"] == scope)]+ if not ks:+ continue+ cell = {"n": len(ks)}+ for metric in ("recall", "a", "b"):+ field = {"recall": "recall", "a": "all_lines", "b": "line_share"}[metric]+ ks2 = [k for k in ks if base[k].get(field) is not None and new[k].get(field) is not None]+ xb = [float(base[k][field]) for k in ks2]+ xn = [float(new[k][field]) for k in ks2]+ rng = random.Random(1)+ cell[metric] = {"n": len(ks2), "base": 100 * sum(xb) / len(xb) if xb else None,+ "new": 100 * sum(xn) / len(xn) if xn else None,+ "change": 100 * (sum(xn) - sum(xb)) / len(xb) if xb else None,+ "change_ci": [100 * v for v in boot([y - x for x, y in zip(xb, xn)], rng) or []]}+ ks3 = [k for k in ks if base[k].get("files_with_lines")]+ pb = [(base[k]["files_all_lines"], base[k]["files_with_lines"]) for k in ks3]+ pn = [(new[k]["files_all_lines"], new[k]["files_with_lines"]) for k in ks3]+ tot = sum(d for _x, d in pb)+ rng = random.Random(1)+ cell["c"] = {"n": tot, "base": 100 * sum(x for x, _d in pb) / tot if tot else None,+ "new": 100 * sum(x for x, _d in pn) / tot if tot else None,+ "change": 100 * (sum(x for x, _d in pn) - sum(x for x, _d in pb)) / tot if tot else None,+ "change_ci": [100 * v for v in boot_ratio([(y[0] - x[0], x[1]) for x, y in zip(pb, pn)], rng)+ or []]}+ out["cells"][f"{scope}|{b}"] = cell+ for metric, title in (("recall", "file recall, %"), ("a", "(a) every gold line inside, %"),+ ("b", "(b) mean share of gold lines inside, %"),+ ("c", "(c) gold files with all their gold lines inside, % (pooled)")):+ md += ["", f"**{title}: base / new / change (paired 95% interval)**", "",+ "| | " + " | ".join(budgets) + " |", "|---|" + "---|" * len(budgets)]+ for scope in ["pooled"] + repos:+ vals = []+ for b in budgets:+ c = out["cells"].get(f"{scope}|{b}", {}).get(metric)+ if not c or c["base"] is None:+ vals.append("-")+ continue+ ci_ = c["change_ci"]+ vals.append(f"{c['base']:.1f} / {c['new']:.1f} / {c['change']:+.1f}"+ + (f" ({ci_[0]:+.1f} to {ci_[1]:+.1f})" if ci_ else ""))+ md.append(f"| {scope} | " + " | ".join(vals) + " |")+ text = "\n".join(md) + "\n"+ print(text)+ if a.md:+ open(a.md, "w").write(text)+ if a.json:+ json.dump(out, open(a.json, "w"), indent=1, sort_keys=True)+++def main():+ ap = argparse.ArgumentParser()+ sub = ap.add_subparsers(dest="cmd", required=True)+ g = sub.add_parser("gold")+ g.add_argument("--work", required=True)+ g.add_argument("--questions", required=True)+ g.add_argument("--diffs", required=True)+ g.add_argument("--out", required=True)+ g.add_argument("--repos", default=",".join(DEV))+ g.add_argument("--fetch", action="store_true")+ g.add_argument("--heldout", action="store_true")+ r = sub.add_parser("run")+ r.add_argument("--work", required=True)+ r.add_argument("--questions", required=True)+ r.add_argument("--texts", required=True)+ r.add_argument("--gold", required=True)+ r.add_argument("--graphicle")+ r.add_argument("--data")+ r.add_argument("--out", required=True)+ r.add_argument("--tokenizer")+ r.add_argument("--budgets", default=",".join(BUDGETS))+ r.add_argument("--repos", default=",".join(DEV))+ r.add_argument("--arms", default="pack")+ r.add_argument("--jobs", type=int, default=8)+ r.add_argument("--env", action="append")+ r.add_argument("--heldout", action="store_true")+ c = sub.add_parser("compare")+ c.add_argument("--base", required=True)+ c.add_argument("--new", required=True)+ c.add_argument("--md")+ c.add_argument("--json")+ c.add_argument("--arm", default="pack")+ p = sub.add_parser("report")+ p.add_argument("--rows", required=True)+ p.add_argument("--base")+ p.add_argument("--md")+ p.add_argument("--json")+ p.add_argument("--arm", default="pack")+ a = ap.parse_args()+ {"gold": cmd_gold, "run": cmd_run, "report": cmd_report, "compare": cmd_compare}[a.cmd](a)+++if __name__ == "__main__":+ main()diff --git a/bench/whole-repo/mock_server.py b/bench/whole-repo/mock_server.pyindex 0809e4f..84933a2 100644--- a/bench/whole-repo/mock_server.py+++ b/bench/whole-repo/mock_server.py@@ -23,6 +23,13 @@ counts the stored history as cached. Tokens are estimated as UTF-8 bytes / 4.--record FILE appends one JSON line per request, without any prompt text: the path, model, cachekey, retention, session affinity, output cap, reasoning effort and the usage returned.+Tool search (https://dev.meta.ai/docs/tool-search.md, hosted mode): a {"type": "tool_search"} tool with+functions marked defer_loading (inside a namespace) works as documented: before the first call of a+deferred tool the output holds a tool_search_call and a tool_search_output that loads its namespace, and+the function_call carries the namespace; more than one tool_search, defer_loading without tool_search,+tool_search without a deferred tool, defer_loading on a namespace, a function named tool_search, or a+json_schema text format with tool_search return HTTP 400.+With tools, the mock explores: find, then grep, then two reads of paths it saw, then it answers.Without tools it answers at once. The answer is {"files": [...]}: paths seen in the prompt or in toolresults, ranked by how often words of the issue appear near them. --fail-every N returns HTTP 500@@ -136,7 +143,8 @@ class Handler(BaseHTTPRequestHandler):"max_output_tokens": req.get("max_output_tokens"), "max_tokens": req.get("max_tokens"),"reasoning_effort": (req.get("reasoning") or {}).get("effort") or req.get("reasoning_effort"),"store": req.get("store"), "previous_response_id": bool(req.get("previous_response_id")),- "tools": len(req.get("tools") or []), "usage": usage}+ "tools": len(req.get("tools") or []),+ "tool_types": sorted({t.get("type") for t in req.get("tools") or []}), "usage": usage}with LOCK:with open(self.server.record, "a") as f:f.write(json.dumps(line, sort_keys=True) + "\n")@@ -212,8 +220,26 @@ class Handler(BaseHTTPRequestHandler):return self.api_error(400, "max_output_tokens has a minimum of 16", "max_output_tokens")items = req.get("input")items = [{"type": "message", "role": "user", "content": items}] if isinstance(items, str) else list(items or [])+ tools = req.get("tools") or []+ searches = [t for t in tools if t.get("type") == "tool_search"]+ fns = [(None, t) for t in tools if t.get("type") == "function"] + \+ [(t.get("name"), f) for t in tools if t.get("type") == "namespace" for f in t.get("tools") or []+ if f.get("type") == "function"]+ deferred = [f for _ns, f in fns if f.get("defer_loading")]+ if len(searches) > 1:+ return self.api_error(400, "only one tool_search tool per request", "tools")+ if any(t.get("type") == "namespace" and "defer_loading" in t for t in tools):+ return self.api_error(400, "defer_loading goes on the functions inside a namespace", "tools")+ if deferred and not searches:+ return self.api_error(400, "defer_loading needs a tool_search tool", "tools")+ if searches and not deferred and searches[0].get("execution") != "client":+ return self.api_error(400, "hosted tool_search needs at least one defer_loading tool", "tools")+ if any(f.get("name") == "tool_search" for _ns, f in fns):+ return self.api_error(400, "tool_search is a reserved name", "tools")+ if searches and ((req.get("text") or {}).get("format") or {}).get("type") == "json_schema":+ return self.api_error(400, "tool_search cannot be combined with a json_schema format", "text.format")prev = req.get("previous_response_id")- history, pending = [], set()+ history, pending, loaded = [], set(), set()if prev:with LOCK:st = STATE["responses"].get(prev)@@ -221,6 +247,7 @@ class Handler(BaseHTTPRequestHandler):return self.api_error(400, "unknown previous_response_id", "previous_response_id")history = list(st["history"])pending = set(st["calls"])+ loaded = set(st.get("loaded") or [])own_calls = {i.get("call_id") for i in items if i.get("type") == "function_call"}for i in items:if i.get("type") == "function_call_output":@@ -233,17 +260,31 @@ class Handler(BaseHTTPRequestHandler):issue = next((flatten(i.get("content")) for i in historyif i.get("type", "message") == "message" and i.get("role") == "user"), "")n_tool = sum(1 for i in history if i.get("type") == "function_call_output")- tool_names = [t.get("name") for t in req.get("tools") or [] if t.get("type") == "function"]+ tool_names = [f.get("name") for _ns, f in fns]+ ns_of = {f.get("name"): ns for ns, f in fns}act = next_action(transcript, issue, n_tool, bool(tool_names), rng)rid = "resp_" + uuid.uuid4().hex[:20]reasoning = rng.randint(200, 1200)output = [{"type": "reasoning", "id": "rs_" + uuid.uuid4().hex[:12], "summary": []}]calls = []if act[0] == "tool" and act[1] in tool_names:+ ns = ns_of.get(act[1])+ fdef = next(f for _n, f in fns if f.get("name") == act[1])+ if fdef.get("defer_loading") and ns not in loaded:+ # Hosted search: the API finds and loads the namespace, then the model calls the tool.+ spec = next(t for t in tools if t.get("type") == "namespace" and t.get("name") == ns)+ output.append({"type": "tool_search_call", "id": "ts_" + uuid.uuid4().hex[:12], "call_id": None,+ "execution": "server", "status": "completed", "arguments": {"paths": [ns]}})+ output.append({"type": "tool_search_output", "id": "tso_" + uuid.uuid4().hex[:12], "call_id": None,+ "execution": "server", "status": "completed", "tools": [spec]})+ loaded.add(ns)cid = "call_" + uuid.uuid4().hex[:12]calls.append(cid)- output.append({"type": "function_call", "id": "fc_" + uuid.uuid4().hex[:12], "call_id": cid,- "name": act[1], "arguments": json.dumps(act[2]), "status": "completed"})+ fc = {"type": "function_call", "id": "fc_" + uuid.uuid4().hex[:12], "call_id": cid,+ "name": act[1], "arguments": json.dumps(act[2]), "status": "completed"}+ if ns:+ fc["namespace"] = ns+ output.append(fc)out_text = json.dumps(act[2])else:text = act[1] if act[0] == "answer" else next_action(transcript, issue, 99, False, rng)[1]@@ -254,7 +295,7 @@ class Handler(BaseHTTPRequestHandler):cached = est("\n".join(str(h) for h in history[:-len(items)])) if prev and items else 0cached = max(cached, key_cached(self.cache_key(req), transcript))with LOCK:- STATE["responses"][rid] = {"history": history + output, "calls": calls}+ STATE["responses"][rid] = {"history": history + output, "calls": calls, "loaded": sorted(loaded)}usage = {"input_tokens": prompt, "output_tokens": est(out_text) + reasoning,"total_tokens": prompt + est(out_text) + reasoning,"input_tokens_details": {"cached_tokens": min(cached, prompt)},diff --git a/bench/whole-repo/prices.json b/bench/whole-repo/prices.jsonindex 26ae393..281db41 100644--- a/bench/whole-repo/prices.json+++ b/bench/whole-repo/prices.json@@ -6,9 +6,10 @@"muse-spark-1.3": {"provider": "meta", "input": 1.25, "cached_input": 0.15, "output": 4.25},"muse-wonder-1.0": {"provider": "meta", "input": 4.0, "cached_input": 0.2, "output": 20.0},"muse-spark-1.2": {"provider": "meta", "input": 1.25, "cached_input": 0.15, "output": 4.25},- "muse-spark-1.3-contributor": {"provider": "meta", "input": 0.10, "cached_input": 0.002, "output": 0.20, "note": "Contributor mode: Meta may use the prompts, context and responses to train future models; 150 requests and 3M tokens per minute (same page, read 2026-10-26)"},+ "muse-spark-1.3-contributor": {"provider": "meta-contributor", "input": 0.10, "cached_input": 0.002, "output": 0.20, "note": "Contributor mode: Meta may use the prompts, context and responses to train future models; 150 requests and 3M tokens per minute (same page, read 2026-10-26)"},"meta-models/muse-spark-open": {"provider": "baseten", "input": 1.25, "cached_input": 0.15, "output": 4.25, "note": "Muse Spark Open on Baseten's Model APIs (https://www.baseten.co/pricing)"},"muse-spark-open": {"provider": "local", "input": 0.0, "cached_input": 0.0, "output": 0.0, "note": "our own GPUs: no per-token price"},- "mock": {"provider": "mock", "input": 1.25, "cached_input": 0.15, "output": 4.25, "note": "the mock server, priced like muse-spark-1.3 to test the spend caps"}+ "mock": {"provider": "mock", "input": 1.25, "cached_input": 0.15, "output": 4.25, "note": "the mock server, priced like muse-spark-1.3 to test the spend caps"},+ "mock-wonder": {"provider": "mock", "input": 4.0, "cached_input": 0.2, "output": 20.0, "note": "the mock server, priced like muse-wonder-1.0 to test the cache meter"}}}diff --git a/bench/whole-repo/results-lines.md b/bench/whole-repo/results-lines.mdnew file mode 100644index 0000000..b899585--- /dev/null+++ b/bench/whole-repo/results-lines.md@@ -0,0 +1,231 @@+# Line-level recall without a model: Graphicle 0.1.9 and the 0.1.10 candidate build++**What was counted.** For each question of the whole-repository benchmark and each budget, `lines.py run` builds a context from the repository at the question's snapshot S and records which of the fix's changed lines it holds. No model is involved. A question's gold lines come from its pull request's diff, placed on S hunk by hunk (`lines.py gold`): the lines of S that the fix removes or replaces (its `-` lines) and, for a hunk that only adds lines, the line before each run it adds. Every question's diff placed on S, and every `-` line matched S. A gold line is inside the pack when a whole file or an excerpt covers it with the file's own line numbers; a line shown only in an outline does not count. BM25 and truncation hold whole files. Tokens are counted with the Muse Spark Open tokenizer (Hugging Face revision 4239e4db). Budgets are 16K to 1M tokens (16,384 to 1,015,808; 128K is 131,072).++**Metrics.** File recall: the mean share of a question's gold files inside the pack, whole or as excerpts or outlines (the benchmark's context recall). (a) The share of questions with every gold line inside. (b) The mean share of gold lines inside. (c) The share of gold files with all their gold lines inside, pooled over the questions. Changes are paired by question, with 95% bootstrap intervals (2,000 resamples of questions, seed 1). Made with `lines.py compare` and, for the references, `lines.py report`. The line that starts each comparison and each reference table names the row files it was made from; the row files are not published.++**Builds.** 0.1.9 is the release build. The 0.1.10 candidate is a build of 0.1.10's pack and HTML changes, made before the fixes of its code review. Each build ran on indexes it built itself, on 27 Oct 2026. The final build, a build of 0.1.10's code after those fixes (before its version numbers were set), was measured again on the development questions only, on 28 Oct 2026 (the last table).++**What was tuned on.** The settings of 0.1.10's pack changes were chosen on the 200 development questions (kubernetes, home-assistant, angular, keycloak and godot, 40 each), so their numbers are tuning numbers, not test results. The 90 held-out questions (pytorch, vscode and elasticsearch, 30 each) are never tuned on: the candidate was measured on them once, beside a run of 0.1.9 on the same questions.++## Held-out repositories: 0.1.9 (base) against the 0.1.10 candidate (new)++90 questions; 1,100 gold lines in 131 gold files.++base heldout/0.1.9.jsonl; new heldout/0.1.10-candidate.jsonl; question-budget pairs in both: 630 (base only 0, new only 0)++**file recall, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 54.1 / 55.8 / +1.7 (+0.0 to +4.4) | 56.0 / 56.0 / +0.0 (+0.0 to +0.0) | 58.1 / 58.1 / +0.0 (+0.0 to +0.0) | 64.3 / 64.1 / -0.3 (-0.8 to +0.0) | 64.6 / 64.6 / +0.0 (+0.0 to +0.0) | 70.9 / 69.8 / -1.1 (-3.3 to +0.0) | 77.9 / 77.9 / +0.0 (+0.0 to +0.0) |+| pytorch | 61.4 / 61.4 / +0.0 (+0.0 to +0.0) | 65.8 / 65.8 / +0.0 (+0.0 to +0.0) | 68.1 / 68.1 / +0.0 (+0.0 to +0.0) | 74.2 / 74.2 / +0.0 (+0.0 to +0.0) | 74.2 / 74.2 / +0.0 (+0.0 to +0.0) | 82.5 / 79.2 / -3.3 (-10.0 to +0.0) | 83.3 / 83.3 / +0.0 (+0.0 to +0.0) |+| vscode | 55.6 / 58.9 / +3.3 (+0.0 to +10.0) | 56.7 / 56.7 / +0.0 (+0.0 to +0.0) | 56.7 / 56.7 / +0.0 (+0.0 to +0.0) | 64.2 / 63.3 / -0.8 (-2.5 to +0.0) | 63.3 / 63.3 / +0.0 (+0.0 to +0.0) | 67.5 / 67.5 / +0.0 (+0.0 to +0.0) | 74.2 / 74.2 / +0.0 (+0.0 to +0.0) |+| elasticsearch | 45.5 / 47.2 / +1.7 (+0.0 to +5.0) | 45.5 / 45.5 / +0.0 (+0.0 to +0.0) | 49.7 / 49.7 / +0.0 (+0.0 to +0.0) | 54.7 / 54.7 / +0.0 (+0.0 to +0.0) | 56.3 / 56.3 / +0.0 (+0.0 to +0.0) | 62.8 / 62.8 / +0.0 (+0.0 to +0.0) | 76.2 / 76.2 / +0.0 (+0.0 to +0.0) |++**(a) every gold line inside, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 21.1 / 21.1 / +0.0 (-3.3 to +3.3) | 26.7 / 34.4 / +7.8 (+2.2 to +13.3) | 33.3 / 33.3 / +0.0 (+0.0 to +0.0) | 41.1 / 48.9 / +7.8 (+2.2 to +13.3) | 47.8 / 52.2 / +4.4 (+1.1 to +8.9) | 53.3 / 58.9 / +5.6 (+1.1 to +10.0) | 58.9 / 64.4 / +5.6 (+1.1 to +10.0) |+| pytorch | 26.7 / 26.7 / +0.0 (+0.0 to +0.0) | 33.3 / 36.7 / +3.3 (+0.0 to +10.0) | 40.0 / 40.0 / +0.0 (+0.0 to +0.0) | 50.0 / 53.3 / +3.3 (+0.0 to +10.0) | 50.0 / 53.3 / +3.3 (+0.0 to +10.0) | 56.7 / 63.3 / +6.7 (+0.0 to +16.7) | 56.7 / 63.3 / +6.7 (+0.0 to +16.7) |+| vscode | 30.0 / 26.7 / -3.3 (-10.0 to +0.0) | 30.0 / 43.3 / +13.3 (+3.3 to +26.7) | 33.3 / 33.3 / +0.0 (+0.0 to +0.0) | 40.0 / 53.3 / +13.3 (+3.3 to +26.7) | 53.3 / 60.0 / +6.7 (+0.0 to +16.7) | 60.0 / 66.7 / +6.7 (+0.0 to +16.7) | 63.3 / 70.0 / +6.7 (+0.0 to +16.7) |+| elasticsearch | 6.7 / 10.0 / +3.3 (+0.0 to +10.0) | 16.7 / 23.3 / +6.7 (+0.0 to +16.7) | 26.7 / 26.7 / +0.0 (+0.0 to +0.0) | 33.3 / 40.0 / +6.7 (+0.0 to +16.7) | 40.0 / 43.3 / +3.3 (+0.0 to +10.0) | 43.3 / 46.7 / +3.3 (+0.0 to +10.0) | 56.7 / 60.0 / +3.3 (+0.0 to +10.0) |++**(b) mean share of gold lines inside, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 33.3 / 32.5 / -0.8 (-3.3 to +0.9) | 39.9 / 44.7 / +4.8 (+1.3 to +9.2) | 46.0 / 46.0 / +0.0 (+0.0 to +0.0) | 52.0 / 54.9 / +2.9 (+0.9 to +5.3) | 55.5 / 57.4 / +1.9 (+0.1 to +3.9) | 63.4 / 66.0 / +2.6 (-0.2 to +5.9) | 69.4 / 72.6 / +3.2 (+0.6 to +6.5) |+| pytorch | 43.2 / 43.2 / +0.0 (+0.0 to +0.0) | 49.6 / 52.9 / +3.3 (+0.0 to +10.0) | 54.1 / 54.1 / +0.0 (+0.0 to +0.0) | 62.8 / 63.9 / +1.1 (+0.0 to +3.3) | 63.7 / 64.9 / +1.3 (+0.0 to +3.6) | 74.1 / 77.0 / +2.8 (-3.7 to +11.8) | 75.7 / 80.3 / +4.6 (+0.0 to +12.5) |+| vscode | 36.8 / 33.5 / -3.3 (-10.0 to +0.0) | 41.5 / 48.3 / +6.8 (+0.6 to +16.1) | 47.7 / 47.7 / +0.0 (+0.0 to +0.0) | 51.9 / 56.3 / +4.4 (+0.4 to +9.7) | 56.7 / 60.0 / +3.3 (+0.0 to +8.3) | 63.7 / 67.0 / +3.3 (+0.0 to +8.3) | 67.0 / 70.4 / +3.3 (+0.0 to +8.3) |+| elasticsearch | 19.9 / 20.8 / +0.9 (+0.0 to +2.7) | 28.7 / 32.9 / +4.2 (+0.0 to +13.3) | 36.3 / 36.3 / +0.0 (+0.0 to +0.0) | 41.3 / 44.7 / +3.3 (+0.0 to +8.3) | 46.2 / 47.3 / +1.1 (-1.7 to +5.0) | 52.3 / 53.9 / +1.7 (+0.0 to +5.0) | 65.6 / 67.3 / +1.7 (+0.0 to +5.0) |++**(c) gold files with all their gold lines inside, % (pooled): base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 22.1 / 22.1 / +0.0 (-2.2 to +2.3) | 29.0 / 34.4 / +5.3 (+1.6 to +9.7) | 34.4 / 34.4 / +0.0 (+0.0 to +0.0) | 43.5 / 48.9 / +5.3 (+1.7 to +9.7) | 49.6 / 52.7 / +3.1 (-0.7 to +6.8) | 57.3 / 61.1 / +3.8 (+0.8 to +7.5) | 61.8 / 66.4 / +4.6 (+1.5 to +8.5) |+| pytorch | 26.2 / 26.2 / +0.0 (+0.0 to +0.0) | 31.0 / 33.3 / +2.4 (+0.0 to +8.1) | 38.1 / 38.1 / +0.0 (+0.0 to +0.0) | 47.6 / 50.0 / +2.4 (+0.0 to +8.6) | 47.6 / 52.4 / +4.8 (+0.0 to +12.2) | 57.1 / 61.9 / +4.8 (+0.0 to +12.8) | 59.5 / 66.7 / +7.1 (+0.0 to +15.8) |+| vscode | 29.3 / 26.8 / -2.4 (-8.6 to +0.0) | 36.6 / 46.3 / +9.8 (+2.2 to +20.9) | 39.0 / 39.0 / +0.0 (+0.0 to +0.0) | 43.9 / 53.7 / +9.8 (+2.1 to +20.6) | 53.7 / 58.5 / +4.9 (+0.0 to +12.8) | 61.0 / 65.9 / +4.9 (+0.0 to +12.8) | 63.4 / 68.3 / +4.9 (+0.0 to +12.8) |+| elasticsearch | 12.5 / 14.6 / +2.1 (+0.0 to +7.5) | 20.8 / 25.0 / +4.2 (+0.0 to +11.6) | 27.1 / 27.1 / +0.0 (+0.0 to +0.0) | 39.6 / 43.8 / +4.2 (+0.0 to +11.5) | 47.9 / 47.9 / +0.0 (-5.9 to +6.4) | 54.2 / 56.2 / +2.1 (+0.0 to +7.3) | 62.5 / 64.6 / +2.1 (+0.0 to +7.3) |++### References on the held-out questions: BM25 and truncation++They do not depend on the Graphicle build. BM25 is file-level BM25 (`bm25.py`, whole files in score order); truncation is the repository's files in a fixed order, each if it still fits.++rows: heldout/references.jsonl (arm bm25; errors 0)++**file recall (mean share of gold files inside)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pytorch (n=30, lines 30) | 20.0 | 25.3 | 35.3 | 36.4 | 36.4 | 43.1 | 49.2 |+| vscode (n=30, lines 30) | 26.1 | 40.0 | 36.7 | 38.3 | 45.0 | 51.7 | 60.0 |+| elasticsearch (n=30, lines 30) | 28.2 | 22.5 | 39.0 | 45.5 | 45.5 | 53.0 | 65.5 |+| pooled (n=90, lines 90) | 24.8 | 29.3 | 37.0 | 40.1 | 42.3 | 49.2 | 58.2 |++**(a) questions with every gold line inside**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pytorch (n=30, lines 30) | 20.0 | 23.3 | 33.3 | 33.3 | 33.3 | 40.0 | 43.3 |+| vscode (n=30, lines 30) | 23.3 | 36.7 | 36.7 | 36.7 | 43.3 | 50.0 | 60.0 |+| elasticsearch (n=30, lines 30) | 23.3 | 20.0 | 36.7 | 40.0 | 40.0 | 46.7 | 60.0 |+| pooled (n=90, lines 90) | 22.2 | 26.7 | 35.6 | 36.7 | 38.9 | 45.6 | 54.4 |++**(b) mean share of gold lines inside**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pytorch (n=30, lines 30) | 20.0 | 27.6 | 37.6 | 39.5 | 39.5 | 46.1 | 50.7 |+| vscode (n=30, lines 30) | 26.9 | 41.4 | 36.7 | 39.2 | 45.8 | 52.5 | 60.0 |+| elasticsearch (n=30, lines 30) | 25.6 | 21.0 | 37.6 | 42.9 | 42.9 | 50.3 | 64.0 |+| pooled (n=90, lines 90) | 24.2 | 30.0 | 37.3 | 40.5 | 42.7 | 49.7 | 58.2 |++**(c) gold files with all their gold lines inside**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pytorch (n=30, lines 30) | 19.0 | 26.2 | 33.3 | 35.7 | 35.7 | 40.5 | 50.0 |+| vscode (n=30, lines 30) | 22.0 | 36.6 | 34.1 | 36.6 | 41.5 | 46.3 | 53.7 |+| elasticsearch (n=30, lines 30) | 22.9 | 18.8 | 29.2 | 37.5 | 37.5 | 43.8 | 54.2 |+| pooled (n=90, lines 90) | 21.4 | 26.7 | 32.1 | 36.6 | 38.2 | 43.5 | 52.7 |++rows: heldout/references.jsonl (arm trunc; errors 0)++**file recall (mean share of gold files inside)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pytorch (n=30, lines 30) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |+| vscode (n=30, lines 30) | 0.0 | 3.3 | 3.3 | 3.3 | 3.3 | 3.3 | 6.7 |+| elasticsearch (n=30, lines 30) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |+| pooled (n=90, lines 90) | 0.0 | 1.1 | 1.1 | 1.1 | 1.1 | 1.1 | 2.2 |++**(a) questions with every gold line inside**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pytorch (n=30, lines 30) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |+| vscode (n=30, lines 30) | 0.0 | 3.3 | 3.3 | 3.3 | 3.3 | 3.3 | 6.7 |+| elasticsearch (n=30, lines 30) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |+| pooled (n=90, lines 90) | 0.0 | 1.1 | 1.1 | 1.1 | 1.1 | 1.1 | 2.2 |++**(b) mean share of gold lines inside**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pytorch (n=30, lines 30) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |+| vscode (n=30, lines 30) | 0.0 | 3.3 | 3.3 | 3.3 | 3.3 | 3.3 | 6.7 |+| elasticsearch (n=30, lines 30) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |+| pooled (n=90, lines 90) | 0.0 | 1.1 | 1.1 | 1.1 | 1.1 | 1.1 | 2.2 |++**(c) gold files with all their gold lines inside**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pytorch (n=30, lines 30) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |+| vscode (n=30, lines 30) | 0.0 | 2.4 | 2.4 | 2.4 | 2.4 | 2.4 | 4.9 |+| elasticsearch (n=30, lines 30) | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |+| pooled (n=90, lines 90) | 0.0 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 1.5 |++## Development repositories (the tuning set): 0.1.9 (base) against the 0.1.10 candidate (new)++200 questions; 1,723 gold lines in 305 gold files.++base development/0.1.9.jsonl; new development/0.1.10-candidate.jsonl; question-budget pairs in both: 1400 (base only 0, new only 0)++**file recall, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 71.2 / 71.5 / +0.2 (-0.6 to +1.4) | 75.0 / 74.0 / -1.0 (-2.5 to +0.0) | 83.6 / 83.8 / +0.2 (+0.0 to +0.8) | 87.3 / 87.2 / -0.2 (-0.8 to +0.3) | 87.1 / 87.3 / +0.2 (-0.8 to +1.5) | 89.8 / 89.8 / +0.0 (+0.0 to +0.0) | 91.7 / 91.2 / -0.5 (-1.5 to +0.0) |+| kubernetes | 80.7 / 80.7 / +0.0 (+0.0 to +0.0) | 80.7 / 80.7 / +0.0 (+0.0 to +0.0) | 87.1 / 87.1 / +0.0 (+0.0 to +0.0) | 89.2 / 89.7 / +0.5 (+0.0 to +1.5) | 89.2 / 89.2 / +0.0 (+0.0 to +0.0) | 91.8 / 91.8 / +0.0 (+0.0 to +0.0) | 92.4 / 92.4 / +0.0 (+0.0 to +0.0) |+| home-assistant | 83.3 / 83.3 / +0.0 (+0.0 to +0.0) | 90.8 / 90.8 / +0.0 (+0.0 to +0.0) | 96.7 / 96.7 / +0.0 (+0.0 to +0.0) | 96.7 / 96.7 / +0.0 (+0.0 to +0.0) | 96.7 / 96.7 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) |+| angular | 72.3 / 72.3 / +0.0 (+0.0 to +0.0) | 73.5 / 71.0 / -2.5 (-7.5 to +0.0) | 89.4 / 90.6 / +1.2 (+0.0 to +3.8) | 93.1 / 93.1 / +0.0 (+0.0 to +0.0) | 93.1 / 93.1 / +0.0 (+0.0 to +0.0) | 93.1 / 93.1 / +0.0 (+0.0 to +0.0) | 93.1 / 93.1 / +0.0 (+0.0 to +0.0) |+| keycloak | 77.1 / 78.1 / +1.0 (-3.1 to +7.1) | 84.8 / 84.8 / +0.0 (+0.0 to +0.0) | 92.9 / 92.9 / +0.0 (+0.0 to +0.0) | 94.2 / 94.2 / +0.0 (+0.0 to +0.0) | 94.2 / 94.2 / +0.0 (+0.0 to +0.0) | 95.5 / 95.5 / +0.0 (+0.0 to +0.0) | 95.5 / 95.5 / +0.0 (+0.0 to +0.0) |+| godot | 42.8 / 42.8 / +0.0 (+0.0 to +0.0) | 45.3 / 42.8 / -2.5 (-7.5 to +0.0) | 51.8 / 51.8 / +0.0 (+0.0 to +0.0) | 63.5 / 62.2 / -1.2 (-3.8 to +0.0) | 62.1 / 63.4 / +1.2 (-3.8 to +7.5) | 68.7 / 68.7 / +0.0 (+0.0 to +0.0) | 77.4 / 74.9 / -2.5 (-7.5 to +0.0) |++**(a) every gold line inside, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 32.0 / 36.0 / +4.0 (+1.0 to +7.5) | 48.0 / 51.0 / +3.0 (+0.0 to +6.5) | 57.5 / 57.5 / +0.0 (+0.0 to +0.0) | 70.0 / 72.0 / +2.0 (+0.0 to +4.5) | 76.0 / 77.5 / +1.5 (+0.0 to +3.5) | 79.5 / 81.0 / +1.5 (+0.0 to +3.5) | 81.0 / 82.5 / +1.5 (+0.0 to +3.5) |+| kubernetes | 32.5 / 35.0 / +2.5 (+0.0 to +7.5) | 45.0 / 50.0 / +5.0 (+0.0 to +12.5) | 52.5 / 52.5 / +0.0 (+0.0 to +0.0) | 62.5 / 72.5 / +10.0 (+2.5 to +20.0) | 70.0 / 75.0 / +5.0 (+0.0 to +12.5) | 70.0 / 75.0 / +5.0 (+0.0 to +12.5) | 70.0 / 75.0 / +5.0 (+0.0 to +12.5) |+| home-assistant | 55.0 / 57.5 / +2.5 (-5.0 to +10.0) | 85.0 / 85.0 / +0.0 (+0.0 to +0.0) | 92.5 / 92.5 / +0.0 (+0.0 to +0.0) | 95.0 / 92.5 / -2.5 (-7.5 to +0.0) | 95.0 / 95.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) |+| angular | 32.5 / 40.0 / +7.5 (-2.5 to +20.0) | 45.0 / 57.5 / +12.5 (+0.0 to +25.0) | 65.0 / 65.0 / +0.0 (+0.0 to +0.0) | 77.5 / 80.0 / +2.5 (+0.0 to +7.5) | 87.5 / 87.5 / +0.0 (+0.0 to +0.0) | 87.5 / 87.5 / +0.0 (+0.0 to +0.0) | 87.5 / 87.5 / +0.0 (+0.0 to +0.0) |+| keycloak | 35.0 / 42.5 / +7.5 (+0.0 to +17.5) | 57.5 / 57.5 / +0.0 (+0.0 to +0.0) | 67.5 / 67.5 / +0.0 (+0.0 to +0.0) | 87.5 / 87.5 / +0.0 (+0.0 to +0.0) | 90.0 / 90.0 / +0.0 (+0.0 to +0.0) | 92.5 / 92.5 / +0.0 (+0.0 to +0.0) | 95.0 / 95.0 / +0.0 (+0.0 to +0.0) |+| godot | 5.0 / 5.0 / +0.0 (+0.0 to +0.0) | 7.5 / 5.0 / -2.5 (-7.5 to +0.0) | 10.0 / 10.0 / +0.0 (+0.0 to +0.0) | 27.5 / 27.5 / +0.0 (+0.0 to +0.0) | 37.5 / 40.0 / +2.5 (+0.0 to +7.5) | 47.5 / 50.0 / +2.5 (+0.0 to +7.5) | 52.5 / 55.0 / +2.5 (+0.0 to +7.5) |++**(b) mean share of gold lines inside, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 45.8 / 48.3 / +2.5 (+0.2 to +4.9) | 58.6 / 60.3 / +1.7 (-0.4 to +3.8) | 66.7 / 66.7 / +0.0 (+0.0 to +0.0) | 76.7 / 77.7 / +1.0 (-0.6 to +2.5) | 81.6 / 82.7 / +1.1 (+0.0 to +2.6) | 84.7 / 85.8 / +1.1 (+0.0 to +2.6) | 86.3 / 87.4 / +1.1 (+0.0 to +2.6) |+| kubernetes | 48.1 / 53.7 / +5.6 (+1.1 to +12.3) | 63.7 / 67.8 / +4.1 (+1.4 to +7.8) | 69.6 / 69.6 / +0.0 (+0.0 to +0.0) | 79.0 / 83.3 / +4.3 (-0.1 to +10.8) | 82.8 / 85.7 / +2.9 (+0.0 to +8.7) | 86.2 / 89.1 / +2.9 (+0.0 to +8.7) | 86.6 / 89.5 / +2.9 (+0.0 to +8.7) |+| home-assistant | 68.0 / 69.4 / +1.3 (-5.0 to +7.5) | 87.7 / 88.2 / +0.5 (+0.0 to +1.5) | 93.6 / 93.6 / +0.0 (+0.0 to +0.0) | 96.1 / 93.6 / -2.5 (-7.5 to +0.0) | 97.4 / 97.4 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) |+| angular | 48.2 / 50.4 / +2.2 (-3.6 to +8.1) | 57.7 / 62.6 / +4.9 (-3.8 to +13.0) | 73.8 / 73.8 / +0.0 (+0.0 to +0.0) | 82.7 / 84.9 / +2.2 (+0.0 to +5.5) | 91.0 / 91.0 / +0.0 (+0.0 to +0.0) | 91.0 / 91.0 / +0.0 (+0.0 to +0.0) | 91.0 / 91.0 / +0.0 (+0.0 to +0.0) |+| keycloak | 55.9 / 59.4 / +3.5 (+0.2 to +8.0) | 71.4 / 71.3 / -0.1 (-0.8 to +0.5) | 80.7 / 80.7 / +0.0 (+0.0 to +0.0) | 89.8 / 89.8 / +0.0 (+0.0 to +0.0) | 92.5 / 92.5 / +0.0 (+0.0 to +0.0) | 94.5 / 94.5 / +0.0 (+0.0 to +0.0) | 96.5 / 96.5 / +0.0 (+0.0 to +0.0) |+| godot | 8.5 / 8.5 / +0.0 (+0.0 to +0.0) | 12.6 / 11.7 / -0.8 (-7.5 to +5.0) | 15.9 / 15.9 / +0.0 (+0.0 to +0.0) | 35.9 / 36.7 / +0.8 (+0.0 to +2.5) | 44.4 / 46.9 / +2.5 (+0.0 to +7.5) | 52.0 / 54.5 / +2.5 (+0.0 to +7.5) | 57.3 / 59.8 / +2.5 (+0.0 to +7.5) |++**(c) gold files with all their gold lines inside, % (pooled): base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 34.1 / 39.0 / +4.9 (+2.2 to +7.8) | 48.5 / 53.1 / +4.6 (+1.9 to +7.6) | 59.3 / 59.3 / +0.0 (+0.0 to +0.0) | 69.8 / 72.1 / +2.3 (+0.6 to +4.2) | 77.4 / 78.4 / +1.0 (+0.0 to +2.3) | 81.6 / 82.6 / +1.0 (+0.0 to +2.3) | 83.3 / 84.3 / +1.0 (+0.0 to +2.3) |+| kubernetes | 23.8 / 30.2 / +6.3 (+1.5 to +13.1) | 36.5 / 47.6 / +11.1 (+5.0 to +17.9) | 50.8 / 50.8 / +0.0 (+0.0 to +0.0) | 61.9 / 69.8 / +7.9 (+1.7 to +15.4) | 73.0 / 76.2 / +3.2 (+0.0 to +8.8) | 77.8 / 81.0 / +3.2 (+0.0 to +8.8) | 79.4 / 82.5 / +3.2 (+0.0 to +8.8) |+| home-assistant | 64.1 / 67.2 / +3.1 (-2.6 to +9.3) | 87.5 / 89.1 / +1.6 (+0.0 to +5.3) | 93.8 / 93.8 / +0.0 (+0.0 to +0.0) | 95.3 / 93.8 / -1.6 (-5.6 to +0.0) | 96.9 / 96.9 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) |+| angular | 33.3 / 42.1 / +8.8 (+0.0 to +18.0) | 43.9 / 54.4 / +10.5 (+1.6 to +21.8) | 68.4 / 68.4 / +0.0 (+0.0 to +0.0) | 78.9 / 82.5 / +3.5 (+0.0 to +8.8) | 89.5 / 89.5 / +0.0 (+0.0 to +0.0) | 89.5 / 89.5 / +0.0 (+0.0 to +0.0) | 89.5 / 89.5 / +0.0 (+0.0 to +0.0) |+| keycloak | 41.7 / 48.3 / +6.7 (+1.5 to +13.8) | 60.0 / 60.0 / +0.0 (-4.8 to +4.5) | 68.3 / 68.3 / +0.0 (+0.0 to +0.0) | 83.3 / 83.3 / +0.0 (+0.0 to +0.0) | 86.7 / 86.7 / +0.0 (+0.0 to +0.0) | 90.0 / 90.0 / +0.0 (+0.0 to +0.0) | 91.7 / 91.7 / +0.0 (+0.0 to +0.0) |+| godot | 6.6 / 6.6 / +0.0 (+0.0 to +0.0) | 13.1 / 13.1 / +0.0 (-4.9 to +4.9) | 14.8 / 14.8 / +0.0 (+0.0 to +0.0) | 29.5 / 31.1 / +1.6 (+0.0 to +5.6) | 41.0 / 42.6 / +1.6 (+0.0 to +5.7) | 50.8 / 52.5 / +1.6 (+0.0 to +5.7) | 55.7 / 57.4 / +1.6 (+0.0 to +5.7) |++## Development repositories: the 0.1.10 candidate (base) against the final 0.1.10 build (new)++The only change in these tables is at 256K: the final build's pack of one godot question leaves out a gold file that the candidate's pack held (file recall -0.5 points pooled, -2.5 for godot). Every other change is 0.0.++base development/0.1.10-candidate.jsonl; new development/0.1.10-final.jsonl; question-budget pairs in both: 1400 (base only 0, new only 0)++**file recall, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 71.5 / 71.5 / +0.0 (+0.0 to +0.0) | 74.0 / 74.0 / +0.0 (+0.0 to +0.0) | 83.8 / 83.8 / +0.0 (+0.0 to +0.0) | 87.2 / 87.2 / +0.0 (+0.0 to +0.0) | 87.3 / 86.8 / -0.5 (-1.5 to +0.0) | 89.8 / 89.8 / +0.0 (+0.0 to +0.0) | 91.2 / 91.2 / +0.0 (+0.0 to +0.0) |+| kubernetes | 80.7 / 80.7 / +0.0 (+0.0 to +0.0) | 80.7 / 80.7 / +0.0 (+0.0 to +0.0) | 87.1 / 87.1 / +0.0 (+0.0 to +0.0) | 89.7 / 89.7 / +0.0 (+0.0 to +0.0) | 89.2 / 89.2 / +0.0 (+0.0 to +0.0) | 91.8 / 91.8 / +0.0 (+0.0 to +0.0) | 92.4 / 92.4 / +0.0 (+0.0 to +0.0) |+| home-assistant | 83.3 / 83.3 / +0.0 (+0.0 to +0.0) | 90.8 / 90.8 / +0.0 (+0.0 to +0.0) | 96.7 / 96.7 / +0.0 (+0.0 to +0.0) | 96.7 / 96.7 / +0.0 (+0.0 to +0.0) | 96.7 / 96.7 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) |+| angular | 72.3 / 72.3 / +0.0 (+0.0 to +0.0) | 71.0 / 71.0 / +0.0 (+0.0 to +0.0) | 90.6 / 90.6 / +0.0 (+0.0 to +0.0) | 93.1 / 93.1 / +0.0 (+0.0 to +0.0) | 93.1 / 93.1 / +0.0 (+0.0 to +0.0) | 93.1 / 93.1 / +0.0 (+0.0 to +0.0) | 93.1 / 93.1 / +0.0 (+0.0 to +0.0) |+| keycloak | 78.1 / 78.1 / +0.0 (+0.0 to +0.0) | 84.8 / 84.8 / +0.0 (+0.0 to +0.0) | 92.9 / 92.9 / +0.0 (+0.0 to +0.0) | 94.2 / 94.2 / +0.0 (+0.0 to +0.0) | 94.2 / 94.2 / +0.0 (+0.0 to +0.0) | 95.5 / 95.5 / +0.0 (+0.0 to +0.0) | 95.5 / 95.5 / +0.0 (+0.0 to +0.0) |+| godot | 42.8 / 42.8 / +0.0 (+0.0 to +0.0) | 42.8 / 42.8 / +0.0 (+0.0 to +0.0) | 51.8 / 51.8 / +0.0 (+0.0 to +0.0) | 62.2 / 62.2 / +0.0 (+0.0 to +0.0) | 63.4 / 60.9 / -2.5 (-7.5 to +0.0) | 68.7 / 68.7 / +0.0 (+0.0 to +0.0) | 74.9 / 74.9 / +0.0 (+0.0 to +0.0) |++**(a) every gold line inside, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 36.0 / 36.0 / +0.0 (+0.0 to +0.0) | 51.0 / 51.0 / +0.0 (+0.0 to +0.0) | 57.5 / 57.5 / +0.0 (+0.0 to +0.0) | 72.0 / 72.0 / +0.0 (+0.0 to +0.0) | 77.5 / 77.5 / +0.0 (+0.0 to +0.0) | 81.0 / 81.0 / +0.0 (+0.0 to +0.0) | 82.5 / 82.5 / +0.0 (+0.0 to +0.0) |+| kubernetes | 35.0 / 35.0 / +0.0 (+0.0 to +0.0) | 50.0 / 50.0 / +0.0 (+0.0 to +0.0) | 52.5 / 52.5 / +0.0 (+0.0 to +0.0) | 72.5 / 72.5 / +0.0 (+0.0 to +0.0) | 75.0 / 75.0 / +0.0 (+0.0 to +0.0) | 75.0 / 75.0 / +0.0 (+0.0 to +0.0) | 75.0 / 75.0 / +0.0 (+0.0 to +0.0) |+| home-assistant | 57.5 / 57.5 / +0.0 (+0.0 to +0.0) | 85.0 / 85.0 / +0.0 (+0.0 to +0.0) | 92.5 / 92.5 / +0.0 (+0.0 to +0.0) | 92.5 / 92.5 / +0.0 (+0.0 to +0.0) | 95.0 / 95.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) |+| angular | 40.0 / 40.0 / +0.0 (+0.0 to +0.0) | 57.5 / 57.5 / +0.0 (+0.0 to +0.0) | 65.0 / 65.0 / +0.0 (+0.0 to +0.0) | 80.0 / 80.0 / +0.0 (+0.0 to +0.0) | 87.5 / 87.5 / +0.0 (+0.0 to +0.0) | 87.5 / 87.5 / +0.0 (+0.0 to +0.0) | 87.5 / 87.5 / +0.0 (+0.0 to +0.0) |+| keycloak | 42.5 / 42.5 / +0.0 (+0.0 to +0.0) | 57.5 / 57.5 / +0.0 (+0.0 to +0.0) | 67.5 / 67.5 / +0.0 (+0.0 to +0.0) | 87.5 / 87.5 / +0.0 (+0.0 to +0.0) | 90.0 / 90.0 / +0.0 (+0.0 to +0.0) | 92.5 / 92.5 / +0.0 (+0.0 to +0.0) | 95.0 / 95.0 / +0.0 (+0.0 to +0.0) |+| godot | 5.0 / 5.0 / +0.0 (+0.0 to +0.0) | 5.0 / 5.0 / +0.0 (+0.0 to +0.0) | 10.0 / 10.0 / +0.0 (+0.0 to +0.0) | 27.5 / 27.5 / +0.0 (+0.0 to +0.0) | 40.0 / 40.0 / +0.0 (+0.0 to +0.0) | 50.0 / 50.0 / +0.0 (+0.0 to +0.0) | 55.0 / 55.0 / +0.0 (+0.0 to +0.0) |++**(b) mean share of gold lines inside, %: base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 48.3 / 48.3 / +0.0 (+0.0 to +0.0) | 60.3 / 60.3 / +0.0 (+0.0 to +0.0) | 66.7 / 66.7 / +0.0 (+0.0 to +0.0) | 77.7 / 77.7 / +0.0 (+0.0 to +0.0) | 82.7 / 82.7 / +0.0 (+0.0 to +0.0) | 85.8 / 85.8 / +0.0 (+0.0 to +0.0) | 87.4 / 87.4 / +0.0 (+0.0 to +0.0) |+| kubernetes | 53.7 / 53.7 / +0.0 (+0.0 to +0.0) | 67.8 / 67.8 / +0.0 (+0.0 to +0.0) | 69.6 / 69.6 / +0.0 (+0.0 to +0.0) | 83.3 / 83.3 / +0.0 (+0.0 to +0.0) | 85.7 / 85.7 / +0.0 (+0.0 to +0.0) | 89.1 / 89.1 / +0.0 (+0.0 to +0.0) | 89.5 / 89.5 / +0.0 (+0.0 to +0.0) |+| home-assistant | 69.4 / 69.4 / +0.0 (+0.0 to +0.0) | 88.2 / 88.2 / +0.0 (+0.0 to +0.0) | 93.6 / 93.6 / +0.0 (+0.0 to +0.0) | 93.6 / 93.6 / +0.0 (+0.0 to +0.0) | 97.4 / 97.4 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) |+| angular | 50.4 / 50.4 / +0.0 (+0.0 to +0.0) | 62.6 / 62.6 / +0.0 (+0.0 to +0.0) | 73.8 / 73.8 / +0.0 (+0.0 to +0.0) | 84.9 / 84.9 / +0.0 (+0.0 to +0.0) | 91.0 / 91.0 / +0.0 (+0.0 to +0.0) | 91.0 / 91.0 / +0.0 (+0.0 to +0.0) | 91.0 / 91.0 / +0.0 (+0.0 to +0.0) |+| keycloak | 59.4 / 59.4 / +0.0 (+0.0 to +0.0) | 71.3 / 71.3 / +0.0 (+0.0 to +0.0) | 80.7 / 80.7 / +0.0 (+0.0 to +0.0) | 89.8 / 89.8 / +0.0 (+0.0 to +0.0) | 92.5 / 92.5 / +0.0 (+0.0 to +0.0) | 94.5 / 94.5 / +0.0 (+0.0 to +0.0) | 96.5 / 96.5 / +0.0 (+0.0 to +0.0) |+| godot | 8.5 / 8.5 / +0.0 (+0.0 to +0.0) | 11.7 / 11.7 / +0.0 (+0.0 to +0.0) | 15.9 / 15.9 / +0.0 (+0.0 to +0.0) | 36.7 / 36.7 / +0.0 (+0.0 to +0.0) | 46.9 / 46.9 / +0.0 (+0.0 to +0.0) | 54.5 / 54.5 / +0.0 (+0.0 to +0.0) | 59.8 / 59.8 / +0.0 (+0.0 to +0.0) |++**(c) gold files with all their gold lines inside, % (pooled): base / new / change (paired 95% interval)**++| | 16K | 32K | 64K | 128K | 256K | 512K | 1M |+|---|---|---|---|---|---|---|---|+| pooled | 39.0 / 39.0 / +0.0 (+0.0 to +0.0) | 53.1 / 53.1 / +0.0 (+0.0 to +0.0) | 59.3 / 59.3 / +0.0 (+0.0 to +0.0) | 72.1 / 72.1 / +0.0 (+0.0 to +0.0) | 78.4 / 78.4 / +0.0 (+0.0 to +0.0) | 82.6 / 82.6 / +0.0 (+0.0 to +0.0) | 84.3 / 84.3 / +0.0 (+0.0 to +0.0) |+| kubernetes | 30.2 / 30.2 / +0.0 (+0.0 to +0.0) | 47.6 / 47.6 / +0.0 (+0.0 to +0.0) | 50.8 / 50.8 / +0.0 (+0.0 to +0.0) | 69.8 / 69.8 / +0.0 (+0.0 to +0.0) | 76.2 / 76.2 / +0.0 (+0.0 to +0.0) | 81.0 / 81.0 / +0.0 (+0.0 to +0.0) | 82.5 / 82.5 / +0.0 (+0.0 to +0.0) |+| home-assistant | 67.2 / 67.2 / +0.0 (+0.0 to +0.0) | 89.1 / 89.1 / +0.0 (+0.0 to +0.0) | 93.8 / 93.8 / +0.0 (+0.0 to +0.0) | 93.8 / 93.8 / +0.0 (+0.0 to +0.0) | 96.9 / 96.9 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) | 100.0 / 100.0 / +0.0 (+0.0 to +0.0) |+| angular | 42.1 / 42.1 / +0.0 (+0.0 to +0.0) | 54.4 / 54.4 / +0.0 (+0.0 to +0.0) | 68.4 / 68.4 / +0.0 (+0.0 to +0.0) | 82.5 / 82.5 / +0.0 (+0.0 to +0.0) | 89.5 / 89.5 / +0.0 (+0.0 to +0.0) | 89.5 / 89.5 / +0.0 (+0.0 to +0.0) | 89.5 / 89.5 / +0.0 (+0.0 to +0.0) |+| keycloak | 48.3 / 48.3 / +0.0 (+0.0 to +0.0) | 60.0 / 60.0 / +0.0 (+0.0 to +0.0) | 68.3 / 68.3 / +0.0 (+0.0 to +0.0) | 83.3 / 83.3 / +0.0 (+0.0 to +0.0) | 86.7 / 86.7 / +0.0 (+0.0 to +0.0) | 90.0 / 90.0 / +0.0 (+0.0 to +0.0) | 91.7 / 91.7 / +0.0 (+0.0 to +0.0) |+| godot | 6.6 / 6.6 / +0.0 (+0.0 to +0.0) | 13.1 / 13.1 / +0.0 (+0.0 to +0.0) | 14.8 / 14.8 / +0.0 (+0.0 to +0.0) | 31.1 / 31.1 / +0.0 (+0.0 to +0.0) | 42.6 / 42.6 / +0.0 (+0.0 to +0.0) | 52.5 / 52.5 / +0.0 (+0.0 to +0.0) | 57.4 / 57.4 / +0.0 (+0.0 to +0.0) |diff --git a/bench/whole-repo/run.py b/bench/whole-repo/run.pyindex b397db4..5862eb8 100644--- a/bench/whole-repo/run.py+++ b/bench/whole-repo/run.py@@ -2,7 +2,7 @@"""Run one arm of the whole-repository benchmark against an OpenAI-compatible model API.usage:- run.py --arm noctx|pack|pack-cache|pack-stable|trunc|agent [--budget 128K] --work WORKDIR+ run.py --arm noctx|pack|pack-cache|pack-stable|trunc|bm25|agent|agent-pack [--budget 128K] --work WORKDIR--questions DIR --texts DIR --out DIR [--profile meta|baseten|mock] [--base-url URL][--model MODEL] [--api responses|chat] [--key-file FILE] [--spend-cap 20|auto][--prices prices.json] [--caps caps.json] [--spend-log FILE] [--repos a,b] [--limit N]@@ -26,10 +26,14 @@ Arms (one prompt template for all, see PROMPT: the context first, the question lsuffixpack-stable --layout cache --prefix-share 1.0: the whole pack is the same for every questiontrunc the repository's files in a fixed order up to B (tokens.py build_truncation)+ bm25 file-level BM25 of the issue over truncation's files, whole files in score order up to B+ (bm25.py, the SWE-bench paper's retrieval baseline)agent the same model with grep, find, list_dir and read (agent_tools.py), at most --max-turns- turns, then the same final answer (sooner when its context passes --agent-max-context);+ turns, then the same final answer (sooner when its context passes --agent-max-context, or+ when its turns' input tokens so far plus the next prompt would pass --agent-max-input);with --api responses the turns are chained with previous_response_id, so the model keeps- its reasoning between turns+ its reasoning between turns; --tool-search defers the tools behind Meta's hosted tool search+ agent-pack the agent with a pack of B (the standard layout) in its first messageCaching. Every call carries a cache key made of the repository, its snapshot, the arm, the budgetand the first 12 hex digits of the sha256 of the arm's shared prefix (the pack's prefix_sha256; the@@ -89,6 +93,7 @@ from pack_arm import PACK_ARMS, pack_context # noqa: E402from score import normalize_answer, score_answer # noqa: E402from redact import redact # noqa: E402from tokens import Counter, build_truncation # noqa: E402+from bm25 import build_bm25 # noqa: E402PROMPT_VERSION = "whole-repo-v1"PROMPT = ("{context}Repository {repo} at commit {sha}. Issue: {issue}\n\n"@@ -98,7 +103,9 @@ PROMPT = ("{context}Repository {repo} at commit {sha}. Issue: {issue}\n\n"AGENT_CONTEXT = ("You can explore the repository at that commit with the tools grep, find, list_dir and read, ""in at most {turns} turns. Then give the answer.\n\n")LAST_TURN = "The turn limit is reached. Answer now, with the JSON only."-BUDGETS = {"64K": 65536, "128K": 131072, "256K": 262144, "512K": 524288, "1M": 1015808}+AGENT_ARMS = ("agent", "agent-pack")+BUDGETS = {"16K": 16384, "32K": 32768, "64K": 65536, "128K": 131072, "256K": 262144, "512K": 524288,+ "1M": 1015808}CACHE_RETENTION = "24h"PROFILES = {"meta": {"base_url": "https://api.meta.ai/v1", "api": "responses", "model": "muse-spark-1.3",@@ -327,7 +334,8 @@ class Runner:body = {"model": a.model, "input": items, "store": True, "reasoning": {"effort": a.reasoning_effort},"max_output_tokens": a.max_output_tokens, **fields}if not final_next:- body["tools"] = agent_tools.responses_tools()+ body["tools"] = (agent_tools.responses_tools_deferred() if a.tool_search+ else agent_tools.responses_tools())if prev:body["previous_response_id"] = prevresp, u = self.call(body, last_in + sum(self.counter.count(str(i.get("output", i.get("content", ""))))@@ -347,7 +355,10 @@ class Runner:args = {}items.append({"type": "function_call_output", "call_id": c["call_id"],"output": tools.call(c.get("name"), args)})- if turn == a.max_turns or last_in > a.agent_max_context:+ # The next turn's prompt: this one's context plus the tool results.+ next_in = last_in + sum(self.counter.count(i["output"]) for i in items)+ if turn == a.max_turns or last_in > a.agent_max_context \+ or sum(x["in"] for x in usages) + next_in > a.agent_max_input:items.append(user_message(LAST_TURN))final_next = Trueprev = resp["id"]@@ -375,7 +386,8 @@ class Runner:args = {}msgs.append({"role": "tool", "tool_call_id": c["id"],"content": tools.call(c["function"].get("name"), args)})- if turn == a.max_turns or u["in"] + u["out"] > a.agent_max_context:+ if turn == a.max_turns or u["in"] + u["out"] > a.agent_max_context \+ or sum(x["in"] for x in usages) + self.counter.count(json.dumps(msgs)) > a.agent_max_input:msgs.append({"role": "user", "content": LAST_TURN})final_next = Truereturn "", usages, raws, a.max_turns + 1, ncalls@@ -388,6 +400,16 @@ class Runner:if a.arm == "agent":ctx = AGENT_CONTEXT.format(turns=a.max_turns)return ctx, None, 0, hashlib.sha256(ctx.encode()).hexdigest(), {}+ if a.arm == "bm25":+ # BM25's files depend on the question, so nothing is shared but the instructions.+ t, inc, ntok = build_bm25(a.work, name, text, a.budget_tokens, self.counter, reuse=True)+ return t + "\n\n", inc, ntok, hashlib.sha256(PROMPT.encode()).hexdigest(), {}+ if a.arm == "agent-pack":+ # The hybrid: the agent, with a pack of the budget in its first message (the standard layout).+ p = pack_context(a.graphicle, os.path.join(a.work, "src", name), os.path.join(a.work, "data", name),+ text, a.budget_tokens, a.tokenizer, a.pack_standin)+ ctx = AGENT_CONTEXT.format(turns=a.max_turns)+ return p["text"] + "\n\n" + ctx, p["included"], p["tokens"], hashlib.sha256(ctx.encode()).hexdigest(), {}if a.arm == "trunc":with self.lock:if name not in self.trunc_cache:@@ -432,14 +454,22 @@ class Runner:prompt = PROMPT.format(context=ctx, repo=q["repo"], sha=q["S"], issue=text)tools = self.tools_for(name)info = {"repo": name, "question": q["id"], "cache_key": key}- if a.arm == "agent":+ if a.arm in AGENT_ARMS:answer, usages, raws, turns, ncalls = self.agent(prompt, tools, key, info)- included = tools.read_paths+ if a.arm == "agent-pack":+ # The hybrid's context: its seed pack's files and the files it read.+ seed = set(included or [])+ row["seed_recall"] = sum(1 for g in q["gold"] if g in seed) / len(q["gold"])+ included = list(dict.fromkeys(list(included or []) + tools.read_paths))+ else:+ included = tools.read_paths+ row["tool_search"] = bool(a.tool_search)else:answer, usages, raws, turns, ncalls = self.single(prompt, key, info)files = parse_files(answer)norm = normalize_answer(files, tools.file_set) if files is not None else []row.update(score_answer(norm, q["gold"]))+ row.update({"in_per_call": [u["in"] for u in usages]})row.update({"files": norm, "answer_parsed": files is not None, "context_tokens": ntok,"context_files": len(included) if included is not None else None,"context_recall": (sum(1 for g in q["gold"] if g in set(included)) / len(q["gold"])@@ -449,7 +479,7 @@ class Runner:"tokens_reasoning": sum(u["reasoning"] for u in usages),"cached_per_call": [u["cached"] for u in usages],"cost_usd": sum(u["cost"] for u in usages), "turns": turns, "tool_calls": ncalls,- "prompt_tokens_counted": self.counter.count(prompt) if a.arm != "agent" else None})+ "prompt_tokens_counted": self.counter.count(prompt) if a.arm not in AGENT_ARMS else None})with open(os.path.join(a.out, "raw", q["id"] + ".json"), "w") as f:json.dump({"responses": raws, "included": included, "answer": answer}, f)except CapReached:@@ -482,7 +512,8 @@ def interleave(groups):def main():ap = argparse.ArgumentParser()- ap.add_argument("--arm", required=True, choices=["noctx", "pack", "pack-cache", "pack-stable", "trunc", "agent"])+ ap.add_argument("--arm", required=True, choices=["noctx", "pack", "pack-cache", "pack-stable", "trunc", "bm25",+ "agent", "agent-pack"])ap.add_argument("--budget", default=None, choices=list(BUDGETS))ap.add_argument("--work", required=True)ap.add_argument("--questions", required=True)@@ -508,6 +539,11 @@ def main():ap.add_argument("--max-turns", type=int, default=30)ap.add_argument("--agent-max-context", type=int, default=900000,help="the agent answers at once when a turn's context passes this many tokens")+ ap.add_argument("--agent-max-input", type=int, default=2000000,+ help="the agent answers at once when its turns' input tokens so far plus the next prompt would "+ "pass this many")+ ap.add_argument("--tool-search", action="store_true",+ help="the agent's tools as one deferred namespace with Meta's hosted tool search")ap.add_argument("--tokenizer")ap.add_argument("--graphicle", default="graphicle")ap.add_argument("--prefix-share", type=float, default=PACK_ARMS["pack-cache"][1],@@ -517,15 +553,17 @@ def main():ap.add_argument("--redact", action="store_true",help="strip email addresses and @handles from the issue text first (redact.py)")a = ap.parse_args()- if a.arm in ("pack", "pack-cache", "pack-stable", "trunc") and not a.budget:- raise SystemExit("--budget is needed for the pack and truncation arms")+ if a.arm in ("pack", "pack-cache", "pack-stable", "trunc", "bm25", "agent-pack") and not a.budget:+ raise SystemExit("--budget is needed for the pack, truncation, BM25 and agent-pack arms")+ if a.tool_search and (a.arm not in AGENT_ARMS or (a.api or PROFILES[a.profile]["api"]) != "responses"):+ raise SystemExit("--tool-search goes with the agent arms on the Responses API")if a.pack_standin and a.arm != "pack":raise SystemExit("--pack-standin goes with --arm pack only")prof = PROFILES[a.profile]a.base_url = a.base_url or prof["base_url"]a.model = a.model or prof["model"]a.api = a.api or prof["api"]- a.order = a.order or ("interleaved" if a.arm == "agent" else "grouped")+ a.order = a.order or ("interleaved" if a.arm in AGENT_ARMS else "grouped")if not a.base_url:raise SystemExit(f"--base-url is needed with --profile {a.profile}")a.budget_tokens = BUDGETS[a.budget] if a.budget else None@@ -608,12 +646,16 @@ def main():runner = Runner(a, key, prices, provider, global_cap)graphicle_version = ""- if a.arm.startswith("pack"):+ if a.arm.startswith("pack") or a.arm == "agent-pack":graphicle_version = subprocess.run([a.graphicle, "--version"], capture_output=True, text=True).stdout.strip()+ agentic = a.arm in AGENT_ARMSmeta = {"label": a.label, "arm": a.arm, "budget": a.budget, "budget_tokens": a.budget_tokens, "model": a.model,"api": a.api, "profile": a.profile, "provider": provider, "base_url": a.base_url,"reasoning_effort": a.reasoning_effort, "max_output_tokens": a.max_output_tokens,- "max_turns": a.max_turns if a.arm == "agent" else None, "order": a.order, "jobs": a.jobs,+ "max_turns": a.max_turns if agentic else None,+ "agent_max_context": a.agent_max_context if agentic else None,+ "agent_max_input": a.agent_max_input if agentic else None,+ "tool_search": a.tool_search if agentic else None, "order": a.order, "jobs": a.jobs,"prefix_share": a.prefix_share if a.arm == "pack-cache" else PACK_ARMS.get(a.arm, (None, None))[1],"cache_key": "prompt_cache_key" if PROFILES[a.profile]["cache_key"] else None,"cache_retention": CACHE_RETENTION if PROFILES[a.profile]["cache_key"] and a.api == "responses" else None,diff --git a/bench/whole-repo/score.py b/bench/whole-repo/score.pyindex f85e67a..361529e 100644--- a/bench/whole-repo/score.py+++ b/bench/whole-repo/score.py@@ -89,6 +89,11 @@ def summarize(rows, rng, nboot):out[m + "_ci"] = boot_ci(xs, rng, nboot)out["errors"] = sum(1 for r in rows if r.get("error"))out["cost_usd_total"] = sum(r.get("cost_usd") or 0 for r in rows)+ # Cost per correct answer: the billed dollars over the answers with a gold file in the top 5+ # (and in first place); None when there is none.+ for k in ("hit5", "hit1"):+ n = sum(1 for r in rows if not r.get("error") and r.get(k))+ out[f"cost_per_{k}"] = out["cost_usd_total"] / n if n else Nonereturn out@@ -140,10 +145,13 @@ def main():ks = [k for k in common if scope == "pooled" or ia[k]["repo"] == scope]b = sum(1 for k in ks if ia[k]["hit5"] and not ib[k]["hit5"])c = sum(1 for k in ks if ib[k]["hit5"] and not ia[k]["hit5"])+ b1 = sum(1 for k in ks if ia[k]["hit1"] and not ib[k]["hit1"])+ c1 = sum(1 for k in ks if ib[k]["hit1"] and not ia[k]["hit1"])result["paired"].append({"a": la, "b": lb, "scope": scope, "n": len(ks), "a_only": b, "b_only": c,"hit5_a": mean([ia[k]["hit5"] for k in ks]),"hit5_b": mean([ib[k]["hit5"] for k in ks]),- "mcnemar_p": mcnemar_exact(b, c)})+ "mcnemar_p": mcnemar_exact(b, c),+ "hit1_a_only": b1, "hit1_b_only": c1, "hit1_mcnemar_p": mcnemar_exact(b1, c1)})with open(a.out, "w") as f:json.dump(result, f, indent=1, sort_keys=True)for label in result["runs"]:diff --git a/bench/whole-repo/test_lines.py b/bench/whole-repo/test_lines.pynew file mode 100644index 0000000..cfff59e--- /dev/null+++ b/bench/whole-repo/test_lines.py@@ -0,0 +1,53 @@+#!/usr/bin/env python3+"""lines.py: hunks placed on S, and E1L's gold-line rule on the placed hunks. Run: python3 test_lines.py"""+import os+import sys+import unittest++HERE = os.path.dirname(os.path.abspath(__file__))+sys.path.insert(0, HERE)+import lines # noqa: E402+++def section(body):+ return ["diff --git a/f.py b/f.py", "--- a/f.py", "+++ b/f.py"] + body+++class Place(unittest.TestCase):+ S = [f"line {i}" for i in range(1, 21)]++ def test_a_hunk_written_against_an_older_base_moves_to_its_lines_at_s(self):+ # The pull request's base had three lines fewer above: its header says 4, S has them at 7.+ sec = section(["@@ -4,3 +4,3 @@", " line 7", "-line 8", "+LINE 8", " line 9"])+ placed, offsets = lines.place(sec, self.S)+ self.assertEqual(offsets, [3])+ gold, minus, hunks = lines.gold_lines(placed)+ self.assertEqual((gold, minus, hunks), ([8], {8: "line 8"}, 1))++ def test_an_insertion_without_minus_lines_gives_the_line_before_it(self):+ sec = section(["@@ -10,2 +10,3 @@", " line 12", "+new", " line 13"])+ placed, offsets = lines.place(sec, self.S)+ self.assertEqual(offsets, [2])+ self.assertEqual(lines.gold_lines(placed)[0], [12])++ def test_the_nearest_match_after_the_previous_hunk_wins(self):+ s = ["x", "a", "b", "x", "a", "b", "x"]+ sec = section(["@@ -5,2 +5,2 @@", "-a", "+A", " b"])+ placed, offsets = lines.place(sec, s)+ self.assertEqual(offsets, [0])+ self.assertEqual(lines.gold_lines(placed)[0], [5])++ def test_a_hunk_that_matches_nowhere_is_not_placed(self):+ sec = section(["@@ -4,2 +4,2 @@", " line 4", "-not at S", "+x"])+ placed, why = lines.place(sec, self.S)+ self.assertIsNone(placed)+ self.assertIn("does not match", why)++ def test_carriage_returns_do_not_stop_a_match(self):+ sec = section(["@@ -2,1 +2,1 @@", "-line 2\r", "+LINE 2\r"])+ placed, offsets = lines.place(sec, self.S)+ self.assertEqual((offsets, lines.gold_lines(placed)[0]), ([0], [2]))+++if __name__ == "__main__":+ unittest.main()diff --git a/bench/whole-repo/test_runner.py b/bench/whole-repo/test_runner.pyindex da98a93..c1f82c5 100644--- a/bench/whole-repo/test_runner.py+++ b/bench/whole-repo/test_runner.py@@ -419,6 +419,56 @@ class RunnerTest(unittest.TestCase):self.assertTrue(rows and all(r["redacted"] == {"emails": 0, "handles": 0} for r in rows))self.assertTrue(read_json(os.path.join(self.tmp, "redacted", "run.json"))["redact"])+ def test_g1_bm25_arm_fills_its_budget_with_ranked_files(self):+ self.run_py("bm25", "--arm", "bm25", "--budget", "16K", "--repos", "kubernetes")+ rows = {r["id"]: r for r in self.rows("bm25")}+ self.assertEqual(len(rows), 4)+ self.assertFalse(any(r["error"] for r in rows.values()))+ for r in rows.values():+ self.assertLessEqual(r["context_tokens"], BUDGETS["16K"])+ self.assertEqual(r["context_recall"], 1.0, r["id"]) # the issue names its handler's words+ keys = {x["cache_key"] for x in self.log_lines("bm25")}+ self.assertTrue(all(":bm25@16K:" in k for k in keys), keys)++ def test_g2_agent_pack_hybrid_seeds_the_first_message(self):+ self.run_py("agent-pack", "--arm", "agent-pack", "--budget", "32K", "--repos", "kubernetes", "--max-turns", "3",+ "--graphicle", self.fake)+ rows = self.rows("agent-pack")+ self.assertEqual(len(rows), 4)+ self.assertFalse(any(r["error"] for r in rows), [r["error"] for r in rows])+ for r in rows:+ self.assertIsNotNone(r["seed_recall"])+ self.assertGreaterEqual(r["context_recall"], r["seed_recall"])+ self.assertGreater(r["context_tokens"], 0)+ self.assertLessEqual(r["turns"], 4)+ self.assertEqual(len(r["in_per_call"]), len(r["cached_per_call"]))+ meta = read_json(os.path.join(self.tmp, "agent-pack", "run.json"))+ self.assertEqual((meta["max_turns"], meta["agent_max_input"], meta["tool_search"]), (3, 2000000, False))++ def test_g3_tool_search_loads_the_deferred_tools(self):+ before = len(self.requests())+ self.run_py("tool-search", "--arm", "agent", "--repos", "pytorch", "--max-turns", "4", "--tool-search")+ rows = self.rows("tool-search")+ self.assertEqual(len(rows), 3)+ self.assertFalse(any(r["error"] for r in rows), [r["error"] for r in rows])+ self.assertTrue(all(r["tool_search"] and r["tool_calls"] > 0 for r in rows))+ reqs = [r for r in self.requests()[before:] if r["tools"]]+ self.assertTrue(reqs and all(r["tool_types"] == ["namespace", "tool_search"] for r in reqs))+ raw = read_json(os.path.join(self.tmp, "tool-search", "raw", "pytorch-1.json"))+ types = [o["type"] for resp in raw["responses"] for o in resp["output"]]+ self.assertEqual(types.count("tool_search_call"), 1, "the namespace loads once per question")+ self.assertTrue(all(o.get("namespace") == "repo" for resp in raw["responses"] for o in resp["output"]+ if o["type"] == "function_call"))++ def test_g4_agent_input_cap_ends_the_question(self):+ self.run_py("agent-capped", "--arm", "agent", "--repos", "pytorch", "--max-turns", "30",+ "--agent-max-input", "600")+ rows = self.rows("agent-capped")+ self.assertFalse(any(r["error"] for r in rows))+ # The first turn's input plus the next prompt (its context, its output and the tool result) pass 600.+ self.assertTrue(all(r["turns"] == 2 for r in rows),+ [(r["turns"], r["in_per_call"], r["tokens_out"]) for r in rows])+def test_estimate_caches_the_shared_prefix(self):agent = {"turns": 15, "turn_tokens": 2500, "out_per_turn": 800}b = BUDGETS["64K"]diff --git a/crates/graphicle-graph/Cargo.lock b/crates/graphicle-graph/Cargo.lockindex 5ccc7f4..40b2254 100644--- a/crates/graphicle-graph/Cargo.lock+++ b/crates/graphicle-graph/Cargo.lock@@ -1471,7 +1471,7 @@ checksum = "e4eba85ea1d0a966a983acd07deee566e67395d2d96b6fb39e62b5a833f1eb0b"[[package]]name = "graphicle"-version = "0.1.9"+version = "0.1.10"dependencies = ["aws-config","aws-sdk-bedrockruntime",@@ -1571,7 +1571,7 @@ dependencies = [[[package]]name = "graphicle-graph"-version = "0.1.9"+version = "0.1.10"dependencies = ["graphicle","libmimalloc-sys",diff --git a/crates/graphicle-graph/Cargo.toml b/crates/graphicle-graph/Cargo.tomlindex 491dd76..d6a8e25 100644--- a/crates/graphicle-graph/Cargo.toml+++ b/crates/graphicle-graph/Cargo.toml@@ -1,6 +1,6 @@[package]name = "graphicle"-version = "0.1.9"+version = "0.1.10"edition = "2024"rust-version = "1.94.1"publish = falsediff --git a/crates/graphicle-graph/cli/Cargo.toml b/crates/graphicle-graph/cli/Cargo.tomlindex 9dbe80c..708536e 100644--- a/crates/graphicle-graph/cli/Cargo.toml+++ b/crates/graphicle-graph/cli/Cargo.toml@@ -1,6 +1,6 @@[package]name = "graphicle-graph"-version = "0.1.9"+version = "0.1.10"edition = "2024"rust-version = "1.94.1"publish = falsediff --git a/crates/graphicle-graph/deny.toml b/crates/graphicle-graph/deny.tomlindex d2da461..86ba521 100644--- a/crates/graphicle-graph/deny.toml+++ b/crates/graphicle-graph/deny.toml@@ -82,6 +82,7 @@ ignore = [{ id = "RUSTSEC-2026-0391", reason = "zstd 0.13.3 via jieba-rs -> include-flate: affects the stream with_context constructors, which include-flate never calls (a new decoder per dictionary)" },{ id = "RUSTSEC-2026-0398", reason = "zstd-safe 7.3.0 via jieba-rs -> include-flate: affects Seekable::decompress, which needs the seekable feature; it is off" },{ id = "RUSTSEC-2026-0403", reason = "zstd-safe 7.3.0 via jieba-rs -> include-flate: affects stream::write::Decoder; include-flate reads with stream::read::Decoder, which the advisory lists as not affected" },+ { id = "RUSTSEC-2026-0418", reason = "libz-sys 1.1.29 via flate2: its build script prints the whole build environment only when built with cc 1.6.0 or later; Cargo.lock pins cc 1.4.7. Remove when the lock moves to libz-sys 1.1.31 or later" },{ id = "RUSTSEC-2024-0436", reason = "paste (proc-macro, build time only) via neo4rs -> nav-types -> nalgebra -> simba" },{ id = "RUSTSEC-2026-0192", reason = "ttf-parser via pdf-extract -> lopdf; font tables are parsed only from local PDFs" },{ id = "RUSTSEC-2025-0075", reason = "unic-char-range via rustpython-parser (Python literal parsing); no vulnerability" },diff --git a/crates/graphicle-graph/migration/AUDIT.json b/crates/graphicle-graph/migration/AUDIT.jsonindex 694946f..8058922 100644--- a/crates/graphicle-graph/migration/AUDIT.json+++ b/crates/graphicle-graph/migration/AUDIT.json@@ -1,6 +1,6 @@{"upstream_commit": "92741d162b2094ffc2fed58cfbd8ee823e9da62c",- "updated_utc": "2026-10-25T13:32:37.758903+00:00",+ "updated_utc": "2026-10-28T09:07:45.657443+00:00","archive_files": 1101,"application_files": 96,"currently_verified_application_files": 96,@@ -9,6 +9,6 @@"stale_receipts": [],"complete_port": true,"qualification_manifests": [- "migration/qualification/b4274287ad6bc03f59da0a6fa7ff26a659fcc1edd8f0950bedd53afd7127e86d-954d397ab169.json"+ "migration/qualification/3c13467ca70fc48c1be171ca1aecff2654c0605941665d32ce6602051eb68176-7ef3e9610115.json"]}diff --git a/crates/graphicle-graph/migration/FILES.json b/crates/graphicle-graph/migration/FILES.jsonindex c09661d..1765e08 100644--- a/crates/graphicle-graph/migration/FILES.json+++ b/crates/graphicle-graph/migration/FILES.json@@ -794,7 +794,7 @@"src/error.rs","tests/public_api.rs"],- "checked_utc": "2026-10-25T13:32:37.420565+00:00"+ "checked_utc": "2026-10-28T09:07:45.333307+00:00"},{"path": "graphify/__main__.py",@@ -924,7 +924,7 @@"src/watch_paths.rs","src/watch_reconcile.rs"],- "checked_utc": "2026-10-25T13:32:37.420638+00:00"+ "checked_utc": "2026-10-28T09:07:45.333393+00:00"},{"path": "graphify/_minhash.py",@@ -995,7 +995,7 @@"rust_files": ["src/minhash.rs"],- "checked_utc": "2026-10-25T13:32:37.420682+00:00"+ "checked_utc": "2026-10-28T09:07:45.333446+00:00"},{"path": "graphify/affected.py",@@ -1090,7 +1090,7 @@"src/session.rs","src/graph_node_link.rs"],- "checked_utc": "2026-10-25T13:32:37.420753+00:00"+ "checked_utc": "2026-10-28T09:07:45.333522+00:00"},{"path": "graphify/always_on/agents-md.md",@@ -1272,7 +1272,7 @@"src/graph_algorithms.rs","src/python_compat.rs"],- "checked_utc": "2026-10-25T13:32:37.420793+00:00"+ "checked_utc": "2026-10-28T09:07:45.333564+00:00"},{"path": "graphify/benchmark.py",@@ -1327,7 +1327,7 @@"src/assets/query/stopwords.json","src/assets/query/jieba-py-0.46.12.hmm"],- "checked_utc": "2026-10-25T13:32:37.420827+00:00"+ "checked_utc": "2026-10-28T09:07:45.333605+00:00"},{"path": "graphify/build.py",@@ -1658,7 +1658,7 @@"src/build_labels.rs","src/hyperedge_members.rs"],- "checked_utc": "2026-10-25T13:32:37.420863+00:00"+ "checked_utc": "2026-10-28T09:07:45.333677+00:00"},{"path": "graphify/cache.py",@@ -1965,7 +1965,7 @@"src/cache_paths.rs","src/cache_api.rs"],- "checked_utc": "2026-10-25T13:32:37.420898+00:00"+ "checked_utc": "2026-10-28T09:07:45.333720+00:00"},{"path": "graphify/callflow_html.py",@@ -2357,7 +2357,7 @@"src/callflow_html.rs","src/assets/callflow/templates.json"],- "checked_utc": "2026-10-25T13:32:37.420930+00:00"+ "checked_utc": "2026-10-28T09:07:45.333761+00:00"},{"path": "graphify/cargo_introspect.py",@@ -2401,7 +2401,7 @@"rust_files": ["src/cargo_introspect.rs"],- "checked_utc": "2026-10-25T13:32:37.420963+00:00"+ "checked_utc": "2026-10-28T09:07:45.333800+00:00"},{"path": "graphify/cli.py",@@ -2722,7 +2722,7 @@"src/assets/cli/constants.json","src/assets/cli/help.txt"],- "checked_utc": "2026-10-25T13:32:37.420997+00:00"+ "checked_utc": "2026-10-28T09:07:45.333840+00:00"},{"path": "graphify/cluster.py",@@ -2805,7 +2805,7 @@"rust_files": ["src/cluster.rs"],- "checked_utc": "2026-10-25T13:32:37.421031+00:00"+ "checked_utc": "2026-10-28T09:07:45.333880+00:00"},{"path": "graphify/command-kilo.md",@@ -2888,7 +2888,7 @@"rust_files": ["src/cross_repo_calls.rs"],- "checked_utc": "2026-10-25T13:32:37.421064+00:00"+ "checked_utc": "2026-10-28T09:07:45.333919+00:00"},{"path": "graphify/cross_repo_types.py",@@ -2914,7 +2914,7 @@"rust_files": ["src/cross_repo_types.rs"],- "checked_utc": "2026-10-25T13:32:37.421097+00:00"+ "checked_utc": "2026-10-28T09:07:45.333956+00:00"},{"path": "graphify/csharp_dispatch.py",@@ -2938,7 +2938,7 @@"rust_files": ["src/csharp_dispatch.rs"],- "checked_utc": "2026-10-25T13:32:37.421129+00:00"+ "checked_utc": "2026-10-28T09:07:45.333994+00:00"},{"path": "graphify/dedup.py",@@ -3204,7 +3204,7 @@"src/dedup_strings.rs","src/dedup_api.rs"],- "checked_utc": "2026-10-25T13:32:37.421161+00:00"+ "checked_utc": "2026-10-28T09:07:45.334032+00:00"},{"path": "graphify/detect.py",@@ -3687,7 +3687,7 @@"src/detect_manifest.rs","src/assets/detect/constants.json"],- "checked_utc": "2026-10-25T13:32:37.421193+00:00"+ "checked_utc": "2026-10-28T09:07:45.334073+00:00"},{"path": "graphify/diagnostics.py",@@ -3786,7 +3786,7 @@"src/diagnostics_report.rs","build.rs"],- "checked_utc": "2026-10-25T13:32:37.421227+00:00"+ "checked_utc": "2026-10-28T09:07:45.334112+00:00"},{"path": "graphify/export.py",@@ -3984,7 +3984,7 @@"src/export_api.rs","src/assets/export/digit_ranges.json"],- "checked_utc": "2026-10-25T13:32:37.421260+00:00"+ "checked_utc": "2026-10-28T09:07:45.334151+00:00"},{"path": "graphify/exporters/__init__.py",@@ -3999,7 +3999,7 @@"rust_files": ["src/exporters/mod.rs"],- "checked_utc": "2026-10-25T13:32:37.421292+00:00"+ "checked_utc": "2026-10-28T09:07:45.334191+00:00"},{"path": "graphify/exporters/base.py",@@ -4016,7 +4016,7 @@"rust_files": ["src/exporters/base.rs"],- "checked_utc": "2026-10-25T13:32:37.421323+00:00"+ "checked_utc": "2026-10-28T09:07:45.334231+00:00"},{"path": "graphify/exporters/graphdb.py",@@ -4076,7 +4076,7 @@"src/exporters/graphdb.rs","src/exporters/common.rs"],- "checked_utc": "2026-10-25T13:32:37.421353+00:00"+ "checked_utc": "2026-10-28T09:07:45.334269+00:00"},{"path": "graphify/exporters/html.py",@@ -4145,7 +4145,7 @@"src/assets/export_html/hyperedges.html.template","src/assets/export_html/document.html.template"],- "checked_utc": "2026-10-25T13:32:37.421389+00:00"+ "checked_utc": "2026-10-28T09:07:45.334308+00:00"},{"path": "graphify/extract.py",@@ -5344,7 +5344,7 @@"src/extractors/resolution.rs","src/extractors/parse_cache.rs"],- "checked_utc": "2026-10-25T13:32:37.421454+00:00"+ "checked_utc": "2026-10-28T09:07:45.334383+00:00"},{"path": "graphify/extractors/MIGRATION.md",@@ -5402,7 +5402,7 @@"src/extractors/registry.rs","src/extractors/mod.rs"],- "checked_utc": "2026-10-25T13:32:37.421489+00:00"+ "checked_utc": "2026-10-28T09:07:45.334423+00:00"},{"path": "graphify/extractors/apex.py",@@ -5438,7 +5438,7 @@"rust_files": ["src/extractors/apex.rs"],- "checked_utc": "2026-10-25T13:32:37.421524+00:00"+ "checked_utc": "2026-10-28T09:07:45.334460+00:00"},{"path": "graphify/extractors/base.py",@@ -5496,7 +5496,7 @@"src/extractors/builtins_data.rs","src/path_syntax.rs"],- "checked_utc": "2026-10-25T13:32:37.421557+00:00"+ "checked_utc": "2026-10-28T09:07:45.334500+00:00"},{"path": "graphify/extractors/bash.py",@@ -5592,7 +5592,7 @@"rust_files": ["src/extractors/bash.rs"],- "checked_utc": "2026-10-25T13:32:37.421591+00:00"+ "checked_utc": "2026-10-28T09:07:45.334536+00:00"},{"path": "graphify/extractors/blade.py",@@ -5619,7 +5619,7 @@"src/extractors/blade.rs","src/regex_compat.rs"],- "checked_utc": "2026-10-25T13:32:37.421624+00:00"+ "checked_utc": "2026-10-28T09:07:45.334571+00:00"},{"path": "graphify/extractors/cobol.py",@@ -5671,7 +5671,7 @@"rust_files": ["src/extractors/cobol.rs"],- "checked_utc": "2026-10-25T13:32:37.421657+00:00"+ "checked_utc": "2026-10-28T09:07:45.334606+00:00"},{"path": "graphify/extractors/commonlisp.py",@@ -5789,7 +5789,7 @@"rust_files": ["src/extractors/commonlisp.rs"],- "checked_utc": "2026-10-25T13:32:37.421689+00:00"+ "checked_utc": "2026-10-28T09:07:45.334641+00:00"},{"path": "graphify/extractors/csharp.py",@@ -5943,7 +5943,7 @@"src/html_compat.rs","src/html_entities.json"],- "checked_utc": "2026-10-25T13:32:37.421722+00:00"+ "checked_utc": "2026-10-28T09:07:45.334676+00:00"},{"path": "graphify/extractors/dart.py",@@ -5999,7 +5999,7 @@"rust_files": ["src/extractors/dart.rs"],- "checked_utc": "2026-10-25T13:32:37.421755+00:00"+ "checked_utc": "2026-10-28T09:07:45.334713+00:00"},{"path": "graphify/extractors/dm.py",@@ -6105,7 +6105,7 @@"rust_files": ["src/extractors/dm.rs"],- "checked_utc": "2026-10-25T13:32:37.421789+00:00"+ "checked_utc": "2026-10-28T09:07:45.334748+00:00"},{"path": "graphify/extractors/elixir.py",@@ -6199,7 +6199,7 @@"rust_files": ["src/extractors/elixir.rs"],- "checked_utc": "2026-10-25T13:32:37.421820+00:00"+ "checked_utc": "2026-10-28T09:07:45.334784+00:00"},{"path": "graphify/extractors/engine.py",@@ -7324,7 +7324,7 @@"src/assets/engine/sets.json","src/assets/engine/configs.json"],- "checked_utc": "2026-10-25T13:32:37.421855+00:00"+ "checked_utc": "2026-10-28T09:07:45.334823+00:00"},{"path": "graphify/extractors/erlang.py",@@ -7378,7 +7378,7 @@"src/extractors/erlang.rs","vendor/tree-sitter-erlang/SOURCE.json"],- "checked_utc": "2026-10-25T13:32:37.421891+00:00"+ "checked_utc": "2026-10-28T09:07:45.334861+00:00"},{"path": "graphify/extractors/fortran.py",@@ -7459,7 +7459,7 @@"src/extractors/fortran.rs","src/process.rs"],- "checked_utc": "2026-10-25T13:32:37.421926+00:00"+ "checked_utc": "2026-10-28T09:07:45.334898+00:00"},{"path": "graphify/extractors/go.py",@@ -7577,7 +7577,7 @@"rust_files": ["src/extractors/go.rs"],- "checked_utc": "2026-10-25T13:32:37.421960+00:00"+ "checked_utc": "2026-10-28T09:07:45.334934+00:00"},{"path": "graphify/extractors/json_config.py",@@ -7635,7 +7635,7 @@"rust_files": ["src/extractors/json_config.rs"],- "checked_utc": "2026-10-25T13:32:37.421995+00:00"+ "checked_utc": "2026-10-28T09:07:45.334970+00:00"},{"path": "graphify/extractors/julia.py",@@ -7739,7 +7739,7 @@"src/extractors/julia.rs","src/extractors/engine_semantics.rs"],- "checked_utc": "2026-10-25T13:32:37.422030+00:00"+ "checked_utc": "2026-10-28T09:07:45.335007+00:00"},{"path": "graphify/extractors/markdown.py",@@ -7843,7 +7843,7 @@"src/extractors/markdown_data.rs","src/extractors/yaml_frontmatter.rs"],- "checked_utc": "2026-10-25T13:32:37.422065+00:00"+ "checked_utc": "2026-10-28T09:07:45.335046+00:00"},{"path": "graphify/extractors/models.py",@@ -7909,7 +7909,7 @@"rust_files": ["src/extractors/models.rs"],- "checked_utc": "2026-10-25T13:32:37.422098+00:00"+ "checked_utc": "2026-10-28T09:07:45.335081+00:00"},{"path": "graphify/extractors/objc.py",@@ -8033,7 +8033,7 @@"src/extractors/engine_declarator.rs","src/extractors/resolution_paths.rs"],- "checked_utc": "2026-10-25T13:32:37.422132+00:00"+ "checked_utc": "2026-10-28T09:07:45.335117+00:00"},{"path": "graphify/extractors/ocaml.py",@@ -8116,7 +8116,7 @@"rust_files": ["src/extractors/ocaml.rs"],- "checked_utc": "2026-10-25T13:32:37.422166+00:00"+ "checked_utc": "2026-10-28T09:07:45.335152+00:00"},{"path": "graphify/extractors/pascal.py",@@ -8242,7 +8242,7 @@"src/extractors/pascal.rs","src/extractors/pascal_paths.rs"],- "checked_utc": "2026-10-25T13:32:37.422200+00:00"+ "checked_utc": "2026-10-28T09:07:45.335187+00:00"},{"path": "graphify/extractors/pascal_forms.py",@@ -8295,7 +8295,7 @@"src/extractors/pascal_forms.rs","src/io_compat.rs"],- "checked_utc": "2026-10-25T13:32:37.422235+00:00"+ "checked_utc": "2026-10-28T09:07:45.335224+00:00"},{"path": "graphify/extractors/powershell.py",@@ -8404,7 +8404,7 @@"rust_files": ["src/extractors/powershell.rs"],- "checked_utc": "2026-10-25T13:32:37.422272+00:00"+ "checked_utc": "2026-10-28T09:07:45.335260+00:00"},{"path": "graphify/extractors/r.py",@@ -8513,7 +8513,7 @@"src/extractors/r.rs","vendor/tree-sitter-r/SOURCE.json"],- "checked_utc": "2026-10-25T13:32:37.422309+00:00"+ "checked_utc": "2026-10-28T09:07:45.335297+00:00"},{"path": "graphify/extractors/razor.py",@@ -8545,7 +8545,7 @@"rust_files": ["src/extractors/razor.rs"],- "checked_utc": "2026-10-25T13:32:37.422343+00:00"+ "checked_utc": "2026-10-28T09:07:45.335331+00:00"},{"path": "graphify/extractors/resolution.py",@@ -9136,7 +9136,7 @@"src/extractors/resolution_types.rs","src/extractors/pascal_paths.rs"],- "checked_utc": "2026-10-25T13:32:37.422380+00:00"+ "checked_utc": "2026-10-28T09:07:45.335367+00:00"},{"path": "graphify/extractors/robot.py",@@ -9277,7 +9277,7 @@"src/extractors/robot.rs","src/assets/robot/languages.json"],- "checked_utc": "2026-10-25T13:32:37.422413+00:00"+ "checked_utc": "2026-10-28T09:07:45.335404+00:00"},{"path": "graphify/extractors/rust.py",@@ -9396,7 +9396,7 @@"rust_files": ["src/extractors/rust.rs"],- "checked_utc": "2026-10-25T13:32:37.422446+00:00"+ "checked_utc": "2026-10-28T09:07:45.335439+00:00"},{"path": "graphify/extractors/sln.py",@@ -9423,7 +9423,7 @@"src/extractors/sln.rs","src/fsutil.rs"],- "checked_utc": "2026-10-25T13:32:37.422483+00:00"+ "checked_utc": "2026-10-28T09:07:45.335477+00:00"},{"path": "graphify/extractors/solidity.py",@@ -9517,7 +9517,7 @@"src/extractors/solidity.rs","vendor/tree-sitter-solidity/SOURCE.json"],- "checked_utc": "2026-10-25T13:32:37.422517+00:00"+ "checked_utc": "2026-10-28T09:07:45.335512+00:00"},{"path": "graphify/extractors/sql.py",@@ -9642,7 +9642,7 @@"vendor/tree-sitter-sql/grammar/tree_sitter/parser.h","vendor/tree-sitter-sql/SOURCE.json"],- "checked_utc": "2026-10-25T13:32:37.422554+00:00"+ "checked_utc": "2026-10-28T09:07:45.335549+00:00"},{"path": "graphify/extractors/terraform.py",@@ -9759,7 +9759,7 @@"vendor/tree-sitter-hcl/grammar/scanner.c","vendor/tree-sitter-hcl/SOURCE.json"],- "checked_utc": "2026-10-25T13:32:37.422613+00:00"+ "checked_utc": "2026-10-28T09:07:45.335586+00:00"},{"path": "graphify/extractors/vbnet.py",@@ -9823,7 +9823,7 @@"src/extractors/vbnet.rs","vendor/tree-sitter-vb-dotnet/SOURCE.json"],- "checked_utc": "2026-10-25T13:32:37.422652+00:00"+ "checked_utc": "2026-10-28T09:07:45.335623+00:00"},{"path": "graphify/extractors/verilog.py",@@ -9921,7 +9921,7 @@"rust_files": ["src/extractors/verilog.rs"],- "checked_utc": "2026-10-25T13:32:37.422689+00:00"+ "checked_utc": "2026-10-28T09:07:45.335657+00:00"},{"path": "graphify/extractors/yaml_config.py",@@ -9975,7 +9975,7 @@"src/extractors/yaml_config.rs","src/extractors/yaml_frontmatter.rs"],- "checked_utc": "2026-10-25T13:32:37.422724+00:00"+ "checked_utc": "2026-10-28T09:07:45.335691+00:00"},{"path": "graphify/extractors/zig.py",@@ -10033,7 +10033,7 @@"rust_files": ["src/extractors/zig.rs"],- "checked_utc": "2026-10-25T13:32:37.422760+00:00"+ "checked_utc": "2026-10-28T09:07:45.335726+00:00"},{"path": "graphify/file_slice.py",@@ -10105,7 +10105,7 @@"rust_files": ["src/file_slice.rs"],- "checked_utc": "2026-10-25T13:32:37.422796+00:00"+ "checked_utc": "2026-10-28T09:07:45.335763+00:00"},{"path": "graphify/global_graph.py",@@ -10181,7 +10181,7 @@"src/build_global.rs","src/graph.rs"],- "checked_utc": "2026-10-25T13:32:37.422833+00:00"+ "checked_utc": "2026-10-28T09:07:45.335801+00:00"},{"path": "graphify/google_workspace.py",@@ -10255,7 +10255,7 @@"rust_files": ["src/google_workspace.rs"],- "checked_utc": "2026-10-25T13:32:37.422870+00:00"+ "checked_utc": "2026-10-28T09:07:45.335840+00:00"},{"path": "graphify/hooks.py",@@ -10406,7 +10406,7 @@"src/hooks.rs","src/hooks_runtime.rs"],- "checked_utc": "2026-10-25T13:32:37.422907+00:00"+ "checked_utc": "2026-10-28T09:07:45.335877+00:00"},{"path": "graphify/ids.py",@@ -10437,7 +10437,7 @@"src/ids.rs","src/unicode15.rs"],- "checked_utc": "2026-10-25T13:32:37.422942+00:00"+ "checked_utc": "2026-10-28T09:07:45.335914+00:00"},{"path": "graphify/ingest.py",@@ -10532,7 +10532,7 @@"src/ingest.rs","src/ingest_api.rs"],- "checked_utc": "2026-10-25T13:32:37.422977+00:00"+ "checked_utc": "2026-10-28T09:07:45.335949+00:00"},{"path": "graphify/install.py",@@ -11025,7 +11025,7 @@"src/assets/install/pi/package.json","src/assets/install/workflows.md"],- "checked_utc": "2026-10-25T13:32:37.423013+00:00"+ "checked_utc": "2026-10-28T09:07:45.335986+00:00"},{"path": "graphify/interface_dispatch.py",@@ -11074,7 +11074,7 @@"rust_files": ["src/interface_dispatch.rs"],- "checked_utc": "2026-10-25T13:32:37.423050+00:00"+ "checked_utc": "2026-10-28T09:07:45.336023+00:00"},{"path": "graphify/llm.py",@@ -11659,7 +11659,7 @@"src/assets/llm/extraction_system.txt","src/assets/llm/label_prompt.txt"],- "checked_utc": "2026-10-25T13:32:37.423087+00:00"+ "checked_utc": "2026-10-28T09:07:45.336063+00:00"},{"path": "graphify/manifest.py",@@ -11676,7 +11676,7 @@"rust_files": ["src/manifest.rs"],- "checked_utc": "2026-10-25T13:32:37.423122+00:00"+ "checked_utc": "2026-10-28T09:07:45.336099+00:00"},{"path": "graphify/manifest_ingest.py",@@ -11767,7 +11767,7 @@"rust_files": ["src/manifest_ingest.rs"],- "checked_utc": "2026-10-25T13:32:37.423157+00:00"+ "checked_utc": "2026-10-28T09:07:45.336133+00:00"},{"path": "graphify/markdown_resolution.py",@@ -11844,7 +11844,7 @@"rust_files": ["src/markdown_resolution.rs"],- "checked_utc": "2026-10-25T13:32:37.423192+00:00"+ "checked_utc": "2026-10-28T09:07:45.336170+00:00"},{"path": "graphify/mcp_ingest.py",@@ -11910,7 +11910,7 @@"rust_files": ["src/mcp_ingest.rs"],- "checked_utc": "2026-10-25T13:32:37.423228+00:00"+ "checked_utc": "2026-10-28T09:07:45.336213+00:00"},{"path": "graphify/multigraph_compat.py",@@ -12011,7 +12011,7 @@"src/multigraph_compat.rs","src/graph.rs"],- "checked_utc": "2026-10-25T13:32:37.423261+00:00"+ "checked_utc": "2026-10-28T09:07:45.336253+00:00"},{"path": "graphify/pascal_resolution.py",@@ -12044,7 +12044,7 @@"rust_files": ["src/pascal_resolution.rs"],- "checked_utc": "2026-10-25T13:32:37.423295+00:00"+ "checked_utc": "2026-10-28T09:07:45.336291+00:00"},{"path": "graphify/paths.py",@@ -12172,7 +12172,7 @@"src/python_json.rs","src/security.rs"],- "checked_utc": "2026-10-25T13:32:37.423331+00:00"+ "checked_utc": "2026-10-28T09:07:45.336327+00:00"},{"path": "graphify/pg_introspect.py",@@ -12208,7 +12208,7 @@"src/assets/postgres/routines.sql","src/assets/postgres/foreign_keys.sql"],- "checked_utc": "2026-10-25T13:32:37.423368+00:00"+ "checked_utc": "2026-10-28T09:07:45.336367+00:00"},{"path": "graphify/pi/index.ts",@@ -12460,7 +12460,7 @@"src/prs_api.rs","src/assets/prs/help.txt"],- "checked_utc": "2026-10-25T13:32:37.423403+00:00"+ "checked_utc": "2026-10-28T09:07:45.336406+00:00"},{"path": "graphify/querylog.py",@@ -12505,7 +12505,7 @@"rust_files": ["src/querylog.rs"],- "checked_utc": "2026-10-25T13:32:37.423438+00:00"+ "checked_utc": "2026-10-28T09:07:45.336442+00:00"},{"path": "graphify/rcfile.py",@@ -12573,7 +12573,7 @@"src/rcfile.rs","src/par.rs"],- "checked_utc": "2026-10-25T13:32:37.423474+00:00"+ "checked_utc": "2026-10-28T09:07:45.336478+00:00"},{"path": "graphify/reflect.py",@@ -12746,7 +12746,7 @@"src/reflect.rs","src/python_datetime.rs"],- "checked_utc": "2026-10-25T13:32:37.423507+00:00"+ "checked_utc": "2026-10-28T09:07:45.336511+00:00"},{"path": "graphify/report.py",@@ -12806,7 +12806,7 @@"rust_files": ["src/report.rs"],- "checked_utc": "2026-10-25T13:32:37.423542+00:00"+ "checked_utc": "2026-10-28T09:07:45.336545+00:00"},{"path": "graphify/resolver_registry.py",@@ -12850,7 +12850,7 @@"rust_files": ["src/resolver_registry.rs"],- "checked_utc": "2026-10-25T13:32:37.423577+00:00"+ "checked_utc": "2026-10-28T09:07:45.336580+00:00"},{"path": "graphify/ruby_resolution.py",@@ -12942,7 +12942,7 @@"src/ruby_resolution.rs","src/build_labels.rs"],- "checked_utc": "2026-10-25T13:32:37.423613+00:00"+ "checked_utc": "2026-10-28T09:07:45.336615+00:00"},{"path": "graphify/scip_ingest.py",@@ -13019,7 +13019,7 @@"rust_files": ["src/scip_ingest.rs"],- "checked_utc": "2026-10-25T13:32:37.423650+00:00"+ "checked_utc": "2026-10-28T09:07:45.336652+00:00"},{"path": "graphify/security.py",@@ -13172,7 +13172,7 @@"src/ip_policy_data.rs","src/decimal_data.rs"],- "checked_utc": "2026-10-25T13:32:37.423684+00:00"+ "checked_utc": "2026-10-28T09:07:45.336689+00:00"},{"path": "graphify/semantic_cleanup.py",@@ -13225,7 +13225,7 @@"src/semantic_cleanup.rs","src/hyperedge_members.rs"],- "checked_utc": "2026-10-25T13:32:37.423720+00:00"+ "checked_utc": "2026-10-28T09:07:45.336727+00:00"},{"path": "graphify/serve.py",@@ -13819,7 +13819,7 @@"src/serve_text.rs","src/assets/serve/constants.json"],- "checked_utc": "2026-10-25T13:32:37.423758+00:00"+ "checked_utc": "2026-10-28T09:07:45.336764+00:00"},{"path": "graphify/skill-agents.md",@@ -15123,7 +15123,7 @@"rust_files": ["src/swift_dispatch.rs"],- "checked_utc": "2026-10-25T13:32:37.423804+00:00"+ "checked_utc": "2026-10-28T09:07:45.336812+00:00"},{"path": "graphify/symbol_resolution.py",@@ -15233,7 +15233,7 @@"rust_files": ["src/symbol_resolution.rs"],- "checked_utc": "2026-10-25T13:32:37.423840+00:00"+ "checked_utc": "2026-10-28T09:07:45.336849+00:00"},{"path": "graphify/transcribe.py",@@ -15301,7 +15301,7 @@"src/transcribe_api.rs","src/assets/transcribe/models.json"],- "checked_utc": "2026-10-25T13:32:37.423876+00:00"+ "checked_utc": "2026-10-28T09:07:45.336886+00:00"},{"path": "graphify/tree_html.py",@@ -15372,7 +15372,7 @@"src/tree_html.rs","src/assets/tree.html.template"],- "checked_utc": "2026-10-25T13:32:37.423912+00:00"+ "checked_utc": "2026-10-28T09:07:45.336921+00:00"},{"path": "graphify/validate.py",@@ -15402,7 +15402,7 @@"src/python_compat.rs","src/python_repr_data.rs"],- "checked_utc": "2026-10-25T13:32:37.423950+00:00"+ "checked_utc": "2026-10-28T09:07:45.336956+00:00"},{"path": "graphify/watch.py",@@ -15762,7 +15762,7 @@"src/watch_paths.rs","src/watch_reconcile.rs"],- "checked_utc": "2026-10-25T13:32:37.423984+00:00"+ "checked_utc": "2026-10-28T09:07:45.336991+00:00"},{"path": "graphify/wiki.py",@@ -15832,7 +15832,7 @@"rust_files": ["src/wiki.rs"],- "checked_utc": "2026-10-25T13:32:37.424019+00:00"+ "checked_utc": "2026-10-28T09:07:45.337026+00:00"},{"path": "pyproject.toml",diff --git a/crates/graphicle-graph/migration/PROGRESS.json b/crates/graphicle-graph/migration/PROGRESS.jsonindex f73b31b..b0931a4 100644--- a/crates/graphicle-graph/migration/PROGRESS.json+++ b/crates/graphicle-graph/migration/PROGRESS.json@@ -105,5 +105,5 @@"graphify/wiki.py"],"pending_files": [],- "updated_utc": "2026-10-25T13:32:37.758903+00:00"+ "updated_utc": "2026-10-28T09:07:45.657443+00:00"}diff --git a/crates/graphicle-graph/src/cli.rs b/crates/graphicle-graph/src/cli.rsindex c626e34..e497839 100644--- a/crates/graphicle-graph/src/cli.rs+++ b/crates/graphicle-graph/src/cli.rs@@ -322,13 +322,28 @@ pub fn force(args: &Args) -> bool {pub fn load(path: &Path, direction: Option<bool>) -> Result<crate::graph::Graph> {load_as(path, direction, None)}+/// The error for a graph file `path` that does not exist. The default graph+/// file, the one `extract .` writes in this folder, comes with that command,+/// so a query run before any extract says what to run.+fn graph_not_found(path: &Path) -> String {+ let message = format!("graph file not found: {}", path.display());+ let default = crate::cli_state::resolve(Path::new(&paths::default_graph_json()));+ if crate::cli_state::resolve(path) == default {+ format!(+ "{message}\n(build it with `{} extract . --code-only` in this folder)",+ program()+ )+ } else {+ message+ }+}pub fn load_as(path: &Path,direction: Option<bool>,multigraph: Option<bool>,) -> Result<crate::graph::Graph> {if !path.is_file() {- return Err(format!("graph file not found: {}", path.display()).into());+ return Err(graph_not_found(path).into());}let mut raw = crate::cli_state::read_graph(path)?;if raw.get("links").is_none() {@@ -375,7 +390,7 @@ pub fn load_indexed(variant: crate::snapshot::Variant,) -> Result<(crate::graph::Graph, crate::serve_search::SearchIndex)> {if !path.is_file() {- return Err(format!("graph file not found: {}", path.display()).into());+ return Err(graph_not_found(path).into());}crate::security::check_own_graph_size_cap(path)?;let build = || {diff --git a/crates/graphicle-graph/tests/missing_graph.rs b/crates/graphicle-graph/tests/missing_graph.rsnew file mode 100644index 0000000..41b969a--- /dev/null+++ b/crates/graphicle-graph/tests/missing_graph.rs@@ -0,0 +1,54 @@+//! A query run before any extract: the error names the missing graph file+//! and, for the default one, the extract command that builds it, and that+//! command makes the same query work.+use std::fs;++fn run(args: &[&str]) -> graphicle::cli::Output {+ graphicle::cli::run(&args.iter().map(|s| s.to_string()).collect::<Vec<_>>())+}++#[test]+fn a_query_before_any_extract_names_the_command_that_builds_the_graph() {+ let project = tempfile::tempdir().unwrap();+ // This test binary runs one test, so it may change the working directory,+ // where the default graph file (.graphicle/graph.json) lives.+ std::env::set_current_dir(project.path()).unwrap();+ fs::write(+ project.path().join("client.py"),+ "def retry():\n pass\n\n\ndef fetch():\n retry()\n",+ )+ .unwrap();+ let hint = "(build it with `graphicle-graph extract . --code-only` in this folder)";+ for args in [&["affected", "retry()"][..], &["query", "retry"]] {+ let out = run(args);+ assert_eq!(out.exit_code, 1, "{}{}", out.stdout, out.stderr);+ assert!(+ out.stderr.contains("graph file not found: "),+ "{}",+ out.stderr+ );+ assert!(out.stderr.contains(hint), "{}", out.stderr);+ }+ // A graph file named with --graph is the caller's own: the error names it+ // and suggests no command.+ let elsewhere = project.path().join("elsewhere.json");+ let out = run(&[+ "affected",+ "retry()",+ "--graph",+ elsewhere.to_str().unwrap(),+ ]);+ assert_eq!(out.exit_code, 1, "{}{}", out.stdout, out.stderr);+ assert!(+ out.stderr.contains("graph file not found: "),+ "{}",+ out.stderr+ );+ assert!(!out.stderr.contains("--code-only"), "{}", out.stderr);+ // The command the error names builds the file the query reads.+ let out = run(&["extract", ".", "--code-only"]);+ assert_eq!(out.exit_code, 0, "{}{}", out.stdout, out.stderr);+ let out = run(&["affected", "retry()"]);+ assert_eq!(out.exit_code, 0, "{}{}", out.stdout, out.stderr);+ assert!(out.stdout.contains("fetch"), "{}", out.stdout);+}diff --git a/crates/graphicle-memory/Cargo.lock b/crates/graphicle-memory/Cargo.lockindex dbc1156..6cda0a4 100644--- a/crates/graphicle-memory/Cargo.lock+++ b/crates/graphicle-memory/Cargo.lock@@ -1453,7 +1453,7 @@ checksum = "e4eba85ea1d0a966a983acd07deee566e67395d2d96b6fb39e62b5a833f1eb0b"[[package]]name = "graphicle"-version = "0.1.9"+version = "0.1.10"dependencies = ["aws-config","aws-sdk-bedrockruntime",@@ -1551,7 +1551,7 @@ dependencies = [[[package]]name = "graphicle-memory"-version = "0.1.9"+version = "0.1.10"dependencies = ["chrono","graphicle",diff --git a/crates/graphicle-memory/Cargo.toml b/crates/graphicle-memory/Cargo.tomlindex 5a6918c..c67ba05 100644--- a/crates/graphicle-memory/Cargo.toml+++ b/crates/graphicle-memory/Cargo.toml@@ -1,6 +1,6 @@[package]name = "graphicle-memory"-version = "0.1.9"+version = "0.1.10"edition = "2024"rust-version = "1.94.1"publish = falsediff --git a/crates/graphicle-memory/deny.toml b/crates/graphicle-memory/deny.tomlindex be51580..d1da096 100644--- a/crates/graphicle-memory/deny.toml+++ b/crates/graphicle-memory/deny.toml@@ -84,6 +84,7 @@ ignore = [{ id = "RUSTSEC-2026-0391", reason = "zstd 0.13.3 via jieba-rs -> include-flate: affects the stream with_context constructors, which include-flate never calls (a new decoder per dictionary)" },{ id = "RUSTSEC-2026-0398", reason = "zstd-safe 7.3.0 via jieba-rs -> include-flate: affects Seekable::decompress, which needs the seekable feature; it is off" },{ id = "RUSTSEC-2026-0403", reason = "zstd-safe 7.3.0 via jieba-rs -> include-flate: affects stream::write::Decoder; include-flate reads with stream::read::Decoder, which the advisory lists as not affected" },+ { id = "RUSTSEC-2026-0418", reason = "libz-sys 1.1.29 via flate2: its build script prints the whole build environment only when built with cc 1.6.0 or later; Cargo.lock pins cc 1.4.7. Remove when the lock moves to libz-sys 1.1.31 or later" },{ id = "RUSTSEC-2024-0436", reason = "paste (proc-macro, build time only) via neo4rs -> nav-types -> nalgebra -> simba" },{ id = "RUSTSEC-2026-0192", reason = "ttf-parser via pdf-extract -> lopdf; font tables are parsed only from local PDFs" },{ id = "RUSTSEC-2025-0075", reason = "unic-char-range via rustpython-parser (Python literal parsing); no vulnerability" },diff --git a/crates/graphicle/Cargo.lock b/crates/graphicle/Cargo.lockindex 646b37d..7429fbe 100644--- a/crates/graphicle/Cargo.lock+++ b/crates/graphicle/Cargo.lock@@ -1327,7 +1327,7 @@ dependencies = [[[package]]name = "graphicle"-version = "0.1.9"+version = "0.1.10"dependencies = ["base64 0.22.1","calamine",@@ -1421,7 +1421,7 @@ dependencies = [[[package]]name = "graphicle-memory"-version = "0.1.9"+version = "0.1.10"dependencies = ["chrono","graphicle",@@ -1439,7 +1439,7 @@ dependencies = [[[package]]name = "graphicle-runtime"-version = "0.1.9"+version = "0.1.10"dependencies = ["aes-gcm","axum",diff --git a/crates/graphicle/Cargo.toml b/crates/graphicle/Cargo.tomlindex e1d501f..9c0e21b 100644--- a/crates/graphicle/Cargo.toml+++ b/crates/graphicle/Cargo.toml@@ -1,6 +1,6 @@[package]name = "graphicle-runtime"-version = "0.1.9"+version = "0.1.10"edition = "2024"rust-version = "1.94.1"publish = falsediff --git a/crates/graphicle/LOCAL_INFERENCE.md b/crates/graphicle/LOCAL_INFERENCE.mdindex 50d1cd5..c36c65a 100644--- a/crates/graphicle/LOCAL_INFERENCE.md+++ b/crates/graphicle/LOCAL_INFERENCE.md@@ -158,6 +158,15 @@ entry that is not exactly a host is an error. A profile with a credential(`key_env`) is refused on such a host, because the key would cross the networkin clear text. Connectors, sign-in and release feeds ignore the variable.+If you accept that risk for a server on your own network, list its host in+`GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS` instead, in the same format: a profile+with a credential may then use plain HTTP to that exact host, and the key+crosses the network in clear text, readable by anyone who can watch it. A host+listed there also counts as listed in `GRAPHICLE_PROVIDER_HTTP_HOSTS`. The+variable is unset by default, Graphicle prints a one-line warning that names+such a host when it accepts such a profile, and connectors, sign-in and release+feeds still ignore it.+```shGRAPHICLE_PROVIDER_HTTP_HOSTS=192.168.210.33 graphicle serve```diff --git a/crates/graphicle/README.md b/crates/graphicle/README.mdindex 5820f4b..5668847 100644--- a/crates/graphicle/README.md+++ b/crates/graphicle/README.md@@ -55,7 +55,7 @@ operations through the extension registry (`src/extension.rs`).provider permission mode ("is not part of Graphicle Core"), while it still enforcesthe provider permissions an existing store holds.- `build.info` reports the edition and its capabilities, and- `graphicle --version` prints it (`graphicle 0.1.9 (core)`).+ `graphicle --version` prints it (`graphicle 0.1.10 (core)`).- A store keeps every table when either edition opens it, and Core keeps theother edition's guarantees on a store it has used (`src/store_compat.rs`).@@ -396,7 +396,8 @@ endpoint and optional API credential; ordinary users do not need environmentvariables. An endpoint uses HTTPS, or HTTP on loopback. A model server on aprivate network that serves no TLS, such as a vLLM host, needs whoever runs theservice to list its exact host in `GRAPHICLE_PROVIDER_HTTP_HOSTS`, and such a-profile takes no credential+profile takes no credential, unless the host is listed in+`GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS` instead, which sends the key in clear text([LOCAL_INFERENCE.md](LOCAL_INFERENCE.md#local-openai-compatible-servers)).Supported protocols are Ollama, OpenAI-compatible Chat Completions andResponses, Anthropic, Gemini, Azure Chat and Azure Responses. Azure profilesdiff --git a/crates/graphicle/deny.toml b/crates/graphicle/deny.tomlindex 30c3201..c294dff 100644--- a/crates/graphicle/deny.toml+++ b/crates/graphicle/deny.toml@@ -83,6 +83,7 @@ ignore = [{ id = "RUSTSEC-2026-0391", reason = "zstd 0.13.3 via jieba-rs -> include-flate: affects the stream with_context constructors, which include-flate never calls (a new decoder per dictionary)" },{ id = "RUSTSEC-2026-0398", reason = "zstd-safe 7.3.0 via jieba-rs -> include-flate: affects Seekable::decompress, which needs the seekable feature; it is off" },{ id = "RUSTSEC-2026-0403", reason = "zstd-safe 7.3.0 via jieba-rs -> include-flate: affects stream::write::Decoder; include-flate reads with stream::read::Decoder, which the advisory lists as not affected" },+ { id = "RUSTSEC-2026-0418", reason = "libz-sys 1.1.29 via flate2: its build script prints the whole build environment only when built with cc 1.6.0 or later; Cargo.lock pins cc 1.4.7. Remove when the lock moves to libz-sys 1.1.31 or later" },{ id = "RUSTSEC-2024-0436", reason = "paste (proc-macro, build time only) via neo4rs -> nav-types -> nalgebra -> simba" },{ id = "RUSTSEC-2026-0192", reason = "ttf-parser via pdf-extract -> lopdf; font tables are parsed only from local PDFs" },{ id = "RUSTSEC-2025-0075", reason = "unic-char-range via rustpython-parser (Python literal parsing); no vulnerability" },diff --git a/crates/graphicle/src/code_pack.rs b/crates/graphicle/src/code_pack.rsindex 9ec6afc..3b3e3d4 100644--- a/crates/graphicle/src/code_pack.rs+++ b/crates/graphicle/src/code_pack.rs@@ -453,6 +453,11 @@ pub struct Options {/// when the budget itself moves between calls (a calibrated budget): the/// part then stays the same bytes ([`prefix_basis`]).pub prefix_budget: Option<usize>,+ /// The call pins `focus` passages ahead of the question's ranking+ /// ([`pinned`]): every ranked file then keeps the per-file caps (no+ /// first rank whole at small budgets, no first two at large ones), so+ /// that each pinned passage keeps its room.+ pub pinned: bool,}impl Options {@@ -598,6 +603,10 @@ impl Options {layout,prefix_share: prefix_share.unwrap_or(DEFAULT_PREFIX_SHARE),prefix_budget,+ pinned: args+ .get("focus")+ .and_then(Value::as_array)+ .is_some_and(|list| !list.is_empty()),})}@@ -925,6 +934,20 @@ fn short(name: &str) -> &str {}}+/// A file's lines (or the header) inside the XML style's elements: as they+/// are, or, when they hold a closing tag of the pack's own elements+/// (`</file` or `</section`, in any case: an HTML5 page's `</section>`), in a+/// CDATA section that starts on a line of its own (a `]]>` in them split+/// across two sections), so that a page never closes the pack's elements.+/// Element and attribute names stay as they are.+fn xml_body(body: &str) -> String {+ let lower = body.to_ascii_lowercase();+ if !lower.contains("</file") && !lower.contains("</section") {+ return body.to_string();+ }+ format!("<![CDATA[\n{}]]>\n", body.replace("]]>", "]]]]><![CDATA[>"))+}+fn attr(text: &str) -> String {let mut out = String::with_capacity(text.len());for c in text.chars() {@@ -1067,9 +1090,10 @@ fn render_file()}Style::Xml => format!(- "<file path=\"{}\" lines=\"{range}\" why=\"{}\">\n{body}</file>\n",+ "<file path=\"{}\" lines=\"{range}\" why=\"{}\">\n{}</file>\n",attr(piece.path),- attr(why)+ attr(why),+ xml_body(&body)),};let tokens = counter.count(@@ -2519,6 +2543,23 @@ const FULL_RANKS: usize = 15;const QUESTION_FULL_TOKENS: usize = 8_000;/// A compactly excerpted file goes in whole at most this size.const COMPACT_WHOLE: usize = 1_500;+/// In a standard pack of at most [`TOP_WHOLE_BUDGET`] tokens the first rank+/// goes in whole when it fits in [`TOP_WHOLE_SHARE`] of the budget, whatever+/// the per-file caps: a fix's changed lines in the top-ranked file are as+/// often outside its ranked passages as in them, and at these budgets its+/// excerpts are small. (Measured on the development questions: past 32K the+/// room it takes costs other files more than its lines are worth.)+const TOP_WHOLE_BUDGET: usize = 32_768;+const TOP_WHOLE_SHARE: f64 = 0.5;+/// In a standard pack of [`TOP_WHOLE_LARGE_BUDGET`] tokens or more, the first+/// [`TOP_WHOLE_LARGE_RANKS`] ranks go in whole when each fits in+/// [`TOP_WHOLE_LARGE_SHARE`] of the budget, whatever the per-file caps. (At+/// 64K, and from 120,000 to 128,000, the room they take pushed other ranked+/// files out on the development questions; from 131,072 it did not.) Both+/// rules compare a file's estimated size ([`est_file`], from its bytes).+const TOP_WHOLE_LARGE_BUDGET: usize = 131_072;+const TOP_WHOLE_LARGE_RANKS: usize = 2;+const TOP_WHOLE_LARGE_SHARE: f64 = 0.25;/// Lines around a passage in a compact excerpt.const COMPACT_CONTEXT: usize = 3;/// Top-ranked files left out that the manifest lists at most.@@ -3319,9 +3360,24 @@ fn fill_focus(let est = est_file(&file.path, text.len());let compact = small && rank > full_ranks;let note = file.added.map_or(String::new(), |why| format!(" ({why})"));- let whole_cap = if compact { COMPACT_WHOLE } else { whole_limit };+ let top_share = if in_prefix.is_some() || fill.options.pinned {+ None+ } else if rank == 1 && sizing.budget <= TOP_WHOLE_BUDGET {+ Some(TOP_WHOLE_SHARE)+ } else if rank <= TOP_WHOLE_LARGE_RANKS && sizing.budget >= TOP_WHOLE_LARGE_BUDGET {+ Some(TOP_WHOLE_LARGE_SHARE)+ } else {+ None+ };+ let (whole_cap, file_cap) = if compact {+ (COMPACT_WHOLE, per_file)+ } else if let Some(share) = top_share {+ (whole_limit.max(sizing.share(share)), usize::MAX)+ } else {+ (whole_limit, per_file)+ };let mut added = 0;- if est <= whole_cap.min(per_file) {+ if est <= whole_cap.min(file_cap) {let names = names_in(&symbols, 1, total);let note = note.clone();let why =@@ -4102,7 +4158,7 @@ fn cache_header_text(corpus: &Corpus<'_>, options: &Options, counter: &Counter));match options.style {Style::Markdown => format!("# Code pack: {}\n\n{body}\n", corpus.project),- Style::Xml => body,+ Style::Xml => xml_body(&body),}}@@ -4522,9 +4578,10 @@ fn outline()}Style::Xml => format!(- "<file path=\"{}\" lines=\"{range}\" why=\"{}\">\n{body}</file>\n",+ "<file path=\"{}\" lines=\"{range}\" why=\"{}\">\n{}</file>\n",attr(path),- attr(why)+ attr(why),+ xml_body(&body)),};let tokens = fill.counter.count(@@ -4704,7 +4761,7 @@ fn header_text();match options.style {Style::Markdown => format!("# Code pack: {}\n\n{body}\n", corpus.project),- Style::Xml => body,+ Style::Xml => xml_body(&body),}}@@ -5390,7 +5447,8 @@ mod tests {#[test]fn small_files_go_in_whole_and_large_ones_as_excerpts() {- let pack = pack("how does F4x3 compute widgets", 30_000, json!({}));+ // Past TOP_WHOLE_BUDGET, so the first rank is cut like any large file.+ let pack = pack("how does F4x3 compute widgets", 40_000, json!({}));let focus = pack["sections"].as_array().unwrap()@@ -5430,6 +5488,405 @@ mod tests {assert!(why.starts_with("focus: rank 1, defines x.F4x"), "{why}");}+ #[test]+ fn the_first_rank_goes_in_whole_at_small_budgets() {+ let focus = |budget: usize| -> Vec<Value> {+ let pack = pack("how does F4x3 compute widgets", budget, json!({}));+ pack["sections"]+ .as_array()+ .unwrap()+ .iter()+ .filter(|s| s["name"] == "focus")+ .flat_map(|s| s["chunks"].as_array().unwrap().clone())+ .filter(|c| c["path"] == "pkg/a/file4.go")+ .collect()+ };+ // file4.go, the first rank, is larger than the whole-file caps of a+ // 30,000 or 40,000 token pack: whole at 30,000 (it fits in half of+ // it), cut into excerpts at 40,000 (past TOP_WHOLE_BUDGET).+ let small = focus(30_000);+ assert_eq!(small.len(), 1, "{small:?}");+ assert_eq!(small[0]["whole"], true);+ assert_eq!(small[0]["start_line"], 1);+ let larger = focus(40_000);+ assert!(!larger.is_empty());+ assert!(larger.iter().all(|c| c["whole"] == false), "{larger:?}");+ // The second rank keeps the caps: file1.go is small and whole either way.+ let pack = pack("how does F4x3 compute widgets", 30_000, json!({}));+ let second = pack["included"]+ .as_array()+ .unwrap()+ .iter()+ .find(|f| f["path"] == "pkg/b/file1.go")+ .unwrap();+ assert_eq!(second["rank"], 2);+ }++ #[test]+ fn the_first_two_ranks_go_in_whole_at_large_budgets() {+ // Two large ranked files (3,000 lines, well past the whole-file caps+ // of a 100,000 or 200,000 token pack) with a symbol every 20 lines,+ // and a small third.+ let mut files = BTreeMap::new();+ let mut symbols = Vec::new();+ for (i, path) in ["big/a.rs", "big/b.rs"].iter().enumerate() {+ let mut text = String::new();+ for line in 1..=3_000 {+ if line % 20 == 1 {+ text.push_str(&format!("fn part{i}_{line}() {{\n"));+ symbols.push(Symbol {+ node: symbols.len(),+ name: format!("big.part{i}_{line}"),+ path: path.to_string(),+ line,+ degree: 1,+ });+ } else {+ text.push_str(&format!(+ " let value_{line} = compute(\"widget {i}\");\n"+ ));+ }+ }+ files.insert(path.to_string(), text);+ }+ files.insert("small/c.rs".to_string(), "fn small() {}\n".to_string());+ let ranking: Vec<(String, usize, usize)> = vec![+ ("big/a.rs".into(), 1_001, 1_010),+ ("big/b.rs".into(), 2_001, 2_010),+ ("small/c.rs".into(), 1, 1),+ ];+ let calls: Vec<(usize, usize)> = Vec::new();+ let whole = |budget: usize| -> Vec<(String, bool)> {+ let options =+ Options::parse(&json!({"question":"how is the widget computed","budget":budget}))+ .unwrap();+ let counter = Counter::open(None, None).unwrap();+ let mut corpus = corpus(&files, &symbols, &calls, ranking.clone());+ let pack = build(&mut corpus, &options, &counter).unwrap();+ let mut out = Vec::new();+ for path in ["big/a.rs", "big/b.rs"] {+ let held = pack["sections"]+ .as_array()+ .unwrap()+ .iter()+ .filter(|s| s["name"] == "focus")+ .flat_map(|s| s["chunks"].as_array().unwrap())+ .any(|c| c["path"] == path && c["whole"] == true);+ out.push((path.to_string(), held));+ }+ out+ };+ // From TOP_WHOLE_LARGE_BUDGET, each fits in a quarter of the budget:+ // whole. Below it, past the per-file caps: excerpts.+ assert!(+ whole(200_000).iter().all(|(_, held)| *held),+ "{:?}",+ whole(200_000)+ );+ assert!(+ whole(100_000).iter().all(|(_, held)| !*held),+ "{:?}",+ whole(100_000)+ );+ }++ /// A Rust file of exactly `tokens` estimated tokens ([`est_file`]), with+ /// a symbol every 20 lines (added to `symbols`).+ fn sized_file(path: &str, tokens: usize, tag: usize, symbols: &mut Vec<Symbol>) -> String {+ let mut text = String::new();+ let mut line = 0;+ loop {+ let next = if (line + 1) % 20 == 1 {+ format!("fn part{tag}_{}() {{\n", line + 1)+ } else {+ format!(" let value_{} = compute(\"widget {tag}\");\n", line + 1)+ };+ if est_file(path, text.len() + next.len() + 4) > tokens {+ break;+ }+ line += 1;+ if line % 20 == 1 {+ symbols.push(Symbol {+ node: symbols.len(),+ name: format!("big.part{tag}_{line}"),+ path: path.to_string(),+ line,+ degree: 1,+ });+ }+ text.push_str(&next);+ }+ text.push_str("//");+ while est_file(path, text.len() + 1) < tokens {+ text.push('x');+ }+ text.push('\n');+ assert_eq!(est_file(path, text.len()), tokens);+ text+ }++ /// Whether `big/a.rs` and `big/b.rs` (ranks 1 and 2, `tokens` estimated+ /// tokens each; `small/c.rs` third) go in whole, in a pack of `budget`+ /// with `extra` arguments; only chunks of the `part` given count.+ fn whole_top_two(budget: usize, tokens: usize, extra: Value, part: Option<&str>) -> [bool; 2] {+ let mut symbols = Vec::new();+ let mut files = BTreeMap::new();+ for (i, path) in ["big/a.rs", "big/b.rs"].iter().enumerate() {+ files.insert(path.to_string(), sized_file(path, tokens, i, &mut symbols));+ }+ files.insert("small/c.rs".to_string(), "fn small() {}\n".to_string());+ let ranking: Vec<(String, usize, usize)> = vec![+ ("big/a.rs".into(), 201, 210),+ ("big/b.rs".into(), 401, 410),+ ("small/c.rs".into(), 1, 1),+ ];+ let calls: Vec<(usize, usize)> = Vec::new();+ let mut args = json!({"question":"how is the widget computed","budget":budget});+ for (k, v) in extra.as_object().unwrap() {+ args[k] = v.clone();+ }+ let options = Options::parse(&args).unwrap();+ let counter = Counter::open(None, None).unwrap();+ let mut corpus = corpus(&files, &symbols, &calls, ranking);+ let pack = build(&mut corpus, &options, &counter).unwrap();+ let chunks: Vec<&Value> = pack["sections"]+ .as_array()+ .unwrap()+ .iter()+ .filter(|s| part.is_none_or(|part| s["part"] == part))+ .flat_map(|s| s["chunks"].as_array().unwrap())+ .collect();+ ["big/a.rs", "big/b.rs"].map(|path| {+ assert!(+ chunks.iter().any(|c| c["path"] == path),+ "{path} missing at {budget}"+ );+ chunks+ .iter()+ .any(|c| c["path"] == path && c["whole"] == true)+ })+ }++ /// The two whole-file rules at their edges: the last budget of the first+ /// (32,768) and the one past it, the first budget of the second and the+ /// token below it, and a file at its share and one token over it.+ /// (Estimated sizes, from the bytes, as the rules compare.)+ #[test]+ fn the_whole_file_rules_hold_at_their_edges() {+ let cases: [(&str, usize, usize, [bool; 2]); 8] = [+ ("rank 1 at 32,768", TOP_WHOLE_BUDGET, 6_000, [true, false]),+ (+ "rank 1 at 32,769",+ TOP_WHOLE_BUDGET + 1,+ 6_000,+ [false, false],+ ),+ ("rank 1 at half the budget", 32_768, 16_384, [true, false]),+ ("rank 1 one token over half", 32_768, 16_385, [false, false]),+ (+ "ranks 1-2 at the large tier's first budget",+ TOP_WHOLE_LARGE_BUDGET,+ 20_000,+ [true, true],+ ),+ (+ "ranks 1-2 one token below it",+ TOP_WHOLE_LARGE_BUDGET - 1,+ 20_000,+ [false, false],+ ),+ (+ "ranks 1-2 at a quarter of the budget",+ 200_000,+ 50_000,+ [true, true],+ ),+ (+ "ranks 1-2 one token over a quarter",+ 200_000,+ 50_001,+ [false, false],+ ),+ ];+ for (name, budget, tokens, expected) in cases {+ // Past the per-file caps either way, so only the rules hold a file whole.+ let sizing = Sizing::new(budget, false);+ assert!(+ tokens > sizing.whole_limit && tokens > sizing.per_file,+ "{name}"+ );+ assert_eq!(+ whole_top_two(budget, tokens, json!({}), None),+ expected,+ "{name}"+ );+ }+ }++ /// The cache layout's question part keeps the per-file caps at any+ /// budget: the top ranks that a standard pack holds whole at 30,000 (the+ /// first rank) and 200,000 (the first two) are excerpts there, as before+ /// the whole-file rules.+ #[test]+ fn the_cache_layouts_question_part_keeps_excerpts() {+ for (budget, tokens, standard) in [+ (30_000, 10_000, [true, false]),+ (200_000, 40_000, [true, true]),+ ] {+ assert_eq!(+ whole_top_two(budget, tokens, json!({}), None),+ standard,+ "{budget}"+ );+ let cache = json!({"layout":"cache","prefix_share":MIN_PREFIX_SHARE});+ assert_eq!(+ whole_top_two(budget, tokens, cache, Some("suffix")),+ [false, false],+ "{budget}"+ );+ }+ }++ /// `fix --budget 16384 --focus big.rs --focus b.rs:120`: with pinned+ /// passages the first rank keeps the per-file caps, so b.rs's passage+ /// keeps its room and its lines 100-140 are inside. (Taking a big.rs of+ /// under half the budget whole could leave b.rs a sliver of the room.)+ #[test]+ fn pinned_passages_keep_their_room() {+ let b: String = (1..=300)+ .map(|i| format!(" let b_{i:03} = widget_value({i:03});\n"))+ .collect();+ let focus = json!([+ {"path":"big.rs","start_line":1,"end_line":1_000_000},+ {"path":"b.rs","start_line":80,"end_line":160}+ ]);+ let ranking: Vec<(String, usize, usize)> =+ vec![("big.rs".into(), 1, 1_000_000), ("b.rs".into(), 80, 160)];+ // (big.rs whole, b.rs's lines 100-140 all inside)+ let held = |big_tokens: usize, pinned: bool| -> (bool, bool) {+ let mut big = String::new();+ let mut n = 0;+ while est_file("big.rs", big.len()) < big_tokens {+ n += 1;+ big.push_str(&format!(" w{n}();\n"));+ }+ let mut files = BTreeMap::new();+ files.insert("big.rs".to_string(), big);+ files.insert("b.rs".to_string(), b.clone());+ let symbols: Vec<Symbol> = Vec::new();+ let calls: Vec<(usize, usize)> = Vec::new();+ let mut options = Options::parse(&json!({"question":"why is the widget value wrong",+ "budget":16_384,"focus":focus}))+ .unwrap();+ assert!(options.pinned);+ options.pinned = pinned;+ let counter = Counter::open(None, None).unwrap();+ let mut corpus = corpus(&files, &symbols, &calls, ranking.clone());+ let pack = build(&mut corpus, &options, &counter).unwrap();+ let chunks: Vec<&Value> = pack["sections"]+ .as_array()+ .unwrap()+ .iter()+ .filter(|s| s["name"] == "focus")+ .flat_map(|s| s["chunks"].as_array().unwrap())+ .collect();+ let big_whole = chunks+ .iter()+ .any(|c| c["path"] == "big.rs" && c["whole"] == true);+ let inside = (100..=140).all(|line: u64| {+ chunks.iter().any(|c| {+ c["path"] == "b.rs"+ && c["start_line"].as_u64().unwrap() <= line+ && c["end_line"].as_u64().unwrap() >= line+ })+ });+ (big_whole, inside)+ };+ let sizes: Vec<usize> = (5_000..=8_192).step_by(32).collect();+ for &tokens in &sizes {+ assert_eq!(+ held(tokens, true),+ (false, true),+ "big.rs of {tokens} tokens"+ );+ }+ // Without the exception the first rank went in whole and b.rs lost lines.+ assert!(+ sizes+ .iter()+ .any(|&tokens| held(tokens, false) == (true, false)),+ "no squeeze found"+ );+ }++ /// `--format xml`: an HTML page's own `</section>` (and `</file>`) goes+ /// in a CDATA section, so it never closes the pack's elements; a `]]>`+ /// in the page is split across two sections; other files are as before.+ #[test]+ fn an_html_page_never_closes_the_xml_packs_elements() {+ let mut files = BTreeMap::new();+ let page = "<!doctype html>\n<section id=\"shelf\">\n <p>Shelf ]]> list</p>\n</section>\n</file>\n";+ files.insert("web/page.html".to_string(), page.to_string());+ let code = "fn shelf() -> Vec<u8> {\n Vec::new()\n}\n";+ files.insert("src/shelf.rs".to_string(), code.to_string());+ let symbols: Vec<Symbol> = Vec::new();+ let calls: Vec<(usize, usize)> = Vec::new();+ let ranking: Vec<(String, usize, usize)> = vec![+ ("web/page.html".into(), 2, 4),+ ("src/shelf.rs".into(), 1, 3),+ ];+ let options = Options::parse(+ &json!({"question":"where is the shelf list","budget":4_000,"style":"xml"}),+ )+ .unwrap();+ let counter = Counter::open(None, None).unwrap();+ let mut corpus = corpus(&files, &symbols, &calls, ranking);+ let pack = build(&mut corpus, &options, &counter).unwrap();+ let chunk = |path: &str| -> (String, String) {+ let chunk = pack["sections"]+ .as_array()+ .unwrap()+ .iter()+ .flat_map(|s| s["chunks"].as_array().unwrap())+ .find(|c| c["path"] == path)+ .unwrap();+ (+ chunk["why"].as_str().unwrap().to_string(),+ chunk["text"].as_str().unwrap().to_string(),+ )+ };+ let (why, text) = chunk("web/page.html");+ assert_eq!(+ text,+ format!(+ "<file path=\"web/page.html\" lines=\"1-5\" why=\"{why}\">\n<![CDATA[\n\+ 1\t<!doctype html>\n2\t<section id=\"shelf\">\n3\t <p>Shelf ]]]]><![CDATA[> list</p>\n\+ 4\t</section>\n5\t</file>\n]]>\n</file>\n"+ )+ );+ let (why, text) = chunk("src/shelf.rs");+ assert_eq!(+ text,+ format!("<file path=\"src/shelf.rs\" lines=\"1-3\" why=\"{why}\">\n")+ + "1\tfn shelf() -> Vec<u8> {\n2\t Vec::new()\n3\t}\n</file>\n"+ );+ // Outside the CDATA sections, every element the pack opens it closes.+ let mut rest = super::text(&pack);+ while let Some(start) = rest.find("<![CDATA[") {+ let end = start + rest[start..].find("]]>").unwrap() + 3;+ rest.replace_range(start..end, "");+ }+ assert_eq!(+ rest.matches("<section ").count(),+ rest.matches("</section>").count()+ );+ assert_eq!(+ rest.matches("<file ").count(),+ rest.matches("</file>").count()+ );+ assert!(rest.matches("</section>").count() >= 2, "{rest}");+ }+#[test]fn overlapping_ranges_merge() {assert_eq!(@@ -6278,7 +6735,9 @@ mod tests {}/// The standard layout gives the bytes and JSON it gave before the- /// layouts (hashes taken at 50ebde1), plus the new fields.+ /// layouts (hashes taken at 50ebde1), plus the new fields; the+ /// 20,000-token pack's hashes are those of the first rank whole+ /// ([`TOP_WHOLE_BUDGET`]).#[test]fn the_standard_layout_is_unchanged_but_for_the_new_fields() {let goldens: [(&str, usize, Value, &str, &str); 6] = [@@ -6286,8 +6745,8 @@ mod tests {"how does F4x3 compute widgets",20_000,json!({}),- "a3fe4f1b8a832d51ebdbd3c82a6f5688bc4abdc9120931ff2f6bdb50decbd6de",- "ec0fcd4c739a584a137d16819673adc52b8213c7e7a392702e9a345cbcee6bd7",+ "5bf7af4c7acc2df6e8b141b66035b7721ec00032a53bc975ad9abce377369e8d",+ "ae55131b46d1cc9ee8522d6fb3676b18dacdb2c0a969335acb0430d18c4cf1b2",),("how does F4x3 compute widgets",diff --git a/crates/graphicle/src/documents.rs b/crates/graphicle/src/documents.rsindex a711ca2..ca3134b 100644--- a/crates/graphicle/src/documents.rs+++ b/crates/graphicle/src/documents.rs@@ -80,6 +80,39 @@ pub fn supported(name: &str) -> bool {| "webp")}++/// Whether a project folder's sync converts the file `name` to text: the+/// [`supported`] formats except HTML. A folder's `.html` and `.htm` files are+/// read as they are, like its other text files: they are templates and pages+/// that a change edits, so a pack, a search hit or an edit's search text+/// needs their own lines, which converted text does not keep. An upload's+/// HTML, and a page that the Confluence connector brings in, is still+/// converted ([`extract`]): it is a page to read, with no lines on disk to+/// point at. The GitHub and Google Drive connectors keep `.html` files as+/// they are. A folder's HTML file past the text-file limit, or one that is+/// not UTF-8 text (a Latin-1 or Shift-JIS page), is still converted, as+/// every one was before 0.1.10 ([`folder_html_converted`]).+pub fn converted_in_folder(name: &str) -> bool {+ supported(name) && !html(name)+}++/// Whether `name` is an HTML page by its extension (`.html`, `.htm`).+pub fn html(name: &str) -> bool {+ matches!(extension(name).as_str(), "html" | "htm")+}++/// Whether a project folder's HTML file of `size` bytes goes in as+/// converted text ([`extract`]) instead of as it is: past the text-file+/// limit `file_bytes`, or, once read, when its `contents` are not UTF-8+/// text.+pub fn folder_html_converted(size: u64, contents: Option<&[u8]>, file_bytes: usize) -> bool {+ size > file_bytes as u64 || contents.is_some_and(|bytes| !utf8_text(bytes))+}++/// Whether `bytes` read as a text file: UTF-8 without a NUL.+pub fn utf8_text(bytes: &[u8]) -> bool {+ std::str::from_utf8(bytes).is_ok_and(|text| !text.contains('\0'))+}fn extension(name: &str) -> String {Path::new(name).extension()@@ -721,6 +754,36 @@ impl Store {mod tests {use super::*;+ #[test]+ fn a_folder_reads_html_as_it_is_and_converts_other_documents() {+ for name in ["index.html", "page.HTM", "templates/view.htm"] {+ assert!(supported(name), "{name}");+ assert!(!converted_in_folder(name), "{name}");+ }+ for name in [+ "plan.docx",+ "sheet.xlsx",+ "report.pdf",+ "book.epub",+ "scan.png",+ ] {+ assert!(converted_in_folder(name), "{name}");+ }+ for name in ["main.rs", "README.md", "index.html.tmpl"] {+ assert!(!converted_in_folder(name), "{name}");+ }+ // HTML past the text-file limit or not UTF-8 is converted, as before.+ let utf8 = "<p>Caf\u{e9}</p>\n".as_bytes();+ let latin1 = b"<p>Caf\xe9</p>\n";+ let shift_jis = b"<p>\x82\xa0</p>\n";+ assert!(!folder_html_converted(100, None, 100));+ assert!(!folder_html_converted(100, Some(utf8), 100));+ assert!(folder_html_converted(101, None, 100));+ assert!(folder_html_converted(16, Some(latin1), 100));+ assert!(folder_html_converted(9, Some(shift_jis), 100));+ assert!(folder_html_converted(5, Some(b"<p>\0</p>"), 100));+ }+#[test]fn extracted_text_with_a_nul_is_refused() {let error = bounded("before\u{0}after".to_string()).unwrap_err();diff --git a/crates/graphicle/src/fresh.rs b/crates/graphicle/src/fresh.rsindex afbcdb1..e351b06 100644--- a/crates/graphicle/src/fresh.rs+++ b/crates/graphicle/src/fresh.rs@@ -79,6 +79,11 @@ const QUIET_WAIT: Duration = Duration::from_secs(120);const UNTIMED_FILES: usize = 2000;/// Changed paths kept as examples.const SAMPLE: usize = 10;+/// How a folder sync reads the folder's files into text, kept in its record+/// ([`Record::text`]). 1: a folder's `.html` and `.htm` files are kept as+/// they are on disk (0.1.10); syncs before it stored html2text's text of+/// them, which the first check after the upgrade finds changed.+const FOLDER_TEXT: u32 = 1;/// `freshness` in the configuration: `auto` checks and refreshes before/// answers, `off` never checks.@@ -146,6 +151,10 @@ struct Record {/// ([`local::converter`]); missing in records of earlier builds.#[serde(default, skip_serializing_if = "Option::is_none")]converter: Option<String>,+ /// The [`FOLDER_TEXT`] the sync read the folder's files with; 0 in+ /// records of earlier builds.+ #[serde(default)]+ text: u32,}/// A sync's view of its folder before it reads it. See [`mark`].@@ -196,6 +205,7 @@ pub(crate) fn record(// Every document of the snapshot was converted by this build, or// kept from a sync whose record named it ([`converted_here`]).converter: Some(local::converter()),+ text: FOLDER_TEXT,};write_record(db, workspace, folder, &record)}@@ -267,7 +277,9 @@ pub struct Check {/// Up to ten of those files, folder-relative.pub sample: Vec<String>,/// `git` when the git signature decided, `scan` when the folder was- /// scanned, empty without a folder.+ /// scanned, `text` when the last sync read some of the synced files+ /// otherwise than this build does (an earlier build's converted HTML),+ /// empty without a folder.pub method: &'static str,/// When the folder's last sync completed (RFC 3339).pub last_sync: Option<String>,@@ -404,6 +416,27 @@ fn check_at(check.elapsed = started.elapsed();return Ok(check);}+ // A sync by an earlier build (no record, or one before FOLDER_TEXT)+ // stored html2text's text of the folder's HTML: those files changed,+ // whatever the folder's times or git state say.+ if baseline+ .record+ .as_ref()+ .is_none_or(|record| record.text < FOLDER_TEXT)+ {+ let (converted, files) =+ store.authorized_read(&session.workspace, &session.capability, "read", |db, _| {+ converted_html(db, project)+ })?;+ if !converted.is_empty() {+ check.method = "text";+ check.changed = Some(converted.len());+ check.sample = converted.into_iter().take(SAMPLE).collect();+ check.files = files;+ check.elapsed = started.elapsed();+ return Ok(check);+ }+ }let record = baseline.record.filter(|record| record.snapshot == baseline.snapshot);@@ -453,6 +486,30 @@ fn check_at(Ok(check)}+/// The project's `.html` and `.htm` heads that hold converted text (an+/// `am_binary_heads` row names their original), and, when there are some,+/// how many heads it has.+fn converted_html(db: &Connection, project: &str) -> Result<(Vec<String>, usize)> {+ let mut statement = db.prepare(+ "SELECT b.path FROM am_binary_heads b JOIN repo_heads h ON h.repository_id=b.repository_id AND h.path=b.path AND h.sha256=b.source_sha WHERE b.repository_id=? ORDER BY b.path",+ )?;+ let html: Vec<String> = statement+ .query_map([project], |row| row.get::<_, String>(0))?+ .collect::<rusqlite::Result<Vec<String>>>()?+ .into_iter()+ .filter(|path| crate::documents::html(path))+ .collect();+ if html.is_empty() {+ return Ok((html, 0));+ }+ let files: i64 = db.query_row(+ "SELECT count(*) FROM repo_heads WHERE repository_id=?",+ [project],+ |row| row.get(0),+ )?;+ Ok((html, files as usize))+}+/// The files under `folder` (the sync's walk, [`local::folder_entries`]) whose inode changed after/// `since_ns`, and the synced files (`heads`, path to SHA-256) that are gone;/// `None` when the folder holds more than [`MAX_SCAN`] entries or the scan@@ -530,7 +587,7 @@ fn scan(/// synced. A document (whose synced text is extracted), a file over the/// sync's limit and an unreadable file never do.fn same_content(folder: &Path, relative: &str, name: &str, head: Option<&String>) -> bool {- if crate::documents::supported(name) {+ if crate::documents::converted_in_folder(name) {return false;}match (local::sync_view(folder, relative), head) {diff --git a/crates/graphicle/src/local.rs b/crates/graphicle/src/local.rsindex 4e99a7e..51f61fe 100644--- a/crates/graphicle/src/local.rs+++ b/crates/graphicle/src/local.rs@@ -453,15 +453,26 @@ pub(crate) fn sync_view(root: &Path, relative: &str) -> Option<Option<String>> {Err(error) if error.kind() == std::io::ErrorKind::NotFound => return Some(None),Err(_) => return None,};- if meta.file_type().is_symlink() || crate::documents::supported(name) {+ if meta.file_type().is_symlink() || crate::documents::converted_in_folder(name) {return None;}- if !meta.is_file() || meta.len() > crate::limits::current().file_bytes as u64 {+ // An HTML file the sync converts (past the text-file limit, or not+ // UTF-8) is a document: its synced text is extracted.+ let html = crate::documents::html(name);+ let file_bytes = crate::limits::current().file_bytes;+ if meta.is_file()+ && html+ && crate::documents::folder_html_converted(meta.len(), None, file_bytes)+ {+ return None;+ }+ if !meta.is_file() || meta.len() > file_bytes as u64 {return Some(None);}let bytes = std::fs::read(&path).ok()?;match String::from_utf8(bytes) {Ok(text) if !text.contains('\0') => Some(without_graphicle(relative, text)),+ _ if html => None,_ => Some(None),}}@@ -716,7 +727,13 @@ fn sync_folder_with(if meta.is_file() && !read_files.insert(file_key(path, &meta)) {continue;}- let is_document = crate::documents::supported(name);+ // A folder's HTML is read as it is, like its other text files, but+ // converted as a document when it is past the text-file limit (up to+ // the document limit) or, once read, not UTF-8 text.+ let html = crate::documents::html(name);+ let mut is_document = crate::documents::converted_in_folder(name)+ || (html+ && crate::documents::folder_html_converted(meta.len(), None, limits.file_bytes));let limit = if is_document {limits.document_bytes} else {@@ -762,6 +779,13 @@ fn sync_folder_with("A source grew during scanning; retry the sync",));}+ if html && !is_document {+ is_document = crate::documents::folder_html_converted(+ contents.len() as u64,+ Some(&contents),+ limits.file_bytes,+ );+ }let content = if is_document {// An unchanged original keeps the text this build extracted// from it (still within the text limit); others are converted.@@ -804,7 +828,7 @@ fn sync_folder_with(binary_bytes += contents.len();if binary_bytes > limits.folder_document_bytes {return Err(Error::bad(format!(- "This folder's documents exceed {} (PDF, Office, EPUB, HTML and image files together). Raise the limit with {}, or leave untracked ones out with .gitignore or .git/info/exclude (they cover only files Git does not track; graphicle config set sync.tracked_ignored false, or GRAPHICLE_SYNC_TRACKED_IGNORED=0, leaves out the tracked files they match too), or set up a subfolder: graphicle setup path/to/subfolder",+ "This folder's documents exceed {} (PDF, Office, EPUB and image files, and HTML files converted to text, together). Raise the limit with {}, or leave untracked ones out with .gitignore or .git/info/exclude (they cover only files Git does not track; graphicle config set sync.tracked_ignored false, or GRAPHICLE_SYNC_TRACKED_IGNORED=0, leaves out the tracked files they match too), or set up a subfolder: graphicle setup path/to/subfolder",crate::limits::size(limits.folder_document_bytes),crate::limits::raise("folder_document_bytes"))));diff --git a/crates/graphicle/src/model.rs b/crates/graphicle/src/model.rsindex 6ba5f93..30bf55b 100644--- a/crates/graphicle/src/model.rs+++ b/crates/graphicle/src/model.rs@@ -362,6 +362,7 @@ impl Config {"fix.test must be a command of at most 4096 characters, and fix.timeout_seconds 1 to 86400",));}+ let mut clear_text_key = None;for (name, p) in &self.models {if name.is_empty()|| name.len() > 100@@ -452,7 +453,10 @@ impl Config {if p.protocol == "local_onnx" {crate::local_inference::validate(p)?;} else {- provider_url(&p.base_url, p.key_env.is_some())?;+ let url = provider_url(&p.base_url, p.key_env.is_some())?;+ if p.key_env.is_some() && url.scheme() == "http" && !loopback(&url) {+ clear_text_key = url.host_str().map(str::to_string);+ }}if p.key_env.as_ref().is_some_and(|key| {key.is_empty()@@ -474,6 +478,9 @@ impl Config {return Err(Error::bad("Default model is not configured"));}}+ if let Some(host) = clear_text_key {+ warn_clear_text_key(&host);+ }Ok(())}pub fn status(&self) -> Value {@@ -526,19 +533,36 @@ fn bare(url: &url::Url) -> bool {&& url.fragment().is_none()}-/// Opt-in plain-HTTP model hosts (EVAL_PLAN R5, P-URL): a model server on a-/// private network, such as a vLLM host, that serves no TLS. The variable-/// lists exact host names or IP addresses, separated by commas or spaces,-/// without scheme, port or path (IPv6 in brackets, as in a URL). Only model-/// profiles read it.+/// Opt-in plain-HTTP model hosts: a model server on a private network, such+/// as a vLLM host, that serves no TLS. The variable lists exact host names or+/// IP addresses, separated by commas or spaces, without scheme, port or path+/// (IPv6 in brackets, as in a URL). Only model profiles read it.pub const PROVIDER_HTTP_HOSTS: &str = "GRAPHICLE_PROVIDER_HTTP_HOSTS";+/// Opt-in plain-HTTP model hosts that may also receive a profile's credential+/// (`key_env`), which then crosses the network in clear text. The same syntax+/// and exact matching as [`PROVIDER_HTTP_HOSTS`]; a host listed here counts as+/// listed there too. Unset by default; only model profiles read it.+pub const PROVIDER_HTTP_KEY_HOSTS: &str = "GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS";+/// The hosts [`PROVIDER_HTTP_HOSTS`] lists; an entry that is not exactly a/// host is refused rather than ignored.pub fn provider_http_hosts() -> Result<Vec<String>> {- http_hosts(&std::env::var(PROVIDER_HTTP_HOSTS).unwrap_or_default())+ http_hosts(+ PROVIDER_HTTP_HOSTS,+ &std::env::var(PROVIDER_HTTP_HOSTS).unwrap_or_default(),+ )+}+/// The hosts [`PROVIDER_HTTP_KEY_HOSTS`] lists, read by the same rule.+pub fn provider_http_key_hosts() -> Result<Vec<String>> {+ http_hosts(+ PROVIDER_HTTP_KEY_HOSTS,+ &std::env::var(PROVIDER_HTTP_KEY_HOSTS).unwrap_or_default(),+ )}-fn http_hosts(value: &str) -> Result<Vec<String>> {+/// The exact hosts that `value`, the value of the environment variable+/// `variable`, lists.+fn http_hosts(variable: &str, value: &str) -> Result<Vec<String>> {value.split(|c: char| c == ',' || c.is_whitespace()).filter(|entry| !entry.is_empty())@@ -557,7 +581,7 @@ fn http_hosts(value: &str) -> Result<Vec<String>> {.map(|_| entry.to_string()).ok_or_else(|| {Error::bad(format!(- "{PROVIDER_HTTP_HOSTS} lists exact hosts (lowercase names or IP addresses, without scheme, port or path); {entry:?} is not one"+ "{variable} lists exact hosts (lowercase names or IP addresses, without scheme, port or path); {entry:?} is not one"))})})@@ -565,22 +589,33 @@ fn http_hosts(value: &str) -> Result<Vec<String>> {}/// A model profile's base URL: [`checked_url`]'s rule, or plain HTTP to a host-/// [`PROVIDER_HTTP_HOSTS`] lists, matched exactly. A profile that sends a-/// credential (`key_env`) never uses plain HTTP off loopback.+/// that [`PROVIDER_HTTP_HOSTS`] or [`PROVIDER_HTTP_KEY_HOSTS`] lists, matched+/// exactly. A profile that sends a credential (`key_env`) uses plain HTTP off+/// loopback only to a host that [`PROVIDER_HTTP_KEY_HOSTS`] lists.pub fn provider_url(value: &str, credential: bool) -> Result<url::Url> {- provider_url_with(value, credential, &provider_http_hosts()?)+ provider_url_with(+ value,+ credential,+ &provider_http_hosts()?,+ &provider_http_key_hosts()?,+ )}-pub fn provider_url_with(value: &str, credential: bool, hosts: &[String]) -> Result<url::Url> {+pub fn provider_url_with(+ value: &str,+ credential: bool,+ hosts: &[String],+ key_hosts: &[String],+) -> Result<url::Url> {let url = url::Url::parse(value).map_err(|_| Error::bad("Invalid provider URL"))?;- let listed = url.scheme() == "http"- && !loopback(&url)- && url- .host_str()- .is_some_and(|host| hosts.iter().any(|h| h == host));+ let plain = url+ .host_str()+ .filter(|_| url.scheme() == "http" && !loopback(&url));+ let keyed = plain.is_some_and(|host| key_hosts.iter().any(|h| h == host));+ let listed = keyed || plain.is_some_and(|host| hosts.iter().any(|h| h == host));if !listed {return checked_url(value).map_err(|_| {Error::bad(format!(- "Use HTTPS, HTTP on loopback, or HTTP to a host listed in {PROVIDER_HTTP_HOSTS}, without credentials or a query in the URL"+ "Use HTTPS, HTTP on loopback, or HTTP to a host listed in {PROVIDER_HTTP_HOSTS} ({PROVIDER_HTTP_KEY_HOSTS} for a profile with key_env), without credentials or a query in the URL"))});}@@ -589,13 +624,24 @@ pub fn provider_url_with(value: &str, credential: bool, hosts: &[String]) -> Res"A provider URL carries no credentials, query or fragment",));}- if credential {+ if credential && !keyed {return Err(Error::bad(format!(- "A provider credential (key_env) is never sent over plain HTTP: use HTTPS for this host, or remove key_env (hosts in {PROVIDER_HTTP_HOSTS} serve without one)"+ "A provider credential (key_env) is sent over plain HTTP only to a host listed in {PROVIDER_HTTP_KEY_HOSTS}: use HTTPS, list the host there, or remove key_env")));}Ok(url)}+/// One line on stderr, at most once per process, when a model profile's+/// credential goes to `host` over plain HTTP because+/// [`PROVIDER_HTTP_KEY_HOSTS`] lists it.+fn warn_clear_text_key(host: &str) {+ static WARNED: std::sync::Once = std::sync::Once::new();+ WARNED.call_once(|| {+ eprintln!(+ "graphicle: a model profile sends its key (key_env) to {host} over plain HTTP, in clear text, because {PROVIDER_HTTP_KEY_HOSTS} lists that host"+ );+ });+}pub fn client() -> Result<reqwest::Client> {client_with_timeout(Duration::from_secs(180))}@@ -2141,22 +2187,26 @@ mod tests {assert_eq!(parsed.worker_concurrency, 1);}- /// P-URL (EVAL_PLAN R5): a model profile reaches a plain-HTTP host only- /// when `GRAPHICLE_PROVIDER_HTTP_HOSTS` lists that exact host, and never- /// with a credential; HTTPS, loopback and every other URL rule stay.+ /// A model profile reaches a plain-HTTP host only when+ /// `GRAPHICLE_PROVIDER_HTTP_HOSTS` lists that exact host, and sends no+ /// credential there unless `GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS` lists it;+ /// HTTPS, loopback and every other URL rule stay.#[test]fn plain_http_model_hosts_are_exact_opt_ins_without_credentials() {- let hosts = http_hosts("192.168.210.33, vllm.internal\n[fd00::7]").unwrap();+ let list = "192.168.210.33, vllm.internal\n[fd00::7]";+ let hosts = http_hosts(super::PROVIDER_HTTP_HOSTS, list).unwrap();assert_eq!(hosts, ["192.168.210.33", "vllm.internal", "[fd00::7]"]);for url in ["http://192.168.210.33:8000/v1","http://vllm.internal/v1","http://[fd00::7]:9000/v1",] {- assert!(provider_url_with(url, false, &hosts).is_ok(), "{url}");- let refused = provider_url_with(url, true, &hosts).unwrap_err();+ assert!(provider_url_with(url, false, &hosts, &[]).is_ok(), "{url}");+ let refused = provider_url_with(url, true, &hosts, &[]).unwrap_err();assert!(- refused.message.contains("never sent over plain HTTP"),+ refused+ .message+ .contains("GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS"),"{url}: {}",refused.message);@@ -2170,30 +2220,79 @@ mod tests {"http://internal/v1","http://[fd00::8]/v1",] {- let refused = provider_url_with(url, false, &hosts).unwrap_err();+ let refused = provider_url_with(url, false, &hosts, &[]).unwrap_err();assert!(refused.message.contains("GRAPHICLE_PROVIDER_HTTP_HOSTS"),"{url}: {}",refused.message);}- // Without the list, plain HTTP off loopback is refused as before;+ // Without the lists, plain HTTP off loopback is refused as before;// HTTPS and loopback HTTP keep working, with or without a credential.- assert!(provider_url_with("http://192.168.210.33/v1", false, &[]).is_err());- assert!(provider_url_with("https://api.example.com/v1", true, &[]).is_ok());- assert!(provider_url_with("http://127.0.0.1:11434", true, &[]).is_ok());+ assert!(provider_url_with("http://192.168.210.33/v1", false, &[], &[]).is_err());+ assert!(provider_url_with("https://api.example.com/v1", true, &[], &[]).is_ok());+ assert!(provider_url_with("http://127.0.0.1:11434", true, &[], &[]).is_ok());// A listed host still takes no user, query or fragment in its URL.for url in ["http://[email protected]/v1","http://vllm.internal/v1?key=x","http://vllm.internal/v1#part",] {- assert!(provider_url_with(url, false, &hosts).is_err(), "{url}");+ assert!(provider_url_with(url, false, &hosts, &[]).is_err(), "{url}");+ assert!(provider_url_with(url, true, &[], &hosts).is_err(), "{url}");}- // Connectors and OAuth use the strict rule, whatever the list says.+ // Connectors and OAuth use the strict rule, whatever the lists say.assert!(checked_url("http://192.168.210.33:8000/v1").is_err());}+ /// `GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS` lets a profile send its credential+ /// over plain HTTP to an exact host it lists, which also serves profiles+ /// without one. A host that only `GRAPHICLE_PROVIDER_HTTP_HOSTS` lists, or+ /// that neither lists, still refuses a credential.+ #[test]+ fn plain_http_credentials_go_only_to_hosts_listed_for_them() {+ let keyed = "192.168.210.33 [fd00::7] gpu.lan";+ let key_hosts = http_hosts(super::PROVIDER_HTTP_KEY_HOSTS, keyed).unwrap();+ let hosts = http_hosts(super::PROVIDER_HTTP_HOSTS, "vllm.internal").unwrap();+ for url in [+ "http://192.168.210.33:8000/v1",+ "http://[fd00::7]:9000/v1",+ "http://gpu.lan/v1",+ ] {+ for credential in [true, false] {+ let accepted = provider_url_with(url, credential, &[], &key_hosts);+ assert!(accepted.is_ok(), "{url} {credential}");+ let accepted = provider_url_with(url, credential, &hosts, &key_hosts);+ assert!(accepted.is_ok(), "{url} {credential}");+ }+ }+ // Listed only for plain HTTP without a credential, or listed nowhere.+ for url in [+ "http://vllm.internal/v1",+ "http://192.168.210.34:8000/v1",+ "http://api.gpu.lan/v1",+ ] {+ let refused = provider_url_with(url, true, &hosts, &key_hosts).unwrap_err();+ assert!(+ refused+ .message+ .contains("GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS"),+ "{url}: {}",+ refused.message+ );+ }+ // HTTPS and loopback HTTP are unchanged by the list.+ for url in ["https://api.example.com/v1", "http://127.0.0.1:11434/v1"] {+ assert!(+ provider_url_with(url, true, &[], &key_hosts).is_ok(),+ "{url}"+ );+ }+ // Connectors and OAuth keep the strict rule for a host listed here.+ assert!(checked_url("http://192.168.210.33:8000/v1").is_err());+ assert!(checked_url("http://gpu.lan/v1").is_err());+ }+#[test]fn plain_http_reaches_every_loopback_address_and_nothing_else() {for url in [@@ -2205,7 +2304,7 @@ mod tests {"http://[::ffff:127.0.0.1]:8080/v1",] {assert!(checked_url(url).is_ok(), "{url}");- assert!(provider_url_with(url, true, &[]).is_ok(), "{url}");+ assert!(provider_url_with(url, true, &[], &[]).is_ok(), "{url}");}for url in ["http://128.0.0.1/v1",@@ -2221,25 +2320,32 @@ mod tests {}#[test]- fn the_plain_http_host_list_takes_exact_hosts_only() {- assert!(http_hosts("").unwrap().is_empty());- assert!(http_hosts(" , ").unwrap().is_empty());- for entry in [- "vllm.internal:8000",- "http://vllm.internal",- "vllm.internal/v1",- "*.internal",- "[email protected]",- "VLLM.internal",- "192.168.010.033",- "fd00::7",+ fn the_plain_http_host_lists_take_exact_hosts_only() {+ for variable in [+ "GRAPHICLE_PROVIDER_HTTP_HOSTS",+ "GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS",] {- let refused = http_hosts(entry).unwrap_err();- assert!(- refused.message.contains("GRAPHICLE_PROVIDER_HTTP_HOSTS"),- "{entry}: {}",- refused.message- );+ assert!(http_hosts(variable, "").unwrap().is_empty());+ assert!(http_hosts(variable, " , ").unwrap().is_empty());+ for entry in [+ "vllm.internal:8000",+ "http://vllm.internal",+ "vllm.internal/v1",+ "*.internal",+ "[email protected]",+ "VLLM.internal",+ "192.168.010.033",+ "fd00::7",+ ] {+ let refused = http_hosts(variable, entry).unwrap_err();+ assert!(+ refused+ .message+ .starts_with(&format!("{variable} lists exact hosts")),+ "{entry}: {}",+ refused.message+ );+ }}}/// A long-context call to the Meta Model API asks for the profile'sdiff --git a/crates/graphicle/src/notes_first.rs b/crates/graphicle/src/notes_first.rsindex d1a55cf..571e587 100644--- a/crates/graphicle/src/notes_first.rs+++ b/crates/graphicle/src/notes_first.rs@@ -90,7 +90,9 @@ pub fn names_code(question: &str) -> bool {}/// A note or document by its file name: Markdown, plain text,-/// reStructuredText, AsciiDoc, Org, PDF, Word or HTML.+/// reStructuredText, AsciiDoc, Org, PDF or Word. Not HTML: a folder's+/// `.html` and `.htm` files are kept as markup (no `#` headings), and are+/// pages and templates rather than notes.pub fn note_path(path: &str) -> bool {let name = path.rsplit('/').next().unwrap_or(path);let Some((_, extension)) = name.rsplit_once('.') else {@@ -98,17 +100,7 @@ pub fn note_path(path: &str) -> bool {};matches!(extension.to_ascii_lowercase().as_str(),- "md" | "markdown"- | "mdx"- | "txt"- | "text"- | "rst"- | "adoc"- | "org"- | "pdf"- | "docx"- | "html"- | "htm"+ "md" | "markdown" | "mdx" | "txt" | "text" | "rst" | "adoc" | "org" | "pdf" | "docx")}@@ -393,6 +385,7 @@ mod tests {fn notes_are_named_by_file_folder_and_headings() {assert!(note_path("notes/build-checklist.md") && note_path("docs/a.rst"));assert!(!note_path("src/query.rs") && !note_path("Makefile"));+ assert!(!note_path("templates/index.html") && !note_path("docs/OLD.HTM"));assert_eq!(stems(&name_text("docs/guides/install-step3/GUIDE.md")),stems("GUIDE install-step3")diff --git a/crates/graphicle/src/review.rs b/crates/graphicle/src/review.rsindex 381779a..4237774 100644--- a/crates/graphicle/src/review.rs+++ b/crates/graphicle/src/review.rs@@ -725,6 +725,110 @@ fn quiet_mentions(text: &str) -> String {out}+/// `text` with `&`, `<` and `>` as HTML entities outside Markdown code, which+/// stays as it is: fenced code blocks (``` or ~~~) and code spans (a run of+/// backticks up to the next run of the same length in its paragraph).+/// GitHub renders raw HTML in a comment (an `<img>`, a `<!--` that hides the+/// rest), so the model's text shows as it was written.+fn escape_markup(text: &str) -> String {+ let mut out = String::with_capacity(text.len());+ let mut i = 0;+ while let Some(c) = text[i..].chars().next() {+ if (i == 0 || text.as_bytes()[i - 1] == b'\n')+ && let Some(end) = fence_end(text, i)+ {+ out.push_str(&text[i..end]);+ i = end;+ continue;+ }+ if c == '`' {+ let run = backticks(&text[i..]);+ let block = paragraph_end(text, i);+ // A run with no closing run of its length is literal backticks.+ let mut end = i + run;+ let mut from = i + run;+ while let Some(at) = text[from..block].find('`').map(|at| from + at) {+ let len = backticks(&text[at..]);+ if len == run {+ end = at + len;+ break;+ }+ from = at + len;+ }+ out.push_str(&text[i..end]);+ i = end;+ continue;+ }+ match c {+ '&' => out.push_str("&"),+ '<' => out.push_str("<"),+ '>' => out.push_str(">"),+ c => out.push(c),+ }+ i += c.len_utf8();+ }+ out+}++fn backticks(text: &str) -> usize {+ text.bytes().take_while(|&b| b == b'`').count()+}++/// Where the paragraph that holds `from` ends: at the line break before the+/// next blank line, else at the end of `text`.+fn paragraph_end(text: &str, from: usize) -> usize {+ let mut at = from;+ while let Some(n) = text[at..].find('\n').map(|n| at + n) {+ let next = &text[n + 1..];+ if next[..next.find('\n').unwrap_or(next.len())]+ .trim()+ .is_empty()+ {+ return n;+ }+ at = n + 1;+ }+ text.len()+}++/// The end of the fenced code block that opens on the line at `start` (up to+/// three spaces, then three or more backticks or tildes): after its closing+/// fence, else the end of `text`. `None` when no fence opens there.+fn fence_end(text: &str, start: usize) -> Option<usize> {+ let line_end = |from: usize| text[from..].find('\n').map_or(text.len(), |n| from + n + 1);+ // The run of `mark` that a line opens with, and where it ends.+ let fence = |line: &str, mark: char| -> Option<(usize, usize)> {+ let line = line.trim_end_matches(['\n', '\r']);+ let indent = line.len() - line.trim_start_matches(' ').len();+ let rest = &line[indent..];+ let run = rest.len() - rest.trim_start_matches(mark).len();+ (indent <= 3 && run >= 3).then_some((run, indent + run))+ };+ let first = &text[start..line_end(start)];+ let mark = first.trim_start_matches(' ').chars().next()?;+ if mark != '`' && mark != '~' {+ return None;+ }+ let (run, info) = fence(first, mark)?;+ // A backtick fence's info string holds no backtick (that is a code span).+ if mark == '`' && first[info..].contains('`') {+ return None;+ }+ let mut at = line_end(start);+ while at < text.len() {+ let end = line_end(at);+ let line = &text[at..end];+ if let Some((close, after)) = fence(line, mark)+ && close >= run+ && line[after..].trim().is_empty()+ {+ return Some(end);+ }+ at = end;+ }+ Some(text.len())+}+fn cite_list(comment: &Value, valid: bool) -> Vec<String> {comment["evidence"].as_array()@@ -742,12 +846,12 @@ fn github_comment_body(comment: &Value) -> String {.into_iter().map(|c| format!("`{c}`")).collect();- quiet_mentions(&format!(+ quiet_mentions(&escape_markup(&format!("**{}**: {}\n\nEvidence: {}",comment["severity"].as_str().unwrap_or("minor"),comment["body"].as_str().unwrap_or(""),cites.join(", ")- ))+ )))}/// The body of GitHub's create-a-review call: a `COMMENT` review at the@@ -788,7 +892,7 @@ pub fn github_review(report: &Value, prefix: &str) -> Value {body.push_str(&format!("\n\nUsage: {line}"));}json!({"commit_id":report["head"],"event":"COMMENT",- "body":clip(&quiet_mentions(&body), 60_000),"comments":comments})+ "body":clip(&quiet_mentions(&escape_markup(&body)), 60_000),"comments":comments})}/// The report for a terminal.@@ -1285,6 +1389,44 @@ index 9999999..aaaaaaa 100644assert!(summary.contains("1 inline comment(s); 1 withheld"));}+ /// The review's body, its comments and so the step summary (the body)+ /// show the model's markup as text: `&`, `<` and `>` are escaped outside+ /// code spans, which stay as they are.+ #[test]+ fn the_github_review_escapes_markup_outside_code_spans() {+ let report = json!({"result":"reviewed","merge_base":"0123456789abcdef","head":"fedcba9876543210ffff",+ "summary":"<img src=x><!--h--> and `a < b && c > d`.",+ "comments":[{"path":"web/page.html","line":6,"severity":"major",+ "body":"<img src=x><!--h--> R&D: keep ``Vec<u8> & `x` `` and `if a<b {}`; a lone ` <b>",+ "evidence":[{"cite":"web/page.html:3","valid":true}]}],+ "flagged":[],"dropped":[]});+ let review = github_review(&report, "");+ assert_eq!(+ review["comments"][0]["body"],+ "**major**: <img src=x><!--h--> R&D: keep ``Vec<u8> & `x` `` and `if a<b {}`; a lone ` <b>\n\nEvidence: `web/page.html:3`"+ );+ let summary = review["body"].as_str().unwrap();+ assert!(+ summary.contains(".\n\n<img src=x><!--h--> and `a < b && c > d`."),+ "{summary}"+ );+ assert_eq!(+ escape_markup("<img src=x><!--h-->"),+ "<img src=x><!--h-->"+ );+ assert_eq!(escape_markup("`<b>` & ```<i>```"), "`<b>` & ```<i>```");+ // A code span ends with its paragraph; a fenced block may hold blank lines.+ assert_eq!(+ escape_markup("a ` b <i>\n\n`c` <u>"),+ "a ` b <i>\n\n`c` <u>"+ );+ assert_eq!(+ escape_markup("```suggestion\nif a < b {\n\n c >> 1;\n}\n```\n<b>"),+ "```suggestion\nif a < b {\n\n c >> 1;\n}\n```\n<b>"+ );+ assert_eq!(escape_markup("~~~\n<x>\n"), "~~~\n<x>\n");+ }+#[test]fn affected_modules_come_from_the_architecture() {let pack = json!({"sections":[{"name":"architecture","part":"prefix","chunks":[{"text":diff --git a/crates/graphicle/tests/it/core_limits.rs b/crates/graphicle/tests/it/core_limits.rsindex d8712b9..676c145 100644--- a/crates/graphicle/tests/it/core_limits.rs+++ b/crates/graphicle/tests/it/core_limits.rs@@ -664,6 +664,68 @@ fn connector_and_uploaded_documents_take_the_document_text_limit() {assert!(uploaded["source_id"].is_string(), "{uploaded}");}+/// A folder's HTML is read as it is when it is UTF-8 text within+/// `file_bytes`; one past `file_bytes` (up to `document_bytes`) or not UTF-8+/// (a Latin-1 or Shift-JIS page, which earlier versions indexed) is+/// converted to text, as every HTML file was before 0.1.10, and nothing is+/// dropped.+#[test]+fn a_folders_html_past_the_file_limit_or_not_utf8_is_converted() {+ let mut f = Fixture::new(small());+ let page = "<html><body><p>The aurora marker lives here.</p></body></html>\n";+ let big = format!(+ "<html><body>\n{}</body></html>\n",+ "<p>The meteor marker lives here.</p>\n".repeat(1_800)+ );+ assert!(big.len() > 64 * 1024);+ f.write("page.html", page);+ f.write("big.html", &big);+ f.write(+ "latin.htm",+ b"<html><body><p>Caf\xe9 au lait: the zenith marker lives here.</p></body></html>\n",+ );+ f.write(+ "sjis.html",+ b"<html><body><p>\x82\xa0\x82\xa2: the nadir marker lives here.</p></body></html>\n",+ );+ let synced = f.sync().unwrap();+ assert_eq!(synced["binary_documents"], 3, "{synced}");+ assert_eq!(synced["excluded"], 0, "{synced}");+ let repository = s(&synced, "repository_id").to_string();+ let stored = |path: &str| -> (String, i64) {+ f.store+ .read(|db| {+ Ok(db.query_row(+ "SELECT o.content,(SELECT count(*) FROM am_binary_heads b WHERE b.repository_id=h.repository_id AND b.path=h.path) FROM repo_heads h JOIN repo_objects o ON o.repository_id=h.repository_id AND o.sha256=h.sha256 WHERE h.repository_id=? AND h.path=?",+ rusqlite::params![repository, path],+ |row| Ok((row.get::<_, String>(0)?, row.get::<_, i64>(1)?)),+ )?)+ })+ .unwrap()+ };+ assert_eq!(stored("page.html"), (page.to_string(), 0));+ for (path, marker) in [+ ("big.html", "meteor marker"),+ ("latin.htm", "zenith marker"),+ ("sjis.html", "nadir marker"),+ ] {+ let (text, converted) = stored(path);+ assert!(+ text.contains(marker) && !text.contains("<p>"),+ "{path}: {text}"+ );+ assert_eq!(converted, 1, "{path}");+ }+ // Past document_bytes, an HTML file is left out and listed.+ f.store = f.store.clone().with_limits(Limits {+ document_bytes: 32 * 1024,+ ..small()+ });+ let synced = f.sync().unwrap();+ let skipped = paths(&synced["skipped"]);+ assert!(skipped.contains(&"big.html"), "{synced}");+}+/// On a file system that ignores case (macOS, Windows), Git matches ignore/// patterns without case (`core.ignorecase`) while the sync's walk matches/// them with case: a tracked `src/Foo.js` that `.gitignore`'s `foo.js`diff --git a/crates/graphicle/tests/it/freshness.rs b/crates/graphicle/tests/it/freshness.rsindex e7f00e9..848b055 100644--- a/crates/graphicle/tests/it/freshness.rs+++ b/crates/graphicle/tests/it/freshness.rs@@ -689,6 +689,23 @@ async fn http_mcp_tool_calls_sync_changed_files_before_answering() {assert_ne!(h.state(&project).0, before);}+/// A Word document of one paragraph, `text`.+fn docx(text: &str) -> Vec<u8> {+ use std::io::Write;+ let mut zip = zip::ZipWriter::new(std::io::Cursor::new(Vec::new()));+ zip.start_file(+ "word/document.xml",+ zip::write::SimpleFileOptions::default(),+ )+ .unwrap();+ write!(+ zip,+ "<w:document xmlns:w='w'><w:body><w:p><w:r><w:t>{text}</w:t></w:r></w:p></w:body></w:document>"+ )+ .unwrap();+ zip.finish().unwrap().into_inner()+}+/// A sync of an unchanged folder converts no document again: an unchanged/// original keeps the text this build extracted from it, and the result is/// the same. A changed document and a record of an earlier build convert@@ -700,11 +717,7 @@ fn an_unchanged_sync_converts_no_document_again() {let root = dir.path().canonical().unwrap().join("docs");std::fs::create_dir_all(&root).unwrap();std::fs::write(root.join("a.py"), A_V1).unwrap();- std::fs::write(- root.join("guide.html"),- "<html><body><h1>Guide</h1><p>Alpha runs first.</p></body></html>",- )- .unwrap();+ std::fs::write(root.join("guide.docx"), docx("Alpha runs first.")).unwrap();std::fs::write(root.join("diagram.png"), b"\x89PNG\r\n\x1a\nnot an image").unwrap();let store = Store::open(dir.path().join("data")).unwrap();let mut session = graphicle_runtime::local::session(&store, true).unwrap();@@ -715,7 +728,7 @@ fn an_unchanged_sync_converts_no_document_again() {store.transaction(|db| {db.execute(- "UPDATE am_binary_heads SET parser=? WHERE path='guide.html'",+ "UPDATE am_binary_heads SET parser=? WHERE path='guide.docx'",[parser],)?;Ok(())@@ -726,7 +739,7 @@ fn an_unchanged_sync_converts_no_document_again() {store.read(|db| {Ok(db.query_row(- "SELECT parser FROM am_binary_heads WHERE path='guide.html'",+ "SELECT parser FROM am_binary_heads WHERE path='guide.docx'",[],|row| row.get(0),)?)@@ -749,14 +762,14 @@ fn an_unchanged_sync_converts_no_document_again() {let first = sync(&mut session);assert_eq!(first["binary_documents"], 1, "{first:#}");assert_eq!(first["skipped"][0]["path"], "diagram.png", "{first:#}");- assert_eq!(parser(), "html2text");- // Unchanged: the page's head is kept as it is, and nothing differs.+ assert_eq!(parser(), "rust-office-xml");+ // Unchanged: the document's head is kept as it is, and nothing differs.mark("kept");let second = sync(&mut session);assert_eq!(second["replayed"], true, "{second:#}");same(&first, &second);assert_eq!(parser(), "kept");- // A record of an earlier build: the page is converted again.+ // A record of an earlier build: the document is converted again.let project = s(&first, "repository_id").to_string();store.transaction(|db| {@@ -769,21 +782,17 @@ fn an_unchanged_sync_converts_no_document_again() {.unwrap();let third = sync(&mut session);same(&first, &third);- assert_eq!(parser(), "html2text");- // A changed page is converted again, and its new text is synced.+ assert_eq!(parser(), "rust-office-xml");+ // A changed document is converted again, and its new text is synced.mark("kept");- std::fs::write(- root.join("guide.html"),- "<html><body><h1>Guide</h1><p>Beta runs first.</p></body></html>",- )- .unwrap();+ std::fs::write(root.join("guide.docx"), docx("Beta runs first.")).unwrap();let fourth = sync(&mut session);assert_ne!(fourth["snapshot"], first["snapshot"]);- assert_eq!(parser(), "html2text");+ assert_eq!(parser(), "rust-office-xml");let text: String = store.read(|db| {Ok(db.query_row(- "SELECT o.content FROM repo_heads h JOIN repo_objects o ON o.repository_id=h.repository_id AND o.sha256=h.sha256 WHERE h.repository_id=? AND h.path='guide.html'",+ "SELECT o.content FROM repo_heads h JOIN repo_objects o ON o.repository_id=h.repository_id AND o.sha256=h.sha256 WHERE h.repository_id=? AND h.path='guide.docx'",[&project],|row| row.get(0),)?)@@ -792,6 +801,165 @@ fn an_unchanged_sync_converts_no_document_again() {assert!(text.contains("Beta runs first."), "{text}");}+/// A folder's HTML files are text files: the sync keeps each one as it is on+/// disk (no conversion, no original kept apart), and a pack quotes its lines+/// with their own numbers, so an edit of the template can match them.+#[test]+fn a_folders_html_is_synced_and_packed_as_it_is() {+ let dir = TempDir::new().unwrap();+ let root = dir.path().canonical().unwrap().join("site");+ std::fs::create_dir_all(root.join("templates")).unwrap();+ std::fs::write(root.join("a.py"), A_V1).unwrap();+ let page = "<!doctype html>\n<html>\n<body>\n <h1>Library</h1>\n <ul class=\"shelf-list\">\n {% for book in shelf %}\n <li data-isbn=\"{{ book.isbn }}\">{{ book.title }}</li>\n {% endfor %}\n </ul>\n</body>\n</html>\n";+ std::fs::write(root.join("templates/shelf.html"), page).unwrap();+ std::fs::write(root.join("old.HTM"), "<p>Old page</p>\n").unwrap();+ std::fs::write(root.join("guide.docx"), docx("Shelves list books.")).unwrap();+ let store = Store::open(dir.path().join("data")).unwrap();+ let mut session = graphicle_runtime::local::session(&store, true).unwrap();+ let synced = graphicle_runtime::local::sync(&store, &mut session, &root, None).unwrap();+ // Only the Word document is a converted document.+ assert_eq!(synced["binary_documents"], 1, "{synced:#}");+ let project = s(&synced, "repository_id").to_string();+ let stored = |path: &str| -> (String, i64) {+ store+ .read(|db| {+ Ok(db.query_row(+ "SELECT o.content,(SELECT count(*) FROM am_binary_heads b WHERE b.repository_id=h.repository_id AND b.path=h.path) FROM repo_heads h JOIN repo_objects o ON o.repository_id=h.repository_id AND o.sha256=h.sha256 WHERE h.repository_id=? AND h.path=?",+ rusqlite::params![project, path],+ |row| Ok((row.get::<_, String>(0)?, row.get::<_, i64>(1)?)),+ )?)+ })+ .unwrap()+ };+ assert_eq!(stored("templates/shelf.html"), (page.to_string(), 0));+ assert_eq!(stored("old.HTM"), ("<p>Old page</p>\n".to_string(), 0));+ let (text, heads) = stored("guide.docx");+ assert!(text.contains("Shelves list books."), "{text}");+ assert_eq!(heads, 1);+ // The pack holds the template with the file's own lines.+ let pack = store+ .project_pack(+ &session.workspace,+ &session.capability,+ &json!({"repository_id": project, "question": "The shelf-list template shows the wrong book.isbn",+ "budget": 8000}),+ )+ .unwrap();+ let lines: Vec<&str> = page.lines().collect();+ let chunks: Vec<&Value> = pack["sections"]+ .as_array()+ .unwrap()+ .iter()+ .flat_map(|section| section["chunks"].as_array().unwrap().iter())+ .filter(|chunk| chunk["path"] == "templates/shelf.html")+ .collect();+ assert!(!chunks.is_empty(), "{pack:#}");+ for chunk in chunks {+ let (a, b) = (+ chunk["start_line"].as_u64().unwrap() as usize,+ chunk["end_line"].as_u64().unwrap() as usize,+ );+ for (n, line) in lines.iter().enumerate().take(b).skip(a - 1) {+ assert!(+ chunk["text"].as_str().unwrap().contains(line),+ "line {} ({line}) missing: {chunk:#}",+ n + 1+ );+ }+ }+}++/// A store synced by 0.1.9 or earlier holds a folder's HTML as html2text's+/// text: the first check after the upgrade finds those pages changed, though+/// nothing on disk did, and the refresh before an answer reads them as they+/// are, so a pack quotes the page's own lines.+#[test]+fn html_an_earlier_build_converted_is_synced_again() {+ use graphicle_runtime::fresh::{self, GraphPolicy, Mode, Options, State};+ let dir = TempDir::new().unwrap();+ let root = dir.path().canonical().unwrap().join("site");+ std::fs::create_dir_all(&root).unwrap();+ std::fs::write(root.join("a.py"), A_V1).unwrap();+ let page = "<!doctype html>\n<html>\n<body>\n <section class=\"shelf\">\n <h1>Library</h1>\n <ul class=\"shelf-list\">\n <li data-isbn=\"{{ book.isbn }}\">{{ book.title }}</li>\n </ul>\n </section>\n</body>\n</html>\n";+ std::fs::write(root.join("t.html"), page).unwrap();+ let store = Store::open(dir.path().join("data")).unwrap();+ let mut session = graphicle_runtime::local::session(&store, true).unwrap();+ let synced = graphicle_runtime::local::sync(&store, &mut session, &root, None).unwrap();+ let project = s(&synced, "repository_id").to_string();+ let state = || fresh::check(&store, &session, &project).unwrap();+ assert_eq!(state().state, State::Fresh);+ // As 0.1.9 left it: the page's head holds html2text's text, an+ // am_binary_heads row names the original, and the folder's record has+ // no folder-text policy.+ let converted = graphicle_runtime::documents::extract("t.html", page.as_bytes()).unwrap();+ let text = s(&converted, "text").to_string();+ assert!(!text.contains("<li"), "{text}");+ store+ .transaction(|db| {+ db.execute(+ "INSERT OR IGNORE INTO repo_objects VALUES(?,?,?,?)",+ rusqlite::params![project, s(&converted, "text_sha256"), text, text.len() as i64],+ )?;+ db.execute(+ "UPDATE repo_heads SET sha256=? WHERE repository_id=? AND path='t.html'",+ rusqlite::params![s(&converted, "text_sha256"), project],+ )?;+ db.execute(+ "INSERT INTO am_binary_heads VALUES(?,?,?,?,?)",+ rusqlite::params![+ project,+ "t.html",+ s(&converted, "text_sha256"),+ s(&converted, "original_sha256"),+ s(&converted, "parser")+ ],+ )?;+ db.execute(+ "UPDATE repo_folders SET freshness=json_remove(freshness,'$.text') WHERE repository_id=?",+ [&project],+ )?;+ Ok(())+ })+ .unwrap();+ let check = state();+ assert_eq!(check.state, State::Changed);+ assert_eq!(check.changed, Some(1));+ assert_eq!(check.sample, ["t.html"]);+ assert_eq!(check.method, "text");+ let outcome = fresh::ensure(+ &store,+ &session,+ &project,+ Options {+ mode: Mode::Auto,+ graph: GraphPolicy::Skip,+ },+ );+ let report = outcome.report().cloned().unwrap_or_default();+ assert_eq!(report["status"], "refreshed", "{report:#}");+ assert_eq!(report["changed"], 1, "{report:#}");+ assert_eq!(state().state, State::Fresh);+ let pack = store+ .project_pack(+ &session.workspace,+ &session.capability,+ &json!({"repository_id": project, "question": "The shelf-list template shows the wrong book.isbn",+ "budget": 8000}),+ )+ .unwrap();+ let quoted: String = pack["sections"]+ .as_array()+ .unwrap()+ .iter()+ .flat_map(|section| section["chunks"].as_array().unwrap().iter())+ .filter(|chunk| chunk["path"] == "t.html")+ .map(|chunk| chunk["text"].as_str().unwrap().to_string())+ .collect();+ for line in page.lines() {+ assert!(quoted.contains(line), "{line} missing: {quoted}");+ }+}+/// Two processes that find the same change sync it once: the second waits/// for the first's lock, then finds the folder fresh.#[test]diff --git a/crates/graphicle/tests/it/provider_http_hosts.rs b/crates/graphicle/tests/it/provider_http_hosts.rsindex b951a7a..1de3aaa 100644--- a/crates/graphicle/tests/it/provider_http_hosts.rs+++ b/crates/graphicle/tests/it/provider_http_hosts.rs@@ -1,15 +1,21 @@-//! P-URL (EVAL_PLAN R5): a model profile may call a plain-HTTP host that+//! A model profile may call a plain-HTTP host that//! `GRAPHICLE_PROVIDER_HTTP_HOSTS` lists exactly, provided the profile sends-//! no credential. Connector endpoints keep HTTPS or loopback HTTP whatever-//! the list says. The program checks the configuration it loads, so `init`-//! succeeds or fails on it.+//! no credential; it sends a credential over plain HTTP only to a host that+//! `GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS` lists exactly. Connector endpoints+//! keep HTTPS or loopback HTTP whatever the lists say. The program checks the+//! configuration it loads, so `init` succeeds or fails on it.use serde_json::{Value, json};use std::process::{Command, Output, Stdio};use tempfile::TempDir;const HOSTS: &str = "GRAPHICLE_PROVIDER_HTTP_HOSTS";+const KEY_HOSTS: &str = "GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS";fn init(config: &Value, hosts: Option<&str>) -> Output {+ init_lists(config, hosts, None)+}++fn init_lists(config: &Value, hosts: Option<&str>, key_hosts: Option<&str>) -> Output {let dir = TempDir::new().unwrap();let path = dir.path().join("models.json");std::fs::write(&path, config.to_string()).unwrap();@@ -20,10 +26,15 @@ fn init(config: &Value, hosts: Option<&str>) -> Output {.arg("--config").arg(&path).arg("init")- .env_remove(HOSTS);+ .env_remove(HOSTS)+ .env_remove(KEY_HOSTS)+ .env("VLLM_KEY", "not-a-real-key");if let Some(hosts) = hosts {command.env(HOSTS, hosts);}+ if let Some(key_hosts) = key_hosts {+ command.env(KEY_HOSTS, key_hosts);+ }command.stdin(Stdio::null()).stdout(Stdio::piped())@@ -62,13 +73,14 @@ fn a_listed_plain_http_model_host_is_accepted_without_a_credential() {// Exact hosts only: a neighbouring address or a prefix does not match.refused(&init(&lan, Some("192.168.210.3")), HOSTS);refused(&init(&lan, Some("192.168.210.34 vllm.internal")), HOSTS);- // A credential is never sent over plain HTTP, listed host or not.+ // A credential is not sent over plain HTTP to a host that this list+ // alone names.refused(&init(&model("http://192.168.210.33:8000/v1", Some("VLLM_KEY")),Some("192.168.210.33"),),- "never sent over plain HTTP",+ KEY_HOSTS,);// An entry that is not exactly a host is an error, not a silent no-op.refused(&init(&lan, Some("192.168.210.33:8000")), HOSTS);@@ -82,4 +94,50 @@ fn connector_endpoints_keep_https_or_loopback_whatever_the_list_says() {&init(&config, Some("192.168.210.33")),"Use HTTPS, or HTTP on loopback",);+ refused(+ &init_lists(&config, None, Some("192.168.210.33")),+ "Use HTTPS, or HTTP on loopback",+ );+}++#[test]+fn a_credential_goes_over_plain_http_only_to_a_host_listed_for_it() {+ let keyed = model("http://192.168.210.33:8000/v1", Some("VLLM_KEY"));+ // Listed for a credential: accepted, with one line on stderr that names+ // the host and the variable.+ let accepted = init_lists(&keyed, None, Some("192.168.210.33"));+ let stderr = String::from_utf8_lossy(&accepted.stderr);+ assert!(accepted.status.success(), "{stderr}");+ let warnings: Vec<&str> = stderr.lines().filter(|l| l.contains(KEY_HOSTS)).collect();+ assert_eq!(warnings.len(), 1, "{stderr}");+ assert!(warnings[0].contains("192.168.210.33"), "{stderr}");+ assert!(warnings[0].contains("clear text"), "{stderr}");+ // Listed only for plain HTTP without a credential, listed nowhere, or a+ // neighbouring address: refused, naming the variable.+ refused(&init_lists(&keyed, Some("192.168.210.33"), None), KEY_HOSTS);+ refused(&init_lists(&keyed, None, None), KEY_HOSTS);+ refused(&init_lists(&keyed, None, Some("192.168.210.3")), KEY_HOSTS);+ // A host listed for a credential also serves a profile without one,+ // and prints nothing about a key.+ let lan = model("http://192.168.210.33:8000/v1", None);+ let accepted = init_lists(&lan, None, Some("192.168.210.33"));+ let stderr = String::from_utf8_lossy(&accepted.stderr);+ assert!(accepted.status.success(), "{stderr}");+ assert!(!stderr.contains(KEY_HOSTS), "{stderr}");+ // HTTPS and loopback HTTP take a credential without either list.+ for url in ["https://api.example.com/v1", "http://127.0.0.1:11434/v1"] {+ let accepted = init_lists(&model(url, Some("VLLM_KEY")), None, None);+ let stderr = String::from_utf8_lossy(&accepted.stderr);+ assert!(accepted.status.success(), "{url}: {stderr}");+ assert!(!stderr.contains(KEY_HOSTS), "{url}: {stderr}");+ }+ // An entry that is not exactly a host is an error that names the variable.+ for entry in [+ "192.168.210.33:8000",+ "http://192.168.210.33",+ "*.lan",+ "192.168.210.33/v1",+ ] {+ refused(&init_lists(&lan, None, Some(entry)), KEY_HOSTS);+ }}diff --git a/docs/benchmarks.md b/docs/benchmarks.mdindex 710714b..ed4ab01 100644--- a/docs/benchmarks.md+++ b/docs/benchmarks.md@@ -16,7 +16,7 @@ endorsement is implied.| Retrieval: finding the files a fix changes | Graphicle 0.1.8, offline, 25 October 2026, on 100 SWE-bench Verified issues never used for tuning; Graphicle 0.1.3 and the 0.1.2 release, 21 October 2026, on those and 80 issues used for tuning | On the held-out issues, a file the fix changed was among the first 5 files of 0.1.8's context packet for 75, against 61 for BM25 (SWE-bench style; McNemar exact p = 0.013) and 54 for grep on the issue's names; for the first file and the first 10 files the differences from BM25 are not significant. 0.1.3 had the same counts, apart from 82 in the first 10 files against 0.1.8's 81. Ranking only: no agent test of this ranking has been run yet ([retrieval benchmark](benchmarks/retrieval.md)) || Retrieval: time per question, our run | Graphicle 0.1.8 against 0.1.7 on our Linux server, 25 October 2026 | kubernetes, the 22 questions of issue #8, each call a new process: `graphicle context` took a median of 1.34 s with 0.1.8 against 2.99 s with 0.1.7 on 16 cores, and 1.38 s against 3.89 s on 4; the peak memory of a call was 0.6 GB against 3.5 GB, with the same packet for every question. [Details](#our-own-run-on-kubernetes-017-and-018) || Retrieval: time per question, measured independently | Run and published by @selimaytac, who reported issue #8, on Graphicle 0.1.3 and 0.1.5, 23 October 2026 | kubernetes, 22 questions, an Apple M3 Pro, no answer model: `graphicle context` took a median of 153.5 s per question on 0.1.3 and 9.5 s on 0.1.5, and the prompt hook returned a packet for 18 of 22. [Details](#independent-measurements) |-| Whole-repository packs: the files a fix changes, in repositories past 1M tokens | Questions, arms and scorer fixed; the model runs are not made yet. Context recall without a model, on 3 held-out and 2 development repositories, with the pack built before Meta's hackathon (2a46edb) | Held out (pytorch, vscode and elasticsearch, 90 questions): a mean 55.8% of the files a fix changed had text inside a 64K-token pack (whole, or as excerpts or outlines of their symbols) and 76.8% inside 1M tokens, against 1.1% and 2.2% for the repository cut to the same budget, which holds whole files only. [The benchmark's page](benchmarks/whole-repo.md) |+| Whole-repository packs: the files a fix changes, in repositories past 1M tokens | Questions, arms and scorer fixed; the model runs are not made yet. Context recall without a model, on 3 held-out and 2 development repositories, with a pre-release build of the pack (26 October 2026, before the event) | Held out (pytorch, vscode and elasticsearch, 90 questions): a mean 55.8% of the files a fix changed had text inside a 64K-token pack (whole, or as excerpts or outlines of their symbols) and 76.8% inside 1M tokens, against 1.1% and 2.2% for the repository cut to the same budget, which holds whole files only. [The benchmark's page](benchmarks/whole-repo.md) || Agent memory: comparison with seven memory systems | Done, on development sets, with a proxy evaluator | Every system's scores and the 21 registered comparisons are [below](#agent-memory-comparison-with-seven-memory-systems). None of them is a headline claim || Agent memory: retrieval defaults | Chosen | Model-free retrieval runs on development data, plus held-out checks; their records are not published yet, so no numbers are given |@@ -158,8 +158,8 @@ That is the parity claim, with these limits:Graphify's `graphify-out/` folder, for example, is Graphicle's`.graphicle/`.- **The checked build.** All the checks last passed on 13 October 2026, on a- pre-release build (commit cce5fd4, 13 October 2026) of the engine- (`graphicle-graph`) for macOS, release profile; the widened checks ran on+ pre-release build of 0.1.0's engine (`graphicle-graph`), made on+ 13 October 2026, for macOS, release profile; the widened checks ran on14 October 2026 on a Linux release build of the same source. Both buildsuse the default features plus `postgres`, `bedrock` and `transcription`,which some checks exercise. The engine pins tree-sitter 0.25.10, the parserdiff --git a/docs/benchmarks/whole-repo.json b/docs/benchmarks/whole-repo.jsonindex 6ee26af..cdebb87 100644--- a/docs/benchmarks/whole-repo.json+++ b/docs/benchmarks/whole-repo.json@@ -14,7 +14,7 @@"output": 20.0}},- "pack_build": "pack 06818eb",+ "pack_build": "a pre-release build of 0.1.9","prices_date": "2026-10-26","question_tokens_nominal": 811,"repos": [@@ -788,7 +788,7 @@"recall": [{"errors": 0,- "label": "pack 2a46edb, built before the event: held-out repositories",+ "label": "A pre-release build of the pack (26 Oct, before the event): held-out repositories","pack_source": "pack","rows": [{@@ -2080,7 +2080,7 @@},{"errors": 0,- "label": "pack 2a46edb, built before the event: development repositories (used for tuning)",+ "label": "A pre-release build of the pack (26 Oct, before the event): development repositories (used for tuning)","pack_source": "pack","rows": [{diff --git a/docs/benchmarks/whole-repo.md b/docs/benchmarks/whole-repo.mdindex 678ab03..0a00629 100644--- a/docs/benchmarks/whole-repo.md+++ b/docs/benchmarks/whole-repo.md@@ -10,7 +10,7 @@ Not run yet. The questions, arms, prompts and scorer are fixed and committed; thFor every question and budget, with no model involved: the share of the question's gold files that are inside the context, for the pack and for truncation filled to the same budget, with tokens counted with the Muse Spark Open tokenizer (Hugging Face revision 4239e4db). The pack holds small files whole and large ones as excerpts and as outlines of their symbols, and a gold file counts as inside when any of its text is in the pack; truncation holds whole files only. "Some inside" is the share of questions with at least one gold file inside. Each table is one run, named by the pack build it used.-### pack 2a46edb, built before the event: held-out repositories+### A pre-release build of the pack (26 Oct, before the event): held-out repositories| Repository | Role | Budget | Questions | Pack: gold files inside | Truncation: gold files inside | Pack: some inside | Truncation: some inside ||---|---|---|---|---|---|---|---|@@ -35,7 +35,7 @@ For every question and budget, with no model involved: the share of the question| **all held-out** | held-out | 512K | 90 | 68.0% | 1.1% | 73.3% | 1.1% || **all held-out** | held-out | 1M | 90 | 76.8% | 2.2% | 81.1% | 2.2% |-### pack 2a46edb, built before the event: development repositories (used for tuning)+### A pre-release build of the pack (26 Oct, before the event): development repositories (used for tuning)| Repository | Role | Budget | Questions | Pack: gold files inside | Truncation: gold files inside | Pack: some inside | Truncation: some inside ||---|---|---|---|---|---|---|---|@@ -61,7 +61,7 @@ For every question and budget, with no model involved: the share of the questionMeta's API serves the longest prefix a prompt shares with an earlier prompt from its cache, and bills it at the cached-input price (Muse Spark 1.3 $1.25 per million input tokens, $0.15 cached; Muse Wonder $4.00 per million input tokens, $0.20 cached; prices of 2026-10-26). A context whose first part is the same for every question about a repository pays the full input price once; every follow-up question pays the cached price on that part and the full price only on the rest. Truncation's dump is the same for every question, so it is cached the same way. These are input costs; output is billed on top ($4.25 per million on Muse Spark 1.3), ($20.00 per million on Muse Wonder).-The shared prefix and the question-specific tokens are the means over the questions of the development repositories (kubernetes, home-assistant) for each context and budget (pack 06818eb), counted with the Muse Spark Open tokenizer. A first question pays for both, plus the question and the prompt template after the context.+The shared prefix and the question-specific tokens are the means over the questions of the development repositories (kubernetes, home-assistant) for each context and budget (a pre-release build of 0.1.9), counted with the Muse Spark Open tokenizer. A first question pays for both, plus the question and the prompt template after the context.<p align="center"><picture>diff --git a/docs/configuration.md b/docs/configuration.mdindex 7ba066a..6494f5e 100644--- a/docs/configuration.md+++ b/docs/configuration.md@@ -110,7 +110,7 @@ You can add a model in any of three ways:| `embedding_model` | The profile that embeds passages for the dense arm of answers. `graphicle run embed --wait` builds the vectors. Each run makes at most `--max-calls` calls (default 4, at most 32), so a large project needs several runs || `worker_concurrency` | Jobs run at once, from 1 to 64 (default 1) || `models.NAME.protocol` | `ollama`; `chat` (Chat Completions, for OpenAI-compatible servers such as vLLM or llama.cpp); `responses`; `anthropic`; `gemini`; `azure_chat`; `azure_responses`. `local_onnx` needs a build with `local-inference` |-| `base_url` | HTTPS, or HTTP on loopback. A plain-HTTP host on your network must be listed in `GRAPHICLE_PROVIDER_HTTP_HOSTS` (exact host names or addresses, separated by commas). Such a profile cannot have a `key_env` |+| `base_url` | HTTPS, or HTTP on loopback. A plain-HTTP host on your network must be listed in `GRAPHICLE_PROVIDER_HTTP_HOSTS` (exact host names or addresses, separated by commas). Such a profile cannot have a `key_env`, unless its host is listed in `GRAPHICLE_PROVIDER_HTTP_KEY_HOSTS` instead (the same format; it also counts as listed in the first). The key then crosses the network in clear text, so anyone who can watch that network can read it. This is off by default, and listing a host there is your choice; Graphicle then prints a one-line warning that names such a host || `model` | The provider's model name || `key_env` | The name of the environment variable that holds the API key. The key itself never goes in the file || `input_limit`, `output_limit` | Token limits: 512 to 1,048,576 (default 16,000) and 64 to 131,072 (default 2,048). A reasoning model counts its reasoning in the output |@@ -586,7 +586,7 @@ cannot raise them.| Calls collected from one file | 50,000 | 10,000,000 | `limits.file_calls` | `GRAPHICLE_MAX_FILE_CALLS` | The call list is cut at the limit. Listed under `limited` (`calls`) || Syntax nodes read in one file | 2,000,000 | 1,000,000,000 | `limits.file_nodes` | `GRAPHICLE_MAX_FILE_NODES` | The analysis stops at the limit. Listed under `limited` (`nodes`) || Declarations and links kept per file, and imports of Python, JavaScript, TypeScript, Rust and Markdown files | 16,000 each | 10,000,000 | `limits.file_symbols` | `GRAPHICLE_MAX_FILE_SYMBOLS` | The list is cut at the limit. Listed under `limited` (`symbols`) |-| One document file (PDF, Office, EPUB, HTML, image) | 128 MiB | 4 GiB | `limits.document_bytes` | `GRAPHICLE_MAX_DOCUMENT_BYTES` | A folder sync lists it under `skipped`; an upload is refused |+| One document file (PDF, Office, EPUB, image; HTML that is uploaded or that the Confluence connector brings in, and a folder's HTML file past the text-file size or not UTF-8) | 128 MiB | 4 GiB | `limits.document_bytes` | `GRAPHICLE_MAX_DOCUMENT_BYTES` | A folder sync lists it under `skipped`; an upload is refused || Text of one document: extracted from a file, or one connector or uploaded document | 8 MiB | 512 MiB | `limits.document_text_bytes` | `GRAPHICLE_MAX_DOCUMENT_TEXT_BYTES` | A folder sync lists it under `skipped`; a connector sync lists it under `skipped` and goes on; an import or upload is refused with the document's name || An Office or EPUB archive, expanded | 512 MiB | 16 GiB | `limits.archive_bytes` | `GRAPHICLE_MAX_ARCHIVE_BYTES` | The document is not converted || Entries of an Office or EPUB archive | 40,000 | 10,000,000 | `limits.archive_entries` | `GRAPHICLE_MAX_ARCHIVE_ENTRIES` | The same |@@ -684,7 +684,12 @@ environment variable `GRAPHICLE_SYNC_TRACKED_IGNORED` (`0` or `1`) overridesthe setting. It skips`.git`, `node_modules`, `target`, build output, `.env` files, keys andcredential files, symbolic links and binary files other than documents. It-reads PDF, DOCX, PPTX, XLSX, ODF and EPUB documents, HTML and UTF-8 text. It+reads PDF, DOCX, PPTX, XLSX, ODF and EPUB documents as their extracted text,+and HTML and other UTF-8 text files as they are on disk, with their own line+numbers (an HTML file past `limits.file_bytes`, or one that is not UTF-8, such+as a Latin-1 or Shift-JIS page, is read as its extracted text, as earlier+versions read every HTML file; an HTML file read as it is counts its markup+toward `limits.project_bytes`). Italso skips Graphicle's own writes: the `<file>.graphicle-bak` backups, ClaudeCode's personal `.claude/settings.local.json`, a `.mcp.json` or`.vscode/mcp.json` holding only Graphicle's entries, and the Graphicle sectiondiff --git a/docs/evidence/README.md b/docs/evidence/README.mdindex 4ee04c1..b38441d 100644--- a/docs/evidence/README.md+++ b/docs/evidence/README.md@@ -9,7 +9,7 @@ public release.A summary of the comparison checks of the graph engine against the pinnedGraphify 0.9.88 reference, run on 13 October 2026 on a pre-release build-(commit cce5fd4, 13 October 2026; release profile):+of 0.1.0 (13 October 2026; release profile):- the binary, source set and build (profile, features, compiler) that werechecked, and the version, commit and archive SHA-256 of the reference;diff --git a/docs/install.md b/docs/install.mdindex 173b4b7..f9b1154 100644--- a/docs/install.md+++ b/docs/install.md@@ -21,7 +21,7 @@ agent's hooks later. Or run `graphicle setup` in a normal terminal.```shbrew install graphicle-ai/tap/graphicle-graphicle --version # graphicle 0.1.9 (core)+graphicle --version # graphicle 0.1.10 (core)````brew upgrade graphicle` installs a new release. Afterwards, read@@ -159,7 +159,7 @@ folder with both programs, `LICENSE`, `NOTICE`, `NOTICE.md`, `README.md`,| Windows, x86-64 (preview) | `x86_64-pc-windows-msvc`, a `.zip` |```sh-version=0.1.9+version=0.1.10target=aarch64-apple-darwinbase=https://github.com/graphicle-ai/graphicle/releases/download/v$versioncurl -fLO "$base/graphicle-$version-$target.tar.gz"@@ -253,7 +253,7 @@ in them.## Check the installation```sh-graphicle --version # graphicle 0.1.9 (core)+graphicle --version # graphicle 0.1.10 (core)graphicle graph --help # the code-graph engine's commandsgraphicle doctor # checks the programs, the data folder and your agents```diff --git a/docs/pack.md b/docs/pack.mdindex ffe3571..8005bb5 100644--- a/docs/pack.md+++ b/docs/pack.md@@ -48,7 +48,7 @@ tests. The sections, each with its share of the budget:| Header | The repository, commit, budget, tokens used, how the files were chosen and how tokens were counted | || Manifest | Every file in the pack with its tokens, section and rank, then the top-ranked files left out | || Architecture | One line per folder: files, tokens, main language, purpose (from a README or package comment), key symbols by connections in the code graph, entry points; then the dependencies between folders | about 4% (20% without a question) |-| Focus | The ranked files: small ones whole, large ones as excerpts of the symbols around the ranked passages, with overlapping ranges merged | 50% or more |+| Focus | The ranked files: small ones whole, large ones as excerpts of the symbols around the ranked passages, with overlapping ranges merged; in a standard pack of 32,768 tokens or less, the first ranked file whole when its estimated size (from its bytes) fits in half the budget, and in one of 131,072 tokens or more (so not at the default 128,000), the first two whole when each one's estimated size fits in a quarter of it; not in a pack with pinned passages (`fix --focus`, `review`), where every file keeps the caps | 50% or more || Call paths | Callers and callees of the focus symbols, two steps along call edges, as `a (path:line) -> b (path:line)`, then the bodies of the key ones | up to 10% || Tests | Tests that call or reference the focus symbols, from the code graph, else the test files that go with the top files by name | up to 10% || Docs | Ranked documentation passages and the nearest README of the top files | up to 5% |@@ -77,6 +77,20 @@ and in XML:</file>```+A file's lines go in as they are, not escaped. When they hold `</file` or+`</section` (an HTML page's own `</section>`), they go inside a CDATA section+that starts on a line of its own, so that the page never closes the pack's+`<file>` or `<section>`:++```xml+<file path="web/index.html" lines="1-40" why="focus: rank 1">+<![CDATA[+1 <!doctype html>+...+]]>+</file>+```+## Options| Option | Default | Meaning |diff --git a/packaging/muse-code-plugin/.muse-plugin/plugin.json b/packaging/muse-code-plugin/.muse-plugin/plugin.jsonindex 674c4ae..79c2401 100644--- a/packaging/muse-code-plugin/.muse-plugin/plugin.json+++ b/packaging/muse-code-plugin/.muse-plugin/plugin.json@@ -2,7 +2,7 @@"schemaVersion": 1,"name": "graphicle","displayName": "Graphicle",- "version": "0.1.9",+ "version": "0.1.10","description": "Graphicle's code graph, whole-repository packs and reviewed project memory for Muse Code, with the context added at session start and per prompt.","compat": {"source": "native",diff --git a/sdk/python/graphicle_sdk/__init__.py b/sdk/python/graphicle_sdk/__init__.pyindex a0bf4e1..b7470a4 100644--- a/sdk/python/graphicle_sdk/__init__.py+++ b/sdk/python/graphicle_sdk/__init__.py@@ -73,4 +73,4 @@ __all__ = ["resolve_tool_call","tool_schemas",]-__version__ = "0.1.9"+__version__ = "0.1.10"diff --git a/sdk/python/pyproject.toml b/sdk/python/pyproject.tomlindex d9ab6b2..cc01b9a 100644--- a/sdk/python/pyproject.toml+++ b/sdk/python/pyproject.toml@@ -5,7 +5,7 @@ build-backend = "setuptools.build_meta"[project]# The PyPI name "graphicle" belongs to an unrelated project; the import package is graphicle_sdk.name = "graphicle-sdk"-version = "0.1.9"+version = "0.1.10"description = "Python SDK for Graphicle, a local-first memory service that keeps original sources"readme = "README.md"license = "Apache-2.0"diff --git a/sdk/typescript/package.json b/sdk/typescript/package.jsonindex ce56310..d288e6e 100644--- a/sdk/typescript/package.json+++ b/sdk/typescript/package.json@@ -1,6 +1,6 @@{"name": "@graphicle/sdk",- "version": "0.1.9",+ "version": "0.1.10","description": "Graphicle project evidence, memory, graph and workflow client","private": true,"type": "module",diff --git a/server.json b/server.jsonindex f36ae3c..eb0db24 100644--- a/server.json+++ b/server.json@@ -3,11 +3,11 @@"name": "io.github.Graphicle-AI/graphicle","title": "Graphicle","description": "Code graph and project memory for coding agents, cited to exact files and lines, on your machine.",- "version": "0.1.8",- "websiteUrl": "https://github.com/Graphicle-AI/graphicle/blob/v0.1.8/docs/mcp.md",+ "version": "0.1.9",+ "websiteUrl": "https://github.com/Graphicle-AI/graphicle/blob/v0.1.9/docs/mcp.md","icons": [{- "src": "https://raw.githubusercontent.com/Graphicle-AI/graphicle/4e24671c97cdd702770f3983cee9816876c304f6/packaging/mcpb/icon.png",+ "src": "https://raw.githubusercontent.com/Graphicle-AI/graphicle/4bbe6cd85d7c9ebce9de5ae7a7c19a105668f1aa/packaging/mcpb/icon.png","mimeType": "image/png","sizes": ["512x512"@@ -22,45 +22,45 @@"packages": [{"registryType": "mcpb",- "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.8/graphicle-0.1.8-aarch64-apple-darwin.mcpb",- "version": "0.1.8",- "fileSha256": "644053a0977d4a60b5fae9ad182637f6937038223d47c2e4fddd1875f9425a0f",+ "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.9/graphicle-0.1.9-aarch64-apple-darwin.mcpb",+ "version": "0.1.9",+ "fileSha256": "29362eb4ea37f7a42129c3638ced6dbb843d982b88e179b49230139548a7ca5c","transport": {"type": "stdio"}},{"registryType": "mcpb",- "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.8/graphicle-0.1.8-x86_64-apple-darwin.mcpb",- "version": "0.1.8",- "fileSha256": "9cc09ecc0dba89d5590720353fd4dc67bd92a84a08401768954326b8732b6f42",+ "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.9/graphicle-0.1.9-x86_64-apple-darwin.mcpb",+ "version": "0.1.9",+ "fileSha256": "72173aa9639860e72f290bee5105a7b7c2d47478fa5a02ea69e62974e0430213","transport": {"type": "stdio"}},{"registryType": "mcpb",- "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.8/graphicle-0.1.8-x86_64-pc-windows-msvc.mcpb",- "version": "0.1.8",- "fileSha256": "2538c881396985fdf80f84ce647a8280e7d7c402273822033aaba1f5dc15e264",+ "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.9/graphicle-0.1.9-x86_64-pc-windows-msvc.mcpb",+ "version": "0.1.9",+ "fileSha256": "fdd5bdbc71383aa228a61a6050d8bf3781787235bf05855a952a165c7d47e296","transport": {"type": "stdio"}},{"registryType": "mcpb",- "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.8/graphicle-0.1.8-x86_64-unknown-linux-gnu.mcpb",- "version": "0.1.8",- "fileSha256": "91d4b905ab891c70b9bf5fb4658ac8f8efaaa5357e6014ccefe9c4075c8a418b",+ "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.9/graphicle-0.1.9-x86_64-unknown-linux-gnu.mcpb",+ "version": "0.1.9",+ "fileSha256": "7f6b1eef23e0a53b336d3d31fdd44dd7a2ef1c9aee0034eacf8802be0b7e0699","transport": {"type": "stdio"}},{"registryType": "mcpb",- "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.8/graphicle-0.1.8-aarch64-unknown-linux-gnu.mcpb",- "version": "0.1.8",- "fileSha256": "02261bfaa4a8118318081d58de055e9455c65ab16d0c0cb9875cb5b77c520ed9",+ "identifier": "https://github.com/Graphicle-AI/graphicle/releases/download/v0.1.9/graphicle-0.1.9-aarch64-unknown-linux-gnu.mcpb",+ "version": "0.1.9",+ "fileSha256": "b26cbcde77e8492140aa25d575ab859c7a757fd5a13275bed11655df4a7cbd06","transport": {"type": "stdio"}