Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
Merge pull request #345 from chopratejas/rust-proxy-wire-compressors
4c52766 Tejas Chopra committed 6 months ago
fix(test): stub _run_compression_in_executor on _DummyOpenAIHandler
456a6b3 chopratejas committed 6 months ago
fix(rust): wire ICM compressor into Rust proxy on /v1/messages
fa5fbfa chopratejas committed 6 months ago
Merge pull request #343 from chopratejas/rust-message-scorer-port
f726d0e Tejas Chopra committed 6 months ago
fix(proxy): cache concurrency lock, multi-worker docs, bounded compression executor
ea78cf6 chopratejas committed 6 months ago
fix(rust): IntelligentContextManager port (simplified, OSS) — PR-B
013344f chopratejas committed 6 months ago
Merge pull request #338 from chopratejas/rust-message-scorer-port
05f91d9 Tejas Chopra committed 6 months ago
Merge pull request #339 from chopratejas/fix-327-walker-removal
9129188 Tejas Chopra committed 6 months ago
ci: pin dtolnay/rust-toolchain@stable, set toolchain via input
bcef763 chopratejas committed 6 months ago
style: apply ruff format to test_proxy_anthropic_cache_stability lambdas
521fbbe chopratejas committed 6 months ago
fix(proxy): remove content-keyed TTL walker that conflated content with positional cache (#327)
35eaf8d chopratejas committed 6 months ago
Merge remote-tracking branch 'origin/main' into rust-message-scorer-port
c4989b1 chopratejas committed 6 months ago
fix(rust): port MessageScorer to Rust + parity harness (PR-A)
21989e3 chopratejas committed 6 months ago
Merge pull request #336 from chopratejas/rust-audit-cleanup
764b7a8 Tejas Chopra committed 6 months ago
fix(rust): audit cleanup — DiffCompressor CCR leak, CCR TOCTOU race, clippy debt, dep dedup
378d8a0 chopratejas committed 6 months ago
Merge pull request #333 from smartwatermelon/fix/proxy-numpy-import
276e92e Tejas Chopra committed 6 months ago
fix(memory): make numpy import optional for proxy boot path
d236b4b Claude Code Bot committed 6 months ago
Merge pull request #331 from chopratejas/rust-stage-3g-pr2-smartcrusher-offload
3319030 Tejas Chopra committed 6 months ago
Merge pull request #330 from chopratejas/rust-stage-3g-reformat-offload-rework
a1d62d8 Tejas Chopra committed 6 months ago
test(proxy): align hooks regression test with Bug 3 recount semantics
b6137aa chopratejas committed 6 months ago
fix(proxy): restore Anthropic compression on token mode (issue #327)
44944fb chopratejas committed 6 months ago
fix(rust): wire SmartCrusher as JsonOffload in the pipeline (Phase 3g PR2)
2a0582d chopratejas committed 6 months ago
fix(rust): reformat/offload pipeline + log templates + diff noise (Phase 3g rework)
01a423a chopratejas committed 6 months ago
Merge pull request #326 from gglucass/fix/traffic-learner-min-evidence
dd287a8 Tejas Chopra committed 6 months ago
Merge pull request #324 from chopratejas/rust-stage-3e-4-tag-protector
c89182f Tejas Chopra committed 6 months ago
test(traffic-learner): cover helper edge cases + apply ruff format
4512a06 Garm committed 6 months ago
test(traffic-learner): regression test for shutdown evidence gate
a8ebf9a Garm committed 6 months ago