Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
Merge pull request #365 from chopratejas/realign-D2-bedrock-event-stream
32a1fd4 Tejas Chopra committed 6 months ago
Merge pull request #364 from chopratejas/realign-D1-bedrock-native-invoke
dd1dadf Tejas Chopra committed 6 months ago
Merge pull request #361 from chopratejas/realign-C5-retire-responses-converter
76c113d Tejas Chopra committed 6 months ago
fix(proxy): PR-D2 Bedrock streaming via binary EventStream
66426e7 chopratejas committed 6 months ago
Merge pull request #363 from chopratejas/fix-release-workflow-wheels-and-npm
75fa4a4 Tejas Chopra committed 6 months ago
fix(ci): unbreak release pipeline — wheel openssl + dead npm artifact downloads
7ba47e2 chopratejas committed 6 months ago
fix(proxy): PR-D1 native Bedrock InvokeModel route + SigV4
f2d4fe3 chopratejas committed 6 months ago
fix: PR-C5 retire responses_converter.py — Rust owns /v1/responses
221109d chopratejas committed 6 months ago
Merge pull request #358 from chopratejas/realign-C4-rust-responses-streaming
1352f62 Tejas Chopra committed 6 months ago
Merge pull request #356 from chopratejas/realign-C3-rust-responses-http
70cad6c Tejas Chopra committed 6 months ago
Merge pull request #354 from chopratejas/realign-C2-rust-chat-completions
f9b4491 Tejas Chopra committed 6 months ago
Merge pull request #360 from chopratejas/refactor/single-wheel-maturin-backend
aa80ec2 Tejas Chopra committed 6 months ago
fix(e2e): pin marketplace source via env var in init Dockerfile
9ae696e chopratejas committed 6 months ago
fix(ci): switch e2e runtime to python:3.11-slim (trixie, glibc 2.41)
73a4782 chopratejas committed 6 months ago
fix(ci): multi-stage manylinux build for e2e dockerfiles + release workflow test
b31a34b chopratejas committed 6 months ago
fix(ci): pin public PyPI in pyproject.toml + scrub Netflix URLs from uv.lock
e325d1b chopratejas committed 6 months ago
fix(ci): use ghcr devcontainer rust feature instead of manual rustup install
9ce61af chopratejas committed 6 months ago
fix(ci): pre-install rustfmt+clippy components in all Dockerfiles
2ae5772 chopratejas committed 6 months ago
fix(ci): add minimal-privilege permissions blocks to release.yml jobs
d289c0d chopratejas committed 6 months ago
refactor: single-wheel maturin build backend (fixes #355)
2a91cbb chopratejas committed 6 months ago
fix: C4 — /v1/responses streaming + Conversations API in Rust
866d346 chopratejas committed 6 months ago
fix: C3 — /v1/responses Rust HTTP handler + per-item-type passthrough
57c3e38 chopratejas committed 6 months ago
fix: C2 — /v1/chat/completions Rust handler + OpenAI live-zone
fe00dc0 chopratejas committed 6 months ago
Merge pull request #353 from chopratejas/realign-C1-rust-sse-parser
f34e0c2 Tejas Chopra committed 6 months ago
Merge pull request #350 from chopratejas/realign-phase-AB-cache-safety-and-live-zone
9266ea7 Tejas Chopra committed 6 months ago