Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
feat(rust): adaptive_sizer port — Kneedle, SimHash, zlib validation
8f810a0 chopratejas committed 6 months ago
fix(rust): smart_crusher self-review — Python parity for f64 overflow path
ab4d294 chopratejas committed 6 months ago
feat(rust): smart_crusher SmartAnalyzer — field stats, change-points, crushability
c26d225 chopratejas committed 6 months ago
feat(rust): smart_crusher analyzer helpers — id/score/outlier detectors + bug #3 fix
f029055 chopratejas committed 6 months ago
fix(rust): smart_crusher scaffold review findings — hash truncation, int parse, python-repr matcher
a64716d chopratejas committed 6 months ago
feat(rust): scaffold smart_crusher module + foundational helpers
d219bee chopratejas committed 6 months ago
Merge pull request #277 from chopratejas/rust-stage-3b-diff-bridge
fcef84f Tejas Chopra committed 6 months ago
ci: locate maturin-built .so via filesystem, not via import
dd0697a chopratejas committed 6 months ago
ci: use maturin build + pip install instead of maturin develop
7fd5b21 chopratejas committed 6 months ago
fix(tests): stop module-level dotenv loaders from polluting os.environ during pytest collection
d5ca50c chopratejas committed 6 months ago
feat(rust): retire python diff_compressor, ship rust-only via pyo3
f5f4654 chopratejas committed 6 months ago
fix(diff): close ContentRouter routing gaps for merge diffs and long preambles
48c1324 chopratejas committed 6 months ago
fix(diff_compressor): four silent information-loss paths in Python AND Rust
6d47a0c chopratejas committed 6 months ago
refactor(rust): diff_compressor — surface hidden cutoffs + lossy-emit stats
255b429 chopratejas committed 6 months ago
feat(rust): diff_compressor port — byte-equal parity + sidecar stats
5c3c9c4 chopratejas committed 6 months ago
Merge pull request #275 from chopratejas/rust-stage-2-tokenizer
ab7b191 Tejas Chopra committed 6 months ago
Merge pull request #272 from chopratejas/rust-stage-2.1-hf-hub
c275567 Tejas Chopra committed 6 months ago
Merge pull request #271 from chopratejas/rust-stage-2-tokenizer
342a6a4 Tejas Chopra committed 6 months ago
feat(rust): HfTokenizer::from_pretrained — HuggingFace Hub auto-download
a23ee8e chopratejas committed 6 months ago
test(memory): add qdrant_url/qdrant_api_key to expected config dict
3957288 chopratejas committed 6 months ago
feat(rust): tokenizer crate with tiktoken-rs + HuggingFace + estimator
9ce1c01 chopratejas committed 6 months ago
Merge pull request #266 from ipapapa/fix/31-qdrant-env-vars
7c1cff2 Tejas Chopra committed 6 months ago