Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Python agentaianthropicclaude-codecompressioncontext-engineeringcontext-windowcursorfastapilangchainllmmcpopenaiprompt-engineeringproxypythonragtoken-optimizationtokenstypescript
Commits on main
Fix mypy error: add type annotation for SentenceTransformer return
be0ca4c chopratejas committed 9 months ago
Fix test_router_is_available_with_models after MLModelRegistry refactor
0bd9ce5 chopratejas committed 9 months ago
Add centralized MLModelRegistry to share ML model instances
f201480 chopratejas committed 9 months ago
Add SQLite vector backend as default and fix HNSW test skipping
eca5c94 chopratejas committed 9 months ago
Add SQLiteVectorIndex using sqlite-vec for bounded vector search
84ad47e chopratejas committed 9 months ago
Add bounded memory support to HNSWVectorIndex with LRU eviction
b27c95b chopratejas committed 9 months ago
Merge pull request #24 from chopratejas/feature/memory-observability
f5fc371 Tejas Chopra committed 9 months ago
Add SQLiteGraphStore for bounded, persistent graph storage
f2ecf1d chopratejas committed 9 months ago
Merge pull request #23 from chopratejas/feature/memory-observability
8847355 Tejas Chopra committed 9 months ago
Merge pull request #20 from chopratejas/fix/intelligent-context-anthropic-format
0e04099 Tejas Chopra committed 9 months ago
fix: Extend Anthropic format tool protection to IntelligentContextManager
d7d50fe chopratejas committed 9 months ago
Merge pull request #19 from prakersh/dev/prakersh/fix-anthropic-tool-unit-detection
adb710b Tejas Chopra committed 9 months ago
fix: Handle Anthropic format tool_use/tool_result as atomic units
f83f92a Prakersh Maheshwari committed 9 months ago
Add question-aware compression and enable ContentRouter by default
02e742f chopratejas committed 9 months ago
Merge pull request #18 from smartwatermelon/feature/exclude-tools-compression
c925352 Tejas Chopra committed 9 months ago
fix(config): remove web tools from default exclusion list
dae51a1 Claude Code Bot committed 9 months ago
fix(tests): add missing skip decorator and tests for exclude_tools
1c5a0e0 Claude Code Bot committed 9 months ago
fix(tests): skip memory tests when hnswlib not available
b6b8eed Claude Code Bot committed 9 months ago
fix(memory): use subprocess probe to avoid hnswlib SIGILL crash on CI
c3f0327 Claude Code Bot committed 9 months ago
fix(tests): skip HTML extractor tests when trafilatura not installed
9ff67fb Claude Code Bot committed 9 months ago
feat(compression): add exclude_tools to bypass compression for specific tools
e86d9a3 Claude Code Bot committed 9 months ago
Add OpenRouter backend support with provider registry pattern
8d1731b chopratejas committed 9 months ago