Solution for long term memory for agent coding CLIs and to facilitate handoff between different agent vendors
Rust
docs: document Cheaper Inference as an openai-compat provider
aiapienthusiast360b54daf896
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex e2063e75..b60bd477 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -35,6 +35,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0`ai-memory backup --to <tarball>` command(`docs/lifecycle-ops.md#backup`) is unchanged. (#950)+### Changed+- Documented Cheaper Inference as an endpoint for the existing `openai-compat`+ provider.+### Fixed- `memory_query` now returns `global_scope_hits` (standing `_global` user/teampreferences) for a single-project query whose project is named explicitlydiff --git a/docs/install.md b/docs/install.mdindex 99da442f..6f6e7f37 100644--- a/docs/install.md+++ b/docs/install.md@@ -1899,6 +1899,23 @@ Replace the model with another current OrcaRouter model id (same`provider/model` format as OpenRouter, e.g. `anthropic/claude-sonnet-4.6` or`deepseek/deepseek-v4-flash`) when needed.+[Cheaper Inference](https://cheaperinference.com) is an OpenAI-compatible LLM+gateway. Each model costs 15–60% less than the list price of its lab. It uses+the same provider; no dedicated ai-memory provider is needed.+Pass its API key through the generic compatibility credential:++```bash+-e AI_MEMORY_LLM_PROVIDER=openai-compat+-e AI_MEMORY_LLM_BASE_URL=https://api.cheaperinference.com/v1+-e AI_MEMORY_LLM_MODEL=gpt-5.4-mini+-e LLM_API_KEY=ci_live_...+```++Model ids are bare, without a `provider/` prefix. Replace the model with+another current Cheaper Inference model id (e.g. `claude-haiku-4.5` or+`deepseek-v4-flash`) when needed. Cheaper Inference serves chat models only+and has no embeddings endpoint; configure embeddings separately.+OpenAI-compatible structured calls use the operation's JSON Schema by default:```bashdiff --git a/docs/llm-providers.md b/docs/llm-providers.mdindex 23b87f24..60b3bddb 100644--- a/docs/llm-providers.md+++ b/docs/llm-providers.md@@ -50,7 +50,7 @@ Recommended defaults:| `copilot` | `gpt-5.5` | GitHub Copilot Chat backend via `ai-memory auth login copilot` or `COPILOT_GITHUB_TOKEN`; requires a Copilot subscription. || `gemini` | `gemini-3.5-flash` | Google-hosted option with a generous free tier. || `opencode` | `claude-sonnet-4-6` | OpenCode Go or Zen via `OPENCODE_API_KEY`. Go is the default endpoint; `AI_MEMORY_LLM_BASE_URL` selects Zen. Set `AI_MEMORY_LLM_MODEL` to an id the chosen endpoint serves. |-| `openai-compat` | no default | OpenRouter, Atlas Cloud, OrcaRouter, Ollama, vLLM, LM Studio, and other compatible endpoints. |+| `openai-compat` | no default | OpenRouter, Atlas Cloud, OrcaRouter, Cheaper Inference, Ollama, vLLM, LM Studio, and other compatible endpoints. || `openai-compat` + `AI_MEMORY_LLM_BASE_URL=https://openrouter.ai/api/v1` | no default (recommended: `anthropic/claude-haiku-4.5`) | Hosted access to a large model catalogue through one key. See [OpenRouter](#openrouter) below and the empirical comparison in [`llm-provider-comparison.md`](llm-provider-comparison.md). |`openai-oauth` stores a refresh token in `<data_dir>/auth.json` and talks to@@ -371,6 +371,7 @@ sentence embeddings run in-process (pure-Rust `all-MiniLM-L6-v2`,pinned checksums — see [`docs/local-embeddings.md`](local-embeddings.md).See [`docs/install.md#llm-provider-tiers`](install.md#llm-provider-tiers)-for env vars and Ollama/OpenRouter/Atlas Cloud/OrcaRouter examples, and+for env vars and Ollama/OpenRouter/Atlas Cloud/OrcaRouter/Cheaper Inference+examples, and[`docs/llm-provider-comparison.md`](llm-provider-comparison.md)for the empirical model comparison.