Skip to content

Solution for long term memory for agent coding CLIs and to facilitate handoff between different agent vendors

Rust

docs: document Cheaper Inference as an openai-compat provider

aiapienthusiast360b54daf896
diff --git a/CHANGELOG.md b/CHANGELOG.md
index e2063e75..b60bd477 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -35,6 +35,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
`ai-memory backup --to <tarball>` command
(`docs/lifecycle-ops.md#backup`) is unchanged. (#950)
+### Changed
+- Documented Cheaper Inference as an endpoint for the existing `openai-compat`
+ provider.
+
### Fixed
- `memory_query` now returns `global_scope_hits` (standing `_global` user/team
preferences) for a single-project query whose project is named explicitly
diff --git a/docs/install.md b/docs/install.md
index 99da442f..6f6e7f37 100644
--- a/docs/install.md
+++ b/docs/install.md
@@ -1899,6 +1899,23 @@ Replace the model with another current OrcaRouter model id (same
`provider/model` format as OpenRouter, e.g. `anthropic/claude-sonnet-4.6` or
`deepseek/deepseek-v4-flash`) when needed.
+[Cheaper Inference](https://cheaperinference.com) is an OpenAI-compatible LLM
+gateway. Each model costs 15–60% less than the list price of its lab. It uses
+the same provider; no dedicated ai-memory provider is needed.
+Pass its API key through the generic compatibility credential:
+
+```bash
+-e AI_MEMORY_LLM_PROVIDER=openai-compat
+-e AI_MEMORY_LLM_BASE_URL=https://api.cheaperinference.com/v1
+-e AI_MEMORY_LLM_MODEL=gpt-5.4-mini
+-e LLM_API_KEY=ci_live_...
+```
+
+Model ids are bare, without a `provider/` prefix. Replace the model with
+another current Cheaper Inference model id (e.g. `claude-haiku-4.5` or
+`deepseek-v4-flash`) when needed. Cheaper Inference serves chat models only
+and has no embeddings endpoint; configure embeddings separately.
+
OpenAI-compatible structured calls use the operation's JSON Schema by default:
```bash
diff --git a/docs/llm-providers.md b/docs/llm-providers.md
index 23b87f24..60b3bddb 100644
--- a/docs/llm-providers.md
+++ b/docs/llm-providers.md
@@ -50,7 +50,7 @@ Recommended defaults:
| `copilot` | `gpt-5.5` | GitHub Copilot Chat backend via `ai-memory auth login copilot` or `COPILOT_GITHUB_TOKEN`; requires a Copilot subscription. |
| `gemini` | `gemini-3.5-flash` | Google-hosted option with a generous free tier. |
| `opencode` | `claude-sonnet-4-6` | OpenCode Go or Zen via `OPENCODE_API_KEY`. Go is the default endpoint; `AI_MEMORY_LLM_BASE_URL` selects Zen. Set `AI_MEMORY_LLM_MODEL` to an id the chosen endpoint serves. |
-| `openai-compat` | no default | OpenRouter, Atlas Cloud, OrcaRouter, Ollama, vLLM, LM Studio, and other compatible endpoints. |
+| `openai-compat` | no default | OpenRouter, Atlas Cloud, OrcaRouter, Cheaper Inference, Ollama, vLLM, LM Studio, and other compatible endpoints. |
| `openai-compat` + `AI_MEMORY_LLM_BASE_URL=https://openrouter.ai/api/v1` | no default (recommended: `anthropic/claude-haiku-4.5`) | Hosted access to a large model catalogue through one key. See [OpenRouter](#openrouter) below and the empirical comparison in [`llm-provider-comparison.md`](llm-provider-comparison.md). |
`openai-oauth` stores a refresh token in `<data_dir>/auth.json` and talks to
@@ -371,6 +371,7 @@ sentence embeddings run in-process (pure-Rust `all-MiniLM-L6-v2`,
pinned checksums — see [`docs/local-embeddings.md`](local-embeddings.md).
See [`docs/install.md#llm-provider-tiers`](install.md#llm-provider-tiers)
-for env vars and Ollama/OpenRouter/Atlas Cloud/OrcaRouter examples, and
+for env vars and Ollama/OpenRouter/Atlas Cloud/OrcaRouter/Cheaper Inference
+examples, and
[`docs/llm-provider-comparison.md`](llm-provider-comparison.md)
for the empirical model comparison.