Skip to content

Self-improving AI Employees for everyone

docs: deepen bun coverage in CLAUDE.md, pipeline doc, and README

trohitgd8af5c8e2849
diff --git a/CLAUDE.md b/CLAUDE.md
index daddf3fa..7cc7bd2e 100644
--- a/CLAUDE.md
+++ b/CLAUDE.md
@@ -41,9 +41,9 @@ This is a React Flow-based workflow automation platform implementing n8n-inspire
| **[Data Node & Vision](./docs-internal/data_node.md)** | The `dataSource` agent tool (raw local data over two namespaces: workspace paths + operator-approved `mnt/<name>/...` external mounts with per-mount writable flags; typed bounded read tiers text/csv/json/pdf/html/xlsx/image-metadata/binary; write/append but **no delete**; `copy_to_workspace` imports mount files as real FileRefs), the machine-wide `data_mounts` allowlist (`services/data/mount_store.py` — refuses `DATA_DIR` overlap, drive roots, home dir), the `visionAnalyze` delegate tool (vision for every host model via openai/anthropic/gemini official SDK shapes + the `services/media/image_fit.py` visual-token budget), and the first native-image-blocks increment: `ContentBlock.source` (durable `file_ref` vs transient `bytes` — the wire codec raises on bytes), the `llm_media` tool-result opt-in, capability-gated `hydrate_image_blocks` in `run_native_llm_step`, Anthropic `tool_result` image encoding (openai/gemini encoders pending; their `vision.enabled` stays false until then). |
| **[Canvas Node](./docs-internal/canvas_node.md)** | The `canvas` node — pushed-content display board (the Claude/ChatGPT-Canvas analog) in [`server/nodes/tool/canvas/`](./server/nodes/tool/canvas/). Dual control: agents call the locked `canvas(...)` tool (paths / url / 64KB-capped markdown notes, append/replace), workflow edges auto-display upstream FileRefs via a structural scan of `connected_outputs` (`tts → canvas` is a zero-config edge; the node is the one addition to `NodeExecutor._NEEDS_CONNECTED_OUTPUTS`). Board = plugin-owned `canvas_boards`/`canvas_items` tables (mount_store mechanism, 200-item FIFO), identity-only `canvas_updated` broadcast (direct, no canary consumer), `canvas_list/remove/clear` WS handlers with the simple_memory security preamble. **Two frontend hosts share one renderer**: the `isCanvasPanel` parameter panel and the new docked resizable right sidebar (`CanvasDock` + `canvasDockStore`; auto-open via `notifyPushed`, ephemeral click-to-preview from the gallery dialog, `usePanelResize` extracted from ConsolePanel). Renders media carousel with follow-latest image poll, markdown/code/JSON via the repo's first capped client-side text fetch (`useWorkspaceText`, 512KB), external URLs + workspace HTML in strictly sandboxed iframes (never `allow-same-origin`; `NEVER_INLINE` untouched), and inline PDF via the `INLINE_EXACT` exact-match addition to `preview.py`. Browser screenshots became displayable in the same change: both browser plugins persist shots as workspace FileRefs via the tolerant `nodes/browser/_screenshots.py`. |
| **[Translate / Transliterate / Detect](./docs-internal/speech_provider_rfc.md#8-what-this-pattern-should-absorb-next)** | The second application of the multi-vendor pattern, and the one that retired `nodes/sarvam/`. Three nodes (`translateText`, `transliterateText`, `detectLanguage`) in [`server/nodes/translate/`](./server/nodes/translate/), backed by **three registries — one per capability**, because the asymmetry is sharper than speech's: DeepL translates and does nothing else, while Sarvam and LLM-backed providers do all three. Membership makes an unsupported selection unrepresentable rather than a runtime failure inside a paid call. Providers: **deepl** (`Authorization: DeepL-Auth-Key`, `text` is an array, free keys ending `:fx` route to a different host, and it returns `billed_characters` so cost is the provider's own figure), **sarvam** (all three over dedicated REST), **openai** (all three via `ChatUnifier` — proves the Protocol does not care what a provider does internally; billing deliberately NOT recorded because that path bills tokens the LLM layer already costs). Capabilities in `server/config/translate_defaults.json`. |
-| **[CI/CD Pipeline](./docs-internal/ci_cd.md)** | GitHub Actions workflows, predeploy validation, release publishing, and composite setup action |
+| **[CI/CD Pipeline](./docs-internal/ci_cd.md)** | GitHub Actions workflows, predeploy validation, release publishing, and the composite setup action (bun via SHA-pinned `oven-sh/setup-bun` reading the root `packageManager` pin + Node 22 + Python 3.12 + uv; `bun install --frozen-lockfile` everywhere, publish stays `npm publish --provenance`) |
| **[Performance](./docs-internal/performance.md)** | Cold-start measurements (Application startup complete 2.90 s warm, 21.5 s cold post-`company clean` — was 71 s before the 2026-07-14 boot-delay fixes; first WS connect 8.29 s) + warm and cold per-phase timelines + optimisation history (lazy LangChain imports, lazy LLM-SDK exception refs, esbuild sidecar bundle, bytecode-at-build, PartySocket reconnect, TanStack Query auth bootstrap, `manualChunks`, Vite dep-cache preservation, off-loop Temporal build-id hash) + bottleneck inventory + reproduction commands + anti-patterns to never reintroduce (incl. eager SDK import at LLM provider registration, unconditional `.vite` wipe, synchronous `Worker()` on the event loop). Pairs with the build-time pipeline doc below. |
-| **[Release Build Pipeline](./docs-internal/release_build_pipeline.md)** | npm-distribution build pipeline: `typescript@7` (native Go compiler, exact-pinned in **root** devDependencies — client keeps `typescript@^5.x` because typescript-eslint's peer range excludes 6/7, and one manifest cannot declare `typescript` twice) for type-check, measured 5.9× faster than tsc 5.9.3 (820 ms vs 4830 ms); `bun run --filter react-flow-client typecheck` delegates up to the root gate, Vite `manualChunks` + `target: 'es2022'`, esbuild Node.js sidecar bundle (drops `tsx` interpreter cost), bytecode pre-compile in two halves — `[tool.uv] compile-bytecode = true` (uv sync compiles `.venv/` site-packages) + `python -m compileall` for project source (plain `.pyc`, **no `-O`** — per PEP 488 the non-`-O` runtimes never load `.opt-1.pyc`; excludes `.venv/`, `tests/`). Single source of truth for the bytecode-compile path list: `cli.commands.build.COMPILEALL_SOURCE_DIRS`. |
+| **[Release Build Pipeline](./docs-internal/release_build_pipeline.md)** | npm-distribution build pipeline: `typescript@7` (native Go compiler, exact-pinned in **root** devDependencies — client keeps `typescript@^5.x` because typescript-eslint's peer range excludes 6/7, and one manifest cannot declare `typescript` twice) for type-check, measured 5.9× faster than tsc 5.9.3 (820 ms vs 4830 ms); `bun run --filter react-flow-client typecheck` delegates up to the root gate, Vite `manualChunks` + `target: 'es2022'`, esbuild Node.js sidecar bundle (drops `tsx` interpreter cost), bytecode pre-compile in two halves — `[tool.uv] compile-bytecode = true` (uv sync compiles `.venv/` site-packages) + `python -m compileall` for project source (plain `.pyc`, **no `-O`** — per PEP 488 the non-`-O` runtimes never load `.opt-1.pyc`; excludes `.venv/`, `tests/`). Single source of truth for the bytecode-compile path list: `cli.commands.build.COMPILEALL_SOURCE_DIRS`. Dev PM is **[email protected]** (tracked text `bun.lock`, `bunfig.toml` pins the isolated linker, ranged security pins in top-level `overrides`); `company build` step [1/6] is `bun install`. |
| **[Workflow Schema](./docs-internal/workflow-schema.md)** | JSON schema for workflows, edge handle conventions, config node architecture |
| **[Execution Engine Design](./docs-internal/DESIGN.md)** | Architecture patterns, design standards, and implementation details for the workflow execution engine |
| **[Execution Roadmap](./docs-internal/ROADMAP.md)** | Implementation status, completed phases, and pending features |
@@ -760,6 +760,8 @@ Execution routing falls back Temporal → sequential; the Temporal dev server +
## Development Commands
+**Package manager: bun** (pinned via `packageManager: [email protected]` in the root package.json). Source checkouts are gated to bun by `scripts/preinstall.js` (keys on `bunfig.toml` + a `bun` user agent) — `npm install` in the repo is rejected with a pointer to https://bun.sh; end-user installs of the published npm package are unaffected. `bunfig.toml` pins the **isolated linker** (pnpm-style symlinked `node_modules` with the store at `node_modules/.bun/`), the lockfile is the tracked text `bun.lock`, and Node 22 remains the runtime — bun only installs and runs scripts, never executes tools with `--bun`. Security pins live in the top-level `overrides` block (version-ranged keys). See [CONTRIBUTING.md](./CONTRIBUTING.md) → "Known differences from pnpm" for the guards that changed in the 2026-08 pnpm→bun migration.
+
### CLI Commands (after the global install)
```bash
company start # Start all services (production mode)
diff --git a/README.md b/README.md
index e4fdf4fc..27206e4a 100644
--- a/README.md
+++ b/README.md
@@ -28,11 +28,9 @@ Open http://localhost:5678 and click the key icon (**API Credentials**) in the t
<summary><b>Run from source (for contributors)</b></summary>
```bash
-# install bun (https://bun.sh) — Windows: powershell -c "irm bun.sh/install.ps1 | iex"
-curl -fsSL https://bun.sh/install | bash
git clone https://github.com/zeenie-ai/OpenCompany.git OpenCompany
cd OpenCompany
-bun install
+npm install -g bun
bun run build
bun run dev
```
diff --git a/docs-internal/release_build_pipeline.md b/docs-internal/release_build_pipeline.md
index ee27a398..9ad940f4 100644
--- a/docs-internal/release_build_pipeline.md
+++ b/docs-internal/release_build_pipeline.md
@@ -13,6 +13,47 @@ User scope (confirmed before this work): stay on npm distribution; **no** Nuitka
| Node sidecar | `esbuild` bundle to `dist/index.js`, run via `node` | Drops tsx interpreter startup (~500ms-1s every server boot). `--packages=external` keeps Express in `node_modules/` for patch flow. |
| Python | `python -m compileall -q -j 0 <project dirs>` + `[tool.uv] compile-bytecode = true` | Pre-compile bytecode. Implemented as step `[5/6]` in [`cli/commands/build.py`](../cli/commands/build.py) (`COMPILEALL_SOURCE_DIRS` constant lists the dirs); `server/pyproject.toml`'s `compile-bytecode = true` makes `uv sync` (step `[4/6]`) compile `.venv/` site-packages too. No `-O`: every runtime launches python without `-O`, and per PEP 488 a non-optimized interpreter only loads plain `.pyc` — the earlier `-O` invocation produced `.opt-1.pyc` that nothing ever loaded (fixed 2026-07-14; ~30-50s cold-start gain, see [performance.md](performance.md)). |
+## Package manager (bun)
+
+The dev workspace runs on **bun** (migrated from [email protected], 2026-08; pinned
+via `"packageManager": "[email protected]"` — CI's `oven-sh/setup-bun` reads that pin).
+Facts that are load-bearing, each verified during the migration:
+
+- **Scope**: bun installs the workspace and runs scripts; **Node 22 stays the
+ runtime** (vite/vitest/eslint/the sidecar run on node via shebang — never
+ pass `--bun`). Everything npm-facing is deliberately untouched: end-user
+ `npm install -g @zeenie-ai/opencompany`, the backend's
+ `npm install --prefix <DATA_DIR>/packages/` shared tree, the sidecar's
+ user-package endpoints, and `npm publish --provenance` in release.yml.
+- **Gate**: `scripts/preinstall.js` rejects non-bun installs in a source
+ checkout. It keys on `bunfig.toml` existing (committed, excluded from the
+ tarball by the `files` allowlist, so end-user npm installs never trigger it)
+ and on `npm_config_user_agent` **starting with** `bun` — bun's UA is
+ `bun/x.y.z npm/? node/...`, so a substring match on "npm" would misfire.
+- **Layout**: `bunfig.toml` pins `linker = "isolated"` — pnpm-style symlinked
+ `node_modules` with the store at `node_modules/.bun/` (NOT `.pnpm/`). The
+ phantom-dependency guard, the `typeRoots` tsconfig workaround, and the
+ `vite-env.d.ts` triple-slash reference all depend on this layout.
+- **Lockfile**: the tracked text `bun.lock` is **lockfileVersion 3** — forced
+ by the version-ranged keys in the top-level `overrides` block (the security
+ pins formerly under `pnpm.overrides`, moved verbatim). Older bun cannot read
+ it; the `packageManager` pin is the effective read-floor.
+- **Sharp edges** (each bites silently): declaring `trustedDependencies`
+ REPLACES bun's default trusted list rather than extending it — do not declare
+ it (esbuild's install script would stop running); never pass
+ `--omit=optional` (it drops the per-platform rollup/esbuild/TS7 binaries,
+ oven-sh/bun#16696); bun 1.4 rejects the space-separated `--cwd ..` form
+ (`bun --cwd=.. run <script>` is required — this is why the client typecheck
+ script uses `=`); and `--filter` must come AFTER the `run` subcommand.
+- **Lost guard**: pnpm's `strict-peer-dependencies` has no bun equivalent (bun
+ never errors on peer conflicts, oven-sh/bun#9135). The
+ `test_client_keeps_typescript_5_for_typescript_eslint` CLI test is now the
+ only check keeping client `typescript` inside typescript-eslint's peer range.
+- Config invariants (gate source, manifest shape, bunfig linker, workspace
+ paths) are locked by `cli/tests/test_release_pipeline_config.py`; the
+ workspace-member oracle in `cli/tests/conftest.py` parses the root
+ `workspaces` array directly (bun has no `pnpm list --json` equivalent).
+
## Implementation steps
### 1. TypeScript 7 type-check
diff --git a/server/config/model_registry.json b/server/config/model_registry.json
index 0111a32f..474df351 100644
--- a/server/config/model_registry.json
+++ b/server/config/model_registry.json
@@ -1,17 +1,17 @@
{
- "_generated": "2026-08-24T09:07:32.003848+00:00",
+ "_generated": "2026-09-01T06:12:50.522492+00:00",
"_source": "openrouter",
- "_model_count": 422,
+ "_model_count": 420,
"models": {
- "meta/muse-spark-1.2-contributor": {
- "id": "meta/muse-spark-1.2-contributor",
- "name": "Meta: Muse Spark 1.2 Contributor",
- "provider": "meta",
- "local_id": "muse-spark-1.2-contributor",
- "context_length": 1048576,
- "max_output_tokens": 0,
+ "ibm-granite/granite-4.2-8b": {
+ "id": "ibm-granite/granite-4.2-8b",
+ "name": "IBM: Granite 4.2 8B",
+ "provider": "ibm-granite",
+ "local_id": "granite-4.2-8b",
+ "context_length": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.1,
- "output_price_per_mtok": 0.2,
+ "output_price_per_mtok": 0.15,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -20,29 +20,173 @@
],
"is_reasoning_model": false,
"supported_parameters": [
+ "frequency_penalty",
"include_reasoning",
+ "logprobs",
"max_tokens",
+ "presence_penalty",
"reasoning",
"reasoning_effort",
"repetition_penalty",
"response_format",
+ "seed",
+ "stop",
"structured_outputs",
"temperature",
"tool_choice",
"tools",
"top_k",
+ "top_logprobs",
"top_p"
]
},
- "deepseek/deepseek-v4-flash-vision-exp": {
- "id": "deepseek/deepseek-v4-flash-vision-exp",
- "name": "DeepSeek: DeepSeek V4 Flash Vision Exp",
- "provider": "deepseek",
- "local_id": "deepseek-v4-flash-vision-exp",
+ "tencent/hy4-preview": {
+ "id": "tencent/hy4-preview",
+ "name": "Tencent: Hy4 preview",
+ "provider": "tencent",
+ "local_id": "hy4-preview",
"context_length": 1048576,
- "max_output_tokens": 384000,
- "input_price_per_mtok": 0.22,
- "output_price_per_mtok": 0.66,
+ "max_output_tokens": 64000,
+ "input_price_per_mtok": 0.834,
+ "output_price_per_mtok": 2.501,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "include_reasoning",
+ "max_completion_tokens",
+ "max_tokens",
+ "reasoning",
+ "reasoning_effort",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools"
+ ]
+ },
+ "inclusionai/ling-3.0-flash-fin:free": {
+ "id": "inclusionai/ling-3.0-flash-fin:free",
+ "name": "Ling 3.0 Flash Fin (free)",
+ "provider": "inclusionai",
+ "local_id": "ling-3.0-flash-fin:free",
+ "context_length": 262144,
+ "max_output_tokens": 32768,
+ "input_price_per_mtok": 0.0,
+ "output_price_per_mtok": 0.0,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logprobs",
+ "max_tokens",
+ "presence_penalty",
+ "reasoning",
+ "repetition_penalty",
+ "seed",
+ "stop",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_logprobs",
+ "top_p"
+ ]
+ },
+ "qwen/qwen3.8-flash": {
+ "id": "qwen/qwen3.8-flash",
+ "name": "Qwen: Qwen3.8 Flash",
+ "provider": "qwen",
+ "local_id": "qwen3.8-flash",
+ "context_length": 1000000,
+ "max_output_tokens": 131072,
+ "input_price_per_mtok": 0.15,
+ "output_price_per_mtok": 0.47,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logprobs",
+ "max_tokens",
+ "presence_penalty",
+ "reasoning",
+ "response_format",
+ "seed",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_logprobs",
+ "top_p"
+ ]
+ },
+ "z-ai/glm-5.3-flash": {
+ "id": "z-ai/glm-5.3-flash",
+ "name": "Z.ai: GLM 5.3 Flash",
+ "provider": "z-ai",
+ "local_id": "glm-5.3-flash",
+ "context_length": 1310720,
+ "max_output_tokens": 131072,
+ "input_price_per_mtok": 0.075,
+ "output_price_per_mtok": 0.25,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "logprobs",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "seed",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_logprobs",
+ "top_p"
+ ]
+ },
+ "z-ai/glm-5.3-flash:batch": {
+ "id": "z-ai/glm-5.3-flash:batch",
+ "name": "Z.ai: GLM 5.3 Flash (batch)",
+ "provider": "z-ai",
+ "local_id": "glm-5.3-flash:batch",
+ "context_length": 1048575,
+ "max_output_tokens": 943717,
+ "input_price_per_mtok": 0.15,
+ "output_price_per_mtok": 0.5,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -53,29 +197,34 @@
"supported_parameters": [
"frequency_penalty",
"include_reasoning",
+ "logit_bias",
"logprobs",
"max_tokens",
+ "min_p",
"presence_penalty",
"reasoning",
"reasoning_effort",
+ "repetition_penalty",
"response_format",
"stop",
+ "structured_outputs",
"temperature",
"tool_choice",
"tools",
+ "top_k",
"top_logprobs",
"top_p"
]
},
- "stealth/ox-alpha": {
- "id": "stealth/ox-alpha",
- "name": "Ox Alpha",
- "provider": "stealth",
- "local_id": "ox-alpha",
+ "meta/muse-spark-1.2-contributor": {
+ "id": "meta/muse-spark-1.2-contributor",
+ "name": "Meta: Muse Spark 1.2 Contributor",
+ "provider": "meta",
+ "local_id": "muse-spark-1.2-contributor",
"context_length": 1048576,
- "max_output_tokens": 131072,
- "input_price_per_mtok": 0.0,
- "output_price_per_mtok": 0.0,
+ "max_output_tokens": 943718,
+ "input_price_per_mtok": 0.1,
+ "output_price_per_mtok": 0.2,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -88,7 +237,9 @@
"max_tokens",
"reasoning",
"reasoning_effort",
+ "repetition_penalty",
"response_format",
+ "structured_outputs",
"temperature",
"tool_choice",
"tools",
@@ -96,6 +247,42 @@
"top_p"
]
},
+ "deepseek/deepseek-v4-flash-vision-exp": {
+ "id": "deepseek/deepseek-v4-flash-vision-exp",
+ "name": "DeepSeek: DeepSeek V4 Flash Vision Exp",
+ "provider": "deepseek",
+ "local_id": "deepseek-v4-flash-vision-exp",
+ "context_length": 1048576,
+ "max_output_tokens": 384000,
+ "input_price_per_mtok": 0.44,
+ "output_price_per_mtok": 1.32,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logprobs",
+ "max_tokens",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "seed",
+ "stop",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_logprobs",
+ "top_p"
+ ]
+ },
"tencent/hy-mt2-1.8b": {
"id": "tencent/hy-mt2-1.8b",
"name": "Tencent: Hy-MT2-1.8B",
@@ -149,10 +336,10 @@
"name": "Z.ai: GLM Latest",
"provider": "z-ai",
"local_id": "glm-latest",
- "context_length": 1048576,
- "max_output_tokens": 131072,
- "input_price_per_mtok": 1.4,
- "output_price_per_mtok": 4.4,
+ "context_length": 1310720,
+ "max_output_tokens": 943718,
+ "input_price_per_mtok": 1.17,
+ "output_price_per_mtok": 3.96,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -161,15 +348,25 @@
],
"is_reasoning_model": false,
"supported_parameters": [
+ "frequency_penalty",
"include_reasoning",
+ "logit_bias",
+ "logprobs",
"max_tokens",
+ "min_p",
+ "presence_penalty",
"reasoning",
"reasoning_effort",
+ "repetition_penalty",
"response_format",
+ "seed",
+ "stop",
+ "structured_outputs",
"temperature",
"tool_choice",
"tools",
"top_k",
+ "top_logprobs",
"top_p"
]
},
@@ -203,7 +400,7 @@
"name": "Z.ai: GLM 5.3",
"provider": "z-ai",
"local_id": "glm-5.3",
- "context_length": 1048576,
+ "context_length": 1310720,
"max_output_tokens": 131072,
"input_price_per_mtok": 1.4,
"output_price_per_mtok": 4.4,
@@ -215,15 +412,25 @@
],
"is_reasoning_model": false,
"supported_parameters": [
+ "frequency_penalty",
"include_reasoning",
+ "logit_bias",
+ "logprobs",
"max_tokens",
+ "min_p",
+ "presence_penalty",
"reasoning",
"reasoning_effort",
+ "repetition_penalty",
"response_format",
+ "seed",
+ "stop",
+ "structured_outputs",
"temperature",
"tool_choice",
"tools",
"top_k",
+ "top_logprobs",
"top_p"
]
},
@@ -234,8 +441,8 @@
"local_id": "qwen3.8-27b",
"context_length": 1000000,
"max_output_tokens": 131072,
- "input_price_per_mtok": 0.4,
- "output_price_per_mtok": 3.0,
+ "input_price_per_mtok": 0.425,
+ "output_price_per_mtok": 2.55,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -249,6 +456,7 @@
"logit_bias",
"logprobs",
"max_tokens",
+ "min_p",
"presence_penalty",
"reasoning",
"reasoning_effort",
@@ -271,7 +479,7 @@
"provider": "dots-studio",
"local_id": "dots-3-note-preview:free",
"context_length": 512000,
- "max_output_tokens": 512000,
+ "max_output_tokens": 460800,
"input_price_per_mtok": 0.0,
"output_price_per_mtok": 0.0,
"supports_thinking": false,
@@ -300,8 +508,8 @@
"local_id": "gemini-3.7-flash",
"context_length": 1048576,
"max_output_tokens": 65536,
- "input_price_per_mtok": 0.375,
- "output_price_per_mtok": 1.875,
+ "input_price_per_mtok": 0.75,
+ "output_price_per_mtok": 3.75,
"supports_thinking": true,
"thinking_type": "budget",
"temperature_range": [
@@ -359,7 +567,7 @@
"provider": "bytedance-seed",
"local_id": "seed-2-1-turbo",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.5,
"output_price_per_mtok": 2.5,
"supports_thinking": false,
@@ -389,7 +597,7 @@
"provider": "qwen",
"local_id": "qwen3.8-2.4t-a95b",
"context_length": 1048576,
- "max_output_tokens": 131072,
+ "max_output_tokens": 262144,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 6.0,
"supports_thinking": false,
@@ -422,6 +630,44 @@
"top_p"
]
},
+ "qwen/qwen3.8-2.4t-a95b:batch": {
+ "id": "qwen/qwen3.8-2.4t-a95b:batch",
+ "name": "Qwen: Qwen3.8 2.4T A95B (batch)",
+ "provider": "qwen",
+ "local_id": "qwen3.8-2.4t-a95b:batch",
+ "context_length": 1010000,
+ "max_output_tokens": 909000,
+ "input_price_per_mtok": 2.5,
+ "output_price_per_mtok": 6.25,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "logprobs",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_logprobs",
+ "top_p"
+ ]
+ },
"bytedance-seed/seed-2.0-code": {
"id": "bytedance-seed/seed-2.0-code",
"name": "ByteDance Seed: Seed-2.0-Code",
@@ -459,9 +705,9 @@
"provider": "deepseek",
"local_id": "deepseek-v4-pro-0813",
"context_length": 1048576,
- "max_output_tokens": 0,
- "input_price_per_mtok": 1.122,
- "output_price_per_mtok": 3.366,
+ "max_output_tokens": 384000,
+ "input_price_per_mtok": 1.1154,
+ "output_price_per_mtok": 3.3462,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -492,13 +738,49 @@
"top_p"
]
},
+ "deepseek/deepseek-v4-pro-0813:batch": {
+ "id": "deepseek/deepseek-v4-pro-0813:batch",
+ "name": "DeepSeek: DeepSeek V4 Pro 0813 (batch)",
+ "provider": "deepseek",
+ "local_id": "deepseek-v4-pro-0813:batch",
+ "context_length": 1048576,
+ "max_output_tokens": 943718,
+ "input_price_per_mtok": 1.32,
+ "output_price_per_mtok": 3.96,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_p"
+ ]
+ },
"xai/grok-4.6": {
"id": "x-ai/grok-4.6",
"name": "SpaceXAI: Grok 4.6",
"provider": "xai",
"local_id": "grok-4.6",
"context_length": 500000,
- "max_output_tokens": 0,
+ "max_output_tokens": 450000,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 6.0,
"supports_thinking": false,
@@ -516,10 +798,12 @@
"reasoning_effort",
"response_format",
"seed",
+ "stop",
"structured_outputs",
"temperature",
"tool_choice",
"tools",
+ "top_k",
"top_logprobs",
"top_p"
]
@@ -689,9 +973,9 @@
"provider": "meta",
"local_id": "muse-glimmer-30b",
"context_length": 131072,
- "max_output_tokens": 0,
- "input_price_per_mtok": 0.35,
- "output_price_per_mtok": 1.5,
+ "max_output_tokens": 16384,
+ "input_price_per_mtok": 0.3,
+ "output_price_per_mtok": 1.2,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -722,13 +1006,49 @@
"top_p"
]
},
+ "meta/muse-glimmer-30b:batch": {
+ "id": "meta/muse-glimmer-30b:batch",
+ "name": "Meta: Muse Glimmer 30B (batch)",
+ "provider": "meta",
+ "local_id": "muse-glimmer-30b:batch",
+ "context_length": 131072,
+ "max_output_tokens": 117964,
+ "input_price_per_mtok": 0.35,
+ "output_price_per_mtok": 1.5,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_p"
+ ]
+ },
"meta/muse-spark-1.2": {
"id": "meta/muse-spark-1.2",
"name": "Meta: Muse Spark 1.2",
"provider": "meta",
"local_id": "muse-spark-1.2",
"context_length": 1048576,
- "max_output_tokens": 0,
+ "max_output_tokens": 943718,
"input_price_per_mtok": 1.25,
"output_price_per_mtok": 4.25,
"supports_thinking": false,
@@ -795,9 +1115,9 @@
"provider": "deepseek",
"local_id": "deepseek-v4-flash-latest",
"context_length": 1310720,
- "max_output_tokens": 1048576,
- "input_price_per_mtok": 0.04,
- "output_price_per_mtok": 0.08,
+ "max_output_tokens": 393216,
+ "input_price_per_mtok": 0.05,
+ "output_price_per_mtok": 0.16,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -836,7 +1156,48 @@
"provider": "deepseek",
"local_id": "deepseek-v4-flash-0731",
"context_length": 1310720,
- "max_output_tokens": 131072,
+ "max_output_tokens": 943718,
+ "input_price_per_mtok": 0.065,
+ "output_price_per_mtok": 0.18,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "logprobs",
+ "max_tokens",
+ "min_p",
+ "parallel_tool_calls",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "seed",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_a",
+ "top_k",
+ "top_logprobs",
+ "top_p"
+ ]
+ },
+ "deepseek/deepseek-v4-flash-0731:batch": {
+ "id": "deepseek/deepseek-v4-flash-0731:batch",
+ "name": "DeepSeek: DeepSeek V4 Flash 0731 (batch)",
+ "provider": "deepseek",
+ "local_id": "deepseek-v4-flash-0731:batch",
+ "context_length": 1048576,
+ "max_output_tokens": 943718,
"input_price_per_mtok": 0.14,
"output_price_per_mtok": 0.28,
"supports_thinking": false,
@@ -846,6 +1207,42 @@
2.0
],
"is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_p"
+ ]
+ },
+ "thinkingmachines/inkling-small": {
+ "id": "thinkingmachines/inkling-small",
+ "name": "Thinking Machines: Inkling Small",
+ "provider": "thinkingmachines",
+ "local_id": "inkling-small",
+ "context_length": 1048576,
+ "max_output_tokens": 262144,
+ "input_price_per_mtok": 0.45,
+ "output_price_per_mtok": 1.2,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
"supported_parameters": [
"frequency_penalty",
"include_reasoning",
@@ -853,32 +1250,28 @@
"logprobs",
"max_tokens",
"min_p",
- "parallel_tool_calls",
"presence_penalty",
"reasoning",
"reasoning_effort",
"repetition_penalty",
- "response_format",
"seed",
"stop",
- "structured_outputs",
"temperature",
"tool_choice",
"tools",
- "top_a",
"top_k",
"top_logprobs",
"top_p"
]
},
- "thinkingmachines/inkling-small": {
- "id": "thinkingmachines/inkling-small",
- "name": "Thinking Machines: Inkling Small",
+ "thinkingmachines/inkling-small:batch": {
+ "id": "thinkingmachines/inkling-small:batch",
+ "name": "Thinking Machines: Inkling Small (batch)",
"provider": "thinkingmachines",
- "local_id": "inkling-small",
- "context_length": 1048576,
- "max_output_tokens": 262144,
- "input_price_per_mtok": 0.45,
+ "local_id": "inkling-small:batch",
+ "context_length": 524288,
+ "max_output_tokens": 471859,
+ "input_price_per_mtok": 0.5,
"output_price_per_mtok": 1.2,
"supports_thinking": false,
"thinking_type": "none",
@@ -898,7 +1291,6 @@
"reasoning",
"reasoning_effort",
"repetition_penalty",
- "seed",
"stop",
"temperature",
"tool_choice",
@@ -913,7 +1305,7 @@
"name": "Thinking Machines: Inkling Small (free)",
"provider": "thinkingmachines",
"local_id": "inkling-small:free",
- "context_length": 262144,
+ "context_length": 1048576,
"max_output_tokens": 262144,
"input_price_per_mtok": 0.0,
"output_price_per_mtok": 0.0,
@@ -1305,7 +1697,7 @@
"provider": "thinkingmachines",
"local_id": "inkling",
"context_length": 1048576,
- "max_output_tokens": 0,
+ "max_output_tokens": 471859,
"input_price_per_mtok": 1.0,
"output_price_per_mtok": 4.05,
"supports_thinking": false,
@@ -1341,7 +1733,7 @@
"provider": "thinkingmachines",
"local_id": "inkling:batch",
"context_length": 524288,
- "max_output_tokens": 0,
+ "max_output_tokens": 471859,
"input_price_per_mtok": 1.0,
"output_price_per_mtok": 4.05,
"supports_thinking": false,
@@ -1374,7 +1766,7 @@
"name": "Thinking Machines: Inkling (free)",
"provider": "thinkingmachines",
"local_id": "inkling:free",
- "context_length": 262144,
+ "context_length": 1048576,
"max_output_tokens": 262144,
"input_price_per_mtok": 0.0,
"output_price_per_mtok": 0.0,
@@ -1447,7 +1839,7 @@
"provider": "moonshotai",
"local_id": "kimi-k3",
"context_length": 1048576,
- "max_output_tokens": 1048576,
+ "max_output_tokens": 943718,
"input_price_per_mtok": 3.0,
"output_price_per_mtok": 15.0,
"supports_thinking": false,
@@ -1480,15 +1872,15 @@
"top_p"
]
},
- "meta/muse-spark-1.1": {
- "id": "meta/muse-spark-1.1",
- "name": "Meta: Muse Spark 1.1",
- "provider": "meta",
- "local_id": "muse-spark-1.1",
+ "moonshotai/kimi-k3:batch": {
+ "id": "moonshotai/kimi-k3:batch",
+ "name": "MoonshotAI: Kimi K3 (batch)",
+ "provider": "moonshotai",
+ "local_id": "kimi-k3:batch",
"context_length": 1048576,
- "max_output_tokens": 0,
- "input_price_per_mtok": 1.25,
- "output_price_per_mtok": 4.25,
+ "max_output_tokens": 943718,
+ "input_price_per_mtok": 3.0,
+ "output_price_per_mtok": 15.0,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -1497,12 +1889,17 @@
],
"is_reasoning_model": false,
"supported_parameters": [
+ "frequency_penalty",
"include_reasoning",
+ "logit_bias",
"max_tokens",
+ "min_p",
+ "presence_penalty",
"reasoning",
"reasoning_effort",
"repetition_penalty",
"response_format",
+ "stop",
"structured_outputs",
"temperature",
"tool_choice",
@@ -1511,15 +1908,15 @@
"top_p"
]
},
- "kwaipilot/kat-coder-air-v2.5": {
- "id": "kwaipilot/kat-coder-air-v2.5",
- "name": "Kwaipilot: KAT-Coder-Air V2.5",
- "provider": "kwaipilot",
- "local_id": "kat-coder-air-v2.5",
- "context_length": 256000,
- "max_output_tokens": 80000,
- "input_price_per_mtok": 0.15,
- "output_price_per_mtok": 0.6,
+ "meta/muse-spark-1.1": {
+ "id": "meta/muse-spark-1.1",
+ "name": "Meta: Muse Spark 1.1",
+ "provider": "meta",
+ "local_id": "muse-spark-1.1",
+ "context_length": 1048576,
+ "max_output_tokens": 943718,
+ "input_price_per_mtok": 1.25,
+ "output_price_per_mtok": 4.25,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -1528,16 +1925,17 @@
],
"is_reasoning_model": false,
"supported_parameters": [
- "logprobs",
+ "include_reasoning",
"max_tokens",
- "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
"response_format",
- "stop",
"structured_outputs",
"temperature",
"tool_choice",
"tools",
- "top_logprobs",
+ "top_k",
"top_p"
]
},
@@ -1546,8 +1944,8 @@
"name": "Kwaipilot: KAT-Coder-Pro V2.5",
"provider": "kwaipilot",
"local_id": "kat-coder-pro-v2.5",
- "context_length": 256000,
- "max_output_tokens": 80000,
+ "context_length": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.74,
"output_price_per_mtok": 2.96,
"supports_thinking": false,
@@ -1558,16 +1956,20 @@
],
"is_reasoning_model": false,
"supported_parameters": [
- "logprobs",
+ "frequency_penalty",
+ "logit_bias",
"max_tokens",
+ "min_p",
"presence_penalty",
+ "repetition_penalty",
"response_format",
+ "seed",
"stop",
"structured_outputs",
"temperature",
"tool_choice",
"tools",
- "top_logprobs",
+ "top_k",
"top_p"
]
},
@@ -1919,7 +2321,7 @@
"provider": "xai",
"local_id": "grok-4.5",
"context_length": 500000,
- "max_output_tokens": 0,
+ "max_output_tokens": 450000,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 6.0,
"supports_thinking": false,
@@ -1951,7 +2353,7 @@
"provider": "xai",
"local_id": "grok-latest",
"context_length": 500000,
- "max_output_tokens": 0,
+ "max_output_tokens": 450000,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 6.0,
"supports_thinking": false,
@@ -1969,10 +2371,12 @@
"reasoning_effort",
"response_format",
"seed",
+ "stop",
"structured_outputs",
"temperature",
"tool_choice",
"tools",
+ "top_k",
"top_logprobs",
"top_p"
]
@@ -2184,7 +2588,7 @@
"provider": "gemini",
"local_id": "gemini-3.1-flash-lite-image",
"context_length": 65536,
- "max_output_tokens": 65536,
+ "max_output_tokens": 58982,
"input_price_per_mtok": 0.25,
"output_price_per_mtok": 1.5,
"supports_thinking": true,
@@ -2211,7 +2615,7 @@
"provider": "nex-agi",
"local_id": "nex-n2-mini",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.025,
"output_price_per_mtok": 0.1,
"supports_thinking": false,
@@ -2357,9 +2761,9 @@
"provider": "z-ai",
"local_id": "glm-5.2",
"context_length": 1048576,
- "max_output_tokens": 131072,
- "input_price_per_mtok": 0.966,
- "output_price_per_mtok": 3.036,
+ "max_output_tokens": 262144,
+ "input_price_per_mtok": 1.19,
+ "output_price_per_mtok": 3.74,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -2391,49 +2795,13 @@
"top_p"
]
},
- "z-ai/glm-5.2:batch": {
- "id": "z-ai/glm-5.2:batch",
- "name": "Z.ai: GLM 5.2 (batch)",
- "provider": "z-ai",
- "local_id": "glm-5.2:batch",
- "context_length": 1048575,
- "max_output_tokens": 0,
- "input_price_per_mtok": 1.4,
- "output_price_per_mtok": 4.4,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "include_reasoning",
- "logit_bias",
- "max_tokens",
- "min_p",
- "presence_penalty",
- "reasoning",
- "reasoning_effort",
- "repetition_penalty",
- "response_format",
- "stop",
- "structured_outputs",
- "temperature",
- "tool_choice",
- "tools",
- "top_k",
- "top_p"
- ]
- },
"z-ai/glm-5.2:free": {
"id": "z-ai/glm-5.2:free",
"name": "Z.ai: GLM 5.2 (free)",
"provider": "z-ai",
"local_id": "glm-5.2:free",
"context_length": 256000,
- "max_output_tokens": 256000,
+ "max_output_tokens": 230400,
"input_price_per_mtok": 0.0,
"output_price_per_mtok": 0.0,
"supports_thinking": false,
@@ -2487,8 +2855,8 @@
"provider": "moonshotai",
"local_id": "kimi-k2.7-code",
"context_length": 262144,
- "max_output_tokens": 262144,
- "input_price_per_mtok": 0.67,
+ "max_output_tokens": 235929,
+ "input_price_per_mtok": 0.66,
"output_price_per_mtok": 3.4,
"supports_thinking": false,
"thinking_type": "none",
@@ -2520,41 +2888,6 @@
"top_p"
]
},
- "moonshotai/kimi-k2.7-code:batch": {
- "id": "moonshotai/kimi-k2.7-code:batch",
- "name": "MoonshotAI: Kimi K2.7 Code (batch)",
- "provider": "moonshotai",
- "local_id": "kimi-k2.7-code:batch",
- "context_length": 262144,
- "max_output_tokens": 0,
- "input_price_per_mtok": 0.95,
- "output_price_per_mtok": 4.0,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "include_reasoning",
- "logit_bias",
- "max_tokens",
- "min_p",
- "presence_penalty",
- "reasoning",
- "repetition_penalty",
- "response_format",
- "stop",
- "structured_outputs",
- "temperature",
- "tool_choice",
- "tools",
- "top_k",
- "top_p"
- ]
- },
"anthropic/claude-fable-latest": {
"id": "~anthropic/claude-fable-latest",
"name": "Anthropic: Claude Fable Latest",
@@ -2650,7 +2983,7 @@
"provider": "nex-agi",
"local_id": "nex-n2-pro",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.25,
"output_price_per_mtok": 1.0,
"supports_thinking": false,
@@ -2704,10 +3037,10 @@
"name": "NVIDIA: Nemotron 3 Ultra",
"provider": "nvidia",
"local_id": "nemotron-3-ultra-550b-a55b",
- "context_length": 512288,
- "max_output_tokens": 0,
- "input_price_per_mtok": 0.6,
- "output_price_per_mtok": 3.6,
+ "context_length": 262144,
+ "max_output_tokens": 16384,
+ "input_price_per_mtok": 0.5,
+ "output_price_per_mtok": 2.2,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -2742,7 +3075,7 @@
"provider": "nvidia",
"local_id": "nemotron-3-ultra-550b-a55b:batch",
"context_length": 512288,
- "max_output_tokens": 0,
+ "max_output_tokens": 461059,
"input_price_per_mtok": 0.6,
"output_price_per_mtok": 3.6,
"supports_thinking": false,
@@ -2879,7 +3212,7 @@
"provider": "minimax",
"local_id": "minimax-m3:batch",
"context_length": 524288,
- "max_output_tokens": 0,
+ "max_output_tokens": 471859,
"input_price_per_mtok": 0.3,
"output_price_per_mtok": 1.2,
"supports_thinking": false,
@@ -2908,13 +3241,41 @@
"top_p"
]
},
+ "minimax/minimax-m3:free": {
+ "id": "minimax/minimax-m3:free",
+ "name": "MiniMax: MiniMax M3 (free)",
+ "provider": "minimax",
+ "local_id": "minimax-m3:free",
+ "context_length": 1048576,
+ "max_output_tokens": 943718,
+ "input_price_per_mtok": 0.0,
+ "output_price_per_mtok": 0.0,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "include_reasoning",
+ "max_tokens",
+ "reasoning",
+ "response_format",
+ "seed",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_p"
+ ]
+ },
"stepfun/step-3.7-flash": {
"id": "stepfun/step-3.7-flash",
"name": "StepFun: Step 3.7 Flash",
"provider": "stepfun",
"local_id": "step-3.7-flash",
"context_length": 262144,
- "max_output_tokens": 256000,
+ "max_output_tokens": 230400,
"input_price_per_mtok": 0.2,
"output_price_per_mtok": 1.15,
"supports_thinking": false,
@@ -3077,7 +3438,7 @@
"provider": "xai",
"local_id": "grok-build-0.1",
"context_length": 256000,
- "max_output_tokens": 0,
+ "max_output_tokens": 230400,
"input_price_per_mtok": 1.0,
"output_price_per_mtok": 2.0,
"supports_thinking": false,
@@ -3221,40 +3582,6 @@
"top_p"
]
},
- "inclusionai/ring-2.6-1t": {
- "id": "inclusionai/ring-2.6-1t",
- "name": "inclusionAI: Ring-2.6-1T",
- "provider": "inclusionai",
- "local_id": "ring-2.6-1t",
- "context_length": 262144,
- "max_output_tokens": 65536,
- "input_price_per_mtok": 0.075,
- "output_price_per_mtok": 0.625,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "include_reasoning",
- "max_tokens",
- "presence_penalty",
- "reasoning",
- "reasoning_effort",
- "repetition_penalty",
- "response_format",
- "seed",
- "stop",
- "temperature",
- "tool_choice",
- "tools",
- "top_k",
- "top_p"
- ]
- },
"gemini/gemini-3.1-flash-lite": {
"id": "google/gemini-3.1-flash-lite",
"name": "Google: Gemini 3.1 Flash Lite",
@@ -3348,7 +3675,7 @@
"provider": "xai",
"local_id": "grok-4.3",
"context_length": 1000000,
- "max_output_tokens": 0,
+ "max_output_tokens": 900000,
"input_price_per_mtok": 1.25,
"output_price_per_mtok": 2.5,
"supports_thinking": false,
@@ -3380,7 +3707,7 @@
"provider": "ibm-granite",
"local_id": "granite-4.1-8b",
"context_length": 131072,
- "max_output_tokens": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.05,
"output_price_per_mtok": 0.1,
"supports_thinking": false,
@@ -3412,11 +3739,44 @@
"id": "mistralai/mistral-medium-3-5",
"name": "Mistral: Mistral Medium 3.5",
"provider": "mistralai",
- "local_id": "mistral-medium-3-5",
+ "local_id": "mistral-medium-3-5",
+ "context_length": 262144,
+ "max_output_tokens": 209715,
+ "input_price_per_mtok": 1.5,
+ "output_price_per_mtok": 7.5,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "max_tokens",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "response_format",
+ "seed",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_p"
+ ]
+ },
+ "mistralai/mistral-medium-3-5:batch": {
+ "id": "mistralai/mistral-medium-3-5:batch",
+ "name": "Mistral: Mistral Medium 3.5 (batch)",
+ "provider": "mistralai",
+ "local_id": "mistral-medium-3-5:batch",
"context_length": 262144,
- "max_output_tokens": 0,
- "input_price_per_mtok": 1.5,
- "output_price_per_mtok": 7.5,
+ "max_output_tokens": 209715,
+ "input_price_per_mtok": 0.75,
+ "output_price_per_mtok": 3.75,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -3565,9 +3925,9 @@
"provider": "moonshotai",
"local_id": "kimi-latest",
"context_length": 1048576,
- "max_output_tokens": 974842,
- "input_price_per_mtok": 2.6,
- "output_price_per_mtok": 13.0,
+ "max_output_tokens": 943718,
+ "input_price_per_mtok": 2.55,
+ "output_price_per_mtok": 12.75,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -3605,8 +3965,8 @@
"local_id": "gemini-flash-latest",
"context_length": 1048576,
"max_output_tokens": 65536,
- "input_price_per_mtok": 0.375,
- "output_price_per_mtok": 1.875,
+ "input_price_per_mtok": 0.75,
+ "output_price_per_mtok": 3.75,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -3764,9 +4124,9 @@
"provider": "qwen",
"local_id": "qwen3.6-35b-a3b",
"context_length": 262144,
- "max_output_tokens": 262144,
- "input_price_per_mtok": 0.14,
- "output_price_per_mtok": 1.0,
+ "max_output_tokens": 235929,
+ "input_price_per_mtok": 0.1,
+ "output_price_per_mtok": 0.9,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -3837,9 +4197,9 @@
"provider": "qwen",
"local_id": "qwen3.6-27b",
"context_length": 262144,
- "max_output_tokens": 81920,
- "input_price_per_mtok": 0.32,
- "output_price_per_mtok": 3.2,
+ "max_output_tokens": 235929,
+ "input_price_per_mtok": 0.6,
+ "output_price_per_mtok": 3.6,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -3988,9 +4348,9 @@
"provider": "deepseek",
"local_id": "deepseek-v4-pro",
"context_length": 1048576,
- "max_output_tokens": 384000,
- "input_price_per_mtok": 0.5262,
- "output_price_per_mtok": 1.0524,
+ "max_output_tokens": 393216,
+ "input_price_per_mtok": 1.6,
+ "output_price_per_mtok": 3.2,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -4029,8 +4389,8 @@
"local_id": "deepseek-v4-flash",
"context_length": 1048576,
"max_output_tokens": 384000,
- "input_price_per_mtok": 0.0574,
- "output_price_per_mtok": 0.1148,
+ "input_price_per_mtok": 0.0809,
+ "output_price_per_mtok": 0.1618,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -4063,47 +4423,13 @@
"top_p"
]
},
- "inclusionai/ling-2.6-1t": {
- "id": "inclusionai/ling-2.6-1t",
- "name": "inclusionAI: Ling-2.6-1T",
- "provider": "inclusionai",
- "local_id": "ling-2.6-1t",
- "context_length": 262144,
- "max_output_tokens": 32768,
- "input_price_per_mtok": 0.075,
- "output_price_per_mtok": 0.625,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "logprobs",
- "max_tokens",
- "presence_penalty",
- "repetition_penalty",
- "response_format",
- "seed",
- "stop",
- "structured_outputs",
- "temperature",
- "tool_choice",
- "tools",
- "top_k",
- "top_logprobs",
- "top_p"
- ]
- },
"tencent/hy3-preview": {
"id": "tencent/hy3-preview",
"name": "Tencent: Hy3 preview",
"provider": "tencent",
"local_id": "hy3-preview",
"context_length": 262144,
- "max_output_tokens": 0,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.18,
"output_price_per_mtok": 0.6,
"supports_thinking": false,
@@ -4233,40 +4559,6 @@
"top_logprobs"
]
},
- "inclusionai/ling-2.6-flash": {
- "id": "inclusionai/ling-2.6-flash",
- "name": "inclusionAI: Ling-2.6-flash",
- "provider": "inclusionai",
- "local_id": "ling-2.6-flash",
- "context_length": 262144,
- "max_output_tokens": 32768,
- "input_price_per_mtok": 0.01,
- "output_price_per_mtok": 0.03,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "logprobs",
- "max_tokens",
- "presence_penalty",
- "repetition_penalty",
- "response_format",
- "seed",
- "stop",
- "structured_outputs",
- "temperature",
- "tool_choice",
- "tools",
- "top_k",
- "top_logprobs",
- "top_p"
- ]
- },
"anthropic/claude-opus-latest": {
"id": "~anthropic/claude-opus-latest",
"name": "Anthropic: Claude Opus Latest",
@@ -4322,7 +4614,7 @@
"provider": "moonshotai",
"local_id": "kimi-k2.6",
"context_length": 262144,
- "max_output_tokens": 0,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.95,
"output_price_per_mtok": 4.0,
"supports_thinking": false,
@@ -4524,8 +4816,8 @@
"provider": "gemini",
"local_id": "gemma-4-31b-it",
"context_length": 262144,
- "max_output_tokens": 262144,
- "input_price_per_mtok": 0.1,
+ "max_output_tokens": 16384,
+ "input_price_per_mtok": 0.09,
"output_price_per_mtok": 0.34,
"supports_thinking": false,
"thinking_type": "none",
@@ -4556,6 +4848,41 @@
"top_p"
]
},
+ "gemini/gemma-4-31b-it:batch": {
+ "id": "google/gemma-4-31b-it:batch",
+ "name": "Google: Gemma 4 31B (batch)",
+ "provider": "gemini",
+ "local_id": "gemma-4-31b-it:batch",
+ "context_length": 262144,
+ "max_output_tokens": 235929,
+ "input_price_per_mtok": 0.39,
+ "output_price_per_mtok": 0.97,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "repetition_penalty",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_p"
+ ]
+ },
"gemini/gemma-4-31b-it:free": {
"id": "google/gemma-4-31b-it:free",
"name": "Google: Gemma 4 31B (free)",
@@ -4653,9 +4980,9 @@
"provider": "arcee-ai",
"local_id": "trinity-large-thinking",
"context_length": 262144,
- "max_output_tokens": 262144,
- "input_price_per_mtok": 0.22,
- "output_price_per_mtok": 0.85,
+ "max_output_tokens": 80000,
+ "input_price_per_mtok": 0.25,
+ "output_price_per_mtok": 0.8,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -4664,23 +4991,13 @@
],
"is_reasoning_model": false,
"supported_parameters": [
- "frequency_penalty",
"include_reasoning",
- "logit_bias",
- "logprobs",
"max_tokens",
- "presence_penalty",
"reasoning",
- "repetition_penalty",
- "response_format",
- "seed",
- "stop",
- "structured_outputs",
"temperature",
"tool_choice",
"tools",
"top_k",
- "top_logprobs",
"top_p"
]
},
@@ -4690,7 +5007,7 @@
"provider": "xai",
"local_id": "grok-4.20-multi-agent",
"context_length": 2000000,
- "max_output_tokens": 0,
+ "max_output_tokens": 1800000,
"input_price_per_mtok": 1.25,
"output_price_per_mtok": 2.5,
"supports_thinking": false,
@@ -4720,7 +5037,7 @@
"provider": "xai",
"local_id": "grok-4.20",
"context_length": 2000000,
- "max_output_tokens": 0,
+ "max_output_tokens": 1800000,
"input_price_per_mtok": 1.25,
"output_price_per_mtok": 2.5,
"supports_thinking": false,
@@ -4799,7 +5116,7 @@
"provider": "kwaipilot",
"local_id": "kat-coder-pro-v2",
"context_length": 262144,
- "max_output_tokens": 80000,
+ "max_output_tokens": 144000,
"input_price_per_mtok": 0.3,
"output_price_per_mtok": 1.2,
"supports_thinking": false,
@@ -4812,7 +5129,6 @@
"supported_parameters": [
"frequency_penalty",
"logit_bias",
- "logprobs",
"max_tokens",
"min_p",
"presence_penalty",
@@ -4825,7 +5141,6 @@
"tool_choice",
"tools",
"top_k",
- "top_logprobs",
"top_p"
]
},
@@ -4835,7 +5150,7 @@
"provider": "rekaai",
"local_id": "reka-edge",
"context_length": 16384,
- "max_output_tokens": 16384,
+ "max_output_tokens": 14745,
"input_price_per_mtok": 0.1,
"output_price_per_mtok": 0.1,
"supports_thinking": false,
@@ -4867,9 +5182,9 @@
"provider": "minimax",
"local_id": "minimax-m2.7",
"context_length": 204800,
- "max_output_tokens": 0,
- "input_price_per_mtok": 0.24,
- "output_price_per_mtok": 0.96,
+ "max_output_tokens": 131072,
+ "input_price_per_mtok": 0.3,
+ "output_price_per_mtok": 1.2,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -4899,6 +5214,34 @@
"top_p"
]
},
+ "minimax/minimax-m2.7:free": {
+ "id": "minimax/minimax-m2.7:free",
+ "name": "MiniMax: MiniMax M2.7 (free)",
+ "provider": "minimax",
+ "local_id": "minimax-m2.7:free",
+ "context_length": 196608,
+ "max_output_tokens": 176947,
+ "input_price_per_mtok": 0.0,
+ "output_price_per_mtok": 0.0,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "include_reasoning",
+ "max_tokens",
+ "reasoning",
+ "response_format",
+ "seed",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_p"
+ ]
+ },
"openai/gpt-5.4-nano": {
"id": "openai/gpt-5.4-nano",
"name": "OpenAI: GPT-5.4 Nano",
@@ -5019,7 +5362,7 @@
"provider": "mistralai",
"local_id": "mistral-small-2603",
"context_length": 262144,
- "max_output_tokens": 0,
+ "max_output_tokens": 209715,
"input_price_per_mtok": 0.15,
"output_price_per_mtok": 0.6,
"supports_thinking": false,
@@ -5120,7 +5463,7 @@
"provider": "nvidia",
"local_id": "nemotron-3-super-120b-a12b:free",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.0,
"output_price_per_mtok": 0.0,
"supports_thinking": false,
@@ -5181,7 +5524,7 @@
"provider": "qwen",
"local_id": "qwen3.5-9b",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.1,
"output_price_per_mtok": 0.15,
"supports_thinking": false,
@@ -5213,6 +5556,41 @@
"top_p"
]
},
+ "qwen/qwen3.5-9b:batch": {
+ "id": "qwen/qwen3.5-9b:batch",
+ "name": "Qwen: Qwen3.5-9B (batch)",
+ "provider": "qwen",
+ "local_id": "qwen3.5-9b:batch",
+ "context_length": 262144,
+ "max_output_tokens": 235929,
+ "input_price_per_mtok": 0.17,
+ "output_price_per_mtok": 0.25,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "repetition_penalty",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_p"
+ ]
+ },
"openai/gpt-5.4-pro": {
"id": "openai/gpt-5.4-pro",
"name": "OpenAI: GPT-5.4 Pro",
@@ -5423,7 +5801,7 @@
"provider": "gemini",
"local_id": "gemini-3.1-flash-image-preview",
"context_length": 65536,
- "max_output_tokens": 65536,
+ "max_output_tokens": 58982,
"input_price_per_mtok": 0.5,
"output_price_per_mtok": 3.0,
"supports_thinking": true,
@@ -5451,7 +5829,7 @@
"provider": "qwen",
"local_id": "qwen3.5-35b-a3b",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.25,
"output_price_per_mtok": 1.25,
"supports_thinking": false,
@@ -5527,9 +5905,9 @@
"provider": "qwen",
"local_id": "qwen3.5-122b-a10b",
"context_length": 262144,
- "max_output_tokens": 262144,
- "input_price_per_mtok": 0.26,
- "output_price_per_mtok": 2.08,
+ "max_output_tokens": 81920,
+ "input_price_per_mtok": 0.29,
+ "output_price_per_mtok": 2.4,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -5845,9 +6223,9 @@
"provider": "qwen",
"local_id": "qwen3.5-397b-a17b",
"context_length": 262144,
- "max_output_tokens": 262144,
- "input_price_per_mtok": 0.5,
- "output_price_per_mtok": 3.6,
+ "max_output_tokens": 65536,
+ "input_price_per_mtok": 0.39,
+ "output_price_per_mtok": 2.34,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -6058,7 +6436,7 @@
"provider": "qwen",
"local_id": "qwen3-coder-next",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.12,
"output_price_per_mtok": 0.8,
"supports_thinking": false,
@@ -6160,7 +6538,7 @@
"provider": "moonshotai",
"local_id": "kimi-k2.5",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.45,
"output_price_per_mtok": 2.25,
"supports_thinking": false,
@@ -6198,7 +6576,7 @@
"provider": "upstage",
"local_id": "solar-pro-3",
"context_length": 131072,
- "max_output_tokens": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.15,
"output_price_per_mtok": 0.6,
"supports_thinking": false,
@@ -6513,7 +6891,6 @@
"frequency_penalty",
"include_reasoning",
"logit_bias",
- "logprobs",
"max_tokens",
"min_p",
"presence_penalty",
@@ -6528,7 +6905,6 @@
"tools",
"top_a",
"top_k",
- "top_logprobs",
"top_p"
]
},
@@ -6600,7 +6976,7 @@
"provider": "nvidia",
"local_id": "nemotron-3-nano-30b-a3b",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 228000,
"input_price_per_mtok": 0.05,
"output_price_per_mtok": 0.2,
"supports_thinking": false,
@@ -6632,33 +7008,6 @@
"top_p"
]
},
- "nvidia/nemotron-3-nano-30b-a3b:free": {
- "id": "nvidia/nemotron-3-nano-30b-a3b:free",
- "name": "NVIDIA: Nemotron 3 Nano 30B A3B (free)",
- "provider": "nvidia",
- "local_id": "nemotron-3-nano-30b-a3b:free",
- "context_length": 256000,
- "max_output_tokens": 0,
- "input_price_per_mtok": 0.0,
- "output_price_per_mtok": 0.0,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "seed",
- "temperature",
- "tool_choice",
- "tools",
- "top_p"
- ]
- },
"openai/gpt-5.2-chat": {
"id": "openai/gpt-5.2-chat",
"name": "OpenAI: GPT-5.2 Chat",
@@ -6797,6 +7146,36 @@
"tools"
]
},
+ "mistralai/devstral-2512": {
+ "id": "mistralai/devstral-2512",
+ "name": "Mistral: Devstral 2 2512",
+ "provider": "mistralai",
+ "local_id": "devstral-2512",
+ "context_length": 262144,
+ "max_output_tokens": 209715,
+ "input_price_per_mtok": 0.4,
+ "output_price_per_mtok": 2.0,
+ "supports_thinking": false,
+ "thinking_type": "none",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "max_tokens",
+ "presence_penalty",
+ "response_format",
+ "seed",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_p"
+ ]
+ },
"relace/relace-search": {
"id": "relace/relace-search",
"name": "Relace: Relace Search",
@@ -6937,7 +7316,7 @@
"provider": "mistralai",
"local_id": "ministral-14b-2512",
"context_length": 262144,
- "max_output_tokens": 0,
+ "max_output_tokens": 209715,
"input_price_per_mtok": 0.2,
"output_price_per_mtok": 0.2,
"supports_thinking": false,
@@ -6967,7 +7346,7 @@
"provider": "mistralai",
"local_id": "ministral-8b-2512",
"context_length": 262144,
- "max_output_tokens": 0,
+ "max_output_tokens": 209715,
"input_price_per_mtok": 0.15,
"output_price_per_mtok": 0.15,
"supports_thinking": false,
@@ -6997,7 +7376,7 @@
"provider": "mistralai",
"local_id": "ministral-3b-2512",
"context_length": 131072,
- "max_output_tokens": 0,
+ "max_output_tokens": 104857,
"input_price_per_mtok": 0.1,
"output_price_per_mtok": 0.1,
"supports_thinking": false,
@@ -7027,7 +7406,7 @@
"provider": "mistralai",
"local_id": "mistral-large-2512",
"context_length": 262144,
- "max_output_tokens": 0,
+ "max_output_tokens": 209715,
"input_price_per_mtok": 0.5,
"output_price_per_mtok": 1.5,
"supports_thinking": false,
@@ -7057,9 +7436,9 @@
"provider": "deepseek",
"local_id": "deepseek-v3.2",
"context_length": 163840,
- "max_output_tokens": 163840,
- "input_price_per_mtok": 0.26,
- "output_price_per_mtok": 0.38,
+ "max_output_tokens": 65536,
+ "input_price_per_mtok": 0.269,
+ "output_price_per_mtok": 0.4,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -7149,39 +7528,6 @@
"verbosity"
]
},
- "allenai/olmo-3-32b-think": {
- "id": "allenai/olmo-3-32b-think",
- "name": "AllenAI: Olmo 3 32B Think",
- "provider": "allenai",
- "local_id": "olmo-3-32b-think",
- "context_length": 65536,
- "max_output_tokens": 65536,
- "input_price_per_mtok": 0.15,
- "output_price_per_mtok": 0.5,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "include_reasoning",
- "logit_bias",
- "max_tokens",
- "presence_penalty",
- "reasoning",
- "repetition_penalty",
- "response_format",
- "seed",
- "stop",
- "structured_outputs",
- "temperature",
- "top_k",
- "top_p"
- ]
- },
"gemini/gemini-3-pro-image-preview": {
"id": "google/gemini-3-pro-image-preview",
"name": "Google: Nano Banana Pro (Gemini 3 Pro Image Preview)",
@@ -7418,8 +7764,8 @@
"name": "Mistral: Voxtral Small 24B 2507",
"provider": "mistralai",
"local_id": "voxtral-small-24b-2507",
- "context_length": 32000,
- "max_output_tokens": 0,
+ "context_length": 32768,
+ "max_output_tokens": 26214,
"input_price_per_mtok": 0.1,
"output_price_per_mtok": 0.3,
"supports_thinking": false,
@@ -7473,33 +7819,6 @@
"top_p"
]
},
- "nvidia/nemotron-nano-12b-v2-vl:free": {
- "id": "nvidia/nemotron-nano-12b-v2-vl:free",
- "name": "NVIDIA: Nemotron Nano 12B 2 VL (free)",
- "provider": "nvidia",
- "local_id": "nemotron-nano-12b-v2-vl:free",
- "context_length": 128000,
- "max_output_tokens": 128000,
- "input_price_per_mtok": 0.0,
- "output_price_per_mtok": 0.0,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "seed",
- "temperature",
- "tool_choice",
- "tools",
- "top_p"
- ]
- },
"minimax/minimax-m2": {
"id": "minimax/minimax-m2",
"name": "MiniMax: MiniMax M2",
@@ -7575,7 +7894,7 @@
"provider": "ibm-granite",
"local_id": "granite-4.0-h-micro",
"context_length": 131000,
- "max_output_tokens": 131000,
+ "max_output_tokens": 117900,
"input_price_per_mtok": 0.017,
"output_price_per_mtok": 0.112,
"supports_thinking": false,
@@ -7866,9 +8185,9 @@
"provider": "qwen",
"local_id": "qwen3-vl-30b-a3b-instruct",
"context_length": 262144,
- "max_output_tokens": 32768,
- "input_price_per_mtok": 0.13,
- "output_price_per_mtok": 0.52,
+ "max_output_tokens": 16384,
+ "input_price_per_mtok": 0.15,
+ "output_price_per_mtok": 0.6,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -7958,9 +8277,9 @@
"provider": "z-ai",
"local_id": "glm-4.6",
"context_length": 204800,
- "max_output_tokens": 131072,
- "input_price_per_mtok": 0.5,
- "output_price_per_mtok": 2.0,
+ "max_output_tokens": 16384,
+ "input_price_per_mtok": 0.43,
+ "output_price_per_mtok": 1.75,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -8093,7 +8412,7 @@
"provider": "thedrummer",
"local_id": "cydonia-24b-v4.1",
"context_length": 131072,
- "max_output_tokens": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.3,
"output_price_per_mtok": 0.5,
"supports_thinking": false,
@@ -8280,33 +8599,6 @@
"top_p"
]
},
- "openai/gpt-5-codex:batch": {
- "id": "openai/gpt-5-codex:batch",
- "name": "OpenAI: GPT-5 Codex (batch)",
- "provider": "openai",
- "local_id": "gpt-5-codex:batch",
- "context_length": 400000,
- "max_output_tokens": 128000,
- "input_price_per_mtok": 0.625,
- "output_price_per_mtok": 5.0,
- "supports_thinking": true,
- "thinking_type": "effort",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "response_format",
- "seed",
- "structured_outputs",
- "tool_choice",
- "tools"
- ]
- },
"deepseek/deepseek-v3.1-terminus": {
"id": "deepseek/deepseek-v3.1-terminus",
"name": "DeepSeek: DeepSeek V3.1 Terminus",
@@ -8394,7 +8686,6 @@
"supported_parameters": [
"frequency_penalty",
"include_reasoning",
- "logit_bias",
"logprobs",
"max_tokens",
"presence_penalty",
@@ -8418,7 +8709,7 @@
"provider": "qwen",
"local_id": "qwen3-next-80b-a3b-instruct",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.1,
"output_price_per_mtok": 1.1,
"supports_thinking": false,
@@ -8481,70 +8772,6 @@
"top_p"
]
},
- "qwen/qwen-plus-2025-07-28:thinking": {
- "id": "qwen/qwen-plus-2025-07-28:thinking",
- "name": "Qwen: Qwen Plus 0728 (thinking)",
- "provider": "qwen",
- "local_id": "qwen-plus-2025-07-28:thinking",
- "context_length": 1000000,
- "max_output_tokens": 32768,
- "input_price_per_mtok": 0.26,
- "output_price_per_mtok": 0.78,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "include_reasoning",
- "logprobs",
- "max_tokens",
- "presence_penalty",
- "reasoning",
- "response_format",
- "seed",
- "stop",
- "structured_outputs",
- "temperature",
- "tool_choice",
- "tools",
- "top_k",
- "top_logprobs",
- "top_p"
- ]
- },
- "nvidia/nemotron-nano-9b-v2:free": {
- "id": "nvidia/nemotron-nano-9b-v2:free",
- "name": "NVIDIA: Nemotron Nano 9B V2 (free)",
- "provider": "nvidia",
- "local_id": "nemotron-nano-9b-v2:free",
- "context_length": 128000,
- "max_output_tokens": 0,
- "input_price_per_mtok": 0.0,
- "output_price_per_mtok": 0.0,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "response_format",
- "seed",
- "structured_outputs",
- "temperature",
- "tool_choice",
- "tools",
- "top_p"
- ]
- },
"moonshotai/kimi-k2-0905": {
"id": "moonshotai/kimi-k2-0905",
"name": "MoonshotAI: Kimi K2 0905",
@@ -8615,7 +8842,7 @@
"provider": "nousresearch",
"local_id": "hermes-4-70b",
"context_length": 131072,
- "max_output_tokens": 0,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.13,
"output_price_per_mtok": 0.4,
"supports_thinking": false,
@@ -8644,7 +8871,7 @@
"provider": "nousresearch",
"local_id": "hermes-4-405b",
"context_length": 131072,
- "max_output_tokens": 0,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 1.0,
"output_price_per_mtok": 3.0,
"supports_thinking": false,
@@ -8673,7 +8900,7 @@
"provider": "deepseek",
"local_id": "deepseek-chat-v3.1",
"context_length": 163840,
- "max_output_tokens": 161000,
+ "max_output_tokens": 144900,
"input_price_per_mtok": 0.55,
"output_price_per_mtok": 1.65,
"supports_thinking": false,
@@ -8711,7 +8938,7 @@
"provider": "mistralai",
"local_id": "mistral-medium-3.1",
"context_length": 131072,
- "max_output_tokens": 0,
+ "max_output_tokens": 104857,
"input_price_per_mtok": 0.4,
"output_price_per_mtok": 2.0,
"supports_thinking": false,
@@ -8945,7 +9172,7 @@
"provider": "openai",
"local_id": "gpt-oss-120b",
"context_length": 131072,
- "max_output_tokens": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.037,
"output_price_per_mtok": 0.17,
"supports_thinking": true,
@@ -8979,13 +9206,49 @@
"top_p"
]
},
+ "openai/gpt-oss-120b:batch": {
+ "id": "openai/gpt-oss-120b:batch",
+ "name": "OpenAI: gpt-oss-120b (batch)",
+ "provider": "openai",
+ "local_id": "gpt-oss-120b:batch",
+ "context_length": 131072,
+ "max_output_tokens": 117964,
+ "input_price_per_mtok": 0.15,
+ "output_price_per_mtok": 0.6,
+ "supports_thinking": true,
+ "thinking_type": "effort",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "tool_choice",
+ "tools",
+ "top_k",
+ "top_p"
+ ]
+ },
"openai/gpt-oss-20b": {
"id": "openai/gpt-oss-20b",
"name": "OpenAI: gpt-oss-20b",
"provider": "openai",
"local_id": "gpt-oss-20b",
"context_length": 131072,
- "max_output_tokens": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.03,
"output_price_per_mtok": 0.13,
"supports_thinking": true,
@@ -9018,6 +9281,40 @@
"top_p"
]
},
+ "openai/gpt-oss-20b:batch": {
+ "id": "openai/gpt-oss-20b:batch",
+ "name": "OpenAI: gpt-oss-20b (batch)",
+ "provider": "openai",
+ "local_id": "gpt-oss-20b:batch",
+ "context_length": 131072,
+ "max_output_tokens": 117964,
+ "input_price_per_mtok": 0.05,
+ "output_price_per_mtok": 0.2,
+ "supports_thinking": true,
+ "thinking_type": "effort",
+ "temperature_range": [
+ 0.0,
+ 2.0
+ ],
+ "is_reasoning_model": false,
+ "supported_parameters": [
+ "frequency_penalty",
+ "include_reasoning",
+ "logit_bias",
+ "max_tokens",
+ "min_p",
+ "presence_penalty",
+ "reasoning",
+ "reasoning_effort",
+ "repetition_penalty",
+ "response_format",
+ "stop",
+ "structured_outputs",
+ "temperature",
+ "top_k",
+ "top_p"
+ ]
+ },
"anthropic/claude-opus-4.1": {
"id": "anthropic/claude-opus-4.1",
"name": "Anthropic: Claude Opus 4.1",
@@ -9080,7 +9377,7 @@
"provider": "mistralai",
"local_id": "codestral-2508",
"context_length": 256000,
- "max_output_tokens": 0,
+ "max_output_tokens": 204800,
"input_price_per_mtok": 0.3,
"output_price_per_mtok": 0.9,
"supports_thinking": false,
@@ -9111,7 +9408,7 @@
"provider": "qwen",
"local_id": "qwen3-coder-30b-a3b-instruct",
"context_length": 262144,
- "max_output_tokens": 262144,
+ "max_output_tokens": 235929,
"input_price_per_mtok": 0.07,
"output_price_per_mtok": 0.28,
"supports_thinking": false,
@@ -9239,8 +9536,8 @@
"name": "Qwen: Qwen3 235B A22B Thinking 2507",
"provider": "qwen",
"local_id": "qwen3-235b-a22b-thinking-2507",
- "context_length": 262144,
- "max_output_tokens": 0,
+ "context_length": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.23,
"output_price_per_mtok": 2.3,
"supports_thinking": false,
@@ -9253,10 +9550,8 @@
"supported_parameters": [
"frequency_penalty",
"include_reasoning",
- "logit_bias",
"logprobs",
"max_tokens",
- "min_p",
"presence_penalty",
"reasoning",
"repetition_penalty",
@@ -9498,7 +9793,7 @@
"provider": "tencent",
"local_id": "hunyuan-a13b-instruct",
"context_length": 131072,
- "max_output_tokens": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.14,
"output_price_per_mtok": 0.57,
"supports_thinking": false,
@@ -9771,57 +10066,30 @@
0.0,
2.0
],
- "is_reasoning_model": false,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "response_format",
- "seed",
- "stop",
- "structured_outputs",
- "temperature",
- "tool_choice",
- "tools",
- "top_p"
- ]
- },
- "openai/o3-pro": {
- "id": "openai/o3-pro",
- "name": "OpenAI: o3 Pro",
- "provider": "openai",
- "local_id": "o3-pro",
- "context_length": 200000,
- "max_output_tokens": 100000,
- "input_price_per_mtok": 20.0,
- "output_price_per_mtok": 80.0,
- "supports_thinking": true,
- "thinking_type": "effort",
- "temperature_range": [
- 1.0,
- 1.0
- ],
- "is_reasoning_model": true,
+ "is_reasoning_model": false,
"supported_parameters": [
"include_reasoning",
"max_tokens",
"reasoning",
"response_format",
"seed",
+ "stop",
"structured_outputs",
+ "temperature",
"tool_choice",
- "tools"
+ "tools",
+ "top_p"
]
},
- "openai/o3-pro:batch": {
- "id": "openai/o3-pro:batch",
- "name": "OpenAI: o3 Pro (batch)",
+ "openai/o3-pro": {
+ "id": "openai/o3-pro",
+ "name": "OpenAI: o3 Pro",
"provider": "openai",
- "local_id": "o3-pro:batch",
+ "local_id": "o3-pro",
"context_length": 200000,
"max_output_tokens": 100000,
- "input_price_per_mtok": 10.0,
- "output_price_per_mtok": 40.0,
+ "input_price_per_mtok": 20.0,
+ "output_price_per_mtok": 80.0,
"supports_thinking": true,
"thinking_type": "effort",
"temperature_range": [
@@ -9963,44 +10231,13 @@
"top_p"
]
},
- "gemini/gemma-3n-e4b-it": {
- "id": "google/gemma-3n-e4b-it",
- "name": "Google: Gemma 3n 4B",
- "provider": "gemini",
- "local_id": "gemma-3n-e4b-it",
- "context_length": 32768,
- "max_output_tokens": 0,
- "input_price_per_mtok": 0.06,
- "output_price_per_mtok": 0.12,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "logit_bias",
- "max_tokens",
- "min_p",
- "presence_penalty",
- "repetition_penalty",
- "response_format",
- "stop",
- "structured_outputs",
- "temperature",
- "top_k",
- "top_p"
- ]
- },
"mistralai/mistral-medium-3": {
"id": "mistralai/mistral-medium-3",
"name": "Mistral: Mistral Medium 3",
"provider": "mistralai",
"local_id": "mistral-medium-3",
"context_length": 131072,
- "max_output_tokens": 0,
+ "max_output_tokens": 104857,
"input_price_per_mtok": 0.4,
"output_price_per_mtok": 2.0,
"supports_thinking": false,
@@ -10054,43 +10291,12 @@
"top_p"
]
},
- "arcee-ai/virtuoso-large": {
- "id": "arcee-ai/virtuoso-large",
- "name": "Arcee AI: Virtuoso Large",
- "provider": "arcee-ai",
- "local_id": "virtuoso-large",
- "context_length": 131072,
- "max_output_tokens": 64000,
- "input_price_per_mtok": 0.75,
- "output_price_per_mtok": 1.2,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "logit_bias",
- "max_tokens",
- "min_p",
- "presence_penalty",
- "repetition_penalty",
- "stop",
- "temperature",
- "tool_choice",
- "tools",
- "top_k",
- "top_p"
- ]
- },
"meta/llama-guard-4-12b": {
"id": "meta-llama/llama-guard-4-12b",
"name": "Meta: Llama Guard 4 12B",
"provider": "meta",
"local_id": "llama-guard-4-12b",
- "context_length": 1048576,
+ "context_length": 163840,
"max_output_tokens": 16384,
"input_price_per_mtok": 0.18,
"output_price_per_mtok": 0.18,
@@ -10241,7 +10447,6 @@
"frequency_penalty",
"include_reasoning",
"logit_bias",
- "logprobs",
"max_tokens",
"min_p",
"presence_penalty",
@@ -10255,7 +10460,6 @@
"tool_choice",
"tools",
"top_k",
- "top_logprobs",
"top_p"
]
},
@@ -10319,34 +10523,6 @@
"tools"
]
},
- "openai/o4-mini-high:batch": {
- "id": "openai/o4-mini-high:batch",
- "name": "OpenAI: o4 Mini High (batch)",
- "provider": "openai",
- "local_id": "o4-mini-high:batch",
- "context_length": 200000,
- "max_output_tokens": 100000,
- "input_price_per_mtok": 0.55,
- "output_price_per_mtok": 2.2,
- "supports_thinking": true,
- "thinking_type": "effort",
- "temperature_range": [
- 1.0,
- 1.0
- ],
- "is_reasoning_model": true,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "reasoning_effort",
- "response_format",
- "seed",
- "structured_outputs",
- "tool_choice",
- "tools"
- ]
- },
"openai/o3": {
"id": "openai/o3",
"name": "OpenAI: o3",
@@ -10626,9 +10802,9 @@
"provider": "meta",
"local_id": "llama-4-maverick",
"context_length": 1048576,
- "max_output_tokens": 16384,
+ "max_output_tokens": 115200,
"input_price_per_mtok": 0.2,
- "output_price_per_mtok": 0.8,
+ "output_price_per_mtok": 0.696,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -10696,7 +10872,7 @@
"provider": "deepseek",
"local_id": "deepseek-chat-v3-0324",
"context_length": 163840,
- "max_output_tokens": 163840,
+ "max_output_tokens": 147456,
"input_price_per_mtok": 0.25,
"output_price_per_mtok": 1.0,
"supports_thinking": false,
@@ -10751,38 +10927,13 @@
"structured_outputs"
]
},
- "openai/o1-pro:batch": {
- "id": "openai/o1-pro:batch",
- "name": "OpenAI: o1-pro (batch)",
- "provider": "openai",
- "local_id": "o1-pro:batch",
- "context_length": 200000,
- "max_output_tokens": 100000,
- "input_price_per_mtok": 75.0,
- "output_price_per_mtok": 300.0,
- "supports_thinking": true,
- "thinking_type": "effort",
- "temperature_range": [
- 1.0,
- 1.0
- ],
- "is_reasoning_model": true,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "response_format",
- "seed",
- "structured_outputs"
- ]
- },
"mistralai/mistral-small-3.1-24b-instruct": {
"id": "mistralai/mistral-small-3.1-24b-instruct",
"name": "Mistral: Mistral Small 3.1 24B",
"provider": "mistralai",
"local_id": "mistral-small-3.1-24b-instruct",
"context_length": 128000,
- "max_output_tokens": 128000,
+ "max_output_tokens": 102400,
"input_price_per_mtok": 0.351,
"output_price_per_mtok": 0.555,
"supports_thinking": false,
@@ -10909,7 +11060,7 @@
"provider": "rekaai",
"local_id": "reka-flash-3",
"context_length": 65536,
- "max_output_tokens": 65536,
+ "max_output_tokens": 58982,
"input_price_per_mtok": 0.1,
"output_price_per_mtok": 0.2,
"supports_thinking": false,
@@ -10940,8 +11091,8 @@
"name": "Google: Gemma 3 27B",
"provider": "gemini",
"local_id": "gemma-3-27b-it",
- "context_length": 262144,
- "max_output_tokens": 131072,
+ "context_length": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.08,
"output_price_per_mtok": 0.45,
"supports_thinking": false,
@@ -10977,7 +11128,7 @@
"provider": "thedrummer",
"local_id": "skyfall-36b-v2",
"context_length": 32768,
- "max_output_tokens": 32768,
+ "max_output_tokens": 29491,
"input_price_per_mtok": 0.55,
"output_price_per_mtok": 0.8,
"supports_thinking": false,
@@ -11010,7 +11161,7 @@
"provider": "perplexity",
"local_id": "sonar-reasoning-pro",
"context_length": 128000,
- "max_output_tokens": 0,
+ "max_output_tokens": 115200,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 8.0,
"supports_thinking": false,
@@ -11064,7 +11215,7 @@
"provider": "perplexity",
"local_id": "sonar-deep-research",
"context_length": 128000,
- "max_output_tokens": 0,
+ "max_output_tokens": 115200,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 8.0,
"supports_thinking": false,
@@ -11092,7 +11243,7 @@
"provider": "mistralai",
"local_id": "mistral-saba",
"context_length": 32768,
- "max_output_tokens": 0,
+ "max_output_tokens": 26214,
"input_price_per_mtok": 0.2,
"output_price_per_mtok": 0.6,
"supports_thinking": false,
@@ -11144,41 +11295,13 @@
"tools"
]
},
- "openai/o3-mini-high:batch": {
- "id": "openai/o3-mini-high:batch",
- "name": "OpenAI: o3 Mini High (batch)",
- "provider": "openai",
- "local_id": "o3-mini-high:batch",
- "context_length": 200000,
- "max_output_tokens": 100000,
- "input_price_per_mtok": 0.55,
- "output_price_per_mtok": 2.2,
- "supports_thinking": true,
- "thinking_type": "effort",
- "temperature_range": [
- 1.0,
- 1.0
- ],
- "is_reasoning_model": true,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "reasoning_effort",
- "response_format",
- "seed",
- "structured_outputs",
- "tool_choice",
- "tools"
- ]
- },
"aion-labs/aion-rp-llama-3.1-8b": {
"id": "aion-labs/aion-rp-llama-3.1-8b",
"name": "AionLabs: Aion-RP 1.0 (8B)",
"provider": "aion-labs",
"local_id": "aion-rp-llama-3.1-8b",
"context_length": 32768,
- "max_output_tokens": 32768,
+ "max_output_tokens": 29491,
"input_price_per_mtok": 0.8,
"output_price_per_mtok": 1.6,
"supports_thinking": false,
@@ -11200,9 +11323,9 @@
"provider": "qwen",
"local_id": "qwen2.5-vl-72b-instruct",
"context_length": 128000,
- "max_output_tokens": 128000,
- "input_price_per_mtok": 0.8,
- "output_price_per_mtok": 1.0,
+ "max_output_tokens": 28800,
+ "input_price_per_mtok": 0.25,
+ "output_price_per_mtok": 0.75,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -11352,7 +11475,7 @@
"provider": "perplexity",
"local_id": "sonar",
"context_length": 127072,
- "max_output_tokens": 0,
+ "max_output_tokens": 114364,
"input_price_per_mtok": 1.0,
"output_price_per_mtok": 1.0,
"supports_thinking": false,
@@ -11378,7 +11501,7 @@
"provider": "deepseek",
"local_id": "deepseek-r1-distill-llama-70b",
"context_length": 8192,
- "max_output_tokens": 8192,
+ "max_output_tokens": 7372,
"input_price_per_mtok": 0.8,
"output_price_per_mtok": 0.8,
"supports_thinking": false,
@@ -11442,7 +11565,7 @@
"provider": "minimax",
"local_id": "minimax-01",
"context_length": 1000192,
- "max_output_tokens": 1000192,
+ "max_output_tokens": 900172,
"input_price_per_mtok": 0.2,
"output_price_per_mtok": 1.1,
"supports_thinking": false,
@@ -11464,7 +11587,7 @@
"provider": "microsoft",
"local_id": "phi-4",
"context_length": 16384,
- "max_output_tokens": 16384,
+ "max_output_tokens": 14745,
"input_price_per_mtok": 0.07,
"output_price_per_mtok": 0.14,
"supports_thinking": false,
@@ -11582,33 +11705,6 @@
"tools"
]
},
- "openai/o1:batch": {
- "id": "openai/o1:batch",
- "name": "OpenAI: o1 (batch)",
- "provider": "openai",
- "local_id": "o1:batch",
- "context_length": 200000,
- "max_output_tokens": 100000,
- "input_price_per_mtok": 7.5,
- "output_price_per_mtok": 30.0,
- "supports_thinking": true,
- "thinking_type": "effort",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "include_reasoning",
- "max_tokens",
- "reasoning",
- "response_format",
- "seed",
- "structured_outputs",
- "tool_choice",
- "tools"
- ]
- },
"cohere/command-r7b-12-2024": {
"id": "cohere/command-r7b-12-2024",
"name": "Cohere: Command R7B (12-2024)",
@@ -11644,9 +11740,9 @@
"provider": "meta",
"local_id": "llama-3.3-70b-instruct",
"context_length": 131072,
- "max_output_tokens": 16384,
- "input_price_per_mtok": 0.1,
- "output_price_per_mtok": 0.32,
+ "max_output_tokens": 115200,
+ "input_price_per_mtok": 0.71,
+ "output_price_per_mtok": 0.71,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [
@@ -11790,7 +11886,7 @@
"provider": "mistralai",
"local_id": "mistral-large-2407",
"context_length": 131072,
- "max_output_tokens": 0,
+ "max_output_tokens": 104857,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 6.0,
"supports_thinking": false,
@@ -11820,7 +11916,7 @@
"provider": "qwen",
"local_id": "qwen-2.5-coder-32b-instruct",
"context_length": 32768,
- "max_output_tokens": 32768,
+ "max_output_tokens": 29491,
"input_price_per_mtok": 0.66,
"output_price_per_mtok": 1.0,
"supports_thinking": false,
@@ -11850,7 +11946,7 @@
"provider": "thedrummer",
"local_id": "unslopnemo-12b",
"context_length": 1024000,
- "max_output_tokens": 32768,
+ "max_output_tokens": 26214,
"input_price_per_mtok": 0.4,
"output_price_per_mtok": 0.4,
"supports_thinking": false,
@@ -11886,7 +11982,7 @@
"local_id": "magnum-v4-72b",
"context_length": 32768,
"max_output_tokens": 4096,
- "input_price_per_mtok": 3.0,
+ "input_price_per_mtok": 2.5,
"output_price_per_mtok": 5.0,
"supports_thinking": false,
"thinking_type": "none",
@@ -11914,41 +12010,13 @@
"top_p"
]
},
- "mistralai/ministral-8b": {
- "id": "mistralai/ministral-8b",
- "name": "Mistral: Ministral 8B",
- "provider": "mistralai",
- "local_id": "ministral-8b",
- "context_length": 128000,
- "max_output_tokens": 0,
- "input_price_per_mtok": 0.11,
- "output_price_per_mtok": 0.11,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "max_tokens",
- "presence_penalty",
- "response_format",
- "seed",
- "stop",
- "structured_outputs",
- "temperature",
- "top_p"
- ]
- },
"qwen/qwen-2.5-7b-instruct": {
"id": "qwen/qwen-2.5-7b-instruct",
"name": "Qwen: Qwen2.5 7B Instruct",
"provider": "qwen",
"local_id": "qwen-2.5-7b-instruct",
"context_length": 32768,
- "max_output_tokens": 32768,
+ "max_output_tokens": 29491,
"input_price_per_mtok": 0.1,
"output_price_per_mtok": 0.2,
"supports_thinking": false,
@@ -11960,7 +12028,6 @@
"is_reasoning_model": false,
"supported_parameters": [
"frequency_penalty",
- "logit_bias",
"max_tokens",
"min_p",
"presence_penalty",
@@ -11976,46 +12043,13 @@
"top_p"
]
},
- "thedrummer/rocinante-12b": {
- "id": "thedrummer/rocinante-12b",
- "name": "TheDrummer: Rocinante 12B",
- "provider": "thedrummer",
- "local_id": "rocinante-12b",
- "context_length": 65536,
- "max_output_tokens": 65536,
- "input_price_per_mtok": 0.25,
- "output_price_per_mtok": 0.5,
- "supports_thinking": false,
- "thinking_type": "none",
- "temperature_range": [
- 0.0,
- 2.0
- ],
- "is_reasoning_model": false,
- "supported_parameters": [
- "frequency_penalty",
- "logit_bias",
- "logprobs",
- "max_tokens",
- "presence_penalty",
- "repetition_penalty",
- "response_format",
- "seed",
- "stop",
- "structured_outputs",
- "temperature",
- "top_k",
- "top_logprobs",
- "top_p"
- ]
- },
"meta/llama-3.2-1b-instruct": {
"id": "meta-llama/llama-3.2-1b-instruct",
"name": "Meta: Llama 3.2 1B Instruct",
"provider": "meta",
"local_id": "llama-3.2-1b-instruct",
"context_length": 60000,
- "max_output_tokens": 60000,
+ "max_output_tokens": 54000,
"input_price_per_mtok": 0.027,
"output_price_per_mtok": 0.201,
"supports_thinking": false,
@@ -12045,7 +12079,7 @@
"provider": "meta",
"local_id": "llama-3.2-3b-instruct",
"context_length": 131072,
- "max_output_tokens": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.05,
"output_price_per_mtok": 0.33,
"supports_thinking": false,
@@ -12272,7 +12306,7 @@
"provider": "sao10k",
"local_id": "l3-lunaris-8b",
"context_length": 8192,
- "max_output_tokens": 16384,
+ "max_output_tokens": 7372,
"input_price_per_mtok": 0.04,
"output_price_per_mtok": 0.05,
"supports_thinking": false,
@@ -12378,7 +12412,7 @@
"provider": "meta",
"local_id": "llama-3.1-8b-instruct",
"context_length": 131072,
- "max_output_tokens": 131072,
+ "max_output_tokens": 117964,
"input_price_per_mtok": 0.05,
"output_price_per_mtok": 0.08,
"supports_thinking": false,
@@ -12692,7 +12726,7 @@
"provider": "mistralai",
"local_id": "mixtral-8x22b-instruct",
"context_length": 65536,
- "max_output_tokens": 0,
+ "max_output_tokens": 52428,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 6.0,
"supports_thinking": false,
@@ -12843,7 +12877,7 @@
"provider": "mistralai",
"local_id": "mistral-large",
"context_length": 128000,
- "max_output_tokens": 0,
+ "max_output_tokens": 102400,
"input_price_per_mtok": 2.0,
"output_price_per_mtok": 6.0,
"supports_thinking": false,
@@ -12873,7 +12907,7 @@
"provider": "openai",
"local_id": "gpt-3.5-turbo-0613",
"context_length": 4095,
- "max_output_tokens": 4096,
+ "max_output_tokens": 3685,
"input_price_per_mtok": 1.0,
"output_price_per_mtok": 2.0,
"supports_thinking": false,
@@ -12981,7 +13015,7 @@
"provider": "openai",
"local_id": "gpt-3.5-turbo-instruct",
"context_length": 4095,
- "max_output_tokens": 4096,
+ "max_output_tokens": 3685,
"input_price_per_mtok": 1.5,
"output_price_per_mtok": 2.0,
"supports_thinking": false,
@@ -13047,7 +13081,7 @@
"local_id": "weaver",
"context_length": 8000,
"max_output_tokens": 6000,
- "input_price_per_mtok": 0.5,
+ "input_price_per_mtok": 0.4,
"output_price_per_mtok": 0.75,
"supports_thinking": false,
"thinking_type": "none",
@@ -13115,9 +13149,9 @@
"provider": "gryphe",
"local_id": "mythomax-l2-13b",
"context_length": 8192,
- "max_output_tokens": 4096,
- "input_price_per_mtok": 0.06,
- "output_price_per_mtok": 0.06,
+ "max_output_tokens": 7372,
+ "input_price_per_mtok": 0.35,
+ "output_price_per_mtok": 0.6,
"supports_thinking": false,
"thinking_type": "none",
"temperature_range": [