Self-improving AI Employees for everyone
Python ai-agentsai-employeeai-employeesassistantautonomous-agentsco-employeescompanygrok-botinstinctloop-agentsmuseown-your-datapersonalself-hosted
Cerebras Chat Model (cerebrasChatModel)
| Field | Value |
|---|---|
| Category | ai_chat_models |
| Backend handler | server/nodes/model/cerebras_chat_model/__init__.py (dispatch via BaseNode.execute() -> @Operation("chat") in server/nodes/model/_base.py) |
| AI service | server/services/ai.py::AIService.execute_chat |
| Tests | server/tests/nodes/test_ai_chat_models.py |
| Skill (if any) | n/a |
| Dual-purpose tool | no (group ('model',)) |
Purpose
Ultra-fast inference on Cerebras' custom AI hardware. The public endpoints
serve exactly two models: gpt-oss-120b (default) and qwen-3.8-27b; other
families exist only on Dedicated Endpoints. The
ChatModelBase.chat operation calls
AIService.execute_chat, which routes through ChatUnifier. Like Groq,
Cerebras is one of the nine OpenAI-compatible providers registered in
providers/_compat.py; bare chat and current agent executions share this
native provider path.
Inputs (handles)
| Handle | Connection type | Required | Purpose |
|---|---|---|---|
input-main |
main | no | Upstream data; not consumed directly |
Parameters
| Name | Type | Default | Required | displayOptions.show | Description |
|---|---|---|---|---|---|
prompt |
string | "" |
yes | - | User message |
system_prompt |
string | "" |
no | - | System prompt |
model |
string | "" (injected) |
no | - | gpt-oss-120b (default) or qwen-3.8-27b |
temperature |
number|null | null |
no | - | Narrower range than OpenAI (0-1.5 rather than 0-2) |
max_tokens |
number|null | null (up to 40K) |
no | - | 1-200000 |
top_p |
number|null | 1.0 |
no | - | |
thinking_enabled |
boolean | false |
no | - | Inert: no current Cerebras model is in thinking_models |
thinking_budget |
number|null | 2048 |
no | thinking_enabled=[true] |
1024-16000; inert while thinking_models is empty |
reasoning_format |
enum | parsed |
no | - | parsed / hidden - same semantics as Groq Qwen (inherited base field) |
api_key |
string|null | null (injected) |
no | - | auth_service.get_api_key('cerebras', 'default') |
(Field names are snake_case on CerebrasChatModelParams; unknown keys ignored.)
Outputs (handles)
| Handle | Shape | Description |
|---|---|---|
output-model |
object | Model output; standard envelope payload |
Output payload
{
response: string;
thinking: string | null;
thinking_enabled: boolean;
model: string;
provider: 'cerebras';
finish_reason: string;
timestamp: string;
input: { prompt: string; system_prompt: string };
}
Logic Flow
flowchart TD
A[NodeExecutor dispatch -> BaseNode.execute] --> B[ChatModelBase.chat Operation]
B --> C[AIService.execute_chat]
C --> D{valid key + prompt?}
D -- no --> X[error envelope]
D -- yes --> E[detect_ai_provider -> 'cerebras']
E --> F[Preserve opaque provider model ID]
F --> G[ChatUnifier.chat provider='cerebras']
G --> H[registry.get_provider cerebras<br/>_compat.py spec: OpenAIProvider + base_url=api.cerebras.ai/v1]
H --> I[await provider.chat -> LLMResponse]
I --> J[success envelope]
H -- typed SDK error --> X
Decision Logic
- Validation: missing api_key / empty prompt -> error envelope.
- Provider routing:
detect_ai_providermatches'cerebras' in node_type.lower()before the groq branch, so routing is unambiguous. - Native OpenAI-compatible path:
ChatUnifierresolves thecerebrasspec registered inproviders/_compat.py(reusesOpenAIProviderwith the Cerebrasbase_url) for both chat and agent requests. - Reasoning: no curated reasoning-capable model since
zai-glm-4.7left Cerebras' public endpoints (2026-09); the two current models (gpt-oss-120b,qwen-3.8-27b) ignore the shared thinking controls. - Temperature range: narrower (0-1.5 clamp) than OpenAI/Groq.
_resolve_temperatureapplies the clamp.
Side Effects
- Database writes: none on bare chat path.
- Broadcasts: none.
- External API calls:
POST https://api.cerebras.ai/v1/chat/completionsvia the nativeopenaiSDK withbase_urloverride. - File I/O: none.
- Subprocess: none.
External Dependencies
- Credentials:
auth_service.get_api_key('cerebras', 'default')plus optionalcerebras_proxy. - Services:
ChatUnifier+OpenAIProviderwith the Cerebrasbase_url. - Python packages:
openai. - Environment variables: none.
Edge cases & known limits
- Temperature capped at 1.5, not 2.
- Reasoning only on the configured GLM preview tier.
- Output ceiling: current curated Cerebras models allow up to 40,960 output tokens; unknown models use the configured 8K fallback.
- Error boundary: typed OpenAI SDK failures become user-safe
NodeUserErrorvalues inChatUnifierand are re-raised toBaseNode.execute(), which produces the standard failure envelope. Unexpected failures are logged and returned byexecute_chat.
Related
- Peer nodes: see the other chat-model docs in this folder.
- Architecture docs: Native LLM SDK.