Self-improving AI Employees for everyone
Python ai-agentsai-employeeai-employeesassistantautonomous-agentsco-employeescompanygrok-botinstinctloop-agentsmuseown-your-datapersonalself-hosted
Gemini Chat Model (geminiChatModel)
| Field | Value |
|---|---|
| Category | ai_chat_models |
| Backend handler | server/nodes/model/gemini_chat_model/__init__.py (dispatch via BaseNode.execute() -> @Operation("chat") in server/nodes/model/_base.py) |
| AI service | server/services/ai.py::AIService.execute_chat |
| Tests | server/tests/nodes/test_ai_chat_models.py |
| Skill (if any) | n/a |
| Dual-purpose tool | yes - tool name gemini_chat_model (advisor; usable_as_tool = True, group ('model', 'tool')) |
Purpose
Single-turn chat completion against Google's Gemini API (google-genai native SDK). The ChatModelBase.chat operation calls AIService.execute_chat. Also wired as an AI-agent advisor tool (usable_as_tool = True) so an agent can consult Gemini mid-task.
Inputs (handles)
| Handle | Connection type | Required | Purpose |
|---|---|---|---|
input-main |
main | no | Upstream data; not consumed directly |
Parameters
| Name | Type | Default | Required | displayOptions.show | Description |
|---|---|---|---|---|---|
prompt |
string | "" |
yes (non-empty) | - | User message |
system_prompt |
string | "" |
no | - | System prompt |
model |
string | "" (injected) |
no | - | e.g. gemini-2.5-pro, gemini-2.5-flash, gemini-3-pro |
temperature |
number|null | null |
no | - | 0-2 range |
max_tokens |
number|null | null (clamped to ceiling) |
no | - | 1-200000; up to 65K output |
top_p |
number|null | 1.0 |
no | - | |
top_k |
number|null | 40 |
no | - | 1-100; Gemini-specific |
thinking_enabled |
boolean | false |
no | - | Enable thinking (2.5 Pro/Flash, 3.x) |
thinking_budget |
number|null | 2048 |
no | thinking_enabled=[true] |
1024-16000 token budget for internal reasoning |
safety_settings |
enum | default |
no | - | default / strict / permissive |
api_key |
string|null | null (injected) |
no | - | auth_service.get_api_key('gemini', 'default') |
(Field names are snake_case on GeminiChatModelParams; unknown keys ignored.)
Outputs (handles)
| Handle | Shape | Description |
|---|---|---|
output-model |
object | Model output; standard envelope payload |
Output payload
{
response: string;
thinking: string | null;
thinking_enabled: boolean;
model: string;
provider: 'gemini';
finish_reason: string;
timestamp: string;
input: { prompt: string; system_prompt: string };
}
Logic Flow
flowchart TD
A[NodeExecutor dispatch -> BaseNode.execute] --> B[ChatModelBase.chat Operation]
B --> C[AIService.execute_chat]
C --> D{valid key + prompt?}
D -- no --> X[error envelope]
D -- yes --> E[detect_ai_provider -> 'gemini']
E --> F[Build NativeThinkingConfig w/ budget]
F --> G[ChatUnifier.chat -> registry.get_provider gemini<br/>google.genai.Client]
G --> H[provider.chat -> LLMResponse]
H --> I[success envelope]
G -- typed SDK error --> X[NodeUserError -> BaseNode error envelope]
Decision Logic
- Validation: missing api_key / empty prompt -> error envelope.
- Provider routing: matches
'gemini' in node_type.lower(). - Native SDK:
ChatUnifierusesgoogle.genai.Clientfor both chat and current agent requests. - Thinking budget:
thinkingBudget->NativeThinkingConfig.budget-> Geminithinking_budgetAPI parameter. - Model ID handling: only the UI-only
[FREE]decoration is stripped; the remaining provider model ID is preserved.
Side Effects
- Database writes: none on bare chat path.
- Broadcasts: none.
- External API calls: the endpoint selected by the native
google-genaiSDK. A proxy credential can override the Developer API base URL; Vertex Express mode uses the Vertex endpoint and ignores that proxy. - File I/O: none.
- Subprocess: none.
External Dependencies
- Credentials:
auth_service.get_api_key('gemini', 'default')plus optionalgemini_proxy. - Services:
services/llm/providers/gemini.py. - Python packages:
google-genai(native). - Environment variables: none.
Edge cases & known limits
- Windows/Python 3.13 quirk: the native
google-genaiprovider avoids the former adapter's gRPC import deadlock. Both current chat and agent executions use the native path. - Thinking budget units: expressed as token count, not low/medium/high effort levels. Defaults to 2048.
- Safety settings: forwarded via the SDK; typed API failures are translated into a user-safe node error at the execution boundary.
maxTokensclamp: capped at the model's ceiling (65K for 2.5/3.x).- Error boundary: typed Google SDK failures become user-safe
NodeUserErrorvalues inChatUnifierand are re-raised toBaseNode.execute(), which produces the standard failure envelope. Unexpected failures are logged and returned byexecute_chat.
Related
- Peer nodes:
openaiChatModel,anthropicChatModel,openrouterChatModel,groqChatModel,cerebrasChatModel,deepseekChatModel,kimiChatModel,mistralChatModel. - Architecture docs: Native LLM SDK.