Self-improving AI Employees for everyone
Python ai-agentsai-employeeai-employeesassistantautonomous-agentsco-employeescompanygrok-botinstinctloop-agentsmuseown-your-datapersonalself-hosted
docs(multimodal): update system design docs and diagrams for image input
trohitg255df3093d4c
diff --git a/docs-internal/agent_architecture.md b/docs-internal/agent_architecture.mdindex 03973054..9b934b40 100644--- a/docs-internal/agent_architecture.md+++ b/docs-internal/agent_architecture.md@@ -669,3 +669,17 @@ AI Agents delegate to other agents wired to their `input-tools` handle, enablingDesign decisions (legacy path): **memory isolation** (child uses its own connected memory, not the parent's), **error isolation** (child errors are logged + broadcast, never propagated to the parent), **task tracking** (background tasks live in `_delegated_tasks`, cleaned up on completion).Key files: `server/services/ai.py` (`DelegateToAgentSchema` in `_get_tool_schema()`, injects `ai_service` / `database` / `nodes` / `edges` into tool config), `server/services/handlers/tools.py` (`_execute_delegated_agent()`, `get_delegated_task_status()`). Full plumbing — memory / parameter / execution-context flow — is in [agent_delegation.md](agent_delegation.md); the multi-agent team-lead variant is in [agent_teams.md](agent_teams.md).+++## Multimodal tool results++A tool result may opt into vision by including `llm_media: [{"ref": <FileRef+kind=image>, "detail": "auto"}]` next to its normal payload. The agent loop+(`agent_runtime.py`) and the Temporal activity path (`agent_activities.py`)+attach ref-only image blocks to the tool message; `run_native_llm_step`+hydrates them per provider call, gated by `provider_supports_vision` (unknown+providers degrade to a text placeholder, so non-vision models keep working+unchanged). Producers today: the `dataSource` image tier. For text-only host+models the `visionAnalyze` delegate tool provides image understanding+instead. Details: [native_llm_sdk.md](native_llm_sdk.md) and+[data_node.md](data_node.md).diff --git a/docs-internal/design-system/assets/diagrams/ai-agent-routing.svg b/docs-internal/design-system/assets/diagrams/ai-agent-routing.svgindex 6626e289..ceae290c 100644--- a/docs-internal/design-system/assets/diagrams/ai-agent-routing.svg+++ b/docs-internal/design-system/assets/diagrams/ai-agent-routing.svg@@ -85,17 +85,18 @@<rect class="box p-purple" x="605" y="324" width="500" height="76" rx="6"/><text class="h2" x="855" y="348" text-anchor="middle">create_model() -> LangChain chat model</text>- <text class="sub" x="855" y="368" text-anchor="middle">ChatOpenAI / ChatAnthropic / ChatGoogleGenerativeAI / ...</text>- <text class="sub" x="855" y="386" text-anchor="middle">.bind_tools([StructuredTool, ...])</text>+ <text class="sub" x="855" y="368" text-anchor="middle">AnthropicProvider / OpenAIProvider / GeminiProvider / ...</text>+ <text class="sub" x="855" y="386" text-anchor="middle">provider-neutral ToolDef schemas</text><path class="conn" d="M 855 400 L 855 448" marker-end="url(#arrow)"/><text class="label" x="865" y="428">bind_tools</text>- <rect class="box p-purple" x="605" y="448" width="500" height="94" rx="6"/>- <text class="h2" x="855" y="472" text-anchor="middle">_run_agent_loop (plain async)</text>- <text class="sub" x="855" y="492" text-anchor="middle">loop: ainvoke -> tool_calls? dispatch -> ToolMessage</text>+ <rect class="box p-purple" x="605" y="448" width="500" height="112" rx="6"/>+ <text class="h2" x="855" y="472" text-anchor="middle">run_native_agent_loop (plain async)</text>+ <text class="sub" x="855" y="492" text-anchor="middle">loop: chat -> tool_calls? dispatch -> tool message</text><text class="sub" x="855" y="510" text-anchor="middle">max-iterations guard · delegate_to_<type> auto-injected</text><text class="sub" x="855" y="528" text-anchor="middle">hot-rebind of tools after canvas mutations</text>+ <text class="sub" x="855" y="546" text-anchor="middle">llm_media image refs -> hydrated per call (vision-gated)</text><!-- Convergence arrows --><path class="conn" d="M 295 630 V 662 H 462 V 706" marker-end="url(#arrow)"/>diff --git a/docs-internal/design-system/assets/diagrams/system-overview.svg b/docs-internal/design-system/assets/diagrams/system-overview.svgindex f2708010..be926103 100644--- a/docs-internal/design-system/assets/diagrams/system-overview.svg+++ b/docs-internal/design-system/assets/diagrams/system-overview.svg@@ -120,11 +120,12 @@<rect class="panel p-green" x="1320" y="104" width="440" height="936" rx="10"/><text class="h1" x="1540" y="134" text-anchor="middle">External services</text>- <rect class="box p-green" x="1340" y="152" width="400" height="100" rx="8"/>+ <rect class="box p-green" x="1340" y="152" width="400" height="116" rx="8"/><text class="h2" x="1540" y="177" text-anchor="middle">LLM providers (12)</text><text class="sub" x="1540" y="197" text-anchor="middle">OpenAI, Anthropic, Gemini, OpenRouter, xAI,</text><text class="sub" x="1540" y="215" text-anchor="middle">DeepSeek, Kimi, Mistral, Groq, Cerebras</text><text class="sub" x="1540" y="233" text-anchor="middle">local: Ollama, LM Studio</text>+ <text class="sub" x="1540" y="251" text-anchor="middle">image input: native blocks + visionAnalyze delegate</text><rect class="box p-green" x="1340" y="280" width="400" height="60" rx="8"/><text class="h2" x="1540" y="305" text-anchor="middle">Google Workspace</text>diff --git a/docs-internal/media_transport.md b/docs-internal/media_transport.mdindex 21d242ad..dbc48fed 100644--- a/docs-internal/media_transport.md+++ b/docs-internal/media_transport.md@@ -318,3 +318,27 @@ So the rule for the next kind:| An escaping symlink is not listed | `tests/nodes/test_gallery.py::TestWorkspaceContainmentOfSymlinks` || A mutating caller with an unresolvable workflow id is refused, not defaulted | `tests/services/test_workspace_locator.py` || A returned ref round-trips through the GET route | `tests/routers/test_workspace.py` |+++## Images to models — the hydration boundary++Multimodal input extends the never-bytes rule to LLM requests. Durable state+(journal events, Temporal payloads, node results) carries image **FileRefs**+inside `ContentBlock.source` (`kind="file_ref"`, ~450 B); actual bytes exist+only between `services/llm/media.py::hydrate_image_blocks` and the provider+HTTP call, on throwaway message copies. The protocol codec raises if a+bytes-kind source ever reaches serialization — same structural-enforcement+philosophy as `FileRef.extra="forbid"`.++`services/media/image_fit.py` is the sizing authority: budgets are defined in+visual tokens (`small`/`normal`/`large` = 256/1024/2048), converted to a+pixel area (`tokens x patch^2`) and applied with the aspect-preserving,+patch-grid-snapping `smart_resize` (floors AND ceilings — thumbnails scale+up). JPEG q90 for opaque images, PNG when alpha must survive. Consumers: the+`visionAnalyze` delegate node and image-block hydration.++The `dataSource` node is the reference producer: its image read tier returns+Pillow header metadata plus the FileRef, and adds the `llm_media` opt-in for+workspace refs of allowlisted types. External-mount images have no FileRef by+design — `copy_to_workspace` imports them first. Full node reference:+[data_node.md](data_node.md).diff --git a/docs-internal/native_llm_sdk.md b/docs-internal/native_llm_sdk.mdindex c5b63e0e..9f48fe5a 100644--- a/docs-internal/native_llm_sdk.md+++ b/docs-internal/native_llm_sdk.md@@ -494,3 +494,37 @@ is to Reset the deployment, which starts a fresh generation.`tests/llm/test_langchain_removed.py` enforces the dependency end state via anAST walk over production sources, the `pyproject.toml` declarations, runtimeimportability, and a guarded `core.container` boot.+++## Multimodal image input (first increment)++Image input rides the same normalized protocol rather than a parallel path.+`ContentBlock` carries an optional `source` dict, discriminated by `kind`:+durable `{"kind": "file_ref", "ref": <FileRef kind=image>, "detail": ...}`+(~450 B) or transient `{"kind": "bytes", "media_type", "data_b64"}`. The wire+codec's `_durable_source` **raises** on a bytes-kind source, so hydrated+request material can never enter the journal or a Temporal payload — the+never-bytes rule from [media_transport.md](media_transport.md), enforced+structurally.++Flow: a tool result opts in with `llm_media: [{ref, detail}]` (max 8 entries,+png/jpeg/webp/gif, `ref.workflow_id` required). Both agent loops attach+ref-only image blocks to the tool message. `run_native_llm_step` calls+`services/llm/media.py::hydrate_image_blocks` once per step, on deep copies:+bytes are read through the contained media reader, fitted to a visual-token+budget (`services/media/image_fit.py`, detail low/auto/high -> small/normal/+large), and dropped after the HTTP call. Originals never mutate.++**Capability gate**: `provider_supports_vision` reads+`llm_defaults.json providers.<p>.vision.enabled`; unknown or absent means+False and the model gets a text placeholder instead — never emit a block a+model is not confirmed to accept, because a rejected block would be journaled+and resent every turn. **Encoder status**: Anthropic renders hydrated images+inside `tool_result.content` (the documented block-list shape). OpenAI+(Responses `input_image` inside `function_call_output`; Chat Completions+hoist-to-user-turn) and Gemini (`inline_data` parts beside+`function_response`) are pending — their `vision.enabled` stays `false` until+those encoders land, so bytes are never hydrated only to be dropped.+Text-only providers keep the `visionAnalyze` delegate tool as their vision+path (see [data_node.md](data_node.md)). Locked by+`tests/llm/test_media_blocks.py`.diff --git a/docs/diagrams/ai-agent-routing.svg b/docs/diagrams/ai-agent-routing.svgindex e9f26794..036584a9 100644--- a/docs/diagrams/ai-agent-routing.svg+++ b/docs/diagrams/ai-agent-routing.svg@@ -85,17 +85,18 @@<rect class="box p-purple" x="605" y="324" width="500" height="76" rx="6"/><text class="h2" x="855" y="348" text-anchor="middle">ChatUnifier -> native provider SDK</text>- <text class="sub" x="855" y="368" text-anchor="middle">ChatOpenAI / ChatAnthropic / ChatGoogleGenerativeAI / ...</text>- <text class="sub" x="855" y="386" text-anchor="middle">.bind_tools([StructuredTool, ...])</text>+ <text class="sub" x="855" y="368" text-anchor="middle">AnthropicProvider / OpenAIProvider / GeminiProvider / ...</text>+ <text class="sub" x="855" y="386" text-anchor="middle">provider-neutral ToolDef schemas</text><path class="conn" d="M 855 400 L 855 448" marker-end="url(#arrow)"/><text class="label" x="865" y="428">bind_tools</text>- <rect class="box p-purple" x="605" y="448" width="500" height="94" rx="6"/>- <text class="h2" x="855" y="472" text-anchor="middle">_run_agent_loop (plain async)</text>- <text class="sub" x="855" y="492" text-anchor="middle">loop: ainvoke -> tool_calls? dispatch -> ToolMessage</text>+ <rect class="box p-purple" x="605" y="448" width="500" height="112" rx="6"/>+ <text class="h2" x="855" y="472" text-anchor="middle">run_native_agent_loop (plain async)</text>+ <text class="sub" x="855" y="492" text-anchor="middle">loop: chat -> tool_calls? dispatch -> tool message</text><text class="sub" x="855" y="510" text-anchor="middle">max-iterations guard · delegate_to_<type> auto-injected</text><text class="sub" x="855" y="528" text-anchor="middle">hot-rebind of tools after canvas mutations</text>+ <text class="sub" x="855" y="546" text-anchor="middle">llm_media image refs -> hydrated per call (vision-gated)</text><!-- Convergence arrows --><path class="conn" d="M 295 630 V 662 H 462 V 706" marker-end="url(#arrow)"/>diff --git a/docs/diagrams/system-overview.svg b/docs/diagrams/system-overview.svgindex b36fadd3..c2b0eae6 100644--- a/docs/diagrams/system-overview.svg+++ b/docs/diagrams/system-overview.svg@@ -120,11 +120,12 @@<rect class="panel p-green" x="1320" y="104" width="440" height="936" rx="10"/><text class="h1" x="1540" y="134" text-anchor="middle">External services</text>- <rect class="box p-green" x="1340" y="152" width="400" height="100" rx="8"/>+ <rect class="box p-green" x="1340" y="152" width="400" height="116" rx="8"/><text class="h2" x="1540" y="177" text-anchor="middle">LLM providers (12)</text><text class="sub" x="1540" y="197" text-anchor="middle">OpenAI, Anthropic, Gemini, OpenRouter, xAI,</text><text class="sub" x="1540" y="215" text-anchor="middle">DeepSeek, Kimi, Mistral, Groq, Cerebras</text><text class="sub" x="1540" y="233" text-anchor="middle">local: Ollama, LM Studio</text>+ <text class="sub" x="1540" y="251" text-anchor="middle">image input: native blocks + visionAnalyze delegate</text><rect class="box p-green" x="1340" y="280" width="400" height="60" rx="8"/><text class="h2" x="1540" y="305" text-anchor="middle">Google Workspace</text>diff --git a/docs/diagrams/v2/dark/01-system-context.svg b/docs/diagrams/v2/dark/01-system-context.svgindex 1eae9224..b052a63c 100644--- a/docs/diagrams/v2/dark/01-system-context.svg+++ b/docs/diagrams/v2/dark/01-system-context.svg@@ -20,6 +20,6 @@<rect width="1920" height="1080" fill="#0d0f13"/><text x="72" y="58" class="title">OpenCompany System Context</text><text x="72" y="91" class="subtitle">Who uses the system and which external capabilities it orchestrates</text>-<g data-group-id="opencompany-boundary"><rect x="420" y="145" width="930" height="800" rx="18" fill="#15171c" stroke="#bd93f9" stroke-width="2"/><text x="440" y="177" class="group-label">OPENCOMPANY SYSTEM BOUNDARY</text></g><g data-relationship-id="r-authors-design"><title>Design and run automations · via Browser UI / CLI</title><path d="M 340 327.5 L 510 327 L 510 445 L 665 487.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="389.2" y="341.0" width="221.6" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="500" y="362" class="edge-label" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">Design and run automations</text><text x="500" y="382" class="edge-protocol" text-anchor="middle">via Browser UI / CLI</text></g><g data-relationship-id="r-operators-control"><title>Control deployed workflows · via Browser UI / WebSocket</title><path d="M 340 702.5 L 535 702 L 535 535 L 665 487.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="394.2" y="641.0" width="221.6" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="505" y="662" class="edge-label" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">Control deployed workflows</text><text x="505" y="682" class="edge-protocol" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">via Browser UI / WebSocket</text></g><g data-relationship-id="r-opencompany-llm"><title>Requests inference · via Provider SDK / HTTPS</title><path d="M 1105 487.5 L 1210 487 L 1210 182 L 1480 182.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1221.8" y="158.0" width="206.39999999999998" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1325" y="179" class="edge-label" text-anchor="middle">Requests inference</text><text x="1325" y="199" class="edge-protocol" text-anchor="middle" textLength="188.4" lengthAdjust="spacingAndGlyphs">via Provider SDK / HTTPS</text></g><g data-relationship-id="r-opencompany-productivity"><title>Reads and updates work · via OAuth / HTTPS</title><path d="M 1105 487.5 L 1240 487 L 1240 327 L 1480 327.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1254.4" y="303.0" width="191.2" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1350" y="324" class="edge-label" text-anchor="middle" textLength="173.2" lengthAdjust="spacingAndGlyphs">Reads and updates work</text><text x="1350" y="344" class="edge-protocol" text-anchor="middle">via OAuth / HTTPS</text></g><g data-relationship-id="r-opencompany-messaging"><title>Sends and receives messages · via Webhooks / RPC</title><path d="M 1105 487.5 L 1270 487 L 1270 472 L 1480 472.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><path d="M 1365.0 472.0 L 1275 472" fill="none" stroke="#9aa1ac" stroke-width="1" stroke-dasharray="3 4" opacity=".7"/><rect x="1160.4" y="448.0" width="229.2" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1275" y="469" class="edge-label" text-anchor="middle" textLength="211.2" lengthAdjust="spacingAndGlyphs">Sends and receives messages</text><text x="1275" y="489" class="edge-protocol" text-anchor="middle">via Webhooks / RPC</text></g><g data-relationship-id="r-opencompany-devices"><title>Invokes device actions · via RPC / platform APIs</title><path d="M 1105 487.5 L 1270 487 L 1270 617 L 1480 617.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1260.6" y="593.0" width="198.79999999999998" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1360" y="614" class="edge-label" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">Invokes device actions</text><text x="1360" y="634" class="edge-protocol" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">via RPC / platform APIs</text></g><g data-relationship-id="r-opencompany-developer"><title>Uses code and dev tools · via MCP / CLI / HTTPS</title><path d="M 1105 487.5 L 1240 487 L 1240 762 L 1480 762.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1250.6" y="738.0" width="198.79999999999998" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1350" y="759" class="edge-label" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">Uses code and dev tools</text><text x="1350" y="779" class="edge-protocol" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">via MCP / CLI / HTTPS</text></g><g data-relationship-id="r-opencompany-search"><title>Indexes and retrieves knowledge · via HTTPS / vector API</title><path d="M 1105 487.5 L 1210 487 L 1210 910 L 1480 910.0" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1210.2" y="886.0" width="259.6" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1340" y="907" class="edge-label" text-anchor="middle" textLength="241.6" lengthAdjust="spacingAndGlyphs">Indexes and retrieves knowledge</text><text x="1340" y="927" class="edge-protocol" text-anchor="middle">via HTTPS / vector API</text></g><g data-component-id="workflow-authors"><title>Workflow authors</title><rect x="55" y="265" width="285" height="125" rx="12" fill="#1b1e25" stroke="#f1fa8c" stroke-width="2"/><rect x="55" y="265" width="285" height="7" rx="4" fill="#f1fa8c"/><text x="73" y="291" class="type-label">PERSON</text><text x="73" y="317" class="node-label">Workflow authors</text><text x="73" y="343" class="node-detail">Build and test automations</text></g><g data-component-id="workflow-operators"><title>Workflow operators</title><rect x="55" y="640" width="285" height="125" rx="12" fill="#1b1e25" stroke="#f1fa8c" stroke-width="2"/><rect x="55" y="640" width="285" height="7" rx="4" fill="#f1fa8c"/><text x="73" y="666" class="type-label">PERSON</text><text x="73" y="692" class="node-label">Workflow operators</text><text x="73" y="718" class="node-detail">Deploy and supervise runs</text></g><g data-component-id="opencompany"><title>OpenCompany</title><rect x="665" y="385" width="440" height="205" rx="12" fill="#1b1e25" stroke="#bd93f9" stroke-width="2"/><rect x="665" y="385" width="440" height="7" rx="4" fill="#bd93f9"/><text x="683" y="411" class="type-label">SOFTWARE SYSTEM</text><text x="683" y="437" class="node-label">OpenCompany</text><text x="683" y="463" class="node-detail">Visual workflow workspace</text><text x="683" y="483" class="node-detail">Agents, tools, triggers and durable runs</text></g><g data-component-id="llm-providers"><title>LLM providers</title><rect x="1480" y="130" width="365" height="105" rx="12" fill="#1b1e25" stroke="#8be9fd" stroke-width="2"/><rect x="1480" y="130" width="365" height="7" rx="4" fill="#8be9fd"/><text x="1498" y="156" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="182" class="node-label">LLM providers</text><text x="1498" y="208" class="node-detail">Hosted and local inference</text></g><g data-component-id="productivity-services"><title>Productivity services</title><rect x="1480" y="275" width="365" height="105" rx="12" fill="#1b1e25" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="275" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="301" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="327" class="node-label">Productivity services</text><text x="1498" y="353" class="node-detail">Mail, calendar, docs and CRM</text></g><g data-component-id="messaging-channels"><title>Messaging channels</title><rect x="1480" y="420" width="365" height="105" rx="12" fill="#1b1e25" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="420" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="446" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="472" class="node-label">Messaging channels</text><text x="1498" y="498" class="node-detail">Chat and social platforms</text></g><g data-component-id="connected-devices"><title>Connected devices</title><rect x="1480" y="565" width="365" height="105" rx="12" fill="#1b1e25" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="565" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="591" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="617" class="node-label">Connected devices</text><text x="1498" y="643" class="node-detail">Android and device services</text></g><g data-component-id="developer-services"><title>Developer services</title><rect x="1480" y="710" width="365" height="105" rx="12" fill="#1b1e25" stroke="#8be9fd" stroke-width="2"/><rect x="1480" y="710" width="365" height="7" rx="4" fill="#8be9fd"/><text x="1498" y="736" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="762" class="node-label">Developer services</text><text x="1498" y="788" class="node-detail">Code, CLI and MCP tools</text></g><g data-component-id="search-vector-stores"><title>Search and vector stores</title><rect x="1480" y="855" width="365" height="110" rx="12" fill="#1b1e25" stroke="#ff79c6" stroke-width="2"/><rect x="1480" y="855" width="365" height="7" rx="4" fill="#ff79c6"/><text x="1498" y="881" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="907" class="node-label">Search and</text><text x="1498" y="929" class="node-label">vector stores</text><text x="1498" y="955" class="node-detail">Retrieval and knowledge indexes</text></g><g data-callout-id="system-purpose"><rect x="615" y="700" width="540" height="135" rx="10" fill="#1b1e25" stroke="#f1fa8c" stroke-width="2" stroke-dasharray="7 6"/><text x="631" y="730" class="callout-title">System responsibility</text><text x="631" y="756" class="callout-text">Compose external capabilities as directed graphs.</text><text x="631" y="778" class="callout-text">Keep execution, credentials and observability</text><text x="631" y="800" class="callout-text">inside one user-scoped workspace.</text></g>+<g data-group-id="opencompany-boundary"><rect x="420" y="145" width="930" height="800" rx="18" fill="#15171c" stroke="#bd93f9" stroke-width="2"/><text x="440" y="177" class="group-label">OPENCOMPANY SYSTEM BOUNDARY</text></g><g data-relationship-id="r-authors-design"><title>Design and run automations · via Browser UI / CLI</title><path d="M 340 327.5 L 510 327 L 510 445 L 665 487.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="389.2" y="341.0" width="221.6" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="500" y="362" class="edge-label" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">Design and run automations</text><text x="500" y="382" class="edge-protocol" text-anchor="middle">via Browser UI / CLI</text></g><g data-relationship-id="r-operators-control"><title>Control deployed workflows · via Browser UI / WebSocket</title><path d="M 340 702.5 L 535 702 L 535 535 L 665 487.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="394.2" y="641.0" width="221.6" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="505" y="662" class="edge-label" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">Control deployed workflows</text><text x="505" y="682" class="edge-protocol" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">via Browser UI / WebSocket</text></g><g data-relationship-id="r-opencompany-llm"><title>Requests inference · via Provider SDK / HTTPS</title><path d="M 1105 487.5 L 1210 487 L 1210 182 L 1480 182.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1221.8" y="158.0" width="206.39999999999998" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1325" y="179" class="edge-label" text-anchor="middle">Requests inference</text><text x="1325" y="199" class="edge-protocol" text-anchor="middle" textLength="188.4" lengthAdjust="spacingAndGlyphs">via Provider SDK / HTTPS</text></g><g data-relationship-id="r-opencompany-productivity"><title>Reads and updates work · via OAuth / HTTPS</title><path d="M 1105 487.5 L 1240 487 L 1240 327 L 1480 327.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1254.4" y="303.0" width="191.2" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1350" y="324" class="edge-label" text-anchor="middle" textLength="173.2" lengthAdjust="spacingAndGlyphs">Reads and updates work</text><text x="1350" y="344" class="edge-protocol" text-anchor="middle">via OAuth / HTTPS</text></g><g data-relationship-id="r-opencompany-messaging"><title>Sends and receives messages · via Webhooks / RPC</title><path d="M 1105 487.5 L 1270 487 L 1270 472 L 1480 472.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><path d="M 1365.0 472.0 L 1275 472" fill="none" stroke="#9aa1ac" stroke-width="1" stroke-dasharray="3 4" opacity=".7"/><rect x="1160.4" y="448.0" width="229.2" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1275" y="469" class="edge-label" text-anchor="middle" textLength="211.2" lengthAdjust="spacingAndGlyphs">Sends and receives messages</text><text x="1275" y="489" class="edge-protocol" text-anchor="middle">via Webhooks / RPC</text></g><g data-relationship-id="r-opencompany-devices"><title>Invokes device actions · via RPC / platform APIs</title><path d="M 1105 487.5 L 1270 487 L 1270 617 L 1480 617.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1260.6" y="593.0" width="198.79999999999998" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1360" y="614" class="edge-label" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">Invokes device actions</text><text x="1360" y="634" class="edge-protocol" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">via RPC / platform APIs</text></g><g data-relationship-id="r-opencompany-developer"><title>Uses code and dev tools · via MCP / CLI / HTTPS</title><path d="M 1105 487.5 L 1240 487 L 1240 762 L 1480 762.5" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1250.6" y="738.0" width="198.79999999999998" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1350" y="759" class="edge-label" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">Uses code and dev tools</text><text x="1350" y="779" class="edge-protocol" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">via MCP / CLI / HTTPS</text></g><g data-relationship-id="r-opencompany-search"><title>Indexes and retrieves knowledge · via HTTPS / vector API</title><path d="M 1105 487.5 L 1210 487 L 1210 910 L 1480 910.0" fill="none" stroke="#e8eaed" stroke-width="2" marker-end="url(#arrow)"/><rect x="1210.2" y="886.0" width="259.6" height="48" rx="7" fill="#15171c" stroke="#2b2f37"/><text x="1340" y="907" class="edge-label" text-anchor="middle" textLength="241.6" lengthAdjust="spacingAndGlyphs">Indexes and retrieves knowledge</text><text x="1340" y="927" class="edge-protocol" text-anchor="middle">via HTTPS / vector API</text></g><g data-component-id="workflow-authors"><title>Workflow authors</title><rect x="55" y="265" width="285" height="125" rx="12" fill="#1b1e25" stroke="#f1fa8c" stroke-width="2"/><rect x="55" y="265" width="285" height="7" rx="4" fill="#f1fa8c"/><text x="73" y="291" class="type-label">PERSON</text><text x="73" y="317" class="node-label">Workflow authors</text><text x="73" y="343" class="node-detail">Build and test automations</text></g><g data-component-id="workflow-operators"><title>Workflow operators</title><rect x="55" y="640" width="285" height="125" rx="12" fill="#1b1e25" stroke="#f1fa8c" stroke-width="2"/><rect x="55" y="640" width="285" height="7" rx="4" fill="#f1fa8c"/><text x="73" y="666" class="type-label">PERSON</text><text x="73" y="692" class="node-label">Workflow operators</text><text x="73" y="718" class="node-detail">Deploy and supervise runs</text></g><g data-component-id="opencompany"><title>OpenCompany</title><rect x="665" y="385" width="440" height="205" rx="12" fill="#1b1e25" stroke="#bd93f9" stroke-width="2"/><rect x="665" y="385" width="440" height="7" rx="4" fill="#bd93f9"/><text x="683" y="411" class="type-label">SOFTWARE SYSTEM</text><text x="683" y="437" class="node-label">OpenCompany</text><text x="683" y="463" class="node-detail">Visual workflow workspace</text><text x="683" y="483" class="node-detail">Agents, tools, triggers and durable runs</text></g><g data-component-id="llm-providers"><title>LLM providers</title><rect x="1480" y="130" width="365" height="105" rx="12" fill="#1b1e25" stroke="#8be9fd" stroke-width="2"/><rect x="1480" y="130" width="365" height="7" rx="4" fill="#8be9fd"/><text x="1498" y="156" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="182" class="node-label">LLM providers</text><text x="1498" y="208" class="node-detail">Hosted and local inference - text + image input</text></g><g data-component-id="productivity-services"><title>Productivity services</title><rect x="1480" y="275" width="365" height="105" rx="12" fill="#1b1e25" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="275" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="301" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="327" class="node-label">Productivity services</text><text x="1498" y="353" class="node-detail">Mail, calendar, docs and CRM</text></g><g data-component-id="messaging-channels"><title>Messaging channels</title><rect x="1480" y="420" width="365" height="105" rx="12" fill="#1b1e25" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="420" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="446" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="472" class="node-label">Messaging channels</text><text x="1498" y="498" class="node-detail">Chat and social platforms</text></g><g data-component-id="connected-devices"><title>Connected devices</title><rect x="1480" y="565" width="365" height="105" rx="12" fill="#1b1e25" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="565" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="591" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="617" class="node-label">Connected devices</text><text x="1498" y="643" class="node-detail">Android and device services</text></g><g data-component-id="developer-services"><title>Developer services</title><rect x="1480" y="710" width="365" height="105" rx="12" fill="#1b1e25" stroke="#8be9fd" stroke-width="2"/><rect x="1480" y="710" width="365" height="7" rx="4" fill="#8be9fd"/><text x="1498" y="736" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="762" class="node-label">Developer services</text><text x="1498" y="788" class="node-detail">Code, CLI and MCP tools</text></g><g data-component-id="search-vector-stores"><title>Search and vector stores</title><rect x="1480" y="855" width="365" height="110" rx="12" fill="#1b1e25" stroke="#ff79c6" stroke-width="2"/><rect x="1480" y="855" width="365" height="7" rx="4" fill="#ff79c6"/><text x="1498" y="881" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="907" class="node-label">Search and</text><text x="1498" y="929" class="node-label">vector stores</text><text x="1498" y="955" class="node-detail">Retrieval and knowledge indexes</text></g><g data-callout-id="system-purpose"><rect x="615" y="700" width="540" height="135" rx="10" fill="#1b1e25" stroke="#f1fa8c" stroke-width="2" stroke-dasharray="7 6"/><text x="631" y="730" class="callout-title">System responsibility</text><text x="631" y="756" class="callout-text">Compose external capabilities as directed graphs.</text><text x="631" y="778" class="callout-text">Keep execution, credentials and observability</text><text x="631" y="800" class="callout-text">inside one user-scoped workspace.</text></g><g aria-label="Legend"><circle cx="72" cy="1038" r="7" fill="#bd93f9"/><text x="86" y="1044" class="legend">Agents / system</text><circle cx="317" cy="1038" r="7" fill="#8be9fd"/><text x="331" y="1044" class="legend">Models / interfaces</text><circle cx="562" cy="1038" r="7" fill="#50fa7b"/><text x="576" y="1044" class="legend">Tools / results</text><circle cx="807" cy="1038" r="7" fill="#ff79c6"/><text x="821" y="1044" class="legend">Triggers / events</text><circle cx="1052" cy="1038" r="7" fill="#ffb86c"/><text x="1066" y="1044" class="legend">Workflow / runtime</text><circle cx="1297" cy="1038" r="7" fill="#f1fa8c"/><text x="1311" y="1044" class="legend">Security note</text></g></svg>diff --git a/docs/diagrams/v2/light/01-system-context.svg b/docs/diagrams/v2/light/01-system-context.svgindex 61ff3549..4df88f96 100644--- a/docs/diagrams/v2/light/01-system-context.svg+++ b/docs/diagrams/v2/light/01-system-context.svg@@ -20,6 +20,6 @@<rect width="1920" height="1080" fill="#f5f7fa"/><text x="72" y="58" class="title">OpenCompany System Context</text><text x="72" y="91" class="subtitle">Who uses the system and which external capabilities it orchestrates</text>-<g data-group-id="opencompany-boundary"><rect x="420" y="145" width="930" height="800" rx="18" fill="#fafbfc" stroke="#bd93f9" stroke-width="2"/><text x="440" y="177" class="group-label">OPENCOMPANY SYSTEM BOUNDARY</text></g><g data-relationship-id="r-authors-design"><title>Design and run automations · via Browser UI / CLI</title><path d="M 340 327.5 L 510 327 L 510 445 L 665 487.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="389.2" y="341.0" width="221.6" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="500" y="362" class="edge-label" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">Design and run automations</text><text x="500" y="382" class="edge-protocol" text-anchor="middle">via Browser UI / CLI</text></g><g data-relationship-id="r-operators-control"><title>Control deployed workflows · via Browser UI / WebSocket</title><path d="M 340 702.5 L 535 702 L 535 535 L 665 487.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="394.2" y="641.0" width="221.6" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="505" y="662" class="edge-label" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">Control deployed workflows</text><text x="505" y="682" class="edge-protocol" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">via Browser UI / WebSocket</text></g><g data-relationship-id="r-opencompany-llm"><title>Requests inference · via Provider SDK / HTTPS</title><path d="M 1105 487.5 L 1210 487 L 1210 182 L 1480 182.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1221.8" y="158.0" width="206.39999999999998" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1325" y="179" class="edge-label" text-anchor="middle">Requests inference</text><text x="1325" y="199" class="edge-protocol" text-anchor="middle" textLength="188.4" lengthAdjust="spacingAndGlyphs">via Provider SDK / HTTPS</text></g><g data-relationship-id="r-opencompany-productivity"><title>Reads and updates work · via OAuth / HTTPS</title><path d="M 1105 487.5 L 1240 487 L 1240 327 L 1480 327.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1254.4" y="303.0" width="191.2" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1350" y="324" class="edge-label" text-anchor="middle" textLength="173.2" lengthAdjust="spacingAndGlyphs">Reads and updates work</text><text x="1350" y="344" class="edge-protocol" text-anchor="middle">via OAuth / HTTPS</text></g><g data-relationship-id="r-opencompany-messaging"><title>Sends and receives messages · via Webhooks / RPC</title><path d="M 1105 487.5 L 1270 487 L 1270 472 L 1480 472.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><path d="M 1365.0 472.0 L 1275 472" fill="none" stroke="#4b5563" stroke-width="1" stroke-dasharray="3 4" opacity=".7"/><rect x="1160.4" y="448.0" width="229.2" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1275" y="469" class="edge-label" text-anchor="middle" textLength="211.2" lengthAdjust="spacingAndGlyphs">Sends and receives messages</text><text x="1275" y="489" class="edge-protocol" text-anchor="middle">via Webhooks / RPC</text></g><g data-relationship-id="r-opencompany-devices"><title>Invokes device actions · via RPC / platform APIs</title><path d="M 1105 487.5 L 1270 487 L 1270 617 L 1480 617.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1260.6" y="593.0" width="198.79999999999998" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1360" y="614" class="edge-label" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">Invokes device actions</text><text x="1360" y="634" class="edge-protocol" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">via RPC / platform APIs</text></g><g data-relationship-id="r-opencompany-developer"><title>Uses code and dev tools · via MCP / CLI / HTTPS</title><path d="M 1105 487.5 L 1240 487 L 1240 762 L 1480 762.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1250.6" y="738.0" width="198.79999999999998" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1350" y="759" class="edge-label" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">Uses code and dev tools</text><text x="1350" y="779" class="edge-protocol" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">via MCP / CLI / HTTPS</text></g><g data-relationship-id="r-opencompany-search"><title>Indexes and retrieves knowledge · via HTTPS / vector API</title><path d="M 1105 487.5 L 1210 487 L 1210 910 L 1480 910.0" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1210.2" y="886.0" width="259.6" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1340" y="907" class="edge-label" text-anchor="middle" textLength="241.6" lengthAdjust="spacingAndGlyphs">Indexes and retrieves knowledge</text><text x="1340" y="927" class="edge-protocol" text-anchor="middle">via HTTPS / vector API</text></g><g data-component-id="workflow-authors"><title>Workflow authors</title><rect x="55" y="265" width="285" height="125" rx="12" fill="#ffffff" stroke="#f1fa8c" stroke-width="2"/><rect x="55" y="265" width="285" height="7" rx="4" fill="#f1fa8c"/><text x="73" y="291" class="type-label">PERSON</text><text x="73" y="317" class="node-label">Workflow authors</text><text x="73" y="343" class="node-detail">Build and test automations</text></g><g data-component-id="workflow-operators"><title>Workflow operators</title><rect x="55" y="640" width="285" height="125" rx="12" fill="#ffffff" stroke="#f1fa8c" stroke-width="2"/><rect x="55" y="640" width="285" height="7" rx="4" fill="#f1fa8c"/><text x="73" y="666" class="type-label">PERSON</text><text x="73" y="692" class="node-label">Workflow operators</text><text x="73" y="718" class="node-detail">Deploy and supervise runs</text></g><g data-component-id="opencompany"><title>OpenCompany</title><rect x="665" y="385" width="440" height="205" rx="12" fill="#ffffff" stroke="#bd93f9" stroke-width="2"/><rect x="665" y="385" width="440" height="7" rx="4" fill="#bd93f9"/><text x="683" y="411" class="type-label">SOFTWARE SYSTEM</text><text x="683" y="437" class="node-label">OpenCompany</text><text x="683" y="463" class="node-detail">Visual workflow workspace</text><text x="683" y="483" class="node-detail">Agents, tools, triggers and durable runs</text></g><g data-component-id="llm-providers"><title>LLM providers</title><rect x="1480" y="130" width="365" height="105" rx="12" fill="#ffffff" stroke="#8be9fd" stroke-width="2"/><rect x="1480" y="130" width="365" height="7" rx="4" fill="#8be9fd"/><text x="1498" y="156" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="182" class="node-label">LLM providers</text><text x="1498" y="208" class="node-detail">Hosted and local inference</text></g><g data-component-id="productivity-services"><title>Productivity services</title><rect x="1480" y="275" width="365" height="105" rx="12" fill="#ffffff" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="275" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="301" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="327" class="node-label">Productivity services</text><text x="1498" y="353" class="node-detail">Mail, calendar, docs and CRM</text></g><g data-component-id="messaging-channels"><title>Messaging channels</title><rect x="1480" y="420" width="365" height="105" rx="12" fill="#ffffff" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="420" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="446" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="472" class="node-label">Messaging channels</text><text x="1498" y="498" class="node-detail">Chat and social platforms</text></g><g data-component-id="connected-devices"><title>Connected devices</title><rect x="1480" y="565" width="365" height="105" rx="12" fill="#ffffff" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="565" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="591" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="617" class="node-label">Connected devices</text><text x="1498" y="643" class="node-detail">Android and device services</text></g><g data-component-id="developer-services"><title>Developer services</title><rect x="1480" y="710" width="365" height="105" rx="12" fill="#ffffff" stroke="#8be9fd" stroke-width="2"/><rect x="1480" y="710" width="365" height="7" rx="4" fill="#8be9fd"/><text x="1498" y="736" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="762" class="node-label">Developer services</text><text x="1498" y="788" class="node-detail">Code, CLI and MCP tools</text></g><g data-component-id="search-vector-stores"><title>Search and vector stores</title><rect x="1480" y="855" width="365" height="110" rx="12" fill="#ffffff" stroke="#ff79c6" stroke-width="2"/><rect x="1480" y="855" width="365" height="7" rx="4" fill="#ff79c6"/><text x="1498" y="881" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="907" class="node-label">Search and</text><text x="1498" y="929" class="node-label">vector stores</text><text x="1498" y="955" class="node-detail">Retrieval and knowledge indexes</text></g><g data-callout-id="system-purpose"><rect x="615" y="700" width="540" height="135" rx="10" fill="#ffffff" stroke="#f1fa8c" stroke-width="2" stroke-dasharray="7 6"/><text x="631" y="730" class="callout-title">System responsibility</text><text x="631" y="756" class="callout-text">Compose external capabilities as directed graphs.</text><text x="631" y="778" class="callout-text">Keep execution, credentials and observability</text><text x="631" y="800" class="callout-text">inside one user-scoped workspace.</text></g>+<g data-group-id="opencompany-boundary"><rect x="420" y="145" width="930" height="800" rx="18" fill="#fafbfc" stroke="#bd93f9" stroke-width="2"/><text x="440" y="177" class="group-label">OPENCOMPANY SYSTEM BOUNDARY</text></g><g data-relationship-id="r-authors-design"><title>Design and run automations · via Browser UI / CLI</title><path d="M 340 327.5 L 510 327 L 510 445 L 665 487.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="389.2" y="341.0" width="221.6" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="500" y="362" class="edge-label" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">Design and run automations</text><text x="500" y="382" class="edge-protocol" text-anchor="middle">via Browser UI / CLI</text></g><g data-relationship-id="r-operators-control"><title>Control deployed workflows · via Browser UI / WebSocket</title><path d="M 340 702.5 L 535 702 L 535 535 L 665 487.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="394.2" y="641.0" width="221.6" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="505" y="662" class="edge-label" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">Control deployed workflows</text><text x="505" y="682" class="edge-protocol" text-anchor="middle" textLength="203.6" lengthAdjust="spacingAndGlyphs">via Browser UI / WebSocket</text></g><g data-relationship-id="r-opencompany-llm"><title>Requests inference · via Provider SDK / HTTPS</title><path d="M 1105 487.5 L 1210 487 L 1210 182 L 1480 182.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1221.8" y="158.0" width="206.39999999999998" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1325" y="179" class="edge-label" text-anchor="middle">Requests inference</text><text x="1325" y="199" class="edge-protocol" text-anchor="middle" textLength="188.4" lengthAdjust="spacingAndGlyphs">via Provider SDK / HTTPS</text></g><g data-relationship-id="r-opencompany-productivity"><title>Reads and updates work · via OAuth / HTTPS</title><path d="M 1105 487.5 L 1240 487 L 1240 327 L 1480 327.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1254.4" y="303.0" width="191.2" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1350" y="324" class="edge-label" text-anchor="middle" textLength="173.2" lengthAdjust="spacingAndGlyphs">Reads and updates work</text><text x="1350" y="344" class="edge-protocol" text-anchor="middle">via OAuth / HTTPS</text></g><g data-relationship-id="r-opencompany-messaging"><title>Sends and receives messages · via Webhooks / RPC</title><path d="M 1105 487.5 L 1270 487 L 1270 472 L 1480 472.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><path d="M 1365.0 472.0 L 1275 472" fill="none" stroke="#4b5563" stroke-width="1" stroke-dasharray="3 4" opacity=".7"/><rect x="1160.4" y="448.0" width="229.2" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1275" y="469" class="edge-label" text-anchor="middle" textLength="211.2" lengthAdjust="spacingAndGlyphs">Sends and receives messages</text><text x="1275" y="489" class="edge-protocol" text-anchor="middle">via Webhooks / RPC</text></g><g data-relationship-id="r-opencompany-devices"><title>Invokes device actions · via RPC / platform APIs</title><path d="M 1105 487.5 L 1270 487 L 1270 617 L 1480 617.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1260.6" y="593.0" width="198.79999999999998" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1360" y="614" class="edge-label" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">Invokes device actions</text><text x="1360" y="634" class="edge-protocol" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">via RPC / platform APIs</text></g><g data-relationship-id="r-opencompany-developer"><title>Uses code and dev tools · via MCP / CLI / HTTPS</title><path d="M 1105 487.5 L 1240 487 L 1240 762 L 1480 762.5" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1250.6" y="738.0" width="198.79999999999998" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1350" y="759" class="edge-label" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">Uses code and dev tools</text><text x="1350" y="779" class="edge-protocol" text-anchor="middle" textLength="180.8" lengthAdjust="spacingAndGlyphs">via MCP / CLI / HTTPS</text></g><g data-relationship-id="r-opencompany-search"><title>Indexes and retrieves knowledge · via HTTPS / vector API</title><path d="M 1105 487.5 L 1210 487 L 1210 910 L 1480 910.0" fill="none" stroke="#374151" stroke-width="2" marker-end="url(#arrow)"/><rect x="1210.2" y="886.0" width="259.6" height="48" rx="7" fill="#ffffff" stroke="#d1d5db"/><text x="1340" y="907" class="edge-label" text-anchor="middle" textLength="241.6" lengthAdjust="spacingAndGlyphs">Indexes and retrieves knowledge</text><text x="1340" y="927" class="edge-protocol" text-anchor="middle">via HTTPS / vector API</text></g><g data-component-id="workflow-authors"><title>Workflow authors</title><rect x="55" y="265" width="285" height="125" rx="12" fill="#ffffff" stroke="#f1fa8c" stroke-width="2"/><rect x="55" y="265" width="285" height="7" rx="4" fill="#f1fa8c"/><text x="73" y="291" class="type-label">PERSON</text><text x="73" y="317" class="node-label">Workflow authors</text><text x="73" y="343" class="node-detail">Build and test automations</text></g><g data-component-id="workflow-operators"><title>Workflow operators</title><rect x="55" y="640" width="285" height="125" rx="12" fill="#ffffff" stroke="#f1fa8c" stroke-width="2"/><rect x="55" y="640" width="285" height="7" rx="4" fill="#f1fa8c"/><text x="73" y="666" class="type-label">PERSON</text><text x="73" y="692" class="node-label">Workflow operators</text><text x="73" y="718" class="node-detail">Deploy and supervise runs</text></g><g data-component-id="opencompany"><title>OpenCompany</title><rect x="665" y="385" width="440" height="205" rx="12" fill="#ffffff" stroke="#bd93f9" stroke-width="2"/><rect x="665" y="385" width="440" height="7" rx="4" fill="#bd93f9"/><text x="683" y="411" class="type-label">SOFTWARE SYSTEM</text><text x="683" y="437" class="node-label">OpenCompany</text><text x="683" y="463" class="node-detail">Visual workflow workspace</text><text x="683" y="483" class="node-detail">Agents, tools, triggers and durable runs</text></g><g data-component-id="llm-providers"><title>LLM providers</title><rect x="1480" y="130" width="365" height="105" rx="12" fill="#ffffff" stroke="#8be9fd" stroke-width="2"/><rect x="1480" y="130" width="365" height="7" rx="4" fill="#8be9fd"/><text x="1498" y="156" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="182" class="node-label">LLM providers</text><text x="1498" y="208" class="node-detail">Hosted and local inference - text + image input</text></g><g data-component-id="productivity-services"><title>Productivity services</title><rect x="1480" y="275" width="365" height="105" rx="12" fill="#ffffff" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="275" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="301" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="327" class="node-label">Productivity services</text><text x="1498" y="353" class="node-detail">Mail, calendar, docs and CRM</text></g><g data-component-id="messaging-channels"><title>Messaging channels</title><rect x="1480" y="420" width="365" height="105" rx="12" fill="#ffffff" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="420" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="446" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="472" class="node-label">Messaging channels</text><text x="1498" y="498" class="node-detail">Chat and social platforms</text></g><g data-component-id="connected-devices"><title>Connected devices</title><rect x="1480" y="565" width="365" height="105" rx="12" fill="#ffffff" stroke="#50fa7b" stroke-width="2"/><rect x="1480" y="565" width="365" height="7" rx="4" fill="#50fa7b"/><text x="1498" y="591" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="617" class="node-label">Connected devices</text><text x="1498" y="643" class="node-detail">Android and device services</text></g><g data-component-id="developer-services"><title>Developer services</title><rect x="1480" y="710" width="365" height="105" rx="12" fill="#ffffff" stroke="#8be9fd" stroke-width="2"/><rect x="1480" y="710" width="365" height="7" rx="4" fill="#8be9fd"/><text x="1498" y="736" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="762" class="node-label">Developer services</text><text x="1498" y="788" class="node-detail">Code, CLI and MCP tools</text></g><g data-component-id="search-vector-stores"><title>Search and vector stores</title><rect x="1480" y="855" width="365" height="110" rx="12" fill="#ffffff" stroke="#ff79c6" stroke-width="2"/><rect x="1480" y="855" width="365" height="7" rx="4" fill="#ff79c6"/><text x="1498" y="881" class="type-label">EXTERNAL SYSTEM</text><text x="1498" y="907" class="node-label">Search and</text><text x="1498" y="929" class="node-label">vector stores</text><text x="1498" y="955" class="node-detail">Retrieval and knowledge indexes</text></g><g data-callout-id="system-purpose"><rect x="615" y="700" width="540" height="135" rx="10" fill="#ffffff" stroke="#f1fa8c" stroke-width="2" stroke-dasharray="7 6"/><text x="631" y="730" class="callout-title">System responsibility</text><text x="631" y="756" class="callout-text">Compose external capabilities as directed graphs.</text><text x="631" y="778" class="callout-text">Keep execution, credentials and observability</text><text x="631" y="800" class="callout-text">inside one user-scoped workspace.</text></g><g aria-label="Legend"><circle cx="72" cy="1038" r="7" fill="#bd93f9"/><text x="86" y="1044" class="legend">Agents / system</text><circle cx="317" cy="1038" r="7" fill="#8be9fd"/><text x="331" y="1044" class="legend">Models / interfaces</text><circle cx="562" cy="1038" r="7" fill="#50fa7b"/><text x="576" y="1044" class="legend">Tools / results</text><circle cx="807" cy="1038" r="7" fill="#ff79c6"/><text x="821" y="1044" class="legend">Triggers / events</text><circle cx="1052" cy="1038" r="7" fill="#ffb86c"/><text x="1066" y="1044" class="legend">Workflow / runtime</text><circle cx="1297" cy="1038" r="7" fill="#f1fa8c"/><text x="1311" y="1044" class="legend">Security note</text></g></svg>diff --git a/server/config/model_registry.json b/server/config/model_registry.jsonindex 0e0a0a94..4b9f2bae 100644--- a/server/config/model_registry.json+++ b/server/config/model_registry.json@@ -1,8 +1,161 @@{- "_generated": "2026-08-10T11:26:16.723945+00:00",+ "_generated": "2026-08-11T16:59:26.837006+00:00","_source": "openrouter",- "_model_count": 401,+ "_model_count": 405,"models": {+ "nvidia/nemotron-3.5-lightning": {+ "id": "nvidia/nemotron-3.5-lightning",+ "name": "NVIDIA: Nemotron 3.5 Lightning",+ "provider": "nvidia",+ "local_id": "nemotron-3.5-lightning",+ "context_length": 262144,+ "max_output_tokens": 262144,+ "input_price_per_mtok": 0.1,+ "output_price_per_mtok": 0.25,+ "supports_thinking": false,+ "thinking_type": "none",+ "temperature_range": [+ 0.0,+ 2.0+ ],+ "is_reasoning_model": false,+ "supported_parameters": [+ "frequency_penalty",+ "include_reasoning",+ "logprobs",+ "max_tokens",+ "presence_penalty",+ "reasoning",+ "repetition_penalty",+ "response_format",+ "seed",+ "stop",+ "structured_outputs",+ "temperature",+ "top_k",+ "top_logprobs",+ "top_p"+ ]+ },+ "nvidia/nemotron-3.5-lightning:free": {+ "id": "nvidia/nemotron-3.5-lightning:free",+ "name": "NVIDIA: Nemotron 3.5 Lightning (free)",+ "provider": "nvidia",+ "local_id": "nemotron-3.5-lightning:free",+ "context_length": 1000000,+ "max_output_tokens": 65536,+ "input_price_per_mtok": 0.0,+ "output_price_per_mtok": 0.0,+ "supports_thinking": false,+ "thinking_type": "none",+ "temperature_range": [+ 0.0,+ 2.0+ ],+ "is_reasoning_model": false,+ "supported_parameters": [+ "include_reasoning",+ "max_tokens",+ "reasoning",+ "seed",+ "temperature",+ "tool_choice",+ "tools",+ "top_p"+ ]+ },+ "sakana/sakana-namazu": {+ "id": "sakana/sakana-namazu",+ "name": "Sakana: Sakana Namazu",+ "provider": "sakana",+ "local_id": "sakana-namazu",+ "context_length": 262144,+ "max_output_tokens": 65536,+ "input_price_per_mtok": 0.95,+ "output_price_per_mtok": 4.0,+ "supports_thinking": false,+ "thinking_type": "none",+ "temperature_range": [+ 0.0,+ 2.0+ ],+ "is_reasoning_model": false,+ "supported_parameters": [+ "include_reasoning",+ "reasoning",+ "reasoning_effort",+ "structured_outputs",+ "tool_choice",+ "tools",+ "web_search_options"+ ]+ },+ "upstage/solar-pro4": {+ "id": "upstage/solar-pro4",+ "name": "Upstage: Solar Pro 4",+ "provider": "upstage",+ "local_id": "solar-pro4",+ "context_length": 524288,+ "max_output_tokens": 131072,+ "input_price_per_mtok": 0.03,+ "output_price_per_mtok": 0.12,+ "supports_thinking": false,+ "thinking_type": "none",+ "temperature_range": [+ 0.0,+ 2.0+ ],+ "is_reasoning_model": false,+ "supported_parameters": [+ "frequency_penalty",+ "include_reasoning",+ "max_tokens",+ "presence_penalty",+ "reasoning",+ "response_format",+ "structured_outputs",+ "temperature",+ "tool_choice",+ "tools",+ "top_p"+ ]+ },+ "meta/muse-glimmer-30b": {+ "id": "meta/muse-glimmer-30b",+ "name": "Meta: Muse Glimmer 30B",+ "provider": "meta",+ "local_id": "muse-glimmer-30b",+ "context_length": 131072,+ "max_output_tokens": 0,+ "input_price_per_mtok": 0.35,+ "output_price_per_mtok": 1.5,+ "supports_thinking": false,+ "thinking_type": "none",+ "temperature_range": [+ 0.0,+ 2.0+ ],+ "is_reasoning_model": false,+ "supported_parameters": [+ "frequency_penalty",+ "include_reasoning",+ "logit_bias",+ "max_tokens",+ "min_p",+ "presence_penalty",+ "reasoning",+ "reasoning_effort",+ "repetition_penalty",+ "response_format",+ "stop",+ "structured_outputs",+ "temperature",+ "tool_choice",+ "tools",+ "top_k",+ "top_p"+ ]+ },"inclusionai/ling-3.0-tiny:free": {"id": "inclusionai/ling-3.0-tiny:free","name": "inclusionAI: Ling 3.0 Tiny (free)",@@ -110,9 +263,9 @@"provider": "deepseek","local_id": "deepseek-v4-flash-latest","context_length": 1048576,- "max_output_tokens": 0,- "input_price_per_mtok": 0.08,- "output_price_per_mtok": 0.252,+ "max_output_tokens": 262144,+ "input_price_per_mtok": 0.072,+ "output_price_per_mtok": 0.144,"supports_thinking": false,"thinking_type": "none","temperature_range": [@@ -127,6 +280,7 @@"logprobs","max_tokens","min_p",+ "parallel_tool_calls","presence_penalty","reasoning","reasoning_effort",@@ -167,6 +321,7 @@"logprobs","max_tokens","min_p",+ "parallel_tool_calls","presence_penalty","reasoning","reasoning_effort",@@ -184,6 +339,37 @@"top_p"]},+ "bytedance-seed/seed-2.0-code": {+ "id": "bytedance-seed/seed-2.0-code",+ "name": "ByteDance Seed: Seed-2.0-Code",+ "provider": "bytedance-seed",+ "local_id": "seed-2.0-code",+ "context_length": 262144,+ "max_output_tokens": 131072,+ "input_price_per_mtok": 0.5,+ "output_price_per_mtok": 3.0,+ "supports_thinking": false,+ "thinking_type": "none",+ "temperature_range": [+ 0.0,+ 2.0+ ],+ "is_reasoning_model": false,+ "supported_parameters": [+ "frequency_penalty",+ "include_reasoning",+ "max_tokens",+ "reasoning",+ "reasoning_effort",+ "response_format",+ "stop",+ "structured_outputs",+ "temperature",+ "tool_choice",+ "tools",+ "top_p"+ ]+ },"thinkingmachines/inkling-small": {"id": "thinkingmachines/inkling-small","name": "Thinking Machines: Inkling Small",@@ -1618,9 +1804,9 @@"provider": "z-ai","local_id": "glm-5.2","context_length": 1048576,- "max_output_tokens": 262144,- "input_price_per_mtok": 0.76,- "output_price_per_mtok": 2.42,+ "max_output_tokens": 131072,+ "input_price_per_mtok": 0.4886,+ "output_price_per_mtok": 1.5356,"supports_thinking": false,"thinking_type": "none","temperature_range": [@@ -3219,9 +3405,9 @@"provider": "deepseek","local_id": "deepseek-v4-pro","context_length": 1048576,- "max_output_tokens": 384000,- "input_price_per_mtok": 0.435,- "output_price_per_mtok": 0.87,+ "max_output_tokens": 393216,+ "input_price_per_mtok": 0.6317,+ "output_price_per_mtok": 1.2634,"supports_thinking": false,"thinking_type": "none","temperature_range": [@@ -3552,8 +3738,8 @@"local_id": "kimi-k2.6","context_length": 262144,"max_output_tokens": 262144,- "input_price_per_mtok": 0.95,- "output_price_per_mtok": 4.0,+ "input_price_per_mtok": 0.5795,+ "output_price_per_mtok": 2.44,"supports_thinking": false,"thinking_type": "none","temperature_range": [@@ -3650,8 +3836,8 @@"local_id": "glm-5.1","context_length": 204800,"max_output_tokens": 131072,- "input_price_per_mtok": 1.4,- "output_price_per_mtok": 4.4,+ "input_price_per_mtok": 0.952,+ "output_price_per_mtok": 2.992,"supports_thinking": false,"thinking_type": "none","temperature_range": [@@ -4594,31 +4780,6 @@"tools"]},- "openai/gpt-5.3-chat": {- "id": "openai/gpt-5.3-chat",- "name": "OpenAI: GPT-5.3 Chat",- "provider": "openai",- "local_id": "gpt-5.3-chat",- "context_length": 128000,- "max_output_tokens": 16384,- "input_price_per_mtok": 1.75,- "output_price_per_mtok": 14.0,- "supports_thinking": true,- "thinking_type": "effort",- "temperature_range": [- 0.0,- 2.0- ],- "is_reasoning_model": false,- "supported_parameters": [- "max_tokens",- "response_format",- "seed",- "structured_outputs",- "tool_choice",- "tools"- ]- },"gemini/gemini-3.1-flash-lite-preview": {"id": "google/gemini-3.1-flash-lite-preview","name": "Google: Gemini 3.1 Flash Lite Preview",@@ -5108,9 +5269,9 @@"provider": "qwen","local_id": "qwen3.5-397b-a17b","context_length": 262144,- "max_output_tokens": 65536,- "input_price_per_mtok": 0.39,- "output_price_per_mtok": 2.34,+ "max_output_tokens": 262144,+ "input_price_per_mtok": 0.5,+ "output_price_per_mtok": 3.6,"supports_thinking": false,"thinking_type": "none","temperature_range": [@@ -5927,7 +6088,7 @@"provider": "openai","local_id": "gpt-5.2-chat","context_length": 128000,- "max_output_tokens": 16384,+ "max_output_tokens": 32000,"input_price_per_mtok": 1.75,"output_price_per_mtok": 14.0,"supports_thinking": true,@@ -5939,7 +6100,6 @@"is_reasoning_model": false,"supported_parameters": ["max_completion_tokens",- "max_tokens","response_format","seed","structured_outputs",@@ -7677,7 +7837,7 @@"provider": "qwen","local_id": "qwen3-next-80b-a3b-thinking","context_length": 262144,- "max_output_tokens": 32768,+ "max_output_tokens": 262144,"input_price_per_mtok": 0.15,"output_price_per_mtok": 1.2,"supports_thinking": false,@@ -8470,9 +8630,9 @@"provider": "qwen","local_id": "qwen3-coder-30b-a3b-instruct","context_length": 262144,- "max_output_tokens": 32768,+ "max_output_tokens": 262144,"input_price_per_mtok": 0.07,- "output_price_per_mtok": 0.27,+ "output_price_per_mtok": 0.28,"supports_thinking": false,"thinking_type": "none","temperature_range": [@@ -12574,27 +12734,6 @@"top_logprobs","top_p"]- },- "lmstudio/google/gemma-4-12b-qat": {- "id": "lmstudio/google/gemma-4-12b-qat",- "name": "google/gemma-4-12b-qat",- "provider": "lmstudio",- "local_id": "google/gemma-4-12b-qat",- "context_length": 205207,- "max_output_tokens": 4096,- "input_price_per_mtok": 0.0,- "output_price_per_mtok": 0.0,- "supports_thinking": false,- "thinking_type": "none",- "temperature_range": [- 0.0,- 2.0- ],- "is_reasoning_model": false,- "supported_parameters": [- "tools",- "vision"- ]}}}\ No newline at end of file