Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
TypeScript agentic-aiagentsaiai-agentsaiagentsdeveloper-toolsfunction-callinggpt-4javascriptjsllmllmopsmcppythonremote-mcp-serverssetypescript
docs(sessions): explain experimental fast mode
Tridhatri Vallamkonduba49066bce12
diff --git a/docs/content/docs/configuring-sessions.mdx b/docs/content/docs/configuring-sessions.mdxindex 88b285145..512412375 100644--- a/docs/content/docs/configuring-sessions.mdx+++ b/docs/content/docs/configuring-sessions.mdx@@ -26,6 +26,51 @@ By default, a session has access to every toolkit in the Composio catalog. YourYou can also attach local custom tools and custom toolkits that run in-process alongside Composio tools. See [Custom tools and toolkits](/docs/extending-sessions/custom-tools-and-toolkits).+## Fast mode (experimental)++Fast mode reduces search latency by skipping the LLM reranker and plan search. To enable it, set `experimental.fast_mode` to `true` in the session creation request:++```bash+curl --request POST \+ --url https://backend.composio.dev/api/v3/tool_router/session \+ --header "x-api-key: $COMPOSIO_API_KEY" \+ --header 'Content-Type: application/json' \+ --data '{+ "user_id": "user_123",+ "experimental": {+ "fast_mode": true+ }+ }'+```++Set `COMPOSIO_API_KEY` to your project API key before running this request. The flag applies to searches in that session, including `COMPOSIO_SEARCH_TOOLS` and the session search API. Omit it when creating a session to use the default search behavior.++<Callout type="warn" title="Experimental">+Fast mode returns embedding and keyword search results without LLM reranking. It also omits plan-derived guidance, including `recommended_plan_steps`, `known_pitfalls`, and `reference_workbench_snippets`. This can reduce retrieval quality, especially for requests that need multiple tools or steps. Evaluate it against your own queries before enabling it. Experimental behavior may change.+</Callout>++### Enable fast mode on an existing session++You can also update a session created through the API or an SDK. Replace `SESSION_ID` with that session's ID and use a project API key from the same project:++```bash+curl --request PATCH \+ --url "https://backend.composio.dev/api/v3/tool_router/session/$SESSION_ID" \+ --header "x-api-key: $COMPOSIO_API_KEY" \+ --header 'Content-Type: application/json' \+ --data '{+ "experimental": {+ "fast_mode": true+ }+ }'+```++To turn fast mode off, send the same PATCH request with `"fast_mode": false`. Omitting the field from a PATCH request leaves its current value unchanged.++<Callout type="info">+The high-level TypeScript `composio.create()` and Python `composio.sessions.create()` helpers don't currently forward `fast_mode`. Use the API requests above to configure it, even if you use an SDK for the rest of your session workflow.+</Callout>+## Enabling toolkitsTo limit a session to specific toolkits, pass an array of toolkit slugs. The agent can only discover and use tools from these toolkits.