Skip to content

Open-source AI browser agent for Chrome and Firefox (monorepo) 🧠

Add OpenRouter and Comfy media providers

Emre Sokullu32425adc47d8
diff --git a/docs/providers-and-models.md b/docs/providers-and-models.md
index 3cd671200..1d16feec8 100644
--- a/docs/providers-and-models.md
+++ b/docs/providers-and-models.md
@@ -6,7 +6,7 @@
**Settings → Providers** selects the main model for conversation, planning and
final replies. **Settings → Assistive Models** groups Vision (including screenshot
-limits and redaction), Speech to text, Generative media (fal.ai, powering the
+limits and redaction), Speech to text, Generative Media (powering the
`generate_image` agent tool), Jev (TypeSafe), and SafeSocial. Configuring an assistive
model does not replace the active provider. Jev is outside the dynamic provider
list; its verification, fast-classification and experimental browser switches
@@ -14,19 +14,50 @@ are independent opt-ins. See [the settings guide](https://webbrain.one/docs/sett
and [data flow](privacy-and-data-flow.md#optional-jev-typesafe-scheduled-task-verification)
for setup and disclosure details. Existing `#multimodal` settings links still work.
-### Generative media (fal.ai)
-
-The `generate_image` agent tool submits a text prompt to fal.ai's queue API
-(`agent/fal-media.js`) and returns the hosted media URL. Configure the API key
-and model under **Settings → Assistive Models → Generative media (fal.ai)**.
-The settings card offers **Test Connection** (a cheap auth probe that never
-generates media) and per-card **Save / Clear** controls. The tool is a full-tier
-Act-mode tool: it is **not** offered in Ask mode or on the compact/mid normal
-tool surface, so use a Full-tier provider in Act mode to exercise it.
-
-The Act system prompt and the planner tool catalog tell the model to call
-`generate_image` whenever the user asks to generate media, rather than
-navigating to third-party image sites.
+### Generative Media
+
+Configure **Settings → Assistive Models → Generative Media** for the
+`generate_image` agent tool. Select one provider and save its settings:
+
+| Provider | Required settings | Generation |
+| --- | --- | --- |
+| fal.ai | API key, model ID (for example `fal-ai/flux/schnell`) | fal.ai queue API; existing saved fal.ai settings remain compatible |
+| OpenRouter | API key, image model ID | [Dedicated Image API](https://openrouter.ai/docs/guides/overview/multimodal/image-generation); inline images appear in chat with a save link |
+| Comfy Router | Comfy API key, `provider/model` ID (for example `bfl/flux-2-pro`) | [Queued requests](https://docs.comfy.org/development/comfy-router/queued-delivery); hosted or inline media |
+| ComfyUI (localhost) | Local server URL (default `http://127.0.0.1:8188`), workflow JSON in API format | Local `/prompt`, `/history/{prompt_id}`, and `/view` endpoints; no API key |
+
+For Comfy Router models with native inputs other than `prompt`, paste their input
+JSON in **Model input JSON** and place `{{prompt}}` in the text field(s). Other
+values, such as duration or resolution, are preserved. Without a placeholder,
+WebBrain supplies the tool prompt as `prompt`. Refer to the model's
+[input schema](https://docs.comfy.org/development/comfy-router/schemas).
+
+For local ComfyUI, start the server, export a working workflow **in API format**,
+and replace its positive prompt text with `{{prompt}}`. Keep the model names,
+connections, and other inputs from the working export. Include a Save Image or
+other media output node. Only loopback URLs (`localhost`, `127.0.0.1`, or `[::1]`)
+are accepted. A connection test checks the server, not workflow execution.
+
+**Test Connection** makes only free, read-only authentication/model/server probes;
+it does not generate media. OpenRouter also checks that the selected model appears
+in the image generation catalog. **Save / Clear** apply to the selected media
+configuration. Unsaved drafts survive provider switches while settings remain open;
+only the saved selection is used by the agent.
+
+The tool is a full-tier Act-mode tool and is unavailable in Ask mode or on the
+compact/mid tool surface. Permission checks use the selected provider's host.
+Cloud keys are sent only to fixed API origins, and authenticated requests reject
+redirects. Generations have a ten-minute client deadline. Stop cancels queued
+fal.ai/Comfy Router jobs when possible; local Stop deletes only this prompt from
+the queue. A local workflow that has already started can continue, and Comfy Router
+can charge for a partner generation already in flight. Inline media is limited to
+20 MB; choose hosted output for larger files. Inline outputs are stored locally
+as media assets, so their previews and save links survive panel reopening without
+putting base64 bytes in the run journal or model context.
+
+The Act system prompt and planner direct the model to call `generate_image` when
+the user asks to generate media. Provider results are treated as untrusted content.
+Inline bytes are shown in chat and excluded from model context.
### SafeSocial image classifier (experimental)
diff --git a/package.json b/package.json
index 5883b71f2..e4429a2c1 100644
--- a/package.json
+++ b/package.json
@@ -5,7 +5,7 @@
"private": true,
"type": "module",
"scripts": {
- "test": "npm run test:cms && npm run test:markdown && npm run test:systemone && npm run test:systemone:fast && node --test test/browser-dialogs.mjs test/capsolver-cloud-broker.mjs test/captcha-providers.mjs test/captcha-weighted-fallback.mjs test/captcha-hcaptcha-providers.mjs test/captcha-native-providers.mjs test/captcha-runtime-policy.mjs test/captcha-callback-bridge.mjs test/captcha-aws-recovery.mjs test/captcha-documented-contracts.mjs test/huggingface-signup-recovery.mjs test/trace-full-export.mjs && npm run test:firefox-bidi && npm run test:runtime-lifecycle && npm run test:billing-notice && npm run test:compass-quota && npm run test:provider-limits && npm run test:provider-catalog && npm run test:openrouter-capabilities && npm run test:accessibility-tree-benchmark && npm run test:toolbar-guard && npm run test:cloud-bridge-approval && npm run test:discord && npm run test:pdf-read && npm run test:pdf-selection && npm run test:social-contract && npm run test:safesocial && npm run test:build-unpacked && npm run test:attachment-drop && npm run test:workflow-editor && node --test test/profile-sync-stats.mjs && node --test test/memcode-recall.mjs && node test/run.js && node test/selection-scope-restoration.mjs && node scripts/benchmark-offline-relevance.mjs && npm run test:security",
+ "test": "npm run test:cms && npm run test:markdown && npm run test:generative-media && npm run test:systemone && npm run test:systemone:fast && node --test test/browser-dialogs.mjs test/capsolver-cloud-broker.mjs test/captcha-providers.mjs test/captcha-weighted-fallback.mjs test/captcha-hcaptcha-providers.mjs test/captcha-native-providers.mjs test/captcha-runtime-policy.mjs test/captcha-callback-bridge.mjs test/captcha-aws-recovery.mjs test/captcha-documented-contracts.mjs test/huggingface-signup-recovery.mjs test/trace-full-export.mjs && npm run test:firefox-bidi && npm run test:runtime-lifecycle && npm run test:billing-notice && npm run test:compass-quota && npm run test:provider-limits && npm run test:provider-catalog && npm run test:openrouter-capabilities && npm run test:accessibility-tree-benchmark && npm run test:toolbar-guard && npm run test:cloud-bridge-approval && npm run test:discord && npm run test:pdf-read && npm run test:pdf-selection && npm run test:social-contract && npm run test:safesocial && npm run test:build-unpacked && npm run test:attachment-drop && npm run test:workflow-editor && node --test test/profile-sync-stats.mjs && node --test test/memcode-recall.mjs && node test/run.js && node test/selection-scope-restoration.mjs && node scripts/benchmark-offline-relevance.mjs && npm run test:security",
"test:captcha:ui": "node test/captcha-settings-ui.mjs && node test/captcha-application-ui.mjs",
"test:captcha:bridge:ui": "node test/captcha-callback-bridge-ui.mjs",
"test:billing-notice": "node test/billing-payment-notice.mjs",
@@ -68,7 +68,9 @@
"test:cms": "node --test test/cms-api-first.mjs",
"test:cms:browser": "node --test test/cms-browser-smoke.mjs",
"test:compass-quota": "node --test test/compass-quota.mjs",
- "test:compass-quota:ui": "node test/compass-quota-ui.mjs"
+ "test:compass-quota:ui": "node test/compass-quota-ui.mjs",
+ "test:generative-media": "node --test test/generative-media.mjs",
+ "test:generative-media:ui": "node test/generative-media-ui.mjs"
},
"devDependencies": {
"playwright": "^1.48.0",
diff --git a/src/chrome/src/agent/agent.js b/src/chrome/src/agent/agent.js
index c7fd6b070..65b4c9a77 100644
--- a/src/chrome/src/agent/agent.js
+++ b/src/chrome/src/agent/agent.js
@@ -128,7 +128,8 @@ import {
visionGenerationOptions,
} from '../providers/provider-compatibility.js';
import { resolveMaxOutputTokens } from '../providers/context-windows.js';
-import { generateImage } from './fal-media.js';
+import { generateImage, readMediaConfig } from './generative-media.js';
+import { mediaPermissionUrl, validateMediaConfig } from './media-config.js';
import { extractFirstJsonObject } from './json-extract.js';
import { repairAssistantDisplayText, sanitizeText as sanitizePlannerText } from './text-sanitize.js';
import { emptyOutputFailureMessage, modelOutputDiagnostics } from './model-output-diagnostics.js';
@@ -12446,6 +12447,19 @@ Rules: no prose intro, no conclusion, no "this screenshot shows...", no layout d
continue;
}
const otpEmailPermissionArgs = otpEmailPreparation.permissionArgs;
+ let imageGenConfig;
+ let imageGenPermissionUrl = '';
+ if (fnName === 'generate_image') {
+ try {
+ imageGenConfig = await readMediaConfig();
+ validateMediaConfig(imageGenConfig);
+ imageGenPermissionUrl = mediaPermissionUrl(imageGenConfig);
+ } catch (error) {
+ const recovery = await recordPreparationFailure(toolIndex, fnName, fnArgs, { success: false, error: error.message });
+ if (recovery) return recovery;
+ continue;
+ }
+ }
const mediaTargetGuard = await this._downloadPublicMediaExplicitUrlGuard(tabId, fnName, fnArgs);
if (mediaTargetGuard) {
@@ -12958,7 +12972,9 @@ Rules: no prose intro, no conclusion, no "this screenshot shows...", no layout d
if (capability === Capability.NETWORK && isNetworkMutation(fnName, fnArgs) && apiMutationsAllowedForRun()) continue;
// Every distinct host the call touches must be granted. Usually one,
// but download_files takes a urls[] array that can span many hosts.
- const gateArgs = fnName === OTP_EMAIL_TOOL_NAME && otpEmailPermissionArgs
+ const gateArgs = fnName === 'generate_image'
+ ? { _generativeMediaUrl: imageGenPermissionUrl }
+ : fnName === OTP_EMAIL_TOOL_NAME && otpEmailPermissionArgs
? otpEmailPermissionArgs
: this._skillPermissionArgsForCapability(skillCallTool, capability, fnArgs);
const hosts = requiredHosts(capability, gateArgs, curUrl, fnName);
@@ -13299,6 +13315,7 @@ Rules: no prose intro, no conclusion, no "this screenshot shows...", no layout d
dispatchBinding: pipelineToolbarPreflight.probe?.dispatchBinding || null,
...messageRecipientExecutionContext,
iframeTargetUnresolved: pipelineToolbarPreflight.iframeTargetUnresolved === true,
+ imageGenConfig,
_contentActionAbortSignal: abortSignal,
_contentActionDispatchState: actionDispatchState,
},
@@ -31998,6 +32015,10 @@ If the user has already named or confirmed this exact recipient, do NOT ask agai
*/
_limitToolResult(result, maxResultChars = STANDARD_TOOL_RESULT_CHARS) {
maxResultChars = Number(maxResultChars) === 16000 ? 16000 : STANDARD_TOOL_RESULT_CHARS;
+ // Inline media is rendered for the user; base64 bytes have no value in model context.
+ if (result?.success && result?.provider && (result.inlineMedia || /^data:(image|video|audio)\//.test(result.url || ''))) {
+ result = { ...result, url: undefined, mediaId: undefined, inlineMedia: true, note: 'Generated media is displayed in the chat with a save link. Tell the user it is ready; do not invent a hosted URL.' };
+ }
const windowSafeResult = isReadPageWindowResult(result)
? fitReadPageWindowResult(result, maxResultChars)
: result;
@@ -36329,7 +36350,7 @@ If the user has already named or confirmed this exact recipient, do NOT ask agai
return await fetchUrl(args.url, args, { tabId, signal: executionContext?._contentActionAbortSignal });
}
if (name === 'generate_image') {
- return await generateImage(args, { signal: executionContext?._contentActionAbortSignal });
+ return await generateImage(args, { signal: executionContext?._contentActionAbortSignal, ...(executionContext?.imageGenConfig ? { config: executionContext.imageGenConfig } : {}) });
}
if (name === 'read_page_source') {
return await readPageSource(args.url, args, { tabId, signal: executionContext?._contentActionAbortSignal });
diff --git a/src/chrome/src/agent/fal-media.js b/src/chrome/src/agent/fal-media.js
index 1994f5812..d90dc5442 100644
--- a/src/chrome/src/agent/fal-media.js
+++ b/src/chrome/src/agent/fal-media.js
@@ -1,6 +1,6 @@
// fal.ai generative media (assistive model).
//
-// Configured in Settings -> Assistive Models -> "Generative media (fal.ai)"
+// Configured in Settings -> Assistive Models -> Generative Media (fal.ai provider).
// and stored in extension storage as `imageGenModel = { apiKey, model }`.
// fal.ai uses a queue API: submit a prompt, poll status_url, then fetch
// response_url. Auth uses `Authorization: Key <FAL_KEY>`.
@@ -20,9 +20,7 @@ export function normalizeFalModelId(model) {
return id;
}
-export function isImageGenConfigured(cfg) {
- return !!(cfg && cfg.apiKey && cfg.model);
-}
+export { isImageGenConfigured } from './media-config.js';
export function falQueueSubmitUrl(model) {
return `${FAL_QUEUE_BASE}/${model}`;
@@ -150,6 +148,7 @@ export async function runFalGeneration({
throwIfAborted(operation.signal);
const submitRes = await fetchImpl(falQueueSubmitUrl(model), {
method: 'POST',
+ redirect: 'error', credentials: 'omit',
headers,
body: JSON.stringify({ prompt: text }),
signal: operation.signal,
@@ -177,7 +176,7 @@ export async function runFalGeneration({
let status = 'IN_QUEUE';
while (true) {
await abortableDelay(FAL_STATUS_POLL_INTERVAL_MS, operation.signal);
- const statusRes = await fetchImpl(statusUrl, { headers, signal: operation.signal });
+ const statusRes = await fetchImpl(statusUrl, { headers, signal: operation.signal, redirect: 'error', credentials: 'omit' });
if (!statusRes.ok) throw new Error(`fal.ai status check failed (HTTP ${statusRes.status}).`);
let statusPayload;
@@ -188,7 +187,7 @@ export async function runFalGeneration({
}
status = String(statusPayload?.status || '').toUpperCase();
if (status === 'COMPLETED') {
- const resultRes = await fetchImpl(responseUrl, { headers, signal: operation.signal });
+ const resultRes = await fetchImpl(responseUrl, { headers, signal: operation.signal, redirect: 'error', credentials: 'omit' });
if (!resultRes.ok) throw new Error(`fal.ai result fetch failed (HTTP ${resultRes.status}).`);
let payload;
@@ -217,54 +216,13 @@ export async function runFalGeneration({
}
}
-/** Agent tool entry point. Reads the assistive-model config from storage. */
+// Legacy entry points retained for callers importing fal-media.js.
export async function generateImage(args, options = {}) {
- const fetchImpl = typeof options === 'function' ? options : (options.fetchImpl || fetch);
- const signal = typeof options === 'object' ? options.signal : null;
- let cfg;
- const api = (typeof browser !== 'undefined' && browser?.storage) ? browser
- : (typeof chrome !== 'undefined' ? chrome : null);
- try {
- const stored = await api.storage.local.get([IMAGE_GEN_MODEL_KEY]);
- cfg = stored?.[IMAGE_GEN_MODEL_KEY];
- } catch (error) {
- return { success: false, error: 'Failed to read generative media config: ' + error.message };
- }
- if (!isImageGenConfigured(cfg)) {
- return { success: false, error: 'Generative media is not configured. Set up fal.ai in Settings -> Assistive Models.' };
- }
- try {
- const result = await runFalGeneration({ prompt: args?.prompt, config: cfg, fetchImpl, signal });
- return { success: true, url: result.url, model: result.model };
- } catch (error) {
- return { success: false, error: error.message };
- }
+ const media = await import('./generative-media.js');
+ return media.generateImage(args, options);
}
-/** Verify a key against a free, read-only endpoint that requires authentication. */
export async function testImageGenProvider(fetchImpl = fetch) {
- let cfg;
- const api = (typeof browser !== 'undefined' && browser?.storage) ? browser
- : (typeof chrome !== 'undefined' ? chrome : null);
- try {
- const stored = await api.storage.local.get([IMAGE_GEN_MODEL_KEY]);
- cfg = stored?.[IMAGE_GEN_MODEL_KEY];
- } catch (error) {
- return { ok: false, error: 'Failed to read generative media config: ' + error.message };
- }
- if (!isImageGenConfigured(cfg)) {
- return { ok: false, error: 'Generative media not configured (API Key and Model are required).' };
- }
- const model = normalizeFalModelId(cfg.model);
- if (!model) return { ok: false, error: 'Invalid fal.ai model id.' };
- try {
- const res = await fetchImpl(FAL_AUTH_PROBE_URL, { headers: await falAuthHeaders(cfg.apiKey) });
- if (res.status === 401 || res.status === 403) {
- return { ok: false, error: 'fal.ai rejected the API key (HTTP ' + res.status + ').' };
- }
- if (res.ok) return { ok: true, model };
- return { ok: false, error: `Unexpected response from fal.ai (HTTP ${res.status}).` };
- } catch (error) {
- return { ok: false, error: error.message };
- }
+ const media = await import('./generative-media.js');
+ return media.testImageGenProvider(fetchImpl);
}
diff --git a/src/chrome/src/agent/generative-media.js b/src/chrome/src/agent/generative-media.js
new file mode 100644
index 000000000..f87a3104a
--- /dev/null
+++ b/src/chrome/src/agent/generative-media.js
@@ -0,0 +1,232 @@
+import { runFalGeneration, FAL_AUTH_PROBE_URL } from './fal-media.js';
+import { storeGeneratedMedia } from '../generated-media-store.js';
+import { IMAGE_GEN_MODEL_KEY, MEDIA_PROVIDERS, mediaProvider, normalizeMediaModel, comfyBaseUrl, parseMediaJson, validateMediaConfig, bindMediaPrompt } from './media-config.js';
+
+const GENERATION_TIMEOUT_MS = 600000;
+const MAX_INLINE_BYTES = 20 * 1024 * 1024;
+const INLINE_MEDIA = /^data:(image\/(?:png|jpeg|webp|gif)|audio\/(?:mpeg|wav|ogg)|video\/mp4);base64,[A-Za-z0-9+/=\s]+$/;
+
+export function safeMediaUrl(value) {
+ if (typeof value !== 'string') return '';
+ if (value.length <= MAX_INLINE_BYTES * 1.4 && INLINE_MEDIA.test(value)) return value;
+ try { const url = new URL(value); return url.protocol === 'https:' && !url.username && !url.password ? url.href : ''; } catch { return ''; }
+}
+
+function base64Media(bytes, mime) {
+ if (!bytes || bytes.length > MAX_INLINE_BYTES * 1.4 || !/^[A-Za-z0-9+/=\s]+$/.test(bytes)) return '';
+ return safeMediaUrl(`data:${mime || 'image/png'};base64,${bytes}`);
+}
+
+// Known media fields only: never mistake an API/status URL for the generated asset.
+export function extractMediaUrl(payload, depth = 0) {
+ if (!payload || typeof payload !== 'object' || depth > 8) return '';
+ if (Array.isArray(payload)) {
+ for (const item of payload) { const url = safeMediaUrl(item) || extractMediaUrl(item, depth + 1); if (url) return url; }
+ return '';
+ }
+ if (payload.b64_json) { const url = base64Media(payload.b64_json, payload.media_type); if (url) return url; }
+ if (payload.inlineData || payload.inline_data) {
+ const data = payload.inlineData || payload.inline_data;
+ const url = base64Media(data.data, data.mimeType || data.mime_type); if (url) return url;
+ }
+ // Native Comfy Router outputs (e.g. Luma) include preview assets too.
+ // Prefer the final video/audio over its image; progress_video is not a result.
+ for (const key of ['video', 'audio', 'image']) {
+ const asset = payload.assets?.[key];
+ const url = safeMediaUrl(asset) || extractMediaUrl(asset, depth + 1); if (url) return url;
+ }
+ for (const key of ['url', 'sample', 'image_url', 'video_url', 'audio_url']) {
+ const url = safeMediaUrl(payload[key]) || extractMediaUrl(payload[key], depth + 1); if (url) return url;
+ }
+ for (const key of ['data', 'result', 'output', 'images', 'image', 'videos', 'video', 'audio', 'candidates', 'content', 'parts']) {
+ const url = safeMediaUrl(payload[key]) || extractMediaUrl(payload[key], depth + 1); if (url) return url;
+ }
+ return '';
+}
+
+function operationSignal(signal, timeoutMs) {
+ const controller = new AbortController();
+ const onAbort = () => controller.abort(signal.reason || new DOMException('Generation cancelled.', 'AbortError'));
+ if (signal?.aborted) onAbort(); else signal?.addEventListener('abort', onAbort, { once: true });
+ const timer = setTimeout(() => controller.abort(new DOMException('Generative media timed out.', 'TimeoutError')), timeoutMs);
+ return { signal: controller.signal, dispose() { clearTimeout(timer); signal?.removeEventListener('abort', onAbort); } };
+}
+
+function delay(ms, signal) {
+ signal.throwIfAborted();
+ return new Promise((resolve, reject) => {
+ const onAbort = () => { clearTimeout(timer); reject(signal.reason); };
+ const timer = setTimeout(() => { signal.removeEventListener('abort', onAbort); resolve(); }, ms);
+ signal.addEventListener('abort', onAbort, { once: true });
+ });
+}
+
+async function jsonResponse(response, label) {
+ if (!response.ok) {
+ let message = '';
+ try { message = (await response.text()).slice(0, 300); } catch { /* no body */ }
+ throw new Error(`${label} failed (HTTP ${response.status})${message ? ': ' + message : '.'}`);
+ }
+ const body = await response.json();
+ if (body?.error || body?.error_type) throw new Error(`${label}: ${body.error?.message || body.error_type || body.error}`);
+ return body;
+}
+
+function pollDelay(response, fallback) {
+ const seconds = Number(response.headers?.get?.('Retry-After'));
+ return Number.isFinite(seconds) && seconds > 0 ? Math.min(seconds * 1000, 60000) : fallback;
+}
+
+async function cancelRequest(url, init, fetchImpl) {
+ if (!url) return;
+ const controller = new AbortController();
+ const timer = setTimeout(() => controller.abort(), 2000);
+ try { await fetchImpl(url, { ...init, signal: controller.signal, redirect: 'error', credentials: 'omit' }); } catch { /* best effort */ }
+ finally { clearTimeout(timer); }
+}
+
+async function mediaResponse(response, label) {
+ const mime = (response.headers?.get?.('Content-Type') || '').split(';')[0].trim();
+ if (response.ok && /^(image\/(?:png|jpeg|webp|gif)|audio\/(?:mpeg|wav|ogg)|video\/mp4)$/.test(mime)) {
+ const bytes = new Uint8Array(await response.arrayBuffer());
+ if (bytes.length > MAX_INLINE_BYTES) throw new Error('Generated media exceeds the 20 MB inline limit. Choose a model that returns hosted media.');
+ let binary = '';
+ for (let offset = 0; offset < bytes.length; offset += 8192) binary += String.fromCharCode(...bytes.subarray(offset, offset + 8192));
+ return `data:${mime};base64,${btoa(binary)}`;
+ }
+ const payload = await jsonResponse(response, label);
+ const url = extractMediaUrl(payload);
+ if (!url) throw new Error(`${label} returned no supported media URL or inline media.`);
+ return url;
+}
+
+export async function runMediaGeneration({ prompt, config, fetchImpl = fetch, signal, timeoutMs = GENERATION_TIMEOUT_MS, pollIntervalMs = 2000 }) {
+ const provider = validateMediaConfig(config);
+ const text = String(prompt || '').trim();
+ if (!text) throw new Error('prompt is required.');
+ if (provider === 'fal') return runFalGeneration({ prompt: text, config, fetchImpl, signal, timeoutMs });
+ const operation = operationSignal(signal, timeoutMs);
+ const model = provider === 'comfyui' ? 'ComfyUI workflow' : normalizeMediaModel(config.model);
+ const request = (url, init = {}) => {
+ operation.signal.throwIfAborted();
+ return fetchImpl(url, { ...init, signal: operation.signal, redirect: 'error', credentials: 'omit' });
+ };
+ let cancelUrl = '', cancelInit;
+ let completed = false;
+ try {
+ if (provider === 'openrouter') {
+ const res = await request('https://openrouter.ai/api/v1/images', {
+ method: 'POST', headers: { Authorization: `Bearer ${config.apiKey}`, 'Content-Type': 'application/json' },
+ body: JSON.stringify({ model, prompt: text }),
+ });
+ return { url: await mediaResponse(res, 'OpenRouter generation'), model };
+ }
+ if (provider === 'comfyrouter') {
+ const base = `https://api.comfy.org/v2/models/${model}/requests`;
+ const headers = { 'X-API-Key': config.apiKey, 'Content-Type': 'application/json' };
+ const parameters = parseMediaJson(config.parameters || '{}', 'Model input');
+ const usesTemplate = JSON.stringify(parameters).includes('{{prompt}}');
+ const body = usesTemplate ? bindMediaPrompt(parameters, text) : { ...parameters, prompt: text };
+ const queued = await jsonResponse(await request(base, {
+ method: 'POST', headers: { ...headers, 'Idempotency-Key': crypto.randomUUID() }, body: JSON.stringify(body),
+ }), 'Comfy Router submit');
+ if (!/^[A-Za-z0-9_-]+$/.test(queued.request_id || '')) throw new Error('Comfy Router returned an invalid request ID.');
+ // Build authenticated URLs ourselves; never send the key to returned URLs.
+ const resultUrl = `${base}/${queued.request_id}`;
+ cancelUrl = `${resultUrl}/cancel`; cancelInit = { method: 'PUT', headers };
+ let waitMs = pollIntervalMs;
+ while (true) {
+ await delay(waitMs, operation.signal);
+ const res = await request(`${resultUrl}/status`, { headers });
+ const status = await jsonResponse(res, 'Comfy Router status');
+ waitMs = pollDelay(res, pollIntervalMs);
+ if (status.status === 'COMPLETED') {
+ const result = await request(resultUrl, { headers });
+ if (result.status === 202) { waitMs = pollDelay(result, pollIntervalMs); continue; }
+ const url = await mediaResponse(result, 'Comfy Router generation');
+ completed = true;
+ return { url, model };
+ }
+ if (!['IN_QUEUE', 'IN_PROGRESS'].includes(status.status)) throw new Error('Comfy Router returned an unknown queue status.');
+ }
+ }
+ const base = comfyBaseUrl(config.baseUrl);
+ const headers = { 'Content-Type': 'application/json' };
+ const workflow = bindMediaPrompt(parseMediaJson(config.workflow, 'ComfyUI workflow'), text);
+ const queued = await jsonResponse(await request(`${base}/prompt`, {
+ method: 'POST', headers, body: JSON.stringify({ prompt: workflow, client_id: crypto.randomUUID() }),
+ }), 'ComfyUI submit');
+ if (!/^[A-Za-z0-9_-]+$/.test(queued.prompt_id || '')) throw new Error('ComfyUI returned an invalid prompt ID.');
+ // Delete this queued prompt only. /interrupt could stop someone else's running workflow.
+ cancelUrl = `${base}/queue`; cancelInit = { method: 'POST', headers, body: JSON.stringify({ delete: [queued.prompt_id] }) };
+ while (true) {
+ await delay(pollIntervalMs, operation.signal);
+ const history = await jsonResponse(await request(`${base}/history/${queued.prompt_id}`), 'ComfyUI history');
+ const item = history[queued.prompt_id];
+ if (!item) continue;
+ if (item.status?.status_str === 'error') throw new Error('ComfyUI workflow failed. Check the workflow, installed nodes, and local models.');
+ for (const output of Object.values(item.outputs || {})) {
+ for (const key of ['images', 'gifs', 'videos', 'audio']) for (const file of output[key] || []) {
+ if (typeof file.filename !== 'string' || !file.filename || file.type === 'temp') continue;
+ const params = new URLSearchParams({ filename: file.filename, subfolder: file.subfolder || '', type: file.type || 'output' });
+ completed = true;
+ return { url: `${base}/view?${params}`, model };
+ }
+ }
+ if (item.status?.completed || item.status?.status_str === 'success') throw new Error('ComfyUI workflow completed without saved media. Add a Save Image or media output node.');
+ }
+ } catch (error) {
+ if (!completed && cancelUrl) await cancelRequest(cancelUrl, cancelInit, fetchImpl);
+ throw operation.signal.aborted ? operation.signal.reason : error;
+ } finally { operation.dispose(); }
+}
+
+export async function readMediaConfig() {
+ const api = typeof browser !== 'undefined' && browser?.storage ? browser : globalThis.chrome;
+ const stored = await api.storage.local.get([IMAGE_GEN_MODEL_KEY]);
+ return stored?.[IMAGE_GEN_MODEL_KEY];
+}
+
+export async function generateImage(args, options = {}) {
+ const fetchImpl = typeof options === 'function' ? options : options.fetchImpl || fetch;
+ try {
+ const config = Object.hasOwn(options, 'config') ? options.config : await readMediaConfig();
+ if (!config) throw new Error('Configure Generative Media in Settings → Assistive Models.');
+ const result = await runMediaGeneration({ prompt: args?.prompt, config, fetchImpl, signal: options.signal });
+ if (result.url.startsWith('data:')) {
+ const asset = await storeGeneratedMedia(result.url);
+ return { success: true, model: result.model, provider: mediaProvider(config), ...asset };
+ }
+ return { success: true, ...result, provider: mediaProvider(config) };
+ } catch (error) { return { success: false, error: error.message }; }
+}
+
+// Free read-only probes. Model metadata confirms availability; no generation is submitted.
+export async function testImageGenProvider(fetchImpl = fetch) {
+ const operation = operationSignal(null, 15000);
+ try {
+ const config = await readMediaConfig();
+ const provider = validateMediaConfig(config);
+ const model = provider === 'comfyui' ? 'ComfyUI workflow' : normalizeMediaModel(config.model);
+ let url, headers;
+ if (provider === 'fal') { url = FAL_AUTH_PROBE_URL; headers = { Authorization: `Key ${config.apiKey}` }; }
+ if (provider === 'openrouter') { url = 'https://openrouter.ai/api/v1/key'; headers = { Authorization: `Bearer ${config.apiKey}` }; }
+ if (provider === 'comfyrouter') { url = `https://api.comfy.org/v2/models/${model}`; headers = { 'X-API-Key': config.apiKey }; }
+ if (provider === 'comfyui') { url = `${comfyBaseUrl(config.baseUrl)}/system_stats`; headers = {}; }
+ const res = await fetchImpl(url, { headers, signal: operation.signal, redirect: 'error', credentials: 'omit' });
+ if (!res.ok) throw new Error(`${MEDIA_PROVIDERS[provider].label} connection failed (HTTP ${res.status}).`);
+ if (provider === 'openrouter') {
+ await jsonResponse(res, 'OpenRouter key');
+ const catalog = await jsonResponse(await fetchImpl('https://openrouter.ai/api/v1/images/models', { headers, signal: operation.signal, redirect: 'error', credentials: 'omit' }), 'OpenRouter image models');
+ if (!catalog.data?.some(item => item.id === model)) throw new Error('The selected OpenRouter model is not in the image generation catalog.');
+ } else if (provider === 'comfyui') {
+ const stats = await jsonResponse(res, 'ComfyUI');
+ if (!stats.system || !Array.isArray(stats.devices)) throw new Error('The endpoint did not return ComfyUI system information.');
+ } else if (provider === 'comfyrouter') {
+ const detail = await jsonResponse(res, 'Comfy Router model');
+ if (detail.id !== model) throw new Error('Comfy Router did not confirm the selected model.');
+ }
+ return { ok: true, model, provider };
+ } catch (error) { return { ok: false, error: error.message }; }
+ finally { operation.dispose(); }
+}
diff --git a/src/chrome/src/agent/media-config.js b/src/chrome/src/agent/media-config.js
new file mode 100644
index 000000000..4b548f2ad
--- /dev/null
+++ b/src/chrome/src/agent/media-config.js
@@ -0,0 +1,82 @@
+// Provider settings are user-authored. Model tool arguments never select a host or key.
+export const IMAGE_GEN_MODEL_KEY = 'imageGenModel';
+export const MEDIA_PROVIDERS = Object.freeze({
+ fal: { label: 'fal.ai', model: 'fal-ai/flux/schnell', keyPlaceholder: 'FAL_KEY', docs: 'https://fal.ai/dashboard/keys' },
+ openrouter: { label: 'OpenRouter', model: 'google/gemini-2.5-flash-image', keyPlaceholder: 'sk-or-…', docs: 'https://openrouter.ai/docs/guides/overview/multimodal/image-generation' },
+ comfyrouter: { label: 'Comfy Router', model: 'bfl/flux-2-pro', keyPlaceholder: 'comfyui-…', docs: 'https://docs.comfy.org/development/comfy-router/quickstart' },
+ comfyui: { label: 'ComfyUI (localhost)', baseUrl: 'http://127.0.0.1:8188', docs: 'https://docs.comfy.org/development/comfyui-server/comms_routes' },
+});
+
+export function mediaProvider(config) {
+ // Previously saved { apiKey, model } settings remain fal.ai settings.
+ return config?.provider == null ? 'fal' : String(config.provider);
+}
+
+export function normalizeMediaModel(value) {
+ const model = String(value || '').trim().replace(/^\/+|\/+$/g, '');
+ return /^[A-Za-z0-9][A-Za-z0-9._\-/]*$/.test(model) && !model.includes('..') ? model : '';
+}
+
+export function comfyBaseUrl(value) {
+ const url = new URL(String(value || MEDIA_PROVIDERS.comfyui.baseUrl).trim());
+ if (!['http:', 'https:'].includes(url.protocol) || url.username || url.password || url.search || url.hash
+ || !['localhost', '127.0.0.1', '[::1]'].includes(url.hostname.toLowerCase())) {
+ throw new Error('ComfyUI URL must use localhost, 127.0.0.1, or [::1], without credentials, query, or fragment.');
+ }
+ return url.href.replace(/\/+$/, '');
+}
+
+export function parseMediaJson(value, label) {
+ let parsed = value;
+ if (typeof value === 'string') {
+ if (value.length > 1024 * 1024) throw new Error(`${label} exceeds 1 MB.`);
+ try { parsed = JSON.parse(value || '{}'); } catch { throw new Error(`${label} must be valid JSON.`); }
+ }
+ if (!parsed || typeof parsed !== 'object' || Array.isArray(parsed)) throw new Error(`${label} must be a JSON object.`);
+ return parsed;
+}
+
+export function validateMediaConfig(config) {
+ const provider = mediaProvider(config);
+ if (!Object.hasOwn(MEDIA_PROVIDERS, provider)) throw new Error('Unknown generative media provider.');
+ if (provider === 'comfyui') {
+ comfyBaseUrl(config?.baseUrl);
+ const workflow = parseMediaJson(config?.workflow, 'ComfyUI workflow');
+ const nodes = Object.values(workflow);
+ if (!nodes.length || nodes.some(node => !node || typeof node.class_type !== 'string'
+ || !node.inputs || typeof node.inputs !== 'object' || Array.isArray(node.inputs))) {
+ throw new Error('Export a ComfyUI workflow in API format (node IDs, class_type, and inputs).');
+ }
+ if (!nodes.some(node => Object.values(node.inputs).some(value => typeof value === 'string' && value.includes('{{prompt}}')))) {
+ throw new Error('Replace the positive prompt text in the ComfyUI workflow with {{prompt}}.');
+ }
+ } else {
+ if (!String(config?.apiKey || '').trim()) throw new Error('API Key is required.');
+ const model = normalizeMediaModel(config?.model);
+ if (!model) throw new Error('A valid model ID is required.');
+ if (provider === 'comfyrouter' && model.split('/').length !== 2) throw new Error('Comfy Router model IDs use provider/model.');
+ if (provider === 'comfyrouter') parseMediaJson(config?.parameters || '{}', 'Model input');
+ }
+ return provider;
+}
+
+export function isImageGenConfigured(config) {
+ try { validateMediaConfig(config); return true; } catch { return false; }
+}
+
+export function mediaPermissionUrl(config) {
+ switch (mediaProvider(config)) {
+ case 'fal': return 'https://queue.fal.run';
+ case 'openrouter': return 'https://openrouter.ai';
+ case 'comfyrouter': return 'https://api.comfy.org';
+ case 'comfyui': return comfyBaseUrl(config?.baseUrl);
+ default: return '';
+ }
+}
+
+export function bindMediaPrompt(value, prompt) {
+ if (typeof value === 'string') return value.replaceAll('{{prompt}}', prompt);
+ if (Array.isArray(value)) return value.map(item => bindMediaPrompt(item, prompt));
+ if (value && typeof value === 'object') return Object.fromEntries(Object.entries(value).map(([key, item]) => [key, bindMediaPrompt(item, prompt)]));
+ return value;
+}
diff --git a/src/chrome/src/agent/permission-gate.js b/src/chrome/src/agent/permission-gate.js
index ecce38c68..88e8f2175 100644
--- a/src/chrome/src/agent/permission-gate.js
+++ b/src/chrome/src/agent/permission-gate.js
@@ -90,7 +90,7 @@ export const UNTRUSTED_CONTENT_TOOLS = new Set([
'execute_webmcp_tool',
'fetch_url',
'research_url',
- // fal.ai returns provider-authored URLs and error text.
+ // Generative media providers return untrusted URLs and error text.
'generate_image',
// ChatGPT's answer and cited links are third-party page content.
'delegate_research',
@@ -430,7 +430,7 @@ const TOOL_CAPABILITY = {
download_social_media: Capability.DOWNLOAD,
schedule_resume: Capability.SCHEDULE,
schedule_task: Capability.SCHEDULE,
- // generate_image spends the user's fal.ai credits via a paid network call.
+ // generate_image submits to the user's configured media provider.
generate_image: Capability.NETWORK,
};
@@ -589,7 +589,7 @@ export function hostForCapability(capability, args, currentUrlOrHost, toolName)
return normalizeHost(args._otpMailboxUrl);
}
if (toolName === 'delegate_research') return 'chatgpt.com';
- if (toolName === 'generate_image') return 'queue.fal.run';
+ if (toolName === 'generate_image') return normalizeHost(args._generativeMediaUrl);
if (toolName === 'execute_webmcp_tool') {
// A tool can belong to a cross-origin frame. Charge mutations to that
// frame's resolved URL instead of borrowing the top-level page grant.
diff --git a/src/chrome/src/agent/planner.js b/src/chrome/src/agent/planner.js
index d159306f6..c6b484655 100644
--- a/src/chrome/src/agent/planner.js
+++ b/src/chrome/src/agent/planner.js
@@ -378,7 +378,7 @@ ${PLANNER_RESPONSE_LANGUAGE_RULES}
read: get_accessibility_tree, read_page, extract_data, fetch_url, research_url
interact: click_ax, set_checked, type_ax, set_field, find_text, press_keys, scroll, navigate, gmail_count_results, carousel_navigate, promote_iframe
wait: wait_for_element, wait_for_stable
- media: generate_image (create an image/video/audio directly from a text prompt via the user's fal.ai generative-media model — use when the user asks to GENERATE media, not to browse an image site)
+ media: generate_image (create an image/video/audio directly from a text prompt via the user's configured generative-media provider — use when the user asks to GENERATE media, not to browse an image site)
memory: scratchpad_write, progress_update, progress_read
schedule: schedule_task (future/recurring work the user explicitly asked for), schedule_resume (pause CURRENT run blocked on external event)
user input: clarify (pause and ask one concise question when a required value remains missing after relevant inspection)
@@ -468,7 +468,7 @@ ${PLANNER_RESPONSE_ONLY_RULES}
- Canonical summary, steps, and risks must be English. localized fields must use the requested wbLocale.
${PLANNER_RESPONSE_LANGUAGE_RULES}
- For execute, keep the compact plan to 1–4 steps. For plan_only, provide 2–8 useful steps. For respond and clarify, steps may be empty.
-- When the user asks to generate an image/video/audio, plan one generate_image step (WebBrain's built-in fal.ai media tool). Do not plan steps to visit image-generation sites or to check whether the current page supports image generation.
+- When the user asks to generate an image/video/audio, plan one generate_image step (WebBrain's built-in media tool). Do not plan steps to visit image-generation sites or to check whether the current page supports image generation.
- clarify pauses execution to ask one concise question for a required value. done is terminal and must never be used to request information needed to continue.
- press_keys supports only unmodified Escape, Tab, Enter, arrow keys, and ; (semicolon, for page shortcuts such as Gmail Expand all). Never plan modifier combinations or browser UI shortcuts; use find_text to select one page-text match instead of Ctrl/Cmd+F. Each call replaces the previous selection and cannot create simultaneous highlights or browser Find UI.
- For Instagram /p/<id>/ carousel enumeration, use strictly increasing carousel_navigate indexes unless the latest user request explicitly asks for reverse traversal, in which case use strictly decreasing indexes; never use arrow keys, coordinate clicks, Previous/Next, or go_back to traverse slides.
diff --git a/src/chrome/src/agent/tools.js b/src/chrome/src/agent/tools.js
index b645403b1..1596a2239 100644
--- a/src/chrome/src/agent/tools.js
+++ b/src/chrome/src/agent/tools.js
@@ -1399,7 +1399,7 @@ export const AGENT_TOOLS = [
type: 'function',
function: {
name: 'generate_image',
- description: 'Generate media (usually an image) from a text prompt using the user\'s configured fal.ai assistive model (Settings → Assistive Models → Generative media). Runs on fal.ai\'s queue API and may take up to a minute. Returns the hosted media URL on success. Not available in Ask mode.',
+ description: 'Generate media (usually an image) from a text prompt using the user\'s configured generative media provider (Settings → Assistive Models → Generative Media). Supports fal.ai, OpenRouter, Comfy Router and local ComfyUI workflows; generation may take several minutes. Returns a media URL or inline media displayed in the chat. Not available in Ask mode.',
parameters: {
type: 'object',
properties: {
@@ -2118,7 +2118,7 @@ ${BROWSER_TAB_LIMITATION}
- scratchpad_write: Pin a note in context that survives summarization (use on long tasks to remember download IDs, file paths, plans)
- progress_update / progress_read: Structured app-owned ledger for the active repeated item/action task. Use it for per-user/per-item status and collected fields; close pending/acted rows before done.
- download_public_media (if enabled by a skill) / download_social_media: One-shot image/video download from public social sites. Prefer the enabled skill tool for public media URLs; otherwise use download_social_media. Single call — no need to inspect the DOM yourself.
-- generate_image: Create media (usually an image, sometimes video/audio) directly from a text prompt through the user's configured fal.ai generative-media model. When the user asks to GENERATE media ("generate an image of a red apple", "make a logo", "create a video clip"), call this tool — do NOT navigate to third-party image sites (Midjourney, DALL·E, Bing Images, etc.). Requires Settings → Assistive Models → Generative media. Not available in Ask mode.
+- generate_image: Create media (usually an image, sometimes video/audio) directly from a text prompt through the user's configured generative-media provider. When the user asks to GENERATE media ("generate an image of a red apple", "make a logo", "create a video clip"), call this tool — do NOT navigate to third-party image sites (Midjourney, DALL·E, Bing Images, etc.). Requires Settings → Assistive Models → Generative Media. Not available in Ask mode.
- Recording is user-driven only. If the user asks to record, do NOT call tools; tell them to type \`/record\` for current-tab recording or \`/record --full-screen\` for screen/window recording; add \`--transcribe\` to either form if they want a Whisper transcript after stop. If they ask to stop a recording, tell them to press Escape twice in WebBrain/browser surfaces or use Chrome's Stop sharing control.
- hover: CDP-trusted hover over a ref_id. Use ONLY for menus/tooltips that REVEAL on hover (GitHub three-dot menus, Linear card actions, nav menus with reveal-on-hover children). Re-read the tree after to find the newly-visible items. Do NOT call hover before every click — most things are clickable directly.
- drag_drop: Drag one ref_id onto another via CDP-trusted pointer events. Use for Trello/Linear/Notion-style card reordering, file-tree node moves, image-crop handles, slider thumbs. Pass \`steps: 15–20\` if the first attempt doesn't trigger the drop indicator on momentum-tracking dnd. Verify by re-reading the tree.
diff --git a/src/chrome/src/generated-media-store.js b/src/chrome/src/generated-media-store.js
new file mode 100644
index 000000000..5d8b27c5b
--- /dev/null
+++ b/src/chrome/src/generated-media-store.js
@@ -0,0 +1,50 @@
+// Keep inline assets outside the bounded run journal and serialized chat HTML.
+const DB_NAME = 'webbrain_generated_media';
+const STORE_NAME = 'assets';
+const MAX_BYTES = 20 * 1024 * 1024;
+const MEDIA_MIME = /^(image\/(?:png|jpeg|webp|gif)|audio\/(?:mpeg|wav|ogg)|video\/mp4)$/;
+
+async function openDB() {
+ return new Promise((resolve, reject) => {
+ const request = indexedDB.open(DB_NAME, 1);
+ request.onupgradeneeded = () => request.result.createObjectStore(STORE_NAME, { keyPath: 'id' });
+ request.onsuccess = () => resolve(request.result);
+ request.onerror = () => reject(request.error);
+ });
+}
+
+export async function storeGeneratedMedia(dataUrl) {
+ const match = /^data:([^;]+);base64,([A-Za-z0-9+/=\s]+)$/.exec(dataUrl || '');
+ if (!match || !MEDIA_MIME.test(match[1]) || match[2].length > MAX_BYTES * 1.4) throw new Error('Unsupported generated media.');
+ const binary = atob(match[2]);
+ if (binary.length > MAX_BYTES) throw new Error('Generated media exceeds the 20 MB inline limit.');
+ const bytes = Uint8Array.from(binary, char => char.charCodeAt(0));
+ const blob = new Blob([bytes], { type: match[1] });
+ const id = crypto.randomUUID();
+ const db = await openDB();
+ try {
+ await new Promise((resolve, reject) => {
+ const transaction = db.transaction(STORE_NAME, 'readwrite');
+ transaction.objectStore(STORE_NAME).put({ id, blob });
+ // Wait for commit before publishing a handle to other extension contexts.
+ transaction.oncomplete = resolve;
+ transaction.onabort = transaction.onerror = () => reject(transaction.error || new Error('Generated media could not be saved.'));
+ });
+ } finally { db.close(); }
+ return { mediaId: id, mimeType: blob.type, inlineMedia: true };
+}
+
+export async function loadGeneratedMedia(id) {
+ if (!/^[\da-f]{8}-[\da-f]{4}-[\da-f]{4}-[\da-f]{4}-[\da-f]{12}$/i.test(id || '')) return null;
+ const db = await openDB();
+ try {
+ return await new Promise((resolve, reject) => {
+ const request = db.transaction(STORE_NAME, 'readonly').objectStore(STORE_NAME).get(id);
+ request.onsuccess = () => {
+ const blob = request.result?.blob;
+ resolve(blob instanceof Blob && MEDIA_MIME.test(blob.type) && blob.size <= MAX_BYTES ? blob : null);
+ };
+ request.onerror = () => reject(request.error);
+ });
+ } finally { db.close(); }
+}
diff --git a/src/chrome/src/run-ui-journal.js b/src/chrome/src/run-ui-journal.js
index e3f1421ee..5de5f3b90 100644
--- a/src/chrome/src/run-ui-journal.js
+++ b/src/chrome/src/run-ui-journal.js
@@ -45,7 +45,7 @@ export function runUiSnapshotForRequest(snapshot, requestedRequestId = '') {
const RUN_UI_TOOL_RESULT_PREVIEW_CHARS = 500;
-function compactRunUiToolResult(result) {
+function compactRunUiToolResult(result, name) {
const source = result && typeof result === 'object' && !Array.isArray(result) ? result : {};
const compacted = {};
if (typeof source.success === 'boolean') compacted.success = source.success;
@@ -68,6 +68,14 @@ function compactRunUiToolResult(result) {
if (source.truncated === true) compacted.truncated = true;
if (source.hasMore === true) compacted.hasMore = true;
if (source.notice) compacted.notice = String(source.notice).slice(0, 300);
+ if (name === 'generate_image' && source.success === true) {
+ // Inline bytes live in IndexedDB; retain the asset handle for live delivery
+ // and replay. Hosted/local URLs are small enough to keep in the journal.
+ for (const key of ['url', 'mediaId', 'mimeType', 'provider', 'model']) {
+ if (typeof source[key] === 'string') compacted[key] = source[key];
+ }
+ if (source.inlineMedia === true) compacted.inlineMedia = true;
+ }
if (Object.keys(compacted).length === 0) {
try {
compacted.preview = String(JSON.stringify(source) || '{}').slice(0, 300);
@@ -83,7 +91,7 @@ export function compactRunUiData(type, data) {
if (type === 'tool_result') {
return {
name: data.name,
- result: compactRunUiToolResult(data.result),
+ result: compactRunUiToolResult(data.result, data.name),
};
}
if (type === 'text' || type === 'text_delta') {
diff --git a/src/chrome/src/ui/generated-media-view.js b/src/chrome/src/ui/generated-media-view.js
new file mode 100644
index 000000000..55f2ff4aa
--- /dev/null
+++ b/src/chrome/src/ui/generated-media-view.js
@@ -0,0 +1,65 @@
+import { loadGeneratedMedia } from '../generated-media-store.js';
+
+const objectUrls = new WeakMap();
+
+function renderPreview(wrapper, url, t, storedMime = '') {
+ let allowed = /^data:(image\/(?:png|jpeg|webp|gif)|audio\/(?:mpeg|wav|ogg)|video\/mp4);base64,[A-Za-z0-9+/=\s]+$/.test(url);
+ let parsed;
+ try {
+ parsed = new URL(url);
+ allowed ||= !parsed.username && !parsed.password && (parsed.protocol === 'https:'
+ || (['http:', 'https:'].includes(parsed.protocol) && ['localhost', '127.0.0.1', '[::1]'].includes(parsed.hostname)));
+ } catch { /* only supported media URLs */ }
+ // Blob URLs are accepted only when created here from a validated stored asset.
+ if (!allowed && objectUrls.get(wrapper) !== url) return;
+ const mime = storedMime || url.match(/^data:([^;]+);/)?.[1] || '';
+ const filename = parsed?.searchParams.get('filename') || parsed?.pathname || '';
+ const video = mime.startsWith('video/') || /\.(mp4|webm|mov)$/i.test(filename);
+ const audio = mime.startsWith('audio/') || /\.(mp3|wav|ogg)$/i.test(filename);
+ const media = document.createElement(video ? 'video' : audio ? 'audio' : 'img');
+ if (media.tagName === 'IMG') media.alt = t('st.imagegen.output');
+ else { media.controls = true; media.preload = 'metadata'; }
+ media.style.cssText = 'max-width:100%;max-height:480px;border-radius:8px;object-fit:contain;';
+ media.referrerPolicy = 'no-referrer';
+ media.src = url;
+ const link = document.createElement('a');
+ link.href = url; link.textContent = t('st.imagegen.save_output');
+ link.target = '_blank'; link.rel = 'noopener noreferrer';
+ if (url.startsWith('data:') || storedMime) link.download = `webbrain-media.${({ 'image/png': 'png', 'image/jpeg': 'jpg', 'image/webp': 'webp', 'image/gif': 'gif', 'audio/mpeg': 'mp3', 'audio/wav': 'wav', 'audio/ogg': 'ogg', 'video/mp4': 'mp4' })[mime] || 'png'}`;
+ wrapper.replaceChildren(media, link);
+}
+
+async function hydrateStoredMedia(wrapper, t) {
+ try {
+ const blob = await loadGeneratedMedia(wrapper.dataset.mediaId);
+ if (!blob) throw new Error('Missing generated media');
+ const previous = objectUrls.get(wrapper);
+ if (previous) URL.revokeObjectURL(previous);
+ const url = URL.createObjectURL(blob);
+ objectUrls.set(wrapper, url);
+ renderPreview(wrapper, url, t, blob.type);
+ } catch {
+ wrapper.textContent = t('st.imagegen.unavailable_output');
+ }
+}
+
+// A synchronous placeholder keeps the asset handle in chat snapshots even if
+// the panel closes before the IndexedDB read finishes.
+export function appendGeneratedMedia(container, result, t) {
+ if (!container || !result?.success || (!result.mediaId && typeof result.url !== 'string')) return;
+ const wrapper = document.createElement('div');
+ wrapper.className = 'generated-media';
+ wrapper.style.cssText = 'margin:12px 0;display:grid;gap:8px;max-width:100%;';
+ if (result.mediaId) {
+ wrapper.dataset.mediaId = result.mediaId;
+ container.appendChild(wrapper);
+ return hydrateStoredMedia(wrapper, t);
+ }
+ renderPreview(wrapper, result.url, t);
+ if (wrapper.childElementCount) container.appendChild(wrapper);
+}
+
+export function restoreGeneratedMedia(root, t) {
+ return Promise.all([...root.querySelectorAll('.generated-media[data-media-id]')]
+ .map(wrapper => hydrateStoredMedia(wrapper, t)));
+}
diff --git a/src/chrome/src/ui/locales/ar.js b/src/chrome/src/ui/locales/ar.js
index de7d7f00d..0a6f4da4e 100644
--- a/src/chrome/src/ui/locales/ar.js
+++ b/src/chrome/src/ui/locales/ar.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Arabic (ar).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ar'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'تكبير واجهة الإضافة',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "تم الاتصال! النموذج: {model}",
"st.transcription.failed": "فشل: {error}",
"st.transcription.fill_required": "املأ عنوان API الأساسي والنموذج أولًا.",
- "st.imagegen.heading": "الوسائط التوليدية (fal.ai)",
- "st.imagegen.desc": "تُستخدَم بواسطة أداة generate_image لإنشاء الصور وغيرها من الوسائط من وصف نصي عبر واجهة قائمة الانتظار في fal.ai. احصل على مفتاح من fal.ai/dashboard/keys. لا تُستخدم للمحادثة.",
+ "st.imagegen.heading": "الوسائط التوليدية",
+ "st.imagegen.desc": "تستخدم أداة الوكيل generate_image المزوّد المحدد لإنشاء الصور والوسائط الأخرى من وصف نصي.",
"st.imagegen.saved": "تم الحفظ!",
"st.imagegen.cleared": "تم المسح.",
"st.imagegen.testing": "جارٍ الاختبار...",
diff --git a/src/chrome/src/ui/locales/bn.js b/src/chrome/src/ui/locales/bn.js
index 6e669e4b6..57304316e 100644
--- a/src/chrome/src/ui/locales/bn.js
+++ b/src/chrome/src/ui/locales/bn.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Bengali — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('bn'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'এক্সটেনশনের UI জুম',
@@ -901,8 +903,8 @@ export default {
'st.transcription.connected': "সংযুক্ত ! মডেল: {model}",
'st.transcription.failed': "ব্যর্থ হয়েছে: {error}",
'st.transcription.fill_required': "প্রথমে বেস URL এবং মডেল পূরণ করুন।",
- "st.imagegen.heading": "জেনারেটিভ মিডিয়া (fal.ai)",
- "st.imagegen.desc": "generate_image এজেন্ট টুল দ্বারা fal.ai-র কিউ API-র মাধ্যমে টেক্সট প্রম্পট থেকে ছবি ও অন্যান্য মিডিয়া তৈরিতে ব্যবহৃত হয়। fal.ai/dashboard/keys থেকে কী নিন। চ্যাটের জন্য ব্যবহৃত হয় না।",
+ "st.imagegen.heading": "জেনারেটিভ মিডিয়া",
+ "st.imagegen.desc": "generate_image এজেন্ট টুল নির্বাচিত প্রদানকারীর মাধ্যমে টেক্সট প্রম্পট থেকে ছবি ও অন্যান্য মিডিয়া তৈরি করে।",
"st.imagegen.saved": "সংরক্ষিত হয়েছে!",
"st.imagegen.cleared": "মুছে ফেলা হয়েছে।",
"st.imagegen.testing": "পরীক্ষা চলছে...",
diff --git a/src/chrome/src/ui/locales/de.js b/src/chrome/src/ui/locales/de.js
index 35754b585..9026d21ff 100644
--- a/src/chrome/src/ui/locales/de.js
+++ b/src/chrome/src/ui/locales/de.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// German (de).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('de'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Erweiterungsoberfläche zoomen',
@@ -843,8 +845,8 @@ export default {
'st.transcription.connected': 'Verbunden! Modell: {model}',
'st.transcription.failed': 'Fehlgeschlagen: {error}',
'st.transcription.fill_required': 'Füllen Sie zuerst die Basis-URL und das Modell aus.',
- "st.imagegen.heading": "Generative Medien (fal.ai)",
- "st.imagegen.desc": "Wird vom Agent-Tool generate_image verwendet, um aus einem Textprompt Bilder und andere Medien über die Queue-API von fal.ai zu erzeugen. Schlüssel unter fal.ai/dashboard/keys erhalten. Wird nicht für Chat verwendet.",
+ "st.imagegen.heading": "Generative Medien",
+ "st.imagegen.desc": "Das Agentenwerkzeug generate_image erstellt Bilder und andere Medien aus einem Textprompt mit dem ausgewählten Anbieter.",
"st.imagegen.saved": "Gespeichert!",
"st.imagegen.cleared": "Gelöscht.",
"st.imagegen.testing": "Wird getestet...",
diff --git a/src/chrome/src/ui/locales/en.js b/src/chrome/src/ui/locales/en.js
index 493b4647c..f97d56bb2 100644
--- a/src/chrome/src/ui/locales/en.js
+++ b/src/chrome/src/ui/locales/en.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// English — canonical locale. Other locales inherit key names from this file.
@@ -5,6 +6,7 @@ import apocalypseModeCopy from './apocalypse-copy.mjs';
import emergencyCopy from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('en'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Extension UI zoom',
@@ -907,9 +909,9 @@ export default {
'st.transcription.failed': 'Failed: {error}',
'st.transcription.fill_required': 'Fill in Base URL and Model first.',
- // Generative media (fal.ai) — Assistive Models section
- 'st.imagegen.heading': 'Generative media (fal.ai)',
- 'st.imagegen.desc': 'Used by the generate_image agent tool to create images and other media from a text prompt via fal.ai\'s queue API. Get a key at fal.ai/dashboard/keys. Not used for chat.',
+ // Generative Media — Assistive Models section
+ 'st.imagegen.heading': "Generative Media",
+ 'st.imagegen.desc': "Used by the generate_image agent tool to create images and other media from a text prompt with the selected provider.",
'st.imagegen.saved': 'Saved!',
'st.imagegen.cleared': 'Cleared.',
'st.imagegen.testing': 'Testing...',
diff --git a/src/chrome/src/ui/locales/es.js b/src/chrome/src/ui/locales/es.js
index 11118b865..ffd7a76e9 100644
--- a/src/chrome/src/ui/locales/es.js
+++ b/src/chrome/src/ui/locales/es.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Spanish (es).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('es'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom de la interfaz de la extensión',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "¡Conectado! Modelo: {model}",
"st.transcription.failed": "Falló: {error}",
"st.transcription.fill_required": "Rellena primero la URL base y el modelo.",
- "st.imagegen.heading": "Medios generativos (fal.ai)",
- "st.imagegen.desc": "Usada por la herramienta de agente generate_image para crear imágenes y otros medios a partir de un prompt de texto mediante la API de cola de fal.ai. Obtén una clave en fal.ai/dashboard/keys. No se usa para chat.",
+ "st.imagegen.heading": "Medios generativos",
+ "st.imagegen.desc": "La herramienta de agente generate_image crea imágenes y otros medios a partir de texto con el proveedor seleccionado.",
"st.imagegen.saved": "¡Guardado!",
"st.imagegen.cleared": "Borrado.",
"st.imagegen.testing": "Probando...",
diff --git a/src/chrome/src/ui/locales/fa.js b/src/chrome/src/ui/locales/fa.js
index 13daf5683..b208e7643 100644
--- a/src/chrome/src/ui/locales/fa.js
+++ b/src/chrome/src/ui/locales/fa.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Persian — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('fa'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'بزرگ‌نمایی رابط کاربری افزونه',
@@ -901,8 +903,8 @@ export default {
'st.transcription.connected': "متصل است! مدل: {model}",
'st.transcription.failed': "ناموفق: {error}",
'st.transcription.fill_required': "ابتدا Base URL و Model را پر کنید.",
- "st.imagegen.heading": "رسانه‌های مولد (fal.ai)",
- "st.imagegen.desc": "ابزار ایجنت generate_image برای ساخت تصویر و سایر رسانه‌ها از یک پرامپت متنی از طریق API صف fal.ai استفاده می‌کند. کلید را از fal.ai/dashboard/keys بگیرید. برای چت استفاده نمی‌شود.",
+ "st.imagegen.heading": "رسانه‌های مولد",
+ "st.imagegen.desc": "ابزار عامل generate_image با ارائه‌دهنده انتخاب‌شده از درخواست متنی، تصویر و رسانه‌های دیگر تولید می‌کند.",
"st.imagegen.saved": "ذخیره شد!",
"st.imagegen.cleared": "پاک شد.",
"st.imagegen.testing": "در حال آزمایش...",
diff --git a/src/chrome/src/ui/locales/fr.js b/src/chrome/src/ui/locales/fr.js
index ba5620dcc..5b63a1a62 100644
--- a/src/chrome/src/ui/locales/fr.js
+++ b/src/chrome/src/ui/locales/fr.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// French (fr).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('fr'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom de l’interface de l’extension',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "Connecté ! Modèle : {model}",
"st.transcription.failed": "Échec : {error}",
"st.transcription.fill_required": "Remplissez d'abord l'URL de base et le modèle.",
- "st.imagegen.heading": "Médias génératifs (fal.ai)",
- "st.imagegen.desc": "Utilisée par l'outil d'agent generate_image pour créer des images et d'autres médias à partir d'un prompt texte via l'API de file d'attente de fal.ai. Obtenez une clé sur fal.ai/dashboard/keys. Non utilisée pour le chat.",
+ "st.imagegen.heading": "Médias génératifs",
+ "st.imagegen.desc": "L’outil d’agent generate_image crée des images et d’autres médias à partir de texte avec le fournisseur sélectionné.",
"st.imagegen.saved": "Enregistré !",
"st.imagegen.cleared": "Effacé.",
"st.imagegen.testing": "Test en cours...",
diff --git a/src/chrome/src/ui/locales/generative-media-copy.mjs b/src/chrome/src/ui/locales/generative-media-copy.mjs
new file mode 100644
index 000000000..19c67f907
--- /dev/null
+++ b/src/chrome/src/ui/locales/generative-media-copy.mjs
@@ -0,0 +1,31 @@
+const english = {
+ 'st.imagegen.provider': 'Provider',
+ 'st.imagegen.local_provider': 'ComfyUI (localhost)',
+ 'st.imagegen.workflow': 'Workflow JSON (API format)',
+ 'st.imagegen.parameters': 'Model input JSON (optional)',
+ 'st.imagegen.setup': 'Setup guide ↗',
+ 'st.imagegen.hint.fal': 'Enter your fal.ai key and model ID. Test Connection checks authentication without generating media.',
+ 'st.imagegen.hint.openrouter': 'Enter an OpenRouter key and an image generation model ID. Test Connection checks the key and image catalog without generating an image.',
+ 'st.imagegen.hint.comfyrouter': 'Enter a Comfy API key and provider/model ID. For models with other prompt fields, paste their input JSON using {{prompt}} where the text belongs. Test Connection reads model metadata.',
+ 'st.imagegen.hint.comfyui': 'Start ComfyUI locally, export the workflow in API format, and replace its positive prompt text with {{prompt}}. Include a Save Image or media output node. No API key is needed. Test Connection checks the local server; the workflow runs only when you request generation.',
+ 'st.imagegen.output': 'Generated media',
+ 'st.imagegen.save_output': 'Save generated media',
+ 'st.imagegen.unavailable_output': 'The saved media is unavailable.',
+};
+const turkish = {
+ 'st.imagegen.provider': 'Sağlayıcı',
+ 'st.imagegen.local_provider': 'ComfyUI (yerel sunucu)',
+ 'st.imagegen.workflow': 'İş akışı JSON (API biçimi)',
+ 'st.imagegen.parameters': 'Model girdisi JSON (isteğe bağlı)',
+ 'st.imagegen.setup': 'Kurulum rehberi ↗',
+ 'st.imagegen.hint.fal': 'fal.ai anahtarınızı ve model kimliğini girin. Bağlantı testi medya üretmeden kimlik doğrulamayı kontrol eder.',
+ 'st.imagegen.hint.openrouter': 'OpenRouter anahtarını ve görsel üreten bir model kimliğini girin. Bağlantı testi görsel üretmeden anahtarı ve görsel kataloğunu kontrol eder.',
+ 'st.imagegen.hint.comfyrouter': 'Comfy API anahtarını ve sağlayıcı/model kimliğini girin. Farklı istem alanları kullanan modeller için girdi JSON dosyasını yapıştırıp metnin yerine {{prompt}} yazın. Bağlantı testi model bilgilerini okur.',
+ 'st.imagegen.hint.comfyui': 'ComfyUI yerel sunucusunu başlatın, iş akışını API biçiminde dışa aktarın ve olumlu istem metnini {{prompt}} ile değiştirin. Save Image veya medya çıktı düğümü ekleyin. API anahtarı gerekmez. Bağlantı testi yerel sunucuyu kontrol eder; iş akışı yalnızca medya üretimi istediğinizde çalışır.',
+ 'st.imagegen.output': 'Üretilen medya',
+ 'st.imagegen.save_output': 'Üretilen medyayı kaydet',
+ 'st.imagegen.unavailable_output': 'Kaydedilen medya kullanılamıyor.',
+};
+export function getGenerativeMediaCopy(locale) {
+ return { ...english, ...(locale === 'tr' ? turkish : {}) };
+}
diff --git a/src/chrome/src/ui/locales/he.js b/src/chrome/src/ui/locales/he.js
index 36928a0f9..4fdd81106 100644
--- a/src/chrome/src/ui/locales/he.js
+++ b/src/chrome/src/ui/locales/he.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Hebrew (he).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('he'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'הגדלת ממשק התוסף',
@@ -822,8 +824,8 @@ export default {
"st.transcription.connected": "מחובר! מודל: {model}",
"st.transcription.failed": "נכשל: {error}",
"st.transcription.fill_required": "יש למלא תחילה כתובת URL בסיסית ומודל.",
- "st.imagegen.heading": "מדיה גנרטיבית (fal.ai)",
- "st.imagegen.desc": "בשימוש על ידי כלי הסוכן generate_image ליצירת תמונות ומדיה אחרת מתיאור טקסטואלי דרך ה-Queue API של fal.ai. אפשר לקבל מפתח ב-fal.ai/dashboard/keys. אינו משמש לצ׳אט.",
+ "st.imagegen.heading": "מדיה גנרטיבית",
+ "st.imagegen.desc": "כלי הסוכן generate_image יוצר תמונות ומדיה נוספת מהנחיית טקסט באמצעות הספק שנבחר.",
"st.imagegen.saved": "נשמר!",
"st.imagegen.cleared": "נמחק.",
"st.imagegen.testing": "בודק...",
diff --git a/src/chrome/src/ui/locales/hi.js b/src/chrome/src/ui/locales/hi.js
index 04ab9b81e..f1da00a1e 100644
--- a/src/chrome/src/ui/locales/hi.js
+++ b/src/chrome/src/ui/locales/hi.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Hindi — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('hi'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'एक्सटेंशन UI ज़ूम',
@@ -901,8 +903,8 @@ export default {
'st.transcription.connected': "जुड़ा हुआ! मॉडल: {model}",
'st.transcription.failed': "विफल: {error}",
'st.transcription.fill_required': "सबसे पहले बेस यूआरएल और मॉडल भरें।",
- "st.imagegen.heading": "जनरेटिव मीडिया (fal.ai)",
- "st.imagegen.desc": "generate_image एजेंट टूल द्वारा fal.ai की क्यू API के ज़रिए टेक्स्ट प्रॉम्प्ट से इमेज और अन्य मीडिया बनाने के लिए उपयोग किया जाता है। fal.ai/dashboard/keys से की लें। चैट के लिए उपयोग नहीं होता।",
+ "st.imagegen.heading": "जनरेटिव मीडिया",
+ "st.imagegen.desc": "generate_image एजेंट टूल चुने हुए प्रदाता से टेक्स्ट प्रॉम्प्ट के आधार पर चित्र और अन्य मीडिया बनाता है।",
"st.imagegen.saved": "सहेजा गया!",
"st.imagegen.cleared": "साफ़ कर दिया गया।",
"st.imagegen.testing": "जाँच जारी...",
diff --git a/src/chrome/src/ui/locales/id.js b/src/chrome/src/ui/locales/id.js
index 4eb37bc74..d8edc0c2c 100644
--- a/src/chrome/src/ui/locales/id.js
+++ b/src/chrome/src/ui/locales/id.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Indonesian (id).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('id'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom UI ekstensi',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "Terhubung! Model: {model}",
"st.transcription.failed": "Gagal: {error}",
"st.transcription.fill_required": "Isi URL dasar dan Model terlebih dahulu.",
- "st.imagegen.heading": "Media generatif (fal.ai)",
- "st.imagegen.desc": "Digunakan oleh alat agen generate_image untuk membuat gambar dan media lain dari prompt teks melalui API antrean fal.ai. Dapatkan kunci di fal.ai/dashboard/keys. Tidak digunakan untuk obrolan.",
+ "st.imagegen.heading": "Media generatif",
+ "st.imagegen.desc": "Alat agen generate_image membuat gambar dan media lainnya dari prompt teks melalui penyedia yang dipilih.",
"st.imagegen.saved": "Tersimpan!",
"st.imagegen.cleared": "Dihapus.",
"st.imagegen.testing": "Menguji...",
diff --git a/src/chrome/src/ui/locales/ja.js b/src/chrome/src/ui/locales/ja.js
index 6f603bb39..d837349ce 100644
--- a/src/chrome/src/ui/locales/ja.js
+++ b/src/chrome/src/ui/locales/ja.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Japanese (ja).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ja'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': '拡張機能 UI のズーム',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "接続しました!モデル: {model}",
"st.transcription.failed": "失敗: {error}",
"st.transcription.fill_required": "先にベース URL とモデルを入力してください。",
- "st.imagegen.heading": "生成メディア (fal.ai)",
- "st.imagegen.desc": "generate_image エージェントツールが fal.ai のキュー API を通じてテキストプロンプトから画像などのメディアを生成するために使用します。キーは fal.ai/dashboard/keys で取得できます。チャットには使用されません。",
+ "st.imagegen.heading": "生成メディア",
+ "st.imagegen.desc": "エージェントツール generate_image は、選択したプロバイダーでテキストプロンプトから画像などのメディアを生成します。",
"st.imagegen.saved": "保存しました!",
"st.imagegen.cleared": "クリアしました。",
"st.imagegen.testing": "テスト中...",
diff --git a/src/chrome/src/ui/locales/ko.js b/src/chrome/src/ui/locales/ko.js
index fa1b8bafe..76327fb3a 100644
--- a/src/chrome/src/ui/locales/ko.js
+++ b/src/chrome/src/ui/locales/ko.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Korean (ko).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ko'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': '확장 프로그램 UI 확대/축소',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "연결됨! 모델: {model}",
"st.transcription.failed": "실패: {error}",
"st.transcription.fill_required": "먼저 기본 URL과 모델을 입력하세요.",
- "st.imagegen.heading": "생성 미디어 (fal.ai)",
- "st.imagegen.desc": "generate_image 에이전트 도구가 fal.ai 큐 API를 통해 텍스트 프롬프트에서 이미지 등 미디어를 생성하는 데 사용됩니다. fal.ai/dashboard/keys에서 키를 발급받으세요. 채팅에는 사용되지 않습니다.",
+ "st.imagegen.heading": "생성 미디어",
+ "st.imagegen.desc": "generate_image 에이전트 도구가 선택한 제공업체를 통해 텍스트 프롬프트로 이미지와 기타 미디어를 생성합니다.",
"st.imagegen.saved": "저장되었습니다!",
"st.imagegen.cleared": "지워졌습니다.",
"st.imagegen.testing": "테스트 중...",
diff --git a/src/chrome/src/ui/locales/ms.js b/src/chrome/src/ui/locales/ms.js
index 97dea58e4..ff3a908db 100644
--- a/src/chrome/src/ui/locales/ms.js
+++ b/src/chrome/src/ui/locales/ms.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Malay (ms).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ms'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zum UI sambungan',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "Tersambung! Model: {model}",
"st.transcription.failed": "Gagal: {error}",
"st.transcription.fill_required": "Isi URL Asas dan Model terlebih dahulu.",
- "st.imagegen.heading": "Media generatif (fal.ai)",
- "st.imagegen.desc": "Digunakan oleh alat ejen generate_image untuk mencipta imej dan media lain daripada geseran teks melalui API baris giliran fal.ai. Dapatkan kunci di fal.ai/dashboard/keys. Tidak digunakan untuk sembang.",
+ "st.imagegen.heading": "Media generatif",
+ "st.imagegen.desc": "Alat ejen generate_image menghasilkan imej dan media lain daripada gesaan teks melalui penyedia yang dipilih.",
"st.imagegen.saved": "Disimpan!",
"st.imagegen.cleared": "Dibersihkan.",
"st.imagegen.testing": "Menguji...",
diff --git a/src/chrome/src/ui/locales/nl.js b/src/chrome/src/ui/locales/nl.js
index af3268ade..9bed53a26 100644
--- a/src/chrome/src/ui/locales/nl.js
+++ b/src/chrome/src/ui/locales/nl.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Dutch (nl).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('nl'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom van extensie-interface',
@@ -809,8 +811,8 @@ export default {
'st.transcription.connected': 'Verbonden! Model: {model}',
'st.transcription.failed': 'Mislukt: {error}',
'st.transcription.fill_required': 'Vul eerst basis-URL en model in.',
- "st.imagegen.heading": "Generatieve media (fal.ai)",
- "st.imagegen.desc": "Wordt gebruikt door de agenttool generate_image om afbeeldingen en andere media te maken vanuit een tekstprompt via de queue-API van fal.ai. Vraag een sleutel aan op fal.ai/dashboard/keys. Niet voor chat.",
+ "st.imagegen.heading": "Generatieve media",
+ "st.imagegen.desc": "De agenttool generate_image maakt afbeeldingen en andere media vanuit een tekstprompt met de geselecteerde aanbieder.",
"st.imagegen.saved": "Opgeslagen!",
"st.imagegen.cleared": "Wissen gelukt.",
"st.imagegen.testing": "Testen...",
diff --git a/src/chrome/src/ui/locales/pl.js b/src/chrome/src/ui/locales/pl.js
index e0bbd3b85..4fdf1e5e5 100644
--- a/src/chrome/src/ui/locales/pl.js
+++ b/src/chrome/src/ui/locales/pl.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Polski — translated from en.js. Keys mirror the English canonical file.
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('pl'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Powiększenie interfejsu rozszerzenia',
@@ -642,8 +644,8 @@ export default {
'st.transcription.connected': 'Połączono! Model: {model}',
'st.transcription.failed': 'Niepowodzenie: {error}',
'st.transcription.fill_required': 'Najpierw wypełnij bazowy adres URL i model.',
- "st.imagegen.heading": "Media generatywne (fal.ai)",
- "st.imagegen.desc": "Używane przez narzędzie agenta generate_image do tworzenia obrazów i innych mediów z promptu tekstowego przez API kolejki fal.ai. Klucz uzyskasz na fal.ai/dashboard/keys. Nieużywane do czatu.",
+ "st.imagegen.heading": "Media generatywne",
+ "st.imagegen.desc": "Narzędzie agenta generate_image tworzy obrazy i inne media z opisu tekstowego za pomocą wybranego dostawcy.",
"st.imagegen.saved": "Zapisano!",
"st.imagegen.cleared": "Wyczyszczono.",
"st.imagegen.testing": "Testowanie...",
diff --git a/src/chrome/src/ui/locales/pt.js b/src/chrome/src/ui/locales/pt.js
index c70878477..4452afe32 100644
--- a/src/chrome/src/ui/locales/pt.js
+++ b/src/chrome/src/ui/locales/pt.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Portuguese — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('pt'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom da interface da extensão',
@@ -901,8 +903,8 @@ export default {
'st.transcription.connected': "Conectado! Modelo: {model}",
'st.transcription.failed': "Falha: {error}",
'st.transcription.fill_required': "Preencha primeiro o URL base e o modelo.",
- "st.imagegen.heading": "Mídia generativa (fal.ai)",
- "st.imagegen.desc": "Usada pela ferramenta de agente generate_image para criar imagens e outras mídias a partir de um prompt de texto pela API de fila da fal.ai. Obtenha uma chave em fal.ai/dashboard/keys. Não usada para chat.",
+ "st.imagegen.heading": "Mídia generativa",
+ "st.imagegen.desc": "A ferramenta de agente generate_image cria imagens e outras mídias a partir de texto com o provedor selecionado.",
"st.imagegen.saved": "Salvo!",
"st.imagegen.cleared": "Limpo.",
"st.imagegen.testing": "Testando...",
diff --git a/src/chrome/src/ui/locales/ru.js b/src/chrome/src/ui/locales/ru.js
index 856c947d6..18e0675a6 100644
--- a/src/chrome/src/ui/locales/ru.js
+++ b/src/chrome/src/ui/locales/ru.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Russian (ru).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ru'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Масштаб интерфейса расширения',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "Подключено! Модель: {model}",
"st.transcription.failed": "Сбой: {error}",
"st.transcription.fill_required": "Сначала заполните базовый URL и модель.",
- "st.imagegen.heading": "Генеративные медиа (fal.ai)",
- "st.imagegen.desc": "Используется инструментом агента generate_image для создания изображений и других медиа из текстового запроса через очередь API fal.ai. Ключ можно получить на fal.ai/dashboard/keys. Не используется для чата.",
+ "st.imagegen.heading": "Генеративные медиа",
+ "st.imagegen.desc": "Инструмент агента generate_image создаёт изображения и другие медиа по текстовому запросу через выбранного провайдера.",
"st.imagegen.saved": "Сохранено!",
"st.imagegen.cleared": "Очищено.",
"st.imagegen.testing": "Проверка...",
diff --git a/src/chrome/src/ui/locales/th.js b/src/chrome/src/ui/locales/th.js
index f0c1211c9..4946f436c 100644
--- a/src/chrome/src/ui/locales/th.js
+++ b/src/chrome/src/ui/locales/th.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Thai (th).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('th'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'ซูม UI ของส่วนขยาย',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "เชื่อมต่อแล้ว! โมเดล: {model}",
"st.transcription.failed": "ล้มเหลว: {error}",
"st.transcription.fill_required": "กรอก URL ฐานและโมเดลก่อน",
- "st.imagegen.heading": "สื่อเชิงสร้างสรรค์ (fal.ai)",
- "st.imagegen.desc": "เครื่องมือเอเจนต์ generate_image ใช้สร้างรูปภาพและสื่ออื่น ๆ จากพรอมต์ข้อความผ่านคิว API ของ fal.ai รับคีย์ได้ที่ fal.ai/dashboard/keys ไม่ได้ใช้สำหรับแชท",
+ "st.imagegen.heading": "สื่อเชิงสร้างสรรค์",
+ "st.imagegen.desc": "เครื่องมือเอเจนต์ generate_image สร้างภาพและสื่ออื่นจากพรอมต์ข้อความผ่านผู้ให้บริการที่เลือก",
"st.imagegen.saved": "บันทึกแล้ว!",
"st.imagegen.cleared": "ล้างแล้ว.",
"st.imagegen.testing": "กำลังทดสอบ...",
diff --git a/src/chrome/src/ui/locales/tl.js b/src/chrome/src/ui/locales/tl.js
index 8d86aef2d..703020ed2 100644
--- a/src/chrome/src/ui/locales/tl.js
+++ b/src/chrome/src/ui/locales/tl.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Filipino / Tagalog (tl).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('tl'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Pag-zoom ng UI ng extension',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "Konektado! Modelo: {model}",
"st.transcription.failed": "Nabigo: {error}",
"st.transcription.fill_required": "Punan muna ang Base URL at Modelo.",
- "st.imagegen.heading": "Generative media (fal.ai)",
- "st.imagegen.desc": "Ginagamit ng generate_image agent tool para gumawa ng mga larawan at iba pang media mula sa text prompt sa pamamagitan ng fal.ai queue API. Kumuha ng key sa fal.ai/dashboard/keys. Hindi ginagamit sa chat.",
+ "st.imagegen.heading": "Generative media",
+ "st.imagegen.desc": "Gumagawa ang generate_image agent tool ng mga larawan at ibang media mula sa text prompt gamit ang napiling provider.",
"st.imagegen.saved": "Na-save!",
"st.imagegen.cleared": "Na-clear.",
"st.imagegen.testing": "Sinusuri...",
diff --git a/src/chrome/src/ui/locales/tr.js b/src/chrome/src/ui/locales/tr.js
index c8d331880..0d933093c 100644
--- a/src/chrome/src/ui/locales/tr.js
+++ b/src/chrome/src/ui/locales/tr.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Turkish (tr).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('tr'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Uzantı arayüzü yakınlaştırması',
@@ -655,8 +657,8 @@ export default {
"st.transcription.connected": "Bağlandı! Model: {model}",
"st.transcription.failed": "Başarısız: {error}",
"st.transcription.fill_required": "Önce Temel URL ve Model alanlarını doldur.",
- "st.imagegen.heading": "Üretken medya (fal.ai)",
- "st.imagegen.desc": "generate_image ajan aracı tarafından metin isteminden fal.ai'nin kuyruk API'si üzerinden görsel ve diğer medyaları oluşturmak için kullanılır. Anahtar alın: fal.ai/dashboard/keys. Sohbet için kullanılmaz.",
+ "st.imagegen.heading": "Üretken medya",
+ "st.imagegen.desc": "generate_image ajan aracı, seçilen sağlayıcıyla metin isteminden görsel ve diğer medyaları üretir.",
"st.imagegen.saved": "Kaydedildi!",
"st.imagegen.cleared": "Temizlendi.",
"st.imagegen.testing": "Test ediliyor...",
diff --git a/src/chrome/src/ui/locales/uk.js b/src/chrome/src/ui/locales/uk.js
index 8a0fecc1a..7cc7709f6 100644
--- a/src/chrome/src/ui/locales/uk.js
+++ b/src/chrome/src/ui/locales/uk.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Ukrainian (uk).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('uk'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Масштаб інтерфейсу розширення',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "Підключено! Модель: {model}",
"st.transcription.failed": "Збій: {error}",
"st.transcription.fill_required": "Спочатку заповніть базовий URL і модель.",
- "st.imagegen.heading": "Генеративні медіа (fal.ai)",
- "st.imagegen.desc": "Використовується інструментом агента generate_image для створення зображень та інших медіа з текстового запиту через API черги fal.ai. Ключ можна отримати на fal.ai/dashboard/keys. Не використовується для чату.",
+ "st.imagegen.heading": "Генеративні медіа",
+ "st.imagegen.desc": "Інструмент агента generate_image створює зображення та інші медіа за текстовим запитом через вибраного постачальника.",
"st.imagegen.saved": "Збережено!",
"st.imagegen.cleared": "Очищено.",
"st.imagegen.testing": "Перевірка...",
diff --git a/src/chrome/src/ui/locales/vi.js b/src/chrome/src/ui/locales/vi.js
index 6e882a70c..228a8f468 100644
--- a/src/chrome/src/ui/locales/vi.js
+++ b/src/chrome/src/ui/locales/vi.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Vietnamese — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('vi'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Thu phóng giao diện tiện ích',
@@ -901,8 +903,8 @@ export default {
'st.transcription.connected': "Đã kết nối! Model: {model}",
'st.transcription.failed': "Không thành công: {error}",
'st.transcription.fill_required': "Trước tiên hãy điền URL cơ sở và Mô hình.",
- "st.imagegen.heading": "Media tạo sinh (fal.ai)",
- "st.imagegen.desc": "Được công cụ tác nhân generate_image sử dụng để tạo hình ảnh và phương tiện khác từ lời nhắc văn bản thông qua API hàng đợi của fal.ai. Lấy khóa tại fal.ai/dashboard/keys. Không dùng cho trò chuyện.",
+ "st.imagegen.heading": "Media tạo sinh",
+ "st.imagegen.desc": "Công cụ tác nhân generate_image tạo hình ảnh và phương tiện khác từ lời nhắc văn bản qua nhà cung cấp đã chọn.",
"st.imagegen.saved": "Đã lưu!",
"st.imagegen.cleared": "Đã xóa.",
"st.imagegen.testing": "Đang kiểm tra...",
diff --git a/src/chrome/src/ui/locales/zh.js b/src/chrome/src/ui/locales/zh.js
index 5fd380dc5..77a44936e 100644
--- a/src/chrome/src/ui/locales/zh.js
+++ b/src/chrome/src/ui/locales/zh.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Simplified Chinese (zh).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('zh'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': '插件界面缩放',
@@ -615,8 +617,8 @@ export default {
"st.transcription.connected": "连接成功!模型:{model}",
"st.transcription.failed": "失败:{error}",
"st.transcription.fill_required": "请先填写基础 URL 和模型。",
- "st.imagegen.heading": "生成式媒体 (fal.ai)",
- "st.imagegen.desc": "generate_image 代理工具通过 fal.ai 的队列 API 根据文本提示生成图片等媒体。请前往 fal.ai/dashboard/keys 获取密钥。不用于聊天。",
+ "st.imagegen.heading": "生成式媒体",
+ "st.imagegen.desc": "generate_image 智能体工具通过所选提供商,根据文本提示生成图像和其他媒体。",
"st.imagegen.saved": "已保存!",
"st.imagegen.cleared": "已清除。",
"st.imagegen.testing": "测试中...",
diff --git a/src/chrome/src/ui/settings.html b/src/chrome/src/ui/settings.html
index 1ce55d82f..5585fbd72 100644
--- a/src/chrome/src/ui/settings.html
+++ b/src/chrome/src/ui/settings.html
@@ -2185,22 +2185,47 @@
</svg>
<span data-i18n="st.imagegen.heading"></span>
</h3>
- <div class="provider-card" id="image-gen-card">
+ <div class="provider-card" id="image-gen-card" aria-labelledby="image-gen-heading">
<div style="font-size:12px;color:var(--text2);margin-bottom:12px;line-height:1.5;" data-i18n="st.imagegen.desc"></div>
<div class="field">
- <label data-i18n="st.provider.field.api_key"></label>
- <input type="password" id="image-gen-api-key" placeholder="FAL_KEY">
+ <label for="image-gen-provider" data-i18n="st.imagegen.provider"></label>
+ <select id="image-gen-provider">
+ <option value="fal">fal.ai</option>
+ <option value="openrouter">OpenRouter</option>
+ <option value="comfyrouter">Comfy Router</option>
+ <option value="comfyui" data-i18n="st.imagegen.local_provider">ComfyUI (localhost)</option>
+ </select>
</div>
- <div class="field">
- <label data-i18n="st.provider.field.model"></label>
+ <div class="field" id="image-gen-key-field">
+ <label for="image-gen-api-key" data-i18n="st.provider.field.api_key"></label>
+ <input type="password" id="image-gen-api-key" placeholder="FAL_KEY" autocomplete="off">
+ </div>
+ <div class="field" id="image-gen-model-field">
+ <label for="image-gen-model" data-i18n="st.provider.field.model"></label>
<input type="text" id="image-gen-model" placeholder="fal-ai/flux/schnell">
</div>
+ <div class="field" id="image-gen-url-field" hidden>
+ <label for="image-gen-base-url" data-i18n="st.provider.field.api_base_url"></label>
+ <input type="url" id="image-gen-base-url" placeholder="http://127.0.0.1:8188">
+ </div>
+ <div class="field" id="image-gen-workflow-field" hidden>
+ <label for="image-gen-workflow" data-i18n="st.imagegen.workflow"></label>
+ <textarea id="image-gen-workflow" rows="8" spellcheck="false" placeholder='{"6":{"class_type":"CLIPTextEncode","inputs":{"text":"{{prompt}}"}}}'></textarea>
+ </div>
+ <div class="field" id="image-gen-parameters-field" hidden>
+ <label for="image-gen-parameters" data-i18n="st.imagegen.parameters"></label>
+ <textarea id="image-gen-parameters" rows="4" spellcheck="false" placeholder='{"prompt":"{{prompt}}"}'></textarea>
+ </div>
+ <div style="font-size:12px;color:var(--text2);line-height:1.5;margin-bottom:12px;">
+ <span id="image-gen-provider-hint"></span>
+ <a id="image-gen-docs" href="https://fal.ai/dashboard/keys" target="_blank" rel="noopener noreferrer" data-i18n="st.imagegen.setup"></a>
+ </div>
<div class="btn-row">
<button class="btn-primary" id="btn-save-image-gen" data-i18n="st.transcription.save"></button>
<button class="btn-secondary" id="btn-test-image-gen" data-i18n="st.transcription.test"></button>
<button class="btn-secondary" id="btn-clear-image-gen" data-i18n="st.transcription.clear"></button>
</div>
- <div class="test-result" id="test-image-gen"></div>
+ <div class="test-result" id="test-image-gen" role="status"></div>
</div>
<h3 class="mm-section-heading" id="system-one-heading">
diff --git a/src/chrome/src/ui/settings.js b/src/chrome/src/ui/settings.js
index 8a5a5a3f4..2b5f4dcfa 100644
--- a/src/chrome/src/ui/settings.js
+++ b/src/chrome/src/ui/settings.js
@@ -4,6 +4,7 @@
import { t, getLocale, setLocale, LANGUAGES } from './i18n.js';
import { escapeHtml } from './utils.js';
+import { MEDIA_PROVIDERS, mediaProvider, validateMediaConfig } from '../agent/media-config.js';
import { THEME_MODES, applyMode, loadMode, watch } from './theme.js';
import {
UI_SCALE_LEVELS,
@@ -170,7 +171,11 @@ const btnSaveTranscription = document.getElementById('btn-save-transcription');
const btnTestTranscription = document.getElementById('btn-test-transcription');
const btnClearTranscription = document.getElementById('btn-clear-transcription');
const transcriptionTestResult = document.getElementById('test-transcription');
-// Generative media (fal.ai) — assistive model, stored as `imageGenModel = { apiKey, model }`.
+// Generative Media — provider settings stored as imageGenModel.
+const imageGenProviderInput = document.getElementById('image-gen-provider');
+const imageGenBaseUrlInput = document.getElementById('image-gen-base-url');
+const imageGenWorkflowInput = document.getElementById('image-gen-workflow');
+const imageGenParametersInput = document.getElementById('image-gen-parameters');
const imageGenApiKeyInput = document.getElementById('image-gen-api-key');
const imageGenModelInput = document.getElementById('image-gen-model');
const btnSaveImageGen = document.getElementById('btn-save-image-gen');
@@ -731,11 +736,9 @@ async function init() {
updateMultimodalDetectedProvider('vision');
updateMultimodalDetectedProvider('transcription');
- // Load generative media (fal.ai) config. Used by the generate_image agent tool.
+ // Load Generative Media config. Used by the generate_image agent tool.
const imageGenStored = await chrome.storage.local.get(['imageGenModel']);
- const imageGen = imageGenStored.imageGenModel || {};
- if (imageGenApiKeyInput) imageGenApiKeyInput.value = imageGen.apiKey || '';
- if (imageGenModelInput) imageGenModelInput.value = imageGen.model || '';
+ renderImageGenConfig(imageGenStored.imageGenModel || {});
// Load profile (auto-fill bio + throwaway password)
const profileStored = await chrome.storage.local.get(['profileEnabled', 'profileText']);
@@ -1864,11 +1867,9 @@ if (btnClearTranscription) {
transcriptionBaseUrlInput?.addEventListener('input', () => updateMultimodalDetectedProvider('transcription'));
-// --- Generative Media (fal.ai) ---
-//
-// Same UX as the transcription override. Stored in chrome.storage.local under
-// `imageGenModel = { apiKey, model }`. Consumed by the `generate_image` agent
-// tool (agent/fal-media.js), which submits to fal.ai's queue API.
+// --- Generative Media ---
+const imageGenDrafts = new Map();
+let imageGenCurrentProvider = 'fal';
function showImageGenResult(className, text, color = '') {
if (!imageGenTestResult) return;
@@ -1883,63 +1884,81 @@ function flashImageGenResult(className, text) {
if (resultEl) setTimeout(() => resultEl.classList.remove('show'), 2000);
}
-if (btnSaveImageGen) {
- btnSaveImageGen.addEventListener('click', async () => {
- const apiKey = imageGenApiKeyInput.value.trim();
- const model = imageGenModelInput.value.trim();
-
- if (!apiKey && !model) {
- await chrome.storage.local.remove('imageGenModel');
- flashImageGenResult('ok', t('st.imagegen.cleared'));
- return;
- }
-
- await chrome.storage.local.set({
- imageGenModel: { apiKey, model },
- });
- flashImageGenResult('ok', t('st.imagegen.saved'));
- });
+function readImageGenForm() {
+ const provider = imageGenProviderInput?.value || 'fal';
+ if (provider === 'comfyui') return { provider, baseUrl: imageGenBaseUrlInput.value.trim() || MEDIA_PROVIDERS.comfyui.baseUrl, workflow: imageGenWorkflowInput.value.trim() };
+ const config = { provider, apiKey: imageGenApiKeyInput.value.trim(), model: imageGenModelInput.value.trim() };
+ if (provider === 'comfyrouter') config.parameters = imageGenParametersInput.value.trim() || '{}';
+ return config;
}
-if (btnTestImageGen) {
- btnTestImageGen.addEventListener('click', async () => {
- const apiKey = imageGenApiKeyInput.value.trim();
- const model = imageGenModelInput.value.trim();
+function updateImageGenProvider() {
+ const provider = imageGenProviderInput?.value || 'fal';
+ const meta = MEDIA_PROVIDERS[provider] || MEDIA_PROVIDERS.fal;
+ const local = provider === 'comfyui';
+ for (const [id, hidden] of [['image-gen-key-field', local], ['image-gen-model-field', local], ['image-gen-url-field', !local], ['image-gen-workflow-field', !local], ['image-gen-parameters-field', provider !== 'comfyrouter']]) {
+ const field = document.getElementById(id); if (field) field.hidden = hidden;
+ }
+ if (imageGenApiKeyInput) imageGenApiKeyInput.placeholder = meta.keyPlaceholder || '';
+ if (imageGenModelInput) imageGenModelInput.placeholder = meta.model || '';
+ const hint = document.getElementById('image-gen-provider-hint');
+ if (hint) hint.textContent = t(`st.imagegen.hint.${provider}`) + ' ';
+ const docs = document.getElementById('image-gen-docs'); if (docs) docs.href = meta.docs;
+}
+
+function renderImageGenConfig(config) {
+ const provider = Object.hasOwn(MEDIA_PROVIDERS, mediaProvider(config)) ? mediaProvider(config) : 'fal';
+ imageGenCurrentProvider = provider;
+ if (imageGenProviderInput) imageGenProviderInput.value = provider;
+ if (imageGenApiKeyInput) imageGenApiKeyInput.value = config.apiKey || '';
+ if (imageGenModelInput) imageGenModelInput.value = config.model || '';
+ if (imageGenBaseUrlInput) imageGenBaseUrlInput.value = config.baseUrl || MEDIA_PROVIDERS.comfyui.baseUrl;
+ if (imageGenWorkflowInput) imageGenWorkflowInput.value = typeof config.workflow === 'object' ? JSON.stringify(config.workflow, null, 2) : config.workflow || '';
+ if (imageGenParametersInput) imageGenParametersInput.value = typeof config.parameters === 'object' ? JSON.stringify(config.parameters, null, 2) : config.parameters || '';
+ updateImageGenProvider();
+}
+
+imageGenProviderInput?.addEventListener('change', () => {
+ const selected = imageGenProviderInput.value;
+ // Preserve unsaved drafts while switching, and never reuse another provider's key.
+ imageGenProviderInput.value = imageGenCurrentProvider;
+ imageGenDrafts.set(imageGenCurrentProvider, readImageGenForm());
+ renderImageGenConfig(imageGenDrafts.get(selected) || { provider: selected });
+ if (imageGenTestResult) imageGenTestResult.classList.remove('show');
+});
+document.addEventListener('wb-locale-changed', updateImageGenProvider);
- if (!apiKey || !model) {
- const resultEl = showImageGenResult('fail', t('st.imagegen.fill_required'));
- if (resultEl) setTimeout(() => resultEl.classList.remove('show'), 2500);
- return;
- }
+async function saveImageGenForm() {
+ const config = readImageGenForm();
+ validateMediaConfig(config);
+ await chrome.storage.local.set({ imageGenModel: config });
+ return config;
+}
- // Persist before testing so the background handler sees the values.
- await chrome.storage.local.set({
- imageGenModel: { apiKey, model },
- });
+btnSaveImageGen?.addEventListener('click', async () => {
+ try { await saveImageGenForm(); flashImageGenResult('ok', t('st.imagegen.saved')); }
+ catch (error) { showImageGenResult('fail', t('st.imagegen.failed', { error: error.message })); }
+});
+btnTestImageGen?.addEventListener('click', async () => {
+ btnTestImageGen.disabled = true;
+ try {
+ const config = await saveImageGenForm();
showImageGenResult('', t('st.imagegen.testing'), 'var(--text2)');
+ const res = await sendToBackground('test_image_gen_provider');
+ if (res?.ok) showImageGenResult('ok', t('st.imagegen.connected', { model: res.model || config.model }));
+ else showImageGenResult('fail', t('st.imagegen.failed', { error: res?.error || 'Unknown error' }));
+ } catch (error) { showImageGenResult('fail', t('st.imagegen.failed', { error: error.message })); }
+ finally { btnTestImageGen.disabled = false; }
+});
- try {
- const res = await sendToBackground('test_image_gen_provider');
- if (res?.ok) {
- showImageGenResult('ok', t('st.imagegen.connected', { model: res.model || model }));
- } else {
- showImageGenResult('fail', t('st.imagegen.failed', { error: res?.error || 'Unknown error' }));
- }
- } catch (e) {
- showImageGenResult('fail', t('st.imagegen.failed', { error: e.message }));
- }
- });
-}
-
-if (btnClearImageGen) {
- btnClearImageGen.addEventListener('click', async () => {
- imageGenApiKeyInput.value = '';
- imageGenModelInput.value = '';
- await chrome.storage.local.remove('imageGenModel');
- flashImageGenResult('ok', t('st.imagegen.cleared'));
- });
-}
+btnClearImageGen?.addEventListener('click', async () => {
+ const provider = imageGenProviderInput.value;
+ imageGenDrafts.clear();
+ renderImageGenConfig({ provider });
+ await chrome.storage.local.remove('imageGenModel');
+ flashImageGenResult('ok', t('st.imagegen.cleared'));
+});
// --- Profile auto-fill ---
let profileSyncChallenge = null;
@@ -1999,9 +2018,7 @@ async function reloadProfileSyncData() {
if (transcriptionApiKeyInput) transcriptionApiKeyInput.value = transcription.apiKey || '';
if (transcriptionModelInput) transcriptionModelInput.value = transcription.model || '';
updateMultimodalDetectedProvider('transcription');
- const imageGen = stored.imageGenModel || {};
- if (imageGenApiKeyInput) imageGenApiKeyInput.value = imageGen.apiKey || '';
- if (imageGenModelInput) imageGenModelInput.value = imageGen.model || '';
+ renderImageGenConfig(stored.imageGenModel || {});
await loadUserMemorySettings();
const res = await sendToBackground('get_providers');
providersData = res.providers;
diff --git a/src/chrome/src/ui/sidepanel.js b/src/chrome/src/ui/sidepanel.js
index 0dfcdd881..b579d87e9 100644
--- a/src/chrome/src/ui/sidepanel.js
+++ b/src/chrome/src/ui/sidepanel.js
@@ -1,3 +1,4 @@
+import { appendGeneratedMedia, restoreGeneratedMedia } from './generated-media-view.js';
/**
* WebBrain Side Panel — Chat UI logic.
* Default: compact history in chat plus the live label; click for status-only mode.
@@ -7231,6 +7232,7 @@ function renderAgentErrorUpdate(data, tabId = currentTabId, requestId = '', opti
}
function rebindRestoredMessageControls() {
+ void restoreGeneratedMedia(messagesEl, t);
restoreStagedScreenshotAttachments();
rebindCopyButtons();
rebindMessageInfoToggles();
@@ -10158,6 +10160,10 @@ function handleAgentUpdateMessage(msg) {
case 'tool_result':
if (currentAssistantEl) {
+ if (data.name === 'generate_image') {
+ void appendGeneratedMedia(currentAssistantEl.querySelector('.message-content'), data.result, t);
+ schedulePersist();
+ }
if (verboseMode) appendVerboseToolResult(data.name, data.result);
else markLastStepDone(data.name, data.result);
}
diff --git a/src/firefox/src/agent/agent.js b/src/firefox/src/agent/agent.js
index 8e0a708bf..6994e310e 100644
--- a/src/firefox/src/agent/agent.js
+++ b/src/firefox/src/agent/agent.js
@@ -122,7 +122,8 @@ import {
visionGenerationOptions,
} from '../providers/provider-compatibility.js';
import { resolveMaxOutputTokens } from '../providers/context-windows.js';
-import { generateImage } from './fal-media.js';
+import { generateImage, readMediaConfig } from './generative-media.js';
+import { mediaPermissionUrl, validateMediaConfig } from './media-config.js';
import { extractFirstJsonObject } from './json-extract.js';
import { repairAssistantDisplayText, sanitizeText as sanitizePlannerText } from './text-sanitize.js';
import { emptyOutputFailureMessage, modelOutputDiagnostics } from './model-output-diagnostics.js';
@@ -11110,6 +11111,19 @@ Rules: no prose intro, no conclusion, no "this screenshot shows...", no layout d
continue;
}
const otpEmailPermissionArgs = otpEmailPreparation.permissionArgs;
+ let imageGenConfig;
+ let imageGenPermissionUrl = '';
+ if (fnName === 'generate_image') {
+ try {
+ imageGenConfig = await readMediaConfig();
+ validateMediaConfig(imageGenConfig);
+ imageGenPermissionUrl = mediaPermissionUrl(imageGenConfig);
+ } catch (error) {
+ const recovery = await recordPreparationFailure(toolIndex, fnName, fnArgs, { success: false, error: error.message });
+ if (recovery) return recovery;
+ continue;
+ }
+ }
const mediaTargetGuard = await this._downloadPublicMediaExplicitUrlGuard(tabId, fnName, fnArgs);
if (mediaTargetGuard) {
@@ -11587,7 +11601,9 @@ Rules: no prose intro, no conclusion, no "this screenshot shows...", no layout d
if (capability === Capability.NETWORK && isNetworkMutation(fnName, fnArgs) && apiMutationsAllowedForRun()) continue;
// Every distinct host the call touches must be granted. Usually one,
// but download_files takes a urls[] array that can span many hosts.
- const gateArgs = fnName === OTP_EMAIL_TOOL_NAME && otpEmailPermissionArgs
+ const gateArgs = fnName === 'generate_image'
+ ? { _generativeMediaUrl: imageGenPermissionUrl }
+ : fnName === OTP_EMAIL_TOOL_NAME && otpEmailPermissionArgs
? otpEmailPermissionArgs
: this._skillPermissionArgsForCapability(skillCallTool, capability, fnArgs);
const hosts = requiredHosts(capability, gateArgs, curUrl, fnName);
@@ -11915,6 +11931,7 @@ Rules: no prose intro, no conclusion, no "this screenshot shows...", no layout d
dispatchBinding: pipelineToolbarPreflight.probe?.dispatchBinding || null,
...messageRecipientExecutionContext,
iframeTargetUnresolved: pipelineToolbarPreflight.iframeTargetUnresolved === true,
+ imageGenConfig,
_contentActionAbortSignal: abortSignal,
_contentActionDispatchState: actionDispatchState,
},
@@ -29427,6 +29444,10 @@ Rules: no prose intro, no conclusion, no "this screenshot shows...", no layout d
*/
_limitToolResult(result, maxResultChars = STANDARD_TOOL_RESULT_CHARS) {
maxResultChars = Number(maxResultChars) === 16000 ? 16000 : STANDARD_TOOL_RESULT_CHARS;
+ // Inline media is rendered for the user; base64 bytes have no value in model context.
+ if (result?.success && result?.provider && (result.inlineMedia || /^data:(image|video|audio)\//.test(result.url || ''))) {
+ result = { ...result, url: undefined, mediaId: undefined, inlineMedia: true, note: 'Generated media is displayed in the chat with a save link. Tell the user it is ready; do not invent a hosted URL.' };
+ }
const windowSafeResult = isReadPageWindowResult(result)
? fitReadPageWindowResult(result, maxResultChars)
: result;
@@ -32810,7 +32831,7 @@ Rules: no prose intro, no conclusion, no "this screenshot shows...", no layout d
return await this._restrictedDomainScreenshotFallback(tabId, name, args.url, result);
}
if (name === 'generate_image') {
- return await generateImage(args, { signal: executionContext?._contentActionAbortSignal });
+ return await generateImage(args, { signal: executionContext?._contentActionAbortSignal, ...(executionContext?.imageGenConfig ? { config: executionContext.imageGenConfig } : {}) });
}
if (name === 'read_page_source') {
const result = await readPageSource(args.url, args, { tabId, signal: executionContext?._contentActionAbortSignal });
diff --git a/src/firefox/src/agent/fal-media.js b/src/firefox/src/agent/fal-media.js
index 1994f5812..d90dc5442 100644
--- a/src/firefox/src/agent/fal-media.js
+++ b/src/firefox/src/agent/fal-media.js
@@ -1,6 +1,6 @@
// fal.ai generative media (assistive model).
//
-// Configured in Settings -> Assistive Models -> "Generative media (fal.ai)"
+// Configured in Settings -> Assistive Models -> Generative Media (fal.ai provider).
// and stored in extension storage as `imageGenModel = { apiKey, model }`.
// fal.ai uses a queue API: submit a prompt, poll status_url, then fetch
// response_url. Auth uses `Authorization: Key <FAL_KEY>`.
@@ -20,9 +20,7 @@ export function normalizeFalModelId(model) {
return id;
}
-export function isImageGenConfigured(cfg) {
- return !!(cfg && cfg.apiKey && cfg.model);
-}
+export { isImageGenConfigured } from './media-config.js';
export function falQueueSubmitUrl(model) {
return `${FAL_QUEUE_BASE}/${model}`;
@@ -150,6 +148,7 @@ export async function runFalGeneration({
throwIfAborted(operation.signal);
const submitRes = await fetchImpl(falQueueSubmitUrl(model), {
method: 'POST',
+ redirect: 'error', credentials: 'omit',
headers,
body: JSON.stringify({ prompt: text }),
signal: operation.signal,
@@ -177,7 +176,7 @@ export async function runFalGeneration({
let status = 'IN_QUEUE';
while (true) {
await abortableDelay(FAL_STATUS_POLL_INTERVAL_MS, operation.signal);
- const statusRes = await fetchImpl(statusUrl, { headers, signal: operation.signal });
+ const statusRes = await fetchImpl(statusUrl, { headers, signal: operation.signal, redirect: 'error', credentials: 'omit' });
if (!statusRes.ok) throw new Error(`fal.ai status check failed (HTTP ${statusRes.status}).`);
let statusPayload;
@@ -188,7 +187,7 @@ export async function runFalGeneration({
}
status = String(statusPayload?.status || '').toUpperCase();
if (status === 'COMPLETED') {
- const resultRes = await fetchImpl(responseUrl, { headers, signal: operation.signal });
+ const resultRes = await fetchImpl(responseUrl, { headers, signal: operation.signal, redirect: 'error', credentials: 'omit' });
if (!resultRes.ok) throw new Error(`fal.ai result fetch failed (HTTP ${resultRes.status}).`);
let payload;
@@ -217,54 +216,13 @@ export async function runFalGeneration({
}
}
-/** Agent tool entry point. Reads the assistive-model config from storage. */
+// Legacy entry points retained for callers importing fal-media.js.
export async function generateImage(args, options = {}) {
- const fetchImpl = typeof options === 'function' ? options : (options.fetchImpl || fetch);
- const signal = typeof options === 'object' ? options.signal : null;
- let cfg;
- const api = (typeof browser !== 'undefined' && browser?.storage) ? browser
- : (typeof chrome !== 'undefined' ? chrome : null);
- try {
- const stored = await api.storage.local.get([IMAGE_GEN_MODEL_KEY]);
- cfg = stored?.[IMAGE_GEN_MODEL_KEY];
- } catch (error) {
- return { success: false, error: 'Failed to read generative media config: ' + error.message };
- }
- if (!isImageGenConfigured(cfg)) {
- return { success: false, error: 'Generative media is not configured. Set up fal.ai in Settings -> Assistive Models.' };
- }
- try {
- const result = await runFalGeneration({ prompt: args?.prompt, config: cfg, fetchImpl, signal });
- return { success: true, url: result.url, model: result.model };
- } catch (error) {
- return { success: false, error: error.message };
- }
+ const media = await import('./generative-media.js');
+ return media.generateImage(args, options);
}
-/** Verify a key against a free, read-only endpoint that requires authentication. */
export async function testImageGenProvider(fetchImpl = fetch) {
- let cfg;
- const api = (typeof browser !== 'undefined' && browser?.storage) ? browser
- : (typeof chrome !== 'undefined' ? chrome : null);
- try {
- const stored = await api.storage.local.get([IMAGE_GEN_MODEL_KEY]);
- cfg = stored?.[IMAGE_GEN_MODEL_KEY];
- } catch (error) {
- return { ok: false, error: 'Failed to read generative media config: ' + error.message };
- }
- if (!isImageGenConfigured(cfg)) {
- return { ok: false, error: 'Generative media not configured (API Key and Model are required).' };
- }
- const model = normalizeFalModelId(cfg.model);
- if (!model) return { ok: false, error: 'Invalid fal.ai model id.' };
- try {
- const res = await fetchImpl(FAL_AUTH_PROBE_URL, { headers: await falAuthHeaders(cfg.apiKey) });
- if (res.status === 401 || res.status === 403) {
- return { ok: false, error: 'fal.ai rejected the API key (HTTP ' + res.status + ').' };
- }
- if (res.ok) return { ok: true, model };
- return { ok: false, error: `Unexpected response from fal.ai (HTTP ${res.status}).` };
- } catch (error) {
- return { ok: false, error: error.message };
- }
+ const media = await import('./generative-media.js');
+ return media.testImageGenProvider(fetchImpl);
}
diff --git a/src/firefox/src/agent/generative-media.js b/src/firefox/src/agent/generative-media.js
new file mode 100644
index 000000000..f87a3104a
--- /dev/null
+++ b/src/firefox/src/agent/generative-media.js
@@ -0,0 +1,232 @@
+import { runFalGeneration, FAL_AUTH_PROBE_URL } from './fal-media.js';
+import { storeGeneratedMedia } from '../generated-media-store.js';
+import { IMAGE_GEN_MODEL_KEY, MEDIA_PROVIDERS, mediaProvider, normalizeMediaModel, comfyBaseUrl, parseMediaJson, validateMediaConfig, bindMediaPrompt } from './media-config.js';
+
+const GENERATION_TIMEOUT_MS = 600000;
+const MAX_INLINE_BYTES = 20 * 1024 * 1024;
+const INLINE_MEDIA = /^data:(image\/(?:png|jpeg|webp|gif)|audio\/(?:mpeg|wav|ogg)|video\/mp4);base64,[A-Za-z0-9+/=\s]+$/;
+
+export function safeMediaUrl(value) {
+ if (typeof value !== 'string') return '';
+ if (value.length <= MAX_INLINE_BYTES * 1.4 && INLINE_MEDIA.test(value)) return value;
+ try { const url = new URL(value); return url.protocol === 'https:' && !url.username && !url.password ? url.href : ''; } catch { return ''; }
+}
+
+function base64Media(bytes, mime) {
+ if (!bytes || bytes.length > MAX_INLINE_BYTES * 1.4 || !/^[A-Za-z0-9+/=\s]+$/.test(bytes)) return '';
+ return safeMediaUrl(`data:${mime || 'image/png'};base64,${bytes}`);
+}
+
+// Known media fields only: never mistake an API/status URL for the generated asset.
+export function extractMediaUrl(payload, depth = 0) {
+ if (!payload || typeof payload !== 'object' || depth > 8) return '';
+ if (Array.isArray(payload)) {
+ for (const item of payload) { const url = safeMediaUrl(item) || extractMediaUrl(item, depth + 1); if (url) return url; }
+ return '';
+ }
+ if (payload.b64_json) { const url = base64Media(payload.b64_json, payload.media_type); if (url) return url; }
+ if (payload.inlineData || payload.inline_data) {
+ const data = payload.inlineData || payload.inline_data;
+ const url = base64Media(data.data, data.mimeType || data.mime_type); if (url) return url;
+ }
+ // Native Comfy Router outputs (e.g. Luma) include preview assets too.
+ // Prefer the final video/audio over its image; progress_video is not a result.
+ for (const key of ['video', 'audio', 'image']) {
+ const asset = payload.assets?.[key];
+ const url = safeMediaUrl(asset) || extractMediaUrl(asset, depth + 1); if (url) return url;
+ }
+ for (const key of ['url', 'sample', 'image_url', 'video_url', 'audio_url']) {
+ const url = safeMediaUrl(payload[key]) || extractMediaUrl(payload[key], depth + 1); if (url) return url;
+ }
+ for (const key of ['data', 'result', 'output', 'images', 'image', 'videos', 'video', 'audio', 'candidates', 'content', 'parts']) {
+ const url = safeMediaUrl(payload[key]) || extractMediaUrl(payload[key], depth + 1); if (url) return url;
+ }
+ return '';
+}
+
+function operationSignal(signal, timeoutMs) {
+ const controller = new AbortController();
+ const onAbort = () => controller.abort(signal.reason || new DOMException('Generation cancelled.', 'AbortError'));
+ if (signal?.aborted) onAbort(); else signal?.addEventListener('abort', onAbort, { once: true });
+ const timer = setTimeout(() => controller.abort(new DOMException('Generative media timed out.', 'TimeoutError')), timeoutMs);
+ return { signal: controller.signal, dispose() { clearTimeout(timer); signal?.removeEventListener('abort', onAbort); } };
+}
+
+function delay(ms, signal) {
+ signal.throwIfAborted();
+ return new Promise((resolve, reject) => {
+ const onAbort = () => { clearTimeout(timer); reject(signal.reason); };
+ const timer = setTimeout(() => { signal.removeEventListener('abort', onAbort); resolve(); }, ms);
+ signal.addEventListener('abort', onAbort, { once: true });
+ });
+}
+
+async function jsonResponse(response, label) {
+ if (!response.ok) {
+ let message = '';
+ try { message = (await response.text()).slice(0, 300); } catch { /* no body */ }
+ throw new Error(`${label} failed (HTTP ${response.status})${message ? ': ' + message : '.'}`);
+ }
+ const body = await response.json();
+ if (body?.error || body?.error_type) throw new Error(`${label}: ${body.error?.message || body.error_type || body.error}`);
+ return body;
+}
+
+function pollDelay(response, fallback) {
+ const seconds = Number(response.headers?.get?.('Retry-After'));
+ return Number.isFinite(seconds) && seconds > 0 ? Math.min(seconds * 1000, 60000) : fallback;
+}
+
+async function cancelRequest(url, init, fetchImpl) {
+ if (!url) return;
+ const controller = new AbortController();
+ const timer = setTimeout(() => controller.abort(), 2000);
+ try { await fetchImpl(url, { ...init, signal: controller.signal, redirect: 'error', credentials: 'omit' }); } catch { /* best effort */ }
+ finally { clearTimeout(timer); }
+}
+
+async function mediaResponse(response, label) {
+ const mime = (response.headers?.get?.('Content-Type') || '').split(';')[0].trim();
+ if (response.ok && /^(image\/(?:png|jpeg|webp|gif)|audio\/(?:mpeg|wav|ogg)|video\/mp4)$/.test(mime)) {
+ const bytes = new Uint8Array(await response.arrayBuffer());
+ if (bytes.length > MAX_INLINE_BYTES) throw new Error('Generated media exceeds the 20 MB inline limit. Choose a model that returns hosted media.');
+ let binary = '';
+ for (let offset = 0; offset < bytes.length; offset += 8192) binary += String.fromCharCode(...bytes.subarray(offset, offset + 8192));
+ return `data:${mime};base64,${btoa(binary)}`;
+ }
+ const payload = await jsonResponse(response, label);
+ const url = extractMediaUrl(payload);
+ if (!url) throw new Error(`${label} returned no supported media URL or inline media.`);
+ return url;
+}
+
+export async function runMediaGeneration({ prompt, config, fetchImpl = fetch, signal, timeoutMs = GENERATION_TIMEOUT_MS, pollIntervalMs = 2000 }) {
+ const provider = validateMediaConfig(config);
+ const text = String(prompt || '').trim();
+ if (!text) throw new Error('prompt is required.');
+ if (provider === 'fal') return runFalGeneration({ prompt: text, config, fetchImpl, signal, timeoutMs });
+ const operation = operationSignal(signal, timeoutMs);
+ const model = provider === 'comfyui' ? 'ComfyUI workflow' : normalizeMediaModel(config.model);
+ const request = (url, init = {}) => {
+ operation.signal.throwIfAborted();
+ return fetchImpl(url, { ...init, signal: operation.signal, redirect: 'error', credentials: 'omit' });
+ };
+ let cancelUrl = '', cancelInit;
+ let completed = false;
+ try {
+ if (provider === 'openrouter') {
+ const res = await request('https://openrouter.ai/api/v1/images', {
+ method: 'POST', headers: { Authorization: `Bearer ${config.apiKey}`, 'Content-Type': 'application/json' },
+ body: JSON.stringify({ model, prompt: text }),
+ });
+ return { url: await mediaResponse(res, 'OpenRouter generation'), model };
+ }
+ if (provider === 'comfyrouter') {
+ const base = `https://api.comfy.org/v2/models/${model}/requests`;
+ const headers = { 'X-API-Key': config.apiKey, 'Content-Type': 'application/json' };
+ const parameters = parseMediaJson(config.parameters || '{}', 'Model input');
+ const usesTemplate = JSON.stringify(parameters).includes('{{prompt}}');
+ const body = usesTemplate ? bindMediaPrompt(parameters, text) : { ...parameters, prompt: text };
+ const queued = await jsonResponse(await request(base, {
+ method: 'POST', headers: { ...headers, 'Idempotency-Key': crypto.randomUUID() }, body: JSON.stringify(body),
+ }), 'Comfy Router submit');
+ if (!/^[A-Za-z0-9_-]+$/.test(queued.request_id || '')) throw new Error('Comfy Router returned an invalid request ID.');
+ // Build authenticated URLs ourselves; never send the key to returned URLs.
+ const resultUrl = `${base}/${queued.request_id}`;
+ cancelUrl = `${resultUrl}/cancel`; cancelInit = { method: 'PUT', headers };
+ let waitMs = pollIntervalMs;
+ while (true) {
+ await delay(waitMs, operation.signal);
+ const res = await request(`${resultUrl}/status`, { headers });
+ const status = await jsonResponse(res, 'Comfy Router status');
+ waitMs = pollDelay(res, pollIntervalMs);
+ if (status.status === 'COMPLETED') {
+ const result = await request(resultUrl, { headers });
+ if (result.status === 202) { waitMs = pollDelay(result, pollIntervalMs); continue; }
+ const url = await mediaResponse(result, 'Comfy Router generation');
+ completed = true;
+ return { url, model };
+ }
+ if (!['IN_QUEUE', 'IN_PROGRESS'].includes(status.status)) throw new Error('Comfy Router returned an unknown queue status.');
+ }
+ }
+ const base = comfyBaseUrl(config.baseUrl);
+ const headers = { 'Content-Type': 'application/json' };
+ const workflow = bindMediaPrompt(parseMediaJson(config.workflow, 'ComfyUI workflow'), text);
+ const queued = await jsonResponse(await request(`${base}/prompt`, {
+ method: 'POST', headers, body: JSON.stringify({ prompt: workflow, client_id: crypto.randomUUID() }),
+ }), 'ComfyUI submit');
+ if (!/^[A-Za-z0-9_-]+$/.test(queued.prompt_id || '')) throw new Error('ComfyUI returned an invalid prompt ID.');
+ // Delete this queued prompt only. /interrupt could stop someone else's running workflow.
+ cancelUrl = `${base}/queue`; cancelInit = { method: 'POST', headers, body: JSON.stringify({ delete: [queued.prompt_id] }) };
+ while (true) {
+ await delay(pollIntervalMs, operation.signal);
+ const history = await jsonResponse(await request(`${base}/history/${queued.prompt_id}`), 'ComfyUI history');
+ const item = history[queued.prompt_id];
+ if (!item) continue;
+ if (item.status?.status_str === 'error') throw new Error('ComfyUI workflow failed. Check the workflow, installed nodes, and local models.');
+ for (const output of Object.values(item.outputs || {})) {
+ for (const key of ['images', 'gifs', 'videos', 'audio']) for (const file of output[key] || []) {
+ if (typeof file.filename !== 'string' || !file.filename || file.type === 'temp') continue;
+ const params = new URLSearchParams({ filename: file.filename, subfolder: file.subfolder || '', type: file.type || 'output' });
+ completed = true;
+ return { url: `${base}/view?${params}`, model };
+ }
+ }
+ if (item.status?.completed || item.status?.status_str === 'success') throw new Error('ComfyUI workflow completed without saved media. Add a Save Image or media output node.');
+ }
+ } catch (error) {
+ if (!completed && cancelUrl) await cancelRequest(cancelUrl, cancelInit, fetchImpl);
+ throw operation.signal.aborted ? operation.signal.reason : error;
+ } finally { operation.dispose(); }
+}
+
+export async function readMediaConfig() {
+ const api = typeof browser !== 'undefined' && browser?.storage ? browser : globalThis.chrome;
+ const stored = await api.storage.local.get([IMAGE_GEN_MODEL_KEY]);
+ return stored?.[IMAGE_GEN_MODEL_KEY];
+}
+
+export async function generateImage(args, options = {}) {
+ const fetchImpl = typeof options === 'function' ? options : options.fetchImpl || fetch;
+ try {
+ const config = Object.hasOwn(options, 'config') ? options.config : await readMediaConfig();
+ if (!config) throw new Error('Configure Generative Media in Settings → Assistive Models.');
+ const result = await runMediaGeneration({ prompt: args?.prompt, config, fetchImpl, signal: options.signal });
+ if (result.url.startsWith('data:')) {
+ const asset = await storeGeneratedMedia(result.url);
+ return { success: true, model: result.model, provider: mediaProvider(config), ...asset };
+ }
+ return { success: true, ...result, provider: mediaProvider(config) };
+ } catch (error) { return { success: false, error: error.message }; }
+}
+
+// Free read-only probes. Model metadata confirms availability; no generation is submitted.
+export async function testImageGenProvider(fetchImpl = fetch) {
+ const operation = operationSignal(null, 15000);
+ try {
+ const config = await readMediaConfig();
+ const provider = validateMediaConfig(config);
+ const model = provider === 'comfyui' ? 'ComfyUI workflow' : normalizeMediaModel(config.model);
+ let url, headers;
+ if (provider === 'fal') { url = FAL_AUTH_PROBE_URL; headers = { Authorization: `Key ${config.apiKey}` }; }
+ if (provider === 'openrouter') { url = 'https://openrouter.ai/api/v1/key'; headers = { Authorization: `Bearer ${config.apiKey}` }; }
+ if (provider === 'comfyrouter') { url = `https://api.comfy.org/v2/models/${model}`; headers = { 'X-API-Key': config.apiKey }; }
+ if (provider === 'comfyui') { url = `${comfyBaseUrl(config.baseUrl)}/system_stats`; headers = {}; }
+ const res = await fetchImpl(url, { headers, signal: operation.signal, redirect: 'error', credentials: 'omit' });
+ if (!res.ok) throw new Error(`${MEDIA_PROVIDERS[provider].label} connection failed (HTTP ${res.status}).`);
+ if (provider === 'openrouter') {
+ await jsonResponse(res, 'OpenRouter key');
+ const catalog = await jsonResponse(await fetchImpl('https://openrouter.ai/api/v1/images/models', { headers, signal: operation.signal, redirect: 'error', credentials: 'omit' }), 'OpenRouter image models');
+ if (!catalog.data?.some(item => item.id === model)) throw new Error('The selected OpenRouter model is not in the image generation catalog.');
+ } else if (provider === 'comfyui') {
+ const stats = await jsonResponse(res, 'ComfyUI');
+ if (!stats.system || !Array.isArray(stats.devices)) throw new Error('The endpoint did not return ComfyUI system information.');
+ } else if (provider === 'comfyrouter') {
+ const detail = await jsonResponse(res, 'Comfy Router model');
+ if (detail.id !== model) throw new Error('Comfy Router did not confirm the selected model.');
+ }
+ return { ok: true, model, provider };
+ } catch (error) { return { ok: false, error: error.message }; }
+ finally { operation.dispose(); }
+}
diff --git a/src/firefox/src/agent/media-config.js b/src/firefox/src/agent/media-config.js
new file mode 100644
index 000000000..4b548f2ad
--- /dev/null
+++ b/src/firefox/src/agent/media-config.js
@@ -0,0 +1,82 @@
+// Provider settings are user-authored. Model tool arguments never select a host or key.
+export const IMAGE_GEN_MODEL_KEY = 'imageGenModel';
+export const MEDIA_PROVIDERS = Object.freeze({
+ fal: { label: 'fal.ai', model: 'fal-ai/flux/schnell', keyPlaceholder: 'FAL_KEY', docs: 'https://fal.ai/dashboard/keys' },
+ openrouter: { label: 'OpenRouter', model: 'google/gemini-2.5-flash-image', keyPlaceholder: 'sk-or-…', docs: 'https://openrouter.ai/docs/guides/overview/multimodal/image-generation' },
+ comfyrouter: { label: 'Comfy Router', model: 'bfl/flux-2-pro', keyPlaceholder: 'comfyui-…', docs: 'https://docs.comfy.org/development/comfy-router/quickstart' },
+ comfyui: { label: 'ComfyUI (localhost)', baseUrl: 'http://127.0.0.1:8188', docs: 'https://docs.comfy.org/development/comfyui-server/comms_routes' },
+});
+
+export function mediaProvider(config) {
+ // Previously saved { apiKey, model } settings remain fal.ai settings.
+ return config?.provider == null ? 'fal' : String(config.provider);
+}
+
+export function normalizeMediaModel(value) {
+ const model = String(value || '').trim().replace(/^\/+|\/+$/g, '');
+ return /^[A-Za-z0-9][A-Za-z0-9._\-/]*$/.test(model) && !model.includes('..') ? model : '';
+}
+
+export function comfyBaseUrl(value) {
+ const url = new URL(String(value || MEDIA_PROVIDERS.comfyui.baseUrl).trim());
+ if (!['http:', 'https:'].includes(url.protocol) || url.username || url.password || url.search || url.hash
+ || !['localhost', '127.0.0.1', '[::1]'].includes(url.hostname.toLowerCase())) {
+ throw new Error('ComfyUI URL must use localhost, 127.0.0.1, or [::1], without credentials, query, or fragment.');
+ }
+ return url.href.replace(/\/+$/, '');
+}
+
+export function parseMediaJson(value, label) {
+ let parsed = value;
+ if (typeof value === 'string') {
+ if (value.length > 1024 * 1024) throw new Error(`${label} exceeds 1 MB.`);
+ try { parsed = JSON.parse(value || '{}'); } catch { throw new Error(`${label} must be valid JSON.`); }
+ }
+ if (!parsed || typeof parsed !== 'object' || Array.isArray(parsed)) throw new Error(`${label} must be a JSON object.`);
+ return parsed;
+}
+
+export function validateMediaConfig(config) {
+ const provider = mediaProvider(config);
+ if (!Object.hasOwn(MEDIA_PROVIDERS, provider)) throw new Error('Unknown generative media provider.');
+ if (provider === 'comfyui') {
+ comfyBaseUrl(config?.baseUrl);
+ const workflow = parseMediaJson(config?.workflow, 'ComfyUI workflow');
+ const nodes = Object.values(workflow);
+ if (!nodes.length || nodes.some(node => !node || typeof node.class_type !== 'string'
+ || !node.inputs || typeof node.inputs !== 'object' || Array.isArray(node.inputs))) {
+ throw new Error('Export a ComfyUI workflow in API format (node IDs, class_type, and inputs).');
+ }
+ if (!nodes.some(node => Object.values(node.inputs).some(value => typeof value === 'string' && value.includes('{{prompt}}')))) {
+ throw new Error('Replace the positive prompt text in the ComfyUI workflow with {{prompt}}.');
+ }
+ } else {
+ if (!String(config?.apiKey || '').trim()) throw new Error('API Key is required.');
+ const model = normalizeMediaModel(config?.model);
+ if (!model) throw new Error('A valid model ID is required.');
+ if (provider === 'comfyrouter' && model.split('/').length !== 2) throw new Error('Comfy Router model IDs use provider/model.');
+ if (provider === 'comfyrouter') parseMediaJson(config?.parameters || '{}', 'Model input');
+ }
+ return provider;
+}
+
+export function isImageGenConfigured(config) {
+ try { validateMediaConfig(config); return true; } catch { return false; }
+}
+
+export function mediaPermissionUrl(config) {
+ switch (mediaProvider(config)) {
+ case 'fal': return 'https://queue.fal.run';
+ case 'openrouter': return 'https://openrouter.ai';
+ case 'comfyrouter': return 'https://api.comfy.org';
+ case 'comfyui': return comfyBaseUrl(config?.baseUrl);
+ default: return '';
+ }
+}
+
+export function bindMediaPrompt(value, prompt) {
+ if (typeof value === 'string') return value.replaceAll('{{prompt}}', prompt);
+ if (Array.isArray(value)) return value.map(item => bindMediaPrompt(item, prompt));
+ if (value && typeof value === 'object') return Object.fromEntries(Object.entries(value).map(([key, item]) => [key, bindMediaPrompt(item, prompt)]));
+ return value;
+}
diff --git a/src/firefox/src/agent/permission-gate.js b/src/firefox/src/agent/permission-gate.js
index b5a4797ce..7f13a06e2 100644
--- a/src/firefox/src/agent/permission-gate.js
+++ b/src/firefox/src/agent/permission-gate.js
@@ -88,7 +88,7 @@ export const UNTRUSTED_CONTENT_TOOLS = new Set([
'execute_webmcp_tool',
'fetch_url',
'research_url',
- // fal.ai returns provider-authored URLs and error text.
+ // Generative media providers return untrusted URLs and error text.
'generate_image',
// ChatGPT's answer and cited links are third-party page content.
'delegate_research',
@@ -415,7 +415,7 @@ const TOOL_CAPABILITY = {
chrome_web_store_publish: Capability.NETWORK,
schedule_resume: Capability.SCHEDULE,
schedule_task: Capability.SCHEDULE,
- // generate_image spends the user's fal.ai credits via a paid network call.
+ // generate_image submits to the user's configured media provider.
generate_image: Capability.NETWORK,
};
@@ -574,7 +574,7 @@ export function hostForCapability(capability, args, currentUrlOrHost, toolName)
return normalizeHost(args._otpMailboxUrl);
}
if (toolName === 'delegate_research') return 'chatgpt.com';
- if (toolName === 'generate_image') return 'queue.fal.run';
+ if (toolName === 'generate_image') return normalizeHost(args._generativeMediaUrl);
if (toolName === 'execute_webmcp_tool') {
// A tool can belong to a cross-origin frame. Charge mutations to that
// frame's resolved URL instead of borrowing the top-level page grant.
diff --git a/src/firefox/src/agent/planner.js b/src/firefox/src/agent/planner.js
index d159306f6..c6b484655 100644
--- a/src/firefox/src/agent/planner.js
+++ b/src/firefox/src/agent/planner.js
@@ -378,7 +378,7 @@ ${PLANNER_RESPONSE_LANGUAGE_RULES}
read: get_accessibility_tree, read_page, extract_data, fetch_url, research_url
interact: click_ax, set_checked, type_ax, set_field, find_text, press_keys, scroll, navigate, gmail_count_results, carousel_navigate, promote_iframe
wait: wait_for_element, wait_for_stable
- media: generate_image (create an image/video/audio directly from a text prompt via the user's fal.ai generative-media model — use when the user asks to GENERATE media, not to browse an image site)
+ media: generate_image (create an image/video/audio directly from a text prompt via the user's configured generative-media provider — use when the user asks to GENERATE media, not to browse an image site)
memory: scratchpad_write, progress_update, progress_read
schedule: schedule_task (future/recurring work the user explicitly asked for), schedule_resume (pause CURRENT run blocked on external event)
user input: clarify (pause and ask one concise question when a required value remains missing after relevant inspection)
@@ -468,7 +468,7 @@ ${PLANNER_RESPONSE_ONLY_RULES}
- Canonical summary, steps, and risks must be English. localized fields must use the requested wbLocale.
${PLANNER_RESPONSE_LANGUAGE_RULES}
- For execute, keep the compact plan to 1–4 steps. For plan_only, provide 2–8 useful steps. For respond and clarify, steps may be empty.
-- When the user asks to generate an image/video/audio, plan one generate_image step (WebBrain's built-in fal.ai media tool). Do not plan steps to visit image-generation sites or to check whether the current page supports image generation.
+- When the user asks to generate an image/video/audio, plan one generate_image step (WebBrain's built-in media tool). Do not plan steps to visit image-generation sites or to check whether the current page supports image generation.
- clarify pauses execution to ask one concise question for a required value. done is terminal and must never be used to request information needed to continue.
- press_keys supports only unmodified Escape, Tab, Enter, arrow keys, and ; (semicolon, for page shortcuts such as Gmail Expand all). Never plan modifier combinations or browser UI shortcuts; use find_text to select one page-text match instead of Ctrl/Cmd+F. Each call replaces the previous selection and cannot create simultaneous highlights or browser Find UI.
- For Instagram /p/<id>/ carousel enumeration, use strictly increasing carousel_navigate indexes unless the latest user request explicitly asks for reverse traversal, in which case use strictly decreasing indexes; never use arrow keys, coordinate clicks, Previous/Next, or go_back to traverse slides.
diff --git a/src/firefox/src/agent/tools.js b/src/firefox/src/agent/tools.js
index ad1a8c1ff..9546c4a98 100644
--- a/src/firefox/src/agent/tools.js
+++ b/src/firefox/src/agent/tools.js
@@ -1253,7 +1253,7 @@ export const AGENT_TOOLS = [
type: 'function',
function: {
name: 'generate_image',
- description: 'Generate media (usually an image) from a text prompt using the user\'s configured fal.ai assistive model (Settings → Assistive Models → Generative media). Runs on fal.ai\'s queue API and may take up to a minute. Returns the hosted media URL on success. Not available in Ask mode.',
+ description: 'Generate media (usually an image) from a text prompt using the user\'s configured generative media provider (Settings → Assistive Models → Generative Media). Supports fal.ai, OpenRouter, Comfy Router and local ComfyUI workflows; generation may take several minutes. Returns a media URL or inline media displayed in the chat. Not available in Ask mode.',
parameters: {
type: 'object',
properties: {
@@ -1994,7 +1994,7 @@ ${BROWSER_TAB_LIMITATION}
- scratchpad_write: Pin a note in context that survives summarization (use on long tasks to remember download IDs, file paths, plans)
- progress_update / progress_read: Structured app-owned ledger for the active repeated item/action task. Use it for per-user/per-item status and collected fields; close pending/acted rows before done.
- download_public_media (if enabled by a skill) / download_social_media: One-shot image/video download from public social sites. Prefer the enabled skill tool for public media URLs; otherwise use download_social_media. Single call — no need to inspect the DOM yourself.
-- generate_image: Create media (usually an image, sometimes video/audio) directly from a text prompt through the user's configured fal.ai generative-media model. When the user asks to GENERATE media ("generate an image of a red apple", "make a logo", "create a video clip"), call this tool — do NOT navigate to third-party image sites (Midjourney, DALL·E, Bing Images, etc.). Requires Settings → Assistive Models → Generative media. Not available in Ask mode.
+- generate_image: Create media (usually an image, sometimes video/audio) directly from a text prompt through the user's configured generative-media provider. When the user asks to GENERATE media ("generate an image of a red apple", "make a logo", "create a video clip"), call this tool — do NOT navigate to third-party image sites (Midjourney, DALL·E, Bing Images, etc.). Requires Settings → Assistive Models → Generative Media. Not available in Ask mode.
- hover: Synthetic hover over a ref_id (Firefox MV2 — no CDP). Use ONLY for menus/tooltips that REVEAL on hover (GitHub three-dot menus, Linear card actions). Re-read the tree after to find the newly-visible items. isTrusted=false, so sites with strict event-trust gating won't respond — fall back to clicking the explicit "..." button if hover doesn't reveal a menu.
- drag_drop: Synthetic drag from one ref_id to another (pointerdown/move/up + HTML5 dragstart/drop). Use for Trello/Linear/Notion-style card reordering, image-crop handles. Less reliable than Chrome's CDP path — verify by re-reading the tree.
- wait_for_stable: Wait until the page is quiet (no DOM mutations + no in-flight network) for \`quietMs\` ms. Use AFTER navigate / set_field({submit:true}) / a click that fires async work, BEFORE re-reading the tree. Different from wait_for_element: wait_for_element answers "did X appear", wait_for_stable answers "is the page done shuffling".
diff --git a/src/firefox/src/generated-media-store.js b/src/firefox/src/generated-media-store.js
new file mode 100644
index 000000000..5d8b27c5b
--- /dev/null
+++ b/src/firefox/src/generated-media-store.js
@@ -0,0 +1,50 @@
+// Keep inline assets outside the bounded run journal and serialized chat HTML.
+const DB_NAME = 'webbrain_generated_media';
+const STORE_NAME = 'assets';
+const MAX_BYTES = 20 * 1024 * 1024;
+const MEDIA_MIME = /^(image\/(?:png|jpeg|webp|gif)|audio\/(?:mpeg|wav|ogg)|video\/mp4)$/;
+
+async function openDB() {
+ return new Promise((resolve, reject) => {
+ const request = indexedDB.open(DB_NAME, 1);
+ request.onupgradeneeded = () => request.result.createObjectStore(STORE_NAME, { keyPath: 'id' });
+ request.onsuccess = () => resolve(request.result);
+ request.onerror = () => reject(request.error);
+ });
+}
+
+export async function storeGeneratedMedia(dataUrl) {
+ const match = /^data:([^;]+);base64,([A-Za-z0-9+/=\s]+)$/.exec(dataUrl || '');
+ if (!match || !MEDIA_MIME.test(match[1]) || match[2].length > MAX_BYTES * 1.4) throw new Error('Unsupported generated media.');
+ const binary = atob(match[2]);
+ if (binary.length > MAX_BYTES) throw new Error('Generated media exceeds the 20 MB inline limit.');
+ const bytes = Uint8Array.from(binary, char => char.charCodeAt(0));
+ const blob = new Blob([bytes], { type: match[1] });
+ const id = crypto.randomUUID();
+ const db = await openDB();
+ try {
+ await new Promise((resolve, reject) => {
+ const transaction = db.transaction(STORE_NAME, 'readwrite');
+ transaction.objectStore(STORE_NAME).put({ id, blob });
+ // Wait for commit before publishing a handle to other extension contexts.
+ transaction.oncomplete = resolve;
+ transaction.onabort = transaction.onerror = () => reject(transaction.error || new Error('Generated media could not be saved.'));
+ });
+ } finally { db.close(); }
+ return { mediaId: id, mimeType: blob.type, inlineMedia: true };
+}
+
+export async function loadGeneratedMedia(id) {
+ if (!/^[\da-f]{8}-[\da-f]{4}-[\da-f]{4}-[\da-f]{4}-[\da-f]{12}$/i.test(id || '')) return null;
+ const db = await openDB();
+ try {
+ return await new Promise((resolve, reject) => {
+ const request = db.transaction(STORE_NAME, 'readonly').objectStore(STORE_NAME).get(id);
+ request.onsuccess = () => {
+ const blob = request.result?.blob;
+ resolve(blob instanceof Blob && MEDIA_MIME.test(blob.type) && blob.size <= MAX_BYTES ? blob : null);
+ };
+ request.onerror = () => reject(request.error);
+ });
+ } finally { db.close(); }
+}
diff --git a/src/firefox/src/run-ui-journal.js b/src/firefox/src/run-ui-journal.js
index e3f1421ee..5de5f3b90 100644
--- a/src/firefox/src/run-ui-journal.js
+++ b/src/firefox/src/run-ui-journal.js
@@ -45,7 +45,7 @@ export function runUiSnapshotForRequest(snapshot, requestedRequestId = '') {
const RUN_UI_TOOL_RESULT_PREVIEW_CHARS = 500;
-function compactRunUiToolResult(result) {
+function compactRunUiToolResult(result, name) {
const source = result && typeof result === 'object' && !Array.isArray(result) ? result : {};
const compacted = {};
if (typeof source.success === 'boolean') compacted.success = source.success;
@@ -68,6 +68,14 @@ function compactRunUiToolResult(result) {
if (source.truncated === true) compacted.truncated = true;
if (source.hasMore === true) compacted.hasMore = true;
if (source.notice) compacted.notice = String(source.notice).slice(0, 300);
+ if (name === 'generate_image' && source.success === true) {
+ // Inline bytes live in IndexedDB; retain the asset handle for live delivery
+ // and replay. Hosted/local URLs are small enough to keep in the journal.
+ for (const key of ['url', 'mediaId', 'mimeType', 'provider', 'model']) {
+ if (typeof source[key] === 'string') compacted[key] = source[key];
+ }
+ if (source.inlineMedia === true) compacted.inlineMedia = true;
+ }
if (Object.keys(compacted).length === 0) {
try {
compacted.preview = String(JSON.stringify(source) || '{}').slice(0, 300);
@@ -83,7 +91,7 @@ export function compactRunUiData(type, data) {
if (type === 'tool_result') {
return {
name: data.name,
- result: compactRunUiToolResult(data.result),
+ result: compactRunUiToolResult(data.result, data.name),
};
}
if (type === 'text' || type === 'text_delta') {
diff --git a/src/firefox/src/ui/generated-media-view.js b/src/firefox/src/ui/generated-media-view.js
new file mode 100644
index 000000000..55f2ff4aa
--- /dev/null
+++ b/src/firefox/src/ui/generated-media-view.js
@@ -0,0 +1,65 @@
+import { loadGeneratedMedia } from '../generated-media-store.js';
+
+const objectUrls = new WeakMap();
+
+function renderPreview(wrapper, url, t, storedMime = '') {
+ let allowed = /^data:(image\/(?:png|jpeg|webp|gif)|audio\/(?:mpeg|wav|ogg)|video\/mp4);base64,[A-Za-z0-9+/=\s]+$/.test(url);
+ let parsed;
+ try {
+ parsed = new URL(url);
+ allowed ||= !parsed.username && !parsed.password && (parsed.protocol === 'https:'
+ || (['http:', 'https:'].includes(parsed.protocol) && ['localhost', '127.0.0.1', '[::1]'].includes(parsed.hostname)));
+ } catch { /* only supported media URLs */ }
+ // Blob URLs are accepted only when created here from a validated stored asset.
+ if (!allowed && objectUrls.get(wrapper) !== url) return;
+ const mime = storedMime || url.match(/^data:([^;]+);/)?.[1] || '';
+ const filename = parsed?.searchParams.get('filename') || parsed?.pathname || '';
+ const video = mime.startsWith('video/') || /\.(mp4|webm|mov)$/i.test(filename);
+ const audio = mime.startsWith('audio/') || /\.(mp3|wav|ogg)$/i.test(filename);
+ const media = document.createElement(video ? 'video' : audio ? 'audio' : 'img');
+ if (media.tagName === 'IMG') media.alt = t('st.imagegen.output');
+ else { media.controls = true; media.preload = 'metadata'; }
+ media.style.cssText = 'max-width:100%;max-height:480px;border-radius:8px;object-fit:contain;';
+ media.referrerPolicy = 'no-referrer';
+ media.src = url;
+ const link = document.createElement('a');
+ link.href = url; link.textContent = t('st.imagegen.save_output');
+ link.target = '_blank'; link.rel = 'noopener noreferrer';
+ if (url.startsWith('data:') || storedMime) link.download = `webbrain-media.${({ 'image/png': 'png', 'image/jpeg': 'jpg', 'image/webp': 'webp', 'image/gif': 'gif', 'audio/mpeg': 'mp3', 'audio/wav': 'wav', 'audio/ogg': 'ogg', 'video/mp4': 'mp4' })[mime] || 'png'}`;
+ wrapper.replaceChildren(media, link);
+}
+
+async function hydrateStoredMedia(wrapper, t) {
+ try {
+ const blob = await loadGeneratedMedia(wrapper.dataset.mediaId);
+ if (!blob) throw new Error('Missing generated media');
+ const previous = objectUrls.get(wrapper);
+ if (previous) URL.revokeObjectURL(previous);
+ const url = URL.createObjectURL(blob);
+ objectUrls.set(wrapper, url);
+ renderPreview(wrapper, url, t, blob.type);
+ } catch {
+ wrapper.textContent = t('st.imagegen.unavailable_output');
+ }
+}
+
+// A synchronous placeholder keeps the asset handle in chat snapshots even if
+// the panel closes before the IndexedDB read finishes.
+export function appendGeneratedMedia(container, result, t) {
+ if (!container || !result?.success || (!result.mediaId && typeof result.url !== 'string')) return;
+ const wrapper = document.createElement('div');
+ wrapper.className = 'generated-media';
+ wrapper.style.cssText = 'margin:12px 0;display:grid;gap:8px;max-width:100%;';
+ if (result.mediaId) {
+ wrapper.dataset.mediaId = result.mediaId;
+ container.appendChild(wrapper);
+ return hydrateStoredMedia(wrapper, t);
+ }
+ renderPreview(wrapper, result.url, t);
+ if (wrapper.childElementCount) container.appendChild(wrapper);
+}
+
+export function restoreGeneratedMedia(root, t) {
+ return Promise.all([...root.querySelectorAll('.generated-media[data-media-id]')]
+ .map(wrapper => hydrateStoredMedia(wrapper, t)));
+}
diff --git a/src/firefox/src/ui/locales/ar.js b/src/firefox/src/ui/locales/ar.js
index 60bd02061..c6b55f3db 100644
--- a/src/firefox/src/ui/locales/ar.js
+++ b/src/firefox/src/ui/locales/ar.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Arabic (ar).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ar'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'تكبير واجهة الإضافة',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "تم الاتصال! النموذج: {model}",
"st.transcription.failed": "فشل: {error}",
"st.transcription.fill_required": "املأ عنوان API الأساسي والنموذج أولًا.",
- "st.imagegen.heading": "الوسائط التوليدية (fal.ai)",
- "st.imagegen.desc": "تُستخدَم بواسطة أداة generate_image لإنشاء الصور وغيرها من الوسائط من وصف نصي عبر واجهة قائمة الانتظار في fal.ai. احصل على مفتاح من fal.ai/dashboard/keys. لا تُستخدم للمحادثة.",
+ "st.imagegen.heading": "الوسائط التوليدية",
+ "st.imagegen.desc": "تستخدم أداة الوكيل generate_image المزوّد المحدد لإنشاء الصور والوسائط الأخرى من وصف نصي.",
"st.imagegen.saved": "تم الحفظ!",
"st.imagegen.cleared": "تم المسح.",
"st.imagegen.testing": "جارٍ الاختبار...",
diff --git a/src/firefox/src/ui/locales/bn.js b/src/firefox/src/ui/locales/bn.js
index 218d3635d..0f931b1a2 100644
--- a/src/firefox/src/ui/locales/bn.js
+++ b/src/firefox/src/ui/locales/bn.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Bengali — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('bn'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'এক্সটেনশনের UI জুম',
@@ -891,8 +893,8 @@ export default {
'st.transcription.connected': "সংযুক্ত ! মডেল: {model}",
'st.transcription.failed': "ব্যর্থ হয়েছে: {error}",
'st.transcription.fill_required': "প্রথমে বেস URL এবং মডেল পূরণ করুন।",
- "st.imagegen.heading": "জেনারেটিভ মিডিয়া (fal.ai)",
- "st.imagegen.desc": "generate_image এজেন্ট টুল দ্বারা fal.ai-র কিউ API-র মাধ্যমে টেক্সট প্রম্পট থেকে ছবি ও অন্যান্য মিডিয়া তৈরিতে ব্যবহৃত হয়। fal.ai/dashboard/keys থেকে কী নিন। চ্যাটের জন্য ব্যবহৃত হয় না।",
+ "st.imagegen.heading": "জেনারেটিভ মিডিয়া",
+ "st.imagegen.desc": "generate_image এজেন্ট টুল নির্বাচিত প্রদানকারীর মাধ্যমে টেক্সট প্রম্পট থেকে ছবি ও অন্যান্য মিডিয়া তৈরি করে।",
"st.imagegen.saved": "সংরক্ষিত হয়েছে!",
"st.imagegen.cleared": "মুছে ফেলা হয়েছে।",
"st.imagegen.testing": "পরীক্ষা চলছে...",
diff --git a/src/firefox/src/ui/locales/de.js b/src/firefox/src/ui/locales/de.js
index f70e5898c..7e239ce4f 100644
--- a/src/firefox/src/ui/locales/de.js
+++ b/src/firefox/src/ui/locales/de.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// German (de).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('de'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Erweiterungsoberfläche zoomen',
@@ -833,8 +835,8 @@ export default {
'st.transcription.connected': 'Verbunden! Modell: {model}',
'st.transcription.failed': 'Fehlgeschlagen: {error}',
'st.transcription.fill_required': 'Füllen Sie zuerst die Basis-URL und das Modell aus.',
- "st.imagegen.heading": "Generative Medien (fal.ai)",
- "st.imagegen.desc": "Wird vom Agent-Tool generate_image verwendet, um aus einem Textprompt Bilder und andere Medien über die Queue-API von fal.ai zu erzeugen. Schlüssel unter fal.ai/dashboard/keys erhalten. Wird nicht für Chat verwendet.",
+ "st.imagegen.heading": "Generative Medien",
+ "st.imagegen.desc": "Das Agentenwerkzeug generate_image erstellt Bilder und andere Medien aus einem Textprompt mit dem ausgewählten Anbieter.",
"st.imagegen.saved": "Gespeichert!",
"st.imagegen.cleared": "Gelöscht.",
"st.imagegen.testing": "Wird getestet...",
diff --git a/src/firefox/src/ui/locales/en.js b/src/firefox/src/ui/locales/en.js
index 16697c475..2ef2c5e70 100644
--- a/src/firefox/src/ui/locales/en.js
+++ b/src/firefox/src/ui/locales/en.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// English — canonical locale. Other locales inherit key names from this file.
@@ -5,6 +6,7 @@ import apocalypseModeCopy from './apocalypse-copy.mjs';
import emergencyCopy from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('en'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Extension UI zoom',
@@ -897,9 +899,9 @@ export default {
'st.transcription.failed': 'Failed: {error}',
'st.transcription.fill_required': 'Fill in Base URL and Model first.',
- // Generative media (fal.ai) — Assistive Models section
- 'st.imagegen.heading': 'Generative media (fal.ai)',
- 'st.imagegen.desc': 'Used by the generate_image agent tool to create images and other media from a text prompt via fal.ai\'s queue API. Get a key at fal.ai/dashboard/keys. Not used for chat.',
+ // Generative Media — Assistive Models section
+ 'st.imagegen.heading': "Generative Media",
+ 'st.imagegen.desc': "Used by the generate_image agent tool to create images and other media from a text prompt with the selected provider.",
'st.imagegen.saved': 'Saved!',
'st.imagegen.cleared': 'Cleared.',
'st.imagegen.testing': 'Testing...',
diff --git a/src/firefox/src/ui/locales/es.js b/src/firefox/src/ui/locales/es.js
index 352bb6c7e..528dcdf26 100644
--- a/src/firefox/src/ui/locales/es.js
+++ b/src/firefox/src/ui/locales/es.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Spanish (es).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('es'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom de la interfaz de la extensión',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "¡Conectado! Modelo: {model}",
"st.transcription.failed": "Falló: {error}",
"st.transcription.fill_required": "Rellena primero la URL base y el modelo.",
- "st.imagegen.heading": "Medios generativos (fal.ai)",
- "st.imagegen.desc": "Usada por la herramienta de agente generate_image para crear imágenes y otros medios a partir de un prompt de texto mediante la API de cola de fal.ai. Obtén una clave en fal.ai/dashboard/keys. No se usa para chat.",
+ "st.imagegen.heading": "Medios generativos",
+ "st.imagegen.desc": "La herramienta de agente generate_image crea imágenes y otros medios a partir de texto con el proveedor seleccionado.",
"st.imagegen.saved": "¡Guardado!",
"st.imagegen.cleared": "Borrado.",
"st.imagegen.testing": "Probando...",
diff --git a/src/firefox/src/ui/locales/fa.js b/src/firefox/src/ui/locales/fa.js
index f0963a5c4..f20dd6655 100644
--- a/src/firefox/src/ui/locales/fa.js
+++ b/src/firefox/src/ui/locales/fa.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Persian — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('fa'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'بزرگ‌نمایی رابط کاربری افزونه',
@@ -891,8 +893,8 @@ export default {
'st.transcription.connected': "متصل است! مدل: {model}",
'st.transcription.failed': "ناموفق: {error}",
'st.transcription.fill_required': "ابتدا Base URL و Model را پر کنید.",
- "st.imagegen.heading": "رسانه‌های مولد (fal.ai)",
- "st.imagegen.desc": "ابزار ایجنت generate_image برای ساخت تصویر و سایر رسانه‌ها از یک پرامپت متنی از طریق API صف fal.ai استفاده می‌کند. کلید را از fal.ai/dashboard/keys بگیرید. برای چت استفاده نمی‌شود.",
+ "st.imagegen.heading": "رسانه‌های مولد",
+ "st.imagegen.desc": "ابزار عامل generate_image با ارائه‌دهنده انتخاب‌شده از درخواست متنی، تصویر و رسانه‌های دیگر تولید می‌کند.",
"st.imagegen.saved": "ذخیره شد!",
"st.imagegen.cleared": "پاک شد.",
"st.imagegen.testing": "در حال آزمایش...",
diff --git a/src/firefox/src/ui/locales/fr.js b/src/firefox/src/ui/locales/fr.js
index 906f138f5..d989be4a6 100644
--- a/src/firefox/src/ui/locales/fr.js
+++ b/src/firefox/src/ui/locales/fr.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// French (fr).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('fr'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom de l’interface de l’extension',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "Connecté ! Modèle : {model}",
"st.transcription.failed": "Échec : {error}",
"st.transcription.fill_required": "Remplissez d'abord l'URL de base et le modèle.",
- "st.imagegen.heading": "Médias génératifs (fal.ai)",
- "st.imagegen.desc": "Utilisée par l'outil d'agent generate_image pour créer des images et d'autres médias à partir d'un prompt texte via l'API de file d'attente de fal.ai. Obtenez une clé sur fal.ai/dashboard/keys. Non utilisée pour le chat.",
+ "st.imagegen.heading": "Médias génératifs",
+ "st.imagegen.desc": "L’outil d’agent generate_image crée des images et d’autres médias à partir de texte avec le fournisseur sélectionné.",
"st.imagegen.saved": "Enregistré !",
"st.imagegen.cleared": "Effacé.",
"st.imagegen.testing": "Test en cours...",
diff --git a/src/firefox/src/ui/locales/generative-media-copy.mjs b/src/firefox/src/ui/locales/generative-media-copy.mjs
new file mode 100644
index 000000000..19c67f907
--- /dev/null
+++ b/src/firefox/src/ui/locales/generative-media-copy.mjs
@@ -0,0 +1,31 @@
+const english = {
+ 'st.imagegen.provider': 'Provider',
+ 'st.imagegen.local_provider': 'ComfyUI (localhost)',
+ 'st.imagegen.workflow': 'Workflow JSON (API format)',
+ 'st.imagegen.parameters': 'Model input JSON (optional)',
+ 'st.imagegen.setup': 'Setup guide ↗',
+ 'st.imagegen.hint.fal': 'Enter your fal.ai key and model ID. Test Connection checks authentication without generating media.',
+ 'st.imagegen.hint.openrouter': 'Enter an OpenRouter key and an image generation model ID. Test Connection checks the key and image catalog without generating an image.',
+ 'st.imagegen.hint.comfyrouter': 'Enter a Comfy API key and provider/model ID. For models with other prompt fields, paste their input JSON using {{prompt}} where the text belongs. Test Connection reads model metadata.',
+ 'st.imagegen.hint.comfyui': 'Start ComfyUI locally, export the workflow in API format, and replace its positive prompt text with {{prompt}}. Include a Save Image or media output node. No API key is needed. Test Connection checks the local server; the workflow runs only when you request generation.',
+ 'st.imagegen.output': 'Generated media',
+ 'st.imagegen.save_output': 'Save generated media',
+ 'st.imagegen.unavailable_output': 'The saved media is unavailable.',
+};
+const turkish = {
+ 'st.imagegen.provider': 'Sağlayıcı',
+ 'st.imagegen.local_provider': 'ComfyUI (yerel sunucu)',
+ 'st.imagegen.workflow': 'İş akışı JSON (API biçimi)',
+ 'st.imagegen.parameters': 'Model girdisi JSON (isteğe bağlı)',
+ 'st.imagegen.setup': 'Kurulum rehberi ↗',
+ 'st.imagegen.hint.fal': 'fal.ai anahtarınızı ve model kimliğini girin. Bağlantı testi medya üretmeden kimlik doğrulamayı kontrol eder.',
+ 'st.imagegen.hint.openrouter': 'OpenRouter anahtarını ve görsel üreten bir model kimliğini girin. Bağlantı testi görsel üretmeden anahtarı ve görsel kataloğunu kontrol eder.',
+ 'st.imagegen.hint.comfyrouter': 'Comfy API anahtarını ve sağlayıcı/model kimliğini girin. Farklı istem alanları kullanan modeller için girdi JSON dosyasını yapıştırıp metnin yerine {{prompt}} yazın. Bağlantı testi model bilgilerini okur.',
+ 'st.imagegen.hint.comfyui': 'ComfyUI yerel sunucusunu başlatın, iş akışını API biçiminde dışa aktarın ve olumlu istem metnini {{prompt}} ile değiştirin. Save Image veya medya çıktı düğümü ekleyin. API anahtarı gerekmez. Bağlantı testi yerel sunucuyu kontrol eder; iş akışı yalnızca medya üretimi istediğinizde çalışır.',
+ 'st.imagegen.output': 'Üretilen medya',
+ 'st.imagegen.save_output': 'Üretilen medyayı kaydet',
+ 'st.imagegen.unavailable_output': 'Kaydedilen medya kullanılamıyor.',
+};
+export function getGenerativeMediaCopy(locale) {
+ return { ...english, ...(locale === 'tr' ? turkish : {}) };
+}
diff --git a/src/firefox/src/ui/locales/he.js b/src/firefox/src/ui/locales/he.js
index 416594dcf..e2550cc67 100644
--- a/src/firefox/src/ui/locales/he.js
+++ b/src/firefox/src/ui/locales/he.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Hebrew (he).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('he'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'הגדלת ממשק התוסף',
@@ -805,8 +807,8 @@ export default {
"st.transcription.connected": "מחובר! מודל: {model}",
"st.transcription.failed": "נכשל: {error}",
"st.transcription.fill_required": "יש למלא תחילה כתובת URL בסיסית ומודל.",
- "st.imagegen.heading": "מדיה גנרטיבית (fal.ai)",
- "st.imagegen.desc": "בשימוש על ידי כלי הסוכן generate_image ליצירת תמונות ומדיה אחרת מתיאור טקסטואלי דרך ה-Queue API של fal.ai. אפשר לקבל מפתח ב-fal.ai/dashboard/keys. אינו משמש לצ׳אט.",
+ "st.imagegen.heading": "מדיה גנרטיבית",
+ "st.imagegen.desc": "כלי הסוכן generate_image יוצר תמונות ומדיה נוספת מהנחיית טקסט באמצעות הספק שנבחר.",
"st.imagegen.saved": "נשמר!",
"st.imagegen.cleared": "נמחק.",
"st.imagegen.testing": "בודק...",
diff --git a/src/firefox/src/ui/locales/hi.js b/src/firefox/src/ui/locales/hi.js
index 5c515ae09..947f325d1 100644
--- a/src/firefox/src/ui/locales/hi.js
+++ b/src/firefox/src/ui/locales/hi.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Hindi — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('hi'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'एक्सटेंशन UI ज़ूम',
@@ -891,8 +893,8 @@ export default {
'st.transcription.connected': "जुड़ा हुआ! मॉडल: {model}",
'st.transcription.failed': "विफल: {error}",
'st.transcription.fill_required': "सबसे पहले बेस यूआरएल और मॉडल भरें।",
- "st.imagegen.heading": "जनरेटिव मीडिया (fal.ai)",
- "st.imagegen.desc": "generate_image एजेंट टूल द्वारा fal.ai की क्यू API के ज़रिए टेक्स्ट प्रॉम्प्ट से इमेज और अन्य मीडिया बनाने के लिए उपयोग किया जाता है। fal.ai/dashboard/keys से की लें। चैट के लिए उपयोग नहीं होता।",
+ "st.imagegen.heading": "जनरेटिव मीडिया",
+ "st.imagegen.desc": "generate_image एजेंट टूल चुने हुए प्रदाता से टेक्स्ट प्रॉम्प्ट के आधार पर चित्र और अन्य मीडिया बनाता है।",
"st.imagegen.saved": "सहेजा गया!",
"st.imagegen.cleared": "साफ़ कर दिया गया।",
"st.imagegen.testing": "जाँच जारी...",
diff --git a/src/firefox/src/ui/locales/id.js b/src/firefox/src/ui/locales/id.js
index 75c8dd23c..ce262c42c 100644
--- a/src/firefox/src/ui/locales/id.js
+++ b/src/firefox/src/ui/locales/id.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Indonesian (id).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('id'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom UI ekstensi',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "Terhubung! Model: {model}",
"st.transcription.failed": "Gagal: {error}",
"st.transcription.fill_required": "Isi URL dasar dan Model terlebih dahulu.",
- "st.imagegen.heading": "Media generatif (fal.ai)",
- "st.imagegen.desc": "Digunakan oleh alat agen generate_image untuk membuat gambar dan media lain dari prompt teks melalui API antrean fal.ai. Dapatkan kunci di fal.ai/dashboard/keys. Tidak digunakan untuk obrolan.",
+ "st.imagegen.heading": "Media generatif",
+ "st.imagegen.desc": "Alat agen generate_image membuat gambar dan media lainnya dari prompt teks melalui penyedia yang dipilih.",
"st.imagegen.saved": "Tersimpan!",
"st.imagegen.cleared": "Dihapus.",
"st.imagegen.testing": "Menguji...",
diff --git a/src/firefox/src/ui/locales/ja.js b/src/firefox/src/ui/locales/ja.js
index 63c015587..895f3f37d 100644
--- a/src/firefox/src/ui/locales/ja.js
+++ b/src/firefox/src/ui/locales/ja.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Japanese (ja).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ja'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': '拡張機能 UI のズーム',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "接続しました!モデル: {model}",
"st.transcription.failed": "失敗: {error}",
"st.transcription.fill_required": "先にベース URL とモデルを入力してください。",
- "st.imagegen.heading": "生成メディア (fal.ai)",
- "st.imagegen.desc": "generate_image エージェントツールが fal.ai のキュー API を通じてテキストプロンプトから画像などのメディアを生成するために使用します。キーは fal.ai/dashboard/keys で取得できます。チャットには使用されません。",
+ "st.imagegen.heading": "生成メディア",
+ "st.imagegen.desc": "エージェントツール generate_image は、選択したプロバイダーでテキストプロンプトから画像などのメディアを生成します。",
"st.imagegen.saved": "保存しました!",
"st.imagegen.cleared": "クリアしました。",
"st.imagegen.testing": "テスト中...",
diff --git a/src/firefox/src/ui/locales/ko.js b/src/firefox/src/ui/locales/ko.js
index 8433e4a9e..d97d386fc 100644
--- a/src/firefox/src/ui/locales/ko.js
+++ b/src/firefox/src/ui/locales/ko.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Korean (ko).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ko'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': '확장 프로그램 UI 확대/축소',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "연결됨! 모델: {model}",
"st.transcription.failed": "실패: {error}",
"st.transcription.fill_required": "먼저 기본 URL과 모델을 입력하세요.",
- "st.imagegen.heading": "생성 미디어 (fal.ai)",
- "st.imagegen.desc": "generate_image 에이전트 도구가 fal.ai 큐 API를 통해 텍스트 프롬프트에서 이미지 등 미디어를 생성하는 데 사용됩니다. fal.ai/dashboard/keys에서 키를 발급받으세요. 채팅에는 사용되지 않습니다.",
+ "st.imagegen.heading": "생성 미디어",
+ "st.imagegen.desc": "generate_image 에이전트 도구가 선택한 제공업체를 통해 텍스트 프롬프트로 이미지와 기타 미디어를 생성합니다.",
"st.imagegen.saved": "저장되었습니다!",
"st.imagegen.cleared": "지워졌습니다.",
"st.imagegen.testing": "테스트 중...",
diff --git a/src/firefox/src/ui/locales/ms.js b/src/firefox/src/ui/locales/ms.js
index d2a04686e..f9b6ed2b5 100644
--- a/src/firefox/src/ui/locales/ms.js
+++ b/src/firefox/src/ui/locales/ms.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Malay (ms).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ms'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zum UI sambungan',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "Tersambung! Model: {model}",
"st.transcription.failed": "Gagal: {error}",
"st.transcription.fill_required": "Isi URL Asas dan Model terlebih dahulu.",
- "st.imagegen.heading": "Media generatif (fal.ai)",
- "st.imagegen.desc": "Digunakan oleh alat ejen generate_image untuk mencipta imej dan media lain daripada geseran teks melalui API baris giliran fal.ai. Dapatkan kunci di fal.ai/dashboard/keys. Tidak digunakan untuk sembang.",
+ "st.imagegen.heading": "Media generatif",
+ "st.imagegen.desc": "Alat ejen generate_image menghasilkan imej dan media lain daripada gesaan teks melalui penyedia yang dipilih.",
"st.imagegen.saved": "Disimpan!",
"st.imagegen.cleared": "Dibersihkan.",
"st.imagegen.testing": "Menguji...",
diff --git a/src/firefox/src/ui/locales/nl.js b/src/firefox/src/ui/locales/nl.js
index 6b2dc23ea..d8802096b 100644
--- a/src/firefox/src/ui/locales/nl.js
+++ b/src/firefox/src/ui/locales/nl.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Dutch (nl).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('nl'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom van extensie-interface',
@@ -799,8 +801,8 @@ export default {
'st.transcription.connected': 'Verbonden! Model: {model}',
'st.transcription.failed': 'Mislukt: {error}',
'st.transcription.fill_required': 'Vul eerst basis-URL en model in.',
- "st.imagegen.heading": "Generatieve media (fal.ai)",
- "st.imagegen.desc": "Wordt gebruikt door de agenttool generate_image om afbeeldingen en andere media te maken vanuit een tekstprompt via de queue-API van fal.ai. Vraag een sleutel aan op fal.ai/dashboard/keys. Niet voor chat.",
+ "st.imagegen.heading": "Generatieve media",
+ "st.imagegen.desc": "De agenttool generate_image maakt afbeeldingen en andere media vanuit een tekstprompt met de geselecteerde aanbieder.",
"st.imagegen.saved": "Opgeslagen!",
"st.imagegen.cleared": "Wissen gelukt.",
"st.imagegen.testing": "Testen...",
diff --git a/src/firefox/src/ui/locales/pl.js b/src/firefox/src/ui/locales/pl.js
index 5ced9f81d..5a600a15a 100644
--- a/src/firefox/src/ui/locales/pl.js
+++ b/src/firefox/src/ui/locales/pl.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Polski — translated from en.js. Keys mirror the English canonical file.
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('pl'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Powiększenie interfejsu rozszerzenia',
@@ -626,8 +628,8 @@ export default {
'st.transcription.connected': 'Połączono! Model: {model}',
'st.transcription.failed': 'Niepowodzenie: {error}',
'st.transcription.fill_required': 'Najpierw wypełnij bazowy adres URL i model.',
- "st.imagegen.heading": "Media generatywne (fal.ai)",
- "st.imagegen.desc": "Używane przez narzędzie agenta generate_image do tworzenia obrazów i innych mediów z promptu tekstowego przez API kolejki fal.ai. Klucz uzyskasz na fal.ai/dashboard/keys. Nieużywane do czatu.",
+ "st.imagegen.heading": "Media generatywne",
+ "st.imagegen.desc": "Narzędzie agenta generate_image tworzy obrazy i inne media z opisu tekstowego za pomocą wybranego dostawcy.",
"st.imagegen.saved": "Zapisano!",
"st.imagegen.cleared": "Wyczyszczono.",
"st.imagegen.testing": "Testowanie...",
diff --git a/src/firefox/src/ui/locales/pt.js b/src/firefox/src/ui/locales/pt.js
index 798f50b4a..782bb9ecf 100644
--- a/src/firefox/src/ui/locales/pt.js
+++ b/src/firefox/src/ui/locales/pt.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Portuguese — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('pt'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Zoom da interface da extensão',
@@ -891,8 +893,8 @@ export default {
'st.transcription.connected': "Conectado! Modelo: {model}",
'st.transcription.failed': "Falha: {error}",
'st.transcription.fill_required': "Preencha primeiro o URL base e o modelo.",
- "st.imagegen.heading": "Mídia generativa (fal.ai)",
- "st.imagegen.desc": "Usada pela ferramenta de agente generate_image para criar imagens e outras mídias a partir de um prompt de texto pela API de fila da fal.ai. Obtenha uma chave em fal.ai/dashboard/keys. Não usada para chat.",
+ "st.imagegen.heading": "Mídia generativa",
+ "st.imagegen.desc": "A ferramenta de agente generate_image cria imagens e outras mídias a partir de texto com o provedor selecionado.",
"st.imagegen.saved": "Salvo!",
"st.imagegen.cleared": "Limpo.",
"st.imagegen.testing": "Testando...",
diff --git a/src/firefox/src/ui/locales/ru.js b/src/firefox/src/ui/locales/ru.js
index 7be6e031e..d58c637ee 100644
--- a/src/firefox/src/ui/locales/ru.js
+++ b/src/firefox/src/ui/locales/ru.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Russian (ru).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('ru'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Масштаб интерфейса расширения',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "Подключено! Модель: {model}",
"st.transcription.failed": "Сбой: {error}",
"st.transcription.fill_required": "Сначала заполните базовый URL и модель.",
- "st.imagegen.heading": "Генеративные медиа (fal.ai)",
- "st.imagegen.desc": "Используется инструментом агента generate_image для создания изображений и других медиа из текстового запроса через очередь API fal.ai. Ключ можно получить на fal.ai/dashboard/keys. Не используется для чата.",
+ "st.imagegen.heading": "Генеративные медиа",
+ "st.imagegen.desc": "Инструмент агента generate_image создаёт изображения и другие медиа по текстовому запросу через выбранного провайдера.",
"st.imagegen.saved": "Сохранено!",
"st.imagegen.cleared": "Очищено.",
"st.imagegen.testing": "Проверка...",
diff --git a/src/firefox/src/ui/locales/th.js b/src/firefox/src/ui/locales/th.js
index a7cde3d3b..814c493c8 100644
--- a/src/firefox/src/ui/locales/th.js
+++ b/src/firefox/src/ui/locales/th.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Thai (th).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('th'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'ซูม UI ของส่วนขยาย',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "เชื่อมต่อแล้ว! โมเดล: {model}",
"st.transcription.failed": "ล้มเหลว: {error}",
"st.transcription.fill_required": "กรอก URL ฐานและโมเดลก่อน",
- "st.imagegen.heading": "สื่อเชิงสร้างสรรค์ (fal.ai)",
- "st.imagegen.desc": "เครื่องมือเอเจนต์ generate_image ใช้สร้างรูปภาพและสื่ออื่น ๆ จากพรอมต์ข้อความผ่านคิว API ของ fal.ai รับคีย์ได้ที่ fal.ai/dashboard/keys ไม่ได้ใช้สำหรับแชท",
+ "st.imagegen.heading": "สื่อเชิงสร้างสรรค์",
+ "st.imagegen.desc": "เครื่องมือเอเจนต์ generate_image สร้างภาพและสื่ออื่นจากพรอมต์ข้อความผ่านผู้ให้บริการที่เลือก",
"st.imagegen.saved": "บันทึกแล้ว!",
"st.imagegen.cleared": "ล้างแล้ว.",
"st.imagegen.testing": "กำลังทดสอบ...",
diff --git a/src/firefox/src/ui/locales/tl.js b/src/firefox/src/ui/locales/tl.js
index c9a5c90d9..e4f040d61 100644
--- a/src/firefox/src/ui/locales/tl.js
+++ b/src/firefox/src/ui/locales/tl.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Filipino / Tagalog (tl).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('tl'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Pag-zoom ng UI ng extension',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "Konektado! Modelo: {model}",
"st.transcription.failed": "Nabigo: {error}",
"st.transcription.fill_required": "Punan muna ang Base URL at Modelo.",
- "st.imagegen.heading": "Generative media (fal.ai)",
- "st.imagegen.desc": "Ginagamit ng generate_image agent tool para gumawa ng mga larawan at iba pang media mula sa text prompt sa pamamagitan ng fal.ai queue API. Kumuha ng key sa fal.ai/dashboard/keys. Hindi ginagamit sa chat.",
+ "st.imagegen.heading": "Generative media",
+ "st.imagegen.desc": "Gumagawa ang generate_image agent tool ng mga larawan at ibang media mula sa text prompt gamit ang napiling provider.",
"st.imagegen.saved": "Na-save!",
"st.imagegen.cleared": "Na-clear.",
"st.imagegen.testing": "Sinusuri...",
diff --git a/src/firefox/src/ui/locales/tr.js b/src/firefox/src/ui/locales/tr.js
index 9c98411ca..c716fb555 100644
--- a/src/firefox/src/ui/locales/tr.js
+++ b/src/firefox/src/ui/locales/tr.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Turkish (tr).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('tr'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Uzantı arayüzü yakınlaştırması',
@@ -639,8 +641,8 @@ export default {
"st.transcription.connected": "Bağlandı! Model: {model}",
"st.transcription.failed": "Başarısız: {error}",
"st.transcription.fill_required": "Önce Temel URL ve Model alanlarını doldur.",
- "st.imagegen.heading": "Üretken medya (fal.ai)",
- "st.imagegen.desc": "generate_image ajan aracı tarafından metin isteminden fal.ai'nin kuyruk API'si üzerinden görsel ve diğer medyaları oluşturmak için kullanılır. Anahtar alın: fal.ai/dashboard/keys. Sohbet için kullanılmaz.",
+ "st.imagegen.heading": "Üretken medya",
+ "st.imagegen.desc": "generate_image ajan aracı, seçilen sağlayıcıyla metin isteminden görsel ve diğer medyaları üretir.",
"st.imagegen.saved": "Kaydedildi!",
"st.imagegen.cleared": "Temizlendi.",
"st.imagegen.testing": "Test ediliyor...",
diff --git a/src/firefox/src/ui/locales/uk.js b/src/firefox/src/ui/locales/uk.js
index ef74ca504..75cb30f6e 100644
--- a/src/firefox/src/ui/locales/uk.js
+++ b/src/firefox/src/ui/locales/uk.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Ukrainian (uk).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('uk'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Масштаб інтерфейсу розширення',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "Підключено! Модель: {model}",
"st.transcription.failed": "Збій: {error}",
"st.transcription.fill_required": "Спочатку заповніть базовий URL і модель.",
- "st.imagegen.heading": "Генеративні медіа (fal.ai)",
- "st.imagegen.desc": "Використовується інструментом агента generate_image для створення зображень та інших медіа з текстового запиту через API черги fal.ai. Ключ можна отримати на fal.ai/dashboard/keys. Не використовується для чату.",
+ "st.imagegen.heading": "Генеративні медіа",
+ "st.imagegen.desc": "Інструмент агента generate_image створює зображення та інші медіа за текстовим запитом через вибраного постачальника.",
"st.imagegen.saved": "Збережено!",
"st.imagegen.cleared": "Очищено.",
"st.imagegen.testing": "Перевірка...",
diff --git a/src/firefox/src/ui/locales/vi.js b/src/firefox/src/ui/locales/vi.js
index d3cfa2dec..75694c66e 100644
--- a/src/firefox/src/ui/locales/vi.js
+++ b/src/firefox/src/ui/locales/vi.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Vietnamese — translated from the canonical English locale.
@@ -5,6 +6,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('vi'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': 'Thu phóng giao diện tiện ích',
@@ -891,8 +893,8 @@ export default {
'st.transcription.connected': "Đã kết nối! Model: {model}",
'st.transcription.failed': "Không thành công: {error}",
'st.transcription.fill_required': "Trước tiên hãy điền URL cơ sở và Mô hình.",
- "st.imagegen.heading": "Media tạo sinh (fal.ai)",
- "st.imagegen.desc": "Được công cụ tác nhân generate_image sử dụng để tạo hình ảnh và phương tiện khác từ lời nhắc văn bản thông qua API hàng đợi của fal.ai. Lấy khóa tại fal.ai/dashboard/keys. Không dùng cho trò chuyện.",
+ "st.imagegen.heading": "Media tạo sinh",
+ "st.imagegen.desc": "Công cụ tác nhân generate_image tạo hình ảnh và phương tiện khác từ lời nhắc văn bản qua nhà cung cấp đã chọn.",
"st.imagegen.saved": "Đã lưu!",
"st.imagegen.cleared": "Đã xóa.",
"st.imagegen.testing": "Đang kiểm tra...",
diff --git a/src/firefox/src/ui/locales/zh.js b/src/firefox/src/ui/locales/zh.js
index fab3f9c60..2f6231f2e 100644
--- a/src/firefox/src/ui/locales/zh.js
+++ b/src/firefox/src/ui/locales/zh.js
@@ -1,3 +1,4 @@
+import { getGenerativeMediaCopy } from './generative-media-copy.mjs';
import bidiCopy from './bidi-copy.mjs';
import cloudBridgeCopy from './cloud-bridge-copy.mjs';
// Simplified Chinese (zh).
@@ -7,6 +8,7 @@ import { getApocalypseModeCopy } from './apocalypse-copy.mjs';
import { getEmergencyBoxCopy } from './emergency-copy.mjs';
export default {
+ ...getGenerativeMediaCopy('zh'),
...bidiCopy,
...cloudBridgeCopy,
'sp.ui_scale.label': '插件界面缩放',
@@ -599,8 +601,8 @@ export default {
"st.transcription.connected": "连接成功!模型:{model}",
"st.transcription.failed": "失败:{error}",
"st.transcription.fill_required": "请先填写基础 URL 和模型。",
- "st.imagegen.heading": "生成式媒体 (fal.ai)",
- "st.imagegen.desc": "generate_image 代理工具通过 fal.ai 的队列 API 根据文本提示生成图片等媒体。请前往 fal.ai/dashboard/keys 获取密钥。不用于聊天。",
+ "st.imagegen.heading": "生成式媒体",
+ "st.imagegen.desc": "generate_image 智能体工具通过所选提供商,根据文本提示生成图像和其他媒体。",
"st.imagegen.saved": "已保存!",
"st.imagegen.cleared": "已清除。",
"st.imagegen.testing": "测试中...",
diff --git a/src/firefox/src/ui/settings.html b/src/firefox/src/ui/settings.html
index b3969dd18..b39425883 100644
--- a/src/firefox/src/ui/settings.html
+++ b/src/firefox/src/ui/settings.html
@@ -2054,22 +2054,47 @@
</svg>
<span data-i18n="st.imagegen.heading"></span>
</h3>
- <div class="provider-card" id="image-gen-card">
+ <div class="provider-card" id="image-gen-card" aria-labelledby="image-gen-heading">
<div style="font-size:12px;color:var(--text2);margin-bottom:12px;line-height:1.5;" data-i18n="st.imagegen.desc"></div>
<div class="field">
- <label data-i18n="st.provider.field.api_key"></label>
- <input type="password" id="image-gen-api-key" placeholder="FAL_KEY">
+ <label for="image-gen-provider" data-i18n="st.imagegen.provider"></label>
+ <select id="image-gen-provider">
+ <option value="fal">fal.ai</option>
+ <option value="openrouter">OpenRouter</option>
+ <option value="comfyrouter">Comfy Router</option>
+ <option value="comfyui" data-i18n="st.imagegen.local_provider">ComfyUI (localhost)</option>
+ </select>
</div>
- <div class="field">
- <label data-i18n="st.provider.field.model"></label>
+ <div class="field" id="image-gen-key-field">
+ <label for="image-gen-api-key" data-i18n="st.provider.field.api_key"></label>
+ <input type="password" id="image-gen-api-key" placeholder="FAL_KEY" autocomplete="off">
+ </div>
+ <div class="field" id="image-gen-model-field">
+ <label for="image-gen-model" data-i18n="st.provider.field.model"></label>
<input type="text" id="image-gen-model" placeholder="fal-ai/flux/schnell">
</div>
+ <div class="field" id="image-gen-url-field" hidden>
+ <label for="image-gen-base-url" data-i18n="st.provider.field.api_base_url"></label>
+ <input type="url" id="image-gen-base-url" placeholder="http://127.0.0.1:8188">
+ </div>
+ <div class="field" id="image-gen-workflow-field" hidden>
+ <label for="image-gen-workflow" data-i18n="st.imagegen.workflow"></label>
+ <textarea id="image-gen-workflow" rows="8" spellcheck="false" placeholder='{"6":{"class_type":"CLIPTextEncode","inputs":{"text":"{{prompt}}"}}}'></textarea>
+ </div>
+ <div class="field" id="image-gen-parameters-field" hidden>
+ <label for="image-gen-parameters" data-i18n="st.imagegen.parameters"></label>
+ <textarea id="image-gen-parameters" rows="4" spellcheck="false" placeholder='{"prompt":"{{prompt}}"}'></textarea>
+ </div>
+ <div style="font-size:12px;color:var(--text2);line-height:1.5;margin-bottom:12px;">
+ <span id="image-gen-provider-hint"></span>
+ <a id="image-gen-docs" href="https://fal.ai/dashboard/keys" target="_blank" rel="noopener noreferrer" data-i18n="st.imagegen.setup"></a>
+ </div>
<div class="btn-row">
<button class="btn-primary" id="btn-save-image-gen" data-i18n="st.transcription.save"></button>
<button class="btn-secondary" id="btn-test-image-gen" data-i18n="st.transcription.test"></button>
<button class="btn-secondary" id="btn-clear-image-gen" data-i18n="st.transcription.clear"></button>
</div>
- <div class="test-result" id="test-image-gen"></div>
+ <div class="test-result" id="test-image-gen" role="status"></div>
</div>
<h3 class="mm-section-heading" id="system-one-heading">
diff --git a/src/firefox/src/ui/settings.js b/src/firefox/src/ui/settings.js
index 1ca3ea5b4..f6d5eda92 100644
--- a/src/firefox/src/ui/settings.js
+++ b/src/firefox/src/ui/settings.js
@@ -4,6 +4,7 @@
import { t, getLocale, setLocale, LANGUAGES } from './i18n.js';
import { escapeHtml } from './utils.js';
+import { MEDIA_PROVIDERS, mediaProvider, validateMediaConfig } from '../agent/media-config.js';
import { RESEARCH_DATA_COLLECTION } from '../trace/research-consent.js';
import { THEME_MODES, applyMode, loadMode, watch } from './theme.js';
import {
@@ -161,7 +162,11 @@ const btnSaveTranscription = document.getElementById('btn-save-transcription');
const btnTestTranscription = document.getElementById('btn-test-transcription');
const btnClearTranscription = document.getElementById('btn-clear-transcription');
const transcriptionTestResult = document.getElementById('test-transcription');
-// Generative media (fal.ai) — assistive model, stored as `imageGenModel = { apiKey, model }`.
+// Generative Media — provider settings stored as imageGenModel.
+const imageGenProviderInput = document.getElementById('image-gen-provider');
+const imageGenBaseUrlInput = document.getElementById('image-gen-base-url');
+const imageGenWorkflowInput = document.getElementById('image-gen-workflow');
+const imageGenParametersInput = document.getElementById('image-gen-parameters');
const imageGenApiKeyInput = document.getElementById('image-gen-api-key');
const imageGenModelInput = document.getElementById('image-gen-model');
const btnSaveImageGen = document.getElementById('btn-save-image-gen');
@@ -698,11 +703,9 @@ async function init() {
updateMultimodalDetectedProvider('vision');
updateMultimodalDetectedProvider('transcription');
- // Load generative media (fal.ai) config. Used by the generate_image agent tool.
+ // Load Generative Media config. Used by the generate_image agent tool.
const imageGenStored = await browser.storage.local.get(['imageGenModel']);
- const imageGen = imageGenStored.imageGenModel || {};
- if (imageGenApiKeyInput) imageGenApiKeyInput.value = imageGen.apiKey || '';
- if (imageGenModelInput) imageGenModelInput.value = imageGen.model || '';
+ renderImageGenConfig(imageGenStored.imageGenModel || {});
// Load profile (auto-fill bio + throwaway password)
const profileStored = await browser.storage.local.get(['profileEnabled', 'profileText']);
@@ -1712,11 +1715,9 @@ if (btnClearTranscription) {
transcriptionBaseUrlInput?.addEventListener('input', () => updateMultimodalDetectedProvider('transcription'));
-// --- Generative Media (fal.ai) ---
-//
-// Same UX as the transcription override. Stored in browser.storage.local under
-// `imageGenModel = { apiKey, model }`. Consumed by the `generate_image` agent
-// tool (agent/fal-media.js), which submits to fal.ai's queue API.
+// --- Generative Media ---
+const imageGenDrafts = new Map();
+let imageGenCurrentProvider = 'fal';
function showImageGenResult(className, text, color = '') {
if (!imageGenTestResult) return;
@@ -1731,63 +1732,81 @@ function flashImageGenResult(className, text) {
if (resultEl) setTimeout(() => resultEl.classList.remove('show'), 2000);
}
-if (btnSaveImageGen) {
- btnSaveImageGen.addEventListener('click', async () => {
- const apiKey = imageGenApiKeyInput.value.trim();
- const model = imageGenModelInput.value.trim();
-
- if (!apiKey && !model) {
- await browser.storage.local.remove('imageGenModel');
- flashImageGenResult('ok', t('st.imagegen.cleared'));
- return;
- }
-
- await browser.storage.local.set({
- imageGenModel: { apiKey, model },
- });
- flashImageGenResult('ok', t('st.imagegen.saved'));
- });
+function readImageGenForm() {
+ const provider = imageGenProviderInput?.value || 'fal';
+ if (provider === 'comfyui') return { provider, baseUrl: imageGenBaseUrlInput.value.trim() || MEDIA_PROVIDERS.comfyui.baseUrl, workflow: imageGenWorkflowInput.value.trim() };
+ const config = { provider, apiKey: imageGenApiKeyInput.value.trim(), model: imageGenModelInput.value.trim() };
+ if (provider === 'comfyrouter') config.parameters = imageGenParametersInput.value.trim() || '{}';
+ return config;
}
-if (btnTestImageGen) {
- btnTestImageGen.addEventListener('click', async () => {
- const apiKey = imageGenApiKeyInput.value.trim();
- const model = imageGenModelInput.value.trim();
+function updateImageGenProvider() {
+ const provider = imageGenProviderInput?.value || 'fal';
+ const meta = MEDIA_PROVIDERS[provider] || MEDIA_PROVIDERS.fal;
+ const local = provider === 'comfyui';
+ for (const [id, hidden] of [['image-gen-key-field', local], ['image-gen-model-field', local], ['image-gen-url-field', !local], ['image-gen-workflow-field', !local], ['image-gen-parameters-field', provider !== 'comfyrouter']]) {
+ const field = document.getElementById(id); if (field) field.hidden = hidden;
+ }
+ if (imageGenApiKeyInput) imageGenApiKeyInput.placeholder = meta.keyPlaceholder || '';
+ if (imageGenModelInput) imageGenModelInput.placeholder = meta.model || '';
+ const hint = document.getElementById('image-gen-provider-hint');
+ if (hint) hint.textContent = t(`st.imagegen.hint.${provider}`) + ' ';
+ const docs = document.getElementById('image-gen-docs'); if (docs) docs.href = meta.docs;
+}
+
+function renderImageGenConfig(config) {
+ const provider = Object.hasOwn(MEDIA_PROVIDERS, mediaProvider(config)) ? mediaProvider(config) : 'fal';
+ imageGenCurrentProvider = provider;
+ if (imageGenProviderInput) imageGenProviderInput.value = provider;
+ if (imageGenApiKeyInput) imageGenApiKeyInput.value = config.apiKey || '';
+ if (imageGenModelInput) imageGenModelInput.value = config.model || '';
+ if (imageGenBaseUrlInput) imageGenBaseUrlInput.value = config.baseUrl || MEDIA_PROVIDERS.comfyui.baseUrl;
+ if (imageGenWorkflowInput) imageGenWorkflowInput.value = typeof config.workflow === 'object' ? JSON.stringify(config.workflow, null, 2) : config.workflow || '';
+ if (imageGenParametersInput) imageGenParametersInput.value = typeof config.parameters === 'object' ? JSON.stringify(config.parameters, null, 2) : config.parameters || '';
+ updateImageGenProvider();
+}
+
+imageGenProviderInput?.addEventListener('change', () => {
+ const selected = imageGenProviderInput.value;
+ // Preserve unsaved drafts while switching, and never reuse another provider's key.
+ imageGenProviderInput.value = imageGenCurrentProvider;
+ imageGenDrafts.set(imageGenCurrentProvider, readImageGenForm());
+ renderImageGenConfig(imageGenDrafts.get(selected) || { provider: selected });
+ if (imageGenTestResult) imageGenTestResult.classList.remove('show');
+});
+document.addEventListener('wb-locale-changed', updateImageGenProvider);
- if (!apiKey || !model) {
- const resultEl = showImageGenResult('fail', t('st.imagegen.fill_required'));
- if (resultEl) setTimeout(() => resultEl.classList.remove('show'), 2500);
- return;
- }
+async function saveImageGenForm() {
+ const config = readImageGenForm();
+ validateMediaConfig(config);
+ await browser.storage.local.set({ imageGenModel: config });
+ return config;
+}
- // Persist before testing so the background handler sees the values.
- await browser.storage.local.set({
- imageGenModel: { apiKey, model },
- });
+btnSaveImageGen?.addEventListener('click', async () => {
+ try { await saveImageGenForm(); flashImageGenResult('ok', t('st.imagegen.saved')); }
+ catch (error) { showImageGenResult('fail', t('st.imagegen.failed', { error: error.message })); }
+});
+btnTestImageGen?.addEventListener('click', async () => {
+ btnTestImageGen.disabled = true;
+ try {
+ const config = await saveImageGenForm();
showImageGenResult('', t('st.imagegen.testing'), 'var(--text2)');
+ const res = await sendToBackground('test_image_gen_provider');
+ if (res?.ok) showImageGenResult('ok', t('st.imagegen.connected', { model: res.model || config.model }));
+ else showImageGenResult('fail', t('st.imagegen.failed', { error: res?.error || 'Unknown error' }));
+ } catch (error) { showImageGenResult('fail', t('st.imagegen.failed', { error: error.message })); }
+ finally { btnTestImageGen.disabled = false; }
+});
- try {
- const res = await sendToBackground('test_image_gen_provider');
- if (res?.ok) {
- showImageGenResult('ok', t('st.imagegen.connected', { model: res.model || model }));
- } else {
- showImageGenResult('fail', t('st.imagegen.failed', { error: res?.error || 'Unknown error' }));
- }
- } catch (e) {
- showImageGenResult('fail', t('st.imagegen.failed', { error: e.message }));
- }
- });
-}
-
-if (btnClearImageGen) {
- btnClearImageGen.addEventListener('click', async () => {
- imageGenApiKeyInput.value = '';
- imageGenModelInput.value = '';
- await browser.storage.local.remove('imageGenModel');
- flashImageGenResult('ok', t('st.imagegen.cleared'));
- });
-}
+btnClearImageGen?.addEventListener('click', async () => {
+ const provider = imageGenProviderInput.value;
+ imageGenDrafts.clear();
+ renderImageGenConfig({ provider });
+ await browser.storage.local.remove('imageGenModel');
+ flashImageGenResult('ok', t('st.imagegen.cleared'));
+});
// --- Profile auto-fill ---
let profileSyncChallenge = null;
diff --git a/src/firefox/src/ui/sidepanel.js b/src/firefox/src/ui/sidepanel.js
index 2f1986a00..c69cb204b 100644
--- a/src/firefox/src/ui/sidepanel.js
+++ b/src/firefox/src/ui/sidepanel.js
@@ -1,3 +1,4 @@
+import { appendGeneratedMedia, restoreGeneratedMedia } from './generated-media-view.js';
import { saveScreenshot } from './screenshot-download.js';
/**
* WebBrain Side Panel — Chat UI logic.
@@ -7075,6 +7076,7 @@ function renderAgentErrorUpdate(data, tabId = currentTabId, requestId = '', opti
}
function rebindRestoredMessageControls() {
+ void restoreGeneratedMedia(messagesEl, t);
restoreStagedScreenshotAttachments();
rebindCopyButtons();
rebindMessageInfoToggles();
@@ -9670,6 +9672,10 @@ function handleAgentUpdateMessage(msg) {
case 'tool_result':
if (currentAssistantEl) {
+ if (data.name === 'generate_image') {
+ void appendGeneratedMedia(currentAssistantEl.querySelector('.message-content'), data.result, t);
+ schedulePersist();
+ }
if (verboseMode) appendVerboseToolResult(data.name, data.result);
else markLastStepDone(data.name, data.result);
}
diff --git a/test/generative-media-ui.mjs b/test/generative-media-ui.mjs
new file mode 100644
index 000000000..28daa9dd1
--- /dev/null
+++ b/test/generative-media-ui.mjs
@@ -0,0 +1,190 @@
+import { chromium, firefox } from 'playwright';
+import { createServer } from 'node:http';
+import { readFile, mkdir } from 'node:fs/promises';
+import { resolve, extname, sep } from 'node:path';
+import assert from 'node:assert/strict';
+
+const root = resolve('.');
+const output = process.env.MEDIA_UI_OUTPUT || '/tmp/webbrain-generative-media-ui';
+await mkdir(output, { recursive: true });
+const server = createServer(async (req, res) => {
+ try {
+ const file = resolve(root, '.' + new URL(req.url, 'http://localhost').pathname);
+ if (!file.startsWith(root + sep)) throw new Error('outside root');
+ res.setHeader('Content-Type', ({ '.js': 'text/javascript', '.mjs': 'text/javascript', '.html': 'text/html', '.css': 'text/css', '.svg': 'image/svg+xml' })[extname(file)] || 'text/plain');
+ res.end(await readFile(file));
+ } catch { res.statusCode = 404; res.end(); }
+});
+await new Promise(resolve => server.listen(0, '127.0.0.1', resolve));
+const origin = `http://127.0.0.1:${server.address().port}`;
+const workflow = JSON.stringify({ '6': { class_type: 'CLIPTextEncode', inputs: { text: '{{prompt}}' } }, '9': { class_type: 'SaveImage', inputs: { images: ['6', 0] } } }, null, 2);
+try {
+ for (const [build, engine] of [['chrome', chromium], ['firefox', firefox]]) {
+ const backgroundSource = await readFile(`src/${build}/src/background.js`, 'utf8');
+ const sendStart = backgroundSource.indexOf('function sendAgentUpdate(');
+ const sendSource = backgroundSource.slice(sendStart, backgroundSource.indexOf('\nfunction ', sendStart + 1));
+ const panelSource = await readFile(`src/${build}/src/ui/sidepanel.js`, 'utf8');
+ const handleStart = panelSource.indexOf('function handleAgentUpdateMessage(');
+ const handleEnd = panelSource.slice(handleStart).search(/\n(?:chrome|browser)\.runtime\.onMessage\.addListener/);
+ assert.ok(handleStart >= 0 && handleEnd > 0);
+ const handleSource = panelSource.slice(handleStart, handleStart + handleEnd);
+ const browser = await engine.launch();
+ try {
+ for (const lang of ['en', 'tr']) for (const width of [390, 1280]) {
+ const page = await browser.newPage({ viewport: { width, height: 1100 } });
+ const errors = []; page.on('pageerror', error => errors.push(error.message));
+ await page.addInitScript(({ build, lang }) => {
+ localStorage.setItem('wbLocale', lang);
+ const data = JSON.parse(localStorage.getItem('media-test-store') || 'null') || { wbLocale: lang, imageGenModel: { apiKey: 'legacy-key', model: 'fal-ai/flux/schnell' } };
+ window.testStore = data; window.testRequests = [];
+ const storage = {
+ async get(keys) { return keys == null ? { ...data } : Object.fromEntries((Array.isArray(keys) ? keys : typeof keys === 'string' ? [keys] : Object.keys(keys)).map(key => [key, data[key]])); },
+ async set(values) { Object.assign(data, values); localStorage.setItem('media-test-store', JSON.stringify(data)); },
+ async remove(keys) { for (const key of Array.isArray(keys) ? keys : [keys]) delete data[key]; localStorage.setItem('media-test-store', JSON.stringify(data)); },
+ };
+ window.chrome = window.browser = {
+ storage: { local: storage, onChanged: { addListener() {} } },
+ runtime: { getURL: path => `${location.origin}/src/${build}/${path}`, getManifest: () => ({ version: '39.1.1' }), onMessage: { addListener() {} }, sendMessage(msg, callback) {
+ testRequests.push(msg);
+ const result = msg.action === 'get_providers' ? { providers: {}, active: '' }
+ : msg.action === 'test_image_gen_provider' ? { ok: true, model: data.imageGenModel.model || 'ComfyUI workflow' } : {};
+ callback?.(result); return Promise.resolve(result);
+ } },
+ commands: { getAll: async () => [] }, tabs: { create: async () => ({}) },
+ };
+ }, { build, lang });
+ await page.goto(`${origin}/src/${build}/src/ui/settings.html#multimodal`);
+ await page.waitForFunction(() => document.querySelector('#image-gen-api-key').value === 'legacy-key');
+ assert.equal(await page.locator('#image-gen-heading').innerText(), lang === 'en' ? 'Generative Media' : 'Üretken medya');
+ const provider = page.locator('#image-gen-provider');
+ assert.equal(await provider.inputValue(), 'fal', 'legacy config defaults to fal.ai');
+ assert.deepEqual(await provider.locator('option').evaluateAll(options => options.map(option => option.value)), ['fal', 'openrouter', 'comfyrouter', 'comfyui']);
+ await provider.selectOption('openrouter');
+ assert.equal(await page.locator('#image-gen-api-key').inputValue(), '', 'keys do not cross providers');
+ await page.locator('#image-gen-api-key').fill('synthetic-or-key');
+ await page.locator('#image-gen-model').fill('google/gemini-2.5-flash-image');
+ await page.locator('#btn-save-image-gen').click();
+ await page.waitForFunction(() => testStore.imageGenModel?.provider === 'openrouter');
+ await page.reload();
+ await page.waitForFunction(() => document.querySelector('#image-gen-provider').value === 'openrouter');
+ assert.equal(await page.locator('#image-gen-api-key').inputValue(), 'synthetic-or-key');
+ await page.locator('#btn-test-image-gen').click();
+ await page.waitForFunction(() => testRequests.some(request => request.action === 'test_image_gen_provider'));
+ await provider.selectOption('comfyrouter');
+ assert.equal(await page.locator('#image-gen-parameters-field').isVisible(), true);
+ await page.locator('#image-gen-api-key').fill('synthetic-comfy-key');
+ await page.locator('#image-gen-model').fill('bfl/flux-2-pro');
+ await page.locator('#image-gen-parameters').fill('{bad json');
+ await page.locator('#btn-save-image-gen').click();
+ await page.waitForFunction(() => document.querySelector('#test-image-gen').classList.contains('fail'));
+ assert.equal(await page.evaluate(() => testStore.imageGenModel.provider), 'openrouter', 'invalid input preserves the saved configuration');
+ await page.locator('#image-gen-parameters').fill('{"prompt":"{{prompt}}","width":1024}');
+ await page.locator('#btn-save-image-gen').click();
+ await page.waitForFunction(() => testStore.imageGenModel?.provider === 'comfyrouter');
+ await provider.selectOption('openrouter');
+ assert.equal(await page.locator('#image-gen-api-key').inputValue(), 'synthetic-or-key', 'unsaved draft retained');
+ await provider.selectOption('comfyui');
+ assert.equal(await page.locator('#image-gen-key-field').isVisible(), false);
+ assert.equal(await page.locator('#image-gen-model-field').isVisible(), false);
+ assert.equal(await page.locator('#image-gen-url-field').isVisible(), true);
+ assert.equal(await page.locator('#image-gen-parameters-field').isVisible(), false);
+ assert.equal(await page.locator('#image-gen-base-url').inputValue(), 'http://127.0.0.1:8188');
+ await page.locator('#image-gen-workflow').fill(workflow);
+ await page.locator('#btn-save-image-gen').click();
+ await page.waitForFunction(() => testStore.imageGenModel?.provider === 'comfyui');
+ assert.equal(await page.evaluate(() => testStore.imageGenModel.apiKey), undefined);
+ await page.reload();
+ await page.waitForFunction(() => document.querySelector('#image-gen-provider').value === 'comfyui');
+ assert.equal(await page.locator('#image-gen-workflow').inputValue(), workflow);
+ await page.locator('#image-gen-heading').scrollIntoViewIfNeeded();
+ await page.screenshot({ animations: 'disabled', path: `${output}/${build}-${lang}-${width}-comfyui-configured.png` });
+ await page.locator('#btn-test-image-gen').click();
+ await page.waitForFunction(() => document.querySelector('#test-image-gen').classList.contains('ok'));
+ await page.locator('#btn-clear-image-gen').click();
+ await page.waitForFunction(() => testStore.imageGenModel == null);
+ assert.equal(await page.locator('#image-gen-workflow').inputValue(), '');
+ for (const value of ['fal', 'openrouter', 'comfyrouter', 'comfyui']) {
+ await provider.selectOption(value);
+ assert.equal(await page.locator('#image-gen-api-key').inputValue(), '');
+ await page.locator('#image-gen-heading').scrollIntoViewIfNeeded();
+ await page.screenshot({ animations: 'disabled', path: `${output}/${build}-${lang}-${width}-${value}.png` });
+ assert.equal(await page.evaluate(() => document.documentElement.scrollWidth <= innerWidth), true, `${value}: fits viewport`);
+ }
+ // Exercise the real journal/broadcast/panel handler rather than handing
+ // a raw result straight to the renderer (which hid the original bug).
+ const transport = await page.evaluate(async ({ build, sendSource, handleSource }) => {
+ const { generateImage } = await import(`/src/${build}/src/agent/generative-media.js`);
+ const { appendGeneratedMedia } = await import(`/src/${build}/src/ui/generated-media-view.js`);
+ const { RunUiJournal, compactRunUiSnapshotForPersist, RUN_UI_PERSIST_RETRY_BUDGET } = await import(`/src/${build}/src/run-ui-journal.js`);
+ const { loadGeneratedMedia } = await import(`/src/${build}/src/generated-media-store.js`);
+ const canvas = document.createElement('canvas'); canvas.width = canvas.height = 512;
+ const context = canvas.getContext('2d'); const pixels = context.createImageData(512, 512);
+ for (let i = 0; i < pixels.data.length; i += 65536) crypto.getRandomValues(pixels.data.subarray(i, i + 65536));
+ context.putImageData(pixels, 0, 0);
+ const dataUrl = canvas.toDataURL('image/png');
+ const result = await generateImage({ prompt: 'test image' }, {
+ config: { provider: 'openrouter', apiKey: 'synthetic-key', model: 'image-model' },
+ fetchImpl: async () => new Response(JSON.stringify({ data: [{ b64_json: dataUrl.split(',')[1], media_type: 'image/png' }] }), { headers: { 'Content-Type': 'application/json' } }),
+ });
+ if (!result.success) throw new Error(result.error);
+ const div = document.createElement('div'); div.id = 'media-test-preview'; document.querySelector('#image-gen-card').appendChild(div);
+ div.innerHTML = '<div class="message assistant" data-run-request-id="media-run"><div class="message-content"></div></div>';
+ const handler = new Function('appendGeneratedMedia', 'context', `
+ const { currentAssistantEl, messagesEl, currentTabId, verboseMode } = context;
+ const t = key => key;
+ const clearedConversationRunRequestIds = new Set();
+ const localRunRequestIds = new Map();
+ const ensureCurrentRunAssistant = () => currentAssistantEl;
+ const markLastStepDone = () => {};
+ const appendVerboseToolResult = () => {};
+ const scrollToBottom = () => {};
+ const schedulePersist = () => context.persistCalls++;
+ return (${handleSource});
+ `)(appendGeneratedMedia, { messagesEl: div, currentAssistantEl: div.firstElementChild, currentTabId: 11, verboseMode: false, persistCalls: 0 });
+ const journal = new RunUiJournal(); journal.begin(11, 'media-run');
+ const sent = [];
+ const api = { runtime: { sendMessage: async message => { sent.push(message); handler(message); } } };
+ const send = new Function('recordRunUiEvent', 'agent', 'chrome', 'browser', `return (${sendSource});`)(
+ (...args) => journal.record(...args), { currentRunId: new Map() }, api, api,
+ );
+ send(11, 'media-run', 'tool_result', { name: 'generate_image', result });
+ // Hosted videos must also reach the media element, not their thumbnail.
+ send(11, 'media-run', 'tool_result', { name: 'generate_image', result: { success: true, provider: 'comfyrouter', url: 'https://cdn.example/final.mp4' } });
+ appendGeneratedMedia(div, { success: true, url: 'javascript:alert(1)' }, key => key);
+ const snapshot = compactRunUiSnapshotForPersist(journal.get(11), { tight: true });
+ localStorage.setItem('media-replay-snapshot', JSON.stringify(snapshot));
+ localStorage.setItem('media-asset-id', result.mediaId);
+ const blob = await loadGeneratedMedia(result.mediaId);
+ return { sentHandle: sent[0].data.result.mediaId, mediaId: result.mediaId, url: result.url, blobSize: blob.size, snapshotSize: JSON.stringify(snapshot).length, budget: RUN_UI_PERSIST_RETRY_BUDGET, discarded: snapshot.discardedBeforeSeq };
+ }, { build, sendSource, handleSource });
+ assert.equal(transport.sentHandle, transport.mediaId);
+ assert.equal(transport.url, undefined, 'inline bytes travel as an asset handle');
+ assert.ok(transport.blobSize > 512 * 1024, 'real inline image exceeds journal budget');
+ assert.ok(transport.snapshotSize < transport.budget);
+ assert.equal(transport.discarded, 0);
+ await page.waitForFunction(() => document.querySelector('#media-test-preview img')?.naturalWidth === 512);
+ assert.equal(await page.locator('#media-test-preview a[download]').getAttribute('download'), 'webbrain-media.png');
+ assert.equal(await page.locator('#media-test-preview video').getAttribute('src'), 'https://cdn.example/final.mp4');
+ await page.evaluate(() => localStorage.setItem('media-chat-html', document.querySelector('#media-test-preview').innerHTML));
+ await page.reload();
+ await page.evaluate(async build => {
+ const { appendGeneratedMedia, restoreGeneratedMedia } = await import(`/src/${build}/src/ui/generated-media-view.js`);
+ const { RunUiJournal } = await import(`/src/${build}/src/run-ui-journal.js`);
+ const restored = new RunUiJournal(); restored.restore(11, JSON.parse(localStorage.getItem('media-replay-snapshot')));
+ const div = document.createElement('div'); div.id = 'media-replay-preview'; document.querySelector('#image-gen-card').appendChild(div);
+ for (const event of restored.get(11).events) await appendGeneratedMedia(div, event.data.result, key => key);
+ const chat = document.createElement('div'); chat.id = 'media-restored-chat'; document.querySelector('#image-gen-card').appendChild(chat);
+ chat.innerHTML = localStorage.getItem('media-chat-html');
+ await restoreGeneratedMedia(chat, key => key);
+ }, build);
+ await page.waitForFunction(() => document.querySelector('#media-replay-preview img')?.naturalWidth === 512 && document.querySelector('#media-restored-chat img')?.naturalWidth === 512);
+ assert.equal(await page.locator('#media-restored-chat .generated-media[data-media-id]').getAttribute('data-media-id'), transport.mediaId);
+ assert.equal(await page.locator('#media-replay-preview a[download]').getAttribute('download'), 'webbrain-media.png');
+ assert.equal(await page.locator('#media-replay-preview video').count(), 1);
+ assert.deepEqual(errors, []);
+ console.log(`${build} ${lang} ${width}: settings, live journal delivery, large inline media, replay and restored chat passed`);
+ await page.close();
+ }
+ } finally { await browser.close(); }
+ }
+} finally { await new Promise(resolve => server.close(resolve)); }
diff --git a/test/generative-media.mjs b/test/generative-media.mjs
new file mode 100644
index 000000000..4437d74d6
--- /dev/null
+++ b/test/generative-media.mjs
@@ -0,0 +1,238 @@
+import test from 'node:test';
+import assert from 'node:assert/strict';
+import { readFile } from 'node:fs/promises';
+
+const json = (body, status = 200, headers = {}) => new Response(JSON.stringify(body), { status, headers: { 'Content-Type': 'application/json', ...headers } });
+const workflow = { '6': { class_type: 'CLIPTextEncode', inputs: { text: '{{prompt}}' } }, '9': { class_type: 'SaveImage', inputs: { images: ['6', 0] } } };
+
+for (const build of ['chrome', 'firefox']) {
+ const media = await import(`../src/${build}/src/agent/generative-media.js`);
+ const config = await import(`../src/${build}/src/agent/media-config.js`);
+ const gate = await import(`../src/${build}/src/agent/permission-gate.js`);
+ const journal = await import(`../src/${build}/src/run-ui-journal.js`);
+
+ test(`${build}: generated assets survive the actual background broadcast and bounded replay`, async () => {
+ const source = await readFile(`src/${build}/src/background.js`, 'utf8');
+ const start = source.indexOf('function sendAgentUpdate(');
+ const sendSource = source.slice(start, source.indexOf('\nfunction ', start + 1));
+ const runJournal = new journal.RunUiJournal();
+ runJournal.begin(11, 'media-run');
+ const delivered = [];
+ const api = { runtime: { sendMessage: async message => { delivered.push(message); } } };
+ const send = new Function('recordRunUiEvent', 'agent', 'chrome', 'browser', `return (${sendSource});`)(
+ (...args) => runJournal.record(...args), { currentRunId: new Map() }, api, api,
+ );
+ const results = [
+ { success: true, provider: 'fal', model: 'fal-ai/flux/schnell', url: 'https://cdn.example/image.png' },
+ { success: true, provider: 'comfyrouter', model: 'luma/ray-2', url: 'https://cdn.example/video.mp4' },
+ { success: true, provider: 'comfyui', model: 'ComfyUI workflow', url: 'http://127.0.0.1:8188/view?filename=image.png&type=output' },
+ { success: true, provider: 'openrouter', model: 'image-model', inlineMedia: true, mediaId: 'f0c21b19-32d0-44f4-93cd-1031c6bb9a4d', mimeType: 'image/png' },
+ ];
+ for (const result of results) send(11, 'media-run', 'tool_result', { name: 'generate_image', result });
+ assert.deepEqual(delivered.map(message => message.data.result), results);
+ const persisted = journal.compactRunUiSnapshotForPersist(runJournal.get(11), { tight: true });
+ assert.ok(JSON.stringify(persisted).length < journal.RUN_UI_PERSIST_RETRY_BUDGET);
+ assert.equal(persisted.discardedBeforeSeq, 0);
+ const restored = new journal.RunUiJournal();
+ restored.restore(11, structuredClone(persisted));
+ assert.deepEqual(restored.get(11).events.map(event => event.data.result), results);
+ assert.equal(journal.compactRunUiData('tool_result', { name: 'read_page', result: { success: true, url: 'https://secret.example', mediaId: 'private' } }).result.url, undefined);
+ });
+
+ test(`${build}: old fal settings and selected provider hosts remain correctly scoped`, () => {
+ assert.equal(config.mediaProvider({ apiKey: 'k', model: 'fal-ai/flux/schnell' }), 'fal');
+ assert.equal(config.isImageGenConfigured({ apiKey: 'k', model: 'fal-ai/flux/schnell' }), true);
+ assert.equal(config.isImageGenConfigured({ provider: 'other', apiKey: 'k', model: 'x' }), false);
+ for (const [provider, host] of [['fal', 'queue.fal.run'], ['openrouter', 'openrouter.ai'], ['comfyrouter', 'api.comfy.org'], ['comfyui', '127.0.0.1']]) {
+ assert.equal(gate.hostForCapability(gate.Capability.NETWORK, { _generativeMediaUrl: config.mediaPermissionUrl({ provider }) }, 'evil.example', 'generate_image'), host);
+ }
+ assert.equal(gate.hostForCapability(gate.Capability.NETWORK, { url: 'https://evil.example', provider: 'fal' }, 'example.com', 'generate_image'), '');
+ for (const baseUrl of ['https://evil.example', 'http://localhost.evil.test:8188', 'http://user:pass@localhost:8188', 'http://localhost:8188?x=1', 'file:///tmp/x']) assert.throws(() => config.comfyBaseUrl(baseUrl));
+ assert.equal(config.comfyBaseUrl('http://[::1]:8188/'), 'http://[::1]:8188');
+ assert.equal(config.isImageGenConfigured({ provider: 'comfyui', workflow }), true);
+ assert.throws(() => config.validateMediaConfig({ provider: 'comfyui', workflow: { nodes: [] } }), /API format/);
+ assert.throws(() => config.validateMediaConfig({ provider: 'comfyui', workflow: { '6': { class_type: 'CLIPTextEncode', inputs: { text: 'fixed' } } } }), /positive prompt/);
+ });
+
+ test(`${build}: OpenRouter Image API returns inline media without a chat request`, async () => {
+ const calls = [];
+ const result = await media.runMediaGeneration({ prompt: 'red apple', config: { provider: 'openrouter', apiKey: 'or-key', model: 'google/gemini-2.5-flash-image' }, fetchImpl: async (url, init) => {
+ calls.push(url); assert.equal(init.headers.Authorization, 'Bearer or-key');
+ assert.equal(init.redirect, 'error'); assert.deepEqual(JSON.parse(init.body), { model: 'google/gemini-2.5-flash-image', prompt: 'red apple' });
+ return json({ data: [{ b64_json: 'YWJj', media_type: 'image/webp' }] });
+ } });
+ assert.deepEqual(calls, ['https://openrouter.ai/api/v1/images']);
+ assert.equal(result.url, 'data:image/webp;base64,YWJj');
+ assert.equal(media.extractMediaUrl({ data: [{ b64_json: 'YWJj', media_type: 'image/svg+xml' }] }), '');
+ assert.equal(media.extractMediaUrl({ candidates: [{ content: { parts: [{ inlineData: { mimeType: 'image/png', data: 'YWJj' } }] } }] }), 'data:image/png;base64,YWJj');
+ assert.equal(media.extractMediaUrl({ status_url: 'https://api.example/status' }), '');
+ assert.equal(media.safeMediaUrl('javascript:alert(1)'), '');
+ assert.equal(media.safeMediaUrl('https://[email protected]/x'), '');
+ });
+
+ test(`${build}: Comfy Router binds native inputs and polls trusted job paths`, async () => {
+ const calls = [];
+ const result = await media.runMediaGeneration({ prompt: 'an apple "quoted"', config: { provider: 'comfyrouter', apiKey: 'comfyui-key', model: 'bfl/flux-2-pro', parameters: JSON.stringify({ content: [{ text: '{{prompt}}', type: 'text' }], steps: 20 }) }, pollIntervalMs: 1, fetchImpl: async (url, init) => {
+ calls.push(url); assert.equal(init.headers['X-API-Key'], 'comfyui-key');
+ if (calls.length === 1) {
+ assert.match(init.headers['Idempotency-Key'], /^[\da-f-]{36}$/);
+ assert.deepEqual(JSON.parse(init.body), { content: [{ text: 'an apple "quoted"', type: 'text' }], steps: 20 });
+ return json({ request_id: 'job-1', status_url: 'https://evil.example/status', response_url: 'https://evil.example/result', cancel_url: 'https://evil.example/cancel' }, 201);
+ }
+ if (calls.length === 2) return json({ status: 'COMPLETED' });
+ return json({ result: { sample: 'https://cdn.example/apple.png' } });
+ } });
+ assert.equal(result.url, 'https://cdn.example/apple.png');
+ assert.deepEqual(calls, ['https://api.comfy.org/v2/models/bfl/flux-2-pro/requests', 'https://api.comfy.org/v2/models/bfl/flux-2-pro/requests/job-1/status', 'https://api.comfy.org/v2/models/bfl/flux-2-pro/requests/job-1']);
+ });
+
+ test(`${build}: Comfy Router native assets return the final video without cancelling a completed job`, async () => {
+ const calls = [];
+ const result = await media.runMediaGeneration({ prompt: 'red apple', config: { provider: 'comfyrouter', apiKey: 'k', model: 'luma/ray-2', parameters: { aspect_ratio: '16:9', duration: '5s', resolution: '720p' } }, pollIntervalMs: 1, fetchImpl: async (url, init) => {
+ calls.push({ url, method: init.method });
+ if (calls.length === 1) return json({ request_id: 'luma-1' }, 201);
+ if (calls.length === 2) return json({ status: 'COMPLETED' });
+ return json({ assets: { image: 'https://cdn.example/preview.jpg', progress_video: 'https://cdn.example/progress.mp4', video: 'https://cdn.example/final.mp4' }, status_url: 'https://api.example/status' });
+ } });
+ assert.equal(result.url, 'https://cdn.example/final.mp4');
+ assert.equal(calls.length, 3);
+ assert.ok(calls.every(call => !call.url.endsWith('/cancel')));
+ assert.equal(media.extractMediaUrl({ assets: { image: 'https://cdn.example/final.png' } }), 'https://cdn.example/final.png');
+ assert.equal(media.extractMediaUrl({ result: { video: 'https://cdn.example/final.mp4' } }), 'https://cdn.example/final.mp4');
+ assert.equal(media.extractMediaUrl({ assets: { progress_video: 'https://cdn.example/progress.mp4' }, status_url: 'https://api.example/status' }), '');
+ for (const value of ['javascript:alert(1)', 'file:///tmp/private', 'https://[email protected]/final.mp4']) {
+ assert.equal(media.extractMediaUrl({ assets: { video: value } }), '');
+ }
+ });
+
+ test(`${build}: failed Comfy Router completion cannot become a successful image`, async () => {
+ const calls = [];
+ await assert.rejects(media.runMediaGeneration({ prompt: 'x', config: { provider: 'comfyrouter', apiKey: 'k', model: 'bfl/flux-2-pro' }, pollIntervalMs: 1, fetchImpl: async (url, init) => {
+ calls.push({ url, method: init.method });
+ if (calls.length === 1) return json({ request_id: 'j' }, 201);
+ return json({ status: 'COMPLETED', error_type: 'content_policy_violation' });
+ } }), /content_policy_violation/);
+ assert.equal(calls.at(-1).method, 'PUT');
+ assert.ok(calls.at(-1).url.endsWith('/j/cancel'));
+ });
+
+ test(`${build}: local workflow prompts and saved file query are transported correctly`, async () => {
+ const original = JSON.stringify(workflow);
+ const calls = [];
+ const result = await media.runMediaGeneration({ prompt: 'red apple "with quotes"', config: { provider: 'comfyui', workflow, baseUrl: 'http://localhost:8188/' }, pollIntervalMs: 1, fetchImpl: async (url, init) => {
+ calls.push(url); assert.equal(init.headers?.Authorization, undefined);
+ if (calls.length === 1) {
+ const body = JSON.parse(init.body); assert.equal(body.prompt['6'].inputs.text, 'red apple "with quotes"');
+ assert.equal(body.prompt['9'].class_type, 'SaveImage'); return json({ prompt_id: 'local-1' });
+ }
+ if (calls.length === 2) return json({});
+ return json({ 'local-1': { status: { completed: true }, outputs: { '9': { images: [{ filename: 'apple #1.png', subfolder: 'my folder', type: 'output' }] } } } });
+ } });
+ assert.equal(JSON.stringify(workflow), original);
+ const url = new URL(result.url); assert.equal(url.origin, 'http://localhost:8188');
+ assert.equal(url.pathname, '/view'); assert.equal(url.searchParams.get('filename'), 'apple #1.png');
+ assert.equal(url.searchParams.get('subfolder'), 'my folder');
+ });
+
+ test(`${build}: cancellation deletes only the local queued job`, async () => {
+ const controller = new AbortController(); const calls = [];
+ await assert.rejects(media.runMediaGeneration({ prompt: 'x', config: { provider: 'comfyui', workflow }, signal: controller.signal, pollIntervalMs: 1, fetchImpl: async (url, init) => {
+ calls.push({ url, init });
+ if (url.endsWith('/prompt')) { controller.abort(new Error('stopped')); return json({ prompt_id: 'mine' }); }
+ return json({});
+ } }), /stopped/);
+ assert.equal(calls.length, 2);
+ assert.equal(calls[1].url, 'http://127.0.0.1:8188/queue');
+ assert.deepEqual(JSON.parse(calls[1].init.body), { delete: ['mine'] });
+ assert.ok(!calls.some(call => call.url.includes('/interrupt')));
+ });
+
+ test(`${build}: timeouts abort in-flight generation`, async () => {
+ await assert.rejects(media.runMediaGeneration({ prompt: 'x', config: { provider: 'openrouter', apiKey: 'k', model: 'image-model' }, timeoutMs: 10,
+ fetchImpl: async (_url, init) => new Promise((_resolve, reject) => init.signal.addEventListener('abort', () => reject(init.signal.reason), { once: true })),
+ }), /timed out/);
+ });
+
+ test(`${build}: actual tool batch uses the same provider snapshot for permission and dispatch`, async () => {
+ const originalChrome = globalThis.chrome, originalBrowser = globalThis.browser;
+ let selected = { provider: 'openrouter', apiKey: 'saved-key', model: 'image-model' };
+ const area = { get: async () => ({ imageGenModel: structuredClone(selected) }), set: async () => {}, remove: async () => {} };
+ const api = {
+ storage: { local: area, session: area }, runtime: { getURL: value => `chrome-extension://test/${value}`, sendMessage: async () => ({}) },
+ tabs: { get: async id => ({ id, url: 'https://example.com', title: 'Example' }), sendMessage: async () => ({}) },
+ scripting: { executeScript: async () => [{ result: null }] },
+ };
+ globalThis.chrome = globalThis.browser = api;
+ try {
+ const { Agent } = await import(`../src/${build}/src/agent/agent.js`);
+ const provider = { supportsVision: false, promptTier: 'full' };
+ const agent = new Agent({ getActive: () => provider, getVisionProvider: async () => null });
+ agent._ensureGateSetting = async () => {};
+ agent._persist = () => {};
+ agent._skipPermissionGate = false;
+ const hosts = []; let dispatched = false;
+ agent.permissions.check = host => {
+ hosts.push(host);
+ // A settings change during approval must not move this request to another host.
+ selected = { provider: 'comfyrouter', apiKey: 'other-key', model: 'bfl/flux-2-pro' };
+ return { allowed: true };
+ };
+ agent.executeTool = async (_tab, name, args, _update, context) => {
+ assert.equal(name, 'generate_image'); assert.equal(args.prompt, 'red apple');
+ assert.deepEqual(context.imageGenConfig, { provider: 'openrouter', apiKey: 'saved-key', model: 'image-model' });
+ dispatched = true;
+ return { success: true, provider: 'openrouter', model: 'image-model', url: 'data:image/png;base64,' + 'YWJj'.repeat(4000) };
+ };
+ const messages = [];
+ await agent._executeToolBatch(11, [{ id: 'spoof-call', function: { name: 'generate_image', arguments: JSON.stringify({ prompt: 'red apple', _generativeMediaUrl: 'https://evil.example' }) } }], messages, () => {}, provider, '', new Set(['generate_image']), 1);
+ assert.equal(dispatched, false); assert.match(messages[0].content, /invalid_tool_arguments/);
+ messages.length = 0;
+ await agent._executeToolBatch(11, [{ id: 'media-call', function: { name: 'generate_image', arguments: JSON.stringify({ prompt: 'red apple' }) } }], messages, () => {}, provider, '', new Set(['generate_image']), 1);
+ assert.equal(dispatched, true, JSON.stringify(messages)); assert.deepEqual(hosts, ['openrouter.ai']);
+ assert.ok(messages[0].content.includes('inlineMedia'));
+ assert.ok(!messages[0].content.includes('YWJj'));
+ assert.ok(!messages[0].content.includes('saved-key'));
+ const handleResult = agent._limitToolResult({ success: true, provider: 'openrouter', inlineMedia: true, mediaId: 'private-asset-id', mimeType: 'image/png' });
+ assert.ok(handleResult.includes('do not invent a hosted URL'));
+ assert.ok(!handleResult.includes('private-asset-id'));
+ } finally { globalThis.chrome = originalChrome; globalThis.browser = originalBrowser; }
+ });
+
+ test(`${build}: connection tests are authenticated read-only probes with provider validation`, async () => {
+ const originalChrome = globalThis.chrome, originalBrowser = globalThis.browser;
+ let selected;
+ const api = { storage: { local: { get: async () => ({ imageGenModel: selected }) } } };
+ globalThis.chrome = globalThis.browser = api;
+ try {
+ for (const [provider, values, responses, urls] of [
+ ['fal', { apiKey: 'k', model: 'fal-ai/flux/schnell' }, [json({})], ['https://api.fal.ai/v1/workflows?limit=1']],
+ ['openrouter', { apiKey: 'k', model: 'image-model' }, [json({ data: {} }), json({ data: [{ id: 'image-model' }] })], ['https://openrouter.ai/api/v1/key', 'https://openrouter.ai/api/v1/images/models']],
+ ['comfyrouter', { apiKey: 'k', model: 'bfl/flux-2-pro' }, [json({ id: 'bfl/flux-2-pro' })], ['https://api.comfy.org/v2/models/bfl/flux-2-pro']],
+ ['comfyui', { workflow }, [json({ system: {}, devices: [] })], ['http://127.0.0.1:8188/system_stats']],
+ ]) {
+ selected = { provider, ...values }; const calls = [];
+ const result = await media.testImageGenProvider(async (url, init) => { assert.ok(!init.method || init.method === 'GET'); calls.push(url); return responses.shift(); });
+ assert.equal(result.ok, true, result.error); assert.deepEqual(calls, urls);
+ assert.equal((await media.testImageGenProvider(async () => json({}, 401))).ok, false);
+ }
+ selected = { provider: 'openrouter', apiKey: 'k', model: 'text-only' };
+ const responses = [json({ data: {} }), json({ data: [{ id: 'image-model' }] })];
+ assert.match((await media.testImageGenProvider(async () => responses.shift())).error, /image generation catalog/);
+ } finally { globalThis.chrome = originalChrome; globalThis.browser = originalBrowser; }
+ });
+
+ test(`${build}: locale keys preserve placeholders and neutral media titles`, async () => {
+ const { LANGUAGES } = await import(`../src/${build}/src/ui/i18n.js`);
+ const english = (await import(`../src/${build}/src/ui/locales/en.js`)).default;
+ assert.equal(english['st.imagegen.heading'], 'Generative Media');
+ for (const lang of LANGUAGES) {
+ const dictionary = (await import(`../src/${build}/src/ui/locales/${lang.code}.js`)).default;
+ for (const key of Object.keys(english).filter(key => key.startsWith('st.imagegen.'))) {
+ assert.equal(typeof dictionary[key], 'string', `${lang.code}: ${key}`);
+ assert.deepEqual([...dictionary[key].matchAll(/\{(\w+)\}/g)].map(x => x[1]).sort(), [...english[key].matchAll(/\{(\w+)\}/g)].map(x => x[1]).sort(), `${lang.code}: ${key}`);
+ }
+ assert.ok(!dictionary['st.imagegen.heading'].includes('fal.ai'));
+ }
+
+ });
+}
diff --git a/test/run.js b/test/run.js
index df81acf5a..d633a77ab 100644
--- a/test/run.js
+++ b/test/run.js
@@ -108638,26 +108638,30 @@ test('hostForCapability: navigate/network use target URL, others use current pag
assert.equal(hostForCapability(Capability.NAVIGATE, { steps: 2 }, 'https://cur.com', 'go_forward'), 'cur.com');
});
-test('generate_image permission and result trust are bound to fal.ai in both builds', () => {
+test('generate_image permission and result trust are bound to the configured provider in both builds', () => {
for (const [label, Cap, hostFor, reqHosts, untrustedTools] of [
['firefox', Capability, hostForCapability, requiredHosts, UNTRUSTED_CONTENT_TOOLS],
['chrome', CapabilityCh, hostForCapabilityCh, requiredHostsCh, UNTRUSTED_CONTENT_TOOLS_CH],
]) {
const activePage = 'https://example.com/article';
- assert.equal(
- hostFor(Cap.NETWORK, {}, activePage, 'generate_image'),
- 'queue.fal.run',
- `${label}: paid generation must not borrow the active-page host`,
- );
- assert.deepEqual(
- reqHosts(Cap.NETWORK, {}, activePage, 'generate_image'),
- ['queue.fal.run'],
- `${label}: the grant must name the real fal.ai egress host`,
- );
+ for (const [url, host] of [
+ ['https://queue.fal.run', 'queue.fal.run'],
+ ['https://openrouter.ai', 'openrouter.ai'],
+ ['https://api.comfy.org', 'api.comfy.org'],
+ ['http://127.0.0.1:8188', '127.0.0.1'],
+ ]) {
+ const args = { _generativeMediaUrl: url };
+ assert.equal(hostFor(Cap.NETWORK, args, activePage, 'generate_image'), host,
+ `${label}: generation must not borrow the active-page host`);
+ assert.deepEqual(reqHosts(Cap.NETWORK, args, activePage, 'generate_image'), [host],
+ `${label}: the grant must name the configured media host`);
+ }
+ assert.deepEqual(reqHosts(Cap.NETWORK, {}, activePage, 'generate_image'), [],
+ `${label}: missing trusted settings must fail closed`);
assert.equal(
untrustedTools.has('generate_image'),
true,
- `${label}: provider-authored fal.ai results must be wrapped as untrusted`,
+ `${label}: provider-authored media results must be wrapped as untrusted`,
);
}
});
@@ -128592,6 +128596,7 @@ test('generate_image success completes state-changing tasks while failed generat
[2, { success: false, error: 'fal.ai rejected the request.' }, 0],
[3, { success: false, error: 'fal.ai generation was cancelled.', cancelled: true }, 0],
[4, { success: false, error: 'fal.ai generation timed out.' }, 0],
+ [5, { success: true, inlineMedia: true, mediaId: 'f0c21b19-32d0-44f4-93cd-1031c6bb9a4d', mimeType: 'image/png', provider: 'openrouter' }, 1],
]) {
const state = agent._startPlanExecutionGuard(tabId, 'act', {
requestKind: 'execute',
@@ -128640,7 +128645,7 @@ test('generate_image tool exists in both builds, full tier only, and settings UI
const agentJs = fs.readFileSync(path.join(ROOT, `src/${build}/src/agent/agent.js`), 'utf8');
assert.ok(agentJs.includes("name === 'generate_image'"), `${build}: agent.js should dispatch generate_image`);
- assert.match(agentJs, /generateImage\(args, \{ signal: executionContext\?\._contentActionAbortSignal \}\)/,
+ assert.match(agentJs, /generateImage\(args, \{ signal: executionContext\?\._contentActionAbortSignal, \.\.\.\(executionContext\?\.imageGenConfig \? \{ config: executionContext\.imageGenConfig \} : \{\}\) \}\)/,
`${build}: agent.js should pass the linked run signal into fal generation`);
assert.equal(untrustedTools.has('generate_image'), true, `${build}: fal.ai output must be untrusted`);