Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.
JavaScript aianthropiccross-platformgeminigroqlinuxmacosnvidiaopen-sourceopenaiparakeetspeech-to-texttranscribewhisperwindows
feat(meeting): interop cloud streaming providers + AEC/VAD improvements (#656)
Gabriel Steinb5b35fd86246
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 7dbb45428..6f9a658ed 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -7,6 +7,34 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0## [Unreleased]+## [1.6.11] - 2026-04-22++### Added++- **Interoperable Cloud Streaming Providers**: Meeting recording now supports AssemblyAI Universal-3 Pro, Deepgram, and OpenAI Realtime as interchangeable cloud streaming backends. Provider availability is server-authoritative via the `NOTE_RECORDING_PROVIDERS` env var on the API; desktop picks the active provider from the catalog returned by `/api/note-recording-config`+- **Acoustic VAD Gate for Meeting Mic**: Drops system-dominant microphone chunks using RMS/peak thresholds against a rolling reference window, preventing cross-language hallucinations from speaker bleed into the mic+- **Peak Escape**: Soft exception to the VAD gate when the mic peak spikes cleanly over the system-speaking window, so the user's voice onset is never clipped mid-syllable+- **Cross-Device Delete Propagation** (#646): Deletes now propagate across devices through the sync pipeline for all object types++### Changed++- **Meeting Streaming Provider Authority**: Removed the desktop-side streaming provider UI picker. The authoritative list lives on the API; the desktop renders whichever providers are enabled server-side+- **Echo Cancellation Pipeline**: AEC3 config now disables OS-level `echoCancellation` (it was double-processing) and enables the built-in high-pass filter plus `kModerate` noise suppression, giving a noticeably cleaner mic path before the VAD gate+- **VAD Thresholds Tuned Against Measured Leak**: RMS ceiling `0.018`, peak ceiling `0.07`, lookback `500ms` — calibrated from real session traces where user speech consistently exceeded both thresholds and bleed consistently sat below++### Fixed++- **AssemblyAI v3 Frame Size**: Buffer audio to meet the v3 minimum 50ms frame requirement (was hitting "Input Duration Error: 45.0 ms")+- **AssemblyAI / Deepgram `completedSegments`**: The echo-leak detector crashed on turn-end for non-OpenAI providers because `completedSegments` only existed on the OpenAI client; exposed it on AssemblyAI and Deepgram as well+- **Streaming Token Plumbing**: Streaming client factory now passes both `apiKey` and `token` fields (OpenAI expects `apiKey`, AssemblyAI/Deepgram expect `token`)+- **Note-Recording Config Over IPC**: Moved the `/api/note-recording-config` fetch from the renderer into the main process so Neon Auth session cookies are attached (was returning 401)+- **Speech-Start Timestamp to Echo-Leak Detector**: AssemblyAI and Deepgram turns now pass their speech-start wall-clock time to the detector, eliminating `missing_start` drops on legitimate turns+- **Drop Flagged-Bleed Mic Segments on Holdback Expiry**: When the echo-leak detector flags a mic turn as bleed, the segment is now dropped rather than flushed once the holdback window closes; correlation `>= 0.70` alone is sufficient evidence (in addition to the prior three-condition check)+- **Speaker Label Cap**: UI speaker labels are now strictly capped at `expectedCount` (interpreted as the number of other attendees besides the user), preventing phantom `Speaker 3+` labels in 1-on-1 and small-group sessions+- **Live Speaker Profile Matching Scoped to Note Attendees**: Live diarization no longer pulls in profiles from unrelated notes when identifying attendees+- **Sync — Preserve Client `updated_at` on Note Push**: Server was overwriting `updated_at` on every push, causing spurious sync loops and stale-merge conflicts+- **Chat Intelligence Stale Provider on Mode Switch** (#647): Switching Agent Mode from Cloud Providers to Local left the previous cloud provider cached, routing chat to the stale provider and erroring with "API key not configured" despite a local model being selected; mode changes now clear `agentProvider`/`agentModel` when incompatible with the new mode+## [1.6.10] - 2026-04-20### Added@@ -542,6 +570,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0## [1.4.8] - 2026-02-12### Added+- **Referral Program**: Invite friends to earn free Pro months with referral dashboard, email invitations, invite tracking with status badges, and animated spectrogram share card with unique referral code- **Notes System**: Added sidebar navigation with notes system and dictionary view for organizing transcriptions- **Folder Organization**: Notes can be organized into custom folders with a default Personal folder, folder management UI, and folder-aware note filtering. Upload flow now includes folder selectiondiff --git a/native/meeting-aec-helper/src/aec_processor.cc b/native/meeting-aec-helper/src/aec_processor.ccindex d3d48c1ec..811edca15 100644--- a/native/meeting-aec-helper/src/aec_processor.cc+++ b/native/meeting-aec-helper/src/aec_processor.cc@@ -31,9 +31,11 @@ AecProcessor::AecProcessor(int sample_rate_hz)webrtc::AudioProcessing::Config config;config.pipeline.maximum_internal_processing_rate = kProcessingSampleRate;config.echo_canceller.enabled = true;- config.echo_canceller.enforce_high_pass_filtering = false;- config.high_pass_filter.enabled = false;- config.noise_suppression.enabled = false;+ config.echo_canceller.enforce_high_pass_filtering = true;+ config.high_pass_filter.enabled = true;+ config.noise_suppression.enabled = true;+ config.noise_suppression.level =+ webrtc::AudioProcessing::Config::NoiseSuppression::Level::kModerate;config.transient_suppression.enabled = false;config.gain_controller1.enabled = false;config.gain_controller2.enabled = false;diff --git a/package-lock.json b/package-lock.jsonindex b53523f19..e6e6b06fc 100644--- a/package-lock.json+++ b/package-lock.json@@ -1,12 +1,12 @@{"name": "open-whispr",- "version": "1.6.10",+ "version": "1.6.11","lockfileVersion": 3,"requires": true,"packages": {"": {"name": "open-whispr",- "version": "1.6.10",+ "version": "1.6.11","hasInstallScript": true,"license": "MIT","dependencies": {@@ -409,48 +409,48 @@}},"node_modules/@aws-sdk/client-cognito-identity": {- "version": "3.1032.0",- "resolved": "https://registry.npmjs.org/@aws-sdk/client-cognito-identity/-/client-cognito-identity-3.1032.0.tgz",- "integrity": "sha512-TVgbjyb1fJoHZDoBAmW85hNcx00zxi5qXFG3wvS/2C213Q2PusCQIih7Zlub9mKE3iRtES5epxazFmp8jVeLyQ==",+ "version": "3.1034.0",+ "resolved": "https://registry.npmjs.org/@aws-sdk/client-cognito-identity/-/client-cognito-identity-3.1034.0.tgz",+ "integrity": "sha512-GA2Xo1fNp4qnqTUI/IRGj/QmkQDXZyer3m/nu8WO7PgT3I+8/yWw2Vzw81HjAhOiF//YjNmpn10uHVg3ViSCRA==","license": "Apache-2.0","dependencies": {"@aws-crypto/sha256-browser": "5.2.0","@aws-crypto/sha256-js": "5.2.0",- "@aws-sdk/core": "^3.974.1",- "@aws-sdk/credential-provider-node": "^3.972.32",+ "@aws-sdk/core": "^3.974.3",+ "@aws-sdk/credential-provider-node": "^3.972.34","@aws-sdk/middleware-host-header": "^3.972.10","@aws-sdk/middleware-logger": "^3.972.10","@aws-sdk/middleware-recursion-detection": "^3.972.11",- "@aws-sdk/middleware-user-agent": "^3.972.31",- "@aws-sdk/region-config-resolver": "^3.972.12",+ "@aws-sdk/middleware-user-agent": "^3.972.33",+ "@aws-sdk/region-config-resolver": "^3.972.13","@aws-sdk/types": "^3.973.8",- "@aws-sdk/util-endpoints": "^3.996.7",+ "@aws-sdk/util-endpoints": "^3.996.8","@aws-sdk/util-user-agent-browser": "^3.972.10",- "@aws-sdk/util-user-agent-node": "^3.973.17",- "@smithy/config-resolver": "^4.4.16",- "@smithy/core": "^3.23.15",+ "@aws-sdk/util-user-agent-node": "^3.973.19",+ "@smithy/config-resolver": "^4.4.17",+ "@smithy/core": "^3.23.16","@smithy/fetch-http-handler": "^5.3.17","@smithy/hash-node": "^4.2.14","@smithy/invalid-dependency": "^4.2.14","@smithy/middleware-content-length": "^4.2.14",- "@smithy/middleware-endpoint": "^4.4.30",- "@smithy/middleware-retry": "^4.5.3",- "@smithy/middleware-serde": "^4.2.18",+ "@smithy/middleware-endpoint": "^4.4.31",+ "@smithy/middleware-retry": "^4.5.4",+ "@smithy/middleware-serde": "^4.2.19","@smithy/middleware-stack": "^4.2.14","@smithy/node-config-provider": "^4.3.14",- "@smithy/node-http-handler": "^4.5.3",+ "@smithy/node-http-handler": "^4.6.0","@smithy/protocol-http": "^5.3.14",- "@smithy/smithy-client": "^4.12.11",+ "@smithy/smithy-client": "^4.12.12","@smithy/types": "^4.14.1","@smithy/url-parser": "^4.2.14","@smithy/util-base64": "^4.3.2","@smithy/util-body-length-browser": "^4.2.2","@smithy/util-body-length-node": "^4.2.3",- "@smithy/util-defaults-mode-browser": "^4.3.47",- "@smithy/util-defaults-mode-node": "^4.2.52",- "@smithy/util-endpoints": "^3.4.1",+ "@smithy/util-defaults-mode-browser": "^4.3.48",+ "@smithy/util-defaults-mode-node": "^4.2.53",+ "@smithy/util-endpoints": "^3.4.2","@smithy/util-middleware": "^4.2.14",- "@smithy/util-retry": "^4.3.2",+ "@smithy/util-retry": "^4.3.3","@smithy/util-utf8": "^4.2.2","tslib": "^2.6.2"},@@ -459,22 +459,23 @@}},"node_modules/@aws-sdk/core": {- "version": "3.974.1",- "resolved": "https://registry.npmjs.org/@aws-sdk/core/-/core-3.974.1.tgz",- "integrity": "sha512-gy/gffKz0zaHDaqRiLCdIvgHmaAL/HXuAtMcBP7euYSFx4BsbsdlfmUBJag+Gqe62z6/XuloKyQyaiH+kS3Vrg==",+ "version": "3.974.3",+ "resolved": "https://registry.npmjs.org/@aws-sdk/core/-/core-3.974.3.tgz",+ "integrity": "sha512-W3aJJm2clu8OmsrwMOMnfof13O6LGnbknnZIQeSRbxjqKah2nVvkjbUBBZVhWrt08KC69H7WsINTdrxC/2SXQw==","license": "Apache-2.0","dependencies": {"@aws-sdk/types": "^3.973.8","@aws-sdk/xml-builder": "^3.972.18",- "@smithy/core": "^3.23.15",+ "@smithy/core": "^3.23.16","@smithy/node-config-provider": "^4.3.14","@smithy/property-provider": "^4.2.14","@smithy/protocol-http": "^5.3.14","@smithy/signature-v4": "^5.3.14",- "@smithy/smithy-client": "^4.12.11",+ "@smithy/smithy-client": "^4.12.12","@smithy/types": "^4.14.1","@smithy/util-base64": "^4.3.2","@smithy/util-middleware": "^4.2.14",+ "@smithy/util-retry": "^4.3.3","@smithy/util-utf8": "^4.2.2","tslib": "^2.6.2"},@@ -483,12 +484,12 @@}},"node_modules/@aws-sdk/credential-provider-cognito-identity": {- "version": "3.972.24",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-cognito-identity/-/credential-provider-cognito-identity-3.972.24.tgz",- "integrity": "sha512-i6eMWlKfgQkNY3S/kg1ZnBZm2lhd6r8B3yobCalvrfCCGjvthREwsyDViuWl7gOWSvuUjQEFFGcJhGbCstcqJg==",+ "version": "3.972.26",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-cognito-identity/-/credential-provider-cognito-identity-3.972.26.tgz",+ "integrity": "sha512-eJyE408dpRkr8XSD1TjTQfOCK1r2o+W6vhsGHiL0PmJKr6LgCEP73epBbWbw6ZrJLKxlUYP44nVzY7cmwVlUgw==","license": "Apache-2.0","dependencies": {- "@aws-sdk/nested-clients": "^3.996.21",+ "@aws-sdk/nested-clients": "^3.997.1","@aws-sdk/types": "^3.973.8","@smithy/property-provider": "^4.2.14","@smithy/types": "^4.14.1",@@ -499,12 +500,12 @@}},"node_modules/@aws-sdk/credential-provider-env": {- "version": "3.972.27",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-env/-/credential-provider-env-3.972.27.tgz",- "integrity": "sha512-xfUt2CUZDC+Tf16A6roD1b4pk/nrXdkoLY3TEhv198AXDtBo5xUJP1zd0e8SmuKLN4PpIBX96OizZbmMlcI6oQ==",+ "version": "3.972.29",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-env/-/credential-provider-env-3.972.29.tgz",+ "integrity": "sha512-rf+AlUxgTeSzQ/4zoS0D+Bt7XvgpY48PnWG8Yg/N9fdMgyK2Jaqa+6tLZp4MYMIMHkGrfAxnbSeb2YLMGFMg6g==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",+ "@aws-sdk/core": "^3.974.3","@aws-sdk/types": "^3.973.8","@smithy/property-provider": "^4.2.14","@smithy/types": "^4.14.1",@@ -515,20 +516,20 @@}},"node_modules/@aws-sdk/credential-provider-http": {- "version": "3.972.29",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-http/-/credential-provider-http-3.972.29.tgz",- "integrity": "sha512-hjNeYb6oLyHgMihra83ie0J/T2y9om3cy1qC90h9DRgvYXEoN4BCFf8bHguZjKhXunnv7YkmZRuYL5Mkk77eCA==",+ "version": "3.972.31",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-http/-/credential-provider-http-3.972.31.tgz",+ "integrity": "sha512-TR2/lQ3qKFj2EOrsiASzemsNEz2uzZ/SUBf48+U4Cr9a/FZlHfH/hwAeBJNBp1gMyJNxROJZhT3dn1cO+jnYfQ==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",+ "@aws-sdk/core": "^3.974.3","@aws-sdk/types": "^3.973.8","@smithy/fetch-http-handler": "^5.3.17",- "@smithy/node-http-handler": "^4.5.3",+ "@smithy/node-http-handler": "^4.6.0","@smithy/property-provider": "^4.2.14","@smithy/protocol-http": "^5.3.14",- "@smithy/smithy-client": "^4.12.11",+ "@smithy/smithy-client": "^4.12.12","@smithy/types": "^4.14.1",- "@smithy/util-stream": "^4.5.23",+ "@smithy/util-stream": "^4.5.24","tslib": "^2.6.2"},"engines": {@@ -536,19 +537,19 @@}},"node_modules/@aws-sdk/credential-provider-ini": {- "version": "3.972.31",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-ini/-/credential-provider-ini-3.972.31.tgz",- "integrity": "sha512-PuQ7e8WYzAPpzvFcajxf8c0LqSzakVHVlKw8M0oubk8Kf347YOCCqT1seQrHs5AdZuIh2RD9LX4O+Xa5ImEBfQ==",+ "version": "3.972.33",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-ini/-/credential-provider-ini-3.972.33.tgz",+ "integrity": "sha512-UwdbJbOrgnOxZbshaNZ4DzX35h5wQd33MNYTGzWhN3ORG9lG9KQbDX6l6tDJSAdaGTktJoZPSritmUoW1rYkRA==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",- "@aws-sdk/credential-provider-env": "^3.972.27",- "@aws-sdk/credential-provider-http": "^3.972.29",- "@aws-sdk/credential-provider-login": "^3.972.31",- "@aws-sdk/credential-provider-process": "^3.972.27",- "@aws-sdk/credential-provider-sso": "^3.972.31",- "@aws-sdk/credential-provider-web-identity": "^3.972.31",- "@aws-sdk/nested-clients": "^3.996.21",+ "@aws-sdk/core": "^3.974.3",+ "@aws-sdk/credential-provider-env": "^3.972.29",+ "@aws-sdk/credential-provider-http": "^3.972.31",+ "@aws-sdk/credential-provider-login": "^3.972.33",+ "@aws-sdk/credential-provider-process": "^3.972.29",+ "@aws-sdk/credential-provider-sso": "^3.972.33",+ "@aws-sdk/credential-provider-web-identity": "^3.972.33",+ "@aws-sdk/nested-clients": "^3.997.1","@aws-sdk/types": "^3.973.8","@smithy/credential-provider-imds": "^4.2.14","@smithy/property-provider": "^4.2.14",@@ -561,13 +562,13 @@}},"node_modules/@aws-sdk/credential-provider-login": {- "version": "3.972.31",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-login/-/credential-provider-login-3.972.31.tgz",- "integrity": "sha512-bBmWDmtSpmLOZR6a0kmowBcVL1hiL8Vlap/RXeMpFd7JbWl87YcwqL6T9LH/0oBVEZXu1dUZAtojgSuZgMO5xw==",+ "version": "3.972.33",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-login/-/credential-provider-login-3.972.33.tgz",+ "integrity": "sha512-WyZuPVoDM1HGNl41eVg8HSSXIB+FGkuuK63GhDbh4TMdfWU03AciWvF/QqOVWvJtWVYaLddANJ+aUklVr2ieuw==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",- "@aws-sdk/nested-clients": "^3.996.21",+ "@aws-sdk/core": "^3.974.3",+ "@aws-sdk/nested-clients": "^3.997.1","@aws-sdk/types": "^3.973.8","@smithy/property-provider": "^4.2.14","@smithy/protocol-http": "^5.3.14",@@ -580,17 +581,17 @@}},"node_modules/@aws-sdk/credential-provider-node": {- "version": "3.972.32",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-node/-/credential-provider-node-3.972.32.tgz",- "integrity": "sha512-9aj0x9hGYUondBZSD0XkksAdHhOKttFw4BWpLCeggeg40qSJxGrAP++g0GCm0VqWc1WtC/NRFiAVzPCy56vmog==",+ "version": "3.972.34",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-node/-/credential-provider-node-3.972.34.tgz",+ "integrity": "sha512-sPcisURibKU4x0PCWJkWF1KJYm49Cph9dCn/PAnG5FU0wq5Id3g2v7RuEWAtNlKv1Af4gUJYBVGOeNpSEEx41A==","license": "Apache-2.0","dependencies": {- "@aws-sdk/credential-provider-env": "^3.972.27",- "@aws-sdk/credential-provider-http": "^3.972.29",- "@aws-sdk/credential-provider-ini": "^3.972.31",- "@aws-sdk/credential-provider-process": "^3.972.27",- "@aws-sdk/credential-provider-sso": "^3.972.31",- "@aws-sdk/credential-provider-web-identity": "^3.972.31",+ "@aws-sdk/credential-provider-env": "^3.972.29",+ "@aws-sdk/credential-provider-http": "^3.972.31",+ "@aws-sdk/credential-provider-ini": "^3.972.33",+ "@aws-sdk/credential-provider-process": "^3.972.29",+ "@aws-sdk/credential-provider-sso": "^3.972.33",+ "@aws-sdk/credential-provider-web-identity": "^3.972.33","@aws-sdk/types": "^3.973.8","@smithy/credential-provider-imds": "^4.2.14","@smithy/property-provider": "^4.2.14",@@ -603,12 +604,12 @@}},"node_modules/@aws-sdk/credential-provider-process": {- "version": "3.972.27",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-process/-/credential-provider-process-3.972.27.tgz",- "integrity": "sha512-1CZvfb1WzudWWIFAVQkd1OI/T1RxPcSvNWzNsb2BMBVsBJzBtB8dV5f2nymHVU4UqwxipdVt/DAbgdDRf33JDg==",+ "version": "3.972.29",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-process/-/credential-provider-process-3.972.29.tgz",+ "integrity": "sha512-DURisqWS3bUgiwMXTmzymVNGlcRW0FnbPZ3SZknhmxnCXm3n9idkTJ6T+Uir359KRKtJNFLRViskk8HsSVLi1w==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",+ "@aws-sdk/core": "^3.974.3","@aws-sdk/types": "^3.973.8","@smithy/property-provider": "^4.2.14","@smithy/shared-ini-file-loader": "^4.4.9",@@ -620,14 +621,14 @@}},"node_modules/@aws-sdk/credential-provider-sso": {- "version": "3.972.31",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-sso/-/credential-provider-sso-3.972.31.tgz",- "integrity": "sha512-x8Mx18S48XMl9bEEpYwmXDTvjWGPIfDadReN37Lc099/DUrlL4Zs9T9rwwggo6DkKS1aev6v+MTUx7JTa87TZQ==",+ "version": "3.972.33",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-sso/-/credential-provider-sso-3.972.33.tgz",+ "integrity": "sha512-9y9obU4IQWru9f+NiiscUeyCe5ZmQav4FKEb1qfUNrik/C3BzBGUnHQWyPEyXjOX9cb+vx1TYx0qZBtinKdzTA==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",- "@aws-sdk/nested-clients": "^3.996.21",- "@aws-sdk/token-providers": "3.1032.0",+ "@aws-sdk/core": "^3.974.3",+ "@aws-sdk/nested-clients": "^3.997.1",+ "@aws-sdk/token-providers": "3.1034.0","@aws-sdk/types": "^3.973.8","@smithy/property-provider": "^4.2.14","@smithy/shared-ini-file-loader": "^4.4.9",@@ -639,13 +640,13 @@}},"node_modules/@aws-sdk/credential-provider-web-identity": {- "version": "3.972.31",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-web-identity/-/credential-provider-web-identity-3.972.31.tgz",- "integrity": "sha512-zfuNMIkGfjYsHis9qytYf74Bcmq6Ji9Xwf4w53baRCI/b2otTwZv3SW1uRiJ5Di7999QzRGhHZ96+eUeo3gSOA==",+ "version": "3.972.33",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-provider-web-identity/-/credential-provider-web-identity-3.972.33.tgz",+ "integrity": "sha512-RazhlN0YAkna2T2p2v4YuuRlVBVRNo8V0SL+9JePTWDndEUAeOBAjYeQfAMbtDyCh120+zA0Op6V0jS4dw2+iw==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",- "@aws-sdk/nested-clients": "^3.996.21",+ "@aws-sdk/core": "^3.974.3",+ "@aws-sdk/nested-clients": "^3.997.1","@aws-sdk/types": "^3.973.8","@smithy/property-provider": "^4.2.14","@smithy/shared-ini-file-loader": "^4.4.9",@@ -657,26 +658,26 @@}},"node_modules/@aws-sdk/credential-providers": {- "version": "3.1032.0",- "resolved": "https://registry.npmjs.org/@aws-sdk/credential-providers/-/credential-providers-3.1032.0.tgz",- "integrity": "sha512-OT+4/Kf62PKslLoJJGEzpQricgaMOuXFNf65FR56i3QugNLlNHfkhDWkk1CDvN1NYCHZbYZMJusdGjxVxQKgjQ==",+ "version": "3.1034.0",+ "resolved": "https://registry.npmjs.org/@aws-sdk/credential-providers/-/credential-providers-3.1034.0.tgz",+ "integrity": "sha512-xTmpZN3i4cZEgjJNQhA8CYmxKtW95ZAhh9wINe2b6ffQzbaXBLkuvfz/fhWEezl4P8uv2qWO8J+DEDms6wqL9g==","license": "Apache-2.0","dependencies": {- "@aws-sdk/client-cognito-identity": "3.1032.0",- "@aws-sdk/core": "^3.974.1",- "@aws-sdk/credential-provider-cognito-identity": "^3.972.24",- "@aws-sdk/credential-provider-env": "^3.972.27",- "@aws-sdk/credential-provider-http": "^3.972.29",- "@aws-sdk/credential-provider-ini": "^3.972.31",- "@aws-sdk/credential-provider-login": "^3.972.31",- "@aws-sdk/credential-provider-node": "^3.972.32",- "@aws-sdk/credential-provider-process": "^3.972.27",- "@aws-sdk/credential-provider-sso": "^3.972.31",- "@aws-sdk/credential-provider-web-identity": "^3.972.31",- "@aws-sdk/nested-clients": "^3.996.21",+ "@aws-sdk/client-cognito-identity": "3.1034.0",+ "@aws-sdk/core": "^3.974.3",+ "@aws-sdk/credential-provider-cognito-identity": "^3.972.26",+ "@aws-sdk/credential-provider-env": "^3.972.29",+ "@aws-sdk/credential-provider-http": "^3.972.31",+ "@aws-sdk/credential-provider-ini": "^3.972.33",+ "@aws-sdk/credential-provider-login": "^3.972.33",+ "@aws-sdk/credential-provider-node": "^3.972.34",+ "@aws-sdk/credential-provider-process": "^3.972.29",+ "@aws-sdk/credential-provider-sso": "^3.972.33",+ "@aws-sdk/credential-provider-web-identity": "^3.972.33",+ "@aws-sdk/nested-clients": "^3.997.1","@aws-sdk/types": "^3.973.8",- "@smithy/config-resolver": "^4.4.16",- "@smithy/core": "^3.23.15",+ "@smithy/config-resolver": "^4.4.17",+ "@smithy/core": "^3.23.16","@smithy/credential-provider-imds": "^4.2.14","@smithy/node-config-provider": "^4.3.14","@smithy/property-provider": "^4.2.14",@@ -732,19 +733,44 @@"node": ">=20.0.0"}},+ "node_modules/@aws-sdk/middleware-sdk-s3": {+ "version": "3.972.32",+ "resolved": "https://registry.npmjs.org/@aws-sdk/middleware-sdk-s3/-/middleware-sdk-s3-3.972.32.tgz",+ "integrity": "sha512-dc2O2x0V5pGJhmdQYQveUIFtMZsur7GrGuSgoKM4oQJuEcfvwnJ3sj+ip6WnxR5l6TrX5zkl4KgcgswOy3wAzQ==",+ "license": "Apache-2.0",+ "dependencies": {+ "@aws-sdk/core": "^3.974.3",+ "@aws-sdk/types": "^3.973.8",+ "@aws-sdk/util-arn-parser": "^3.972.3",+ "@smithy/core": "^3.23.16",+ "@smithy/node-config-provider": "^4.3.14",+ "@smithy/protocol-http": "^5.3.14",+ "@smithy/signature-v4": "^5.3.14",+ "@smithy/smithy-client": "^4.12.12",+ "@smithy/types": "^4.14.1",+ "@smithy/util-config-provider": "^4.2.2",+ "@smithy/util-middleware": "^4.2.14",+ "@smithy/util-stream": "^4.5.24",+ "@smithy/util-utf8": "^4.2.2",+ "tslib": "^2.6.2"+ },+ "engines": {+ "node": ">=20.0.0"+ }+ },"node_modules/@aws-sdk/middleware-user-agent": {- "version": "3.972.31",- "resolved": "https://registry.npmjs.org/@aws-sdk/middleware-user-agent/-/middleware-user-agent-3.972.31.tgz",- "integrity": "sha512-L+hXN2HDomlIsWSHW5DVD7ppccCeRnlHXZ5uHG34ePTjF5bm0I1fmrJLbUGiW97xRXWryit5cjdP4Sx2FwiGog==",+ "version": "3.972.33",+ "resolved": "https://registry.npmjs.org/@aws-sdk/middleware-user-agent/-/middleware-user-agent-3.972.33.tgz",+ "integrity": "sha512-mqtT3Fo7xanWMk2SbAcKLGGI/q1GHWNrExBj7cnWP2W2mkTMheXB4ntJvwPZ1UxPrQobrsv2dWFXmaOJeSOiDg==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",+ "@aws-sdk/core": "^3.974.3","@aws-sdk/types": "^3.973.8",- "@aws-sdk/util-endpoints": "^3.996.7",- "@smithy/core": "^3.23.15",+ "@aws-sdk/util-endpoints": "^3.996.8",+ "@smithy/core": "^3.23.16","@smithy/protocol-http": "^5.3.14","@smithy/types": "^4.14.1",- "@smithy/util-retry": "^4.3.2",+ "@smithy/util-retry": "^4.3.3","tslib": "^2.6.2"},"engines": {@@ -752,47 +778,48 @@}},"node_modules/@aws-sdk/nested-clients": {- "version": "3.996.21",- "resolved": "https://registry.npmjs.org/@aws-sdk/nested-clients/-/nested-clients-3.996.21.tgz",- "integrity": "sha512-Me3d/ua2lb2G0bQfFmvCeQQp3+nN6GSPqMxDmi/IQlQ8CrlpQ5C0JJHpz2AnOUkEFI0lBNrAL3Vnt29l44ndkA==",+ "version": "3.997.1",+ "resolved": "https://registry.npmjs.org/@aws-sdk/nested-clients/-/nested-clients-3.997.1.tgz",+ "integrity": "sha512-Afc9hc2WZs3X4Jb8dnxyuYiZsLoWRO51roTCRf497gPnAKN2WRdXANu1vaVCTzwnDMOYFXb/cYv4ZSjxqAqcKA==","license": "Apache-2.0","dependencies": {"@aws-crypto/sha256-browser": "5.2.0","@aws-crypto/sha256-js": "5.2.0",- "@aws-sdk/core": "^3.974.1",+ "@aws-sdk/core": "^3.974.3","@aws-sdk/middleware-host-header": "^3.972.10","@aws-sdk/middleware-logger": "^3.972.10","@aws-sdk/middleware-recursion-detection": "^3.972.11",- "@aws-sdk/middleware-user-agent": "^3.972.31",- "@aws-sdk/region-config-resolver": "^3.972.12",+ "@aws-sdk/middleware-user-agent": "^3.972.33",+ "@aws-sdk/region-config-resolver": "^3.972.13",+ "@aws-sdk/signature-v4-multi-region": "^3.996.20","@aws-sdk/types": "^3.973.8",- "@aws-sdk/util-endpoints": "^3.996.7",+ "@aws-sdk/util-endpoints": "^3.996.8","@aws-sdk/util-user-agent-browser": "^3.972.10",- "@aws-sdk/util-user-agent-node": "^3.973.17",- "@smithy/config-resolver": "^4.4.16",- "@smithy/core": "^3.23.15",+ "@aws-sdk/util-user-agent-node": "^3.973.19",+ "@smithy/config-resolver": "^4.4.17",+ "@smithy/core": "^3.23.16","@smithy/fetch-http-handler": "^5.3.17","@smithy/hash-node": "^4.2.14","@smithy/invalid-dependency": "^4.2.14","@smithy/middleware-content-length": "^4.2.14",- "@smithy/middleware-endpoint": "^4.4.30",- "@smithy/middleware-retry": "^4.5.3",- "@smithy/middleware-serde": "^4.2.18",+ "@smithy/middleware-endpoint": "^4.4.31",+ "@smithy/middleware-retry": "^4.5.4",+ "@smithy/middleware-serde": "^4.2.19","@smithy/middleware-stack": "^4.2.14","@smithy/node-config-provider": "^4.3.14",- "@smithy/node-http-handler": "^4.5.3",+ "@smithy/node-http-handler": "^4.6.0","@smithy/protocol-http": "^5.3.14",- "@smithy/smithy-client": "^4.12.11",+ "@smithy/smithy-client": "^4.12.12","@smithy/types": "^4.14.1","@smithy/url-parser": "^4.2.14","@smithy/util-base64": "^4.3.2","@smithy/util-body-length-browser": "^4.2.2","@smithy/util-body-length-node": "^4.2.3",- "@smithy/util-defaults-mode-browser": "^4.3.47",- "@smithy/util-defaults-mode-node": "^4.2.52",- "@smithy/util-endpoints": "^3.4.1",+ "@smithy/util-defaults-mode-browser": "^4.3.48",+ "@smithy/util-defaults-mode-node": "^4.2.53",+ "@smithy/util-endpoints": "^3.4.2","@smithy/util-middleware": "^4.2.14",- "@smithy/util-retry": "^4.3.2",+ "@smithy/util-retry": "^4.3.3","@smithy/util-utf8": "^4.2.2","tslib": "^2.6.2"},@@ -801,13 +828,13 @@}},"node_modules/@aws-sdk/region-config-resolver": {- "version": "3.972.12",- "resolved": "https://registry.npmjs.org/@aws-sdk/region-config-resolver/-/region-config-resolver-3.972.12.tgz",- "integrity": "sha512-QQI43Mxd53nBij0pm8HXC+t4IOC6gnhhZfzxE0OATQyO6QfPV4e+aTIRRuAJKA6Nig/cR8eLwPryqYTX9ZrjAQ==",+ "version": "3.972.13",+ "resolved": "https://registry.npmjs.org/@aws-sdk/region-config-resolver/-/region-config-resolver-3.972.13.tgz",+ "integrity": "sha512-CvJ2ZIjK/jVD/lbOpowBVElJyC1YxLTIJ13yM0AEo0t2v7swOzGjSA6lJGH+DwZXQhcjUjoYwc8bVYCX5MDr1A==","license": "Apache-2.0","dependencies": {"@aws-sdk/types": "^3.973.8",- "@smithy/config-resolver": "^4.4.16",+ "@smithy/config-resolver": "^4.4.17","@smithy/node-config-provider": "^4.3.14","@smithy/types": "^4.14.1","tslib": "^2.6.2"@@ -816,14 +843,31 @@"node": ">=20.0.0"}},+ "node_modules/@aws-sdk/signature-v4-multi-region": {+ "version": "3.996.20",+ "resolved": "https://registry.npmjs.org/@aws-sdk/signature-v4-multi-region/-/signature-v4-multi-region-3.996.20.tgz",+ "integrity": "sha512-MEj6DhEcaO8RgVtFCJ+xpCQnZC3Iesr09avdY75qkMQfckQULu447IegK7Rs1MCGerVBfKnJQ4q+pQq9hI5lng==",+ "license": "Apache-2.0",+ "dependencies": {+ "@aws-sdk/middleware-sdk-s3": "^3.972.32",+ "@aws-sdk/types": "^3.973.8",+ "@smithy/protocol-http": "^5.3.14",+ "@smithy/signature-v4": "^5.3.14",+ "@smithy/types": "^4.14.1",+ "tslib": "^2.6.2"+ },+ "engines": {+ "node": ">=20.0.0"+ }+ },"node_modules/@aws-sdk/token-providers": {- "version": "3.1032.0",- "resolved": "https://registry.npmjs.org/@aws-sdk/token-providers/-/token-providers-3.1032.0.tgz",- "integrity": "sha512-n+PU8Z+gll7p3wDrH+Wo6fkt8sPrVnq30YYM6Ryga95oJlEneNMEbDHj0iqjMX3V7gaGdJo/hJWyPo4lscP+mA==",+ "version": "3.1034.0",+ "resolved": "https://registry.npmjs.org/@aws-sdk/token-providers/-/token-providers-3.1034.0.tgz",+ "integrity": "sha512-8E+KGcD4ET0H9FXJ2/ZWbfFnQNYEkTZZYJxAs1lkdJlve1AYuqaydInIFfvNgoz5GbYtzbK8/ugsSMu5wPm6kA==","license": "Apache-2.0","dependencies": {- "@aws-sdk/core": "^3.974.1",- "@aws-sdk/nested-clients": "^3.996.21",+ "@aws-sdk/core": "^3.974.3",+ "@aws-sdk/nested-clients": "^3.997.1","@aws-sdk/types": "^3.973.8","@smithy/property-provider": "^4.2.14","@smithy/shared-ini-file-loader": "^4.4.9",@@ -847,16 +891,28 @@"node": ">=20.0.0"}},+ "node_modules/@aws-sdk/util-arn-parser": {+ "version": "3.972.3",+ "resolved": "https://registry.npmjs.org/@aws-sdk/util-arn-parser/-/util-arn-parser-3.972.3.tgz",+ "integrity": "sha512-HzSD8PMFrvgi2Kserxuff5VitNq2sgf3w9qxmskKDiDTThWfVteJxuCS9JXiPIPtmCrp+7N9asfIaVhBFORllA==",+ "license": "Apache-2.0",+ "dependencies": {+ "tslib": "^2.6.2"+ },+ "engines": {+ "node": ">=20.0.0"+ }+ },"node_modules/@aws-sdk/util-endpoints": {- "version": "3.996.7",- "resolved": "https://registry.npmjs.org/@aws-sdk/util-endpoints/-/util-endpoints-3.996.7.tgz",- "integrity": "sha512-ty4LQxN1QC+YhUP28NfEgZDEGXkyqOQy+BDriBozqHsrYO4JMgiPhfizqOGF7P+euBTZ5Ez6SKlLAMCLo8tzmw==",+ "version": "3.996.8",+ "resolved": "https://registry.npmjs.org/@aws-sdk/util-endpoints/-/util-endpoints-3.996.8.tgz",+ "integrity": "sha512-oOZHcRDihk5iEe5V25NVWg45b3qEA8OpHWVdU/XQh8Zj4heVPAJqWvMphQnU7LkufmUo10EpvFPZuQMiFLJK3g==","license": "Apache-2.0","dependencies": {"@aws-sdk/types": "^3.973.8","@smithy/types": "^4.14.1","@smithy/url-parser": "^4.2.14",- "@smithy/util-endpoints": "^3.4.1",+ "@smithy/util-endpoints": "^3.4.2","tslib": "^2.6.2"},"engines": {@@ -888,12 +944,12 @@}},"node_modules/@aws-sdk/util-user-agent-node": {- "version": "3.973.17",- "resolved": "https://registry.npmjs.org/@aws-sdk/util-user-agent-node/-/util-user-agent-node-3.973.17.tgz",- "integrity": "sha512-utF5qjjbuJQuU9VdCkWl7L87sr93cApsrD+uxGfUnlafX8iyEzJrb7EZnufjThURZVTOtelRMXrblWxpefElUg==",+ "version": "3.973.19",+ "resolved": "https://registry.npmjs.org/@aws-sdk/util-user-agent-node/-/util-user-agent-node-3.973.19.tgz",+ "integrity": "sha512-ZAfHjpzdbrzkAftC139JoYGfXzDh5HY+AxRzw8pGJ8cULsf+l721sKAMK8mV5NvRETaW/BwghSwQhGgoNgrxMw==","license": "Apache-2.0","dependencies": {- "@aws-sdk/middleware-user-agent": "^3.972.31",+ "@aws-sdk/middleware-user-agent": "^3.972.33","@aws-sdk/types": "^3.973.8","@smithy/node-config-provider": "^4.3.14","@smithy/types": "^4.14.1",@@ -5896,15 +5952,15 @@}},"node_modules/@smithy/config-resolver": {- "version": "4.4.16",- "resolved": "https://registry.npmjs.org/@smithy/config-resolver/-/config-resolver-4.4.16.tgz",- "integrity": "sha512-GFlGPNLZKrGfqWpqVb31z7hvYCA9ZscfX1buYnvvMGcRYsQQnhH+4uN6mWWflcD5jB4OXP/LBrdpukEdjl41tg==",+ "version": "4.4.17",+ "resolved": "https://registry.npmjs.org/@smithy/config-resolver/-/config-resolver-4.4.17.tgz",+ "integrity": "sha512-TzDZcAnhTyAHbXVxWZo7/tEcrIeFq20IBk8So3OLOetWpR8EwY/yEqBMBFaJMeyEiREDq4NfEl+qO3OAUD+vbQ==","license": "Apache-2.0","dependencies": {"@smithy/node-config-provider": "^4.3.14","@smithy/types": "^4.14.1","@smithy/util-config-provider": "^4.2.2",- "@smithy/util-endpoints": "^3.4.1",+ "@smithy/util-endpoints": "^3.4.2","@smithy/util-middleware": "^4.2.14","tslib": "^2.6.2"},@@ -5913,9 +5969,9 @@}},"node_modules/@smithy/core": {- "version": "3.23.15",- "resolved": "https://registry.npmjs.org/@smithy/core/-/core-3.23.15.tgz",- "integrity": "sha512-E7GVCgsQttzfujEZb6Qep005wWf4xiL4x06apFEtzQMWYBPggZh/0cnOxPficw5cuK/YjjkehKoIN4YUaSh0UQ==",+ "version": "3.23.16",+ "resolved": "https://registry.npmjs.org/@smithy/core/-/core-3.23.16.tgz",+ "integrity": "sha512-JStomOrINQA1VqNEopLsgcdgwd42au7mykKqVr30XFw89wLt9sDxJDi4djVPRwQmmzyTGy/uOvTc2ultMpFi1w==","license": "Apache-2.0","dependencies": {"@smithy/protocol-http": "^5.3.14",@@ -5924,7 +5980,7 @@"@smithy/util-base64": "^4.3.2","@smithy/util-body-length-browser": "^4.2.2","@smithy/util-middleware": "^4.2.14",- "@smithy/util-stream": "^4.5.23",+ "@smithy/util-stream": "^4.5.24","@smithy/util-utf8": "^4.2.2","@smithy/uuid": "^1.1.2","tslib": "^2.6.2"@@ -6035,13 +6091,13 @@}},"node_modules/@smithy/middleware-endpoint": {- "version": "4.4.30",- "resolved": "https://registry.npmjs.org/@smithy/middleware-endpoint/-/middleware-endpoint-4.4.30.tgz",- "integrity": "sha512-qS2XqhKeXmdZ4nEQ4cOxIczSP/Y91wPAHYuRwmWDCh975B7/57uxsm5d6sisnUThn2u2FwzMdJNM7AbO1YPsPg==",+ "version": "4.4.31",+ "resolved": "https://registry.npmjs.org/@smithy/middleware-endpoint/-/middleware-endpoint-4.4.31.tgz",+ "integrity": "sha512-KJPdCIN2kOE2aGmqZd7eUTr4WQwOGgtLWgUkswGJggs7rBcQYQjcZMEDa3C0DwbOiXS9L8/wDoQHkfxBYLfiLw==","license": "Apache-2.0","dependencies": {- "@smithy/core": "^3.23.15",- "@smithy/middleware-serde": "^4.2.18",+ "@smithy/core": "^3.23.16",+ "@smithy/middleware-serde": "^4.2.19","@smithy/node-config-provider": "^4.3.14","@smithy/shared-ini-file-loader": "^4.4.9","@smithy/types": "^4.14.1",@@ -6054,19 +6110,19 @@}},"node_modules/@smithy/middleware-retry": {- "version": "4.5.3",- "resolved": "https://registry.npmjs.org/@smithy/middleware-retry/-/middleware-retry-4.5.3.tgz",- "integrity": "sha512-TE8dJNi6JuxzGSxMCVd3i9IEWDndCl3bmluLsBNDWok8olgj65OfkndMhl9SZ7m14c+C5SQn/PcUmrDl57rSFw==",+ "version": "4.5.4",+ "resolved": "https://registry.npmjs.org/@smithy/middleware-retry/-/middleware-retry-4.5.4.tgz",+ "integrity": "sha512-/z7nIFK+ZRW3Ie/l3NEVGdy34LvmEOzBrtBAvgWZ/4PrKX0xP3kWm8pkfcwUk523SqxZhdbQP9JSXgjF77Uhpw==","license": "Apache-2.0","dependencies": {- "@smithy/core": "^3.23.15",+ "@smithy/core": "^3.23.16","@smithy/node-config-provider": "^4.3.14","@smithy/protocol-http": "^5.3.14",- "@smithy/service-error-classification": "^4.2.14",- "@smithy/smithy-client": "^4.12.11",+ "@smithy/service-error-classification": "^4.3.0",+ "@smithy/smithy-client": "^4.12.12","@smithy/types": "^4.14.1","@smithy/util-middleware": "^4.2.14",- "@smithy/util-retry": "^4.3.2",+ "@smithy/util-retry": "^4.3.3","@smithy/uuid": "^1.1.2","tslib": "^2.6.2"},@@ -6075,12 +6131,12 @@}},"node_modules/@smithy/middleware-serde": {- "version": "4.2.18",- "resolved": "https://registry.npmjs.org/@smithy/middleware-serde/-/middleware-serde-4.2.18.tgz",- "integrity": "sha512-M6CSgnp3v4tYz9ynj2JHbA60woBZcGqEwNjTKjBsNHPV26R1ZX52+0wW8WsZU18q45jD0tw2wL22S17Ze9LpEw==",+ "version": "4.2.19",+ "resolved": "https://registry.npmjs.org/@smithy/middleware-serde/-/middleware-serde-4.2.19.tgz",+ "integrity": "sha512-Q6y+W9h3iYVMCKWDoVge+OC1LKFqbEKaq8SIWG2X2bWJRpd/6dDLyICcNLT6PbjH3Rr6bmg/SeDB25XFOFfeEw==","license": "Apache-2.0","dependencies": {- "@smithy/core": "^3.23.15",+ "@smithy/core": "^3.23.16","@smithy/protocol-http": "^5.3.14","@smithy/types": "^4.14.1","tslib": "^2.6.2"@@ -6118,9 +6174,9 @@}},"node_modules/@smithy/node-http-handler": {- "version": "4.5.3",- "resolved": "https://registry.npmjs.org/@smithy/node-http-handler/-/node-http-handler-4.5.3.tgz",- "integrity": "sha512-lc5jFL++x17sPhIwMWJ3YOnqmSjw/2Po6VLDlUIXvxVWRuJwRXnJ4jOBBLB0cfI5BB5ehIl02Fxr1PDvk/kxDw==",+ "version": "4.6.0",+ "resolved": "https://registry.npmjs.org/@smithy/node-http-handler/-/node-http-handler-4.6.0.tgz",+ "integrity": "sha512-P734cAoTFtuGfWa/R3jgBnGlURt2w9bYEBwQNMKf58sRM9RShirB2mKwLsVP+jlG/wxpCu8abv8NxdUts8tdLA==","license": "Apache-2.0","dependencies": {"@smithy/protocol-http": "^5.3.14",@@ -6186,9 +6242,9 @@}},"node_modules/@smithy/service-error-classification": {- "version": "4.2.14",- "resolved": "https://registry.npmjs.org/@smithy/service-error-classification/-/service-error-classification-4.2.14.tgz",- "integrity": "sha512-vVimoUnGxlx4eLLQbZImdOZFOe+Zh+5ACntv8VxZuGP72LdWu5GV3oEmCahSEReBgRJoWjypFkrehSj7BWx1HQ==",+ "version": "4.3.0",+ "resolved": "https://registry.npmjs.org/@smithy/service-error-classification/-/service-error-classification-4.3.0.tgz",+ "integrity": "sha512-9jKsBYQRPR0xBLgc2415RsA5PIcP2sis4oBdN9s0D13cg1B1284mNTjx9Yc+BEERXzuPm5ObktI96OxsKh8E9A==","license": "Apache-2.0","dependencies": {"@smithy/types": "^4.14.1"@@ -6230,17 +6286,17 @@}},"node_modules/@smithy/smithy-client": {- "version": "4.12.11",- "resolved": "https://registry.npmjs.org/@smithy/smithy-client/-/smithy-client-4.12.11.tgz",- "integrity": "sha512-wzz/Wa1CH/Tlhxh0s4DQPEcXSxSVfJ59AZcUh9Gu0c6JTlKuwGf4o/3P2TExv0VbtPFt8odIBG+eQGK2+vTECg==",+ "version": "4.12.12",+ "resolved": "https://registry.npmjs.org/@smithy/smithy-client/-/smithy-client-4.12.12.tgz",+ "integrity": "sha512-daO7SJn4eM6ArbmrEs+/BTbH7af8AEbSL3OMQdcRvvn8tuUcR5rU2n6DgxIV53aXMS42uwK8NgKKCh5XgqYOPQ==","license": "Apache-2.0","dependencies": {- "@smithy/core": "^3.23.15",- "@smithy/middleware-endpoint": "^4.4.30",+ "@smithy/core": "^3.23.16",+ "@smithy/middleware-endpoint": "^4.4.31","@smithy/middleware-stack": "^4.2.14","@smithy/protocol-http": "^5.3.14","@smithy/types": "^4.14.1",- "@smithy/util-stream": "^4.5.23",+ "@smithy/util-stream": "^4.5.24","tslib": "^2.6.2"},"engines": {@@ -6337,13 +6393,13 @@}},"node_modules/@smithy/util-defaults-mode-browser": {- "version": "4.3.47",- "resolved": "https://registry.npmjs.org/@smithy/util-defaults-mode-browser/-/util-defaults-mode-browser-4.3.47.tgz",- "integrity": "sha512-zlIuXai3/SHjQUQ8y3g/woLvrH573SK2wNjcDaHu5e9VOcC0JwM1MI0Sq0GZJyN3BwSUneIhpjZ18nsiz5AtQw==",+ "version": "4.3.48",+ "resolved": "https://registry.npmjs.org/@smithy/util-defaults-mode-browser/-/util-defaults-mode-browser-4.3.48.tgz",+ "integrity": "sha512-hxVRVPYaRDWa6YQdse1aWX1qrksmLsvNyGBKdc32q4jFzSjxYVNWfstknAfR228TnzS4tzgswXRuYIbhXBuXFQ==","license": "Apache-2.0","dependencies": {"@smithy/property-provider": "^4.2.14",- "@smithy/smithy-client": "^4.12.11",+ "@smithy/smithy-client": "^4.12.12","@smithy/types": "^4.14.1","tslib": "^2.6.2"},@@ -6352,16 +6408,16 @@}},"node_modules/@smithy/util-defaults-mode-node": {- "version": "4.2.52",- "resolved": "https://registry.npmjs.org/@smithy/util-defaults-mode-node/-/util-defaults-mode-node-4.2.52.tgz",- "integrity": "sha512-cQBz8g68Vnw1W2meXlkb3D/hXJU+Taiyj9P8qLJtjREEV9/Td65xi4A/H1sRQ8EIgX5qbZbvdYPKygKLholZ3w==",+ "version": "4.2.53",+ "resolved": "https://registry.npmjs.org/@smithy/util-defaults-mode-node/-/util-defaults-mode-node-4.2.53.tgz",+ "integrity": "sha512-ybgCk+9JdBq8pYC8Y6U5fjyS8e4sboyAShetxPNL0rRBtaVl56GSFAxsolVBIea1tXR4LPIzL8i6xqmcf0+DCQ==","license": "Apache-2.0","dependencies": {- "@smithy/config-resolver": "^4.4.16",+ "@smithy/config-resolver": "^4.4.17","@smithy/credential-provider-imds": "^4.2.14","@smithy/node-config-provider": "^4.3.14","@smithy/property-provider": "^4.2.14",- "@smithy/smithy-client": "^4.12.11",+ "@smithy/smithy-client": "^4.12.12","@smithy/types": "^4.14.1","tslib": "^2.6.2"},@@ -6370,9 +6426,9 @@}},"node_modules/@smithy/util-endpoints": {- "version": "3.4.1",- "resolved": "https://registry.npmjs.org/@smithy/util-endpoints/-/util-endpoints-3.4.1.tgz",- "integrity": "sha512-wMxNDZJrgS5mQV9oxCs4TWl5767VMgOfqfZ3JHyCkMtGC2ykW9iPqMvFur695Otcc5yxLG8OKO/80tsQBxrhXg==",+ "version": "3.4.2",+ "resolved": "https://registry.npmjs.org/@smithy/util-endpoints/-/util-endpoints-3.4.2.tgz",+ "integrity": "sha512-a55Tr+3OKld4TTtnT+RhKOQHyPxm3j/xL4OR83WBUhLJaKDS9dnJ7arRMOp3t31dcLhApwG9bgvrRXBHlLdIkg==","license": "Apache-2.0","dependencies": {"@smithy/node-config-provider": "^4.3.14",@@ -6409,12 +6465,12 @@}},"node_modules/@smithy/util-retry": {- "version": "4.3.2",- "resolved": "https://registry.npmjs.org/@smithy/util-retry/-/util-retry-4.3.2.tgz",- "integrity": "sha512-2+KTsJEwTi63NUv4uR9IQ+IFT1yu6Rf6JuoBK2WKaaJ/TRvOiOVGcXAsEqX/TQN2thR9yII21kPUJq1UV/WI2A==",+ "version": "4.3.3",+ "resolved": "https://registry.npmjs.org/@smithy/util-retry/-/util-retry-4.3.3.tgz",+ "integrity": "sha512-idjUvd4M9Jj6rXkhqw4H4reHoweuK4ZxYWyOrEp4N2rOF5VtaOlQGLDQJva/8WanNXk9ScQtsAb7o5UHGvFm4A==","license": "Apache-2.0","dependencies": {- "@smithy/service-error-classification": "^4.2.14",+ "@smithy/service-error-classification": "^4.3.0","@smithy/types": "^4.14.1","tslib": "^2.6.2"},@@ -6423,13 +6479,13 @@}},"node_modules/@smithy/util-stream": {- "version": "4.5.23",- "resolved": "https://registry.npmjs.org/@smithy/util-stream/-/util-stream-4.5.23.tgz",- "integrity": "sha512-N6on1+ngJ3RznZOnDWNveIwnTSlqxNnXuNAh7ez889ZZaRdXoNRTXKgmYOLe6dB0gCmAVtuRScE1hymQFl4hpg==",+ "version": "4.5.24",+ "resolved": "https://registry.npmjs.org/@smithy/util-stream/-/util-stream-4.5.24.tgz",+ "integrity": "sha512-na5vv2mBSDzXewLEEoWGI7LQQkfpmFEomBsmOpzLFjqGctm0iMwXY5lAwesY9pIaErkccW0qzEOUcYP+WKneXg==","license": "Apache-2.0","dependencies": {"@smithy/fetch-http-handler": "^5.3.17",- "@smithy/node-http-handler": "^4.5.3",+ "@smithy/node-http-handler": "^4.6.0","@smithy/types": "^4.14.1","@smithy/util-base64": "^4.3.2","@smithy/util-buffer-from": "^4.2.2",@@ -6775,70 +6831,6 @@"node": ">=14.0.0"}},- "node_modules/@tailwindcss/oxide-wasm32-wasi/node_modules/@emnapi/core": {- "version": "1.8.1",- "dev": true,- "inBundle": true,- "license": "MIT",- "optional": true,- "dependencies": {- "@emnapi/wasi-threads": "1.1.0",- "tslib": "^2.4.0"- }- },- "node_modules/@tailwindcss/oxide-wasm32-wasi/node_modules/@emnapi/runtime": {- "version": "1.8.1",- "dev": true,- "inBundle": true,- "license": "MIT",- "optional": true,- "dependencies": {- "tslib": "^2.4.0"- }- },- "node_modules/@tailwindcss/oxide-wasm32-wasi/node_modules/@emnapi/wasi-threads": {- "version": "1.1.0",- "dev": true,- "inBundle": true,- "license": "MIT",- "optional": true,- "dependencies": {- "tslib": "^2.4.0"- }- },- "node_modules/@tailwindcss/oxide-wasm32-wasi/node_modules/@napi-rs/wasm-runtime": {- "version": "1.1.1",- "dev": true,- "inBundle": true,- "license": "MIT",- "optional": true,- "dependencies": {- "@emnapi/core": "^1.7.1",- "@emnapi/runtime": "^1.7.1",- "@tybys/wasm-util": "^0.10.1"- },- "funding": {- "type": "github",- "url": "https://github.com/sponsors/Brooooooklyn"- }- },- "node_modules/@tailwindcss/oxide-wasm32-wasi/node_modules/@tybys/wasm-util": {- "version": "0.10.1",- "dev": true,- "inBundle": true,- "license": "MIT",- "optional": true,- "dependencies": {- "tslib": "^2.4.0"- }- },- "node_modules/@tailwindcss/oxide-wasm32-wasi/node_modules/tslib": {- "version": "2.8.1",- "dev": true,- "inBundle": true,- "license": "0BSD",- "optional": true- },"node_modules/@tailwindcss/oxide-win32-arm64-msvc": {"version": "4.2.2","resolved": "https://registry.npmjs.org/@tailwindcss/oxide-win32-arm64-msvc/-/oxide-win32-arm64-msvc-4.2.2.tgz",diff --git a/package.json b/package.jsonindex 7f8f01794..ae90d19b1 100644--- a/package.json+++ b/package.json@@ -1,6 +1,6 @@{"name": "open-whispr",- "version": "1.6.10",+ "version": "1.6.11","description": "A desktop dictation application using whisper.cpp for speech-to-text transcription","main": "main.js","private": true,diff --git a/preload.js b/preload.jsindex 7698eeee8..e5e0e494c 100644--- a/preload.js+++ b/preload.js@@ -474,6 +474,7 @@ contextBridge.exposeInMainWorld("electronAPI", {cloudPreviewSwitch: (opts) => ipcRenderer.invoke("cloud-preview-switch", opts),cloudApiRequest: (opts) => ipcRenderer.invoke("cloud-api-request", opts),getSttConfig: () => ipcRenderer.invoke("get-stt-config"),+ getNoteRecordingConfig: () => ipcRenderer.invoke("get-note-recording-config"),// Cloud audio file transcriptiontranscribeAudioFileCloud: (filePath) =>diff --git a/src/components/ControlPanel.tsx b/src/components/ControlPanel.tsxindex a7a5598a9..7ac74beda 100644--- a/src/components/ControlPanel.tsx+++ b/src/components/ControlPanel.tsx@@ -25,6 +25,7 @@ import WindowControls from "./WindowControls";import { getCachedPlatform } from "../utils/platform";import { isAccessibilitySkipped } from "../utils/permissions";import { setActiveNoteId, setActiveFolderId, initializeNotes } from "../stores/noteStore";+import { fetchProviders as fetchStreamingProviders } from "../stores/streamingProvidersStore";import HistoryView from "./HistoryView";import { syncService } from "../services/SyncService.js";@@ -293,6 +294,10 @@ export default function ControlPanel() {syncService.syncAll().catch(console.error);}, []);+ useEffect(() => {+ fetchStreamingProviders();+ }, []);+const handleMeetingRecordingRequestHandled = useCallback(() => setMeetingRecordingRequest(null),[]diff --git a/src/components/settings/AgentModeSettings.tsx b/src/components/settings/AgentModeSettings.tsxindex c1a649071..31cbcf808 100644--- a/src/components/settings/AgentModeSettings.tsx+++ b/src/components/settings/AgentModeSettings.tsx@@ -15,6 +15,20 @@ import ReasoningModelSelector from "../ReasoningModelSelector";import EnterpriseSection from "../EnterpriseSection";import SelfHostedPanel from "../SelfHostedPanel";import type { InferenceMode } from "../../types/electron";+import { modelRegistry, isEnterpriseProvider } from "../../models/ModelRegistry";++function isProviderValidForMode(provider: string, mode: InferenceMode): boolean {+ switch (mode) {+ case "providers":+ return modelRegistry.getCloudProviders().some((p) => p.id === provider);+ case "local":+ return modelRegistry.getAllProviders().some((p) => p.id === provider);+ case "enterprise":+ return isEnterpriseProvider(provider);+ default:+ return true;+ }+}export default function AgentModeSettings() {const { t } = useTranslation();@@ -98,6 +112,10 @@ export default function AgentModeSettings() {if (mode === agentInferenceMode) return;setAgentInferenceMode(mode);setCloudAgentMode(mode === "openwhispr" ? "openwhispr" : "byok");+ if (!isProviderValidForMode(agentProvider, mode)) {+ setAgentProvider("");+ setAgentModel("");+ }if (mode === "openwhispr" || mode === "self-hosted" || mode === "enterprise") {window.electronAPI?.llamaServerStop?.();}diff --git a/src/helpers/assemblyAiStreaming.js b/src/helpers/assemblyAiStreaming.jsindex 32deed718..b6702c264 100644--- a/src/helpers/assemblyAiStreaming.js+++ b/src/helpers/assemblyAiStreaming.js@@ -9,6 +9,8 @@ const TOKEN_EXPIRY_MS = 300000;const REWARM_DELAY_MS = 2000;const MAX_REWARM_ATTEMPTS = 10;const KEEPALIVE_INTERVAL_MS = 15000;+const MIN_FRAME_MS = 50;+const MIN_FRAME_BYTES = (SAMPLE_RATE * 2 * MIN_FRAME_MS) / 1000;class AssemblyAiStreaming {constructor() {@@ -36,6 +38,10 @@ class AssemblyAiStreaming {this.rewarmTimer = null;this.keepAliveInterval = null;this.isDisconnecting = false;+ this.pendingAudio = [];+ this.pendingAudioBytes = 0;+ this.completedSegments = [];+ this.speechStartedAt = null;}buildWebSocketUrl(options) {@@ -46,8 +52,14 @@ class AssemblyAiStreaming {format_turns: "true",token: options.token,});- if (options.language && options.language !== "auto") {- params.set("speech_model", "universal-streaming-multilingual");+ if (options.model) {+ params.set("speech_model", options.model);+ }+ if (options.minTurnSilence != null) {+ params.set("min_turn_silence", String(options.minTurnSilence));+ }+ if (options.maxTurnSilence != null) {+ params.set("max_turn_silence", String(options.maxTurnSilence));}if (options.keyterms && options.keyterms.length > 0) {params.set("keyterms_prompt", JSON.stringify(options.keyterms.slice(0, 100)));@@ -385,9 +397,10 @@ class AssemblyAiStreaming {// turn only when this variant is formatted, otherwise ignore duplicate.if (message.turn_is_formatted && previousTurn.text !== trimmedTranscript) {previousTurn.text = trimmedTranscript;+ this.completedSegments[this.completedSegments.length - 1] = trimmedTranscript;this.lastTurnText = trimmedTranscript;this.accumulatedText = this.turns.map((turn) => turn.text).join(" ");- this.onFinalTranscript?.(this.accumulatedText);+ this.onFinalTranscript?.(this.accumulatedText, previousTurn.startedAt);debugLogger.debug("AssemblyAI formatted turn update applied", {text: trimmedTranscript.slice(0, 100),totalAccumulated: this.accumulatedText.length,@@ -400,13 +413,17 @@ class AssemblyAiStreaming {break;}+ const speechTimestamp = this.speechStartedAt || Date.now();+ this.speechStartedAt = null;this.turns.push({text: trimmedTranscript,normalized: normalizedTranscript,+ startedAt: speechTimestamp,});+ this.completedSegments.push(trimmedTranscript);this.lastTurnText = trimmedTranscript;this.accumulatedText = this.turns.map((turn) => turn.text).join(" ");- this.onFinalTranscript?.(this.accumulatedText);+ this.onFinalTranscript?.(this.accumulatedText, speechTimestamp);debugLogger.debug("AssemblyAI final transcript (end_of_turn)", {text: message.transcript.slice(0, 100),totalAccumulated: this.accumulatedText.length,@@ -445,6 +462,10 @@ class AssemblyAiStreaming {this.onError?.(new Error(message.error));break;+ case "SpeechStarted":+ this.speechStartedAt = Date.now();+ break;+default:debugLogger.debug("AssemblyAI unknown message type", { type: message.type });}@@ -466,7 +487,16 @@ class AssemblyAiStreaming {return false;}- this.ws.send(pcmBuffer);+ this.pendingAudio.push(pcmBuffer);+ this.pendingAudioBytes += pcmBuffer.length;+ if (this.pendingAudioBytes < MIN_FRAME_BYTES) {+ return true;+ }++ const frame = Buffer.concat(this.pendingAudio, this.pendingAudioBytes);+ this.pendingAudio = [];+ this.pendingAudioBytes = 0;+ this.ws.send(frame);return true;}@@ -522,6 +552,11 @@ class AssemblyAiStreaming {clearTimeout(this.connectionTimeout);this.connectionTimeout = null;+ this.pendingAudio = [];+ this.pendingAudioBytes = 0;+ this.completedSegments = [];+ this.speechStartedAt = null;+if (this.ws) {try {this.ws.close();diff --git a/src/helpers/deepgramStreaming.js b/src/helpers/deepgramStreaming.jsindex a80f7c011..e4a0f9731 100644--- a/src/helpers/deepgramStreaming.js+++ b/src/helpers/deepgramStreaming.js@@ -82,6 +82,7 @@ class DeepgramStreaming {this.connectionTimeout = null;this.accumulatedText = "";this.finalSegments = [];+ this.sessionStartedAt = null;this.closeResolve = null;this.cachedToken = null;this.tokenFetchedAt = null;@@ -107,6 +108,10 @@ class DeepgramStreaming {this.connectionOptions = null;}+ get completedSegments() {+ return this.finalSegments;+ }+setTokenRefreshFn(fn) {this.tokenRefreshFn = fn;}@@ -650,6 +655,7 @@ class DeepgramStreaming {// the Metadata message and jump straight to SpeechStarted/Results.if (this.pendingResolve) {this.isConnected = true;+ this.sessionStartedAt = Date.now();clearTimeout(this.connectionTimeout);this.startKeepAlive(this.ws);if (message.type === "Metadata") {@@ -685,7 +691,11 @@ class DeepgramStreaming {if (trimmed) {this.finalSegments.push(trimmed);this.accumulatedText = this.finalSegments.join(" ");- this.onFinalTranscript?.(this.accumulatedText);+ const startedAt =+ this.sessionStartedAt != null && typeof message.start === "number"+ ? this.sessionStartedAt + message.start * 1000+ : Date.now();+ this.onFinalTranscript?.(this.accumulatedText, startedAt);debugLogger.debug("Deepgram final transcript", {text: trimmed.slice(0, 100),totalAccumulated: this.accumulatedText.length,diff --git a/src/helpers/environment.js b/src/helpers/environment.jsindex 9d05c4efa..1b78c7220 100644--- a/src/helpers/environment.js+++ b/src/helpers/environment.js@@ -10,6 +10,8 @@ const PERSISTED_KEYS = ["GEMINI_API_KEY","GROQ_API_KEY","MISTRAL_API_KEY",+ "ASSEMBLYAI_API_KEY",+ "DEEPGRAM_API_KEY","CUSTOM_TRANSCRIPTION_API_KEY","CUSTOM_REASONING_API_KEY","LOCAL_TRANSCRIPTION_PROVIDER",@@ -124,6 +126,22 @@ class EnvironmentManager {return this._saveKey("MISTRAL_API_KEY", key);}+ getAssemblyAIKey() {+ return this._getKey("ASSEMBLYAI_API_KEY");+ }++ saveAssemblyAIKey(key) {+ return this._saveKey("ASSEMBLYAI_API_KEY", key);+ }++ getDeepgramKey() {+ return this._getKey("DEEPGRAM_API_KEY");+ }++ saveDeepgramKey(key) {+ return this._saveKey("DEEPGRAM_API_KEY", key);+ }+getCustomTranscriptionKey() {return this._getKey("CUSTOM_TRANSCRIPTION_API_KEY");}diff --git a/src/helpers/ipcHandlers.js b/src/helpers/ipcHandlers.jsindex 3b286d827..848cd0f08 100644--- a/src/helpers/ipcHandlers.js+++ b/src/helpers/ipcHandlers.js@@ -32,6 +32,18 @@ const {MAX_SPEAKER_COUNT,} = require("../constants/speakerDetection.json");+const STREAMING_CLIENT_BY_PROVIDER = {+ "openai-realtime": OpenAIRealtimeStreaming,+ "assemblyai-realtime": AssemblyAiStreaming,+ "deepgram-realtime": DeepgramStreaming,+};+const ALLOWED_MEETING_PROVIDERS = new Set([+ "local",+ "openai-realtime",+ "assemblyai-realtime",+ "deepgram-realtime",+]);+function parseAttendees(raw) {if (!raw) return [];if (Array.isArray(raw)) return raw;@@ -380,20 +392,35 @@ class IPCHandlers {return map;}- _resolveOneOnOneOtherParticipant(participantsJson) {- if (!participantsJson) return null;+ _parseNonSelfParticipants(participantsJson) {+ if (!participantsJson) return [];let participants;try {participants = JSON.parse(participantsJson);} catch (_) {- return null;+ return [];}- if (!Array.isArray(participants) || participants.length === 0) return null;+ if (!Array.isArray(participants) || participants.length === 0) return [];const googleEmails = new Set(this.databaseManager.getGoogleAccounts().map((a) => a.email.toLowerCase()));- const isSelf = (p) => p.self === true || googleEmails.has((p.email || "").toLowerCase());- const others = participants.filter((p) => !isSelf(p));+ return participants.filter(+ (p) => p && p.self !== true && !googleEmails.has((p.email || "").toLowerCase())+ );+ }++ _getNoteNonSelfParticipants(noteId) {+ if (!noteId) return [];+ try {+ const note = this.databaseManager.getNote(noteId);+ return this._parseNonSelfParticipants(note?.participants);+ } catch (_) {+ return [];+ }+ }++ _resolveOneOnOneOtherParticipant(participantsJson) {+ const others = this._parseNonSelfParticipants(participantsJson);if (others.length !== 1) return null;const displayName = others[0].displayName || others[0].email;if (!displayName) return null;@@ -3727,6 +3754,15 @@ class IPCHandlers {schedulePendingMicFinalFlush();for (const pending of ready) {+ if (pending.micSuppression?.hasBleedEvidence) {+ debugLogger.debug("Dropping flagged-bleed mic segment after holdback", {+ text: pending.text.slice(0, 80),+ holdbackMs: pending.holdbackMs,+ averageCorrelation: pending.micSuppression?.averageCorrelation?.toFixed(3),+ averageResidual: pending.micSuppression?.averageResidual?.toFixed(3),+ });+ continue;+ }debugLogger.debug("Releasing buffered mic segment after duplicate holdback", {text: pending.text.slice(0, 80),holdbackMs: pending.holdbackMs,@@ -3932,34 +3968,78 @@ class IPCHandlers {};const fetchRealtimeToken = async (event, options, { streams } = {}) => {+ const postServerToken = async (path, body = {}) => {+ const apiUrl = getApiUrl();+ if (!apiUrl) throw new Error("OpenWhispr API URL not configured");+ const cookieHeader = await getSessionCookies(event);+ if (!cookieHeader) throw new Error("No session cookies available");+ const response = await fetch(`${apiUrl}${path}`, {+ method: "POST",+ headers: { "Content-Type": "application/json", Cookie: cookieHeader },+ body: JSON.stringify(body),+ });+ if (!response.ok) {+ const err = await response.json().catch(() => ({}));+ throw new Error(err.error || `Token request failed: ${response.status}`);+ }+ return response.json();+ };++ const dual = (factory) => (streams === 2 ? Promise.all([factory(), factory()]) : factory());++ if (options.provider === "assemblyai-realtime") {+ if (options.mode === "byok") {+ const apiKey = this.environmentManager.getAssemblyAIKey();+ if (!apiKey) {+ throw new Error("No AssemblyAI API key configured. Add your key in Settings.");+ }+ return dual(async () => {+ const response = await fetch(+ "https://streaming.assemblyai.com/v3/token?expires_in_seconds=60",+ { headers: { Authorization: apiKey } }+ );+ if (!response.ok) {+ const err = await response.json().catch(() => ({}));+ throw new Error(err.error || `AssemblyAI token request failed: ${response.status}`);+ }+ const data = await response.json();+ if (!data.token) throw new Error("No AssemblyAI token received");+ return data.token;+ });+ }+ return dual(async () => {+ const data = await postServerToken("/api/streaming-token");+ if (!data.token) throw new Error("No AssemblyAI token received");+ return data.token;+ });+ }++ if (options.provider === "deepgram-realtime") {+ if (options.mode === "byok") {+ const apiKey = this.environmentManager.getDeepgramKey();+ if (!apiKey) {+ throw new Error("No Deepgram API key configured. Add your key in Settings.");+ }+ return streams === 2 ? [apiKey, apiKey] : apiKey;+ }+ return dual(async () => {+ const data = await postServerToken("/api/deepgram-streaming-token");+ if (!data.token) throw new Error("No Deepgram token received");+ return data.token;+ });+ }+if (options.mode === "byok") {const apiKey = this.environmentManager.getOpenAIKey();if (!apiKey) throw new Error("No OpenAI API key configured. Add your key in Settings.");return streams === 2 ? [apiKey, apiKey] : apiKey;}- const apiUrl = getApiUrl();- if (!apiUrl) throw new Error("OpenWhispr API URL not configured");-- const cookieHeader = await getSessionCookies(event);- if (!cookieHeader) throw new Error("No session cookies available");-- const tokenResponse = await fetch(`${apiUrl}/api/openai-realtime-token`, {- method: "POST",- headers: { "Content-Type": "application/json", Cookie: cookieHeader },- body: JSON.stringify({- model: options.model,- language: options.language,- streams: streams || 1,- }),+ const data = await postServerToken("/api/openai-realtime-token", {+ model: options.model,+ language: options.language,+ streams: streams || 1,});-- if (!tokenResponse.ok) {- const err = await tokenResponse.json().catch(() => ({}));- throw new Error(err.error || `Token request failed: ${tokenResponse.status}`);- }-- const data = await tokenResponse.json();if (streams === 2) {if (!data.clientSecrets || data.clientSecrets.length < 2) {throw new Error("Expected two client secrets for dual-stream");@@ -4040,13 +4120,17 @@ class IPCHandlers {];}+ const StreamingClass =+ STREAMING_CLIENT_BY_PROVIDER[options.provider] ?? OpenAIRealtimeStreaming;for (const { ref, source } of pairs) {- this[ref] = new OpenAIRealtimeStreaming();+ this[ref] = new StreamingClass();attachMeetingStreamingHandlers(this[ref], win, source);}await Promise.all(- pairs.map(({ ref, secret }) => this[ref].connect({ apiKey: secret, ...connectOpts }))+ pairs.map(({ ref, secret }) =>+ this[ref].connect({ apiKey: secret, token: secret, ...connectOpts })+ ));return win;@@ -4054,6 +4138,11 @@ class IPCHandlers {const MEETING_MIC_REFERENCE_ALIGNMENT_MS = 320;const MEETING_STARTUP_WARMUP_MS = 1500;+ const MEETING_MIC_BLEED_RMS_CEILING = 0.018;+ const MEETING_MIC_BLEED_PEAK_CEILING = 0.07;+ const MEETING_MIC_BLEED_LOOKBACK_MS = 500;+ const MEETING_MIC_STATS_LOG_LIMIT = 200;+ let meetingMicStatsLogCount = 0;let meetingStartedAt = null;let meetingSendCounts = { mic: 0, system: 0 };const meetingEchoLeakDetector = new MeetingEchoLeakDetector();@@ -4067,6 +4156,21 @@ class IPCHandlers {let meetingLiveSpeakerState = null;let meetingLiveSpeakerStartedAt = null;let meetingReclusterTimer = null;+ let meetingSpeakerRemapper = (id) => id;++ const createSpeakerRemapper = (maxSpeakers) => {+ const cap = Math.max(1, Math.floor(maxSpeakers) || 1);+ const map = new Map();+ return (internalId) => {+ if (!internalId) return internalId;+ const existing = map.get(internalId);+ if (existing !== undefined) return existing;+ const index = map.size < cap ? map.size : cap - 1;+ const label = `speaker_${index}`;+ map.set(internalId, label);+ return label;+ };+ };let meetingLocalMode = false;let meetingLocalBuffers = { mic: [], system: [] };@@ -4084,7 +4188,18 @@ class IPCHandlers {let meetingOneOnOneProfileBound = false;let meetingNoteId = null;- const getLiveSpeakerProfiles = () => this.databaseManager.getSpeakerProfiles(true);+ const getLiveSpeakerProfiles = () => {+ const attendees = this._getNoteNonSelfParticipants(meetingNoteId);+ const attendeeEmails = new Set();+ for (const p of attendees) {+ const email = (p.email || "").toLowerCase().trim();+ if (email) attendeeEmails.add(email);+ }+ if (attendeeEmails.size === 0) return [];+ return this.databaseManager+ .getSpeakerProfiles(true)+ .filter((p) => p.email && attendeeEmails.has(p.email.toLowerCase()));+ };const shouldSuppressMicTranscriptSegment = (startedAt, endedAt = Date.now()) =>meetingEchoLeakDetector.shouldSuppressMicSegment(startedAt, endedAt);@@ -4103,7 +4218,8 @@ class IPCHandlers {const resolveSessionMaxSpeakers = () => {const count = this.activeMeetingSpeakerConfig?.expectedCount;- return count ? Math.min(count, MAX_SPEAKER_COUNT) : DEFAULT_EXPECTED_SPEAKER_COUNT;+ const total = count ? Math.min(count, MAX_SPEAKER_COUNT) : DEFAULT_EXPECTED_SPEAKER_COUNT;+ return Math.max(1, total - 1);};const bindOneOnOneAttendeeToSpeaker = (speakerId) => {@@ -4160,8 +4276,29 @@ class IPCHandlers {if (abs > peak) peak = abs;}const rms = Math.sqrt(sumSq / samples.length);+ const systemSpeaking = meetingEchoLeakDetector.isSystemSpeaking(+ Date.now() - MEETING_MIC_BLEED_LOOKBACK_MS+ );if (rms < 0.0015 && peak < 0.05) {outbound = Buffer.alloc(buffer.length);+ } else if (+ rms < MEETING_MIC_BLEED_RMS_CEILING &&+ peak < MEETING_MIC_BLEED_PEAK_CEILING &&+ systemSpeaking+ ) {+ outbound = Buffer.alloc(buffer.length);+ }+ if (+ meetingMicStatsLogCount < MEETING_MIC_STATS_LOG_LIMIT &&+ (systemSpeaking || rms > 0.02)+ ) {+ meetingMicStatsLogCount += 1;+ debugLogger.debug("Meeting mic audio stats", {+ rms: rms.toFixed(4),+ peak: peak.toFixed(4),+ systemSpeaking,+ zeroed: outbound !== buffer,+ });}}@@ -4295,13 +4432,15 @@ class IPCHandlers {meetingLiveSpeakerState = null;meetingLiveSpeakerStartedAt = Date.now();+ meetingSpeakerRemapper = createSpeakerRemapper(resolveSessionMaxSpeakers());const started = await liveSpeakerIdentifier.start((identification) => {if (!win || win.isDestroyed()) {return;}- bindOneOnOneAttendeeToSpeaker(identification.speakerId);+ const publicSpeakerId = meetingSpeakerRemapper(identification.speakerId);+ bindOneOnOneAttendeeToSpeaker(publicSpeakerId);const displayName = meetingOneOnOneAttendee? meetingOneOnOneAttendee.displayName@@ -4317,6 +4456,7 @@ class IPCHandlers {);const enrichedIdentification = {...identification,+ speakerId: publicSpeakerId,displayName,startTime,endTime,@@ -4333,7 +4473,7 @@ class IPCHandlers {(!seg.speaker || seg.speakerIsPlaceholder)) {applyConfirmedSpeaker(seg, {- speaker: identification.speakerId,+ speaker: publicSpeakerId,speakerName: displayName || seg.speakerName,speakerIsPlaceholder: false,});@@ -4355,7 +4495,14 @@ class IPCHandlers {const merges = await liveSpeakerIdentifier.recluster();if (!merges.length) return;- for (const { keep, remove, displayName } of merges) {+ const publicMerges = merges.map(({ keep, remove, displayName, similarity }) => ({+ keep: meetingSpeakerRemapper(keep),+ remove: meetingSpeakerRemapper(remove),+ displayName,+ similarity,+ }));+ for (const { keep, remove, displayName } of publicMerges) {+ if (keep === remove) continue;for (const seg of meetingDiarizationSegments) {if (seg.speaker === remove) {seg.speaker = keep;@@ -4364,7 +4511,7 @@ class IPCHandlers {}}- win.webContents.send("meeting-speakers-merged", merges);+ win.webContents.send("meeting-speakers-merged", publicMerges);}, 30_000);} else {meetingLiveSpeakerStartedAt = null;@@ -4401,6 +4548,20 @@ class IPCHandlers {return;}+ if (+ source === "mic" &&+ rms < MEETING_MIC_BLEED_RMS_CEILING &&+ peak < MEETING_MIC_BLEED_PEAK_CEILING &&+ meetingEchoLeakDetector.isSystemSpeaking(Date.now() - 5000)+ ) {+ debugLogger.debug("Skipping system-dominant mic chunk", {+ source,+ rms: rms.toFixed(4),+ peak: peak.toFixed(4),+ });+ return;+ }+const wav = pcm16ToWav(pcm16k);try {@@ -4779,12 +4940,12 @@ class IPCHandlers {return { success: false, error: "Operation in progress" };}- if (options.provider === "local") {- return { success: true };+ if (!ALLOWED_MEETING_PROVIDERS.has(options.provider)) {+ return { success: false, error: `Unsupported provider: ${options.provider}` };}- if (options.provider !== "openai-realtime") {- return { success: false, error: `Unsupported provider: ${options.provider}` };+ if (options.provider === "local") {+ return { success: true };}const { mode: systemAudioMode } = await getMeetingSystemAudioPlan();@@ -4917,7 +5078,7 @@ class IPCHandlers {};}- if (options.provider !== "openai-realtime") {+ if (!ALLOWED_MEETING_PROVIDERS.has(options.provider)) {return { success: false, error: `Unsupported provider: ${options.provider}` };}@@ -5762,6 +5923,33 @@ class IPCHandlers {}});+ ipcMain.handle("get-note-recording-config", async (event) => {+ try {+ const apiUrl = getApiUrl();+ if (!apiUrl) throw new Error("OpenWhispr API URL not configured");++ const cookieHeader = await getSessionCookies(event);+ if (!cookieHeader) throw new Error("No session cookies available");++ const response = await fetch(`${apiUrl}/api/note-recording-config`, {+ headers: { Cookie: cookieHeader },+ });++ if (!response.ok) {+ if (response.status === 401) {+ return { success: false, error: "Session expired", code: "AUTH_EXPIRED" };+ }+ throw new Error(`API error: ${response.status}`);+ }++ const data = await response.json();+ return { success: true, ...data };+ } catch (error) {+ debugLogger.error("Note recording config fetch error:", error);+ return null;+ }+ });+ipcMain.handle("transcribe-audio-file-cloud", async (event, filePath) => {try {const apiUrl = getApiUrl();@@ -7285,8 +7473,9 @@ class IPCHandlers {_resolveSpeakerExpectation({ sessionConfig, noteId, observedSpeakerIds }) {if (sessionConfig?.expectedCount) {+ const total = Math.min(sessionConfig.expectedCount, MAX_SPEAKER_COUNT);return {- numSpeakers: Math.min(sessionConfig.expectedCount, MAX_SPEAKER_COUNT),+ numSpeakers: Math.max(1, total - 1),cap: null,};}diff --git a/src/helpers/meetingEchoLeakDetector.js b/src/helpers/meetingEchoLeakDetector.jsindex 87221726f..35500e09b 100644--- a/src/helpers/meetingEchoLeakDetector.js+++ b/src/helpers/meetingEchoLeakDetector.js@@ -15,6 +15,7 @@ const STRONG_BLEED_MIC_TO_SYSTEM_RATIO = 1.25;const PARTIAL_BLEED_CORRELATION = 0.6;const PARTIAL_BLEED_RESIDUAL = 0.45;const PARTIAL_BLEED_EXPLAINED = 0.5;+const HIGH_CORRELATION_BLEED = 0.7;const FINAL_BLEED_CORRELATION = 0.55;const FINAL_BLEED_RESIDUAL = 0.48;const FINAL_BLEED_EXPLAINED = 0.45;@@ -209,9 +210,10 @@ class MeetingEchoLeakDetector {bleedMatches.reduce((sum, entry) => sum + entry.explainedRatio, 0) / bleedMatches.length;return (- averageCorrelation >= PARTIAL_BLEED_CORRELATION &&- averageResidual <= PARTIAL_BLEED_RESIDUAL &&- averageExplained >= PARTIAL_BLEED_EXPLAINED+ averageCorrelation >= HIGH_CORRELATION_BLEED ||+ (averageCorrelation >= PARTIAL_BLEED_CORRELATION &&+ averageResidual <= PARTIAL_BLEED_RESIDUAL &&+ averageExplained >= PARTIAL_BLEED_EXPLAINED));}@@ -277,9 +279,10 @@ class MeetingEchoLeakDetector {: null;const hasBleedEvidence =bleedMatches.length > 0 &&- averageCorrelation >= PARTIAL_BLEED_CORRELATION &&- averageResidual <= PARTIAL_BLEED_RESIDUAL &&- averageExplained >= PARTIAL_BLEED_EXPLAINED;+ (averageCorrelation >= HIGH_CORRELATION_BLEED ||+ (averageCorrelation >= PARTIAL_BLEED_CORRELATION &&+ averageResidual <= PARTIAL_BLEED_RESIDUAL &&+ averageExplained >= PARTIAL_BLEED_EXPLAINED));const bleedShare = bleedMatches.length / relevant.length;const shareGate = systemSpeaking ? VAD_GATED_SUSPECTED_SHARE : 0.6;const likelyRenderBleedShareGate = systemSpeaking ? VAD_GATED_SUSPECTED_SHARE : 0.4;diff --git a/src/hooks/useMeetingTranscription.ts b/src/hooks/useMeetingTranscription.tsindex a1f955012..1865e3436 100644--- a/src/hooks/useMeetingTranscription.ts+++ b/src/hooks/useMeetingTranscription.ts@@ -1,5 +1,6 @@import { useState, useEffect, useRef, useCallback } from "react";import { getSettings, selectResolvedMeetingTranscription } from "../stores/settingsStore";+import { useStreamingProvidersStore } from "../stores/streamingProvidersStore";import { isBuiltInMicrophone } from "../utils/audioDeviceUtils";import type { SystemAudioAccessResult, SystemAudioStrategy } from "../types/electron";import {@@ -78,12 +79,11 @@ interface UseMeetingTranscriptionReturn {const MEETING_AUDIO_BUFFER_SIZE = 800;const MEETING_STOP_FLUSH_TIMEOUT_MS = 50;const MEETING_MIC_PRIMARY_AUDIO_CONSTRAINTS = {- echoCancellation: true,+ echoCancellation: false,noiseSuppression: false,autoGainControl: false,} as const;-const REALTIME_MODELS = new Set(["gpt-4o-mini-transcribe", "gpt-4o-transcribe"]);const SPEAKER_IDENTIFICATION_RETENTION_MS = 30_000;const SYSTEM_SPEAKER_CARRY_FORWARD_MS = 8_000;const buildTranscriptText = (segments: TranscriptSegment[]) =>@@ -129,12 +129,25 @@ const getMeetingTranscriptionOptions = () => {};}- const model = REALTIME_MODELS.has(resolved.cloudTranscriptionModel)- ? resolved.cloudTranscriptionModel- : "gpt-4o-mini-transcribe";+ const catalog = useStreamingProvidersStore.getState().providers;+ const provider =+ catalog?.find((p) => p.id === resolved.cloudTranscriptionProvider) ?? catalog?.[0];+ const byokKeyAvailable = provider?.id === "openai" ? !!state.openaiApiKey : true;const mode =- resolved.cloudTranscriptionMode === "byok" && !!state.openaiApiKey ? "byok" : "openwhispr";- return { provider: "openai-realtime" as const, model, mode };+ resolved.cloudTranscriptionMode === "byok" && byokKeyAvailable ? "byok" : "openwhispr";+ if (!provider) {+ logger.debug(+ "Streaming providers catalog not loaded, falling back to OpenAI default",+ {},+ "meeting"+ );+ return { provider: "openai-realtime" as const, model: "gpt-4o-mini-transcribe", mode };+ }+ const model =+ provider.models.find((m) => m.id === resolved.cloudTranscriptionModel)?.id ??+ provider.models.find((m) => m.default)?.id ??+ provider.models[0]?.id;+ return { provider: `${provider.id}-realtime` as const, model, mode };};const stopMediaStream = (stream: MediaStream | null) => {diff --git a/src/services/SyncService.ts b/src/services/SyncService.tsindex 7758e5d2f..1b76e8178 100644--- a/src/services/SyncService.ts+++ b/src/services/SyncService.ts@@ -109,6 +109,7 @@ class SyncService {audio_duration_seconds: note.audio_duration_seconds,transcript: note.transcript,folder_id: cloudFolderId,+ updated_at: note.updated_at,});} else {const cloud = await NotesService.create({diff --git a/src/stores/settingsStore.ts b/src/stores/settingsStore.tsindex 47b7a55b4..d7e14a094 100644--- a/src/stores/settingsStore.ts+++ b/src/stores/settingsStore.ts@@ -3,6 +3,7 @@ import { API_ENDPOINTS } from "../config/constants";import i18n, { normalizeUiLanguage } from "../i18n";import { hasStoredByokKey } from "../utils/byokDetection";import { ensureAgentNameInDictionary } from "../utils/agentName";+import { useStreamingProvidersStore } from "./streamingProvidersStore";import logger from "../utils/logger";import type { LocalTranscriptionProvider, InferenceMode, SelfHostedType } from "../types/electron";import type { GoogleCalendarAccount } from "../types/calendar";@@ -1133,21 +1134,25 @@ export interface ResolvedMeetingTranscription {export const selectResolvedMeetingTranscription = (state: SettingsState-): ResolvedMeetingTranscription => ({- useLocalWhisper: state.meetingUseLocalWhisper,- whisperModel: state.meetingWhisperModel || state.whisperModel,- localTranscriptionProvider: state.meetingLocalTranscriptionProvider,- parakeetModel: state.meetingParakeetModel || state.parakeetModel,- cloudTranscriptionProvider:- state.meetingCloudTranscriptionProvider || state.cloudTranscriptionProvider,- cloudTranscriptionModel: state.meetingCloudTranscriptionModel || state.cloudTranscriptionModel,- cloudTranscriptionBaseUrl:- state.meetingCloudTranscriptionBaseUrl || state.cloudTranscriptionBaseUrl || "",- cloudTranscriptionMode: state.meetingCloudTranscriptionMode || state.cloudTranscriptionMode,- transcriptionMode: state.meetingTranscriptionMode,- remoteTranscriptionType: state.meetingRemoteTranscriptionType,- remoteTranscriptionUrl: state.meetingRemoteTranscriptionUrl || state.remoteTranscriptionUrl,-});+): ResolvedMeetingTranscription => {+ const catalog = useStreamingProvidersStore.getState().providers;+ const cloudTranscriptionProvider = catalog?.[0]?.id ?? "";++ return {+ useLocalWhisper: state.meetingUseLocalWhisper,+ whisperModel: state.meetingWhisperModel || state.whisperModel,+ localTranscriptionProvider: state.meetingLocalTranscriptionProvider,+ parakeetModel: state.meetingParakeetModel || state.parakeetModel,+ cloudTranscriptionProvider,+ cloudTranscriptionModel: state.meetingCloudTranscriptionModel || state.cloudTranscriptionModel,+ cloudTranscriptionBaseUrl:+ state.meetingCloudTranscriptionBaseUrl || state.cloudTranscriptionBaseUrl || "",+ cloudTranscriptionMode: state.meetingCloudTranscriptionMode || state.cloudTranscriptionMode,+ transcriptionMode: state.meetingTranscriptionMode,+ remoteTranscriptionType: state.meetingRemoteTranscriptionType,+ remoteTranscriptionUrl: state.meetingRemoteTranscriptionUrl || state.remoteTranscriptionUrl,+ };+};export interface ResolvedMeetingReasoning {reasoningProvider: string;diff --git a/src/stores/streamingProvidersStore.ts b/src/stores/streamingProvidersStore.tsnew file mode 100644index 000000000..d9e075fa5--- /dev/null+++ b/src/stores/streamingProvidersStore.ts@@ -0,0 +1,48 @@+import { create } from "zustand";+import logger from "../utils/logger";++export interface NoteRecordingProviderModel {+ id: string;+ name: string;+ default?: boolean;+}++export interface NoteRecordingProvider {+ id: string;+ name: string;+ models: NoteRecordingProviderModel[];+}++interface StreamingProvidersState {+ providers: NoteRecordingProvider[] | null;+}++export const useStreamingProvidersStore = create<StreamingProvidersState>()(() => ({+ providers: null,+}));++let inFlight: Promise<NoteRecordingProvider[] | null> | null = null;++export async function fetchProviders(): Promise<NoteRecordingProvider[] | null> {+ if (inFlight) return inFlight;+ if (!window.electronAPI?.getNoteRecordingConfig) return null;++ inFlight = (async () => {+ try {+ const data = await window.electronAPI.getNoteRecordingConfig!();+ if (!data?.success) {+ throw new Error("Note recording config unavailable");+ }+ const providers = Array.isArray(data.providers) ? data.providers : [];+ useStreamingProvidersStore.setState({ providers });+ return providers;+ } catch (err) {+ logger.warn("Failed to fetch note recording providers", err, "streamingProviders");+ return null;+ } finally {+ inFlight = null;+ }+ })();++ return inFlight;+}diff --git a/src/types/electron.ts b/src/types/electron.tsindex ea2b2c4f6..8a6055490 100644--- a/src/types/electron.ts+++ b/src/types/electron.ts@@ -371,6 +371,15 @@ declare global {streamingProvider: string;} | null>;+ getNoteRecordingConfig?: () => Promise<{+ success: boolean;+ providers: Array<{+ id: string;+ name: string;+ models: Array<{ id: string; name: string; default?: boolean }>;+ }>;+ } | null>;+// Database operationssaveTranscription: (text: string,