High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
Update QA.md with round 2 re-test results
Lc65ff230b350
diff --git a/QA.md b/QA.mdindex d515ab6b..ca711b42 100644--- a/QA.md+++ b/QA.md@@ -1,80 +1,62 @@# Pinchtab QA Report — 2026-02-15-**Build:** commit 4fc2a3e (latest main)**Testers:** Bosch, Mario----## Bugs+## Round 1 — Build 4fc2a3e-### 🔴 P0 — Active Tab Not Tracked After Navigate (Bosch)+### Bugs Found-`/navigate` opens a new tab (or reuses one unpredictably) but `/snapshot` and `/text` don't follow — they return data from a stale tab. This is the main blocker for reliable automation.--**Repro:**-1. Fresh start — Pinchtab opens with `about:blank`-2. `/navigate` to `https://example.com` → works (reuses initial tab)-3. `/navigate` to `https://github.com/luigi-agosti/pinchtab` → opens new tab-4. `/snapshot` → returns `about:blank` or the previous tab, not GitHub--**Expected:** After `/navigate`, subsequent `/snapshot`/`/text` should return data from the navigated tab.--### 🔴 P0 — Invalid JSON in Snapshot/Text (Bosch)--Both `/snapshot` and `/text` produce invalid JSON on pages with certain content. Unescaped control characters break standard JSON parsers.--**Affected sites:** Yahoo Finance, StackOverflow (confirmed), likely others-**Error:** `json.JSONDecodeError: Invalid control character at: line 1 column N`-**Workaround:** `json.loads(raw, strict=False)` in Python-**Fix:** Escape control characters (U+0000–U+001F) in all string values before JSON serialization.--### 🟡 P1 — `newTab:true` Broken (Mario)--`/navigate` with `newTab:true` silently ignores the flag and navigates the existing tab instead of opening a new one. Tabs get overwritten/lost.--### 🟡 P1 — Tab Close Returns 400 (Bosch)--`POST /tab {"action":"close","tabId":"..."}` returns `{"error":"tabId required"}`.-Tried both `"id"` and `"tabId"` as field names — neither works.--**Impact:** Can't clean up tabs programmatically, leading to tab accumulation.--### 🟡 P1 — No Tab Switch/Focus API (Bosch)--No way to manually set the active tab. When active tab tracking drifts, there's no recovery path.--**Suggestion:** Add `POST /tab {"action":"switch","tabId":"..."}` or similar.--### 🟡 P1 — `/action` Unhelpful Error Message (Mario)--Missing `kind` field returns `{"error":"unknown action: "}` instead of telling the user the field is missing or listing valid values (`click`, `type`, `hover`, `select`, `scroll`).--### 🟢 P2 — `/navigate` Returns Empty Title (Mario)--Some sites (BBC, x.com) return `"title":""` in the response. Likely a race condition — title isn't set by the time the response is sent.--### 🟢 P2 — `/text` Google Language Blob (Mario)--Readability extraction on google.com includes the full language picker (all locale names) as content. Should be filtered out.--### 🟢 P2 — Chrome Flag Warning (Bosch)--```-You are using an unsupported command-line flag: --disable-blink-features=AutomationControlled.-Stability and security will suffer.-```--Minor — cosmetic warning but could affect stability per Chrome's own messaging.+| # | Severity | Bug | Found by |+|---|----------|-----|----------|+| 1 | 🔴 P0 | Active tab not tracked after `/navigate` — snapshot/text return stale tab | Bosch |+| 2 | 🔴 P0 | Invalid JSON — unescaped control chars in snapshot/text (Yahoo Finance, StackOverflow) | Bosch |+| 3 | 🟡 P1 | `newTab:true` silently ignored on `/navigate` | Mario |+| 4 | 🟡 P1 | Tab close (`POST /tab`) returns 400 — `tabId` field not recognized | Bosch |+| 5 | 🟡 P1 | No tab switch/focus API — no recovery when tracking drifts | Bosch |+| 6 | 🟡 P1 | `/action` missing `kind` returns unhelpful `"unknown action: "` | Mario |+| 7 | 🟢 P2 | `/navigate` returns empty title on some sites (BBC, x.com) — race condition | Mario |+| 8 | 🟢 P2 | `/text` on google.com includes full language picker blob | Mario |+| 9 | 🟢 P2 | Chrome flag warning: `--disable-blink-features=AutomationControlled` | Bosch |----## Improvements--- **Better `/navigate` title** — Wait for `document.title` to be non-empty (with short timeout) before returning response.-- **Actionable error messages** — `/action` should list valid `kind` values in error responses.-- **`/text` content filtering** — Strip known noise patterns (language pickers, cookie banners) from readability output.-- **Tab management** — Fix `newTab:true`, fix tab close, add tab switch endpoint.-- **Compact snapshot format** — Consider an aria-tree-style text output (indented, role + name per line) instead of/alongside verbose JSON. Could cut snapshot tokens by 3–4×.+## Round 2 — Build 723c927 (Mario fixes)++### Re-test Results++| # | Test | Result | Notes |+|---|------|--------|-------|+| 1 | Active tab tracking (1st navigate after startup) | ❌ FAIL | First navigate still returns stale profile tab |+| 2 | Active tab tracking (2nd navigate) | ✅ PASS | Tracks correctly after first |+| 3 | Active tab tracking (3rd navigate) | ✅ PASS | Keeps tracking |+| 4 | JSON validity — Yahoo Finance `/snapshot` | ✅ PASS | **Fixed!** 707 nodes, valid JSON |+| 5 | JSON validity — Yahoo Finance `/text` | ✅ PASS | **Fixed!** |+| 6 | JSON validity — StackOverflow | ✅ PASS | **Fixed!** |+| 7 | Tab close | ❌ FAIL | Now hangs indefinitely instead of 400 (regression) |+| 8 | `/action` error message | ✅ PASS | **Fixed!** Lists valid `kind` values |++### Bug Status After Round 2++| # | Bug | Status |+|---|-----|--------|+| 1 | Active tab tracking | ⚠️ Partial — works after 1st navigate, fails on initial |+| 2 | Invalid JSON | ✅ Fixed |+| 3 | `newTab:true` broken | ❓ Not retested |+| 4 | Tab close | ❌ Regressed — now hangs instead of 400 |+| 5 | No tab switch API | ❌ Still missing |+| 6 | `/action` error message | ✅ Fixed |+| 7 | Empty title on navigate | ❓ Not retested |+| 8 | Google language blob in `/text` | ❓ Not retested |+| 9 | Chrome flag warning | ❌ Still present |++### Remaining Issues (priority order)++1. **Tab close hangs** — regression, was 400 now hangs forever+2. **First navigate doesn't set active tab** — stale profile tabs confuse initial tracking+3. **No tab switch API** — needed for recovery+4. **10 tabs accumulated** during testing with no way to clean up---@@ -101,10 +83,10 @@ Minor — cosmetic warning but could affect stability per Chrome's own messaging### Key Findings-- **Pinchtab snapshots are 3–4× larger** than OpenClaw aria trees (verbose JSON with `ref`, `role`, `name`, `depth`, `nodeId` per node)-- **Pinchtab `/text` is the most token-efficient format** (~1K tokens for complex finance pages) — great for content extraction-- **OpenClaw aria tree** is the best balance for interactive browsing (~3.5K tokens, structured + compact)-- **`/text` is a real strength** — already very efficient, should be the primary endpoint for read-only tasks+- **Pinchtab snapshots are 3–4× larger** than OpenClaw aria trees (verbose JSON per node)+- **Pinchtab `/text` is the most token-efficient** (~1K tokens for complex finance pages)+- **OpenClaw aria tree** is the best balance for interactive browsing (~3.5K tokens)+- **Recommendation:** Add a compact text-based snapshot format to close the gap with OpenClaw---@@ -129,16 +111,12 @@ Minor — cosmetic warning but could affect stability per Chrome's own messagingAll loaded fine, no bot detection, zero crashes. ✅-----## What Works Well-- ✅ `/navigate` — fast, returns title+URL correctly-- ✅ `/snapshot` — comprehensive a11y tree when on the right tab-- ✅ `/snapshot?filter=interactive` — properly filters to actionable elements-- ✅ `/text` — clean, compact content extraction-- ✅ `/action` with `click` — reliable (tested cookie consent acceptance)-- ✅ `/tabs` — accurate tab listing-- ✅ Startup is fast (~3 seconds to ready)-- ✅ Headless mode works well-- ✅ No bot detection on any tested sites+- ✅ `/navigate` — fast, returns title+URL+- ✅ `/snapshot` — comprehensive a11y tree+- ✅ `/snapshot?filter=interactive` — filters to actionable elements+- ✅ `/text` — clean, compact, token-efficient+- ✅ `/action` with `click` — reliable+- ✅ `/tabs` — accurate listing+- ✅ Fast startup (~3s), headless works, no bot detection