Skip to content

High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.

Update QA.md with round 2 re-test results

Lc65ff230b350
diff --git a/QA.md b/QA.md
index d515ab6b..ca711b42 100644
--- a/QA.md
+++ b/QA.md
@@ -1,80 +1,62 @@
# Pinchtab QA Report — 2026-02-15
-**Build:** commit 4fc2a3e (latest main)
**Testers:** Bosch, Mario
---
-## Bugs
+## Round 1 — Build 4fc2a3e
-### 🔴 P0 — Active Tab Not Tracked After Navigate (Bosch)
+### Bugs Found
-`/navigate` opens a new tab (or reuses one unpredictably) but `/snapshot` and `/text` don't follow — they return data from a stale tab. This is the main blocker for reliable automation.
-
-**Repro:**
-1. Fresh start — Pinchtab opens with `about:blank`
-2. `/navigate` to `https://example.com` → works (reuses initial tab)
-3. `/navigate` to `https://github.com/luigi-agosti/pinchtab` → opens new tab
-4. `/snapshot` → returns `about:blank` or the previous tab, not GitHub
-
-**Expected:** After `/navigate`, subsequent `/snapshot`/`/text` should return data from the navigated tab.
-
-### 🔴 P0 — Invalid JSON in Snapshot/Text (Bosch)
-
-Both `/snapshot` and `/text` produce invalid JSON on pages with certain content. Unescaped control characters break standard JSON parsers.
-
-**Affected sites:** Yahoo Finance, StackOverflow (confirmed), likely others
-**Error:** `json.JSONDecodeError: Invalid control character at: line 1 column N`
-**Workaround:** `json.loads(raw, strict=False)` in Python
-**Fix:** Escape control characters (U+0000–U+001F) in all string values before JSON serialization.
-
-### 🟡 P1 — `newTab:true` Broken (Mario)
-
-`/navigate` with `newTab:true` silently ignores the flag and navigates the existing tab instead of opening a new one. Tabs get overwritten/lost.
-
-### 🟡 P1 — Tab Close Returns 400 (Bosch)
-
-`POST /tab {"action":"close","tabId":"..."}` returns `{"error":"tabId required"}`.
-Tried both `"id"` and `"tabId"` as field names — neither works.
-
-**Impact:** Can't clean up tabs programmatically, leading to tab accumulation.
-
-### 🟡 P1 — No Tab Switch/Focus API (Bosch)
-
-No way to manually set the active tab. When active tab tracking drifts, there's no recovery path.
-
-**Suggestion:** Add `POST /tab {"action":"switch","tabId":"..."}` or similar.
-
-### 🟡 P1 — `/action` Unhelpful Error Message (Mario)
-
-Missing `kind` field returns `{"error":"unknown action: "}` instead of telling the user the field is missing or listing valid values (`click`, `type`, `hover`, `select`, `scroll`).
-
-### 🟢 P2 — `/navigate` Returns Empty Title (Mario)
-
-Some sites (BBC, x.com) return `"title":""` in the response. Likely a race condition — title isn't set by the time the response is sent.
-
-### 🟢 P2 — `/text` Google Language Blob (Mario)
-
-Readability extraction on google.com includes the full language picker (all locale names) as content. Should be filtered out.
-
-### 🟢 P2 — Chrome Flag Warning (Bosch)
-
-```
-You are using an unsupported command-line flag: --disable-blink-features=AutomationControlled.
-Stability and security will suffer.
-```
-
-Minor — cosmetic warning but could affect stability per Chrome's own messaging.
+| # | Severity | Bug | Found by |
+|---|----------|-----|----------|
+| 1 | 🔴 P0 | Active tab not tracked after `/navigate` — snapshot/text return stale tab | Bosch |
+| 2 | 🔴 P0 | Invalid JSON — unescaped control chars in snapshot/text (Yahoo Finance, StackOverflow) | Bosch |
+| 3 | 🟡 P1 | `newTab:true` silently ignored on `/navigate` | Mario |
+| 4 | 🟡 P1 | Tab close (`POST /tab`) returns 400 — `tabId` field not recognized | Bosch |
+| 5 | 🟡 P1 | No tab switch/focus API — no recovery when tracking drifts | Bosch |
+| 6 | 🟡 P1 | `/action` missing `kind` returns unhelpful `"unknown action: "` | Mario |
+| 7 | 🟢 P2 | `/navigate` returns empty title on some sites (BBC, x.com) — race condition | Mario |
+| 8 | 🟢 P2 | `/text` on google.com includes full language picker blob | Mario |
+| 9 | 🟢 P2 | Chrome flag warning: `--disable-blink-features=AutomationControlled` | Bosch |
---
-## Improvements
-
-- **Better `/navigate` title** — Wait for `document.title` to be non-empty (with short timeout) before returning response.
-- **Actionable error messages** — `/action` should list valid `kind` values in error responses.
-- **`/text` content filtering** — Strip known noise patterns (language pickers, cookie banners) from readability output.
-- **Tab management** — Fix `newTab:true`, fix tab close, add tab switch endpoint.
-- **Compact snapshot format** — Consider an aria-tree-style text output (indented, role + name per line) instead of/alongside verbose JSON. Could cut snapshot tokens by 3–4×.
+## Round 2 — Build 723c927 (Mario fixes)
+
+### Re-test Results
+
+| # | Test | Result | Notes |
+|---|------|--------|-------|
+| 1 | Active tab tracking (1st navigate after startup) | ❌ FAIL | First navigate still returns stale profile tab |
+| 2 | Active tab tracking (2nd navigate) | ✅ PASS | Tracks correctly after first |
+| 3 | Active tab tracking (3rd navigate) | ✅ PASS | Keeps tracking |
+| 4 | JSON validity — Yahoo Finance `/snapshot` | ✅ PASS | **Fixed!** 707 nodes, valid JSON |
+| 5 | JSON validity — Yahoo Finance `/text` | ✅ PASS | **Fixed!** |
+| 6 | JSON validity — StackOverflow | ✅ PASS | **Fixed!** |
+| 7 | Tab close | ❌ FAIL | Now hangs indefinitely instead of 400 (regression) |
+| 8 | `/action` error message | ✅ PASS | **Fixed!** Lists valid `kind` values |
+
+### Bug Status After Round 2
+
+| # | Bug | Status |
+|---|-----|--------|
+| 1 | Active tab tracking | ⚠️ Partial — works after 1st navigate, fails on initial |
+| 2 | Invalid JSON | ✅ Fixed |
+| 3 | `newTab:true` broken | ❓ Not retested |
+| 4 | Tab close | ❌ Regressed — now hangs instead of 400 |
+| 5 | No tab switch API | ❌ Still missing |
+| 6 | `/action` error message | ✅ Fixed |
+| 7 | Empty title on navigate | ❓ Not retested |
+| 8 | Google language blob in `/text` | ❓ Not retested |
+| 9 | Chrome flag warning | ❌ Still present |
+
+### Remaining Issues (priority order)
+
+1. **Tab close hangs** — regression, was 400 now hangs forever
+2. **First navigate doesn't set active tab** — stale profile tabs confuse initial tracking
+3. **No tab switch API** — needed for recovery
+4. **10 tabs accumulated** during testing with no way to clean up
---
@@ -101,10 +83,10 @@ Minor — cosmetic warning but could affect stability per Chrome's own messaging
### Key Findings
-- **Pinchtab snapshots are 3–4× larger** than OpenClaw aria trees (verbose JSON with `ref`, `role`, `name`, `depth`, `nodeId` per node)
-- **Pinchtab `/text` is the most token-efficient format** (~1K tokens for complex finance pages) — great for content extraction
-- **OpenClaw aria tree** is the best balance for interactive browsing (~3.5K tokens, structured + compact)
-- **`/text` is a real strength** — already very efficient, should be the primary endpoint for read-only tasks
+- **Pinchtab snapshots are 3–4× larger** than OpenClaw aria trees (verbose JSON per node)
+- **Pinchtab `/text` is the most token-efficient** (~1K tokens for complex finance pages)
+- **OpenClaw aria tree** is the best balance for interactive browsing (~3.5K tokens)
+- **Recommendation:** Add a compact text-based snapshot format to close the gap with OpenClaw
---
@@ -129,16 +111,12 @@ Minor — cosmetic warning but could affect stability per Chrome's own messaging
All loaded fine, no bot detection, zero crashes. ✅
----
-
## What Works Well
-- ✅ `/navigate` — fast, returns title+URL correctly
-- ✅ `/snapshot` — comprehensive a11y tree when on the right tab
-- ✅ `/snapshot?filter=interactive` — properly filters to actionable elements
-- ✅ `/text` — clean, compact content extraction
-- ✅ `/action` with `click` — reliable (tested cookie consent acceptance)
-- ✅ `/tabs` — accurate tab listing
-- ✅ Startup is fast (~3 seconds to ready)
-- ✅ Headless mode works well
-- ✅ No bot detection on any tested sites
+- ✅ `/navigate` — fast, returns title+URL
+- ✅ `/snapshot` — comprehensive a11y tree
+- ✅ `/snapshot?filter=interactive` — filters to actionable elements
+- ✅ `/text` — clean, compact, token-efficient
+- ✅ `/action` with `click` — reliable
+- ✅ `/tabs` — accurate listing
+- ✅ Fast startup (~3s), headless works, no bot detection