Allow Chrome to support remote browser providers and one-chrome-per-snapshot mode

[pirate]

---

---

Summary by cubic

Adds remote Chrome adoption via CHROME_CDP_URL and an optional per‑snapshot isolation mode, with a CDP‑verified readiness contract and thin foreground wait barriers. Standardizes session markers and hook execution, centralizes CDP session setup, and strengthens teardown, stale‑session recovery, and CI logs.

• New Features

  • Remote adoption: CHROME_CDP_URL (ws(s)/http(s)), CHROME_IS_LOCAL=false to omit chrome.pid, optional CHROME_KEEPALIVE=true.
  • Isolation: CHROME_ISOLATION=snapshot adds per‑snapshot lifecycle via on_Snapshot__09_chrome_launch.daemon.bg.js; crawl mode remains default.
  • Readiness/contract: connectToPage returns browser/page/cdpSession and can waitForNavigationComplete with postLoadDelayMs; waitForChromeSessionState (supports requireExtensionsLoaded); connectToBrowserEndpoint; auto‑attach; stronger stale‑session recovery; keepalive‑aware teardown; on_Crawl__91 and on_Snapshot__11 are thin foreground barriers.
  • Markers: stop using port.txt, final_url.txt, page_loaded.txt; use cdp_url.txt and navigation.json.
  • Hooks/tests: run all hooks via their shebang (no explicit node/python); helper updated to execute scripts directly; downstream extractors (e.g., accessibility, dom, infiniscroll, consolelog, dns, headers, outlinks) now use connectToPage and waitForNavigationComplete.
  • CI/tests: tee subprocess output (ABX_PYTEST_TEE_SUBPROCESS_OUTPUT=1), show full pytest results (-rA), expand Chrome tests for remote adoption and snapshot isolation.

• Migration

  • Remote browser: set CHROME_CDP_URL, CHROME_IS_LOCAL=false, optionally CHROME_KEEPALIVE=true.
  • Per‑snapshot mode: set CHROME_ISOLATION=snapshot; snapshot launch hook starts/cleans the browser; crawl hooks skip launching.
  • Helpers: use connectToPage/connectToBrowserEndpoint; use waitForChromeSessionState; waitForPageLoaded is now waitForNavigationComplete.
  • Replace legacy markers with cdp_url.txt and navigation.json.
  • Ensure hooks are executable and invoked via shebang; import env helpers from ../base/utils.js.

^{Written for commit 2d38e91. Summary will update on new commits.}