Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
fix(BrowserPool): ignore `--no-sandbox` flag for webkit launcher (#2148)
Vlad Frangu1eb2f08a3cde
diff --git a/packages/browser-pool/src/playwright/playwright-plugin.ts b/packages/browser-pool/src/playwright/playwright-plugin.tsindex fa1abf4e0..d7d430008 100644--- a/packages/browser-pool/src/playwright/playwright-plugin.ts+++ b/packages/browser-pool/src/playwright/playwright-plugin.ts@@ -54,6 +54,11 @@ export class PlaywrightPlugin extends BrowserPlugin<BrowserType, SafeParameters<...launchOptions!.proxy,};+ // WebKit does not support --no-sandbox+ if (this.library.name() === 'webkit') {+ launchOptions!.args = launchOptions!.args?.filter((arg) => arg !== '--no-sandbox');+ }+const [anonymizedProxyUrl, close] = await anonymizeProxySugar(proxyUrl);if (anonymizedProxyUrl) {launchOptions!.proxy = {