Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
docs(browser-pool): explain retire session in retireBrowserAfterPageC… (#2246)
Lukáš Křivka2a5b94bda639
diff --git a/packages/browser-pool/src/browser-pool.ts b/packages/browser-pool/src/browser-pool.tsindex 6bf0af184..1d2ed50a7 100644--- a/packages/browser-pool/src/browser-pool.ts+++ b/packages/browser-pool/src/browser-pool.ts@@ -68,8 +68,10 @@ export interface BrowserPoolOptions<Plugin extends BrowserPlugin = BrowserPluginmaxOpenPagesPerBrowser?: number;/*** Browsers tend to get bloated after processing a lot of pages. This option- * configures the number of processed pages after which the browser will+ * configures the maximum number of processed pages after which the browser will* automatically retire and close. A new browser will launch in its place.+ * The browser might be retired sooner if the connected {@apilink Session} is retired.+ * You can change session retirement behavior using {@apilink SessionPoolOptions}.** @default 100*/