Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Change Log
All notable changes to this project will be documented in this file. See Conventional Commits for commit guidelines.
3.18.1 (2026-08-12)
Note: Version bump only for package @crawlee/browser-pool
3.18.0 (2026-08-04)
Features
3.17.0 (2026-06-04)
Bug Fixes
- bind
Browser.pages()correctly inPuppeteerPlugin(#3439) (c3a4b3b) - browser-pool: allow unsetting launch context proxy URL (#3621) (d5ab219)
- browser-pool: preserve caller's AbortContext across p-limit queue (#3673) (c4d58d9), closes #3670
- BrowserCrawler closes ctx.page before errorHandler runs on navig… (#3655) (ab34886)
- parse proxy URLs correctly when using
useIncognitoPages(#3433) (db2bb68) - unref BrowserController.close() fallback timer to avoid keeping Node alive longer than needed (#3671) (eef94d4)
Features
- add
ignoreProxyCertificateoption for the internalproxy-chaininstance (#3418) (02eec66), closes #3369
3.16.0 (2026-02-06)
Features
Performance Improvements
3.15.3 (2025-11-10)
Note: Version bump only for package @crawlee/browser-pool
3.15.2 (2025-10-23)
Bug Fixes
- correctly apply
launchOptionswithuseIncognitoPages(#3181) (84a4b70), closes /github.com/apify/crawlee/issues/3173#issuecomment-3346728227 #3173 #3173
3.15.1 (2025-09-26)
Note: Version bump only for package @crawlee/browser-pool
3.15.0 (2025-09-17)
Note: Version bump only for package @crawlee/browser-pool
3.14.1 (2025-08-05)
Note: Version bump only for package @crawlee/browser-pool
3.14.0 (2025-07-25)
Bug Fixes
3.13.10 (2025-07-09)
Note: Version bump only for package @crawlee/browser-pool
3.13.9 (2025-06-27)
Note: Version bump only for package @crawlee/browser-pool
3.13.8 (2025-06-16)
Note: Version bump only for package @crawlee/browser-pool
3.13.7 (2025-06-06)
Note: Version bump only for package @crawlee/browser-pool
3.13.6 (2025-06-05)
Note: Version bump only for package @crawlee/browser-pool
3.13.5 (2025-05-20)
Note: Version bump only for package @crawlee/browser-pool
3.13.4 (2025-05-14)
Note: Version bump only for package @crawlee/browser-pool
3.13.3 (2025-05-05)
Bug Fixes
- await
_createPageForBrowserin browser pool (#2950) (27ba74b), closes #2789 - Fix trailing slash removal in BrowserPool (#2921) (c1fc439), closes #2878
3.13.2 (2025-04-08)
Note: Version bump only for package @crawlee/browser-pool
3.13.1 (2025-04-07)
Note: Version bump only for package @crawlee/browser-pool
3.13.0 (2025-03-04)
Note: Version bump only for package @crawlee/browser-pool
3.12.2 (2025-01-27)
Note: Version bump only for package @crawlee/browser-pool
3.12.1 (2024-12-04)
Note: Version bump only for package @crawlee/browser-pool
3.12.0 (2024-11-04)
Bug Fixes
- update
fingerprintGeneratorOptionstypes (#2705) (fcb098d), closes /github.com/apify/fingerprint-suite/blob/c61814e6ba8822543deb0ce6c03e0a0249933629/packages/fingerprint-generator/src/fingerprint-generator.ts#L73 /github.com/apify/fingerprint-suite/blob/c61814e6ba8822543deb0ce6c03e0a0249933629/packages/header-generator/src/header-generator.ts#L87 #2703
Features
3.11.5 (2024-10-04)
Note: Version bump only for package @crawlee/browser-pool
3.11.4 (2024-09-23)
Note: Version bump only for package @crawlee/browser-pool
3.11.3 (2024-09-03)
Note: Version bump only for package @crawlee/browser-pool
3.11.2 (2024-08-28)
Note: Version bump only for package @crawlee/browser-pool
3.11.1 (2024-07-24)
Note: Version bump only for package @crawlee/browser-pool
3.11.0 (2024-07-09)
Note: Version bump only for package @crawlee/browser-pool
3.10.5 (2024-06-12)
Note: Version bump only for package @crawlee/browser-pool
3.10.4 (2024-06-11)
Note: Version bump only for package @crawlee/browser-pool
3.10.3 (2024-06-07)
Bug Fixes
3.10.2 (2024-06-03)
Note: Version bump only for package @crawlee/browser-pool
3.10.1 (2024-05-23)
Note: Version bump only for package @crawlee/browser-pool
3.10.0 (2024-05-16)
Note: Version bump only for package @crawlee/browser-pool
3.9.2 (2024-04-17)
Note: Version bump only for package @crawlee/browser-pool
3.9.1 (2024-04-11)
Features
3.9.0 (2024-04-10)
Features
tieredProxyUrlsfor ProxyConfiguration (#2348) (5408c7f)- better
newUrlFunctionfor ProxyConfiguration (#2392) (330598b), closes #2348 #2065
3.8.2 (2024-03-21)
Bug Fixes
- fix detection of older puppeteer versions (890669b), closes #2370
- puppeteer: improve detection of older versions (98d4e86)
3.8.1 (2024-02-22)
Note: Version bump only for package @crawlee/browser-pool
3.8.0 (2024-02-21)
Bug Fixes
- puppeteer: add 'process' to the browser bound methods (#2329) (2750ba6)
- puppeteer: support
puppeteer@v22(#2337) (3cc360a)
3.7.3 (2024-01-30)
Note: Version bump only for package @crawlee/browser-pool
3.7.2 (2024-01-09)
Note: Version bump only for package @crawlee/browser-pool
3.7.1 (2024-01-02)
Note: Version bump only for package @crawlee/browser-pool
3.7.0 (2023-12-21)
Bug Fixes
3.6.2 (2023-11-26)
Note: Version bump only for package @crawlee/browser-pool
3.6.1 (2023-11-15)
Features
3.6.0 (2023-11-15)
Bug Fixes
- BrowserPool: ignore
--no-sandboxflag for webkit launcher (#2148) (1eb2f08), closes #1797 - provide more detailed error messages for browser launch errors (#2157) (f188ebe)
3.5.8 (2023-10-17)
Note: Version bump only for package @crawlee/browser-pool
3.5.7 (2023-10-05)
Note: Version bump only for package @crawlee/browser-pool
3.5.6 (2023-10-04)
Note: Version bump only for package @crawlee/browser-pool
3.5.5 (2023-10-02)
Bug Fixes
3.5.4 (2023-09-11)
Note: Version bump only for package @crawlee/browser-pool
3.5.3 (2023-08-31)
Bug Fixes
- browser-pool: improve error handling when browser is not found (#2050) (282527f), closes #1459
- pin all internal dependencies (#2041) (d6f2b17), closes #2040
3.5.2 (2023-08-21)
Note: Version bump only for package @crawlee/browser-pool
3.5.1 (2023-08-16)
Note: Version bump only for package @crawlee/browser-pool
3.5.0 (2023-07-31)
Note: Version bump only for package @crawlee/browser-pool
3.4.2 (2023-07-19)
Note: Version bump only for package @crawlee/browser-pool
3.4.1 (2023-07-13)
Note: Version bump only for package @crawlee/browser-pool
3.4.0 (2023-06-12)
Note: Version bump only for package @crawlee/browser-pool
3.3.3 (2023-05-31)
Note: Version bump only for package @crawlee/browser-pool
3.3.2 (2023-05-11)
Note: Version bump only for package @crawlee/browser-pool
3.3.1 (2023-04-11)
Note: Version bump only for package @crawlee/browser-pool
3.3.0 (2023-03-09)
Note: Version bump only for package @crawlee/browser-pool
3.2.2 (2023-02-08)
Note: Version bump only for package @crawlee/browser-pool
3.2.1 (2023-02-07)
Note: Version bump only for package @crawlee/browser-pool
3.2.0 (2023-02-07)
Bug Fixes
3.1.3 (2022-12-07)
Note: Version bump only for package @crawlee/browser-pool
3.1.2 (2022-11-15)
Note: Version bump only for package @crawlee/browser-pool
3.1.1 (2022-11-07)
Note: Version bump only for package @crawlee/browser-pool
3.1.0 (2022-10-13)
Note: Version bump only for package @crawlee/browser-pool