Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

18.4 KB
Raw Blame

Change Log

All notable changes to this project will be documented in this file. See Conventional Commits for commit guidelines.

3.18.1 (2026-08-12)

Note: Version bump only for package @crawlee/browser-pool

3.18.0 (2026-08-04)

Features

3.17.0 (2026-06-04)

Bug Fixes

  • bind Browser.pages() correctly in PuppeteerPlugin (#3439) (c3a4b3b)
  • browser-pool: allow unsetting launch context proxy URL (#3621) (d5ab219)
  • browser-pool: preserve caller's AbortContext across p-limit queue (#3673) (c4d58d9), closes #3670
  • BrowserCrawler closes ctx.page before errorHandler runs on navig… (#3655) (ab34886)
  • parse proxy URLs correctly when using useIncognitoPages (#3433) (db2bb68)
  • unref BrowserController.close() fallback timer to avoid keeping Node alive longer than needed (#3671) (eef94d4)

Features

  • add ignoreProxyCertificate option for the internal proxy-chain instance (#3418) (02eec66), closes #3369

3.16.0 (2026-02-06)

Features

  • add @crawlee/stagehand package for AI-powered browser automation (#3331) (a89cb5a), closes #3064

Performance Improvements

3.15.3 (2025-11-10)

Note: Version bump only for package @crawlee/browser-pool

3.15.2 (2025-10-23)

Bug Fixes

3.15.1 (2025-09-26)

Note: Version bump only for package @crawlee/browser-pool

3.15.0 (2025-09-17)

Note: Version bump only for package @crawlee/browser-pool

3.14.1 (2025-08-05)

Note: Version bump only for package @crawlee/browser-pool

3.14.0 (2025-07-25)

Bug Fixes

  • don't retire browsers with long-running pre|postLaunchHooks prematurely (#3062) (681660e)

3.13.10 (2025-07-09)

Note: Version bump only for package @crawlee/browser-pool

3.13.9 (2025-06-27)

Note: Version bump only for package @crawlee/browser-pool

3.13.8 (2025-06-16)

Note: Version bump only for package @crawlee/browser-pool

3.13.7 (2025-06-06)

Note: Version bump only for package @crawlee/browser-pool

3.13.6 (2025-06-05)

Note: Version bump only for package @crawlee/browser-pool

3.13.5 (2025-05-20)

Note: Version bump only for package @crawlee/browser-pool

3.13.4 (2025-05-14)

Note: Version bump only for package @crawlee/browser-pool

3.13.3 (2025-05-05)

Bug Fixes

3.13.2 (2025-04-08)

Note: Version bump only for package @crawlee/browser-pool

3.13.1 (2025-04-07)

Note: Version bump only for package @crawlee/browser-pool

3.13.0 (2025-03-04)

Note: Version bump only for package @crawlee/browser-pool

3.12.2 (2025-01-27)

Note: Version bump only for package @crawlee/browser-pool

3.12.1 (2024-12-04)

Note: Version bump only for package @crawlee/browser-pool

3.12.0 (2024-11-04)

Bug Fixes

Features

3.11.5 (2024-10-04)

Note: Version bump only for package @crawlee/browser-pool

3.11.4 (2024-09-23)

Note: Version bump only for package @crawlee/browser-pool

3.11.3 (2024-09-03)

Note: Version bump only for package @crawlee/browser-pool

3.11.2 (2024-08-28)

Note: Version bump only for package @crawlee/browser-pool

3.11.1 (2024-07-24)

Note: Version bump only for package @crawlee/browser-pool

3.11.0 (2024-07-09)

Note: Version bump only for package @crawlee/browser-pool

3.10.5 (2024-06-12)

Note: Version bump only for package @crawlee/browser-pool

3.10.4 (2024-06-11)

Note: Version bump only for package @crawlee/browser-pool

3.10.3 (2024-06-07)

Bug Fixes

  • increase timeout for retiring inactive browsers (#2523) (195f176)

3.10.2 (2024-06-03)

Note: Version bump only for package @crawlee/browser-pool

3.10.1 (2024-05-23)

Note: Version bump only for package @crawlee/browser-pool

3.10.0 (2024-05-16)

Note: Version bump only for package @crawlee/browser-pool

3.9.2 (2024-04-17)

Note: Version bump only for package @crawlee/browser-pool

3.9.1 (2024-04-11)

Features

3.9.0 (2024-04-10)

Features

3.8.2 (2024-03-21)

Bug Fixes

  • fix detection of older puppeteer versions (890669b), closes #2370
  • puppeteer: improve detection of older versions (98d4e86)

3.8.1 (2024-02-22)

Note: Version bump only for package @crawlee/browser-pool

3.8.0 (2024-02-21)

Bug Fixes

  • puppeteer: add 'process' to the browser bound methods (#2329) (2750ba6)
  • puppeteer: support puppeteer@v22 (#2337) (3cc360a)

3.7.3 (2024-01-30)

Note: Version bump only for package @crawlee/browser-pool

3.7.2 (2024-01-09)

Note: Version bump only for package @crawlee/browser-pool

3.7.1 (2024-01-02)

Note: Version bump only for package @crawlee/browser-pool

3.7.0 (2023-12-21)

Bug Fixes

  • browser-pool: respect user options before assigning fingerprints (#2190) (f050776), closes #2164

3.6.2 (2023-11-26)

Note: Version bump only for package @crawlee/browser-pool

3.6.1 (2023-11-15)

Features

3.6.0 (2023-11-15)

Bug Fixes

  • BrowserPool: ignore --no-sandbox flag for webkit launcher (#2148) (1eb2f08), closes #1797
  • provide more detailed error messages for browser launch errors (#2157) (f188ebe)

3.5.8 (2023-10-17)

Note: Version bump only for package @crawlee/browser-pool

3.5.7 (2023-10-05)

Note: Version bump only for package @crawlee/browser-pool

3.5.6 (2023-10-04)

Note: Version bump only for package @crawlee/browser-pool

3.5.5 (2023-10-02)

Bug Fixes

  • allow to use any version of puppeteer or playwright (#2102) (0cafceb), closes #2101

3.5.4 (2023-09-11)

Note: Version bump only for package @crawlee/browser-pool

3.5.3 (2023-08-31)

Bug Fixes

3.5.2 (2023-08-21)

Note: Version bump only for package @crawlee/browser-pool

3.5.1 (2023-08-16)

Note: Version bump only for package @crawlee/browser-pool

3.5.0 (2023-07-31)

Note: Version bump only for package @crawlee/browser-pool

3.4.2 (2023-07-19)

Note: Version bump only for package @crawlee/browser-pool

3.4.1 (2023-07-13)

Note: Version bump only for package @crawlee/browser-pool

3.4.0 (2023-06-12)

Note: Version bump only for package @crawlee/browser-pool

3.3.3 (2023-05-31)

Note: Version bump only for package @crawlee/browser-pool

3.3.2 (2023-05-11)

Note: Version bump only for package @crawlee/browser-pool

3.3.1 (2023-04-11)

Note: Version bump only for package @crawlee/browser-pool

3.3.0 (2023-03-09)

Note: Version bump only for package @crawlee/browser-pool

3.2.2 (2023-02-08)

Note: Version bump only for package @crawlee/browser-pool

3.2.1 (2023-02-07)

Note: Version bump only for package @crawlee/browser-pool

3.2.0 (2023-02-07)

Bug Fixes

  • update playwright to 1.29.2 and make peer dep. less strict (#1735) (c654fcd), closes #1723

3.1.3 (2022-12-07)

Note: Version bump only for package @crawlee/browser-pool

3.1.2 (2022-11-15)

Note: Version bump only for package @crawlee/browser-pool

3.1.1 (2022-11-07)

Note: Version bump only for package @crawlee/browser-pool

3.1.0 (2022-10-13)

Note: Version bump only for package @crawlee/browser-pool

3.0.4 (2022-08-22)

Features