Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update changelog [skip ci]
Ondra Urban49fe0cb65db1
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 7c29ccb94..57bcd5d23 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -14,6 +14,7 @@ custom proxy management will move to `ProxyConfiguration` as well.instances. `ProxyConfiguration` itself is not exposed.- Add `proxyConfiguration` to `BasicCrawlerOptions`, `CheerioCrawlerOptions`and `PuppeteerCrawlerOptions`.+- Fixed a bug where intercepted requests would never continue.0.20.4 / 2020-05-11