Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update changelog [skip ci]
Ondra Urban64bf3f2d3931
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 49313a41c..ea3dcdd43 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -2,6 +2,7 @@ NEXT====================- Add `SessionPool` implemenation to `CheerioCrawler`.- Fix `Request` constructor not making a copy of objects such as `userData` and `headers`.+- Fix `desc` option not being applied in local `dataset.getData()`.0.17.0 / 2019-11-25====================