Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update changelog
Ondra Urban0e84a2feb630
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 95cb777ae..e8096f3c6 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -2,6 +2,8 @@ xxx===================- `PseudoUrl` can now be constructed with a `RegExp`.- `Apify.utils.enqueueLinks()` now accepts `RegExp` instances in its `pseudoUrls` parameter.+- `Apify.utils.enqueueLinks()` now accepts a `baseUrl` option that enables resolution of relative URLs+ when parsing a Cheerio object. (It's done automatically in browser when using Puppeteer).- Better error message for an invalid `launchPuppeteerFunction` passed to `PuppeteerPool`.0.11.6 / 2018-01-24