Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update changelog
Ondra Urban1fb6b0e4eb0b
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 19f2d94c1..95cb777ae 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,3 +1,9 @@+xxx+===================+- `PseudoUrl` can now be constructed with a `RegExp`.+- `Apify.utils.enqueueLinks()` now accepts `RegExp` instances in its `pseudoUrls` parameter.+- Better error message for an invalid `launchPuppeteerFunction` passed to `PuppeteerPool`.+0.11.6 / 2018-01-24===================- **DEPRECATION WARNING** `Apify.utils.puppeteer.enqueueLinks()` was moved to `Apify.utils.enqueueLinks()`.@@ -7,7 +13,6 @@===================- Disabled the `PuppeteerPool` `reusePages` option for now, due to a memory leak.- Added a `keyValueStore.forEachKey()` method to iterate all keys in the store.-- Better error message for an invalid `launchPuppeteerFunction` passed to `PuppeteerPool`.0.11.4 / 2018-01-15===================diff --git a/docs/api/PuppeteerPool.md b/docs/api/PuppeteerPool.mdindex f0ce8d54f..884be3bb7 100644--- a/docs/api/PuppeteerPool.md+++ b/docs/api/PuppeteerPool.md@@ -92,10 +92,12 @@ await puppeteerPool.destroy();<td><code>[options.launchPuppeteerFunction]</code></td><td><code>function</code></td><td></td></tr><tr>-<td colspan="3"><p>Overrides the default function to launch a new <code>Puppeteer</code> instance.- See source code on+<td colspan="3"><p>Overrides the default function to launch a new Puppeteer instance.+ The function must return a promise resolving to+ <a href="https://github.com/GoogleChrome/puppeteer/blob/master/docs/api.md#class-browser"><code>Browser</code></a> instance.+ See the source code on<a href="https://github.com/apifytech/apify-js/blob/master/src/puppeteer_pool.js#L28" target="_blank">GitHub</a>- for default behavior.</p>+ for the default implementation.</p></td></tr><tr><td><code>[options.launchPuppeteerOptions]</code></td><td><code><a href="../typedefs/launchpuppeteeroptions">LaunchPuppeteerOptions</a></code></td><td></td></tr>