Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Merge branch 'develop' into feature/dbug_info

Marek Trunkát64f18fff5137
diff --cc CHANGELOG.md
index 44c7f99ea,95cb777ae..e8e343c1e
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@@ -1,6 -1,13 +1,14 @@@
-xxx
+xxxxxxxxxxxxxxxxxxx
===================
+- Added `utils.createRequestDebugInfo()` function to create a standardized debug info from request and response.
+ - `PseudoUrl` can now be constructed with a `RegExp`.
+ - `Apify.utils.enqueueLinks()` now accepts `RegExp` instances in its `pseudoUrls` parameter.
+ - Better error message for an invalid `launchPuppeteerFunction` passed to `PuppeteerPool`.
+
+ 0.11.6 / 2018-01-24
+ ===================
+ - **DEPRECATION WARNING** `Apify.utils.puppeteer.enqueueLinks()` was moved to `Apify.utils.enqueueLinks()`.
+ - `Apify.utils.enqueueLinks()` now supports `options.$` property to enqueue links from a Cheerio object.
0.11.5 / 2018-01-18
===================