Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Update changelog

Ondra Urbance8cc843adc8
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 926b2a5fc..699305c6c 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -3,6 +3,7 @@ xxxxxxxxxxxxxxxxxxx
- Added `getInfo()` method to Dataset to get meta-information about a dataset.
- Added CheerioCrawler, a specialized class for crawling the web using `cheerio`
- Added `keepDuplicateUrls` option to RequestList to allow duplicate URLs
+- Added `log` to `Apify.utils` to improve logging experience
0.6.1 / 2018-08-17
===================