Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Build docs
Ondra Urban2811c90871b8
diff --git a/docs/api/Request.md b/docs/api/Request.mdindex a65fe9c8f..52a0c0647 100644--- a/docs/api/Request.md+++ b/docs/api/Request.md@@ -184,6 +184,13 @@ to override the default behavior and specify which URLs shall be considered equa## `request.pushErrorMessage(errorOrMessage)`Stores information about an error that occurred during processing of this request.+You should always use Error instances when throwing errors in JavaScript.++Nevertheless, to improve the debugging experience when using third party libraries+that may not always throw an Error instance, the function performs a type+inspection of the passed argument and attempts to extract as much information+as possible, since just throwing a bad type error makes any debugging rather difficult.+<table><thead><tr>