Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
reorder property in JSDoc for RequestAsBrowserOptions (#761)
Paulo Cesardd9d546b4d7f
diff --git a/src/utils_request.js b/src/utils_request.jsindex fbfe0c5e1..1f2810fd4 100644--- a/src/utils_request.js+++ b/src/utils_request.js@@ -36,10 +36,6 @@ const DEFAULT_HTTP_REQUEST_OPTIONS = {* Two-letter ISO 3166 country code.* @property {boolean} [useMobileVersion]* If `true`, the function uses User-Agent of a mobile browser.- * @property {AbortFunction} [abortFunction]- * Function accepts `response` object as a single parameter and should return true or false.- * If function returns true request gets aborted. This function is passed to the- * [@apify/http-request](https://www.npmjs.com/package/@apify/http-request) NPM package.* @property {boolean} [ignoreSslErrors=true]* If set to true, SSL/TLS certificate errors will be ignored.* @property {boolean} [useInsecureHttpParser=true]@@ -50,6 +46,10 @@ const DEFAULT_HTTP_REQUEST_OPTIONS = {* However, it will also open your application to some security vulnerabilities,* although the risk should be negligible as these vulnerabilities mainly relate to server applications, not clients.* Learn more in this [blog post](https://snyk.io/blog/node-js-release-fixes-a-critical-http-security-vulnerability/).+ * @property {AbortFunction} [abortFunction]+ * Function accepts `response` object as a single parameter and should return true or false.+ * If function returns true request gets aborted. This function is passed to the+ * [@apify/http-request](https://www.npmjs.com/package/@apify/http-request) NPM package.*//**diff --git a/tsconfig.json b/tsconfig.jsonindex 805fddcfd..c8cdc13c5 100644--- a/tsconfig.json+++ b/tsconfig.json@@ -4,6 +4,10 @@"module": "commonjs","moduleResolution": "node","lib": [+ "DOM",+ "DOM.Iterable",+ "ES2015",+ "ES2016","ES2018","ES2019.Object","ES2018.AsyncIterable"