Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Improve docs

Ondra Urban4dafa65ce51c
diff --git a/src/request_list.js b/src/request_list.js
index c8a67d555..cada7e722 100644
--- a/src/request_list.js
+++ b/src/request_list.js
@@ -129,6 +129,7 @@ export const SOURCES_PERSISTENCE_KEY = 'REQUEST_LIST_SOURCES';
* URLs will be kept in the list. It does not protect the user from having duplicates in user set
* `uniqueKey`s however. It is the user's responsibility to ensure uniqueness of their unique keys
* if they wish to keep more than just a single copy in the `RequestList`.
+ * @name RequestList
*/
export class RequestList {
constructor(options = {}) {