Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated docs
Jan Curnc534bdd1832a
diff --git a/src/key_value_store.js b/src/key_value_store.jsindex a79bcb675..998e25685 100644--- a/src/key_value_store.js+++ b/src/key_value_store.js@@ -309,7 +309,10 @@ export class KeyValueStore {/*** Iterates over key value store keys, yielding each in turn to an `iteratee` function.- * Each invocation of `iteratee` is called with three arguments: `(item, index, info)`.+ * Each invocation of `iteratee` is called with three arguments: `(key, index, info)`, where `key`+ * is the record key, `index` is a zero-based index of the key in the current iteration+ * (regardless of `options.exclusiveStartKey`) and `info` is an object that contains a single property `size`+ * indicating size of the record in bytes.** If the `iteratee` function returns a Promise then it is awaited before the next call.* If it throws an error, the iteration is aborted and the `forEachKey` function throws the error.