Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updating README
Marek Trunkatd5b02aba3c21
diff --git a/README.md b/README.mdindex a4bfca94f..6760c1a48 100644--- a/README.md+++ b/README.md@@ -659,10 +659,10 @@ Apify.main(async () => {## Storage-Each actor run at Apify platform has assigned its default storages (key-value store, request queue and dataset). ID of these storages-are defined by environment variables <code>APIFY_DEFAULT_KEY_VALUE_STORE_ID</code>, <code>APIFY_DEFAULT_REQUEST_QUEUE_ID</code>-and <code>APIFY_DEFAULT_DATASET_ID</code>. If you are running actor locally then the data get stored in directory defined by-<code>APIFY_LOCAL_EMULATION_DIR</code>.+Each actor run at Apify platform has assigned its default storages (key-value store, request queue and dataset) which are available+via API and helper functions such as `Apify.setValue()`, `Apify.pushData()`, etc.. If you are running actor locally then the data+get stored in the directory defined by <code>APIFY_LOCAL_EMULATION_DIR</code> environment variable and following overridable environment+variables:<table><thead>