Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updating README
Marek Trunkat39dac958519d
diff --git a/README.md b/README.mdindex c078295b2..42650a22e 100644--- a/README.md+++ b/README.md@@ -662,8 +662,8 @@ Apify.main(async () => {Each actor run at Apify platform has assigned its default storages (key-value store, request queue and dataset) which are availablevia API and helper functions such as `Apify.setValue()`, `Apify.pushData()`, etc.. If you are running actor locally then the data-get stored in the directory defined by <code>APIFY_LOCAL_EMULATION_DIR</code> environment variable and following overridable environment-variables:+get stored in the directory defined by <code>APIFY_LOCAL_EMULATION_DIR</code> environment variable and its subdirectories based on+following environment variables:<table><thead>