Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updating docs
Marek Trunkatc0b5988fce28
diff --git a/README.md b/README.mdindex 326ea2be9..d80301de3 100644--- a/README.md+++ b/README.md@@ -162,7 +162,8 @@ npm install apifySDK will use local directory `./apify_storage` for key-value stores, request lists and request queues tostore their data.-However, to make the package work at its full potential (use Apify Proxy, call another actors, etc.),+However, to make the package work at its full potential (use+<a href="https://www.apify.com/docs/proxy" target="_blank">Apify Proxy</a>, call another actors, etc.),you'll need to set one or more of the following environment variablesfor your Node.js process, depending on your circumstances:@@ -180,8 +181,8 @@ for your Node.js process, depending on your circumstances:<td></td><td>Defines if key-value stores, request lists and request queues should store data in Apify cloud or local- directory. By default local directory is used. Use `APIFY_PLATFORM_STORAGE=1` environment variable- for Apify cloud.+ directory. By default local directory is used. Use <code>APIFY_PLATFORM_STORAGE=1</code>+ environment variable for Apify cloud.</td></tr><tr>