Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Writing README.md
Jan Curna58a5e36355c
diff --git a/README.md b/README.mdindex 87cf5497b..9fa58e61c 100644--- a/README.md+++ b/README.md@@ -1,4 +1,4 @@-# apify: web scraping and automation SDK for JavaScript / Node.js+# Apify SDK: web scraping and automation library for JavaScript / Node.js<!-- Mirror this part to src/index.js -->[](http://badge.fury.io/js/apify)@@ -7,7 +7,7 @@<div id="include-readme-1">Apify SDK simplifies development of web crawlers, scrapers, data extractors and web automation jobs.It provides tools to manage and automatically scale a pool of headless Chrome / Puppeteer instances,- maintain lists or queues of URLs to crawl, store crawling results to local filesystem or into the cloud,+ maintain queues of URLs to crawl, store crawling results to local filesystem or into the cloud,rotate proxies and much more.The SDK is available as the <a href="https://www.npmjs.com/package/apify" target="_blank"><code>apify</code></a> NPM package.It can be used either standalone in your own applications@@ -16,7 +16,7 @@</div><div>- View the [Apify SDK Programmer's Reference](https://www.apify.com/docs/sdk/apify-runtime-js/latest).+ View the full <a href="https://www.apify.com/docs/sdk/apify-runtime-js/latest/" target="_blank">Apify SDK Programmer's Reference</a></div>