Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update README.md
Marek Trunkát8c78d92f51cd
diff --git a/README.md b/README.mdindex a7ed28148..f9255ccfd 100644--- a/README.md+++ b/README.md@@ -125,7 +125,7 @@ The Apify SDK is available as the <a href="https://www.npmjs.com/package/apify"></li><li><a href="https://www.apify.com/docs/sdk/apify-runtime-js/latest#RequestQueue"><code>RequestQueue</code></a>- - Represents a queue of URLs to crawl, which is stored either on a local filesystem or in the [Apify Cloud](https://www.apify.com).+ - Represents a queue of URLs to crawl, which is stored either on a local filesystem or in the <a href="https://www.apify.com">Apify Cloud</a>.The queue is used for deep crawling of websites, where you start withseveral URLs and then recursively follow links to other pages.The data structure supports both breadth-first and depth-first crawling orders.