Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Fix frontpage
Ondra Urbanb1a26f610fb6
diff --git a/website/i18n/en.json b/website/i18n/en.jsonindex c711b23fc..b0f470e37 100644--- a/website/i18n/en.json+++ b/website/i18n/en.json@@ -3,7 +3,7 @@"localized-strings": {"next": "Next","previous": "Previous",- "tagline": "The scalable web crawling and scraping library for JavaScript.",+ "tagline": "The scalable web crawling and scraping library for JavaScript. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.","docs": {"api/apify": {"title": "Apify"diff --git a/website/pages/en/index.js b/website/pages/en/index.jsindex de6f56d4a..a800a5da0 100755--- a/website/pages/en/index.js+++ b/website/pages/en/index.js@@ -184,7 +184,7 @@ const PowerfulTools = () => ({content: 'All the crawlers are automatically **scaled** based on available system resources using the [`AutoscaledPool`](docs/api/autoscaledpool) class. ' +'When you run your code on the [Apify Cloud](https://my.apify.com/actors), you can also take advantage of a pool of **proxies** to avoid detection. ' +- 'For the data storage, you can use the [`Dataset`](docs/api/dataset) and [`Key-value store`](docs/api/keyvaluestore) classes.',+ 'For the data storage, you can use the [`Dataset`](docs/api/dataset) and [`KeyValueStore`](docs/api/keyvaluestore) classes.',image: imgUrl('source_code.png'),imageAlign: 'left',title: 'Powerful tools',