Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
text edits
davidjohnbarton32e88c20ff09
diff --git a/website/pages/en/index.js b/website/pages/en/index.jsindex 531f2a4bb..10359eae7 100755--- a/website/pages/en/index.js+++ b/website/pages/en/index.js@@ -116,7 +116,7 @@ const Features = () => ({[{content: '**JavaScript** is the language of the web. Although there are JavaScript tools like [puppeteer](https://www.npmjs.com/package/puppeteer) and [cheerio](https://www.npmjs.com/package/cheerio), ' +- 'there was no universal framework that would enable **large-scale high-performance** web scraping and crawling of any website. **Until now!**',+ 'there was no universal framework that would enable the **large-scale high-performance** web scraping and crawling of any website. **Until now!**',image: imgUrl('javascript_logo.svg'),imageAlign: 'top',title: 'Runs on JavaScript',@@ -145,8 +145,8 @@ const Features = () => (// style={{ textAlign: 'center' }}>// <h2>All the features you need are already included</h2>// <MarkdownBlock>-// We have built three different crawler classes for you so you can be up and running in no time.-// Do you need to crawl just plain HTML? Use our **blazing fast** [`CheerioCrawler`](examples/cheeriocrawler).+// We've built three different crawler classes for you so that you can be up and running in no time.+// Need to crawl plain HTML? Use our **blazing fast** [`CheerioCrawler`](examples/cheeriocrawler).//// For complex websites that use **React, Vue** and other front-end javascript libraries and require real-time manipulation,// spawn a headless browser with our [`PuppeteerCrawler`](examples/puppeteercrawler).@@ -165,8 +165,8 @@ const EasyCrawling = () => (<Block background="light" gridBlockAlign="left">{[{- content: 'There are three main class that you can use to start crawling web in no time. ' +- 'Do you need to crawl just the plain HTML? Use the **blazing fast** [`CheerioCrawler`](examples/cheeriocrawler).\n' ++ content: 'There are three main class that you can use to start crawling the web in no time. ' ++ 'Need to crawl plain HTML? Use the **blazing fast** [`CheerioCrawler`](examples/cheeriocrawler).\n' +'For complex websites that use **React**, **Vue** or other front-end javascript libraries and require JavaScript execution, ' +'spawn a headless browser with [`PuppeteerCrawler`](examples/puppeteercrawler).\n' +'To **control of all aspects** of your crawling, just use the bare bones [`BasicCrawler`](examples/basiccrawler)',@@ -184,7 +184,7 @@ const PowerfulTools = () => ({content: 'All the crawlers are automatically **scaled** based on available system resources using the [`AutoscaledPool`](docs/api/AutoscaledPool) class. ' +'When you run your code on the [Apify Cloud](https://my.apify.com/actors), you can also take advantage of a pool of **proxies** to avoid detection. ' +- 'For the data storage, you can use the [`Dataset`](docs/api/dataset) and [`Key-value store`](docs/api/keyvaluestore) classes.',+ 'For data storage, you can use the [`Dataset`](docs/api/dataset) and [`Key-value store`](docs/api/keyvaluestore) classes.',image: imgUrl('source_code.png'),imageAlign: 'left',title: 'Powerful tools',