Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Merge branch 'develop' into feature/copywriting-new
Jan Curnd79c749047ce
diff --cc README.mdindex 9216ae4f0,682b20200..d2d596d12--- a/README.md+++ b/README.md@@@ -124,8 -124,8 +124,8 @@@ The Apify SDK is available as the <a hr<li><a href="https://www.apify.com/docs/sdk/apify-runtime-js/latest#Dataset"><code>Dataset</code></a>- Provides a store for structured data and enables their- export to formats like JSON, JSONL, CSV, Excel or HTML.+ export to formats like JSON, JSONL, CSV, XML, Excel or HTML.- The data is stored on local filesystem or in the cloud.+ The data is stored on a local filesystem or in the cloud.Datasets are useful for storing and sharing large tabular crawling results,such as a list of products or real estate offers.</li>@@@ -246,7 -250,8 +250,7 @@@ and [Apify Actor](https://www.apify.com### Usage on the Apify cloud platformYou can also develop your web scraping project- in an online code editor directly on the Apify cloud. You'll need to have an Apify account.-in an online code editor directly on the [Apify cloud platform](https://www.apify.com).-You'll need to have an Apify Account.++in an online code editor directly on the Apify cloud. You'll need to have an Apify Account.Go to [Actors](https://my.apify.com/actors)page in the app, click <i>Create new</i> and then go to the<i>Source</i> tab and start writing your code or paste one of the code examples below.