Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Updated docs and README

Jan Curnc413f22b3aac
diff --git a/README.md b/README.md
index d2d596d12..2dfbeb3a8 100644
--- a/README.md
+++ b/README.md
@@ -265,7 +265,7 @@ It can run for a few seconds, hours or even infinitely.
An actor can perform anything from a simple action such as filling out a web form or sending an email,
to complex operations such as crawling an entire website and removing duplicates from a large dataset.
-To run an actor, you need to have an [Apify account](https://my.apify.com/).
+To run an actor, you need to have an [Apify Account](https://my.apify.com/).
Actors can be shared in the [Apify Library](https://www.apify.com/library?&type=acts)
so that other people can use them.
But don't worry, if you share your actor in the library
@@ -481,7 +481,7 @@ Apify.main(async () => {
requestList,
requestQueue,
- // Run Puppeteer in headless mode. If you headless to false, you'll see the scraping
+ // Run Puppeteer in headless mode. If you set headless to false, you'll see the scraping
// browsers showing up on your screen. This is great for debugging.
launchPuppeteerOptions: { headless: true },
@@ -607,7 +607,7 @@ Apify.main(async () => {
This example demonstrates how to load pages in headless Chrome / Puppeteer
over [Apify Proxy](https://www.apify.com/docs/proxy).
-To make it work, you'll need an Apify account
+To make it work, you'll need an Apify Account
that has access to the proxy.
The proxy password is available on the [Proxy](https://my.apify.com/proxy) page in the app.
Just set it to the `APIFY_PROXY_PASSWORD` environment variable
@@ -684,7 +684,7 @@ Apify.main(async () => {
html: `<h1>Kraken.com BTC</h1>${tradedPricesHtml}`,
});
- console.log('Email was sent. Good luck!');
+ console.log('Email sent. Good luck!');
});
```
diff --git a/examples/call_actor.js b/examples/call_actor.js
index 579b99a63..6609c81c1 100644
--- a/examples/call_actor.js
+++ b/examples/call_actor.js
@@ -6,7 +6,7 @@
* The script extracts the current Bitcoin prices from Kraken.com
* and sends them to your email using the [apify/send-mail](https://www.apify.com/apify/send-mail) actor.
*
- * To make the example work, you'll need an [Apify account](https://my.apify.com/).
+ * To make the example work, you'll need an [Apify Account](https://my.apify.com/).
* Go to [Account - Integrations](https://my.apify.com/account#/integrations) page to obtain your API token
* and set it to the `APIFY_TOKEN` environment variable, or run the script using the CLI.
* If you deploy this actor to the Apify platform then you can set up a scheduler for early
diff --git a/examples/puppeteer_proxy.js b/examples/puppeteer_proxy.js
index 9e66535fd..433ba5533 100644
--- a/examples/puppeteer_proxy.js
+++ b/examples/puppeteer_proxy.js
@@ -1,7 +1,7 @@
/**
* This example demonstrates how to load pages in headless Chrome / Puppeteer
* over [Apify Proxy](https://www.apify.com/docs/proxy).
- * To make it work, you'll need an Apify account
+ * To make it work, you'll need an Apify Account
* that has access to the proxy.
* The proxy password is available on the [Proxy](https://my.apify.com/proxy) page in the app.
* Just set it to the `APIFY_PROXY_PASSWORD` environment variable