Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Updated docs

Jan Curn863fcc293171
diff --git a/docs/api/social.md b/docs/api/social.md
index 4e7bd4d5f..0eada551e 100644
--- a/docs/api/social.md
+++ b/docs/api/social.md
@@ -17,8 +17,6 @@ const emails = Apify.utils.social.emailsFromText('[email protected] bob@example.
* [`social`](#social) : <code>object</code>
- * [`.EMAIL_REGEX`](#social.EMAIL_REGEX) : <code>RegExp</code>
- * [`.EMAIL_REGEX_GLOBAL`](#social.EMAIL_REGEX_GLOBAL) : <code>RegExp</code>
* [`.LINKEDIN_REGEX`](#social.LINKEDIN_REGEX) : <code>RegExp</code>
* [`.LINKEDIN_REGEX_GLOBAL`](#social.LINKEDIN_REGEX_GLOBAL) : <code>RegExp</code>
* [`.INSTAGRAM_REGEX`](#social.INSTAGRAM_REGEX) : <code>RegExp</code>
@@ -27,26 +25,16 @@ const emails = Apify.utils.social.emailsFromText('[email protected] bob@example.
* [`.TWITTER_REGEX_GLOBAL`](#social.TWITTER_REGEX_GLOBAL) : <code>RegExp</code>
* [`.FACEBOOK_REGEX`](#social.FACEBOOK_REGEX) : <code>RegExp</code>
* [`.FACEBOOK_REGEX_GLOBAL`](#social.FACEBOOK_REGEX_GLOBAL) : <code>RegExp</code>
+ * [`.EMAIL_REGEX`](#social.EMAIL_REGEX) : <code>RegExp</code>
+ * [`.EMAIL_REGEX_GLOBAL`](#social.EMAIL_REGEX_GLOBAL) : <code>RegExp</code>
* [`.emailsFromText(text)`](#social.emailsFromText) ⇒ <code>Array&lt;String&gt;</code>
* [`.emailsFromUrls(urls)`](#social.emailsFromUrls) ⇒ <code>Array&lt;String&gt;</code>
* [`.phonesFromText(text)`](#social.phonesFromText) ⇒ <code>Array&lt;String&gt;</code>
* [`.phonesFromUrls(urls)`](#social.phonesFromUrls) ⇒ <code>Array&lt;String&gt;</code>
-<a name="social.EMAIL_REGEX"></a>
-
-## `social.EMAIL_REGEX` : <code>RegExp</code>
-Regular expression to exactly match a single email address.
-It has the following form: `/^...$/i`.
-
-<a name="social.EMAIL_REGEX_GLOBAL"></a>
-
-## `social.EMAIL_REGEX_GLOBAL` : <code>RegExp</code>
-Regular expression to find multiple email addresses in a text.
-It has the following form: `/.../ig`.
-
<a name="social.LINKEDIN_REGEX"></a>
-## `social.LINKEDIN_REGEX` : <code>RegExp</code>
+## `social.LINKEDIN\_REGEX` : <code>RegExp</code>
Regular expression to exactly match a single LinkedIn profile URL, without any additional
subdirectories or query parameters. The regular expression has the following form: `/^...$/i`.
@@ -57,46 +45,58 @@ TODO
<a name="social.LINKEDIN_REGEX_GLOBAL"></a>
-## `social.LINKEDIN_REGEX_GLOBAL` : <code>RegExp</code>
+## `social.LINKEDIN\_REGEX\_GLOBAL` : <code>RegExp</code>
Regular expression to find multiple LinkedIn profile URLs in a text.
It has the following form: `/.../ig`.
<a name="social.INSTAGRAM_REGEX"></a>
-## `social.INSTAGRAM_REGEX` : <code>RegExp</code>
+## `social.INSTAGRAM\_REGEX` : <code>RegExp</code>
Regular expression to exactly match a single Instagram profile URL.
It has the following form: `/^...$/i`.
<a name="social.INSTAGRAM_REGEX_GLOBAL"></a>
-## `social.INSTAGRAM_REGEX_GLOBAL` : <code>RegExp</code>
+## `social.INSTAGRAM\_REGEX\_GLOBAL` : <code>RegExp</code>
Regular expression to find multiple Instagram profile URLs in a text.
It has the following form: `/.../ig`.
<a name="social.TWITTER_REGEX"></a>
-## `social.TWITTER_REGEX` : <code>RegExp</code>
+## `social.TWITTER\_REGEX` : <code>RegExp</code>
Regular expression to exactly match a single Instagram profile URL.
It has the following form: `/^...$/i`.
<a name="social.TWITTER_REGEX_GLOBAL"></a>
-## `social.TWITTER_REGEX_GLOBAL` : <code>RegExp</code>
+## `social.TWITTER\_REGEX\_GLOBAL` : <code>RegExp</code>
Regular expression to find multiple Instagram profile URLs in a text.
It has the following form: `/.../ig`.
<a name="social.FACEBOOK_REGEX"></a>
-## `social.FACEBOOK_REGEX` : <code>RegExp</code>
+## `social.FACEBOOK\_REGEX` : <code>RegExp</code>
Regular expression to exactly match a single Facebook user profile URL.
It has the following form: `/^...$/i`.
<a name="social.FACEBOOK_REGEX_GLOBAL"></a>
-## `social.FACEBOOK_REGEX_GLOBAL` : <code>RegExp</code>
+## `social.FACEBOOK\_REGEX\_GLOBAL` : <code>RegExp</code>
Regular expression to find multiple Instagram profile URLs in a text.
It has the following form: `/.../ig`.
+<a name="social.EMAIL_REGEX"></a>
+
+## `social.EMAIL\_REGEX` : <code>RegExp</code>
+Regular expression to exactly match a single email address.
+It has the following form: `/^...$/i`.
+
+<a name="social.EMAIL_REGEX_GLOBAL"></a>
+
+## `social.EMAIL\_REGEX\_GLOBAL` : <code>RegExp</code>
+Regular expression to find multiple email addresses in a text.
+It has the following form: `/.../ig`.
+
<a name="social.emailsFromText"></a>
## `social.emailsFromText(text)` ⇒ <code>Array&lt;String&gt;</code>
diff --git a/docs/api/utils.md b/docs/api/utils.md
index 2dd1421fb..f1abe4c24 100644
--- a/docs/api/utils.md
+++ b/docs/api/utils.md
@@ -28,13 +28,13 @@ await Apify.utils.sleep(1500);
<a name="utils.URL_NO_COMMAS_REGEX"></a>
-## `utils.URL_NO_COMMAS_REGEX`
+## `utils.URL\_NO\_COMMAS\_REGEX`
Default regular expression to match URLs in a string that may be plain text, JSON, CSV or other. It supports common URL characters
and does not support URLs containing commas or spaces. The URLs also may contain Unicode letters (not symbols).
<a name="utils.URL_WITH_COMMAS_REGEX"></a>
-## `utils.URL_WITH_COMMAS_REGEX`
+## `utils.URL\_WITH\_COMMAS\_REGEX`
Regular expression that, in addition to the default regular expression `URL_NO_COMMAS_REGEX`, supports matching commas in URL path and query.
Note, however, that this may prevent parsing URLs from comma delimited lists, or the URLs may become malformed.