Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Update apifytech org to apify

Ondra Urbanfb0754e35dd9
diff --git a/README.md b/README.md
index c7baeb737..932e38256 100644
--- a/README.md
+++ b/README.md
@@ -24,8 +24,7 @@ eventually things will get complicated. For example, when you try to:
- Perform a deep crawl of an entire website using a persistent queue of URLs.
- Run your scraping code on a list of 100k URLs in a CSV file, without losing any data when your code crashes.
-- Rotate proxies to hide your browser origin.
-- Schedule the code to run periodically and send notification on errors.
+- Rotate proxies to hide your browser origin and keep user-like sessions.
- Disable browser fingerprinting protections used by websites.
Python has [Scrapy](https://scrapy.org/) for these tasks, but there was no such library for **JavaScript, the language of
@@ -139,7 +138,7 @@ By default, Apify SDK stores data to `./apify_storage` in the current working di
### Local usage with Apify command-line interface (CLI)
To avoid the need to set the environment variables manually, to create a boilerplate of your project, and to enable pushing and running your code on
-the [Apify Cloud](https://apify.com), you can use the [Apify command-line interface (CLI)](https://github.com/apifytech/apify-cli) tool.
+the [Apify platform](/docs/guides/apify-platform), you can use the [Apify command-line interface (CLI)](https://github.com/apify/apify-cli) tool.
Install the CLI by running:
@@ -166,7 +165,7 @@ apify run
By default, the crawling data will be stored in a local directory at `./apify_storage`. For example, the input JSON file for the actor is expected to
be in the default key-value store in `./apify_storage/key_value_stores/default/INPUT.json`.
-Now you can easily deploy your code to the Apify Cloud by running:
+Now you can easily deploy your code to the Apify platform by running:
```bash
apify login
@@ -176,12 +175,12 @@ apify login
apify push
```
-Your script will be uploaded to the Apify Cloud and built there so that it can be run. For more information, view the
+Your script will be uploaded to the Apify platform and built there so that it can be run. For more information, view the
[Apify Actor](https://docs.apify.com/cli) documentation.
-### Usage on the Apify Cloud
+### Usage on the Apify platform
-You can also develop your web scraping project in an online code editor directly on the [Apify Cloud](https://apify.com/).
+You can also develop your web scraping project in an online code editor directly on the [Apify platform](https://sdk.apify.com/docs/guides/apify-platform).
You'll need to have an Apify Account. Go to [Actors](https://my.apify.com/actors), page in the app, click <i>Create new</i>
and then go to the <i>Source</i> tab and start writing your code or paste one of the examples from the Examples section.
@@ -189,7 +188,7 @@ For more information, view the [Apify actors quick start guide](https://docs.api
## Support
-If you find any bug or issue with the Apify SDK, please [submit an issue on GitHub](https://github.com/apifytech/apify-js/issues).
+If you find any bug or issue with the Apify SDK, please [submit an issue on GitHub](https://github.com/apify/apify-js/issues).
For questions, you can ask on [Stack Overflow](https://stackoverflow.com/questions/tagged/apify) or contact [email protected]
## Contributing
@@ -197,12 +196,12 @@ For questions, you can ask on [Stack Overflow](https://stackoverflow.com/questio
Your code contributions are welcome and you'll be praised to eternity!
If you have any ideas for improvements, either submit an issue or create a pull request.
For contribution guidelines and the code of conduct,
-see [CONTRIBUTING.md](https://github.com/apifytech/apify-js/blob/master/CONTRIBUTING.md).
+see [CONTRIBUTING.md](https://github.com/apify/apify-js/blob/master/CONTRIBUTING.md).
## License
This project is licensed under the Apache License 2.0 -
-see the [LICENSE.md](https://github.com/apifytech/apify-js/blob/master/LICENSE.md) file for details.
+see the [LICENSE.md](https://github.com/apify/apify-js/blob/master/LICENSE.md) file for details.
## Acknowledgments
diff --git a/docs/guides/apify_platform.md b/docs/guides/apify_platform.md
index 148a1e9a2..4803d94e2 100644
--- a/docs/guides/apify_platform.md
+++ b/docs/guides/apify_platform.md
@@ -20,7 +20,7 @@ runnable locally or on any cloud infrastructure.
## Logging into Apify platform from Apify SDK
To access your [Apify account](https://my.apify.com/sign-up) from the SDK, you must provide
credentials - [your API token](https://my.apify.com/account#/integrations). You can do that
-either by utilizing [Apify CLI](https://github.com/apifytech/apify-cli) or by environment
+either by utilizing [Apify CLI](https://github.com/apify/apify-cli) or by environment
variables.
Once you provide credentials to your scraper, you will be able to use all the Apify platform
diff --git a/docs/guides/environment_variables.md b/docs/guides/environment_variables.md
index 82a6313d6..d12bbe39a 100644
--- a/docs/guides/environment_variables.md
+++ b/docs/guides/environment_variables.md
@@ -5,7 +5,7 @@ title: Environment Variables
The following is a list of the environment variables used by Apify SDK that are available to the user.
The SDK is capable of running without any env vars present, but certain features will only become available
-after env vars are properly set. You can use [Apify CLI](https://github.com/apifytech/apify-cli)
+after env vars are properly set. You can use [Apify CLI](https://github.com/apify/apify-cli)
to set the env vars for you. [Apify platform](/docs/guides/apify-platform) also sets the variables automatically.
## Important env vars:
diff --git a/docs/guides/quick_start.md b/docs/guides/quick_start.md
index 5f6274a2b..7a7748660 100644
--- a/docs/guides/quick_start.md
+++ b/docs/guides/quick_start.md
@@ -57,7 +57,7 @@ By default, Apify SDK stores data to `./apify_storage` in the current working di
## Local usage with Apify command-line interface (CLI)
To avoid the need to set the environment variables manually, to create a boilerplate of your project, and to enable pushing and running your code on
-the [Apify platform](/docs/guides/apify-platform), you can use the [Apify command-line interface (CLI)](https://github.com/apifytech/apify-cli) tool.
+the [Apify platform](/docs/guides/apify-platform), you can use the [Apify command-line interface (CLI)](https://github.com/apify/apify-cli) tool.
Install the CLI by running:
diff --git a/docs/readme/support.md b/docs/readme/support.md
index 8232aac37..600c1af34 100644
--- a/docs/readme/support.md
+++ b/docs/readme/support.md
@@ -1,6 +1,6 @@
## Support
-If you find any bug or issue with the Apify SDK, please [submit an issue on GitHub](https://github.com/apifytech/apify-js/issues).
+If you find any bug or issue with the Apify SDK, please [submit an issue on GitHub](https://github.com/apify/apify-js/issues).
For questions, you can ask on [Stack Overflow](https://stackoverflow.com/questions/tagged/apify) or contact [email protected]
## Contributing
@@ -8,12 +8,12 @@ For questions, you can ask on [Stack Overflow](https://stackoverflow.com/questio
Your code contributions are welcome and you'll be praised to eternity!
If you have any ideas for improvements, either submit an issue or create a pull request.
For contribution guidelines and the code of conduct,
-see [CONTRIBUTING.md](https://github.com/apifytech/apify-js/blob/master/CONTRIBUTING.md).
+see [CONTRIBUTING.md](https://github.com/apify/apify-js/blob/master/CONTRIBUTING.md).
## License
This project is licensed under the Apache License 2.0 -
-see the [LICENSE.md](https://github.com/apifytech/apify-js/blob/master/LICENSE.md) file for details.
+see the [LICENSE.md](https://github.com/apify/apify-js/blob/master/LICENSE.md) file for details.
## Acknowledgments
diff --git a/src/crawlers/basic_crawler.js b/src/crawlers/basic_crawler.js
index 6bf8d4fcc..c2327b4c5 100644
--- a/src/crawlers/basic_crawler.js
+++ b/src/crawlers/basic_crawler.js
@@ -80,7 +80,7 @@ const SAFE_MIGRATION_WAIT_MILLIS = 20000;
* represents the last error thrown during processing of the request.
*
* See
- * [source code](https://github.com/apifytech/apify-js/blob/master/src/crawlers/basic_crawler.js#L11)
+ * [source code](https://github.com/apify/apify-js/blob/master/src/crawlers/basic_crawler.js#L11)
* for the default implementation of this function.
* @property {number} [maxRequestRetries=3]
* Indicates how many times the request is retried if {@link BasicCrawlerOptions.handleRequestFunction} fails.
diff --git a/src/crawlers/cheerio_crawler.js b/src/crawlers/cheerio_crawler.js
index 78d6dc11e..d82887fe5 100644
--- a/src/crawlers/cheerio_crawler.js
+++ b/src/crawlers/cheerio_crawler.js
@@ -153,7 +153,7 @@ const DEFAULT_AUTOSCALED_POOL_OPTIONS = {
* where the {@link Request} instance corresponds to the failed request, and the `Error` instance
* represents the last error thrown during processing of the request.
*
- * See [source code](https://github.com/apifytech/apify-js/blob/master/src/crawlers/cheerio_crawler.js#L13)
+ * See [source code](https://github.com/apify/apify-js/blob/master/src/crawlers/cheerio_crawler.js#L13)
* for the default implementation of this function.
* @property {string[]} [additionalMimeTypes]
* An array of <a href="https://developer.mozilla.org/en-US/docs/Web/HTTP/Basics_of_HTTP/MIME_types/Complete_list_of_MIME_types"
diff --git a/src/crawlers/puppeteer_crawler.js b/src/crawlers/puppeteer_crawler.js
index ddefc86da..31bf1819d 100644
--- a/src/crawlers/puppeteer_crawler.js
+++ b/src/crawlers/puppeteer_crawler.js
@@ -107,7 +107,7 @@ import { ProxyConfiguration } from '../proxy_configuration';
* Overrides the default function to launch a new Puppeteer instance.
* Shortcut to the corresponding {@link PuppeteerPool} option.
* See source code on
- * [GitHub](https://github.com/apifytech/apify-js/blob/master/src/puppeteer_pool.js#L28)
+ * [GitHub](https://github.com/apify/apify-js/blob/master/src/puppeteer_pool.js#L28)
* for default behavior.
* @property {LaunchPuppeteerOptions} [launchPuppeteerOptions]
* Options used by {@link Apify#launchPuppeteer} to start new Puppeteer instances.
diff --git a/src/proxy_configuration.js b/src/proxy_configuration.js
index bfd7b822c..3631a7480 100644
--- a/src/proxy_configuration.js
+++ b/src/proxy_configuration.js
@@ -30,7 +30,7 @@ const MAX_SESSION_ID_LENGTH = 50;
* an IP address from a random country. The country code needs to be a two letter ISO country code. See the
* [full list of available country codes](https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2#Officially_assigned_code_elements).
* This parameter is optional, by default, the proxy uses all available proxy servers from all countries.
- * on the Apify cloud, or when using the [Apify CLI](https://github.com/apifytech/apify-cli).
+ * on the Apify cloud, or when using the [Apify CLI](https://github.com/apify/apify-cli).
* @property {string[]} [apifyProxyGroups]
* Same option as `groups` which can be used to
* configurate the proxy by UI input schema. You should use the `groups` option in your crawler code.
@@ -98,7 +98,7 @@ const MAX_SESSION_ID_LENGTH = 50;
* @property {string} password
* User's password for the proxy. By default, it is taken from the `APIFY_PROXY_PASSWORD`
* environment variable, which is automatically set by the system when running the actors
- * on the Apify cloud, or when using the [Apify CLI](https://github.com/apifytech/apify-cli).
+ * on the Apify cloud, or when using the [Apify CLI](https://github.com/apify/apify-cli).
* @property {string} hostname
* Hostname of your proxy.
* @property {string} port
diff --git a/src/utils_request.js b/src/utils_request.js
index 9abb43f79..fbfe0c5e1 100644
--- a/src/utils_request.js
+++ b/src/utils_request.js
@@ -77,7 +77,7 @@ const DEFAULT_HTTP_REQUEST_OPTIONS = {
* Currently, the function sends requests the same way as Firefox web browser does.
* In the future, it might add support for other browsers too.
*
- * Internally, the function uses httpRequest function from the [@apify/httpRequest](https://github.com/apifytech/http-request)
+ * Internally, the function uses httpRequest function from the [@apify/httpRequest](https://github.com/apify/http-request)
* NPM package to perform the request.
* All `options` not recognized by this function are passed to it,
* so see it for more details.
diff --git a/src/utils_social.js b/src/utils_social.js
index 617b2b4e7..70a9b5848 100644
--- a/src/utils_social.js
+++ b/src/utils_social.js
@@ -132,7 +132,7 @@ const SKIP_PHONE_REGEX = new RegExp(`^(${SKIP_PHONE_REGEXS.join('|')})$`, 'i');
/**
* The function attempts to extract phone numbers from a text. Please note that
* the results might not be accurate, since phone numbers appear in a large variety of formats and conventions.
- * If you encounter some problems, please [file an issue](https://github.com/apifytech/apify-js/issues).
+ * If you encounter some problems, please [file an issue](https://github.com/apify/apify-js/issues).
* @param {string} text Text to search the phone numbers in.
* @return {string[]} Array of phone numbers found.
* If no phone numbers are found, the function returns an empty array.
diff --git a/website/pages/en/index.js b/website/pages/en/index.js
index 37ce27887..b720ccfac 100755
--- a/website/pages/en/index.js
+++ b/website/pages/en/index.js
@@ -92,7 +92,7 @@ class HomeSplash extends React.Component {
className="github-button"
href={this.props.config.repoUrl}
data-icon="octicon-star"
- data-count-href="/apifytech/apify-js/stargazers"
+ data-count-href="/apify/apify-js/stargazers"
data-show-count="true"
data-count-aria-label="# stargazers on GitHub"
aria-label="Star Apify SDK on GitHub">
diff --git a/website/siteConfig.js b/website/siteConfig.js
index 6d02ab33d..73465ad16 100644
--- a/website/siteConfig.js
+++ b/website/siteConfig.js
@@ -21,7 +21,7 @@
// ];
const extlink = require('remarkable-extlink');
-const repoUrl = 'https://github.com/apifytech/apify-js';
+const repoUrl = 'https://github.com/apify/apify-js';
const siteConfig = {
title: 'Apify SDK', // Title for your website.
@@ -38,7 +38,7 @@ const siteConfig = {
// Used for publishing and more
projectName: 'apify-js',
- organizationName: 'apifytech',
+ organizationName: 'apify',
// For top-level user or org sites, the organization is still the same.
// e.g., for the https://JoelMarcey.github.io site, it would be set like...
// organizationName: 'JoelMarcey'
diff --git a/website/tools/build_docs.js b/website/tools/build_docs.js
index 0ca7bd11b..40624affa 100644
--- a/website/tools/build_docs.js
+++ b/website/tools/build_docs.js
@@ -11,7 +11,7 @@ const { readStreamToString } = require('apify-shared/streams_utilities'); // es
const BASE_URL = '/docs';
const DOCS_DIR = path.join(__dirname, '..', '..', 'docs');
const EXAMPLES_DIR_NAME = path.join(DOCS_DIR, 'examples');
-const EXAMPLES_REPO = 'https://api.github.com/repos/apifytech/actor-templates/contents/dist/examples';
+const EXAMPLES_REPO = 'https://api.github.com/repos/apify/actor-templates/contents/dist/examples';
const classNames = [];