Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Improved ProxyConfiguration.newUrl() docs (#887)

Jan Čurn57b1b9a02dbb
diff --git a/src/proxy_configuration.js b/src/proxy_configuration.js
index 6ca334d2a..6932e7f07 100644
--- a/src/proxy_configuration.js
+++ b/src/proxy_configuration.js
@@ -255,7 +255,8 @@ export class ProxyConfiguration {
* All the HTTP requests going through the proxy with the same session identifier
* will use the same target proxy server (i.e. the same IP address).
* The identifier must not be longer than 50 characters and include only the following: `0-9`, `a-z`, `A-Z`, `"."`, `"_"` and `"~"`.
- * @return {string} represents the proxy URL.
+ * @return {string} A string with a proxy URL, including authentication credentials and port number.
+ * For example, `http://bob:[email protected]:8000`
*/
newUrl(sessionId) {
if (typeof sessionId === 'number') sessionId = `${sessionId}`;