Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
docs: fix linter
Martin Adámek36afcb84a536
diff --git a/packages/core/src/enqueue_links/enqueue_links.ts b/packages/core/src/enqueue_links/enqueue_links.tsindex 4fd1b89bf..68ea26e0e 100644--- a/packages/core/src/enqueue_links/enqueue_links.ts+++ b/packages/core/src/enqueue_links/enqueue_links.ts@@ -272,7 +272,8 @@ export async function enqueueLinks(options: EnqueueLinksOptions): Promise<BatchA* @internal* This method helps resolve the baseUrl that will be used for filtering in {@apilink enqueueLinks}.* - If a user provides a base url, we always return it- * - If a user specifies {@apilink EnqueueStrategy.All} strategy, they do not care if the newly found urls are on the original request domain, or a redirected one+ * - If a user specifies {@apilink EnqueueStrategy.All} strategy, they do not care if the newly found urls are on the original+ * request domain, or a redirected one* - In all other cases, we return the domain of the original request as that's the one we need to use for filtering*/export function resolveBaseUrlForEnqueueLinksFiltering({