Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
fix: log status message timeouts to debug level
Martin Adámek55ee44aaf5e7
diff --git a/packages/basic-crawler/src/internals/basic-crawler.ts b/packages/basic-crawler/src/internals/basic-crawler.tsindex c4c6c0ca9..f091ac212 100644--- a/packages/basic-crawler/src/internals/basic-crawler.ts+++ b/packages/basic-crawler/src/internals/basic-crawler.ts@@ -809,7 +809,7 @@ export class BasicCrawler<Context extends CrawlingContext = BasicCrawlingContextasync () => client.setStatusMessage!(message, options),1000,'Setting status message timed out after 1s',- ).catch((e) => this.log.warning(e.message));+ ).catch((e) => this.log.debug(e.message));}private getPeriodicLogger() {