Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Don't displaying errors when instance is killed for reason (#42)

Marek Trunkát96711a2e78ef
diff --git a/src/puppeteer_pool.js b/src/puppeteer_pool.js
index bd1c06f8a..65a8b9618 100644
--- a/src/puppeteer_pool.js
+++ b/src/puppeteer_pool.js
@@ -148,7 +148,8 @@ export default class PuppeteerPool {
.browserPromise
.then((browser) => {
browser.on('disconnected', () => {
- log.error('PuppeteerPool: Puppeteer sent "disconnect" event. Crashed???', { id });
+ // If instance.killed === true then we killed the instance so don't log it.
+ if (!instance.killed) log.error('PuppeteerPool: Puppeteer sent "disconnect" event. Crashed???', { id });
this._retireInstance(instance);
});
// This one is done manually in Puppeteerpool.newPage() to happen immediately.