Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated docs
Jan Curn49250ff65cf4
diff --git a/src/events.js b/src/events.jsindex 6433a18b0..ba463ee4f 100644--- a/src/events.js+++ b/src/events.js@@ -79,6 +79,9 @@ let persistStateInterval = null;* their state, in order to avoid repeating all work when the actor restarts.* This event is automatically emitted together with the <code>migrating</code> event,* in which case the <code>isMigrating</code> flag is set to <code>true</code>. Otherwise the flag is <code>false</code>.+ * <br><br>+ * Note that the <code>persistState</code> event is provided merely for user convenience,+ * you can achieve the same effect using `setInterval()` and listening for the `migrating` event.* </td>* </tr>* </tbody>