Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
<svg width="20" height="20" viewBox="0 0 20 20" fill="none" xmlns="http://www.w3.org/2000/svg">
<path d="M6.66602 10.0003C6.66602 10.8844 7.0172 11.7322 7.64233 12.3573C8.26745 12.9825 9.11529 13.3337 9.99935 13.3337C10.8834 13.3337 11.7313 12.9825 12.3564 12.3573C12.9815 11.7322 13.3327 10.8844 13.3327 10.0003C13.3327 9.11627 12.9815 8.26842 12.3564 7.6433C11.7313 7.01818 10.8834 6.66699 9.99935 6.66699C9.11529 6.66699 8.26745 7.01818 7.64233 7.6433C7.0172 8.26842 6.66602 9.11627 6.66602 10.0003Z" stroke="#555D76" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/>
<path d="M2.5 10H3.33333M10 2.5V3.33333M16.6667 10H17.5M10 16.6667V17.5M4.66667 4.66667L5.25 5.25M15.3333 4.66667L14.75 5.25M14.75 14.75L15.3333 15.3333M5.25 14.75L4.66667 15.3333" stroke="#555D76" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"/>
</svg>