Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
chore(release): update internal dependencies [skip ci]
c692fe5 Apify Release Bot committed 2 years ago
fix(core): ensure correct column order in CSV export (#2734)
b66784f Martin Adámek committed 2 years ago
chore(deps): update dependency @types/node to v22 (#2727)
0fb3224 renovate[bot] committed 2 years ago
fix: `.trim()` urls from pretty-printed sitemap.xml files (#2709)
802a6fe Jindřich Bär committed 2 years ago
chore(deps): update dependency eslint-plugin-react-hooks to v5 (#2706)
008522e renovate[bot] committed 2 years ago