Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update patch/minor dependencies (#4407)
renovate[bot] committed 3 days ago
1d0ae7c
chore(deps): dependency sweep (#4398)
apify-deps[bot] committed 6 days ago
a972548
7416673
1ef2a93
eb7b034
393ecd7
58f479b
ea28397
feat: Parallel sitemap discovery (#3571)
Baptiste Jamin committed 13 days ago
9b310c7
f810b35
640a7ba