Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
chore(deps): update dependency @types/node to v16 (#1220)
591bcdf renovate[bot] committed 5 years ago
chore(deps): update amannn/action-semantic-pull-request action to v3.4.6
c6180d5 Renovate Bot committed 5 years ago
chore(deps): update amannn/action-semantic-pull-request action to v3.4.5
2272603 Renovate Bot committed 5 years ago
chore(deps): update amannn/action-semantic-pull-request action to v3.4.4
9527874 Renovate Bot committed 5 years ago
chore(deps): update dependency ua-parser-js to v1 (#1219)
0b2fd6e renovate[bot] committed 5 years ago
fix: only provide Cookie header if cookies are present (#1218)
cfdcbcb Vlad Frangu committed 5 years ago