Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
Merge branch 'develop' of github.com:apifytech/apify-js into develop
0ffe73b Ondra Urban committed 7 years ago
Merge pull request #349 from apifytech/fix/eslint-no-undef
72f3b64 Ondra Urban committed 7 years ago
Merge pull request #352 from apifytech/feature/add_webhook_fix
ffd6f44 Ondra Urban committed 7 years ago
Merge pull request #344 from apifytech/feature/create_webhook
8bcfa71 Ondra Urban committed 7 years ago