Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
Merge pull request #128 from apifytech/bug/kill-subprocess-sigint
8a0ddfd Marek Trunkát committed 8 years ago
Merge pull request #129 from apifytech/feature/live_view
72d10b0 Marek Trunkát committed 8 years ago
Merge pull request #125 from apifytech/bug/setvalue-invalid-characters
f3c4dcc Marek Trunkát committed 8 years ago
Merge pull request #127 from apifytech/feature/puppeteer-pool-retire
c8ec19e Marek Trunkát committed 8 years ago
Merge branch 'bug/setvalue-invalid-characters' of github.com:apifytech/apify-js into bug/setvalue-invalid-characters
87f3506 Ondra Urban committed 8 years ago
Merge pull request #126 from apifytech/bug/puppeteer-page-close
56a64b4 Marek Trunkát committed 8 years ago