Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Bumped package.json version
Jan Curn committed 9 years ago
29a7269
Testing apify-client@beta dependency
Jan Curn committed 9 years ago
739f17c
Upgraded NPM dependencies
Jan Curn committed 9 years ago
e9fec54
Fixed lint errors
Jan Curn committed 9 years ago
91cb62c
Development of support for proxies
Jan Curn committed 9 years ago
5f346fe
1175fe1
Updated README.md
Jan Curn committed 9 years ago
3436c2b
Development of .travis.yml, udpated unit tests
Jan Curn committed 9 years ago
b7456f3
Development of .travis.yml
Jan Curn committed 9 years ago
0193adb
Development of .travis.yml
Jan Curn committed 9 years ago
0083945
Development of .travis.yml
Jan Curn committed 9 years ago
e8e8776
Development of .travis.yml
Jan Curn committed 9 years ago
235b718
Development of .travis.yml
Jan Curn committed 9 years ago
39409fc
Increased timeout in unit tests
Jan Curn committed 9 years ago
e9b27f2
Development of .travis.yml, fixed unit tests
Jan Curn committed 9 years ago
a55c46b
Development of .travis.yml
Jan Curn committed 9 years ago
441840f
Development of .travis.yml
Jan Curn committed 9 years ago
2a339ba
Fixed .travis.yml, new comments
Jan Curn committed 9 years ago
ad9ff67
d1484ee
Updated .travis.yml
Jan Curn committed 9 years ago
1a6c5ca
Development of Chrome/Selenium integration
Jan Curn committed 9 years ago
91131e1
Fixed Lint error
Jan Curn committed 9 years ago
63149a8
5c55ed0
Increasing version
Marek Trunkat committed 9 years ago
07833e0