Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Fixed lint errors
Jan Curn committed 9 years ago
9d3f5e3
Merge branch 'master' into develop
Jan Curn committed 9 years ago
be2dd2a
Bumped package.json version
Jan Curn committed 9 years ago
62f51b4
eed3971
Rmeoving rawBody parameter
Marek Trunkat committed 9 years ago
ca0f734
Bumped package.json version
Jan Curn committed 9 years ago
414245e
22ef915
Increasing version number
Marek Trunkat committed 9 years ago
aec3812
Making 'opts' optional parameter
Marek Trunkat committed 9 years ago
e4f683f
Bumped package.json version
Jan Curn committed 9 years ago
4da13b4
Changing signature of Apify.call()
Marek Trunkat committed 9 years ago
e89e999
Bumped package.json version
Jan Curn committed 9 years ago
1586bd7
Fixed jsdoc
Jan Curn committed 9 years ago
a28748c
Updated README.md
Jan Curn committed 9 years ago
e65bab9
Merge pull request #9 from Apifier/feature/jsdoc
Jan Čurn committed 9 years ago
91ee872
fix in comments
JakubDrobnik committed 9 years ago
68f5cda
Merge branch 'develop' into feature/jsdoc
JakubDrobnik committed 9 years ago
82f1099
init generating docs with jsdoc
JakubDrobnik committed 9 years ago
dfc7ce7
Updated README.md
Jan Curn committed 9 years ago
e559d68
Updated comments
Jan Curn committed 9 years ago
4b2772f
Updated comments
Jan Curn committed 9 years ago
dcbae67
Increasing version number
Marek Trunkat committed 9 years ago
d11adfc
94f625a
Adding test for content type charset auto setting
Marek Trunkat committed 9 years ago
5f33390
a316b10