Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Increasing version
Marek Trunkat committed 9 years ago
b3ea7e4
Adding publishing script
Marek Trunkat committed 9 years ago
77ebd7a
Adding baseUrl to ApifierClient opts
Marek Trunkat committed 9 years ago
cd8bb34
Changed comments in .npmignore
Jan Curn committed 9 years ago
2b04d89
40ad2e5
Increasing version
Marek Trunkat committed 9 years ago
81866b2
Adding postpublish hook to autotag repo
Marek Trunkat committed 9 years ago
9aa2241
cbca397
Bumped NPM package version
Jan Curn committed 9 years ago
75ebda6
Added debug log message
Jan Curn committed 9 years ago
8e75e60
Added logging of process exit code
Jan Curn committed 9 years ago
6674e64
Bumped package.json version
Jan Curn committed 9 years ago
0ad4902
b5d7db1
Bumped package.json version
Jan Curn committed 9 years ago
dd5a77a
Added Apifier.events EventEmitter
Jan Curn committed 9 years ago
bb58759
Udpated README.md
Jan Curn committed 9 years ago
499fc5a
Updated README.md
Jan Curn committed 9 years ago
9e65674
Updated README.md
Jan Curn committed 9 years ago
03e836a
Added unit tests for Apifier.main() output
Jan Curn committed 9 years ago
99e92cd
176308c
Fixed lint errors
Jan Curn committed 9 years ago
351ac8c