Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Updated README
Jan Curn committed 8 years ago
63730e0
Updated README
Jan Curn committed 8 years ago
f52c16f
Updated README and docs
Jan Curn committed 8 years ago
221cff4
Updated README
Jan Curn committed 8 years ago
d358e82
Updated README
Jan Curn committed 8 years ago
0fa5494
Updated README
Jan Curn committed 8 years ago
c1f9727
Updated README and docs
Jan Curn committed 8 years ago
792d20d
Updated README
Jan Curn committed 8 years ago
b7dec10
Updated README
Jan Curn committed 8 years ago
5193998
Updated README
Jan Curn committed 8 years ago
7614055
Updated README
Jan Curn committed 8 years ago
f926039
Updated README and docs
Jan Curn committed 8 years ago
5744f65
Updated README and docs
Jan Curn committed 8 years ago
38f451c
Updated README
Jan Curn committed 8 years ago
6f57fb5
Updated README
Jan Curn committed 8 years ago
3641f56
Updated README
Jan Curn committed 8 years ago
12e7d0e
Updated README
Jan Curn committed 8 years ago
54ad31c
Updated README
Jan Curn committed 8 years ago
4b6ca11
Updated README
Jan Curn committed 8 years ago
099c50f
Updated README
Jan Curn committed 8 years ago
09e1682
Version bump
Marek Trunkat committed 8 years ago
aa05577
Merge pull request #161 from apifytech/feature/env_vars
Marek Trunkát committed 8 years ago
8e2548a
Fixing typo
Marek Trunkat committed 8 years ago
73a2f5f
README - enaming emulation dir to storage dir
Marek Trunkat committed 8 years ago
7ab9ff3
Merging develop
Marek Trunkat committed 8 years ago
b7d26b8
923bd3d
2e486d7
Merging develop
Marek Trunkat committed 8 years ago
8fc3c8c