Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

docs: new blog and minor changes (#2665)
Saurav Jain committed 2 years ago
3e6600b
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
f3eb99d
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
6e934e6
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
d34e4e1
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
0a863ef
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
b9fc6b1
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
e182710
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
02847d4
chore(release): v3.11.3
Apify Release Bot committed 2 years ago
ab52f9e
5feca1b
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
3b1116e
docs: add intercom messenger (#2651)
Daniel Wébr committed 2 years ago
2812ed9
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
d5b7d16
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
3253247
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
da9748c
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
5c105f4
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
07ddd79
chore(deps): update patch/minor dependencies (#2557)
renovate[bot] committed 2 years ago
242849e
chore: update playwright to 1.46 (#2644)
Martin Adámek committed 2 years ago
0c844dc
chore: formatting
Martin Adámek committed 2 years ago
1f4b986
chore: ignore docusaurus dependency updates
Martin Adámek committed 2 years ago
71874e1
chore: ignore dependency updates of cheerio
Martin Adámek committed 2 years ago
016e159
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
c69a34a
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
6c7ad1c
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
3ffcf56