Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
ca42fbe
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
0c0fc00
chore(deps): lock file maintenance (#2788)
renovate[bot] committed 1 year ago
9ea3bd8
chore(deps): update node.js to v22.13.0
renovate[bot] committed 1 year ago
86f7f3f
chore: update docusaurus to v3.7 (#2796)
Martin Adámek committed 1 year ago
ba27233
f912b8b
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
4b4b4dc
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
137f5ba
chore(deps): update yarn to v4.6.0
renovate[bot] committed 1 year ago
f09e3ed
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
b0bf30c
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
482bc34
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
11c9ad2
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
a79ca16
docs: add gmaps scraping blog (#2772)
Saurav Jain committed 1 year ago
3aeb014
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
0f2039b
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
58d3e49
fix(core): type definition of Dataset.reduce (#2774)
Erik Funder Carstensen committed 1 year ago
59bc6d1
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
49044d4
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
668bd2a
chore(deps): update dependency puppeteer to v23.11.1
renovate[bot] committed 1 year ago
bc3b98d
chore(docker): update docker state [skip ci]
Apify Release Bot committed 1 year ago
9a6e5f3
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
d184453
chore(deps): update dependency puppeteer to v23.11.0
renovate[bot] committed 1 year ago
e1785b7
chore(docker): update docker state [skip ci]
Apify Release Bot committed 1 year ago
41a9a0d
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
6bc4d75
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
fdd895e
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
c535141
chore(deps): update dependency is-ci to v4 (#2769)
renovate[bot] committed 1 year ago
ae6046d