Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
32d97a6
chore(release): v3.11.2
Apify Release Bot committed 2 years ago
9d0a588
chore: update dev dependencies (#2642)
Martin Adámek committed 2 years ago
9123201
docs: video-embed (#2639)
Saurav Jain committed 2 years ago
9c21e35
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
b6c0753
docs: add infinite scroll blog (#2636)
Saurav Jain committed 2 years ago
893c918
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
9531fe1
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
6ea1105
chore(deps): update dependency jsdom to v25 (#2632)
renovate[bot] committed 2 years ago
90cce2d
fa6bb09
b5fd3a9
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
23155ae
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
400af91
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
abaebf9
docs: add blog (#2625)
Saurav Jain committed 2 years ago
65fc347
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
c862ab8
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
0d04a5d
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c86bae6
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
e49bec7
docs: remove duplicated `the` in AutoscaledPool (#2624)
Ikko Eltociear Ashimine committed 2 years ago
d9a3877
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
7fc1ca2
feat: resilient sitemap loading (#2619)
Jindřich Bär committed 2 years ago
1dd7660
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
2815de1
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
df0a99d
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
9138268
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
4c09eef
a5f7ce0
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
ccb52fd