Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
6bceb04
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
13d5f18
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c199545
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
cbe1566
chore(deps): update dependency puppeteer to v21.6.1
renovate[bot] committed 2 years ago
b6fdad0
f6b7e28
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
3b8340c
chore(deps): update dependency turbo to v1.11.2
renovate[bot] committed 2 years ago
2cb3dd9
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
544714f
b2da45f
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
083d535
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
70ae972
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
6f63c96
docs: set fixed width for short docs articles (#2227)
Jindřich Bär committed 2 years ago
5758c17
b6ece5a
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
be3ab54
chore(deps): update dependency turbo to v1.11.1
renovate[bot] committed 2 years ago
befa5bf
chore(deps): update vitest monorepo to v1 (#2218)
renovate[bot] committed 2 years ago
47e2469
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
59214fd
chore(deps): update dependency typescript to v5.3.3
renovate[bot] committed 2 years ago
b4301bc
chore(deps): update dependency puppeteer to v21.6.0
renovate[bot] committed 2 years ago
01b52a2
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
afa1fa8
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
3aa30ad
chore(deps): update dependency turbo to v1.11.0
renovate[bot] committed 2 years ago
acf5532
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
20c4e06
ee1cf6a
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
2718ef6
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
fad300b