Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

fix the merge formating.
Petr Patek committed 6 years ago
bbd9af9
1273c13
0235036
builded docs.
Petr Patek committed 6 years ago
34a0d1c
refactored session API.
Petr Patek committed 6 years ago
68a034a
Moved session management KB article to docs.
Petr Patek committed 6 years ago
c2c2923
Merge pull request #552 from dgrcode/patch-1
Ondra Urban committed 6 years ago
b0955ba
Add autogenerated docs
Daniel Gonzalez Reina committed 6 years ago
2edd8ec
Update docs in source file
Daniel Gonzalez Reina committed 6 years ago
b0e008a
Revert previous commit
Daniel Gonzalez Reina committed 6 years ago
b2dc808
Fix typo
Daniel González Reina committed 6 years ago
c8f8275
builded docs.
Petr Patek committed 6 years ago
c7ce26b
improved puppeteer crawler docs.
Petr Patek committed 6 years ago
fa6663c
8997885
Merge branch 'master' into chore/remove-xregexp
Ondra Urban committed 6 years ago
98a46c0
Remove xregexp dependency
Ondra Urban committed 6 years ago
adafe3f
Update changelog and bump version
Ondra Urban committed 6 years ago
5529ede
d6937dc
Remove outdated comments
Ondra Urban committed 6 years ago
9e627b7
refactored.
Petr Patek committed 6 years ago
8e29d23
builded docs
Petr Patek committed 6 years ago
73c903b
fixed passing session id to proxyUrl.
Petr Patek committed 6 years ago
d3cae27
fixed lint.
Petr Patek committed 6 years ago
db3677a
added test.
Petr Patek committed 6 years ago
47f2073
Version bump.
Petr Patek committed 6 years ago
83b3318