Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Bump version to new beta, update changelog
Ondra Urban committed 5 years ago
f97105b
Bump client to v1.0.0
Ondra Urban committed 5 years ago
eff0a62
Bump apify-client from 1.0.0-beta.21 to 1.0.0-beta.22 (#876)
dependabot-preview[bot] committed 5 years ago
b622943
Bump version, update changelog
Ondra Urban committed 5 years ago
b6bec4a
Merge branch 'chore/v0.21.10'
Ondra Urban committed 5 years ago
ab04771
Bump puppeteer and version, update changelog
Ondra Urban committed 5 years ago
b38994e
Improve request creation performance (#869)
Andrey Bykov committed 5 years ago
42d1919
Fix Chrome path on Windows
Ondra Urban committed 5 years ago
137b46b
0b4a10c
fixes HTTP2 in requestAsBrowser (#866)
petrpatek committed 5 years ago
537859e
Fix CLI login example [skip ci]
Ondra Urban committed 5 years ago
c3435d7
Replace Apify.client with Apify.newClient
Ondra Urban committed 5 years ago
b492190
Bump socket.io + ow (#864)
Ondra Urban committed 5 years ago
2e5cb5f
Bump apify-client to beta.21
Ondra Urban committed 5 years ago
00e07cc
Bump apify-client to beta.16
Ondra Urban committed 5 years ago
fcda062
Bump apify-client to beta.15
Ondra Urban committed 5 years ago
55212c5
Bump puppeteer and user agent to Chrome 87
Ondra Urban committed 5 years ago
22c6ca0
Add final beta of new client
Ondra Urban committed 5 years ago
13ca8c8
Bump htmlparser2 from 4.1.0 to 5.0.1 (#817)
dependabot-preview[bot] committed 6 years ago
433f67e
Bump ow from 0.18.0 to 0.19.0 (#830)
dependabot-preview[bot] committed 6 years ago
de22430
Update actions
Ondra Urban committed 6 years ago
37d476b
Update prePublish safety check
Ondra Urban committed 6 years ago
50ca17e
Optimize actions
Ondra Urban committed 6 years ago
a5c6b83
Fix saveSnapshot lint and test
Ondra Urban committed 6 years ago
28c8694
Fix CI skipping
Ondra Urban committed 6 years ago
53ef06a
Update RELEASE.md; allow skipping CI
Ondra Urban committed 6 years ago
d65a9a5
Bump http-request
Ondra Urban committed 6 years ago
e6a28db
728580e
Migrate from Travis to GitHub Actions
Ondra Urban committed 6 years ago
0c64671
Fix saveSnapshot on local (#849)
Lukáš Křivka committed 6 years ago
f243864