Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

docs: remove link to webinar
Martin Adámek committed 4 years ago
24aaa19
docs: add a variable in the example code (#1500)
Youngmin Koo committed 4 years ago
cac9eca
chore: fix typo in background.js (#1487)
Ikko Ashimine committed 4 years ago
7eb6197
chore(deps): lock file maintenance
renovate[bot] committed 4 years ago
c2fc012
e7b8c62
docs: say "a X" instead of "the X" in README.md (#1480)
Sebastian Carlos committed 4 years ago
a02db88
chore(deps): update dependency playwright to v1.25.1
renovate[bot] committed 4 years ago
006f19a
docs: remove links to removed example
Martin Adámek committed 4 years ago
a7f0299
docs: update launch banner to have link to webinar
Martin Adámek committed 4 years ago
1f7f078
docs: remove invalid example
Martin Adámek committed 4 years ago
fedc254
docs: make apify footer logo clickable
Martin Adámek committed 4 years ago
3b5c6b6
docs: add campaign banner
Martin Adámek committed 4 years ago
daedba0
1535da0
docs: update changelog
Martin Adámek committed 4 years ago
27eee04
chore(release): v3.0.4
Martin Adámek committed 4 years ago
06831d5
chore(deps): bump puppeteer support to 15.1 (#1469)
Vlad Frangu committed 4 years ago
853a9a1
docs: add introduction video to homepage
Martin Adámek committed 4 years ago
02bdbc2
docs: fix dockerfile example typo
Ondra Urban committed 4 years ago
5ccf9fd
docs: update docker guide (#1472)
Ondra Urban committed 4 years ago
6501db2
chore: update fingerprint suite
Martin Adámek committed 4 years ago
c356233
chore: regenerate lockfile
Martin Adámek committed 4 years ago
fb2ccaf
docs: update readme
Ondra Urban committed 4 years ago
fc6ba6a
chore: improve templates and upgrading guide
Martin Adámek committed 4 years ago
e0f6e62
f9b25d0
docs: fix double changelog heading
Martin Adámek committed 4 years ago
3a285e6