Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Insights
Commit activity
724 commits in the last 52 weeks (default branch, merge commits not counted).
Code frequency
+3,030,240 additions and −1,394,974 deletions in the last 52 weeks.
Contributors 100
Everyone who committed to the default branch.
| Contributor | Commits | Additions | Deletions |
|---|---|---|---|
renovate[bot] | 941 | +166,648 | −180,312 |
Martin Adámek | 735 | +3,626,979 | −1,009,059 |
Jan Čurn | 649 | +24,006 | −15,229 |
Ondra Urban | 461 | +32,415 | −18,323 |
Ondra Urban | 351 | +46,109 | −25,633 |
Marek Trunkát | 336 | +20,274 | −9,751 |
Jindřich Bär | 277 | +1,592,875 | −3,128,444 |
Apify Release Bot | 264 | +2,417,324 | −15,254 |
petrpatek | 213 | +13,315 | −8,665 |
Jan Buchar | 156 | +473,521 | −42,019 |
Vlad Frangu | 101 | +19,493 | −8,066 |
dependabot[bot] | 84 | +1,277 | −1,319 |
Ondra Urban | 70 | +24,164 | −19,084 |
Szymon Marczak | 47 | +8,003 | −1,666 |
dependabot-preview[bot] | 42 | +99 | −42 |
Jakub Drobník | 42 | +1,201 | −513 |
Saurav Jain | 41 | +4,479 | −232 |
davidjohnbarton | 37 | +290 | −294 |
Lukáš Křivka | 32 | +488 | −142 |
Andrey Bykov | 31 | +1,590 | −678 |
Renovate Bot | 30 | +37 | −37 |
Vlad Frangu | 20 | +4,500 | −3,457 |
Richard Solar | 19 | +5,554 | −1,743 |
Jaroslav Hejlek | 14 | +514 | −166 |
SwastikTripathi | 13 | +556 | −192 |
Nikita Chapovskii | 13 | +768 | −105 |
Jan Bárta | 13 | +1,323 | −1,123 |
vdrmota | 13 | +978 | −822 |
apify-deps[bot] | 11 | +10,016 | −10,341 |
Vlada Dusek | 11 | +2,137 | −532 |
Copilot | 11 | +354 | −130 |
Vratislav Bartonicek | 11 | +586 | −162 |
Anas Khan | 10 | +176 | −15 |
Paulo Cesar | 10 | +1,757 | −754 |
Travis CI | 10 | +2,176 | −2,314 |
Ondrej Urban | 10 | +1,443 | −676 |
Jan Buchar | 9 | +724 | −196 |
Sviatozar Petrenko | 9 | +547 | −65 |
František Nesveda | 8 | +80 | −79 |
Tobey | 8 | +99 | −10 |
Max Bohomolov | 7 | +2,755 | −1 |
aarontjdev | 7 | +71 | −30 |
Pavel 'Strajk' Dolecek | 6 | +737 | −41 |
Matěj Volf | 6 | +256 | −16 |
Matt Stephens | 6 | +851 | −36 |
Jan Turoň | 5 | +389 | −11 |
Jan Novotný | 5 | +81 | −52 |
David Turnbull | 5 | +1,782 | −1,331 |
Luigi Ruocco | 4 | +157 | −76 |
Junghwan | 4 | +352 | −52 |
Harry | 4 | +2,588 | −592 |
Muhammad Haadhee Sheeraz Mian | 4 | +388 | −31 |
Daniel Wébr | 4 | +5,621 | −1,837 |
Sapiens Malti | 4 | +76 | −77 |
Daniel Gonzalez Reina | 4 | +11 | −11 |
Mikhail Koviazin | 3 | +632 | −22 |
Jay Hemnani | 3 | +430 | −294 |
Noah | 3 | +343 | −111 |
Suliman Abdulrazzaq | 3 | +166 | −1 |
Anas Khan | 3 | +84 | −11 |
Richard Biroš | 3 | +753 | −7 |
Marko Kubrachenko | 3 | +75 | −1 |
Lukáš Průša | 3 | +295 | −131 |
Hamza Alwan | 3 | +712 | −31 |
Matej Gagyi | 3 | +10,833 | −2,313 |
Lubos Turek | 3 | +98 | −34 |
breken | 2 | +99 | −7 |
Wei-Lun Li | 2 | +24 | −9 |
Michael Bujnovský | 2 | +283 | −43 |
Yash Hirgude | 2 | +471 | −43 |
Danish Arora | 2 | +361 | −1 |
NathanSavageKaimai | 2 | +5,809 | −50 |
Felix-Ayush | 2 | +286 | −21 |
Adarsh Tiwari | 2 | +77 | −1 |
Matouš Mařík | 2 | +94 | −8 |
Edgars Beigarts | 2 | +58 | −21 |
Daniil Poletaev | 2 | +140 | −27 |
Percival Villalva | 2 | +374 | −1 |
Kristýna Lhoťanová | 2 | +513 | −17 |
Ikko Eltociear Ashimine | 2 | +2 | −2 |
Gustavo Silva | 2 | +72 | −7 |
Jiří Moravčík | 2 | +14 | −24 |
Gabin Desserprit | 2 | +32 | −6 |
audi Bookning | 2 | +151 | −4 |
Glenn Goossens | 2 | +2 | −2 |
Michael Huynh | 2 | +44 | −14 |
Juan Sebastián Gaitán Villamizar | 2 | +4 | −4 |
Lubos Turek | 2 | +2 | −2 |
Robert Säll | 1 | +39 | −5 |
Baptiste Jamin | 1 | +331 | −48 |
Alperen | 1 | +1 | −1 |
Aleksey Safonov | 1 | +12 | −2 |
florinBC89 | 1 | +74 | −2 |
Raphael Fakhri | 1 | +18 | −4 |
Gregor Žunič | 1 | +3 | −2 |
Martin Forejt | 1 | +4 | −3 |
Apify Service Account | 1 | +34 | −0 |
XuJian | 1 | +40 | −3 |
Shervin Babaei | 1 | +10 | −1 |
Atirna | 1 | +286 | −42 |