Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Insights

Commit activity

724 commits in the last 52 weeks (default branch, merge commits not counted).

Code frequency

+3,030,240 additions and −1,394,974 deletions in the last 52 weeks.

Contributors 100

Everyone who committed to the default branch.

ContributorCommitsAdditionsDeletions
renovate[bot]
941+166,648−180,312
Martin Adámek
735+3,626,979−1,009,059
Jan Čurn
649+24,006−15,229
Ondra Urban
461+32,415−18,323
Ondra Urban
351+46,109−25,633
Marek Trunkát
336+20,274−9,751
Jindřich Bär
277+1,592,875−3,128,444
Apify Release Bot
264+2,417,324−15,254
petrpatek
213+13,315−8,665
Jan Buchar
156+473,521−42,019
Vlad Frangu
101+19,493−8,066
dependabot[bot]
84+1,277−1,319
Ondra Urban
70+24,164−19,084
Szymon Marczak
47+8,003−1,666
dependabot-preview[bot]
42+99−42
Jakub Drobník
42+1,201−513
Saurav Jain
41+4,479−232
davidjohnbarton
37+290−294
Lukáš Křivka
32+488−142
Andrey Bykov
31+1,590−678
Renovate Bot
30+37−37
Vlad Frangu
20+4,500−3,457
Richard Solar
19+5,554−1,743
Jaroslav Hejlek
14+514−166
SwastikTripathi
13+556−192
Nikita Chapovskii
13+768−105
Jan Bárta
13+1,323−1,123
vdrmota
13+978−822
apify-deps[bot]
11+10,016−10,341
Vlada Dusek
11+2,137−532
Copilot
11+354−130
Vratislav Bartonicek
11+586−162
Anas Khan
10+176−15
Paulo Cesar
10+1,757−754
Travis CI
10+2,176−2,314
Ondrej Urban
10+1,443−676
Jan Buchar
9+724−196
Sviatozar Petrenko
9+547−65
František Nesveda
8+80−79
Tobey
8+99−10
Max Bohomolov
7+2,755−1
aarontjdev
7+71−30
Pavel 'Strajk' Dolecek
6+737−41
Matěj Volf
6+256−16
Matt Stephens
6+851−36
Jan Turoň
5+389−11
Jan Novotný
5+81−52
David Turnbull
5+1,782−1,331
Luigi Ruocco
4+157−76
Junghwan
4+352−52
Harry
4+2,588−592
Muhammad Haadhee Sheeraz Mian
4+388−31
Daniel Wébr
4+5,621−1,837
Sapiens Malti
4+76−77
Daniel Gonzalez Reina
4+11−11
Mikhail Koviazin
3+632−22
Jay Hemnani
3+430−294
Noah
3+343−111
Suliman Abdulrazzaq
3+166−1
Anas Khan
3+84−11
Richard Biroš
3+753−7
Marko Kubrachenko
3+75−1
Lukáš Průša
3+295−131
Hamza Alwan
3+712−31
Matej Gagyi
3+10,833−2,313
Lubos Turek
3+98−34
breken
2+99−7
Wei-Lun Li
2+24−9
Michael Bujnovský
2+283−43
Yash Hirgude
2+471−43
Danish Arora
2+361−1
NathanSavageKaimai
2+5,809−50
Felix-Ayush
2+286−21
Adarsh Tiwari
2+77−1
Matouš Mařík
2+94−8
Edgars Beigarts
2+58−21
Daniil Poletaev
2+140−27
Percival Villalva
2+374−1
Kristýna Lhoťanová
2+513−17
Ikko Eltociear Ashimine
2+2−2
Gustavo Silva
2+72−7
Jiří Moravčík
2+14−24
Gabin Desserprit
2+32−6
audi Bookning
2+151−4
Glenn Goossens
2+2−2
Michael Huynh
2+44−14
Juan Sebastián Gaitán Villamizar
2+4−4
Lubos Turek
2+2−2
Robert Säll
1+39−5
Baptiste Jamin
1+331−48
Alperen
1+1−1
Aleksey Safonov
1+12−2
florinBC89
1+74−2
Raphael Fakhri
1+18−4
Gregor Žunič
1+3−2
Martin Forejt
1+4−3
Apify Service Account
1+34−0
XuJian
1+40−3
Shervin Babaei
1+10−1
Atirna
1+286−42