Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
PercivalV:
name: Percival Villalva
title: Community Member of Crawlee
url: https://github.com/PerVillalva
image_url: https://avatars.githubusercontent.com/u/70678259?v=4
socials:
github: PerVillalva
SauravJ:
name: Saurav Jain
title: Developer Community Manager
url: https://github.com/souravjain540
image_url: https://avatars.githubusercontent.com/u/53312820?v=4
socials:
x: sauain
github: souravjain540
ArindamM:
name: Arindam Majumder
title: Community Member of Crawlee
url: https://github.com/Arindam200
image_url: https://avatars.githubusercontent.com/u/109217591?v=4
socials:
x: Arindam_1729
github: Arindam200
AyushT:
name: Ayush Thakur
title: Community Member of Crawlee
url: https://github.com/ayush2390
image_url: https://avatars.githubusercontent.com/u/43995654?v=4
socials:
x: JSAyushThakur
github: ayush2390
MaxB:
name: Max
title: Community Member of Crawlee and web scraping expert
url: https://github.com/Mantisus
image_url: https://avatars.githubusercontent.com/u/34358312?v=4
socials:
github: Mantisus
LukasP:
name: Lukáš Průša
title: Junior Web Automation Engineer
url: https://github.com/Patai5
image_url: ./img/lukasp.webp
socials:
github: Patai5
MatejV:
name: Matěj Volf
title: Web Automation Engineer
url: https://github.com/mvolfik
image_url: https://avatars.githubusercontent.com/u/31281386?v=4
socials:
github: mvolfik
SatyamT:
name: Satyam Tripathi
title: Community Member of Crawlee
url: https://github.com/triposat
image_url: https://avatars.githubusercontent.com/u/69134468?v=4
socials:
github: triposat
VladaD:
name: Vlada Dusek
title: Developer of Crawlee for Python
url: https://github.com/vdusek
image_url: https://avatars.githubusercontent.com/u/25082181?v=4
socials:
github: vdusek
RadoC:
name: Radoslav Chudovský
title: Web Automation Engineer
url: https://github.com/chudovskyr
image_url: https://ca.slack-edge.com/T0KRMEKK6-U04MGU11VUK-7f59c4a9343b-512
socials:
github: chudovskyr
B4nan:
name: Martin Adámek
title: Crawlee Maintainer
url: https://github.com/B4nan
image_url: https://avatars1.githubusercontent.com/u/615580?s=460&v=4
socials:
x: B4nan
github: B4nan
ShaheerS:
name: Shaheer Sarfaraz
title: Community Member of Crawlee
url: https://github.com/dakheera47
image_url: https://avatars.githubusercontent.com/u/53654735?v=4
socials:
github: dakheera47
FederCr:
name: Federico
title: Community Member of Crawlee
url: https://github.com/feder-cr
image_url: https://avatars.githubusercontent.com/u/85809106?v=4
socials:
x: FederCr
github: feder-cr