Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

NameLast commit date
..
features
getting-started
API.png
apify_logo.svg
apify_og_SDK.png
apify_sdk_white.svg
apify_sdk.svg
arrow_right.svg
auto-scaling-dark.webp
auto-scaling-light.webp
check.svg
chrome-scrape-dark.gif
chrome-scrape-light.gif
cloud_icon.svg
community-dark-icon.svg
community-light-icon.svg
crawlee-dark.svg
crawlee-javascript-dark.svg
crawlee-javascript-light.svg
crawlee-js-og.png
crawlee-light.svg
crawlee-logo-monocolor.svg
crawlee-logo.svg
crawlee-og.png
crawlee-python-dark.svg
crawlee-python-light.svg
defaults-dark-icon.svg
defaults-light-icon.svg
discord-brand-dark.svg
discord-brand.svg
docusaurus.svg
external-link.svg
favicon.ico
favorite-tools-dark.webp
favorite-tools-light.webp
github-brand-dark.svg
github-brand.svg
hearth.svg
jaeger-search.png
javascript_logo.svg
js_file.svg
logo-big.svg
logo-blur.png
logo-blur.svg
logo-zoom.svg
menu-arrows.svg
oss_logo.png
puppeteer-live-view-dashboard.png
puppeteer-live-view-detail.png
queue-dark-icon.svg
queue-light-icon.svg
robot.png
routing-dark-icon.svg
routing-light-icon.svg
scraping-utils-dark-icon.svg
scraping-utils-light-icon.svg
smart-proxy-dark.webp
smart-proxy-light.webp
source_code.png
system.svg
triangles_dark.svg
triangles_light.svg
workflow.svg
zero-setup-dark-icon.svg
zero-setup-light-icon.svg