Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

1.4 KB
Raw Blame
<svg width="20" height="20" viewBox="0 0 20 20" fill="none" xmlns="http://www.w3.org/2000/svg">
<path d="M10.0001 2.49983C10.1101 2.49983 10.2193 2.49983 10.3276 2.49983C9.25709 3.49459 8.56897 4.83303 8.38288 6.28251C8.1968 7.732 8.52453 9.20086 9.30909 10.4338C10.0937 11.6667 11.2855 12.5857 12.6773 13.0311C14.0692 13.4764 15.5731 13.42 16.9276 12.8715C16.4066 14.1252 15.555 15.214 14.4636 16.0217C13.3723 16.8294 12.0822 17.3257 10.7309 17.4577C9.37962 17.5896 8.01786 17.3523 6.79088 16.771C5.56391 16.1897 4.51774 15.2862 3.76397 14.157C3.0102 13.0277 2.5771 11.7151 2.51088 10.359C2.44466 9.00288 2.7478 7.65424 3.38795 6.45693C4.02811 5.25961 4.98128 4.25852 6.14578 3.56044C7.31028 2.86237 8.64244 2.49349 10.0001 2.49316V2.49983Z" stroke="#555D76" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/>
<path d="M14.1667 3.33301C14.1667 3.77504 14.3423 4.19896 14.6548 4.51152C14.9674 4.82408 15.3913 4.99967 15.8333 4.99967C15.3913 4.99967 14.9674 5.17527 14.6548 5.48783C14.3423 5.80039 14.1667 6.22431 14.1667 6.66634C14.1667 6.22431 13.9911 5.80039 13.6785 5.48783C13.366 5.17527 12.942 4.99967 12.5 4.99967C12.942 4.99967 13.366 4.82408 13.6785 4.51152C13.9911 4.19896 14.1667 3.77504 14.1667 3.33301Z" stroke="#555D76" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/>
<path d="M15.833 9.16634H17.4997M16.6663 8.33301V9.99967" stroke="#555D76" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/>
</svg>