Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
chore(contributing): add loopback instructions for macOS
Szymon Marczakb818033f3e47
diff --git a/CONTRIBUTING.md b/CONTRIBUTING.mdindex ddf138e66..43e9e86b9 100644--- a/CONTRIBUTING.md+++ b/CONTRIBUTING.md@@ -16,6 +16,18 @@ Please note we have a code of conduct, please follow it in all your interactions4. You may merge the Pull Request in once you have the sign-off of two other developers, or if youdo not have permission to do that, you may request the second reviewer to merge it for you.+### macOS++Our proxy tests use different loopback addresses to ensure traffic correctness.+In contrary to Windows and Linux, macOS comes with only one loopback address - `127.0.0.1`.+Therefore it is necessary to run the following once per system startup:++```+sudo ifconfig lo0 alias 127.0.0.2 up+sudo ifconfig lo0 alias 127.0.0.3 up+sudo ifconfig lo0 alias 127.0.0.4 up+```+## Code of Conduct### Our Pledge