Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Trigger travis build
Ondra Urban98e90f2c54d3
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 803d75634..7af1a4f92 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,3 +1,7 @@+NEXT+====================++0.20.0 / 2020-03-03====================- **BREAKING:** `Apify.utils.requestAsBrowser()` no longer aborts request on status code 406diff --git a/website/i18n/en.json b/website/i18n/en.jsonindex a245c3873..adfc94ee2 100644--- a/website/i18n/en.json+++ b/website/i18n/en.json@@ -146,9 +146,6 @@"typedefs/actor-run": {"title": "ActorRun"},- "typedefs/apify-call-error": {- "title": "ApifyCallError"- },"typedefs/apify-env": {"title": "ApifyEnv"},@@ -245,9 +242,6 @@"typedefs/request-as-browser-options": {"title": "RequestAsBrowserOptions"},- "typedefs/request-list-input": {- "title": "RequestListInput"- },"typedefs/request-list-options": {"title": "RequestListOptions"},@@ -275,9 +269,6 @@"typedefs/social-handles": {"title": "SocialHandles"},- "typedefs/source-input": {- "title": "SourceInput"- },"typedefs/stealth-options": {"title": "StealthOptions"},