Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Update readme

Ondra Urban52f03bc71466
diff --git a/README.md b/README.md
index 53da9d3a4..ce76385ba 100644
--- a/README.md
+++ b/README.md
@@ -789,7 +789,17 @@ The following table shows the basic environment variables used by Apify SDK:
By default, the log level is set to <code>INFO</code>, which means that <code>DEBUG</code> messages
are not printed to console.
</td>
- </tr>
+ </tr>
+ <tr>
+ <td><code>APIFY_MEMORY_MBYTES</code></td>
+ <td>
+ Sets the amount of system memory in megabytes to be used by the running process. This is not a hard limit
+ however, only a threshold for the autoscaling feature. It is used to limit the number of concurrently running
+ tasks. Memory leaks not caused by autoscaling will not be confined to this limit. By default,
+ the max amount of memory to be used is set to one quarter of total system memory, i. e. on a system
+ with 8192 MB of memory, the autoscaling feature will only use up to 2048 MB of memory.
+ </td>
+ </tr>
</tbody>
</table>