Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Update changelog, bump version, build docs
Ondra Urban47f8769b04b2
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 70e442723..353ba8381 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,4 +1,4 @@-xxx+0.9.4 / 2018-11-19==================- Automatically adding `--enable-resource-load-scheduler=false`Chrome flag in `Apify.launchPuppeteer()`diff --git a/docs/api/Apify.md b/docs/api/Apify.mdindex adbcff589..1569faa51 100644--- a/docs/api/Apify.md+++ b/docs/api/Apify.md@@ -469,6 +469,8 @@ The `launchPuppeteer()` function alters the following Puppeteer options:<li>The function adds <code>--no-sandbox</code> to <code>args</code> to enable runningheadless Chrome in a Docker container on the Apify platform.+ Also it adds <code>--enable-resource-load-scheduler=false</code>+ to make crawling of pages in all tabs run equally fast.</li></ul>diff --git a/docs/api/puppeteer.md b/docs/api/puppeteer.mdindex 74422219d..ce2a54f9d 100644--- a/docs/api/puppeteer.md+++ b/docs/api/puppeteer.md@@ -88,6 +88,18 @@ e.g. to extract data from HTML elements using CSS selectors.Beware that the injected jQuery object will be set to the `window.$` variable and thus it might cause conflicts withlibraries included by the page that use the same variable (e.g. another version of jQuery).+Example usage:+```javascript+await Apify.utils.puppeteer.injectJQuery(page);+const title = await page.evaluate(() => {+ return $('head title').text();+});+```++Note that `injectJQuery()` does not affect the Puppeteer's+<a href="https://pptr.dev/#?product=Puppeteer&show=api-pageselector" target="_blank"><code>Page.$()</code></a>+function in any way.+<table><thead><tr>diff --git a/package.json b/package.jsonindex ffc5bc4e3..12ebf5104 100644--- a/package.json+++ b/package.json@@ -1,6 +1,6 @@{"name": "apify",- "version": "0.9.3",+ "version": "0.9.4","description": "The scalable web crawling and scraping library for JavaScript. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.","engines": {"node": ">=8.0.0"