Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

docs: compress blog pictures (webp) (#2554)

Jindřich Bär4d718c192377
diff --git a/website/blog/2024/02-22-launching-crawlee-blog/index.md b/website/blog/2024/02-22-launching-crawlee-blog/index.md
index c1a0d1d2e..8d3326ce6 100644
--- a/website/blog/2024/02-22-launching-crawlee-blog/index.md
+++ b/website/blog/2024/02-22-launching-crawlee-blog/index.md
@@ -2,11 +2,11 @@
slug: crawlee-blog-launch
title: 'Launching Crawlee Blog'
description: 'Your Node.js resource hub for web scraping and automation.'
-image: https://raw.githubusercontent.com/souravjain540/crawlee-first-blog/main/og-image.png
+image: https://raw.githubusercontent.com/souravjain540/crawlee-first-blog/main/og-image.webp
author: Saurav Jain
authorTitle: Developer Community Manager
authorURL: https://github.com/souravjain540
-authorImageURL: https://avatars.githubusercontent.com/u/53312820?v=4
+authorImageURL: https://avatars.githubusercontent.com/u/53312820?v=4&s=48
authorTwitter: sauain
---
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/dev-tools-example.png b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/dev-tools-example.png
deleted file mode 100644
index 291564fba..000000000
Binary files a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/dev-tools-example.png and /dev/null differ
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/dev-tools-example.webp b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/dev-tools-example.webp
new file mode 100644
index 000000000..8d8fea2b4
Binary files /dev/null and b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/dev-tools-example.webp differ
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/fields-to-scrape.png b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/fields-to-scrape.png
deleted file mode 100644
index a8f29b7ae..000000000
Binary files a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/fields-to-scrape.png and /dev/null differ
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/fields-to-scrape.webp b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/fields-to-scrape.webp
new file mode 100644
index 000000000..062a490fe
Binary files /dev/null and b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/fields-to-scrape.webp differ
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/how-to-scrape-amazon.png b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/how-to-scrape-amazon.png
deleted file mode 100644
index 49eacd9fd..000000000
Binary files a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/how-to-scrape-amazon.png and /dev/null differ
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/how-to-scrape-amazon.webp b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/how-to-scrape-amazon.webp
new file mode 100644
index 000000000..4392a76f5
Binary files /dev/null and b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/how-to-scrape-amazon.webp differ
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/lukasp.png b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/lukasp.png
deleted file mode 100644
index 861e91e6b..000000000
Binary files a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/lukasp.png and /dev/null differ
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/lukasp.webp b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/lukasp.webp
new file mode 100644
index 000000000..9b235a2f6
Binary files /dev/null and b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/img/lukasp.webp differ
diff --git a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/index.md b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/index.md
index f032def1f..348ccafde 100644
--- a/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/index.md
+++ b/website/blog/2024/03-27-how-to-scrape-amazon-using-typescript-cheerio-and-crawlee/index.md
@@ -2,11 +2,11 @@
slug: how-to-scrape-amazon
title: 'How to scrape Amazon products'
description: 'A detailed step-by-step guide to scraping products on Amazon using TypeScript, Cheerio, and Crawlee.'
-image: ./img/how-to-scrape-amazon.png
+image: ./img/how-to-scrape-amazon.webp
author: Lukáš Průša
authorTitle: Junior Web Automation Engineer
authorURL: https://github.com/Patai5
-authorImageURL: ./img/lukasp.png
+authorImageURL: ./img/lukasp.webp
---
## Introduction
@@ -15,7 +15,7 @@ Amazon is one of the largest and most complex websites, which means scraping it
In this guide, we'll be extracting information from Amazon product pages using the power of [TypeScript](https://www.typescriptlang.org) in combination with the [Cheerio](https://cheerio.js.org) and [Crawlee](https://crawlee.dev) libraries. We'll explore how to retrieve and extract detailed product data such as titles, prices, image URLs, and more from Amazon's vast marketplace. We'll also discuss handling potential blocking issues that may arise during the scraping process.
-![How to scrape Amazon using Typescript, Cheerio, and Crawlee](./img/how-to-scrape-amazon.png)
+![How to scrape Amazon using Typescript, Cheerio, and Crawlee](./img/how-to-scrape-amazon.webp)
<!--truncate-->
@@ -37,7 +37,7 @@ To begin with, let's identify the product fields that we're interested in scrapi
- Image URLs
- Product Overview Attributes
-![Image highlighting the product fields to be scraped on Amazon](./img/fields-to-scrape.png)
+![Image highlighting the product fields to be scraped on Amazon](./img/fields-to-scrape.webp)
For now, our focus will be solely on the scraping part. In a later section, we'll shift our attention to Crawlee, our crawling tool. Let's begin!
@@ -46,7 +46,7 @@ For now, our focus will be solely on the scraping part. In a later section, we'l
Our first step will be to utilize [browser DevTools](https://developer.mozilla.org/en-US/docs/Learn/Common_questions/Tools_and_setup/What_are_browser_developer_tools) to inspect the layout and discover the [CSS selectors](https://developer.mozilla.org/en-US/docs/Learn/CSS/Building_blocks/Selectors) for the data points we aim to scrape. (by default on [Chrome](https://developer.chrome.com/docs/devtools), press `Ctrl + Shift + C`)
For example, let's take a look at how we find the selector for the product title:
-![Amazon product title selector in DevTools](./img/dev-tools-example.png)
+![Amazon product title selector in DevTools](./img/dev-tools-example.webp)
The product title selector we've deduced is `span#productTitle`. This selector targets all `span` elements with the id of `productTitle`. Luckily, there's only one such element on the page - exactly what we're after.
diff --git a/website/blog/2024/04-23-scrapy-vs-crawlee/img/scrapy-vs-crawlee.png b/website/blog/2024/04-23-scrapy-vs-crawlee/img/scrapy-vs-crawlee.png
deleted file mode 100644
index f98432ce8..000000000
Binary files a/website/blog/2024/04-23-scrapy-vs-crawlee/img/scrapy-vs-crawlee.png and /dev/null differ
diff --git a/website/blog/2024/04-23-scrapy-vs-crawlee/img/scrapy-vs-crawlee.webp b/website/blog/2024/04-23-scrapy-vs-crawlee/img/scrapy-vs-crawlee.webp
new file mode 100644
index 000000000..953e7d7cb
Binary files /dev/null and b/website/blog/2024/04-23-scrapy-vs-crawlee/img/scrapy-vs-crawlee.webp differ
diff --git a/website/blog/2024/04-23-scrapy-vs-crawlee/index.md b/website/blog/2024/04-23-scrapy-vs-crawlee/index.md
index 64bd4cb13..ff66cb4b7 100644
--- a/website/blog/2024/04-23-scrapy-vs-crawlee/index.md
+++ b/website/blog/2024/04-23-scrapy-vs-crawlee/index.md
@@ -2,11 +2,11 @@
slug: scrapy-vs-crawlee
title: 'Scrapy vs. Crawlee'
description: 'Which web scraping library should you use in 2024? Learn how each handles headless mode, autoscaling, proxy rotation, errors, and anti-scraping techniques.'
-image: ./img/scrapy-vs-crawlee.png
+image: ./img/scrapy-vs-crawlee.webp
author: Saurav Jain
authorTitle: Developer Community Manager
authorURL: https://github.com/souravjain540
-authorImageURL: https://avatars.githubusercontent.com/u/53312820?v=4
+authorImageURL: https://avatars.githubusercontent.com/u/53312820?v=4&s=48
authorTwitter: sauain
---
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/create-netflix-show-recommender.png b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/create-netflix-show-recommender.png
deleted file mode 100644
index d25d59f4d..000000000
Binary files a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/create-netflix-show-recommender.png and /dev/null differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/create-netflix-show-recommender.webp b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/create-netflix-show-recommender.webp
new file mode 100644
index 000000000..3c6d31fc1
Binary files /dev/null and b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/create-netflix-show-recommender.webp differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/genre.png b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/genre.png
deleted file mode 100644
index 0c1614908..000000000
Binary files a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/genre.png and /dev/null differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/genre.webp b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/genre.webp
new file mode 100644
index 000000000..8dc41df5f
Binary files /dev/null and b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/genre.webp differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/react.png b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/react.png
deleted file mode 100644
index bf3b98719..000000000
Binary files a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/react.png and /dev/null differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/react.webp b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/react.webp
new file mode 100644
index 000000000..ef7b67a19
Binary files /dev/null and b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/react.webp differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/title.png b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/title.png
deleted file mode 100644
index fbb097e4e..000000000
Binary files a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/title.png and /dev/null differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/title.webp b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/title.webp
new file mode 100644
index 000000000..5aac30c1c
Binary files /dev/null and b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/title.webp differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/viteandreact.png b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/viteandreact.png
deleted file mode 100644
index f188699e5..000000000
Binary files a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/viteandreact.png and /dev/null differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/viteandreact.webp b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/viteandreact.webp
new file mode 100644
index 000000000..660d07d11
Binary files /dev/null and b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/img/viteandreact.webp differ
diff --git a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/index.md b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/index.md
index 291646fce..90bf3ebc8 100644
--- a/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/index.md
+++ b/website/blog/2024/06-10-creating-a-netflix-show-recommender-using-crawlee-and-react/index.md
@@ -3,11 +3,11 @@ slug: netflix-show-recommender
title: 'Building a Netflix show recommender using Crawlee and React'
tags: [community]
description: 'Create a Netflix show recommendation system using Crawlee to scrape the data, JavaScript to code, and React to build the front end.'
-image: ./img/create-netflix-show-recommender.png
+image: ./img/create-netflix-show-recommender.webp
author: Ayush Thakur
authorTitle: Community Member of Crawlee
authorURL: https://github.com/ayush2390
-authorImageURL: https://avatars.githubusercontent.com/u/43995654?v=4
+authorImageURL: https://avatars.githubusercontent.com/u/43995654?v=4&s=48
authorTwitter: JSAyushThakur
---
@@ -19,7 +19,7 @@ In this blog, we'll guide you through the process of using Vite and Crawlee to b
One of our community members wrote this blog as a contribution to Crawlee Blog. If you want to contribute blogs like these to Crawlee Blog, please reach out to us on our [discord channel](https://apify.com/discord).
:::
-![How to scrape Netflix using Crawlee and React to build a show recommender](./img/create-netflix-show-recommender.png)
+![How to scrape Netflix using Crawlee and React to build a show recommender](./img/create-netflix-show-recommender.webp)
<!-- truncate -->
@@ -47,13 +47,13 @@ You can check out the [Vite Docs](https://vitejs.dev/guide/) for more details on
Once the React app is created, open it in VS Code.
-![react](./img/react.png)
+![react](./img/react.webp)
This will be the structure of your React app.
Run `npm run dev` command in the terminal to run the app.
-![viteandreact](./img/viteandreact.png)
+![viteandreact](./img/viteandreact.webp)
This will be the output displayed.
@@ -85,11 +85,11 @@ To scrape the genres and shows, we will utilize the [browser DevTools](https://d
We can capture the HTML structure and call `$(element)` to query the element's subtree.
-![genre](./img/genre.png)
+![genre](./img/genre.webp)
Here, we can observe that the name of the genre is captured by a `span` tag with `nm-collections-row-name` class. So we can use the `span.nm-collections-row-name` selector to capture this and similar elements.
-![title](./img/title.png)
+![title](./img/title.webp)
Similarly, we can observe that the title of the show is captured by the `span` tag having `nm-collections-title-name` class. So we can use the `span.nm-collections-title-name` selector to capture this and similar elements.