🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
docs: Updating benchmarks with the latest version of all libraries
Karim shoaird259b85c5b9b
diff --git a/README.md b/README.mdindex 88ba6f8..28e549d 100644--- a/README.md+++ b/README.md@@ -236,20 +236,20 @@ scrapling extract stealthy-fetch 'https://nopecha.com/demo/cloudflare' captchas.## Performance Benchmarks-Scrapling isn't just powerful—it's also blazing fast, and version 0.3 delivers exceptional performance improvements across all operations!+Scrapling isn't just powerful—it's also blazing fast, and the updates since version 0.3 deliver exceptional performance improvements across all operations!### Text Extraction Speed Test (5000 nested elements)| # | Library | Time (ms) | vs Scrapling ||---|:-----------------:|:---------:|:------------:|-| 1 | Scrapling | 1.88 | 1.0x |-| 2 | Parsel/Scrapy | 1.96 | 1.043x |-| 3 | Raw Lxml | 2.32 | 1.234x |-| 4 | PyQuery | 20.2 | ~11x |-| 5 | Selectolax | 85.2 | ~45x |-| 6 | MechanicalSoup | 1305.84 | ~695x |-| 7 | BS4 with Lxml | 1307.92 | ~696x |-| 8 | BS4 with html5lib | 3336.28 | ~1775x |+| 1 | Scrapling | 1.92 | 1.0x |+| 2 | Parsel/Scrapy | 1.99 | 1.036x |+| 3 | Raw Lxml | 2.33 | 1.214x |+| 4 | PyQuery | 20.61 | ~11x |+| 5 | Selectolax | 80.65 | ~42x |+| 6 | BS4 with Lxml | 1283.21 | ~698x |+| 7 | MechanicalSoup | 1304.57 | ~679x |+| 8 | BS4 with html5lib | 3331.96 | ~1735x |### Element Similarity & Text Search Performance@@ -257,8 +257,8 @@ Scrapling's adaptive element finding capabilities significantly outperform alter| Library | Time (ms) | vs Scrapling ||-------------|:---------:|:------------:|-| Scrapling | 2.02 | 1.0x |-| AutoScraper | 10.26 | 5.08x |+| Scrapling | 1.87 | 1.0x |+| AutoScraper | 10.24 | 5.476x |> All benchmarks represent averages of 100+ runs. See [benchmarks.py](https://github.com/D4Vinci/Scrapling/blob/main/benchmarks.py) for methodology.@@ -326,4 +326,4 @@ This project includes code adapted from:- [rebrowser-patches](https://github.com/rebrowser/rebrowser-patches) for stealth improvements----<div align="center"><small>Designed & crafted with ❤️ by Karim Shoair.</small></div><br>+<div align="center"><small>Designed & crafted with ❤️ by Karim Shoair.</small></div><br>\ No newline at end of filediff --git a/docs/benchmarks.md b/docs/benchmarks.mdindex ceb35e4..4e207ad 100644--- a/docs/benchmarks.md+++ b/docs/benchmarks.md@@ -1,6 +1,6 @@# Performance Benchmarks-Scrapling isn't just powerful—it's also blazing fast, and version 0.3 delivers exceptional performance improvements across all operations!+Scrapling isn't just powerful—it's also blazing fast, and the updates since version 0.3 deliver exceptional performance improvements across all operations!## Benchmark Results@@ -8,14 +8,14 @@ Scrapling isn't just powerful—it's also blazing fast, and version 0.3 delivers| # | Library | Time (ms) | vs Scrapling ||---|:-----------------:|:---------:|:------------:|-| 1 | Scrapling | 1.88 | 1.0x |-| 2 | Parsel/Scrapy | 1.96 | 1.043x |-| 3 | Raw Lxml | 2.32 | 1.234x |-| 4 | PyQuery | 20.2 | ~11x |-| 5 | Selectolax | 85.2 | ~45x |-| 6 | MechanicalSoup | 1305.84 | ~695x |-| 7 | BS4 with Lxml | 1307.92 | ~696x |-| 8 | BS4 with html5lib | 3336.28 | ~1775x |+| 1 | Scrapling | 1.92 | 1.0x |+| 2 | Parsel/Scrapy | 1.99 | 1.036x |+| 3 | Raw Lxml | 2.33 | 1.214x |+| 4 | PyQuery | 20.61 | ~11x |+| 5 | Selectolax | 80.65 | ~42x |+| 6 | BS4 with Lxml | 1283.21 | ~698x |+| 7 | MechanicalSoup | 1304.57 | ~679x |+| 8 | BS4 with html5lib | 3331.96 | ~1735x |### Element Similarity & Text Search Performance@@ -23,5 +23,5 @@ Scrapling's adaptive element finding capabilities significantly outperform alter| Library | Time (ms) | vs Scrapling ||-------------|:---------:|:------------:|-| Scrapling | 2.02 | 1.0x |-| AutoScraper | 10.26 | 5.08x |+| Scrapling | 1.87 | 1.0x |+| AutoScraper | 10.24 | 5.476x |