Scrapy, a fast high-level web crawling & scraping framework for Python.
SPM → Zyte API (#6163)
Adrián Chaves369712ee50f7
diff --git a/docs/topics/practices.rst b/docs/topics/practices.rstindex f64da22d8..b1b8c9e9c 100644--- a/docs/topics/practices.rst+++ b/docs/topics/practices.rst@@ -288,9 +288,8 @@ Here are some tips to keep in mind when dealing with these kinds of sites:* use a pool of rotating IPs. For example, the free `Tor project`_ or paidservices like `ProxyMesh`_. An open source alternative is `scrapoxy`_, asuper proxy that you can attach your own proxies to.-* use a highly distributed downloader that circumvents bans internally, so you- can just focus on parsing clean pages. One example of such downloaders is- `Zyte Smart Proxy Manager`_+* use a ban avoidance service, such as `Zyte API`_, which provides a `Scrapy+ plugin <https://github.com/scrapy-plugins/scrapy-zyte-api>`__If you are still unable to prevent your bot getting banned, consider contacting`commercial support`_.@@ -301,4 +300,4 @@ If you are still unable to prevent your bot getting banned, consider contacting.. _Common Crawl: https://commoncrawl.org/.. _testspiders: https://github.com/scrapinghub/testspiders.. _scrapoxy: https://scrapoxy.io/-.. _Zyte Smart Proxy Manager: https://www.zyte.com/smart-proxy-manager/+.. _Zyte API: https://docs.zyte.com/zyte-api/get-started.html