Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

updated suggested changes after review

databenderebddb77a331c
diff --git a/docs/topics/downloader-middleware.rst b/docs/topics/downloader-middleware.rst
index fa211fb75..4d7c87404 100644
--- a/docs/topics/downloader-middleware.rst
+++ b/docs/topics/downloader-middleware.rst
@@ -1068,10 +1068,10 @@ Native implementation, provides better speed than Protego.
In order to use this parser:
-.. warning:: Does not support Python 3.9+
-
* Install `Reppy <https://github.com/seomoz/reppy/>`_ by running ``pip install reppy``
+.. warning:: Does not support Python 3.9+
+
* Set :setting:`ROBOTSTXT_PARSER` setting to
``scrapy.robotstxt.ReppyRobotParser``