Scrapy, a fast high-level web crawling & scraping framework for Python.
updated suggested changes after review
databenderebddb77a331c
diff --git a/docs/topics/downloader-middleware.rst b/docs/topics/downloader-middleware.rstindex fa211fb75..4d7c87404 100644--- a/docs/topics/downloader-middleware.rst+++ b/docs/topics/downloader-middleware.rst@@ -1068,10 +1068,10 @@ Native implementation, provides better speed than Protego.In order to use this parser:-.. warning:: Does not support Python 3.9+-* Install `Reppy <https://github.com/seomoz/reppy/>`_ by running ``pip install reppy``+.. warning:: Does not support Python 3.9++* Set :setting:`ROBOTSTXT_PARSER` setting to``scrapy.robotstxt.ReppyRobotParser``