Scrapy, a fast high-level web crawling & scraping framework for Python.
updated documentation for python version for reppy
databender8bbaea989200
diff --git a/docs/topics/downloader-middleware.rst b/docs/topics/downloader-middleware.rstindex 80c6c2c37..222dda685 100644--- a/docs/topics/downloader-middleware.rst+++ b/docs/topics/downloader-middleware.rst@@ -1073,6 +1073,8 @@ In order to use this parser:* Set :setting:`ROBOTSTXT_PARSER` setting to``scrapy.robotstxt.ReppyRobotParser``+* only works with python 3.8 and earlier+.. _rerp-parser:Robotexclusionrulesparser