Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

updated documentation for python version for reppy

databender8bbaea989200
diff --git a/docs/topics/downloader-middleware.rst b/docs/topics/downloader-middleware.rst
index 80c6c2c37..222dda685 100644
--- a/docs/topics/downloader-middleware.rst
+++ b/docs/topics/downloader-middleware.rst
@@ -1073,6 +1073,8 @@ In order to use this parser:
* Set :setting:`ROBOTSTXT_PARSER` setting to
``scrapy.robotstxt.ReppyRobotParser``
+* only works with python 3.8 and earlier
+
.. _rerp-parser:
Robotexclusionrulesparser