Scrapy, a fast high-level web crawling & scraping framework for Python.
Update docs/topics/downloader-middleware.rst
Vostretsov Nikita38828d3fd45e
diff --git a/docs/topics/downloader-middleware.rst b/docs/topics/downloader-middleware.rstindex be96425cf..192bfd19a 100644--- a/docs/topics/downloader-middleware.rst+++ b/docs/topics/downloader-middleware.rst@@ -1021,7 +1021,7 @@ RobotFileParser~~~~~~~~~~~~~~~`RobotFileParser <https://docs.python.org/3.7/library/urllib.robotparser.html>`_ is-Python's inbuilt robots.txt_ parser. The parser is fully compliant with `Martijn Koster's+Python's built-in robots.txt_ parser. The parser is fully compliant with `Martijn Koster's1996 draft specification <http://www.robotstxt.org/norobots-rfc.txt>`_. It lackssupport for wildcard matching.