Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Merge branch 'master' into download-delay-documentation

Andrey Rakhmatullinf87d061069f8
diff --cc docs/topics/settings.rst
index 468975d6a,022265992..e147a943b
--- a/docs/topics/settings.rst
+++ b/docs/topics/settings.rst
@@@ -660,14 -652,10 +663,15 @@@ desired
.. _spider-download_delay-attribute:
- You can change this setting per spider by setting the ``download_delay``
- spider attribute.
+ .. note::
+
+ This delay can be set per spider using :attr:`download_delay` spider attribute.
+It is also possible to change this setting per domain, although it requires
+non-trivial code. See the implementation of the :ref:`AutoThrottle
+<topics-autothrottle>` extension for an example.
+
+
.. setting:: DOWNLOAD_HANDLERS
DOWNLOAD_HANDLERS