Scrapy, a fast high-level web crawling & scraping framework for Python.
Merge branch 'master' into download-delay-documentation
Andrey Rakhmatullinf87d061069f8
diff --cc docs/topics/settings.rstindex 468975d6a,022265992..e147a943b--- a/docs/topics/settings.rst+++ b/docs/topics/settings.rst@@@ -660,14 -652,10 +663,15 @@@ desired.. _spider-download_delay-attribute:- You can change this setting per spider by setting the ``download_delay``- spider attribute.+ .. note::++ This delay can be set per spider using :attr:`download_delay` spider attribute.+It is also possible to change this setting per domain, although it requires+non-trivial code. See the implementation of the :ref:`AutoThrottle+<topics-autothrottle>` extension for an example.++.. setting:: DOWNLOAD_HANDLERSDOWNLOAD_HANDLERS