Scrapy, a fast high-level web crawling & scraping framework for Python.
add docs for some scheduler settings
Pawel Miechf98ffb53b66c
diff --git a/docs/faq.rst b/docs/faq.rstindex 415331515..ad11b071b 100644--- a/docs/faq.rst+++ b/docs/faq.rst@@ -317,6 +317,6 @@ I'm scraping a XML document and my XPath selector doesn't return any itemsYou may need to remove namespaces. See :ref:`removing-namespaces`... _user agents: https://en.wikipedia.org/wiki/User_agent-.. _LIFO: https://en.wikipedia.org/wiki/LIFO+.. _LIFO: https://en.wikipedia.org/wiki/Stack_(abstract_data_type).. _DFO order: https://en.wikipedia.org/wiki/Depth-first_search.. _BFO order: https://en.wikipedia.org/wiki/Breadth-first_searchdiff --git a/docs/topics/settings.rst b/docs/topics/settings.rstindex 8540308fe..91f3b37c9 100644--- a/docs/topics/settings.rst+++ b/docs/topics/settings.rst@@ -1033,6 +1033,35 @@ Example entry in logs::(type Request)> - no more unserializable requests will be logged(see 'scheduler/unserializable' stats counter)++.. setting:: SCHEDULER_DISK_QUEUE++ SCHEDULER_DISK_QUEUE+--------------------++Default: ``'scrapy.squeues.PickleLifoDiskQueue'``++Type of disk queue that will be used by scheduler. Other available types are+``scrapy.squeues.PickleFifoDiskQueue``, ``scrapy.squeues.MarshalFifoDiskQueue``,+``scrapy.squeues.MarshalLifoDiskQueue``.++.. setting:: SCHEDULER_MEMORY_QUEUE++SCHEDULER_MEMORY_QUEUE+----------------------+Default: ``'scrapy.squeues.LifoMemoryQueue'``++Type of in-memory queue used by scheduler. Other available type is:+``scrapy.squeues.FifoMemoryQueue``.++.. setting:: SCHEDULER_PRIORITY_QUEUE++SCHEDULER_PRIORITY_QUEUE+------------------------+Default: ``'queuelib.PriorityQueue'``++Type of priority queue used by scheduler.+.. setting:: SPIDER_CONTRACTSSPIDER_CONTRACTS