Scrapy, a fast high-level web crawling & scraping framework for Python.
Remove AjaxCrawlMiddleware mention from built-in downloader middleware
Laerte Pereira2eb3c75c6976
diff --git a/docs/topics/downloader-middleware.rst b/docs/topics/downloader-middleware.rstindex 33308940c..ab7e6a0ec 100644--- a/docs/topics/downloader-middleware.rst+++ b/docs/topics/downloader-middleware.rst@@ -763,6 +763,26 @@ HttpProxyMiddlewareKeep in mind this value will take precedence over ``http_proxy``/``https_proxy``environment variables, and it will also ignore ``no_proxy`` environment variable.+HttpProxyMiddleware settings+~~~~~~~~~~~~~~~~~~~~~~~~~~~~++.. setting:: HTTPPROXY_ENABLED+.. setting:: HTTPPROXY_AUTH_ENCODING++HTTPPROXY_ENABLED+^^^^^^^^^^^^^^^^^++Default: ``True``++Whether or not to enable the :class:`HttpProxyMiddleware`.++HTTPPROXY_AUTH_ENCODING+^^^^^^^^^^^^^^^^^^^^^^^++Default: ``"latin-1"``++The default encoding for proxy authentication on :class:`HttpProxyMiddleware`.+OffsiteMiddleware-----------------@@ -1220,60 +1240,4 @@ UserAgentMiddlewareIn order for a spider to override the default user agent, its ``user_agent``attribute must be set.-.. _ajaxcrawl-middleware:--AjaxCrawlMiddleware----------------------.. module:: scrapy.downloadermiddlewares.ajaxcrawl--.. class:: AjaxCrawlMiddleware-- Middleware that finds 'AJAX crawlable' page variants based- on meta-fragment html tag.-- .. note::-- Scrapy finds 'AJAX crawlable' pages for URLs like- ``'http://example.com/!#foo=bar'`` even without this middleware.- AjaxCrawlMiddleware is necessary when URL doesn't contain ``'!#'``.- This is often a case for 'index' or 'main' website pages.--AjaxCrawlMiddleware Settings-~~~~~~~~~~~~~~~~~~~~~~~~~~~~--.. setting:: AJAXCRAWL_ENABLED--AJAXCRAWL_ENABLED-^^^^^^^^^^^^^^^^^--Default: ``False``--Whether the AjaxCrawlMiddleware will be enabled.-- .. note::-- This middleware is deprecated and will be removed in a future Scrapy release.--HttpProxyMiddleware settings-~~~~~~~~~~~~~~~~~~~~~~~~~~~~--.. setting:: HTTPPROXY_ENABLED-.. setting:: HTTPPROXY_AUTH_ENCODING--HTTPPROXY_ENABLED-^^^^^^^^^^^^^^^^^--Default: ``True``--Whether or not to enable the :class:`HttpProxyMiddleware`.--HTTPPROXY_AUTH_ENCODING-^^^^^^^^^^^^^^^^^^^^^^^--Default: ``"latin-1"``--The default encoding for proxy authentication on :class:`HttpProxyMiddleware`.--.. _DBM: https://en.wikipedia.org/wiki/Dbm