Scrapy, a fast high-level web crawling & scraping framework for Python.
Be consistent with domain used for links to documentation website
Daniel Graña65d631329a14
diff --git a/CONTRIBUTING.md b/CONTRIBUTING.mdindex 0a11b05d2..a05d07aee 100644--- a/CONTRIBUTING.md+++ b/CONTRIBUTING.md@@ -1,5 +1,5 @@The guidelines for contributing are available here:-https://doc.scrapy.org/en/master/contributing.html+https://docs.scrapy.org/en/master/contributing.htmlPlease do not abuse the issue tracker for support questions.If your issue topic can be rephrased to "How to ...?", please use thediff --git a/INSTALL b/INSTALLindex a3c7899c6..06e812936 100644--- a/INSTALL+++ b/INSTALL@@ -1,4 +1,4 @@For information about installing Scrapy see:* docs/intro/install.rst (local file)-* https://doc.scrapy.org/en/latest/intro/install.html (online version)+* https://docs.scrapy.org/en/latest/intro/install.html (online version)diff --git a/README.rst b/README.rstindex 1361eac26..c28d217ff 100644--- a/README.rst+++ b/README.rst@@ -51,18 +51,18 @@ The quick way::pip install scrapyFor more details see the install section in the documentation:-https://doc.scrapy.org/en/latest/intro/install.html+https://docs.scrapy.org/en/latest/intro/install.htmlDocumentation=============-Documentation is available online at https://doc.scrapy.org/ and in the ``docs``+Documentation is available online at https://docs.scrapy.org/ and in the ``docs``directory.Releases========-You can find release notes at https://doc.scrapy.org/en/latest/news.html+You can find release notes at https://docs.scrapy.org/en/latest/news.htmlCommunity (blog, twitter, mail list, IRC)=========================================@@ -72,7 +72,7 @@ See https://scrapy.org/community/Contributing============-See https://doc.scrapy.org/en/master/contributing.html+See https://docs.scrapy.org/en/master/contributing.htmlCode of Conduct---------------diff --git a/docs/contributing.rst b/docs/contributing.rstindex 2369c3436..cf27337c8 100644--- a/docs/contributing.rst+++ b/docs/contributing.rst@@ -7,7 +7,7 @@ Contributing to Scrapy.. important::Double check that you are reading the most recent version of this document at- https://doc.scrapy.org/en/master/contributing.html+ https://docs.scrapy.org/en/master/contributing.htmlThere are many ways to contribute to Scrapy. Here are some of them:diff --git a/docs/topics/selectors.rst b/docs/topics/selectors.rstindex 9dced7473..df1d67ae8 100644--- a/docs/topics/selectors.rst+++ b/docs/topics/selectors.rst@@ -100,7 +100,7 @@ To explain how to use the selectors we'll use the `Scrapy shell` (whichprovides interactive testing) and an example page located in the Scrapydocumentation server:- https://doc.scrapy.org/en/latest/_static/selectors-sample1.html+ https://docs.scrapy.org/en/latest/_static/selectors-sample1.html.. _topics-selectors-htmlcode:@@ -113,7 +113,7 @@ For the sake of completeness, here's its full HTML code:First, let's open the shell::- scrapy shell https://doc.scrapy.org/en/latest/_static/selectors-sample1.html+ scrapy shell https://docs.scrapy.org/en/latest/_static/selectors-sample1.htmlThen, after the shell loads, you'll have the response available as ``response``shell variable, and its attached selector in ``response.selector`` attribute.diff --git a/scrapy/extensions/telnet.py b/scrapy/extensions/telnet.pyindex dcf73eb88..26b214ee2 100644--- a/scrapy/extensions/telnet.py+++ b/scrapy/extensions/telnet.py@@ -112,7 +112,7 @@ class TelnetConsole(protocol.ServerFactory):'prefs': print_live_refs,'hpy': hpy,'help': "This is Scrapy telnet console. For more info see: "- "https://doc.scrapy.org/en/latest/topics/telnetconsole.html",+ "https://docs.scrapy.org/en/latest/topics/telnetconsole.html",}self.crawler.signals.send_catch_log(update_telnet_vars, telnet_vars=telnet_vars)return telnet_varsdiff --git a/scrapy/templates/project/module/items.py.tmpl b/scrapy/templates/project/module/items.py.tmplindex 7d766f4fc..a12d08414 100644--- a/scrapy/templates/project/module/items.py.tmpl+++ b/scrapy/templates/project/module/items.py.tmpl@@ -3,7 +3,7 @@# Define here the models for your scraped items## See documentation in:-# https://doc.scrapy.org/en/latest/topics/items.html+# https://docs.scrapy.org/en/latest/topics/items.htmlimport scrapydiff --git a/scrapy/templates/project/module/middlewares.py.tmpl b/scrapy/templates/project/module/middlewares.py.tmplindex c5b542bd6..5debe1cd2 100644--- a/scrapy/templates/project/module/middlewares.py.tmpl+++ b/scrapy/templates/project/module/middlewares.py.tmpl@@ -3,7 +3,7 @@# Define here the models for your spider middleware## See documentation in:-# https://doc.scrapy.org/en/latest/topics/spider-middleware.html+# https://docs.scrapy.org/en/latest/topics/spider-middleware.htmlfrom scrapy import signalsdiff --git a/scrapy/templates/project/module/pipelines.py.tmpl b/scrapy/templates/project/module/pipelines.py.tmplindex e58dab089..fb641d447 100644--- a/scrapy/templates/project/module/pipelines.py.tmpl+++ b/scrapy/templates/project/module/pipelines.py.tmpl@@ -3,7 +3,7 @@# Define your item pipelines here## Don't forget to add your pipeline to the ITEM_PIPELINES setting-# See: https://doc.scrapy.org/en/latest/topics/item-pipeline.html+# See: https://docs.scrapy.org/en/latest/topics/item-pipeline.htmlclass ${ProjectName}Pipeline(object):diff --git a/scrapy/templates/project/module/settings.py.tmpl b/scrapy/templates/project/module/settings.py.tmplindex a0557473e..cb220eafc 100644--- a/scrapy/templates/project/module/settings.py.tmpl+++ b/scrapy/templates/project/module/settings.py.tmpl@@ -5,9 +5,9 @@# For simplicity, this file contains only settings considered important or# commonly used. You can find more settings consulting the documentation:#-# https://doc.scrapy.org/en/latest/topics/settings.html-# https://doc.scrapy.org/en/latest/topics/downloader-middleware.html-# https://doc.scrapy.org/en/latest/topics/spider-middleware.html+# https://docs.scrapy.org/en/latest/topics/settings.html+# https://docs.scrapy.org/en/latest/topics/downloader-middleware.html+# https://docs.scrapy.org/en/latest/topics/spider-middleware.htmlBOT_NAME = '$project_name'@@ -25,7 +25,7 @@ ROBOTSTXT_OBEY = True#CONCURRENT_REQUESTS = 32# Configure a delay for requests for the same website (default: 0)-# See https://doc.scrapy.org/en/latest/topics/settings.html#download-delay+# See https://docs.scrapy.org/en/latest/topics/settings.html#download-delay# See also autothrottle settings and docs#DOWNLOAD_DELAY = 3# The download delay setting will honor only one of:@@ -45,31 +45,31 @@ ROBOTSTXT_OBEY = True#}# Enable or disable spider middlewares-# See https://doc.scrapy.org/en/latest/topics/spider-middleware.html+# See https://docs.scrapy.org/en/latest/topics/spider-middleware.html#SPIDER_MIDDLEWARES = {# '$project_name.middlewares.${ProjectName}SpiderMiddleware': 543,#}# Enable or disable downloader middlewares-# See https://doc.scrapy.org/en/latest/topics/downloader-middleware.html+# See https://docs.scrapy.org/en/latest/topics/downloader-middleware.html#DOWNLOADER_MIDDLEWARES = {# '$project_name.middlewares.${ProjectName}DownloaderMiddleware': 543,#}# Enable or disable extensions-# See https://doc.scrapy.org/en/latest/topics/extensions.html+# See https://docs.scrapy.org/en/latest/topics/extensions.html#EXTENSIONS = {# 'scrapy.extensions.telnet.TelnetConsole': None,#}# Configure item pipelines-# See https://doc.scrapy.org/en/latest/topics/item-pipeline.html+# See https://docs.scrapy.org/en/latest/topics/item-pipeline.html#ITEM_PIPELINES = {# '$project_name.pipelines.${ProjectName}Pipeline': 300,#}# Enable and configure the AutoThrottle extension (disabled by default)-# See https://doc.scrapy.org/en/latest/topics/autothrottle.html+# See https://docs.scrapy.org/en/latest/topics/autothrottle.html#AUTOTHROTTLE_ENABLED = True# The initial download delay#AUTOTHROTTLE_START_DELAY = 5@@ -82,7 +82,7 @@ ROBOTSTXT_OBEY = True#AUTOTHROTTLE_DEBUG = False# Enable and configure HTTP caching (disabled by default)-# See https://doc.scrapy.org/en/latest/topics/downloader-middleware.html#httpcache-middleware-settings+# See https://docs.scrapy.org/en/latest/topics/downloader-middleware.html#httpcache-middleware-settings#HTTPCACHE_ENABLED = True#HTTPCACHE_EXPIRATION_SECS = 0#HTTPCACHE_DIR = 'httpcache'diff --git a/sep/sep-001.rst b/sep/sep-001.rstindex 3766f38fc..2a66f9802 100644--- a/sep/sep-001.rst+++ b/sep/sep-001.rst@@ -61,7 +61,7 @@ ItemForm--------Pros:-- same API used for Items (see https://doc.scrapy.org/en/latest/topics/items.html)+- same API used for Items (see https://docs.scrapy.org/en/latest/topics/items.html)- some people consider setitem API more elegant than methods APICons:diff --git a/sep/sep-006.rst b/sep/sep-006.rstindex 7425c0930..366fcf033 100644--- a/sep/sep-006.rst+++ b/sep/sep-006.rst@@ -16,7 +16,7 @@ Motivation==========When you use Selectors in Scrapy, your final goal is to "extract" the data that-you've selected, as the [https://doc.scrapy.org/en/latest/topics/selectors.html+you've selected, as the [https://docs.scrapy.org/en/latest/topics/selectors.htmlXPath Selectors documentation] says (bolding by me):When you’re scraping web pages, the most common task you need to perform is@@ -71,5 +71,5 @@ webpage or set of pages.References==========- 1. XPath Selectors (https://doc.scrapy.org/topics/selectors.html)+ 1. XPath Selectors (https://docs.scrapy.org/topics/selectors.html)2. XPath and XSLT with lxml (http://lxml.de/xpathxslt.html)diff --git a/tests/__init__.py b/tests/__init__.pyindex 55b1ecde8..a54367f8c 100644--- a/tests/__init__.py+++ b/tests/__init__.py@@ -1,7 +1,7 @@"""tests: this package contains all Scrapy unittests-see https://doc.scrapy.org/en/latest/contributing.html#running-tests+see https://docs.scrapy.org/en/latest/contributing.html#running-tests"""import os