Scrapy, a fast high-level web crawling & scraping framework for Python.
Update spiders.rst
Qiwei Huang8ecc307e8f04
diff --git a/docs/topics/spiders.rst b/docs/topics/spiders.rstindex 9e27614d8..49c0cefb5 100644--- a/docs/topics/spiders.rst+++ b/docs/topics/spiders.rst@@ -80,8 +80,9 @@ scrapy.Spiderallowed to crawl. Requests for URLs not belonging to the domain namesspecified in this list (or their subdomains) won't be followed if:class:`~scrapy.spidermiddlewares.offsite.OffsiteMiddleware` is enabled.- .. note:: If you are scraping an url ``https://www.example.com/1.html``- you should add ``'example.com'`` to allowed_domains list.++ Let's say your target url is ``https://www.example.com/1.html``,+ then add ``'example.com'`` to the list... attribute:: start_urls