Scrapy, a fast high-level web crawling & scraping framework for Python.
DOC fix after bad merge - remove duplicate entries in changelog
Mikhail Korobov2c8c8b2dd868
diff --git a/docs/news.rst b/docs/news.rstindex a4f07efad..4711d2f35 100644--- a/docs/news.rst+++ b/docs/news.rst@@ -26,7 +26,6 @@ Highlights:* various bug fixes, small new features and usability improvements acrossthe codebase.-Selector API changes~~~~~~~~~~~~~~~~~~~~@@ -82,6 +81,8 @@ New extensibility features* new SitemapSpider :meth:`~.SitemapSpider.sitemap_filter` method which allowsto select sitemap entries based on their attributes in SitemapSpidersubclasses (:issue:`3512`).+* Lazy loading of Downloader Handlers is now optional; this enables better+ initialization error handling in custom Downloader Handlers (:issue:`3394`).New FilePipeline and MediaPipeline features~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~@@ -104,34 +105,20 @@ New FilePipeline and MediaPipeline features* Fixed errback handling in contracts, e.g. for cases where a contractis executed for URL which returns non-200 response (:issue:`3371`).-Usability and other improvements, cleanups-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~+Usability improvements+~~~~~~~~~~~~~~~~~~~~~~-* All Scrapy tests now pass on Windows; Scrapy testing suite is executed- in a Windows environment on CI (:issue:`3315`).-* Python 3.7 support (:issue:`3326`, :issue:`3150`, :issue:`3547`).-* Lazy loading of Downloader Handlers is now optional; this enables better- initialization error handling in custom Downloader Handlers (:issue:`3394`).-* Testing and CI fixes (:issue:`3526`, :issue:`3538`, :issue:`3308`,- :issue:`3311`, :issue:`3309`, :issue:`3305`, :issue:`3210`, :issue:`3299`)-* better error message when an exporter is disabled (:issue:`3358`);-* ``scrapy.http.cookies.CookieJar.clear`` accepts "domain", "path" and "name"- optional arguments (:issue:`3231`).* more stats for RobotsTxtMiddleware (:issue:`3100`)* INFO log level is used to show telnet host/port (:issue:`3115`)* a message is added to IgnoreRequest in RobotsTxtMiddleware (:issue:`3113`)* better validation of ``url`` argument in ``Response.follow`` (:issue:`3131`)* non-zero exit code is returned from Scrapy commands when error happens- on spider inititalization (:issue:`3226`);-* link extraction improvements: "ftp" is added to scheme list (:issue:`3152`);+ on spider inititalization (:issue:`3226`)+* Link extraction improvements: "ftp" is added to scheme list (:issue:`3152`);"flv" is added to common video extensions (:issue:`3165`)+* better error message when an exporter is disabled (:issue:`3358`);* `scrapy shell --help` mentions syntax required for local files(``./file.html``) - :issue:`3496`.-* additional files are included to sdist (:issue:`3495`);-* code style fixes (:issue:`3405`, :issue:`3304`);-* unneeded .strip() call is removed (:issue:`3519`);-* collections.deque is used to store MiddlewareManager methods instead- of a list (:issue:`3476`)* Referer header value is added to RFPDupeFilter log messages (:issue:`3588`)Bug fixes@@ -195,44 +182,21 @@ Other deprecation removals:* Deprecated ``Settings.overrides`` and ``Settings.defaults`` attributesare removed (:issue:`3327`, :issue:`3359`).-Internal improvements-~~~~~~~~~~~~~~~~~~~~~+Other improvements, cleanups+~~~~~~~~~~~~~~~~~~~~~~~~~~~~-* ``from_crawler`` support is added to dupefilters (:issue:`2956`); this allows- to access e.g. settings or a spider from a dupefilter.-* :signal:`item_error` is fired when an error happens in a pipeline- (:issue:`3256`);-* :signal:`request_reached_downloader` is fired when Downloader gets- a new Request; this signal can be useful e.g. for custom Schedulers- (:issue:`3393`).+* All Scrapy tests now pass on Windows; Scrapy testing suite is executed+ in a Windows environment on CI (:issue:`3315`).+* Python 3.7 support (:issue:`3326`, :issue:`3150`, :issue:`3547`).+* Testing and CI fixes (:issue:`3526`, :issue:`3538`, :issue:`3308`,+ :issue:`3311`, :issue:`3309`, :issue:`3305`, :issue:`3210`, :issue:`3299`)* ``scrapy.http.cookies.CookieJar.clear`` accepts "domain", "path" and "name"optional arguments (:issue:`3231`).--Usability improvements-~~~~~~~~~~~~~~~~~~~~~~--* more stats for RobotsTxtMiddleware (:issue:`3100`)-* INFO log level is used to show telnet host/port (:issue:`3115`)-* a message is added to IgnoreRequest in RobotsTxtMiddleware (:issue:`3113`)-* better validation of ``url`` argument in ``Response.follow`` (:issue:`3131`)-* non-zero exit code is returned from Scrapy commands when error happens- on spider inititalization (:issue:`3226`)-* Link extraction improvements: "ftp" is added to scheme list (:issue:`3152`);- "flv" is added to common video extensions (:issue:`3165`)--Bug fixes-~~~~~~~~~-* proper handling of pickling errors in Python 3 when serializing objects- for disk queues (:issue:`3082`)-* flags are now preserved when copying Requests (:issue:`3342`);-* FormRequest.from_response clickdata shouldn't ignore elements with- ``input[type=image]`` (:issue:`3153`).-* FormRequest.from_response should preserve duplicate keys (:issue:`3247`)--Cleanups-~~~~~~~~* additional files are included to sdist (:issue:`3495`);-* code style fixes (:issue:`3405`, :issue:`3304`)+* code style fixes (:issue:`3405`, :issue:`3304`);+* unneeded .strip() call is removed (:issue:`3519`);+* collections.deque is used to store MiddlewareManager methods instead+ of a list (:issue:`3476`).. _release-1.5.2: