Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Merge remote-tracking branch 'origin/master' into release-notes-1.2

Paul Tremberthd52fbf2045d3
diff --cc docs/news.rst
index 985eeb796,0e9efe6f6..0ee7642cf
--- a/docs/news.rst
+++ b/docs/news.rst
@@@ -3,59 -3,23 +3,74 @@@
Release notes
=============
+1.2.0 (YYYY-MM-DD)
+------------------
+
+New Features
+~~~~~~~~~~~~
+
+- New :setting:`FEED_EXPORT_ENCODING` setting to customize the encoding
+ used when writing items to a file. This is useful for those wanting
+ something else than UTF-8 for XML or CSV output (:issue:`2034`).
+- ``startproject`` command now supports an optional destination directory
+ to override the default one based on the project name (:issue:`2005`).
+- New :setting:`SCHEDULER_DEBUG` setting to log requests serialization
+ failures (:issue:`1610`).
+- JSON encoder now supports serialization of ``set`` instances (:issue:`2058`).
+- Interpret ``application/json-amazonui-streaming`` as ``TextResponse`` (:issue:`1503`).
+- ``scrapy`` is imported by default when using shell tools (:command:`shell`,
+ :ref:`inspect_response <topics-shell-inspect-response>`) (:issue:`2248`).
+
+Bug fixes
+~~~~~~~~~
+
+- DefaultRequestHeaders middleware now runs before UserAgent middleware
+ (:issue:`2088`). **Warning: this is technically backwards incompatible**,
+ though we consider this a bug fix.
+- ``Selector`` does not allow passing both ``response`` and ``text`` anymore
+ (:issue:`2153`).
+- Fixed logging of wrong callback name with ``scrapy parse`` (:issue:`2169`).
+- Fix for an odd gzip decompression bug (:issue:`1606`).
+- Fix for selected callbacks when using ``CrawlSpider`` with :command:`scrapy parse <parse>`
+ (:issue:`2225`).
+- Fix for invalid JSON and XML files when spider yields no items (:issue:`872`).
+- Implement ``flush()`` fpr ``StreamLogger`` avoiding a warning in logs (:issue:`2125`).
+
+Refactoring
+~~~~~~~~~~~
+
+- ``canonicalize_url`` has been moved to `w3lib.url`_ (:issue:`2168`).
+
+.. _w3lib.url: http://w3lib.readthedocs.io/en/latest/w3lib.html#w3lib.url.canonicalize_url
+
+Documentation
+~~~~~~~~~~~~~
+
- - :ref:`Overview <intro-overview>` and :ref:`tutorial <intro-tutorial>`
- rewritten to use http://toscrape.com websites (:issue:`2236`, :issue:`2249`).
+- Grammar fixes: :issue:`2128`, :issue:`1566`.
+- Download stats badge removed from README (:issue:`2160`).
+- New scrapy :ref:`architecture diagram <topics-architecture>` (:issue:`2165`).
+- Updated ``Response`` parameters documentation (:issue:`2197`).
+- Reworded misleading :setting:`RANDOMIZE_DOWNLOAD_DELAY` description (:issue:`2190`).
+- Add StackOverflow as a support channel (:issue:`2257`).
+
+
+ 1.1.3 (2016-09-22)
+ ------------------
+
+ Bug fixes
+ ~~~~~~~~~
+
+ - Class attributes for subclasses of ``ImagesPipeline`` and ``FilesPipeline``
+ work as they did before 1.1.1 (:issue:`2243`, fixes :issue:`2198`)
+
+ Documentation
+ ~~~~~~~~~~~~~
+
+ - :ref:`Overview <intro-overview>` and :ref:`tutorial <intro-tutorial>`
+ rewritten to use http://toscrape.com websites
+ (:issue:`2236`, :issue:`2249`, :issue:`2252`).
+
+
1.1.2 (2016-08-18)
------------------