Scrapy, a fast high-level web crawling & scraping framework for Python.
Merge remote-tracking branch 'origin/master' into release-notes-1.2
Paul Tremberthd52fbf2045d3
diff --cc docs/news.rstindex 985eeb796,0e9efe6f6..0ee7642cf--- a/docs/news.rst+++ b/docs/news.rst@@@ -3,59 -3,23 +3,74 @@@Release notes=============+1.2.0 (YYYY-MM-DD)+------------------++New Features+~~~~~~~~~~~~++- New :setting:`FEED_EXPORT_ENCODING` setting to customize the encoding+ used when writing items to a file. This is useful for those wanting+ something else than UTF-8 for XML or CSV output (:issue:`2034`).+- ``startproject`` command now supports an optional destination directory+ to override the default one based on the project name (:issue:`2005`).+- New :setting:`SCHEDULER_DEBUG` setting to log requests serialization+ failures (:issue:`1610`).+- JSON encoder now supports serialization of ``set`` instances (:issue:`2058`).+- Interpret ``application/json-amazonui-streaming`` as ``TextResponse`` (:issue:`1503`).+- ``scrapy`` is imported by default when using shell tools (:command:`shell`,+ :ref:`inspect_response <topics-shell-inspect-response>`) (:issue:`2248`).++Bug fixes+~~~~~~~~~++- DefaultRequestHeaders middleware now runs before UserAgent middleware+ (:issue:`2088`). **Warning: this is technically backwards incompatible**,+ though we consider this a bug fix.+- ``Selector`` does not allow passing both ``response`` and ``text`` anymore+ (:issue:`2153`).+- Fixed logging of wrong callback name with ``scrapy parse`` (:issue:`2169`).+- Fix for an odd gzip decompression bug (:issue:`1606`).+- Fix for selected callbacks when using ``CrawlSpider`` with :command:`scrapy parse <parse>`+ (:issue:`2225`).+- Fix for invalid JSON and XML files when spider yields no items (:issue:`872`).+- Implement ``flush()`` fpr ``StreamLogger`` avoiding a warning in logs (:issue:`2125`).++Refactoring+~~~~~~~~~~~++- ``canonicalize_url`` has been moved to `w3lib.url`_ (:issue:`2168`).++.. _w3lib.url: http://w3lib.readthedocs.io/en/latest/w3lib.html#w3lib.url.canonicalize_url++Documentation+~~~~~~~~~~~~~+- - :ref:`Overview <intro-overview>` and :ref:`tutorial <intro-tutorial>`- rewritten to use http://toscrape.com websites (:issue:`2236`, :issue:`2249`).+- Grammar fixes: :issue:`2128`, :issue:`1566`.+- Download stats badge removed from README (:issue:`2160`).+- New scrapy :ref:`architecture diagram <topics-architecture>` (:issue:`2165`).+- Updated ``Response`` parameters documentation (:issue:`2197`).+- Reworded misleading :setting:`RANDOMIZE_DOWNLOAD_DELAY` description (:issue:`2190`).+- Add StackOverflow as a support channel (:issue:`2257`).+++ 1.1.3 (2016-09-22)+ ------------------++ Bug fixes+ ~~~~~~~~~++ - Class attributes for subclasses of ``ImagesPipeline`` and ``FilesPipeline``+ work as they did before 1.1.1 (:issue:`2243`, fixes :issue:`2198`)++ Documentation+ ~~~~~~~~~~~~~++ - :ref:`Overview <intro-overview>` and :ref:`tutorial <intro-tutorial>`+ rewritten to use http://toscrape.com websites+ (:issue:`2236`, :issue:`2249`, :issue:`2252`).++1.1.2 (2016-08-18)------------------