Scrapy, a fast high-level web crawling & scraping framework for Python.
Change release section titles to have correct links in ToC
Paul Tremberthfd0b6faecb97
diff --git a/docs/news.rst b/docs/news.rstindex 450ab5542..b922690c1 100644--- a/docs/news.rst+++ b/docs/news.rst@@ -3,8 +3,8 @@Release notes=============-1.2.0 (YYYY-MM-DD)-------------------+Scrapy 1.2.0 (YYYY-MM-DD)+-------------------------New Features~~~~~~~~~~~~@@ -69,8 +69,8 @@ Documentation- Add StackOverflow as a support channel (:issue:`2257`).-1.1.3 (2016-09-22)-------------------+Scrapy 1.1.3 (2016-09-22)+-------------------------Bug fixes~~~~~~~~~@@ -86,8 +86,8 @@ Documentation(:issue:`2236`, :issue:`2249`, :issue:`2252`).-1.1.2 (2016-08-18)-------------------+Scrapy 1.1.2 (2016-08-18)+-------------------------Bug fixes~~~~~~~~~@@ -100,8 +100,8 @@ Bug fixes(the regression was introduced in 1.1.1)-1.1.1 (2016-07-13)-------------------+Scrapy 1.1.1 (2016-07-13)+-------------------------Bug fixes~~~~~~~~~@@ -152,8 +152,8 @@ Tests- Upgrade py.test requirement on Travis CI and Pin pytest-cov to 2.2.1 (:issue:`2095`)-1.1.0 (2016-05-11)-------------------+Scrapy 1.1.0 (2016-05-11)+-------------------------This 1.1 release brings a lot of interesting features and bug fixes:@@ -341,8 +341,8 @@ Bugfixesto same remote host (:issue:`1912`).-1.0.6 (2016-05-04)-------------------+Scrapy 1.0.6 (2016-05-04)+-------------------------- FIX: RetryMiddleware is now robust to non-standard HTTP status codes (:issue:`1857`)- FIX: Filestorage HTTP cache was checking wrong modified time (:issue:`1875`)@@ -350,8 +350,8 @@ Bugfixes- DOC: Consistency in selectors examples (:issue:`1869`)-1.0.5 (2016-02-04)-------------------+Scrapy 1.0.5 (2016-02-04)+-------------------------- FIX: [Backport] Ignore bogus links in LinkExtractors (fixes :issue:`907`, :commit:`108195e`)- TST: Changed buildbot makefile to use 'pytest' (:commit:`1f3d90a`)@@ -359,8 +359,8 @@ Bugfixes- DOC: Add AjaxCrawlMiddleware to DOWNLOADER_MIDDLEWARES_BASE in settings docs (:commit:`aa94121`)-1.0.4 (2015-12-30)-------------------+Scrapy 1.0.4 (2015-12-30)+-------------------------- Ignoring xlib/tx folder, depending on Twisted version. (:commit:`7dfa979`)- Run on new travis-ci infra (:commit:`6e42f0b`)@@ -411,14 +411,14 @@ Bugfixes- Small grammatical change (:commit:`8752294`)- Add openssl version to version command (:commit:`13c45ac`)-1.0.3 (2015-08-11)-------------------+Scrapy 1.0.3 (2015-08-11)+-------------------------- add service_identity to scrapy install_requires (:commit:`cbc2501`)- Workaround for travis#296 (:commit:`66af9cd`)-1.0.2 (2015-08-06)-------------------+Scrapy 1.0.2 (2015-08-06)+-------------------------- Twisted 15.3.0 does not raises PicklingError serializing lambda functions (:commit:`b04dd7d`)- Minor method name fix (:commit:`6f85c7f`)@@ -427,8 +427,8 @@ Bugfixes- Fixed typos (:commit:`a9ae7b0`)- Fix doc reference. (:commit:`7c8a4fe`)-1.0.1 (2015-07-01)-------------------+Scrapy 1.0.1 (2015-07-01)+-------------------------- Unquote request path before passing to FTPClient, it already escape paths (:commit:`cc00ad2`)- include tests/ to source distribution in MANIFEST.in (:commit:`eca227e`)@@ -437,8 +437,8 @@ Bugfixes- DOC remove version suffix from ubuntu package (:commit:`5303c66`)- DOC Update release date for 1.0 (:commit:`c89fa29`)-1.0.0 (2015-06-19)-------------------+Scrapy 1.0.0 (2015-06-19)+-------------------------You will find a lot of new features and bugfixes in this major release. Makesure to check our updated :ref:`overview <intro-overview>` to get a glance of@@ -803,8 +803,8 @@ Code refactoring(:issue:`805`)- rename "sflo" local variables to less cryptic "log_observer" (:issue:`775`)-0.24.6 (2015-04-20)--------------------+Scrapy 0.24.6 (2015-04-20)+--------------------------- encode invalid xpath with unicode_escape under PY2 (:commit:`07cb3e5`)- fix IPython shell scope issue and load IPython user config (:commit:`2c8e573`)@@ -813,8 +813,8 @@ Code refactoring- Converted sel.xpath() calls to response.xpath() in Extracting the data (:commit:`c2c6d15`)-0.24.5 (2015-02-25)--------------------+Scrapy 0.24.5 (2015-02-25)+--------------------------- Support new _getEndpoint Agent signatures on Twisted 15.0.0 (:commit:`540b9bc`)- DOC a couple more references are fixed (:commit:`b4c454b`)@@ -839,14 +839,14 @@ Code refactoring- Update request-response.rst (:commit:`3f3263d`)- SgmlLinkExtractor - fix for parsing <area> tag with Unicode present (:commit:`49b40f0`)-0.24.4 (2014-08-09)--------------------+Scrapy 0.24.4 (2014-08-09)+--------------------------- pem file is used by mockserver and required by scrapy bench (:commit:`5eddc68`)- scrapy bench needs scrapy.tests* (:commit:`d6cb999`)-0.24.3 (2014-08-09)--------------------+Scrapy 0.24.3 (2014-08-09)+--------------------------- no need to waste travis-ci time on py3 for 0.24 (:commit:`8e080c1`)- Update installation docs (:commit:`1d0c096`)@@ -878,23 +878,23 @@ Code refactoring- better testcase for settings.overrides.setdefault (:commit:`e22daaf`)- Using CRLF as line marker according to http 1.1 definition (:commit:`5ec430b`)-0.24.2 (2014-07-08)--------------------+Scrapy 0.24.2 (2014-07-08)+--------------------------- Use a mutable mapping to proxy deprecated settings.overrides and settings.defaults attribute (:commit:`e5e8133`)- there is not support for python3 yet (:commit:`3cd6146`)- Update python compatible version set to debian packages (:commit:`fa5d76b`)- DOC fix formatting in release notes (:commit:`c6a9e20`)-0.24.1 (2014-06-27)--------------------+Scrapy 0.24.1 (2014-06-27)+--------------------------- Fix deprecated CrawlerSettings and increase backwards compatibility with.defaults attribute (:commit:`8e3f20a`)-0.24.0 (2014-06-26)--------------------+Scrapy 0.24.0 (2014-06-26)+--------------------------Enhancements~~~~~~~~~~~~@@ -973,15 +973,15 @@ Bugfixes- Testsuite doesn't require PIL anymore (:issue:`585`)-0.22.2 (released 2014-02-14)-----------------------------+Scrapy 0.22.2 (released 2014-02-14)+------------------------------------ fix a reference to unexistent engine.slots. closes #593 (:commit:`13c099a`)- downloaderMW doc typo (spiderMW doc copy remnant) (:commit:`8ae11bf`)- Correct typos (:commit:`1346037`)-0.22.1 (released 2014-02-08)-----------------------------+Scrapy 0.22.1 (released 2014-02-08)+------------------------------------ localhost666 can resolve under certain circumstances (:commit:`2ec2279`)- test inspect.stack failure (:commit:`cc3eda3`)@@ -1009,8 +1009,8 @@ Bugfixes- fix 0.22.0 release date (:commit:`af0219a`)- fix typos in news.rst and remove (not released yet) header (:commit:`b7f58f4`)-0.22.0 (released 2014-01-17)-----------------------------+Scrapy 0.22.0 (released 2014-01-17)+-----------------------------------Enhancements~~~~~~~~~~~~@@ -1053,20 +1053,20 @@ Fixes- Fix tests runner under pip 1.5 (:issue:`513`)- Fix logging error when spider name is unicode (:issue:`479`)-0.20.2 (released 2013-12-09)-----------------------------+Scrapy 0.20.2 (released 2013-12-09)+------------------------------------ Update CrawlSpider Template with Selector changes (:commit:`6d1457d`)- fix method name in tutorial. closes GH-480 (:commit:`b4fc359`-0.20.1 (released 2013-11-28)-----------------------------+Scrapy 0.20.1 (released 2013-11-28)+------------------------------------ include_package_data is required to build wheels from published sources (:commit:`5ba1ad5`)- process_parallel was leaking the failures on its internal deferreds. closes #458 (:commit:`419a780`)-0.20.0 (released 2013-11-08)-----------------------------+Scrapy 0.20.0 (released 2013-11-08)+-----------------------------------Enhancements~~~~~~~~~~~~@@ -1153,15 +1153,15 @@ List of contributors sorted by number of commits::1 cacovsky <amarquesferraz@...>1 Berend Iwema <berend@...>-0.18.4 (released 2013-10-10)-----------------------------+Scrapy 0.18.4 (released 2013-10-10)+------------------------------------ IPython refuses to update the namespace. fix #396 (:commit:`3d32c4f`)- Fix AlreadyCalledError replacing a request in shell command. closes #407 (:commit:`b1d8919`)- Fix start_requests laziness and early hangs (:commit:`89faf52`)-0.18.3 (released 2013-10-03)-----------------------------+Scrapy 0.18.3 (released 2013-10-03)+------------------------------------ fix regression on lazy evaluation of start requests (:commit:`12693a5`)- forms: do not submit reset inputs (:commit:`e429f63`)@@ -1169,14 +1169,14 @@ List of contributors sorted by number of commits::- backport master fixes to json exporter (:commit:`cfc2d46`)- Fix permission and set umask before generating sdist tarball (:commit:`06149e0`)-0.18.2 (released 2013-09-03)-----------------------------+Scrapy 0.18.2 (released 2013-09-03)+------------------------------------ Backport `scrapy check` command fixes and backward compatible multicrawler process(:issue:`339`)-0.18.1 (released 2013-08-27)-----------------------------+Scrapy 0.18.1 (released 2013-08-27)+------------------------------------ remove extra import added by cherry picked changes (:commit:`d20304e`)- fix crawling tests under twisted pre 11.0.0 (:commit:`1994f38`)@@ -1194,8 +1194,8 @@ List of contributors sorted by number of commits::- minor updates to 0.18 release notes (:commit:`c45e5f1`)- fix contributters list format (:commit:`0b60031`)-0.18.0 (released 2013-08-09)-----------------------------+Scrapy 0.18.0 (released 2013-08-09)+------------------------------------ Lot of improvements to testsuite run using Tox, including a way to test on pypi- Handle GET parameters for AJAX crawleable urls (:commit:`3fe2a32`)@@ -1286,8 +1286,8 @@ contributors sorted by number of commits::1 Berend Iwema <berend@...>-0.16.5 (released 2013-05-30)-----------------------------+Scrapy 0.16.5 (released 2013-05-30)+------------------------------------ obey request method when scrapy deploy is redirected to a new endpoint (:commit:`8c4fcee`)- fix inaccurate downloader middleware documentation. refs #280 (:commit:`40667cb`)@@ -1295,8 +1295,8 @@ contributors sorted by number of commits::- Find form nodes in invalid html5 documents (:commit:`e3d6945`)- Fix typo labeling attrs type bool instead of list (:commit:`a274276`)-0.16.4 (released 2013-01-23)-----------------------------+Scrapy 0.16.4 (released 2013-01-23)+------------------------------------ fixes spelling errors in documentation (:commit:`6d2b3aa`)- add doc about disabling an extension. refs #132 (:commit:`c90de33`)@@ -1307,8 +1307,8 @@ contributors sorted by number of commits::- fix bug in scrapy parse command when spider is not specified explicitly. closes #209 (:commit:`c72e682`)- Update docs/topics/commands.rst (:commit:`28eac7a`)-0.16.3 (released 2012-12-07)-----------------------------+Scrapy 0.16.3 (released 2012-12-07)+------------------------------------ Remove concurrency limitation when using download delays and still ensure inter-request delays are enforced (:commit:`487b9b5`)- add error details when image pipeline fails (:commit:`8232569`)@@ -1320,8 +1320,8 @@ contributors sorted by number of commits::- Fixed docs typo in SpiderOpenCloseLogging example (:commit:`7184094`)-0.16.2 (released 2012-11-09)-----------------------------+Scrapy 0.16.2 (released 2012-11-09)+------------------------------------ scrapy contracts: python2.6 compat (:commit:`a4a9199`)- scrapy contracts verbose option (:commit:`ec41673`)@@ -1331,8 +1331,8 @@ contributors sorted by number of commits::- Fix SpiderState bug in Windows platforms (:commit:`58998f4`)-0.16.1 (released 2012-10-26)-----------------------------+Scrapy 0.16.1 (released 2012-10-26)+------------------------------------ fixed LogStats extension, which got broken after a wrong merge before the 0.16 release (:commit:`8c780fd`)- better backwards compatibility for scrapy.conf.settings (:commit:`3403089`)@@ -1342,8 +1342,8 @@ contributors sorted by number of commits::- set release date for 0.16.0 in news (:commit:`e292246`)-0.16.0 (released 2012-10-18)-----------------------------+Scrapy 0.16.0 (released 2012-10-18)+-----------------------------------Scrapy changes:@@ -1384,8 +1384,8 @@ Scrapy changes:- number received responses are now tracked through Scrapy stats (stat name: ``response_received_count``)- removed ``scrapy.log.started`` attribute-0.14.4-------+Scrapy 0.14.4+-------------- added precise to supported ubuntu distros (:commit:`b7e46df`)- fixed bug in json-rpc webservice reported in https://groups.google.com/forum/#!topic/scrapy-users/qgVBmFybNAQ/discussion. also removed no longer supported 'run' command from extras/scrapy-ws.py (:commit:`340fbdb`)@@ -1393,8 +1393,8 @@ Scrapy changes:- replace "import Image" by more standard "from PIL import Image". closes #88 (:commit:`4d17048`)- return trial status as bin/runtests.sh exit value. #118 (:commit:`b7b2e7f`)-0.14.3-------+Scrapy 0.14.3+-------------- forgot to include pydispatch license. #118 (:commit:`fd85f9c`)- include egg files used by testsuite in source distribution. #118 (:commit:`c897793`)@@ -1406,8 +1406,8 @@ Scrapy changes:- fixed minor defect in link extractors documentation (:commit:`ba14f38`)- removed some obsolete remaining code related to sqlite support in scrapy (:commit:`0665175`)-0.14.2-------+Scrapy 0.14.2+-------------- move buffer pointing to start of file before computing checksum. refs #92 (:commit:`6a5bef2`)- Compute image checksum before persisting images. closes #92 (:commit:`9817df1`)@@ -1421,8 +1421,8 @@ Scrapy changes:- scrapyd: fixed documentation link (:commit:`2b4e4c3`)- extras/makedeb.py: no longer obtaining version from git (:commit:`caffe0e`)-0.14.1-------+Scrapy 0.14.1+-------------- extras/makedeb.py: no longer obtaining version from git (:commit:`caffe0e`)- bumped version to 0.14.1 (:commit:`6cb9e1c`)@@ -1436,8 +1436,8 @@ Scrapy changes:- Avoid _disconnectedDeferred AttributeError exception in Twisted>=11.1.0 (:commit:`98f3f87`)- allow spider to set autothrottle max concurrency (:commit:`175a4b5`)-0.14-----+Scrapy 0.14+-----------New features and settings~~~~~~~~~~~~~~~~~~~~~~~~~@@ -1504,8 +1504,8 @@ Code rearranged and removed- Renamed attributes of core components: downloader.sites -> downloader.slots, scraper.sites -> scraper.slots (:rev:`2717`, :rev:`2718`)- Renamed setting ``CLOSESPIDER_ITEMPASSED`` to :setting:`CLOSESPIDER_ITEMCOUNT` (:rev:`2655`). Backwards compatibility kept.-0.12-----+Scrapy 0.12+-----------The numbers like #NNN reference tickets in the old issue tracker (Trac) which is no longer available.@@ -1547,8 +1547,8 @@ Deprecated/obsoleted functionality- Deprecated ``queue`` command in favor of using Scrapyd ``schedule.json`` API. See also: Scrapyd changes- Removed the !LxmlItemLoader (experimental contrib which never graduated to main contrib)-0.10-----+Scrapy 0.10+-----------The numbers like #NNN reference tickets in the old issue tracker (Trac) which is no longer available.@@ -1620,8 +1620,8 @@ Changes to settings- Removed ``COMMANDS_SETTINGS_MODULE`` setting (#201)- Renamed ``REQUEST_HANDLERS`` to ``DOWNLOAD_HANDLERS`` and make download handlers classes (instead of functions)-0.9----+Scrapy 0.9+----------The numbers like #NNN reference tickets in the old issue tracker (Trac) which is no longer available.@@ -1660,8 +1660,8 @@ Changes to default settings- Changed default ``SCHEDULER_ORDER`` to ``DFO`` (:rev:`1939`)-0.8----+Scrapy 0.8+----------The numbers like #NNN reference tickets in the old issue tracker (Trac) which is no longer available.@@ -1706,8 +1706,8 @@ Backwards-incompatible changes- Renamed extension: ``DelayedCloseDomain`` to ``SpiderCloseDelay`` (:rev:`1861` | #121)- Removed obsolete ``scrapy.utils.markup.remove_escape_chars`` function - use ``scrapy.utils.markup.replace_escape_chars`` instead (:rev:`1865`)-0.7----+Scrapy 0.7+----------First release of Scrapy.