Scrapy, a fast high-level web crawling & scraping framework for Python.
List merged pull requests since 1.3.3
Paul Tremberth851adcedf222
diff --git a/docs/news.rst b/docs/news.rstindex da856d883..675a6d595 100644--- a/docs/news.rst+++ b/docs/news.rst@@ -3,6 +3,78 @@Release notes=============+Scrapy 1.4.0 (2017-XX-XX)+-------------------------++New Features+~~~~~~~~~~~~++- Use credentials from request.meta['proxy'] #2530+- [httpcompression] add support for br - brotli content encoding #2535+- Enable memusage extension by default. #2539+- response.follow #2540+- add flags to request #2082+- Support Anonymous FTP #2343+- HttpErrorMiddleware stats #2566+- Retry stats #2543+- Set canonicalize=False for LinkExtractor #2537+- Referrer policies in RefererMiddleware #2306+- Fix referrer policy from response headers and support explicit empty string #2627+- Data URI download handler. #2334+- HttpCacheMiddleware: log cache directory at instantiation #2611+- Add warning on duplicate spider name #2612+- Allowed passing objects of Mapping class or its subclass to the CaselessDict initializer #2646+- Allow redirections in media files downloads #2616+- Travis CI: use portable pypy for Linux #2710+++Bug fixes+~~~~~~~~~++- LinkExtractors: strip whitespaces #2547+- FormRequest: handle whitespaces in action attribute properly #2548+- Buffer CONNECT response bytes from proxy until all HTTP headers are received #2495+- Fix FTP downloader and re-enable FTP tests on Python 3 #2599+- Handle data loss gracefully. #2590+- Use body to choose response type after decompression content #2393+- Always decompress Content-Encoding: gzip at HttpCompression stage #2391+- Respect custom log level (#2581, fixes #1612)+- [logformatter] 'flags' format spec backward compatibility #2649+- 'make htmlview' does not open the webbrowser #2661+- Remove "commands" from the command list #2695++Cleanups+~~~~~~~~++- TST remove temp files and folders #2570+- TST fixed ProjectUtilsTest on OS X #2569+- Separate building request from _requests_to_follow in CrawlSpider #2562+- remove “Python 3 progress” badge #2567+- add a couple more lines to gitignore #2557+- deprecate Spider.make_requests_from_url. #1728+- Remove bumpversion prerelease configuration #2159+- Set context factory implementation based on Twisted version #2577+- Add omitted "self" arguments #2595+- Remove redundant slot.add_request() call in ExecutionEngine #2617+- Removed contrib section in contribution documentation #2636+- More specific exception catching: os.path.getmtime can only raise os.error in FSFilesStore #2644++Documentation+~~~~~~~~~~~~~++- Doc: binary mode is required for exporters #2564+- document issue with FormRequest.from_response due to bug in lxml #2572+- Use single quotes uniformly #2596+- Document ftp_user and ftp_password meta keys #2587+- Update release notes for 1.0.7, 1.1.4 and 1.2.3 #2625+- DOC Mention brotli support in HttpCompressionMiddleware section #2628+- Removed contrib section in contribution documentation #2636+- docs: installation instructions, mention conda in the beginning (closes #2475) #2477+- FAQ Rewrite note on Python 3 support on Windows #2690+- DOC Rearrange selector sections #2705+- Remove __nonzero__ from SelectorList docs #2683++Scrapy 1.3.3 (2017-03-10)-------------------------@@ -15,6 +87,7 @@ Bug fixesA new setting is introduced to toggle between warning or exception if needed ;see :setting:`SPIDER_LOADER_WARN_ONLY` for details.+Scrapy 1.3.2 (2017-02-13)-------------------------