Scrapy, a fast high-level web crawling & scraping framework for Python.
Address feedback.
Andrey Rakhmatullind1d6465ef4ea
diff --git a/docs/news.rst b/docs/news.rstindex 6cf366449..5f189760d 100644--- a/docs/news.rst+++ b/docs/news.rst@@ -10,7 +10,7 @@ Scrapy 2.9.0 (YYYY-MM-DD)Highlights:-- Per-domain request settings.+- Per-domain download settings.- Compatibility with new cryptography_ and new parsel_.- TBD@@ -19,7 +19,7 @@ New features- Settings correponding to :setting:`DOWNLOAD_DELAY`,:setting:`CONCURRENT_REQUESTS_PER_DOMAIN` and- :setting:`RANDOMIZE_DOWNLOAD_DELAY` can now be set on a per domain basis+ :setting:`RANDOMIZE_DOWNLOAD_DELAY` can now be set on a per-domain basisvia the new :setting:`DOWNLOAD_SLOTS` setting. (:issue:`5328`)- Added :func:`scrapy.utils.request.request_to_curl`, a function to produce a@@ -28,15 +28,32 @@ New features- Values of :setting:`FILES_STORE` and :setting:`IMAGES_STORE` can now be:class:`pathlib.Path` instances. (:issue:`5801`)+Bug fixes+~~~~~~~~~++- Fixed an error when using feed postprocessing with S3 storage.+ (:issue:`5500`, :issue:`5581`)++- Added the missing :meth:`scrapy.settings.BaseSettings.setdefault` method.+ (:issue:`5811`, :issue:`5821`)++- Fixed an error when using cryptography_ 40.0.0+ and+ :setting:`DOWNLOADER_CLIENT_TLS_VERBOSE_LOGGING` is enabled.+ (:issue:`5857`, :issue:`5858`)++- The checksums returned by :class:`~scrapy.pipelines.files.FilesPipeline`+ for files on Google Cloud Storage are no longer Base64-encoded.+ (:issue:`5874`, :issue:`5891`)+- :func:`scrapy.utils.request.request_from_curl` now supports $-prefixedstring values for the curl ``--data-raw`` argument, which are produced bybrowsers for data that includes certain symbols. (:issue:`5899`,:issue:`5901`)-- The ``scrapy parse`` command now also works with async generator callbacks.+- The :command:`parse` command now also works with async generator callbacks.(:issue:`5819`, :issue:`5824`)-- The ``scrapy genspider`` command now properly works with HTTPS URLs.+- The :command:`genspider` command now properly works with HTTPS URLs.(:issue:`3553`, :issue:`5808`)- Improved handling of asyncio loops. (:issue:`5831`, :issue:`5832`)@@ -48,23 +65,6 @@ New features- :func:`scrapy.utils.python.get_func_args` now supports more types ofcallables. (:issue:`5872`, :issue:`5885`)-Bug fixes-~~~~~~~~~--- Fixed an error when using feed postprocessing with S3 storage.- (:issue:`5500`, :issue:`5581`)--- Added the missing :meth:`scrapy.settings.BaseSettings.setdefault` method.- (:issue:`5811`, :issue:`5821`)--- Fixed an error when using cryptography_ 40.0.0+ and- :setting:`DOWNLOADER_CLIENT_TLS_VERBOSE_LOGGING` is enabled.- (:issue:`5857`, :issue:`5858`)--- The checksums returned by :class:`~scrapy.pipelines.files.FilesPipeline`- for files on Google Cloud Storage are no longer Base64-encoded.- (:issue:`5874`, :issue:`5891`)-- Fixed an error breaking user handling of send failures in:meth:`scrapy.mail.MailSender.send()`. (:issue:`1611`, :issue:`5880`)