Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Cover the signature change of scrape_func (#7875)

Adrian639fac78b310
diff --git a/docs/news.rst b/docs/news.rst
index 670843e0e..a5cc6c723 100644
--- a/docs/news.rst
+++ b/docs/news.rst
@@ -2042,6 +2042,13 @@ Backward-incompatible changes
``process_start_requests()`` has been replaced by ``process_start()``.
(:issue:`6729`)
+- The ``scrape_func`` callable passed to
+ ``scrapy.core.spidermw.SpiderMiddlewareManager.scrape_response()`` is now
+ called with 2 parameters, ``response`` and ``request``, instead of 3, and
+ must return a :class:`~twisted.internet.defer.Deferred` instead of an
+ iterable.
+ (:issue:`6787`)
+
- The now-deprecated ``start_requests()`` method, when it returns an iterable
instead of being defined as a generator, is now executed *after* the
:ref:`scheduler <topics-scheduler>` instance has been created.