Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Allow formdata value to be None to drop field generated from response

Harrison Gregg26f723e4e631
diff --git a/scrapy/http/request/form.py b/scrapy/http/request/form.py
index 905d8412f..d9d178a3e 100644
--- a/scrapy/http/request/form.py
+++ b/scrapy/http/request/form.py
@@ -135,7 +135,7 @@ def _get_inputs(form, formdata, dont_click, clickdata, response):
if clickable and clickable[0] not in formdata and not clickable[0] is None:
values.append(clickable)
- values.extend(formdata.items())
+ values.extend((k, v) for k, v in formdata.items() if v is not None)
return values