Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

upper-constraints.txt: restrict botocore further
Adrián Chaves committed 5 years ago
8e73e1d
Simplify the get_retry_request code example
Adrián Chaves committed 5 years ago
9420161
Merge pull request #4769 from scrapy/http2
Adrián Chaves committed 5 years ago
1d83697
Support Python 3.9 (#4759)
vinayak committed 5 years ago
42e4dbb
Remove unnecesary del statement
Eugenio Lacuesta committed 5 years ago
2f61d7c
simpler stats access
Dmitriy Pomazunovskiy committed 5 years ago
9cc4513
get_retry_request: add typing information
Adrián Chaves committed 5 years ago
c0f3ca1
Test from_settings
Dmitriy Pomazunovskiy committed 5 years ago
0f254a6
Use from_settings for backward compatibility
Dmitriy Pomazunovskiy committed 5 years ago
d4b2b61
Log skipped urls by length to INFO, add skipped stats
Dmitriy Pomazunovskiy committed 5 years ago
6e5ea79
Merge pull request #5016 from deepang17/scrapy-4996
Mikhail Korobov committed 5 years ago
ab037ab
headers_received signal (#4897)
Eugenio Lacuesta committed 5 years ago
0c16088
Remove unused _is_data_lost method
Adrián Chaves committed 5 years ago
3bea5e1
Merge branch 'master' into http2
Adrián Chaves committed 5 years ago
5b2d3e1
FIX: Updated benchmarking.rst
deepang17 committed 5 years ago
3d88ac6
Merge pull request #3667 from Gallaecio/long-allowed-domains
Andrey Rahmatullin committed 5 years ago
954c4b4
dfd4ab2
Merge pull request #5022 from Gallaecio/fix-ci
Andrey Rahmatullin committed 5 years ago
d50bedb
Limit tests to Twisted < 21
Adrián Chaves committed 5 years ago
4fe26ae
DOCS: Covered scrapy-bench
deepang17 committed 5 years ago
36f1dbf
Allow logger/stats customization in get_retry_request
Eugenio Lacuesta committed 5 years ago
9e62355
docs: Clarify there's one extension instance per spider
James McKinney committed 5 years ago
3c5668d
DOCS: Cover scrapy-bench in the documentation
deepang17 committed 5 years ago
b25616d
DOCS:Cover scrapy-bench in the documentation
deepang17 committed 5 years ago
7a54580
Merge pull request #5008 from Gallaecio/close-file
Mikhail Korobov committed 5 years ago
bda5472
f689615
386e2a5