Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

Make Twisted[http2] installation optional (#5113)
Adrián Chaves committed 5 years ago
c5b1ee8
More documentation for setting spider atributes
Shinichi Takayanagi committed 5 years ago
bd60c3f
Refactor request to/from dict (#5130)
Eugenio Lacuesta committed 5 years ago
cec36a9
34b2162
Request type hints
Eugenio Lacuesta committed 5 years ago
19c7415
Merge pull request #5122 from hrnciar/patch-1
Andrey Rahmatullin committed 5 years ago
e27eff4
Deprecate unused squeues (#5117)
Eugenio Lacuesta committed 5 years ago
02ae1de
Scheduler: minimal interface, API docs (#3559)
Eugenio Lacuesta committed 5 years ago
ddea6b7
Add peek method to queues (#5112)
Eugenio Lacuesta committed 5 years ago
6837919
Merge pull request #5082 from storymode7/shell-fix
Andrey Rahmatullin committed 5 years ago
7095df1
Dupefilter type hints (#5108)
Eugenio Lacuesta committed 5 years ago
e779ed7
Engine: remove unnecessary parameter (#5106)
Eugenio Lacuesta committed 5 years ago
e3f81d8
Engine: deprecations and type hints (#5090)
Eugenio Lacuesta committed 5 years ago
7e23677
Merge pull request #5070 from ric2b/patch-1
Andrey Rahmatullin committed 5 years ago
5b78a64
Merge pull request #5100 from wRAR/more-scraper-typing
Andrey Rahmatullin committed 5 years ago
06f3d12
Small changes.
Andrey Rakhmatullin committed 5 years ago
309a637
Additional typing for scraper and a small code change.
Andrey Rakhmatullin committed 5 years ago
77bff0d
Update scrapy/core/spidermw.py
Andrey Rahmatullin committed 5 years ago
9db01a4
Add/update typing, cleanup iterator/iterable inconsistencies.
Andrey Rakhmatullin committed 5 years ago
61197d3
Merge pull request #5077 from wRAR/deferred-typing
Andrey Rahmatullin committed 5 years ago
9bf9ab7
Import Deferred directly in scrapy/utils/defer.py.
Andrey Rakhmatullin committed 5 years ago
08e4eaf
Import Deferred directly in scrapy/middleware.py.
Andrey Rakhmatullin committed 5 years ago
cef0a8b
Update scrapy/utils/defer.py
Andrey Rahmatullin committed 5 years ago
a8de04c
Update scrapy/middleware.py
Andrey Rahmatullin committed 5 years ago
b0e7512
Update scrapy/core/spidermw.py
Andrey Rahmatullin committed 5 years ago
335a256
Add typing also for return values, other small fixes.
Andrey Rakhmatullin committed 5 years ago
76fa225