Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

Small fix for _get_slot_key().
Andrey Rakhmatullin committed 2 years ago
2cba789
Indicate that Selector.type can be json (#6334)
Sanchay Kumar committed 2 years ago
aa025d7
Fix Python 3.8.
Andrey Rakhmatullin committed 2 years ago
40e4a59
Skip coverage checks for TYPE_CHECKING blocks.
Andrey Rakhmatullin committed 2 years ago
4b47a5d
Full typing for scrapy/linkextractors.
Andrey Rakhmatullin committed 2 years ago
c76dfc3
Full typing for scrapy/http/cookies.py.
Andrey Rakhmatullin committed 2 years ago
8a08283
Use the Self type hint in from_crawler/from_settings.
Andrey Rakhmatullin committed 2 years ago
1f39430
Fixes for queuelib.
Andrey Rakhmatullin committed 2 years ago
bd0d4ce
Add queue typing to scrapy/core/scheduler.py.
Andrey Rakhmatullin committed 2 years ago
203fa96
Full typing for scrapy/squeues.py.
Andrey Rakhmatullin committed 2 years ago
5f7fd2a
Full typing for scrapy/robotstxt.py.
Andrey Rakhmatullin committed 2 years ago
b749db9
Full typing for scrapy/resolver.py.
Andrey Rakhmatullin committed 2 years ago
ad35ffd
Fix MutableMapping import for Python 3.8.
Andrey Rakhmatullin committed 2 years ago
21fa076
Full typing for scrapy/pqueues.py.
Andrey Rakhmatullin committed 2 years ago
0c8e21b
Full typing for scrapy/mail.py.
Andrey Rakhmatullin committed 2 years ago
38020e0
Full typing for scrapy/extension.py.
Andrey Rakhmatullin committed 2 years ago
08a265b
Full typing for scrapy/item.py.
Andrey Rakhmatullin committed 2 years ago
fc1a83e
Full typing for scrapy/cmdline.py.
Andrey Rakhmatullin committed 2 years ago
9eea22f
Typing for build_from_*. (#6326)
Andrey Rakhmatullin committed 2 years ago
d7da298
Full typing for scrapy/extensions, part 3. (#6325)
Andrey Rakhmatullin committed 2 years ago
57acad3
a166e97
Merge pull request #6221 from jxlil/fix/LxmlLinkExtractor
Andrey Rakhmatullin committed 2 years ago
a5da77d
Fix test expectations (#6316)
kokobhara committed 2 years ago
b1fe97d
chore: fix some typos in comments (#6317)
TechVest committed 2 years ago
5f67c01
Update practices.rst
Adrián Chaves committed 2 years ago
1d11ea3
Handle robots.txt files not UTF-8 encoded
Lorenzo Verardo committed 2 years ago
7b37dcd
f7bf3f7
Merge pull request #6242 from cankupeli/master
Andrey Rakhmatullin committed 2 years ago
02b97f9