Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

13735bc
Crawling rules: make link extractors optional
Eugenio Lacuesta committed 7 years ago
21ad8e2
Remove deprecated xlib module
Eugenio Lacuesta committed 7 years ago
c5612f3
Update docs/topics/downloader-middleware.rst
Vostretsov Nikita committed 7 years ago
66145b4
documentation rework
Vostretsov Nikita committed 7 years ago
171fa1c
add protego to install_requires
Vostretsov Nikita committed 7 years ago
c7f2bdf
update documentation
Vostretsov Nikita committed 7 years ago
6bd8871
newer version of protego and move up to top
Vostretsov Nikita committed 7 years ago
db20248
Update requirements-py2.txt
Vostretsov Nikita committed 7 years ago
7b33fa5
Update docs/topics/downloader-middleware.rst
Vostretsov Nikita committed 7 years ago
38828d3
use proper equal
Vostretsov Nikita committed 7 years ago
e418554
add pinned versions
Vostretsov Nikita committed 7 years ago
7af8c76
use protego as a default robots.txt parser
Vostretsov Nikita committed 7 years ago
9578f49
534de73
test for files pipeline ftp store
OmarFarrag committed 7 years ago
0e8770a
[test] cb_kwargs contract
Eugenio Lacuesta committed 7 years ago
b92b114
[doc] cb_kwargs contract
Eugenio Lacuesta committed 7 years ago
2061f2a
d4b8bf1
2828cb7
Fix JSONRequest naming (#3982)
Marc Hernández committed 7 years ago
ace2df3
Revert backward-incompatible change (contract priorities)
Eugenio Lacuesta committed 7 years ago
eb0bd2d
Merge
Júlio César Batista committed 7 years ago
b84f99f
Fix default value of FEED_STORAGE_GCS_ACL
Júlio César Batista committed 7 years ago
110bc92
Aplly suggestions by @victor-torres
Eugenio Lacuesta committed 7 years ago
97a7d77
CallbackKeywordArgumentsContract
Eugenio Lacuesta committed 7 years ago
b6b76df
ede9147
93d4b0b
Merge pull request #3978 from anubhavp28/doc-link-fix
Mikhail Korobov committed 7 years ago
b00f81c
makes suggested changes
Anubhav Patel committed 7 years ago
77c8ab2