Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Let framework handle only HTTP redirects by default for fetch and shell commands
778bed0 Paul Tremberth committed 9 years ago
Merge pull request #2331 from moisesguimaraes/fixes-2272
ff3aec6 Mikhail Korobov committed 9 years ago
Merge pull request #2422 from rolando-contrib/nested-spiders-modules
a9c6945 Elias Dorneles committed 9 years ago
Merge pull request #2423 from redapple/release-notes-1.2.2
ea968c6 Paul Tremberth committed 9 years ago
Add reference to fixed scheduler settings documentation
aa2e1b0 Paul Tremberth committed 9 years ago
Merge pull request #2421 from rolando-contrib/tests-bug
c4e67c0 Elias Dorneles committed 9 years ago
Merge pull request #2388 from redapple/robotparser-native-str
f3a4420 Elias Dorneles committed 9 years ago
Merge pull request #2386 from rolando-contrib/manifest-tweak
826b7e9 Mikhail Korobov committed 9 years ago
TST Include nested a nested spider in spider loader test.
923b974 Rolando Espinoza committed 9 years ago
DOC State explicitly that spiders are loaded recursively.
6431e7a Rolando Espinoza committed 9 years ago
Merge pull request #2395 from elacuesta/robots_txt_relative_sitemap_url
5f0af90 Elias Dorneles committed 9 years ago
Merge pull request #2418 from ahlinc/fix_retriggered_issue_396
2086ff4 Elias Dorneles committed 9 years ago