Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Merge pull request #1725 from redapple/spiderstate-notconfigured
85f0596 Daniel Graña committed 10 years ago
Merge pull request #1726 from redapple/mwlist-logging-long
6660175 Mikhail Korobov committed 10 years ago
Use long classes names for enabled middlewares in startup logs
c22a4e3 Paul Tremberth committed 10 years ago
Add test for raised exception with SpiderState extension when no JOBDIR used
2969537 Paul Tremberth committed 10 years ago
Merge pull request #1724 from scrapy/robotstxt-default
0d368c5 Paul Tremberth committed 10 years ago
Enable robots.txt handling by default for new projects. Fixes GH-1668.
f30758c Mikhail Korobov committed 10 years ago
Merge pull request #1723 from redapple/closespider-notconfigured
2246280 Elias Dorneles committed 10 years ago
Merge pull request #1722 from redapple/mwlist-logging
1e48574 Mikhail Korobov committed 10 years ago
Disable CloseSpider extension if no CLOSPIDER_* setting set
6ee8d86 Paul Tremberth committed 10 years ago
Merge pull request #1721 from Digenis/offsitemw_subdomains
de22b6f Elias Dorneles committed 10 years ago
tests+doc for subdomains in offsite middleware
1cffa99 Νικόλαος-Διγενής Καραγιάννης committed 10 years ago
Update docs about local files support for "scrapy shell"
713e1ee Paul Tremberth committed 10 years ago
deprecate unused and untested scrapy.utils.datatypes.MultiValueDict
9c2aa50 Mikhail Korobov committed 10 years ago
deprecate unused and untested scrapy.utils.datatypes.SiteNode
7070dae Mikhail Korobov committed 10 years ago
Merge pull request #1716 from lopuhin/py3-test-pipeline-files-images
b204631 Daniel Graña committed 10 years ago