Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Add deprecation warning for ChunkedTransfer middleware
e6f174b Paul Tremberth committed 10 years ago
Remove ChunkedTransferMiddleware from default settings
03cf5f1 Paul Tremberth committed 10 years ago
Handle redirects transparently by default in shell and fetch
35b655d Paul Tremberth committed 10 years ago
Print more dependencies versions in "scrapy version" verbose output
01142e2 Paul Tremberth committed 10 years ago
Merge pull request #2396 from redapple/ubuntu-packages-toc
a07400c Mikhail Korobov committed 10 years ago
Pass user-agent as native str when checking URLs against robots.txt
6cd35c7 Paul Tremberth committed 10 years ago
Merge pull request #2337 from muriloviana/add-middleware-template
1cbc57f Elias Dorneles committed 10 years ago
Merge pull request #2328 from scrapy/download-latency-meta-docs
570e12b Mikhail Korobov committed 10 years ago
Merge pull request #2275 from scrapy/response-css-xpath-message
de89b1b Paul Tremberth committed 10 years ago
Merge pull request #2387 from rolando-contribute/conda-forge-updates
6d6dc71 Mikhail Korobov committed 10 years ago
Update conda channel to conda-forge and show conda version badge.
76459e1 Rolando Espinoza committed 10 years ago
Merge pull request #2382 from redapple/slot-heartbeat-state-test
ea83e67 Mikhail Korobov committed 10 years ago
Add testcase for catching exception from open_spider() from pipeline
61efacd Paul Tremberth committed 10 years ago