Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Spider middleware: use Mockserver to test process_spider_exception
4090cc3 Eugenio Lacuesta committed 9 years ago
Add SPIDER_LOADER_WARN_ONLY to toggle between spiderloader failure and warning
7be773e Paul Tremberth committed 9 years ago
Merge pull request #2612 from redapple/dupe-spider-name-tests
d3f8f3d Mikhail Korobov committed 9 years ago
Feed exports: consistent and backwards compatible behaviour on indent
c7bb2fa Eugenio Lacuesta committed 9 years ago
Feed exports: enforce difference between None and 0 on indent
766b2c8 Eugenio Lacuesta committed 9 years ago
Warn about modules where duplicate spider names were found
a017f7b Paul Tremberth committed 9 years ago
Merge pull request #2391 from redapple/always-gunzip-content-enc-gzip
802ed30 Mikhail Korobov committed 9 years ago
Always decompress Content-Encoding: gzip at HttpCompression stage
11cdf58 Paul Tremberth committed 10 years ago
Merge pull request #2393 from redapple/response-replace-encoding
6320b74 Mikhail Korobov committed 9 years ago
Use body to chose response type after decompression content
e42b846 Paul Tremberth committed 10 years ago
Merge pull request #2627 from redapple/referrer-empty-string-header
20c4f9f Mikhail Korobov committed 9 years ago
DOC Mention brotli support in HttpCompressionMiddleware section
2a7d391 Paul Tremberth committed 9 years ago
Fix referrer policy from response headers and support explicit empty string
768f315 Paul Tremberth committed 9 years ago
Merge pull request #2625 from redapple/release-notes-packaging-fix
d7b26ed Paul Tremberth committed 9 years ago
Merge pull request #2617 from redapple/engine-dupe-statement
2c5fa0c Mikhail Korobov committed 9 years ago
Remove redundant slot.add_request() call in ExecutionEngine
30d812e Paul Tremberth committed 9 years ago
Respect log settings in custom_settings: fixes GH-1612
ef04cfd Konstantin Lopuhin committed 9 years ago