Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

Remove all non-cached urlparsing references
Paul Tremberth committed 10 years ago
f6a800f
Use urlparse_cached() for OriginWhenCrossOriginPolicy
Paul Tremberth committed 10 years ago
59cb884
Use urlparse_cached() for OriginPolicy
Paul Tremberth committed 10 years ago
f2ee6be
Use urlparse_cached() on request and responses
Paul Tremberth committed 10 years ago
3af88a2
Add tests for the different referrer policies
Paul Tremberth committed 10 years ago
7ec1b5f
WIP Add Referrer policies
Paul Tremberth committed 10 years ago
baed7c4
Spider middleware: process_spider_exception on generators
Eugenio Lacuesta committed 10 years ago
706ed0e
Handle data loss gracefully.
Rolando Espinoza committed 9 years ago
f01ae6f
2f28cb3
0e5ed21
Re-enable FTP tests on Python 3
Paul Tremberth committed 9 years ago
0b90c3b
Merge pull request #2543 from scrapy/retry-stats
Mikhail Korobov committed 9 years ago
c72ba07
Merge pull request #2596 from arvindch/patch-1
Konstantin Lopuhin committed 9 years ago
9a5479c
Use single quotes uniformly
Arvind Chembarpu committed 9 years ago
e85f0db
Merge pull request #2595 from Lodour/master
Mikhail Korobov committed 9 years ago
d6a8288
Add omitted "self" arguments
mangogao committed 9 years ago
4274f0d
fixed typo
MikeinRealLife committed 9 years ago
441f255
fixed ticket #2574
MikeinRealLife committed 9 years ago
96a570a
Add data URI download handler to settings.
Artur Gaspar committed 9 years ago
3139f4a
Rename data URI downloader module.
Artur Gaspar committed 9 years ago
121a668
Use w3lib data URI parser.
Artur Gaspar committed 9 years ago
c847e7d
3397d27
7e9f2c3
data URI download handler.
Artur Gaspar committed 10 years ago
d60642e
Merge pull request #2566 from scrapy/httperror-stats
Mikhail Korobov committed 9 years ago
ce8a9aa
HttpErrorMiddleware stats
Mikhail Korobov committed 9 years ago
26c1256
Merge pull request #2577 from redapple/cleanup-ctxfactory
Mikhail Korobov committed 9 years ago
cac5119