Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Update feedstorage docs: add botocore, mention that boto is supported only on Python 2
e7c4806 Konstantin Lopuhin committed 10 years ago
py3 fix for TestS3FilesStore: checksum is a native string
3cb7a56 Konstantin Lopuhin committed 10 years ago
S3FeedStorageTest: pass on py3, add some non-ascii content to be sure
d1470e8 Konstantin Lopuhin committed 10 years ago
S3FeedStorageTest: add botocore support, and organize boto/botocore checks
3ada45a Konstantin Lopuhin committed 10 years ago
Fix assert_aws_environ: check for botocore with boto fallback on PY2
19b2910 Konstantin Lopuhin committed 10 years ago
Pass env variables required for running tests against real s3 via tox.
408bc15 Konstantin Lopuhin committed 10 years ago
botocore not only does not allow passing our own Date header, but does not handle x-amz-date according to the spec
d6bea3b Konstantin Lopuhin committed 10 years ago
use botocore by default, boto is still used in "precise" env
c3fec83 Konstantin Lopuhin committed 10 years ago
add Headers.to_native_string_dict - useful when interfacing with other libraries
1b1092b Konstantin Lopuhin committed 10 years ago
fix anon test: in this case we do no signing, just change the url
467553c Konstantin Lopuhin committed 10 years ago
using botocore for s3 request signing: proof of concept
eaf3a23 Konstantin Lopuhin committed 10 years ago
Merge pull request #1765 from scrapy/add-deprecation-for-pydispatch
4158839 Paul Tremberth committed 10 years ago
add deprecation for pydispatch (thanks for the help @redapple)
164493d Elias Dorneles committed 10 years ago
Merge pull request #1769 from orangain/stdout-typeerror
150d1c3 Elias Dorneles committed 10 years ago
Merge pull request #1767 from orangain/sitemap-robotstxt
44bc4c0 Mikhail Korobov committed 10 years ago
PY3: Implement some attributes of WrappedRequest required in Python 3
1f74399 orangain committed 10 years ago
Fix SitemapSpider to extract sitemap urls from robots.txt properly
25c5615 orangain committed 10 years ago
Update the email doc for the charset argument to send().
6efc7a9 Nicolas Pennequin committed 10 years ago