Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
Switch from ` to `` where inline code formatting is desired
75d6f56 Adrián Chaves committed 7 years ago
New constructor arg *restrict_text* for FilteringLinkExtractor.
e3b1525 Matthieu Grandrie committed 7 years ago
Updating Google Cloud Storage scheme to gs instead of gcs
0bb3d8c Júlio César Batista committed 7 years ago
setting botocore version as described in debian jessie website
b4d132b Victor Torres committed 7 years ago
Document that the main entry point of downloader and spider middlewares is from_crawler()
50bf4c6 Adrián Chaves committed 7 years ago
A different S3 Endpoint URL is now possible when uploading images
04ccf79 Pedro Sousa committed 7 years ago
using blank string instead of None as default value as proposed by @kmike
984e706 Victor Torres committed 7 years ago
Check that spidercls arguments in scrapy.crawler classes are not spider objects
03e61b9 Adrián Chaves committed 7 years ago
simplifying how we deal with threads.deferToThread calls
1eac2a1 Victor Torres committed 7 years ago
testing public method store instead of private method _store_in_thread
f824f5b Victor Torres committed 7 years ago
no need to use get here since we're defining a default value in default_settings.py
cfd183a Victor Torres committed 7 years ago
trying to fix jessie testenv by adding botocore to requirements and fixing its version
dbeb088 Victor Torres committed 7 years ago