Scrapy, a fast high-level web crawling & scraping framework for Python.
Commits on master
looping over allowed_domains directly instead of via index
91ff194 Jana Cavojska committed 9 years ago
Issues a warning when user puts a URL into allowed_domains (#2250)
62a6261 Jana Cavojska committed 9 years ago
removed commented out code, wrapped line to pep-8 and removed backlashes
846fd83 IAlwaysBeCoding committed 9 years ago
Merge pull request #2989 from colinmorris/ItemExporterDocsExample
b8870ee Daniel Graña committed 9 years ago
Merge pull request #2983 from codeaditya/https-links
fd73345 Konstantin Lopuhin committed 9 years ago
Merge pull request #2921 from revolter/hotfix/disable-logging
1d9c8f5 Daniel Graña committed 9 years ago
Merge pull request #2952 from NoExitTV/Unhelpful-log-message-from-core.downloader.handlers.http11
dc4b36a Daniel Graña committed 9 years ago
Merge pull request #2929 from djunzu/add_m4v_to_ignored_extensions
4f8b45e Daniel Graña committed 9 years ago
Merge pull request #2963 from djunzu/mention_request_meta_depth_on_depthmiddleware_doc
496fc60 Mikhail Korobov committed 9 years ago