Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

Commits on master

Do not cache DNS responses when cache size is 0
Paul Tremberth committed 9 years ago
f0ded6b
Add test for DNS cache disabling
Paul Tremberth committed 9 years ago
1f08d9a
Populate spider variable when using shell.inspect_response
Eugenio Lacuesta committed 9 years ago
793b237
Merge pull request #2793 from lopuhin/pypy2
Mikhail Korobov committed 9 years ago
dd5ab6c
Use environment markers for custom PyPy requirements
Konstantin Lopuhin committed 9 years ago
b0a9236
Remove duplicate PyPy toxenv from Travis config
Konstantin Lopuhin committed 9 years ago
5ba8e5a
Require pypy build to pass
Konstantin Lopuhin committed 9 years ago
271b3a4
Remove Jython gc branch: it's not supported
Konstantin Lopuhin committed 9 years ago
ea08b95
Fix httpcache leveldb tests: gc.collect after del
Konstantin Lopuhin committed 9 years ago
a8df090
Install PyPyDispatcher for PyPy tests
Konstantin Lopuhin committed 9 years ago
b4eb60e
Move garbage_collect to scrapy.utils.python
Konstantin Lopuhin committed 10 years ago
19ca986
Fix get_func_args tests under PyPy
Konstantin Lopuhin committed 10 years ago
7c67047
Fix test_weakkeycache on PyPy: run gc.collect()
Konstantin Lopuhin committed 10 years ago
5abb70c
Fix queue serialization test on PyPy
Konstantin Lopuhin committed 10 years ago
c3d1765
Fix test_output_processor_error undere PyPy
Konstantin Lopuhin committed 10 years ago
6014856
Fix test_start_requests_errors for PyPy
Konstantin Lopuhin committed 10 years ago
5a08cf3
b33e0d5
Merge pull request #2781 from crasker/patch-1
Mikhail Korobov committed 9 years ago
5aebdac
Merge pull request #2777 from chuanjin/patch-1
Mikhail Korobov committed 9 years ago
4e84424
Create item-pipeline.rst
Casker committed 9 years ago
ae679f6
Fix setting name reference
Paul Tremberth committed 9 years ago
39ad0d0
Reformat a bit
Paul Tremberth committed 9 years ago
e7061f7
Update extensions.rst
Chuan Jin committed 9 years ago
3f8542e
make reqser tests create Request with proper callback/errback
Valdir Stumm Junior committed 9 years ago
4b6f68b
fix parse command issue with callback as a string
Valdir Stumm Junior committed 9 years ago
0f6f486
Use https:// for readthedocs links
Paul Tremberth committed 9 years ago
fad6b70
Handle Twisted versions before 15.0
Paul Tremberth committed 9 years ago
6b092c6
Pass proxy URI to ProxyAgent as bytes
Paul Tremberth committed 9 years ago
e162c1f
verify if Request callback is callable
Valdir Stumm Junior committed 9 years ago
60727de