Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

add instructions about how to define output file when running scrapy from script instead of cmd

Deschner, Magdalenae892a484e823
diff --git a/docs/topics/practices.rst b/docs/topics/practices.rst
index 298a078a7..4566eeb6e 100644
--- a/docs/topics/practices.rst
+++ b/docs/topics/practices.rst
@@ -35,12 +35,17 @@ Here's an example showing how to run a single spider with it.
...
process = CrawlerProcess({
- 'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)'
+ 'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)',
+ 'FEED_FORMAT':'json',
+ 'FEED_URI':'items.json'
})
process.crawl(MySpider)
process.start() # the script will block here until the crawling is finished
+Define settings within dictionary in
+CrawlerProcess. FEED_FORMAT and FEED_URI are the equivalent to "-o items.json" when using the scrapy crawl shell command.
+
Make sure to check :class:`~scrapy.crawler.CrawlerProcess` documentation to get
acquainted with its usage details.