Scrapy, a fast high-level web crawling & scraping framework for Python.
add instructions about how to define output file when running scrapy from script instead of cmd
Deschner, Magdalenae892a484e823
diff --git a/docs/topics/practices.rst b/docs/topics/practices.rstindex 298a078a7..4566eeb6e 100644--- a/docs/topics/practices.rst+++ b/docs/topics/practices.rst@@ -35,12 +35,17 @@ Here's an example showing how to run a single spider with it....process = CrawlerProcess({- 'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)'+ 'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)',+ 'FEED_FORMAT':'json',+ 'FEED_URI':'items.json'})process.crawl(MySpider)process.start() # the script will block here until the crawling is finished+Define settings within dictionary in+CrawlerProcess. FEED_FORMAT and FEED_URI are the equivalent to "-o items.json" when using the scrapy crawl shell command.+Make sure to check :class:`~scrapy.crawler.CrawlerProcess` documentation to getacquainted with its usage details.