Skip to content

Scrapy, a fast high-level web crawling & scraping framework for Python.

LOG_SHORT_NAMES option

Akhil Lba75ad2bbc63e
diff --git a/docs/topics/logging.rst b/docs/topics/logging.rst
index b7aa6d985..231f5186b 100644
--- a/docs/topics/logging.rst
+++ b/docs/topics/logging.rst
@@ -150,6 +150,7 @@ These settings can be used to configure the logging:
* :setting:`LOG_FORMAT`
* :setting:`LOG_DATEFORMAT`
* :setting:`LOG_STDOUT`
+* :setting:`LOG_SHORT_NAMES`
The first couple of settings define a destination for log messages. If
:setting:`LOG_FILE` is set, messages sent through the root logger will be
@@ -170,6 +171,10 @@ listed in `logging's logrecord attributes docs
<https://docs.python.org/2/library/datetime.html#strftime-and-strptime-behavior>`_
respectively.
+If :setting:`LOG_SHORT_NAMES` is set, then the logs will not display the scrapy
+component that prints the log. It is unset by default, hence logs contain the
+scrapy component responsible for that log output.
+
Command-line options
--------------------
diff --git a/docs/topics/settings.rst b/docs/topics/settings.rst
index a17472564..c528987ec 100644
--- a/docs/topics/settings.rst
+++ b/docs/topics/settings.rst
@@ -788,6 +788,16 @@ If ``True``, all standard output (and error) of your process will be redirected
to the log. For example if you ``print 'hello'`` it will appear in the Scrapy
log.
+.. setting:: LOG_SHORT_NAMES
+
+LOG_SHORT_NAMES
+____________
+
+Default: ``False``
+
+If ``True``, the logs will just contain the root path. If it is set to ``False``
+then it displays the component responsible for the log output
+
.. setting:: MEMDEBUG_ENABLED
MEMDEBUG_ENABLED
diff --git a/scrapy/settings/default_settings.py b/scrapy/settings/default_settings.py
index 61f4bd567..24714a7a8 100644
--- a/scrapy/settings/default_settings.py
+++ b/scrapy/settings/default_settings.py
@@ -191,6 +191,7 @@ LOG_DATEFORMAT = '%Y-%m-%d %H:%M:%S'
LOG_STDOUT = False
LOG_LEVEL = 'DEBUG'
LOG_FILE = None
+LOG_SHORT_NAMES = False
SCHEDULER_DEBUG = False
diff --git a/scrapy/utils/log.py b/scrapy/utils/log.py
index 51f303216..f33ce7017 100644
--- a/scrapy/utils/log.py
+++ b/scrapy/utils/log.py
@@ -118,7 +118,8 @@ def _get_handler(settings):
)
handler.setFormatter(formatter)
handler.setLevel(settings.get('LOG_LEVEL'))
- handler.addFilter(TopLevelFormatter(['scrapy']))
+ if settings.getbool('LOG_SHORT_NAMES'):
+ handler.addFilter(TopLevelFormatter(['scrapy']))
return handler