An extension that allows a user to display all or some of their scrapy spider settings at runtime.
Project description
Scrapy Settings Log
An extension that allows a user to display all or some of their scrapy spider settings at runtime. It will add a logline with some or all settings for your spider in JSON compatible format.
Install
pip install scrapy-settings-log
Quick-Start
Add the following to your settings:
EXTENSIONS = {
'scrapy_settings_log.SpiderSettingsLogging': 999,
}
SETTINGS_LOGGING_ENABLED = True
When you run your spider you will see a debug log like below when spider is closing:
[scrapy_settings_log.scrapy_settings_log] INFO: {"SETTINGS_LOGGING_ENABLED": true, ...}
Additional Options
SETTINGS_LOGGING_REGEX
- Add a regular expression to only show some settings - for exampleSETTINGS_LOGGING_REGEX = "SPIDERMON"
will show settings with SPIDERMON in their name.SETTINGS_LOGGING_INDENT
- Add indentation to make log more human-readable.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-settings-log-1.0.3.tar.gz
(15.1 kB
view hashes)
Built Distribution
Close
Hashes for scrapy-settings-log-1.0.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3289a277a6261bec5053fb9982c72f15b351c64575952782b861c1d5aa25137f |
|
MD5 | ab8e4510a2f4f52031581912aa4a8081 |
|
BLAKE2b-256 | 31a473e431bc3a81a915a19f6e67b3753f7d9ba98d5f01ad3b54f5acbf131297 |
Close
Hashes for scrapy_settings_log-1.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8438f565734231bf167109b23cf6fbdd9973d674857d965245650d702dd6e43c |
|
MD5 | 9f8d00aff22f50fac8c6c968a9e26410 |
|
BLAKE2b-256 | b134a49c062dc4d9a1f2bde2fa06a6d4b5f47a9e5a2239204b82def1fe016d42 |