Scrapy entrypoint for Scrapinghub job runner
Project description
Scrapy entrypoint for Scrapinghub job runner.
The package implements a base wrapper layer to extract job data from environment, parse/prepare it properly and execute job using Scrapy or custom executor.
Features
parsing job data from environment
processing job args and settings
running a job with Scrapy
collecting stats
advanced logging & error handling
full hubstorage support
custom scripts support
Install
pip install scrapinghub-entrypoint-scrapy
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapinghub-entrypoint-scrapy-0.9.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2546d5825e9674c2f2c199bafeb76235b4aa875a846818324208c457f41e427b |
|
MD5 | e87e0d6ce1ee2b146e0af977c124fcbf |
|
BLAKE2b-256 | 9cd48c22262263accade8b5529ca046702ea119eb4f3f0adfd7d48d449dc7680 |
Close
Hashes for scrapinghub_entrypoint_scrapy-0.9.1-py2-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 64f99aa4ea8dcc3b34275afedee7ddd1325ea55f63222b4b6d8efa32cb75add1 |
|
MD5 | 028714342b9868ed95ebe6fb0f758737 |
|
BLAKE2b-256 | 97f004511e31dea653b4aefdbb4c4a491c7bec6c6a48fd7cef9fb87bbb3801c6 |