Put Scrapy spiders behind an HTTP API
Project description
HTTP server which provides API for scheduling Scrapy spiders and making requests with spiders.
Allows you to easily add HTTP API to your existing Scrapy project. All Scrapy project components (e.g. middleware, pipelines, extensions) are supported out of the box. You simply run Scrapyrt in Scrapy project directory and it starts HTTP server allowing you to schedule your spiders and get spider output in JSON format.
Documentation
Documentation is available here: http://scrapyrt.readthedocs.org/en/latest/index.html
Support
Open source support is provided here in Github. Please create a question issue (ie. issue with “question” label).
Commercial support is also available by Scrapinghub.
Development
Release
Use bumpversion tool, e.g. to release minor version do:
bumpversion minor --verbose git push origin master git push origin <new_version_tag>
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file scrapyrt-0.11.0.tar.gz.
File metadata
- Download URL: scrapyrt-0.11.0.tar.gz
- Upload date:
- Size: 24.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/2.7.15
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4ad45c6f35f2ccaab4ef8d0c8f0a54bfe598f4c4162d0b89af8255703a2d7573 |
|
| MD5 | f6bf1376f9c8a910271bef6a9aa4b451 |
|
| BLAKE2b-256 | 402e2bae97fe4e05878c44f4ba3763fce142693c84cfda405b8ca5afa60a8287 |
Provenance
File details
Details for the file scrapyrt-0.11.0-py2.py3-none-any.whl.
File metadata
- Download URL: scrapyrt-0.11.0-py2.py3-none-any.whl
- Upload date:
- Size: 33.3 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/2.7.15
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5fb05b27bda1b6b270aac40bc827ed31da5b17a92864069cbcda6dc489ceb90b |
|
| MD5 | bc7a99a624366bfbead69979763ee8c0 |
|
| BLAKE2b-256 | ecf3e6010c5cc59c7acdce8589e696d3d8546985155107294f2a92ee3086da5b |
