Kafka-based components for Scrapy
Project description
Kafka-based components for Scrapy, to allow Spider`s to read their next URL from a Kafka topic and an `ItemPipeline to store the JSON-ified Item back into a Kafka topic.
Please see the example directory for how to use this.
Contributors
Contributors to scrapy-kafka, listed alphabetically:
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-kafka-0.1.1.tar.gz
(3.2 kB
view details)
File details
Details for the file scrapy-kafka-0.1.1.tar.gz.
File metadata
- Download URL: scrapy-kafka-0.1.1.tar.gz
- Upload date:
- Size: 3.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f18074c9eead57aef65a391645df3eae3026762c8eb6269987b9541bab287072 |
|
| MD5 | 92f4d2baceaf571138d89c9b35d67a00 |
|
| BLAKE2b-256 | aa0084390c023e9604b9f499c85f0d48bc63a8a963ecec55bcfe96e215a276ca |
