Kafka-based components for Scrapy
Project description
Kafka-based components for Scrapy, to allow Spider`s to read their next URL from a Kafka topic and an `ItemPipeline to store the JSON-ified Item back into a Kafka topic.
Please see the example directory for how to use this.
Contributors
Contributors to scrapy-kafka, listed alphabetically:
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-kafka-0.1.1.tar.gz
(3.2 kB
view hashes)