Memcached HTTP cache storage backend for Scrapy
Project description
Scrapy Memcached Cache
Memcached HTTP cache storage backend for Scrapy.
Install
Install the package with pipenv install scrapy-memcached-cache or pip install memcached-cache.
Usage
In your Scrapy settings.py:
Enable HTTP cache with HTTPCACHE_ENABLED = True
Set the cache expiration (in seconds), for example, with HTTPCACHE_EXPIRATION_SECS = 600
Set MemcachedCacheStorage as your cache storage with HTTPCACHE_STORAGE = 'scrapy_memcached_cache.MemcachedCacheStorage'
Set the location where your Memcached is running, for example, with MEMCACHED_LOCATION=localhost:11211
Done 🎉
Contributing
Please, format your code with Black.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file scrapy-memcached-cache-0.0.3.tar.gz.
File metadata
- Download URL: scrapy-memcached-cache-0.0.3.tar.gz
- Upload date:
- Size: 2.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fbc8b3649fde268b046e85bbcfbf475563a95b166be30612181a5443d68feec5 |
|
| MD5 | d340477cf1d9bb2cabbb26ee3124fd98 |
|
| BLAKE2b-256 | 3e807204d665aae9b3fb6fb997ff89b6009a52655e1e4101cf54df9dbdee76d3 |
