Persistent cache for aiohttp requests
Project description
aiohttp-client-cache
See full documentation at https://aiohttp-client-cache.readthedocs.io
aiohttp-client-cache is an async persistent cache for aiohttp requests, based on requests-cache.
Not to be confused with aiohttp-cache, which is a cache for the aiohttp web server. This package is, as you might guess, specifically for the aiohttp client.
Development Status
This is an early work in progress!
The current state is a working drop-in replacement (or mixin) for aiohttp.ClientSession, with a
fully async SQLite backend.
Additional backends are provided, but cache operations are still synchronous, and have had minimal testing.
Breaking changes should be expected until a 1.0 release.
Installation
Requires python 3.7+
Install the latest stable version with pip:
pip install aiohttp-client-cache
Note: You will need additional dependencies depending on which backend you want to use; See Cache Backends section below for details. To install with extra dependencies for all supported backends:
pip install aiohttp-client-cache[backends]
To set up for local development:
$ git clone https://github.com/JWCook/aiohttp-client-cache
$ cd aiohttp-client-cache
$ pip install -Ue ".[dev]"
$ # Optional but recommended:
$ pre-commit install --config .github/pre-commit.yml
Usage example
See the examples folder for more detailed usage examples.
Here is a simple example using an endpoint that takes 1 second to fetch. After the first request, subsequent requests to the same URL will return near-instantly; so, fetching it 10 times will only take ~1 second instead of 10.
from aiohttp_client_cache import CachedSession, SQLiteBackend
async with CachedSession(cache=SQLiteBackend()) as session:
for i in range(10):
await session.get('http://httpbin.org/delay/1')
aiohttp-client-cache can also be used as a mixin, if you happen have other mixin classes that you
want to combine with it:
from aiohttp import ClientSession
from aiohttp_client_cache import CacheMixin
class CustomSession(CacheMixin, CustomMixin, ClientSession):
pass
Cache Backends
Several backends are available. If one isn't specified, a simple in-memory cache will be used.
SQLiteBackend: Uses a SQLite database (requires aiosqlite)DynamoDBBackend: Uses a Amazon DynamoDB database (requires boto3)RedisBackend: Uses a Redis cache (requires redis-py)MongoDBBackend: Uses a MongoDB database (requires motor)GridFSBackend: Uses a MongoDB GridFS database, which enables storage of documents greater than 16MB (requires pymongo)
You can also provide your own backend by subclassing aiohttp_client_cache.backends.BaseCache.
Expiration
If you are using the expire_after parameter, expired responses are removed from the storage the
next time the same request is made. If you want to manually purge all expired items, you can use
CachedSession.delete_expired_responses. Example:
session = CachedSession(expire_after=3) # Cached responses expire after 3 hours
await session.remove_expired_responses() # Remove any responses over 3 hours old
Conditional Caching
Caching behavior can be customized by defining various conditions:
- Response status codes
- Request HTTP methods
- Request headers
- Specific request parameters
- Custom filter function
See CacheBackend docs for details.
Credits
Thanks to Roman Haritonov and
contributors
for the original requests-cache!
This project is licensed under the MIT license, with the exception of
storage backend code
adapted from requests-cache, which is licensed under the BSD license
(copy included).
History
0.1.0 (2020-11-14)
- Initial PyPI release
- First pass at a general refactor and conversion from
requeststoaiohttp - Basic features are functional, but some backends do not actually operate asynchronously
requests-cache
See requests-cache development history
for details on prior changes.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file aiohttp-client-cache-0.1.4.tar.gz.
File metadata
- Download URL: aiohttp-client-cache-0.1.4.tar.gz
- Upload date:
- Size: 22.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.8.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 187c01f9b9d4ba5d3ccf5aed7efee5e4932785f6cf1b5d0b187094f03118c4ca |
|
| MD5 | f5040604f4487bbcea11f8972e179dce |
|
| BLAKE2b-256 | 5b64f78d09923d1337c3f84776b63d8ef00b7969566e34c6bb79f6c998626502 |
File details
Details for the file aiohttp_client_cache-0.1.4-py3-none-any.whl.
File metadata
- Download URL: aiohttp_client_cache-0.1.4-py3-none-any.whl
- Upload date:
- Size: 24.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.8.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 486617765a4ef5f00c08b92643dd2afa83463a9a0dc3d129aa7fc54e1b5301a4 |
|
| MD5 | f9226535ba5ba10f9a05606396a06174 |
|
| BLAKE2b-256 | d632701ff17b359907884183e280796f60c732c5dba0cc33755ee90b10ed6670 |
