Persistent cache for aiohttp requests
Project description
aiohttp-client-cache
aiohttp-client-cache is an async persistent cache for aiohttp client requests, based on requests-cache.
Features
- Ease of use: Use as a drop-in replacement
for
aiohttp.ClientSession - Customization: Works out of the box with little to no config, but with plenty of options available for customizing cache expiration and other behavior
- Persistence: Includes several storage backends: SQLite, DynamoDB, MongoDB, and Redis.
Development Status
This library is a work in progress!
Breaking changes should be expected until a 1.0 release, so version pinning is recommended.
My goal for this library is to eventually have a similar (but not identical) feature set as
requests-cache, and also contribute new features from this library back to requests-cache.
If there is a feature you want, if you've discovered a bug, or if you have other general feedback, please
create an issue for it!
Quickstart
First, install with pip (python 3.7+ required):
pip install aiohttp-client-cache
Basic Usage
Next, use aiohttp_client_cache.CachedSession in place of aiohttp.ClientSession. To briefly demonstrate how to use it:
Replace this:
from aiohttp import ClientSession
async with ClientSession() as session:
await session.get('http://httpbin.org/delay/1')
With this:
from aiohttp_client_cache import CachedSession, SQLiteBackend
async with CachedSession(cache=SQLiteBackend('demo_cache')) as session:
await session.get('http://httpbin.org/delay/1')
The URL in this example adds a delay of 1 second, simulating a slow or rate-limited website.
With caching, the response will be fetched once, saved to demo_cache.sqlite, and subsequent
requests will return the cached response near-instantly.
Configuration
Several options are available to customize caching behavior. This example demonstrates a few of them:
# fmt: off
from aiohttp_client_cache import SQLiteBackend
cache = SQLiteBackend(
cache_name='~/.cache/aiohttp-requests.db', # For SQLite, this will be used as the filename
expire_after=60*60, # By default, cached responses expire in an hour
urls_expire_after={'*.fillmurray.com': -1}, # Requests for any subdomain on this site will never expire
allowed_codes=(200, 418), # Cache responses with these status codes
allowed_methods=['GET', 'POST'], # Cache requests with these HTTP methods
include_headers=True, # Cache requests with different headers separately
ignored_params=['auth_token'], # Keep using the cached response even if this param changes
timeout=2.5, # Connection timeout for SQLite backend
)
More Info
To learn more, see:
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file aiohttp-client-cache-0.7.0dev0.tar.gz.
File metadata
- Download URL: aiohttp-client-cache-0.7.0dev0.tar.gz
- Upload date:
- Size: 56.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.0a2 CPython/3.9.12 Linux/5.4.0-1078-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 36fe0a35f915e5ce23f6ac6f80420d5d7e65a654c393fd4e2b3400288d704490 |
|
| MD5 | 61f251d62f31e25b150c4eed6f30f8f1 |
|
| BLAKE2b-256 | 4aaaeb1e63946d1f54d36060d5c1aba565d15d31f6d4b7454eef17ef19634168 |
File details
Details for the file aiohttp_client_cache-0.7.0dev0-py3-none-any.whl.
File metadata
- Download URL: aiohttp_client_cache-0.7.0dev0-py3-none-any.whl
- Upload date:
- Size: 32.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.0a2 CPython/3.9.12 Linux/5.4.0-1078-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 51a596e40d636f311846af0382ce3f97ca92ddabf4968a96a32b43fa6c43778f |
|
| MD5 | 76cd583ca9b0841e85cf5846e2593c2a |
|
| BLAKE2b-256 | 409583f9a691d0d2ee197910ebdd8cc23cad2e0502cb3685444e84fee1536fc4 |
