Skip to main content

Persistent cache for aiohttp requests

Project description

aiohttp-client-cache

Build status Documentation Status Coverage Status PyPI PyPI - Python Versions PyPI - Format

aiohttp-client-cache is an async persistent cache for aiohttp client requests, based on requests-cache.

See full documentation at https://aiohttp-client-cache.readthedocs.io

Features

  • Ease of use: Use as a drop-in replacement for aiohttp.ClientSession
  • Customization: Works out of the box with little to no config, but with plenty of options available for customizing cache expiration and other behavior
  • Persistence: Includes several storage backends: SQLite, DynamoDB, MongoDB, and Redis.

Development Status

This library is a work in progress!

Breaking changes should be expected until a 1.0 release, so version pinning is recommended.

My goal for this library is to eventually have a similar (but not identical) feature set as requests-cache, and also contribute new features from this library back to requests-cache. If there is a feature you want, if you've discovered a bug, or if you have other general feedback, please create an issue for it!

Quickstart

First, install with pip (python 3.7+ required):

pip install aiohttp-client-cache

Basic Usage

Next, use aiohttp_client_cache.CachedSession in place of aiohttp.ClientSession. To briefly demonstrate how to use it:

Replace this:

from aiohttp import ClientSession

async with ClientSession() as session:
    await session.get('http://httpbin.org/delay/1')                                                          

With this:

from aiohttp_client_cache import CachedSession, SQLiteBackend

async with CachedSession(cache=SQLiteBackend('demo_cache')) as session:
    await session.get('http://httpbin.org/delay/1')                                                          

The URL in this example adds a delay of 1 second, simulating a slow or rate-limited website. With caching, the response will be fetched once, saved to demo_cache.sqlite, and subsequent requests will return the cached response near-instantly.

Configuration

Several options are available to customize caching behavior. This example demonstrates a few of them:

from aiohttp_client_cache import SQLiteBackend

cache = SQLiteBackend(
    cache_name='~/.cache/aiohttp-requests.db',  # For SQLite, this will be used as the filename
    expire_after=60*60,                         # By default, cached responses expire in an hour
    urls_expire_after={'*.fillmurray.com': -1}, # Requests for any subdomain on this site will never expire
    allowed_codes=(200, 418),                   # Cache responses with these status codes
    allowed_methods=('GET', 'POST'),            # Cache requests with these HTTP methods
    include_headers=True,                       # Cache requests with different headers separately
    ignored_params=['auth_token'],              # Keep using the cached response even if this param changes
    timeout=2.5,                                # Connection timeout for SQLite backend 
)

More Info

To learn more, see:

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aiohttp-client-cache-0.4.1.tar.gz (50.5 kB view details)

Uploaded Source

Built Distribution

aiohttp_client_cache-0.4.1-py3-none-any.whl (37.5 kB view details)

Uploaded Python 3

File details

Details for the file aiohttp-client-cache-0.4.1.tar.gz.

File metadata

  • Download URL: aiohttp-client-cache-0.4.1.tar.gz
  • Upload date:
  • Size: 50.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0a1 CPython/3.9.5 Linux/5.4.0-1051-azure

File hashes

Hashes for aiohttp-client-cache-0.4.1.tar.gz
Algorithm Hash digest
SHA256 5fe10f1ddd29eea02031176b6b8a6f3b4742738ee52e1ffd061b5c7bd78dbfb9
MD5 686f8e8520678893bccc9173406edc5e
BLAKE2b-256 b0b9ca5ed76dfa9b19d0943f1da0806a594823aaa604449f3a5f9b80f8760466

See more details on using hashes here.

File details

Details for the file aiohttp_client_cache-0.4.1-py3-none-any.whl.

File metadata

File hashes

Hashes for aiohttp_client_cache-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 10ab60e29623c959f59eb9f0956f5439596bdf6a3d721fbe7fd1e1b81ad1dac7
MD5 3c02f0926df012a256a40206c45260da
BLAKE2b-256 d1306038e1031c31e9e91704c2d0d0c58c65d014eda4457b417e87fbdcccae25

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page