Skip to main content

Disk and file-based cache

Project description

Rationale: file-based cache in Django is essentially broken. Culling files is too costly. Large caches are forced to scan lots of files and do lots of deletes on some operations. Takes too long in the request/response cycle.

Solution: Each operation, “set” and “del” should delete at most two to ten expired keys.

Each “get” needs only check expiry and delete if needed. Make it speedy.

If only we had some kind of file-based database… we do! It’s called SQLite. For metadata and small stuff, use SQLite and for bigger things use files.

Features

  • Pure-Python

  • Developed on Python 2.7

  • Tested on CPython 2.6, 2.7, 3.3, 3.4, 3.5 and PyPy, PyPy3

  • Get full_path reference to value.

  • Allow storing raw data.

  • Small values stored in database.

  • Leverages SQLite native types: int, float, unicode, blob.

  • Thread-safe and process-safe.

  • Multiple eviction policies - Least-Recently-Stored - Least-Recently-Used - Least-Frequently-Used

  • Stampede barrier decorator.

  • Metadata support for “tag” to evict a group of keys at once.

Quickstart

Installing DiskCache is simple with pip:

$ pip install diskcache

You can access documentation in the interpreter with Python’s built-in help function:

>>> from diskcache import DjangoCache
>>> help(DjangoCache)

Caveats

  • Types matter in key equality comparisons. Comparisons like 1 == 1.0 and b'abc' == u'abc' return False.

Tutorial

TODO

Reference and Indices

License

Copyright 2016 Grant Jenks

Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

diskcache-0.7.0.tar.gz (126.9 kB view details)

Uploaded Source

Built Distribution

diskcache-0.7.0-py2.py3-none-any.whl (13.8 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file diskcache-0.7.0.tar.gz.

File metadata

  • Download URL: diskcache-0.7.0.tar.gz
  • Upload date:
  • Size: 126.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for diskcache-0.7.0.tar.gz
Algorithm Hash digest
SHA256 1c64e23e10ced8ee864800f773f298b10d3c618714f2f29b14d48bf9b12f35d1
MD5 9b1630abe69a796dafe0e32991f1be7c
BLAKE2b-256 17ef6ae176da5f7827b0999b2f4c65f74a023d88ce2c014e5e764e01b230584b

See more details on using hashes here.

Provenance

File details

Details for the file diskcache-0.7.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for diskcache-0.7.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 22605140f677fdaf5c3f75dea45219c810882ee56c640fb6547c1f07f849facc
MD5 7b468986d047b1a3f3d5370080d6fdee
BLAKE2b-256 491a653603c742254c280a6296766af8722d5a211bde83a810434a7b5c3f8584

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page