Skip to main content

An implementation of an efficient object store that writes directly on disk.

Project description

disk-objectstore

An implementation of an efficient key-value store that writes directly on disk and does not require a server running.

Latest release PyPI version PyPI pyversions
Build status Build Status Coverage Status
Getting help Docs status
Performance Benchmarks

Goal

The goal of this project is to have a very efficient implementation of an "object store" that works directly on a disk folder, does not require a server to run, and addresses a number of performance issues, discussed also below.

This project targets objects that range from very few bytes up to tens of GB each, with performance tuned to support tens of millions of objects or more.

This project originated from the requirements needed by an efficient repository implementation in AiiDA (note, however, that this package is completely independent of AiiDA).

How to install

To install, just run:

pip install disk-objectstore

This will also install a simple dostore command line utility together with the library itself.

Documentation

For instructions on how to use it, some quick start guide, and more detailed information on the design of the library and its performance, you can check the documentation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

disk_objectstore-1.1.1.tar.gz (7.3 MB view hashes)

Uploaded Source

Built Distribution

disk_objectstore-1.1.1-py3-none-any.whl (71.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page