Skip to main content

An implementation of an efficient object store that writes directly on disk.

Project description

disk-objectstore

An implementation of an efficient key-value store that writes directly on disk and does not require a server running.

Latest release PyPI version PyPI pyversions
Build status Build Status Coverage Status
Getting help Docs status
Performance Benchmarks

Goal

The goal of this project is to have a very efficient implementation of an "object store" that works directly on a disk folder, does not require a server to run, and addresses a number of performance issues, discussed also below.

This project targets objects that range from very few bytes up to tens of GB each, with performance tuned to support tens of millions of objects or more.

This project originated from the requirements needed by an efficient repository implementation in AiiDA (note, however, that this package is completely independent of AiiDA).

How to install

To install, just run:

pip install disk-objectstore

This will also install a simple dostore command line utility together with the library itself.

Documentation

For instructions on how to use it, some quick start guide, and more detailed information on the design of the library and its performance, you can check the documentation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

disk_objectstore-1.0.0.tar.gz (7.3 MB view details)

Uploaded Source

Built Distribution

disk_objectstore-1.0.0-py3-none-any.whl (65.0 kB view details)

Uploaded Python 3

File details

Details for the file disk_objectstore-1.0.0.tar.gz.

File metadata

  • Download URL: disk_objectstore-1.0.0.tar.gz
  • Upload date:
  • Size: 7.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.31.0

File hashes

Hashes for disk_objectstore-1.0.0.tar.gz
Algorithm Hash digest
SHA256 a61e3a817e2552fc834a61aaba975708ab1342b3bee4d3bdd6e3fc69de5177db
MD5 02d056f1fad7748d9b727baa4dd0e243
BLAKE2b-256 26d5f608e06db76b325a84c996b4883a510e3be4cf5636e9c7174c66fef8f31b

See more details on using hashes here.

Provenance

File details

Details for the file disk_objectstore-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for disk_objectstore-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 4205d245c38af7da87883b651f0e783c25e577beaf5b13d367f3bc07771dd172
MD5 04f12571c2736496285a4bbe1b8614f4
BLAKE2b-256 d34d8b5081cbe8e256e50ce3c7fbb336137dc519120407a289e657252b969bda

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page