Skip to main content

An implementation of an efficient object store that writes directly on disk.

Project description

disk-objectstore

An implementation of an efficient key-value store that writes directly on disk and does not require a server running.

Latest release PyPI version PyPI pyversions
Build status Build Status Coverage Status
Getting help Docs status
Performance Benchmarks

Goal

The goal of this project is to have a very efficient implementation of an "object store" that works directly on a disk folder, does not require a server to run, and addresses a number of performance issues, discussed also below.

This project targets objects that range from very few bytes up to tens of GB each, with performance tuned to support tens of millions of objects or more.

This project originated from the requirements needed by an efficient repository implementation in AiiDA (note, however, that this package is completely independent of AiiDA).

How to install

To install, just run:

pip install disk-objectstore

This will also install a simple dostore command line utility together with the library itself.

Documentation

For instructions on how to use it, some quick start guide, and more detailed information on the design of the library and its performance, you can check the documentation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

disk_objectstore-1.1.1.tar.gz (7.3 MB view details)

Uploaded Source

Built Distribution

disk_objectstore-1.1.1-py3-none-any.whl (71.1 kB view details)

Uploaded Python 3

File details

Details for the file disk_objectstore-1.1.1.tar.gz.

File metadata

  • Download URL: disk_objectstore-1.1.1.tar.gz
  • Upload date:
  • Size: 7.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.32.3

File hashes

Hashes for disk_objectstore-1.1.1.tar.gz
Algorithm Hash digest
SHA256 10962b36469bb1e1ad2647876f73fa57941a3b81a07295b2f801a996d27f403d
MD5 81c2ecba4bc8cd10343f53ffed6a1790
BLAKE2b-256 068a8022bc6c4e63bc3abb3da7858468565b92b8c7e3c94af02a8e3577304980

See more details on using hashes here.

Provenance

File details

Details for the file disk_objectstore-1.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for disk_objectstore-1.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 07c4665843224a86770be30cabcecc4fed59a4970b8d20151e5b6112ed3430ac
MD5 b0bef3f3a8d29b63a2554c4e9e42a6a5
BLAKE2b-256 6b061136a47b50db713d6c41092ce5f99c6bb7c0fc44720ef3cd85d33892c620

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page