Skip to main content

A package for creating, reading from, and writing to indexed tar archives.

Project description

Python interface for reading and appending tar files, while keeping a fast index for finding and reading files in the archive.

This interface has been successfully used to store and manage over one billion files in one of the Pilot-2 simulation campaigns.

Written by Tomas Oppelstrup as part of the DOE/NCI Pilot-2 project, based on an initial (simpler) index implementation by Tomas Oppelstrup, December 11, 2018. Updated to support Python 3 as a module by Francesco DiNatale.

A script for correctness checking and examples of use can be found in tests/indextest.py. The simplest way to run the tests is by e.g.: cd test ./testscript.sh

This software is distributed under the MIT license; see the file "LICENSE" for details. This software was developed at the Lawrence Livermore National Laboratory and has the release number LLNL-CODE-826782; see the file "NOTICE" for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytaridx-1.0.2.tar.gz (16.6 kB view details)

Uploaded Source

Built Distribution

pytaridx-1.0.2-py3-none-any.whl (18.5 kB view details)

Uploaded Python 3

File details

Details for the file pytaridx-1.0.2.tar.gz.

File metadata

  • Download URL: pytaridx-1.0.2.tar.gz
  • Upload date:
  • Size: 16.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5

File hashes

Hashes for pytaridx-1.0.2.tar.gz
Algorithm Hash digest
SHA256 702c42ade13ae8688a56a8edfcd7e0e7512a489a22796c6cfdbcef677010ee47
MD5 c9d4814c6ca6b289874d31b77b1b8c55
BLAKE2b-256 1c3f4649da2154d386fa4dc8ee1de5eb408ccae4db9423fdfbb8c39a0f1b5452

See more details on using hashes here.

Provenance

File details

Details for the file pytaridx-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: pytaridx-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 18.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5

File hashes

Hashes for pytaridx-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 7a41b3adc398e8c0cafe8981d0690daa03d51cfd0bd41a6748f73f703a997ef7
MD5 a6255a5b6fd4ca553635700fce6a2936
BLAKE2b-256 9b0560e76cb53b13a2b52bcfa21284845dc8b5a35e7d292a159d0ad48d4644cb

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page