Skip to main content

A package for creating, reading from, and writing to indexed tar archives.

Project description

Python interface for reading and appending tar files, while keeping a fast index for finding and reading files in the archive.

This interface has been successfully used to store and manage over one billion files in one of the Pilot-2 simulation campaigns.

Written by Tomas Oppelstrup as part of the DOE/NCI Pilot-2 project, based on an initial (simpler) index implementation by Tomas Oppelstrup, December 11, 2018. Updated to support Python 3 as a module by Francesco DiNatale.

A script for correctness checking and examples of use can be found in tests/indextest.py. The simplest way to run the tests is by e.g.: cd test ./testscript.sh

This software is distributed under the MIT license; see the file "LICENSE" for details. This software was developed at the Lawrence Livermore National Laboratory and has the release number LLNL-CODE-826782; see the file "NOTICE" for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytaridx-1.0.1.tar.gz (16.6 kB view details)

Uploaded Source

Built Distribution

pytaridx-1.0.1-py3-none-any.whl (18.5 kB view details)

Uploaded Python 3

File details

Details for the file pytaridx-1.0.1.tar.gz.

File metadata

  • Download URL: pytaridx-1.0.1.tar.gz
  • Upload date:
  • Size: 16.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5

File hashes

Hashes for pytaridx-1.0.1.tar.gz
Algorithm Hash digest
SHA256 01d73716c73423143accafb3d7318cc954f0f7a7c176e9f64ce2148fdead84c7
MD5 00277aa522928e240559905a08f01b93
BLAKE2b-256 3f1c938fc84524616fd9bc0a4e5f841e0a945e06e50129f812625f0df19cfdd8

See more details on using hashes here.

File details

Details for the file pytaridx-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: pytaridx-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 18.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5

File hashes

Hashes for pytaridx-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 978bd0983c54135205aa071f5aea7530472257094b952cd14effd6239e89a95c
MD5 94e894cd2cb19ba7645fdc2e60318f7e
BLAKE2b-256 522f9ac11dbd749bce625c4040e9d7d46c949fa95b97ab4115e16c79b7599ef2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page