Skip to main content

miniwdl plugin for progressive upload of task output files to Amazon S3

Project description

miniwdl-s3upload

This Python package is a MiniWDL plugin to handle the orchestration of S3 upload (delocalization) for S3 URIs in WDL workflow I/O.

Installation

pip3 install miniwdl-s3upload

To check that the installation was successful, run miniwdl --version, which will list available plugins, including this one.

Usage

Set the environment variable MINIWDL__S3_PROGRESSIVE_UPLOAD__URI_PREFIX to an S3 URL where the task outputs should be uploaded.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

miniwdl-s3upload-0.0.8.tar.gz (6.5 kB view details)

Uploaded Source

Built Distribution

miniwdl_s3upload-0.0.8-py2.py3-none-any.whl (4.5 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file miniwdl-s3upload-0.0.8.tar.gz.

File metadata

  • Download URL: miniwdl-s3upload-0.0.8.tar.gz
  • Upload date:
  • Size: 6.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.7.3 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.8

File hashes

Hashes for miniwdl-s3upload-0.0.8.tar.gz
Algorithm Hash digest
SHA256 6bbc28340a6f1036653a15b719e64cce0b38f6590898d058bcd138e4e2b54b66
MD5 d4b8fdce40a551149682fbb4427aa9e8
BLAKE2b-256 85284b2ba0c81f6c0b2ec2173c4bdc232d2dc6f4be13780e6b0f57430b09468b

See more details on using hashes here.

File details

Details for the file miniwdl_s3upload-0.0.8-py2.py3-none-any.whl.

File metadata

  • Download URL: miniwdl_s3upload-0.0.8-py2.py3-none-any.whl
  • Upload date:
  • Size: 4.5 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.7.3 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.8

File hashes

Hashes for miniwdl_s3upload-0.0.8-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 38e07cd2c13b82eda8a5312d938b06ed607308778fbdd40eb74a99046ff0b870
MD5 89024e710cb25d4c89829cacdb6f92b1
BLAKE2b-256 0d792a543bf5690468253d574916e2cffff42aa9f6212efdedc5874646406b37

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page