Skip to main content

miniwdl plugin for progressive upload of task output files to Amazon S3

Project description

miniwdl-s3upload

This Python package is a MiniWDL plugin to handle the orchestration of S3 upload (delocalization) for S3 URIs in WDL workflow I/O.

Installation

pip3 install miniwdl-s3upload

To check that the installation was successful, run miniwdl --version, which will list available plugins, including this one.

Usage

Set the environment variable MINIWDL__S3_PROGRESSIVE_UPLOAD__URI_PREFIX to an S3 URL where the task outputs should be uploaded.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

miniwdl-s3upload-0.0.7.tar.gz (4.2 kB view details)

Uploaded Source

File details

Details for the file miniwdl-s3upload-0.0.7.tar.gz.

File metadata

  • Download URL: miniwdl-s3upload-0.0.7.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.7.3 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.8

File hashes

Hashes for miniwdl-s3upload-0.0.7.tar.gz
Algorithm Hash digest
SHA256 290ac2782b4bf4c015c0f8c6041a5c4456393736129b6ae7cb146868a1d5ae62
MD5 07c10aea3330d847fbbd0d277e0e3382
BLAKE2b-256 c3d03816d4cede2ad0b7ff68ee13c3d8c4905cfcec3a8528b623715f1fa8bc84

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page