Skip to main content

A Snakemake storage plugin to read and write from Azure Blob Storage

Project description

Snakemake Storage Plugin Azure

Azure Blob Storage plugin for snakemake. For documentation and usage instructions, see the Snakemake Plugin Catalog.

Testing

Testing this plugin locally require the azurite storage emulator to be running locally. This can be setup using the following docker run command:

docker run -p 10000:10000 mcr.microsoft.com/azure-storage/azurite azurite-blob --blobHost 0.0.0.0

Then execute the tests:

poetry run coverage run -m pytest tests/tests.py

Example

The below example Snakefile and command will stream a file, test.txt, containing the text "Hello, World" to the azure blob: https://accountname.blob.core.windows.net/container/test.txt

rule touch:
    output: "test.txt"
    shell:
        "echo 'Hello, World!' > {output}"

Command:

The storage account and container that the output file is streamed to is specified using the default-storage-prefix.

snakemake -j1 \
    --default-storage-provider azure \
    --default-storage-prefix "az://container"
    --storage-azure-account-name accountname \
    --verbose

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

snakemake_storage_plugin_azure-0.4.1.tar.gz (7.1 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file snakemake_storage_plugin_azure-0.4.1.tar.gz.

File metadata

File hashes

Hashes for snakemake_storage_plugin_azure-0.4.1.tar.gz
Algorithm Hash digest
SHA256 5200670ee317a572aa8fe843847a3b9810da1584543b84f69b804b54802db11b
MD5 36266ded47655bcc373963389fbaffae
BLAKE2b-256 9b617885ec2563ca83da29add794892a957a715e522450531dd761ec98ca47be

See more details on using hashes here.

Provenance

File details

Details for the file snakemake_storage_plugin_azure-0.4.1-py3-none-any.whl.

File metadata

File hashes

Hashes for snakemake_storage_plugin_azure-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 58c3b5f493e7c284995348527d5c29da5e0af4fc598ab8bf44fb2adfc3620e89
MD5 597d001bd40528d14f94450286ac7a6a
BLAKE2b-256 8892aa494421893c791cd6701e965dac91c466da81e1812affbf015a35988528

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page