Skip to main content

CLI tool to allow submitters to upload to and download from the EBI S3 buckets.

Project description

hca-util

This tool is intended to allow HCA wranglers and contributors to upload and download data to/from the HCA S3 bucket.

https://github.com/ebi-ait/hca-util

Prerequisites

Users need to have

  1. Basic command-line knowledge
  2. Python3.x installed on their machine
  3. Credentials to access data in the S3 bucket (access and secret keys)

Install and configure

  1. Get the tool from PyPi

     $ pip install hca-util
    
  2. Run the hca-util tool

     $ hca-util
     Type ? to list commands
     hca>
    
  3. Run config command specifying your credentials

     hca> config ACCESS_KEY SECRET_KEY
    

Step 2 opens an interactive prompt.

Step 3 adds a new hca-util profile to your local AWS configuration which the tool uses.

Use the tool to upload and download data

The following commands are currently possible.

command                         description
=======                         ===========
config ACCESS_KEY SECRET_KEY    Configure your machine with credentials

create [project_name] [-udx]    Create an upload directory for project (authorised user only)
                                If specified, project name needs to be between 1-12 alphanumeric characters with no space
                                If specified, allowed permissions include 'u', 'ud', 'ux' and 'udx'; otherwise default 'ux'
                                u - upload, d - download, x - delete

list                            List contents of bucket (authorised user only)
list DIR_NAME                   List contents of directory

select DIR_NAME                 Set active directory for upload and download
dir                             Show selected directory

upload F1 [f2] [f3] ...         Multi-files upload to selected directory
upload .                        Upload all files from current user directory

delete F1 [f2] [f3] ...         Delete specified file(s) from selected directory
delete .                        Delete all files from selected directory

download F1 [f2] [f3] ...       Download specified file(s) from selected directory to local machine
download .                      Download all files from selected directory to local machine

exit (or quit)                  Exit the tool. Shorthand: x, q, or Ctrl-D

Type ? or help to list commands.

Type help <command> to display help info about a command.

Note only authorised users (for e.g. wranglers, devs) with their elevated access can create directory and list all directories.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hca-util-0.0.12.tar.gz (7.7 kB view details)

Uploaded Source

Built Distribution

hca_util-0.0.12-py3-none-any.whl (20.3 kB view details)

Uploaded Python 3

File details

Details for the file hca-util-0.0.12.tar.gz.

File metadata

  • Download URL: hca-util-0.0.12.tar.gz
  • Upload date:
  • Size: 7.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.42.0 CPython/3.6.9

File hashes

Hashes for hca-util-0.0.12.tar.gz
Algorithm Hash digest
SHA256 93ff25ebaa91845a8ba84e901780d522fda7036f0fe465c87c974f2c46bcbb67
MD5 da85a61037ec246aa5d31c73dce48e93
BLAKE2b-256 52d2b9882f7d0c90c1e8a03f9f5bd65e16436feb4dfc573335a9fc5d8bce805a

See more details on using hashes here.

File details

Details for the file hca_util-0.0.12-py3-none-any.whl.

File metadata

  • Download URL: hca_util-0.0.12-py3-none-any.whl
  • Upload date:
  • Size: 20.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.42.0 CPython/3.6.9

File hashes

Hashes for hca_util-0.0.12-py3-none-any.whl
Algorithm Hash digest
SHA256 43a2d6facd170e1b0341587706f05deaf445bb8d488b6c69cd5d974622f9fad8
MD5 4c968ab6cf4138ee12ea893d8563f05c
BLAKE2b-256 41868d63ab8614f88636b67e7d71109d71d9848a583633756930b0c29f08d1e8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page