Skip to main content

CLI tool to allow submitters to upload to and download from the EBI S3 buckets.

Project description

hca-util

This tool is intended to allow HCA wranglers and contributors to upload and download data to/from the HCA S3 bucket.

https://github.com/ebi-ait/hca-util

Prerequisites

Users need to have

  1. Basic command-line knowledge
  2. Python3.x installed on their machine
  3. Credentials to access data in the S3 bucket (access and secret keys)

Install and configure

  1. Get the tool from PyPi

     $ pip install hca-util
    
  2. Run the hca-util tool

     $ hca-util
     Type ? to list commands
     hca>
    
  3. Run config command specifying your credentials

     hca> config ACCESS_KEY SECRET_KEY
    

Step 2 opens an interactive prompt.

Step 3 adds a new hca-util profile to your local AWS configuration which the tool uses.

Use the tool to upload and download data

The following commands are currently possible.

command                         description
=======                         ===========
config ACCESS_KEY SECRET_KEY    Configure your machine with credentials

create [project_name] [-udx]    Create an upload directory for project (authorised user only)
                                If specified, project name needs to be between 1-12 alphanumeric characters with no space
                                If specified, allowed permissions include 'u', 'ud', 'ux' and 'udx'; otherwise default 'ux'
                                u - upload, d - download, x - delete

list                            List contents of bucket (authorised user only)
list DIR_NAME                   List contents of directory

select DIR_NAME                 Set active directory for upload and download
dir                             Show selected directory

upload F1 [f2] [f3] ...         Multi-files upload to selected directory
upload .                        Upload all files from current user directory

delete F1 [f2] [f3] ...         Delete specified file(s) from selected directory
delete .                        Delete all files from selected directory

download F1 [f2] [f3] ...       Download specified file(s) from selected directory to local machine
download .                      Download all files from selected directory to local machine

exit (or quit)                  Exit the tool. Shorthand: x, q, or Ctrl-D

Type ? or help to list commands.

Type help <command> to display help info about a command.

Note only authorised users (for e.g. wranglers, devs) with their elevated access can create directory and list all directories.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hca-util-0.0.13.tar.gz (7.8 kB view details)

Uploaded Source

Built Distribution

hca_util-0.0.13-py3-none-any.whl (20.4 kB view details)

Uploaded Python 3

File details

Details for the file hca-util-0.0.13.tar.gz.

File metadata

  • Download URL: hca-util-0.0.13.tar.gz
  • Upload date:
  • Size: 7.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.42.0 CPython/3.6.9

File hashes

Hashes for hca-util-0.0.13.tar.gz
Algorithm Hash digest
SHA256 56fae495212a8f563fdf1cd3033b596a756dd5e1771bf337d3f8f6e31de00a4d
MD5 672eda15533cc87732759f7dae8375fc
BLAKE2b-256 0b126e8ac794c7ea1b2de9c3ca1a926df56bc68d115b2281909f29a1b8191620

See more details on using hashes here.

File details

Details for the file hca_util-0.0.13-py3-none-any.whl.

File metadata

  • Download URL: hca_util-0.0.13-py3-none-any.whl
  • Upload date:
  • Size: 20.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.1.0 requests-toolbelt/0.9.1 tqdm/4.42.0 CPython/3.6.9

File hashes

Hashes for hca_util-0.0.13-py3-none-any.whl
Algorithm Hash digest
SHA256 ef45bc53c2a59ea86f70d8e6dc90d9ac9eeca7d83e4f4074fd0484e0e50c99ee
MD5 23d7ddda696a7d18b42fd27b61ca225e
BLAKE2b-256 7e9c36eb6c0746811cd650a5f6e1bf08e1728526b2c36d289414e511f3b48117

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page