CADC VOS Class Libraries
Project description
vos is a set of python modules and scripts that ease access to VOSpace.
The default installation of vos is tuned for accessing the VOSpace provided by the Canadian Advanced Network For Astronomical Research (CANFAR)
VOSpace is a Distributed Cloud storage service for use in Astronomy.
There are two ways to use vos:
access VOSpace using the command-line script: eg. vcp
use the vos module inside a Python script: import vos
Authentication to the CANFAR VOSpace service is performed using X509 security certificates, header tokens or username/password pairs. The authentication system is managed by the CADC Group Management Service (GMS).
To retrieve an X509 security certificate for use with the vos tools use the getCert script included with this package.
Additional information is available in the CANFAR documentation
System Requirments
A CANFAR VOSpace account (required for WRITE access, READ access can be anonymous)
fuse OR OSX-FUSE (see additional documentation, only required for filesystem based access, not for command line or programmatic)
python2.6 or later
Installation
vos is distributed via PyPI/vos and PyPI is the most direct way to get the latest stable release:
pip install vos --upgrade --user
Or, you can retrieve the github distribution and use
python setup.py install --user
Tutorial
Get a CANFAR account
Install the vos package.
Retrieve a X509/SSL certificate using the getCert script installed as part of the cadcutils package that is automatically installed wiht vos.
Example Usage.
Commandline usage:
vls -l vos: [List a vospace]
vcp vos:jkavelaars/test.txt ./ [copies test.txt to the local directory from vospace]
vchmod g+q vos:VOSPACE/foo/bar.txt 'GROUP1, GROUP2, GROUP3' to give three user GROUPs permission to write to this file.
vmkdir --help [get a list of command line options and arguments]
vmkdir, vrm, vrmdir, vsync vcat, vchmod and vln
The complete list of vos commmand line tools can be found using pydoc vos.commands
In a Python script (the example below provides a listing of a vospace container)
#!python import vos client = vos.Client() client.listdir('vos:jkavelaars')
Development
A virtual environment (venv) is recommended to set up external dependencies without installing them system-wide. Following these instructions, install virtualenv:
$ pip install virtualenv
Next, create, and activate a local venv (this example uses bash):
$ virtualenv venv $ source venv/bin/activate
Setup the new development environment for testing by installing the appropriate packages:
$ pip install -r dev_requirements.txt
The test environment is built into the setup.py so that conducting unit-tests can be achieved like so:
$ python setup.py test
If you would like versbose output formated as a web page, for example, you can add options to the test call:
$ python setup.py test --addopts '--cov-report html:cov_html --cov=vos'
The same option attribute can be used to pass other arguments to py.test that is executing the test. To run specific only tests for example:
$ python setup.py test --addopts 'vos/test/Test_vos.py::TestClient::test_transfer_error'
Each time you resume work on the project and want to use the venv (e.g., from a new shell), simply re-activate it:
$ source venv/bin/activate
When done, just issue a
$ deactivate
command to deactivate the virtual environment.
Integration Tests
The integration tests are, at present, designed to run only with the CADC VOSpace. Tests assume that vos and/or vofs packages have been installed.
Activate the venv and install vos
$ source venv/bin/activate.csh $ pip install vos
Run the tests:
$ ./test/scripts/vospace-all.tcsh
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file vos-3.1.1.tar.gz.
File metadata
- Download URL: vos-3.1.1.tar.gz
- Upload date:
- Size: 64.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.7.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9277964bb372df064664f25149ed834447cdf77e089fbae788ee6f577ce991a5 |
|
| MD5 | 24cb999a86288f7441add7a9872e8bed |
|
| BLAKE2b-256 | 90b105e161f7d46f23d93b95a89224f25385f884fc7b9e911b4d02b379240117 |
