Utilities for expanding dask-jobqueue with appropriate settings for NCAR's clusters
Project description
ncar-jobqueue
Utilities for expanding dask-jobqueue with appropriate settings for NCAR’s clusters.
Supported clusters:
Cheyenne
Casper (DAV)
CGD’s Hobart
Installation
ncar-jobqueue can be installed from PyPI with pip:
pip install ncar-jobqueue
Usage
Casper
>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=2, memory=50.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)
Cheyenne
>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=72, memory=218.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)
Hobart
>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=96, memory=192.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ncar-jobqueue-2020.1.15.tar.gz
(11.1 kB
view hashes)
Built Distribution
Close
Hashes for ncar_jobqueue-2020.1.15-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3719c72b249922bf3e40c42d4b6c840dd800a41604cd8ccbbfe7ed4a59c06ef1 |
|
MD5 | d330800787a0a957597b0f19f7ac8eb2 |
|
BLAKE2b-256 | ca462db4b0cfc2edeff087b54716719abaad2dc66726b7b0b1ab7648914f38b7 |