ncar-jobqueue

Utilities for expanding dask-jobqueue with appropriate settings for NCAR's clusters

Project description

Utilities for expanding dask-jobqueue with appropriate settings for NCAR’s clusters.

Supported clusters:

Cheyenne
Casper (DAV)
CGD’s Hobart

Installation

ncar-jobqueue can be installed from PyPI with pip:

pip install ncar-jobqueue

Usage

Casper

>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=2, memory=50.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)

Cheyenne

>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=72, memory=218.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)

Hobart

>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=96, memory=192.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)

Project details

Release history Release notifications | RSS feed

2021.4.14

Apr 14, 2021

2021.2.10

Feb 10, 2021

2020.12.4

Dec 4, 2020

2020.11.18

Nov 18, 2020

2020.3.4

Mar 4, 2020

2020.1.15

Jan 15, 2020

2020.1.7

Jan 7, 2020

2019.10.16.1

Oct 16, 2019

This version

2019.10.16

Oct 16, 2019

2019.10.13

Oct 13, 2019

2019.9.11

Sep 11, 2019

2019.8.2

Aug 2, 2019

2019.3.8

Mar 8, 2019

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ncar-jobqueue-2019.10.16.tar.gz (9.8 kB view details)

Uploaded Oct 16, 2019 Source

Built Distribution

ncar_jobqueue-2019.10.16-py3-none-any.whl (10.0 kB view details)

Uploaded Oct 16, 2019 Python 3

File details

Details for the file ncar-jobqueue-2019.10.16.tar.gz.

File metadata

Download URL: ncar-jobqueue-2019.10.16.tar.gz
Upload date: Oct 16, 2019
Size: 9.8 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.7.3

File hashes

Hashes for ncar-jobqueue-2019.10.16.tar.gz
Algorithm	Hash digest
SHA256	`51ad459e67816a388c06eefae4385fcd86216edd7784c759c3eaf5540191de60`
MD5	`545e5ad918aa564a8c115c76937c448b`
BLAKE2b-256	`5f7fb14ef048d1208cc019d6bf33bfde234fb295a29ddf779790228c71aaa05c`

See more details on using hashes here.

File details

Details for the file ncar_jobqueue-2019.10.16-py3-none-any.whl.

File metadata

Download URL: ncar_jobqueue-2019.10.16-py3-none-any.whl
Upload date: Oct 16, 2019
Size: 10.0 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.7.3

File hashes

Hashes for ncar_jobqueue-2019.10.16-py3-none-any.whl
Algorithm	Hash digest
SHA256	`c2955049e8f9dbe27e86c6049e430990352c3f8c4b4ed09695054b4df115d82d`
MD5	`adc2610b4e9678b70117a04b68b59bfb`
BLAKE2b-256	`7dba31572ee229b35b76f280c9ed80ff12be0c6a0e3f64b40741b7b8e690ca7c`