Management of QHub on Cloud Infrastructure
Project description
qhub - automated data science environments on cloud environments
QHub is an open source project from Quansight that enables organizations to build and maintain cost-effective and scalable compute/data science platforms on-premise or on any cloud provider with minimal in-house experience. It is a focused JupyterHub distribution that integrates many open source libraries into a coherent platform. The components that form QHub can be rearranged and customized to support many different enterprise use cases. For more information see https://www.quansight.com/post/announcing-qhub.
Quansight LLC is a data science and analytics consulting firm specializing in open source software around the PyData community including Jupyter, scikit-learn, Dask, Pandas, PyTorch, NumPy, SciPy, and much more. Quansight was co-founded by Travis Oliphant, founder of Anaconda, NumFOCUS, and PyData and creator of SciPy, NumPy, and Numba. For more information see https://www.quansight.com/about-us.
Usage
qhub is installed as a command line application in Python. It requires you to choose your the cloud provider you desire. once you've decided on a provider qhub will walk you through the following steps to configure your deployment:
- initialize
- render
- deploy
these steps realized using the qhub CLI.
initialize configurations
qhub init do
qhub init aws
qhub init gcp
The qhub init command will generate configuration files for that service. The configutation files can be tailored to the needs of your organization. Each file specifies general project information, security, infrastructure settings, computational resource profiles and data science environments. See documentation on modifying your configuration file for all of the cloud providers: Configuration File
The configuration file is your user interface into deploying and scaling your data science environment. Each change triggers Github Action that will seamlessly update your infrastructure.
Check out the qhub documentation for more detailed information.
rendering the configuration file
we need more information here.
qhub render -c qhub-config.yaml -o ./ --force
what is this business?
qhub interfaces
The qhub api normalizes with the nuances of configuring interactive data science environments across multiple client providers. The python command line interfaces define an initial environment state that is modified, and its changes are propogated by continuous integration.
Each qhub cloud provider has different configuration specifications; more details can be found at the following links about the Digital Ocean, AWS, and GCP configurations.
Installing qhub
qhub is a pure python package that can be downloaded from the pypi.
pip install qhub
License
Developer
qhub is an open source project and welcomes issues and pull requests.
Contributing
Release
Creating a release:
- Increment the version number in
qhub/VERSION - Ensure that the version number in
qhub/VERSIONis used in pinning qhub in the github actionsqhub/template/{{ cookiecutter.repo_directory }}/.github/workflows/qhub-config.yaml
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file qhub-0.1.20.tar.gz.
File metadata
- Download URL: qhub-0.1.20.tar.gz
- Upload date:
- Size: 32.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.8.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c7cd1a05657a5a9d714742db9f5f303fe9308fda40c77d826ea4c51d4e36ac52 |
|
| MD5 | d80f9ec60d7460866aaead12fda01025 |
|
| BLAKE2b-256 | d646004a6507a0defaf1a5e9fde100cbd86966e1e8faffdbf8ba79d5a735b603 |
