Tool for calculating costs and needs between cloud and HPC.
Project description
Cloud Select
This is a tool that helps a user select a cloud. It will make it easy for an HPC user to say:
I need 4 nodes with these criteria, to run in the cloud.
And then be given a set of options and prices for different clouds to choose from. There are some supporting packages that exist already (in Go for AWS) so we will start there.
🚧️ under development 🚧️
This tool is under development and is not ready for production use. See our
- ⭐️ Documentation ⭐️
- 📦️ Pypi Package 📦️
TODO and Questions
- [ ]create cache of instance types and maybe prices in GitHub (e.g., automated update)
- add tests and testing workflow
- properties testing for handling min/max/numbers
- ensure that required set of attributes for each instance are returned (e.g., name, cpu, memory)
- how to handle instances that don't have an attribute of interest? Should we unselect them?
- add GPU memory - available in AWS and I cannot find for GCP
- should cache be organized by region to allow easier filter (data for AWS doesn't have that attribute)
- need to do something with costs
- can we just scrape prices from? https://cloud.google.com/compute/all-pricing
- TODO: we don't currently account for region as unique property in results (and need to)
- go through list of instance features and implement remaining (if possible)
Future desires
These are either "nice to have" or small details we can improve upon. Aka, not top priority.
- should we allow currency outside USD? Probably not for now.
- could eventually support different resource types (beyond compute or types of prices, e.g., pre-emptible vs. on demand)
- aws instance listing (based on regions) should validate regions - an invalid regions simply returns no results
- for AWS description, when appropriate convert to TB (like Google does)
😁️ Contributors 😁️
We use the all-contributors tool to generate a contributors graphic below.
Vanessasaurus 💻 |
License
HPCIC DevTools is distributed under the terms of the MIT license. All new contributions must be made under this license.
See LICENSE, COPYRIGHT, and NOTICE for details.
SPDX-License-Identifier: (MIT)
LLNL-CODE- 842614
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.