Cloud Select

This is a tool that helps a user select a cloud. It will make it easy for an HPC user to say:

I need 4 nodes with these criteria, to run in the cloud.

And then be given a set of options and prices for different clouds to choose from. There are some supporting packages that exist already (in Go for AWS) so we will start there.

🚧️ under development 🚧️

This tool is under development and is not ready for production use. See our

• ⭐️ Documentation ⭐️
• 📦️ Pypi Package 📦️

TODO and Questions

• [ ]create cache of instance types and maybe prices in GitHub (e.g., automated update)
• add tests and testing workflow
  • properties testing for handling min/max/numbers
  • ensure that required set of attributes for each instance are returned (e.g., name, cpu, memory)
• how to handle instances that don't have an attribute of interest? Should we unselect them?
• add GPU memory - available in AWS and I cannot find for GCP
• should cache be organized by region to allow easier filter (data for AWS doesn't have that attribute)
• need to do something with costs
• can we just scrape prices from? https://cloud.google.com/compute/all-pricing
• TODO: we don't currently account for region as unique property in results (and need to)
• go through list of instance features and implement remaining (if possible)

Future desires

These are either "nice to have" or small details we can improve upon. Aka, not top priority.

• should we allow currency outside USD? Probably not for now.
• could eventually support different resource types (beyond compute or types of prices, e.g., pre-emptible vs. on demand)
• aws instance listing (based on regions) should validate regions - an invalid regions simply returns no results
• for AWS description, when appropriate convert to TB (like Google does)

😁️ Contributors 😁️

We use the all-contributors tool to generate a contributors graphic below.

Vanessasaurus 💻

License

HPCIC DevTools is distributed under the terms of the MIT license. All new contributions must be made under this license.

See LICENSE, COPYRIGHT, and NOTICE for details.

SPDX-License-Identifier: (MIT)

LLNL-CODE- 842614