Backend.AI Accelerator Plugin for CUDA (Mockup)
Project description
backend.ai-accelerator-cuda-mock
A mockup plugin for CUDA accelerators
This plugin deceives the agent and manager to think as if there are CUDA devices.
The configuration follows cuda-mock.toml
placed in the same location of agent.toml
.
Please refer the sample configurations in the configs/accelerator
directory and copy one of them as a starting point.
The statistics are randomly generated in reasonable ranges, but it may seem like "jumping around" because there is no smoothing mechanism of generated values. The configurations for fractional/discrete mode, fraction size, and device masks in etcd are exactly same as the original plugin.
The containers are created without any real CUDA device mounts but with BACKENDAI_MOCK_CUDA_DEVICES
and BACKENDAI_MOCK_CUDA_DEVICE_COUNT
environment variables.
Since the manager does not know if the reported devices are real or not, you can start any CUDA-only containers (but of course they won't work as expected).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for backend.ai-accelerator-cuda-mock-23.3.0a4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 61503ebaccfa42e091453d9ae7941c9ee9cdf5bf48cffe081a5012d9a73ff192 |
|
MD5 | 13116cadf3d3e4a949dcce044a1d2e5f |
|
BLAKE2b-256 | 66e1f0f785834d9e22a19cf786f69a472b5c56c936698a5ea59e2d4e541b488a |
Hashes for backend.ai_accelerator_cuda_mock-23.3.0a4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 68e2defd9670103d39e119163f4e18d96c715caca37337bfeb0c8113a8fb73e3 |
|
MD5 | c412a1e40636e6a37d562875d059c5dc |
|
BLAKE2b-256 | a10e7c73a4c7ab6bf9b66f4cfe1d914e2f37c8861cd226cd3e17232293d37724 |