Backend.AI Accelerator Plugin for CUDA (Mockup)
Project description
backend.ai-accelerator-cuda-mock
A mockup plugin for CUDA accelerators
This plugin deceives the agent and manager to think as if there are CUDA devices.
The configuration follows cuda-mock.toml
placed in the same location of agent.toml
.
Please refer the sample configurations in the configs/accelerator
directory and copy one of them as a starting point.
The statistics are randomly generated in reasonable ranges, but it may seem like "jumping around" because there is no smoothing mechanism of generated values. The configurations for fractional/discrete mode, fraction size, and device masks in etcd are exactly same as the original plugin.
The containers are created without any real CUDA device mounts but with BACKENDAI_MOCK_CUDA_DEVICES
and BACKENDAI_MOCK_CUDA_DEVICE_COUNT
environment variables.
Since the manager does not know if the reported devices are real or not, you can start any CUDA-only containers (but of course they won't work as expected).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for backend.ai_accelerator_cuda_mock-23.3.0.dev0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 329003efef288cdf33c1beb301ce70ad4d981b127fc513f9e36ba455a42e1b7f |
|
MD5 | e0da6ea0a03bcc49bf97eb38a40d4a50 |
|
BLAKE2b-256 | 7df6d5bef91fec03fc11a1bc0466c86c0076edfcd229a1f60f94b09879f9f233 |