Backend.AI Accelerator Plugin for CUDA (Mockup)
Project description
backend.ai-accelerator-cuda-mock
A mockup plugin for CUDA accelerators
This plugin deceives the agent and manager to think as if there are CUDA devices.
The configuration follows cuda-mock.toml
placed in the same location of agent.toml
.
Please refer the sample configurations in the configs/accelerator
directory and copy one of them as a starting point.
The statistics are randomly generated in reasonable ranges, but it may seem like "jumping around" because there is no smoothing mechanism of generated values. The configurations for fractional/discrete mode, fraction size, and device masks in etcd are exactly same as the original plugin.
The containers are created without any real CUDA device mounts but with BACKENDAI_MOCK_CUDA_DEVICES
and BACKENDAI_MOCK_CUDA_DEVICE_COUNT
environment variables.
Since the manager does not know if the reported devices are real or not, you can start any CUDA-only containers (but of course they won't work as expected).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for backend.ai-accelerator-cuda-mock-23.3.0a3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6b7650a2e674c9fc640cd12c846b488f56a6268ab4d8a25f12f59c28ce64987b |
|
MD5 | be200c85dda38e0da5a77408340f3a50 |
|
BLAKE2b-256 | aa5f3ec7aa49dda4e856ecb1c697b56c8ca15bbdb37b1b27734109654634fd38 |
Hashes for backend.ai_accelerator_cuda_mock-23.3.0a3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5df684cc9d5fca9c717f26d9aa909046adb517ecd6b629d2518d04da0b179335 |
|
MD5 | ca921b12bac3e7bebeabde546a6425e3 |
|
BLAKE2b-256 | 6a833d6cc20d55e989545745b79ab151cc5eb2ec2864e7c210b8a2209e4acf31 |