Backend.AI Mockup Accelerator Plugin
Project description
backend.ai-accelerator-mock
A mockup plugin for accelerators
This plugin deceives the agent and manager to think as if there are accelerator devices.
The configuration follows mock-accelerator.toml
placed in the same location of agent.toml
.
Please refer the sample configurations in the configs/accelerator
directory and copy one of them as a starting point.
The statistics are randomly generated in reasonable ranges, but it may seem like "jumping around" because there is no smoothing mechanism of generated values. The configurations for fractional/discrete mode, fraction size, and device masks in etcd are exactly same as the original plugin.
Notes when setting up mock CUDA devices
The containers are created without any real CUDA device mounts but with BACKENDAI_MOCK_CUDA_DEVICES
and BACKENDAI_MOCK_CUDA_DEVICE_COUNT
environment variables.
Since the manager does not know if the reported devices are real or not, you can start any CUDA-only containers (but of course they won't work as expected).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for backend_ai_accelerator_mock-24.3.8rc2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | bec5b003d89afb31d028f6ecf5e7fd7fc3e07e34bde9d2434676b9c14042cfa7 |
|
MD5 | 541509da84259d4c137cc89ab5efa644 |
|
BLAKE2b-256 | 2c8dfb4d1411e351f7b4849d21e3f314763647377ff84458e0e3c49c3a25fdc0 |
Hashes for backend.ai_accelerator_mock-24.3.8rc2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 68f28ea206f3a3d12fe3dccc9923ce82b44f94fbba5cf652bf978b07266bc8d6 |
|
MD5 | 321d19bddcd7f5f98629404c64de23c5 |
|
BLAKE2b-256 | c57978560c1f4de1207f9c5052595b721bca2c0c3cd8d312eeeb4ce5ba71e344 |