Skip to main content

Backend.AI Accelerator Plugin for CUDA (Mockup)

Project description

backend.ai-accelerator-cuda-mock

A mockup plugin for CUDA accelerators

This plugin deceives the agent and manager to think as if there are CUDA devices. The configuration follows cuda-mock.toml placed in the same location of agent.toml. Please refer the sample configurations in the configs/accelerator directory and copy one of them as a starting point.

The statistics are randomly generated in reasonable ranges, but it may seem like "jumping around" because there is no smoothing mechanism of generated values. The configurations for fractional/discrete mode, fraction size, and device masks in etcd are exactly same as the original plugin.

The containers are created without any real CUDA device mounts but with BACKENDAI_MOCK_CUDA_DEVICES and BACKENDAI_MOCK_CUDA_DEVICE_COUNT environment variables. Since the manager does not know if the reported devices are real or not, you can start any CUDA-only containers (but of course they won't work as expected).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

File details

Details for the file backend.ai-accelerator-cuda-mock-22.6.0b4.tar.gz.

File metadata

File hashes

Hashes for backend.ai-accelerator-cuda-mock-22.6.0b4.tar.gz
Algorithm Hash digest
SHA256 50f7f7c2804282a454d9787c80755467f9e99e9c4083520675f269dfe4bdfc87
MD5 d80e2955cb646d3f732b85920af72a44
BLAKE2b-256 2923b550f7f57e8656a3c4dda012b9c197d960efe36c33a57b8002abc605f802

See more details on using hashes here.

Provenance

File details

Details for the file backend.ai_accelerator_cuda_mock-22.6.0b4-py3-none-any.whl.

File metadata

File hashes

Hashes for backend.ai_accelerator_cuda_mock-22.6.0b4-py3-none-any.whl
Algorithm Hash digest
SHA256 bc95d511299a877d41064cbb0fd978899316b2f01eb9a7642a06e29c146678c3
MD5 c1f2cf36192f384274a2c33caba52ee7
BLAKE2b-256 03249397e5a64967060b87f7322f96d4964901321090580567394bb08bf8de6a

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page