Skip to main content

Backend.AI Accelerator Plugin for CUDA (Mockup)

Project description

backend.ai-accelerator-cuda-mock

A mockup plugin for CUDA accelerators

This plugin deceives the agent and manager to think as if there are CUDA devices. The configuration follows cuda-mock.toml placed in the same location of agent.toml. Please refer the sample configurations in the configs/accelerator directory and copy one of them as a starting point.

The statistics are randomly generated in reasonable ranges, but it may seem like "jumping around" because there is no smoothing mechanism of generated values. The configurations for fractional/discrete mode, fraction size, and device masks in etcd are exactly same as the original plugin.

The containers are created without any real CUDA device mounts but with BACKENDAI_MOCK_CUDA_DEVICES and BACKENDAI_MOCK_CUDA_DEVICE_COUNT environment variables. Since the manager does not know if the reported devices are real or not, you can start any CUDA-only containers (but of course they won't work as expected).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

backend.ai-accelerator-cuda-mock-23.3.0.tar.gz (11.0 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file backend.ai-accelerator-cuda-mock-23.3.0.tar.gz.

File metadata

File hashes

Hashes for backend.ai-accelerator-cuda-mock-23.3.0.tar.gz
Algorithm Hash digest
SHA256 c4d06d7fc4cddbbff817b2622e9393b5c7b90d70a7e92fd480ef23d8305edf7f
MD5 6cf0e41fb2007e2e3dc49bc526a60af6
BLAKE2b-256 a1d0524da5cf6f136b0952aee04d34b9a79d792e33d7d8d1a416c5ea43a39db5

See more details on using hashes here.

File details

Details for the file backend.ai_accelerator_cuda_mock-23.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for backend.ai_accelerator_cuda_mock-23.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6ad9d51f10b7f566e998fac78ba8743503b50f11e4b2c68906fd56f1f47211a6
MD5 f75b8614ea1004f95d1b7d088696f73b
BLAKE2b-256 9bff5b55bf5374f7192c5495529189d1f8c015c59eb45424784f2993dba2facd

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page