Skip to main content

Backend.AI Accelerator Plugin for CUDA (Mockup)

Project description

backend.ai-accelerator-cuda-mock

A mockup plugin for CUDA accelerators

This plugin deceives the agent and manager to think as if there are CUDA devices. The configuration follows cuda-mock.toml placed in the same location of agent.toml. Please refer the sample configurations in the configs/accelerator directory and copy one of them as a starting point.

The statistics are randomly generated in reasonable ranges, but it may seem like "jumping around" because there is no smoothing mechanism of generated values. The configurations for fractional/discrete mode, fraction size, and device masks in etcd are exactly same as the original plugin.

The containers are created without any real CUDA device mounts but with BACKENDAI_MOCK_CUDA_DEVICES and BACKENDAI_MOCK_CUDA_DEVICE_COUNT environment variables. Since the manager does not know if the reported devices are real or not, you can start any CUDA-only containers (but of course they won't work as expected).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

backend.ai-accelerator-cuda-mock-22.9.4.tar.gz (10.7 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file backend.ai-accelerator-cuda-mock-22.9.4.tar.gz.

File metadata

File hashes

Hashes for backend.ai-accelerator-cuda-mock-22.9.4.tar.gz
Algorithm Hash digest
SHA256 b0b00d41822bb3a73df8e770b73add7070fe6970ba4c3c61b396626534e3cc40
MD5 d500919cd0398eef3e0f710d02af2198
BLAKE2b-256 1abf4896fca99e6bdcdc7c373a9bcc9885f89aec84956b3bd9153f285f192b0d

See more details on using hashes here.

Provenance

File details

Details for the file backend.ai_accelerator_cuda_mock-22.9.4-py3-none-any.whl.

File metadata

File hashes

Hashes for backend.ai_accelerator_cuda_mock-22.9.4-py3-none-any.whl
Algorithm Hash digest
SHA256 310c0f6526246c001e9289103b4def329bd713e1e2c80f7692feab5dd2c9d704
MD5 dd96e083ac22c99f41db7a40a6cc582f
BLAKE2b-256 c75914d89d797e418723d85627ec25fbe57731595d21e006ce9df12ddb2ca84b

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page