Skip to main content

TorchX SDK and Components

Project description

PyPI License Tests Lint codecov

TorchX

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

TorchX currently supports:

  • Kubernetes (EKS, GKE, AKS, etc)
  • Slurm
  • AWS Batch
  • Docker
  • Local
  • Ray (prototype)
  • GCP Batch (prototype)

Need a scheduler not listed? Let us know!

Quickstart

See the quickstart guide.

Documentation

Requirements

torchx:

  • python3 (3.8+)
  • PyTorch
  • optional: Docker (needed for docker based schedulers)

Certain schedulers may require scheduler specific requirements. See installation for info.

Installation

Stable

# install torchx sdk and CLI -- minimum dependencies
pip install torchx

# install torchx sdk and CLI -- all dependencies
pip install "torchx[dev]"

# install torchx kubeflow pipelines (kfp) support
pip install "torchx[kfp]"

# install torchx Kubernetes / Volcano support
pip install "torchx[kubernetes]"

# install torchx Ray support
pip install "torchx[ray]"

# install torchx GCP Batch support
pip install "torchx[gcp_batch]"

Nightly

# install torchx sdk and CLI
pip install torchx-nightly[dev]

Source

# install torchx sdk and CLI from source
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx

# install extra dependencies
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx[dev]

Docker

TorchX provides a docker container for using as as part of a TorchX role.

See: https://github.com/pytorch/torchx/pkgs/container/torchx

Contributing

We welcome PRs! See the CONTRIBUTING file.

License

TorchX is BSD licensed, as found in the LICENSE file.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

torchx_nightly-2024.4.16-py3-none-any.whl (254.4 kB view details)

Uploaded Python 3

File details

Details for the file torchx_nightly-2024.4.16-py3-none-any.whl.

File metadata

File hashes

Hashes for torchx_nightly-2024.4.16-py3-none-any.whl
Algorithm Hash digest
SHA256 4c03989e8516d212fde894a336087060356f4d75f574b357ce33e8d93597a38e
MD5 2e31e11b6f58bb93b249834ff4d1fbdd
BLAKE2b-256 86f50fd170abc287852dd01d7fb8c4043a13c1a5a1ba9fb812def0a93e1d29ac

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page