Skip to main content

TorchX SDK and Components

Project description

PyPI License Tests Lint codecov

TorchX

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

TorchX currently supports:

  • Kubernetes (EKS, GKE, AKS, etc)
  • Slurm
  • AWS Batch
  • Docker
  • Local
  • Ray (prototype)
  • GCP Batch (prototype)

Need a scheduler not listed? Let us know!

Quickstart

See the quickstart guide.

Documentation

Requirements

torchx:

  • python3 (3.8+)
  • PyTorch
  • optional: Docker (needed for docker based schedulers)

Certain schedulers may require scheduler specific requirements. See installation for info.

Installation

Stable

# install torchx sdk and CLI -- minimum dependencies
pip install torchx

# install torchx sdk and CLI -- all dependencies
pip install "torchx[dev]"

# install torchx kubeflow pipelines (kfp) support
pip install "torchx[kfp]"

# install torchx Kubernetes / Volcano support
pip install "torchx[kubernetes]"

# install torchx Ray support
pip install "torchx[ray]"

# install torchx GCP Batch support
pip install "torchx[gcp_batch]"

Nightly

# install torchx sdk and CLI
pip install torchx-nightly[dev]

Source

# install torchx sdk and CLI from source
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx

# install extra dependencies
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx[dev]

Docker

TorchX provides a docker container for using as as part of a TorchX role.

See: https://github.com/pytorch/torchx/pkgs/container/torchx

Contributing

We welcome PRs! See the CONTRIBUTING file.

License

TorchX is BSD licensed, as found in the LICENSE file.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

torchx-0.6.0.tar.gz (187.1 kB view details)

Uploaded Source

Built Distribution

torchx-0.6.0-py3-none-any.whl (244.4 kB view details)

Uploaded Python 3

File details

Details for the file torchx-0.6.0.tar.gz.

File metadata

  • Download URL: torchx-0.6.0.tar.gz
  • Upload date:
  • Size: 187.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for torchx-0.6.0.tar.gz
Algorithm Hash digest
SHA256 53606233f3a83e10023857f9d65b97b758490797610a996067b53da049fe38b8
MD5 7b2202df6615ae8d96604f685a729ff7
BLAKE2b-256 a716a3984ea76f13936748772715d16dc7cfdc56ca741ac14a7bdfa441d572ab

See more details on using hashes here.

Provenance

File details

Details for the file torchx-0.6.0-py3-none-any.whl.

File metadata

  • Download URL: torchx-0.6.0-py3-none-any.whl
  • Upload date:
  • Size: 244.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.13

File hashes

Hashes for torchx-0.6.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f78aea532db8929187a668baf5cf7069a5b528aff0a2a34071c4011067184cb2
MD5 df8ee8052e80022fb91a8b3625c19e55
BLAKE2b-256 6dfb705826498cde146f00f24775e4ea34dc99a02e3876e9e1b653275a2eedd0

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page