Skip to main content

TorchX SDK and Components

Project description

PyPI License Tests Lint codecov

TorchX

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

TorchX currently supports:

  • Kubernetes (EKS, GKE, AKS, etc)
  • Slurm
  • AWS Batch
  • Docker
  • Local
  • Ray (prototype)

Need a scheduler not listed? Let us know!

Quickstart

See the quickstart guide.

Documentation

Requirements

torchx:

  • python3 (3.8+)
  • PyTorch
  • optional: Docker (needed for docker based schedulers)

Certain schedulers may require scheduler specific requirements. See installation for info.

Installation

Stable

# install torchx sdk and CLI -- minimum dependencies
pip install torchx

# install torchx sdk and CLI -- all dependencies
pip install "torchx[dev]"

# install torchx kubeflow pipelines (kfp) support
pip install "torchx[kfp]"

# install torchx Kubernetes / Volcano support
pip install "torchx[kubernetes]"

# install torchx Ray support
pip install "torchx[ray]"

Nightly

# install torchx sdk and CLI
pip install torchx-nightly[dev]

Source

# install torchx sdk and CLI from source
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx

# install extra dependencies
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx[dev]

Docker

TorchX provides a docker container for using as as part of a TorchX role.

See: https://github.com/pytorch/torchx/pkgs/container/torchx

Contributing

We welcome PRs! See the CONTRIBUTING file.

License

TorchX is BSD licensed, as found in the LICENSE file.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

torchx-0.2.0.tar.gz (132.7 kB view details)

Uploaded Source

Built Distribution

torchx-0.2.0-py3-none-any.whl (177.6 kB view details)

Uploaded Python 3

File details

Details for the file torchx-0.2.0.tar.gz.

File metadata

  • Download URL: torchx-0.2.0.tar.gz
  • Upload date:
  • Size: 132.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.4

File hashes

Hashes for torchx-0.2.0.tar.gz
Algorithm Hash digest
SHA256 d1eacdb9fa9990d7e790ffc8a7ad9a2e78e28a319140355acb5482f846330280
MD5 2026c4e72e6ac65847bba4666032d891
BLAKE2b-256 b186b08c5de2499e2c068a35c0e0c67a215cdee66e78069d7a19009ad4fa0d5c

See more details on using hashes here.

Provenance

File details

Details for the file torchx-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: torchx-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 177.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.4

File hashes

Hashes for torchx-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2010b43595dfbc3bf4090eabb5e8fe629cecba0391170c292ec5326ebd83b1cb
MD5 8fd54fff7b0e935cac75676009403dce
BLAKE2b-256 fcc733f5f2448cc7873d9c1a2958086f92049294fdd58d1ba6569f5b30d08014

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page