TorchServe is a tool for serving neural net models for inference
Project description
TorchServe is a flexible and easy to use tool for serving PyTorch models in production.
Use the TorchServe CLI, or the pre-configured Docker images, to start a service that sets up HTTP endpoints to handle model inference requests.
Installation
Full installation instructions are in the project repo: https://github.com/pytorch/serve/blob/master/README.md
Source code
You can check the latest source code as follows:
git clone https://github.com/pytorch/serve.git
Citation
If you use torchserve in a publication or project, please cite torchserve: https://github.com/pytorch/serve
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
File details
Details for the file torchserve_nightly-2024.6.6-py3-none-any.whl.
File metadata
- Download URL: torchserve_nightly-2024.6.6-py3-none-any.whl
- Upload date:
- Size: 24.3 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.19
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5aa16c7a95e415a3e8bc95edd53e9db92f40fe1cf7972044b06626091b083651 |
|
| MD5 | 16a1998c78eb5e2d339366b5f6944ca0 |
|
| BLAKE2b-256 | 356d8fb6b3cc12dcd468fbb5dad938941a2f714dd289ad12ec0ff2ddb3c3c7fc |
