Experimental tools for converting PyTorch models to ONNX
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Project description
PyTorch to ONNX Exporter
Experimental torch ONNX exporter.
[!WARNING] This is an experimental project and is not designed for production use. Use
torch.onnx.exportfor these purposes.
Installation
pip install --upgrade torch-onnx
Usage
import torch
import torch_onnx
from onnxscript import ir
import onnx
# Get an exported program with torch.export
exported = torch.export.export(...)
model = torch_onnx.exported_program_to_ir(exported)
proto = ir.to_proto(model)
onnx.save(proto, "model.onnx")
# Or patch the torch.onnx export API
# Set error_report=True to get a detailed error report if the export fails
torch_onnx.patch_torch(report=True, verify=True, profile=True)
torch.onnx.export(...)
# Use the analysis API to print an analysis report for unsupported ops
torch_onnx.analyze(exported)
Design
{dynamo/jit} -> {ExportedProgram} -> {torchlib} -> {ONNX IR} -> {ONNX}
- Use ExportedProgram
- Rely on robustness of the torch.export implementation
- Reduce complexity in the exporter
- This does not solve dynamo limitations, but it avoids introducing additional breakage by running fx passes
- Flat graph; Scope info as metadata, not functions
- Because existing tools are not good at handling them
- Eager optimization where appropriate
- Because exsiting tools are not good at optimizing
- Drop in replacement for torch.onnx.export
- Minimum migration effort
- Build graph eagerly in the exporter
- Give the exporter full control over the graph being built
Why is this doable?
- We need to verify torch.export coverage on Huggingface Optimum https://github.com/huggingface/optimum/tree/main/optimum/exporters/onnx; and they are not patching torch.onnx itself.
- Patch torch.onnx.export such that packages do not need to change a single line to use dynamo
- We have all operators implemented and portable
Project details
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
torch_onnx-0.1.10.tar.gz
(63.1 kB
view details)
Built Distribution
File details
Details for the file torch_onnx-0.1.10.tar.gz.
File metadata
- Download URL: torch_onnx-0.1.10.tar.gz
- Upload date:
- Size: 63.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/4.0.1 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5758d7d460052dbe174c63e6df766cac9be1e5b80cbb94fe747177a6fc311626 |
|
| MD5 | b0ff6a89a4c9d3442f576f397f9be47d |
|
| BLAKE2b-256 | 863eed28288c5b0bdda5a86d6426717d4cb44ae66176697358b6743625ea8bb8 |
File details
Details for the file torch_onnx-0.1.10-py3-none-any.whl.
File metadata
- Download URL: torch_onnx-0.1.10-py3-none-any.whl
- Upload date:
- Size: 69.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/4.0.1 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 17838d1e22acb333f993ff6fc5aec954a75391191b0a2d3586f5715277581cd6 |
|
| MD5 | 59bee5d8a0e58699915f12bb345ea506 |
|
| BLAKE2b-256 | d0d9af9228b1e142827f915f10cbef487ac51d24ed4ba3959dd0090251719de9 |
