Skip to content

Model Formats

Overall comparison

Format Ecosystem Cross-Framework Performance Typical Deployment
ONNX General Strong High Industrial deployment
TorchScript PyTorch Weak High C++ inference
SavedModel TensorFlow Weak Medium TensorFlow servers
TensorRT NVIDIA Weak Very high GPU servers
OpenVINO Intel Weak High CPU inference
CoreML Apple Weak High iOS devices
TFLite Mobile Weak Medium Phones and embedded