ONNX Runtime ☆

ONNX defines an open interchange format for trained models; ONNX Runtime executes them across CPUs, GPUs and NPUs. It is the pragmatic layer for enterprise and edge deployment where the serving hardware is not chosen by the model's authors.