You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We noticed VAE Perf Gap b/w Torch-TRT and ONNX-TRT. ONNX-TRT is about 30-40% faster than Torch-TRT. We found that for group_norm layer, ONNX-TRT is using a workaround provided by TensorRT team, InstanceNormalization. Torch-TensorRT uses add_normalization for direct conversion.