We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to export model properly to ONNX/TRT with dynamic batching?
Changing code by adding dynamic_axes parameter while ONNX export doesn`t work:
dynamic_axes
torch.onnx.export(model, img, onnx_path, verbose=False, opset_version=12, input_names=['input'], output_names=["output"], dynamic_axes={'input' : {0 : 'batch_size'}, 'output' : {0 : 'batch_size'}})
Viewing model in netron shows input and output with dynamic batch but there is batch size 1 hardcoded operations inside the model.
The text was updated successfully, but these errors were encountered:
No branches or pull requests
How to export model properly to ONNX/TRT with dynamic batching?
Changing code by adding
dynamic_axes
parameter while ONNX export doesn`t work:torch.onnx.export(model, img, onnx_path, verbose=False, opset_version=12, input_names=['input'], output_names=["output"], dynamic_axes={'input' : {0 : 'batch_size'}, 'output' : {0 : 'batch_size'}})
Viewing model in netron shows input and output with dynamic batch but there is batch size 1 hardcoded operations inside the model.
The text was updated successfully, but these errors were encountered: