How to pass a CUDA buffer into ONNX session ? #16602
-
I am using CUDA EP with C++ API. Currently I pass system memory buffers to the session for inference. |
Beta Was this translation helpful? Give feedback.
Answered by
baijumeswani
Jul 5, 2023
Replies: 1 comment 1 reply
-
You can do this with Example usage in Python: https://onnxruntime.ai/docs/api/python/api_summary.html#data-on-device |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
baijumeswani
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
You can do this with
IOBinding
.Example usage in Python:
https://onnxruntime.ai/docs/api/python/api_summary.html#data-on-device