Is there a way to get the address of activation tensors?

[andylee-24]

Hello, I'm trying to do memory simulation with ONNX.

Is there a way to get the beginning address and size of activations (intermediate input / output buffers) of the given ONNX model
while using the defaultCPU execution providers? The attached figure depicts What I'm trying to inspect.
It would be very helpful if I know the related files, class, structures or keywords....

Thanks in advance,

TaeHan Lee.

[hariharans29]

ORT doesn't have public APIs to query these.

If you would like to study more - here is a good place to start -

onnxruntime/onnxruntime/core/framework/allocation_planner.cc

Line 135 in 14d349e

PlannerImpl(const Node* parent_node, const onnxruntime::GraphViewer& graph_viewer,

. It has logic to deteermine if ORT can re-use a buffer/ has to allocate new buffer for activations. Please keep in mind that these are internal implementation details of ORT and they are bound to change.

[andylee-24]

Thanks a lot!