This directory contains various evaluation code for Hydra, split between c++ executables and a python package
To build the c++ code, build hydra with the option -DHYDRA_ENABLE_EVAL=ON (which is on by default).
To use the python code, setup a virtual environment and pip install this directory. You can then run
hydra-eval --help
or
python -m hydra_eval --help
to see possible commands.
After running hydra, you can evaluate the timing performance of various components by
# -t will plot the elapsed time against dataset time, omitting it will show distributions
hydra-eval timing plot /path/to/results [-t]
or
hydra-eval timing show /path/to/results
will show (a very coarse) breakdown of timing by layer.