Hardware Requirements

[cfchi]

Hi, I'm curious about the hardware requirements for the experiment.
I've been using a 4090 GPU with 128GB of VRAM to run the prune_finetune.py script on the Garden dataset.
However, I'm encountering out-of-memory errors when setting the iteration to 5000.
What sort of hardware specifications would be necessary to achieve training quality comparable to the standards outlined in the paper?
Thanks!