Out Of Memory

[owaisCS]

When I am trying to run the following file: (https://github.com/facebookincubator/submitit/blob/main/docs/examples/torch_distributed.py) its working fine but when I try to add slurm_additional_parameters={"mem_per_gpu": 55} parameter as specified in

submitit/submitit/slurm/test_slurm.py

Line 492 in 990d716

executor.update_parameters(**params, slurm_additional_parameters={"mem_per_gpu": 12})

I am getting the following error:

Requested GRES option unsupported by configured SelectType plugin

I need to add the param slurm_additional_parameters={"mem_per_gpu": 55} parameter because when trying to run my file without this param I am getting the error as:
srun: error: Out Of Memory