Segmentation of only some classes in RTMDet

[Gregorino]

I am using RTMDet segmentation model on a custom dataset consisting of cca. 20 classes. I need segmentation masks only for 2 classes, for the rest only bboxes are needed. In order to improve inference speed, I am thinking it could help to have segmentation head only doing the segmentation for the required 2 classes.
Does my hypotheses makes. any sense at all?
Can this maybe be achieved via configuration file solely or is code update needed?