Generations stuck at 98% while using multiple endpoints (or config.clusters)

[G-370]

And also in the cases where it is stuck at 98% we can observe that the terminal shows it starting at step -1 for some reason.

Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : -1 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 0 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 1 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 2 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 3 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 4 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 5 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 6 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 7 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 8 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 9 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 10 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 11 / 50
Updating status type 0 :  in Guilds: 15, Jobs: 1/0, Hosts: 7
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 12 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 13 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 14 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 15 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 16 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 17 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 18 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 19 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 20 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 21 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 22 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 23 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 24 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 25 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 26 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 27 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 28 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 29 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 30 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 31 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 32 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 33 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 34 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 35 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 36 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 37 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 38 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 39 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 40 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 41 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 42 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 43 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 44 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 45 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 46 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 47 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 48 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e 1 : 49 / 50
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e finished denoise_latents
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e started string
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e finished string
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e started metadata_item
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e finished metadata_item
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e started metadata
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e finished metadata
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e started core_metadata
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e finished core_metadata
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e started collect
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e finished collect
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e started merge_metadata
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e finished merge_metadata
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e started l2i
Fifth loading sdxl/proteus-V2.5/vae
Fifth loaded: proteus-V2.5
Fifth f85e125f-537d-4c43-aedb-5cb830d5c61e finished l2i