Fix Client overwriting its connection cache when using a custom Net.ctx

Fix Client overwriting its connection cache when using a custom Net.ctx #949