Fix vision encoder decoder that may not cache cross-attention

Fix vision encoder decoder that may not cache cross-attention #1552