Fix vision encoder decoder that may not cache cross-attention (#1210)

Fix vision encoder decoder that may not cache cross-attention (#1210) #598