Support multi-query attention for encoder-decoder models #2270

Job	Run time
build-and-push-docker-images	34m 22s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	8m 10s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	7m 53s
build-and-test-cpp-x86_64 (macos-11, mkl)	12m 43s
build-and-test-cpp-x86_64 (macos-11, dnnl)	10m 54s
build-and-test-cpp-aarch64 (openblas)	6m 12s
build-python-wheels (ubuntu-20.04, auto64)	41m 46s
build-python-wheels (macos-11, auto64)	1h 5m 54s
build-python-wheels (windows-2019, auto64)	1h 8m 7s
build-python-wheels (ubuntu-20.04, aarch64)	1h 46m 2s
build-python-wheels (macos-11, arm64)	11m 32s
check-python-style	16s
build-and-deploy-docs	40s
test-python-wheels (ubuntu-20.04)	12m 50s
test-python-wheels (macos-11)	7m 45s
test-python-wheels (windows-2019)	4m 21s
publish-python-wheels-on-pypi	0s
	6h 39m 27s

Provide feedback