Add tensor parallelism for attention QKVO #3211

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
gpu-2.1.0-flash2 / pytest-gpu	3m 34s
gpu-2.1.0 / pytest-gpu	3m 34s
gpu-2.0.1 / pytest-gpu	3m 19s
gpu-latest / pytest-gpu	3m 37s
	14m 4s