Load controlnet in fp8 if weights are in fp8. #181

Job	Run time
test-unix-nightly (macos, 3.11, 12.1, nightly)	9m 2s
test-win-nightly (windows, 3.9, 12.1, nightly)	3m 41s
test-unix-nightly (linux, 3.11, 12.1, nightly)	5m 56s
test-stable (macos, 3.9, 12.1, stable)	8m 58s
test-win-nightly (windows, 3.10, 12.1, nightly)	3m 50s
test-stable (macos, 3.10, 12.1, stable)	8m 59s
test-win-nightly (windows, 3.11, 12.1, nightly)	3m 43s
test-stable (macos, 3.11, 12.1, stable)	8m 57s
test-win-nightly (windows, 3.12, 12.1, nightly)	3m 54s
test-stable (macos, 3.12, 12.1, stable)	8m 51s
test-stable (linux, 3.9, 12.1, stable)	6m 5s
test-stable (linux, 3.10, 12.1, stable)	6m 1s
test-stable (linux, 3.11, 12.1, stable)	6m 0s
test-stable (linux, 3.12, 12.1, stable)	6m 3s
test-stable (windows, 3.9, 12.1, stable)	3m 38s
test-stable (windows, 3.10, 12.1, stable)	3m 40s
test-stable (windows, 3.11, 12.1, stable)	3m 53s
test-stable (windows, 3.12, 12.1, stable)	3m 44s
	1h 44m 55s

Provide feedback