Fix benchmarks failing silently #308

Job	Run time
check-changes	16s
ran-none	0s
start-nix-linux-aarch64-cargo-build-test / nix-linux-arm64	1h 11m 54s
start-macos-x86-64-tests / test-rust-macos-x86-64	15m 49s
start-nix-linux-aarch64-build-default-test / nix-linux-arm64	36m 44s
start-nix-linux-x86-64-tests / nix-linux-x86	39m 52s
start-nix-macos-apple-silicon-tests / nix-apple-silicon	1m 16s
start-ubuntu-x86-64-tests / test zig, rust, wasm...	18m 27s
start-roc-benchmarks / benchmark roc programs	4m 48s
start-windows-release-build-test / windows-release-build	11m 24s
start-windows-tests / windows-test-subset	24m 13s
ran-full	0s
finish	1s
	3h 44m 44s

Provide feedback