doctest failure in ~/work/Chairmarks.jl/Chairmarks.jl/src/public.jl:91-115 ```jldoctest; filter = r"\d+", setup = :(using Random) julia> @b rand(10000) # Benchmark a function 5.833 μs (2 allocs: 78.172 KiB) julia> @b rand hash # How long does it take to hash a random Float64? 1.757 ns julia> @b rand(1000) sort issorted(_) || error() # Simultaneously benchmark and test 11.291 μs (3 allocs: 18.062 KiB) julia> @b rand(1000) sort! issorted(_) || error() # BAD! This repeatedly resorts the same array! 1.309 μs (0.08 allocs: 398.769 bytes) julia> @b rand(1000) sort! issorted(_) || error() evals=1 # Specify evals=1 to ensure the function is only run once between setup and teardown 10.041 μs (2 allocs: 10.125 KiB) julia> @b rand(10) _ sort!∘rand! issorted(_) || error() # Or, include randomization in the benchmarked function and only allocate once 120.536 ns julia> @b (x = 0; for _ in 1:50; x = hash(x); end; x) # We can use arbitrary expressions in any position in the pipeline, not just simple functions. 183.871 ns julia> @b (x = 0; for _ in 1:5e8; x = hash(x); end; x) # This runs for a long time, so it is only run once (with no warmup) 2.447 s (without a warmup) ``` Subexpression: @b (x = 0; for _ in 1:5e8; x = hash(x); end; x) # This runs for a long time, so it is only run once (with no warmup) Evaluated output: 2318188.657 μs (without a warmup) Expected output: 2.447 s (without a warmup) diff = Warning: Diff output requires color. 2.447 s 2318188.657 μs (without a warmup)

doctest failure in ~/work/Chairmarks.jl/Chairmarks.jl/src/public.jl:133-186 ```jldoctest; filter = r"\d+|evaluations?|, \d+\.\d+% gc time|max \d+\.\d+ ..", setup = :(using Random) julia> @be rand(10000) # Benchmark a function Benchmark: 267 samples with 2 evaluations min 8.500 μs (2 allocs: 78.172 KiB) median 10.354 μs (2 allocs: 78.172 KiB) mean 159.639 μs (2 allocs: 78.172 KiB, 0.37% gc time) max 39.579 ms (2 allocs: 78.172 KiB, 99.93% gc time) julia> @be rand hash # How long does it take to hash a random Float64? Benchmark: 4967 samples with 10805 evaluations min 1.758 ns median 1.774 ns mean 1.820 ns max 5.279 ns julia> @be rand(1000) sort issorted(_) || error() # Simultaneously benchmark and test Benchmark: 2689 samples with 2 evaluations min 9.771 μs (3 allocs: 18.062 KiB) median 11.562 μs (3 allocs: 18.062 KiB) mean 14.933 μs (3 allocs: 18.097 KiB, 0.04% gc time) max 4.916 ms (3 allocs: 20.062 KiB, 99.52% gc time) julia> @be rand(1000) sort! issorted(_) || error() # BAD! This repeatedly resorts the same array! Benchmark: 2850 samples with 13 evaluations min 1.647 μs (0.15 allocs: 797.538 bytes) median 1.971 μs (0.15 allocs: 797.538 bytes) mean 2.212 μs (0.15 allocs: 800.745 bytes, 0.03% gc time) max 262.163 μs (0.15 allocs: 955.077 bytes, 98.95% gc time) julia> @be rand(1000) sort! issorted(_) || error() evals=1 # Specify evals=1 to ensure the function is only run once between setup and teardown Benchmark: 6015 samples with 1 evaluation min 9.666 μs (2 allocs: 10.125 KiB) median 10.916 μs (2 allocs: 10.125 KiB) mean 12.330 μs (2 allocs: 10.159 KiB, 0.02% gc time) max 6.883 ms (2 allocs: 12.125 KiB, 99.56% gc time) julia> @be rand(10) _ sort!∘rand! issorted(_) || error() # Or, include randomization in the benchmarked function and only allocate once Benchmark: 3093 samples with 237 evaluations min 121.308 ns median 126.055 ns mean 128.108 ns max 303.447 ns julia> @be (x = 0; for _ in 1:50; x = hash(x); end; x) # We can use arbitrary expressions in any position in the pipeline, not just simple functions. Benchmark: 3387 samples with 144 evaluations min 183.160 ns median 184.611 ns mean 188.869 ns max 541.667 ns julia> @be (x = 0; for _ in 1:5e8; x = hash(x); end; x) # This runs for a long time, so it is only run once (with no warmup) Benchmark: 1 sample with 1 evaluation 2.488 s (without a warmup) ``` Subexpression: @be (x = 0; for _ in 1:5e8; x = hash(x); end; x) # This runs for a long time, so it is only run once (with no warmup) Evaluated output: Benchmark: 1 sample with 1 evaluation 2317457.916 μs (without a warmup) Expected output: Benchmark: 1 sample with 1 evaluation 2.488 s (without a warmup) diff = Warning: Diff output requires color. Benchmark: 1 sample with 1 evaluation 2.488 s 2317457.916 μs (without a warmup)

Process completed with exit code 1.

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/