feat: update benchmarks for new machine

distributed-lab · Oct 9, 2024 · 80f74d1 · 80f74d1
1 parent bac1bd4
commit 80f74d1
Show file tree

Hide file tree

Showing 2 changed files with 41 additions and 15 deletions.
diff --git a/BENCHMARK.md b/BENCHMARK.md
@@ -4,21 +4,47 @@
 
 ## Environment
 
-_Machine:_ `Ram 64 GB memory, 16 kernels`
+_Machine:_ `20 Cores, 144 GB RAM`
 
 _Nargo_: `0.33.0`
 
 _Barrettenberg_: `0.47.1`
 
+_Maximum RAM consumption_: `43 GB`
+
 ## Table (Ultra Honk)
 
 | Version | Message Length | Constraints | Execution Time     | Proving Time       | Writing VK Time    | Verifying Time |
 |---------|----------------|-------------|--------------------|--------------------|--------------------|----------------|
-| v1      | 5              | 2,998,712   | 1 minute 10 seconds | 9 minutes 54 seconds | 9 minutes 37 seconds | 0.06 seconds   |     +
-| v2      | 5              | 2,998,520   | 13 minutes 36 seconds | 11 minutes 12 seconds | 10 minutes 23 seconds | 0.06 seconds |   +
-| v1      | 32             | 2,998,905   | 13 minutes 58 seconds | 11 minutes 27 seconds | 10 minutes 49 seconds | 0.06 seconds |   +
-| v2      | 32             | 2,998,636   | 1 minutes 11 seconds | 14 minutes 42 seconds | 10 minutes 10 seconds | 0.06 seconds   |  +
-| v1      | 100            | 2,999,162   | 13 minutes 2 seconds | 11 minutes 31 seconds | 11 minutes 26 seconds | 0.06 seconds   |  +
-| v2      | 100            | 2,998,893   | 14 minutes 16 seconds | 12 minutes 26 seconds | 11 minutes 26 seconds | 0.06 seconds   |
-| v1      | 10000          | 3,036,441   | 16 minutes 19 seconds | 12 minutes 5 seconds | 12 minutes 7 seconds | 0.06 seconds   |   +
-| v2      | 10000          | 3,036,172   | 17 minutes 9 seconds | 12 minutes 1 seconds | 12 minutes 15 seconds | 0.06 seconds   |   +
+| v1      | 5              | 2,998,712   | 13 minute 56 seconds | 13 minutes 23 seconds | 12 minutes 3 seconds | 0.06 seconds   |   
+| v2      | 5              | 2,998,520   | 13 minutes 52 seconds | 13 minutes 9 seconds | 12 minutes 14 seconds | 0.06 seconds | 
+| v1      | 32             | 2,998,905   | 14 minutes 14 seconds | 13 minutes 3 seconds | 11 minutes 44 seconds | 0.06 seconds | 
+| v2      | 32             | 2,998,636   | 14 minutes 5 seconds | 12 minutes 55 seconds | 11 minutes 48 seconds | 0.06 seconds   |
+| v1      | 100            | 2,999,162   | 14 minutes 44 seconds | 13 minutes 4 seconds | 12 minutes 30 seconds | 0.06 seconds   |
+| v2      | 100            | 2,998,893   | 13 minutes 58 seconds | 12 minutes 57 seconds | 12 minutes 2 seconds | 0.06 seconds   |
+| v1      | 10000          | 3,036,441   | 17 minutes 47 seconds | 13 minutes 35 seconds | 12 minutes 13 seconds | 0.06 seconds   |
+| v2      | 10000          | 3,036,172   | 1 minutes 16 seconds | 13 minutes 59 seconds | 12 minutes 25 seconds | 0.06 seconds   |
+
+
+## Environment
+
+_Machine:_ `20 Cores, 144 GB RAM`
+
+_Nargo_: `0.32.0`
+
+_Barrettenberg_: `0.46.1`
+
+_Maximum RAM consumption_: `123 GB`
+
+## Table (Ultra Plonk)
+
+| Version | Message Length | Constraints | Execution Time     | Proving Time       | Writing VK Time    | Verifying Time |
+|---------|----------------|-------------|--------------------|--------------------|--------------------|----------------|
+| v1      | 5              | 2,998,712   | 15 minute 59 seconds | 53 minutes 15 seconds | 37 minutes 19 seconds | 0.1 seconds   |   
+| v2      | 5              | 2,998,520   | 18 minutes 32 seconds | 58 minutes 42 seconds | 36 minutes 25 seconds | 0.1 seconds | 
+| v1      | 32             | 2,998,905   | 17 minutes 34 seconds | 53 minutes 38 seconds | 36 minutes 43 seconds | 0.11 seconds | 
+| v2      | 32             | 2,998,636   | 17 minutes 9 seconds | 50 minutes 17 seconds | 38 minutes 59 seconds | 0.14 seconds   |
+| v1      | 100            | 2,999,162   | 16 minutes 49 seconds | 24 minutes 9 seconds | 22 minutes 58 seconds | 0.06 seconds   |
+| v2      | 100            | 2,998,893   | 16 minutes 28 seconds | 30 minutes 11 seconds | 25 minutes 14 seconds | 0.07 seconds   |
+| v1      | 10000          | 3,036,441   | 23 minutes 55 seconds | 38 minutes 18 seconds | 32 minutes 19 seconds | 0.08 seconds   |
+| v2      | 10000          | 3,036,172   | 20 minutes 35 seconds | 28 minutes 46 seconds | 30 minutes 40 seconds | 0.07 seconds   |
diff --git a/Makefile b/Makefile
@@ -26,12 +26,12 @@ verify:
 	bb verify -k ./target/vk -p ./target/proof
 
 
-zk:
-	make execute
-	make prove
-	make verify
-
 zk_ultra_honk:
 	make execute
 	make prove_ultra_honk
-	make verify_ultra_honk
+	make verify_ultra_honk
+
+zk:
+	make execute
+	make prove
+	make verify