Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(testing): Task Sender / Stress Tester #1189

Open
wants to merge 62 commits into
base: 1314-fix-sender-receive-batchinclusiondata-or-createnewtaskerror-in-validityresponsemessage
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
012cf22
add task sender
PatStiles Oct 7, 2024
121dd87
add toolchain
PatStiles Oct 7, 2024
adf2257
feat(batcher-task-sender): only connect to server
MarcosNicolau Oct 8, 2024
98633d1
refactor: using tasks instead of theads as it is too much overhead
MarcosNicolau Oct 8, 2024
5a714b2
refactor: task sender to allow sending proofs and connections
MarcosNicolau Oct 8, 2024
5378710
chore: makefile test connections
MarcosNicolau Oct 8, 2024
8817c81
feat: action arg for generate-proofs, infinite-proofs, test-connection
MarcosNicolau Oct 8, 2024
7e5be9c
feat: clean proofs
MarcosNicolau Oct 8, 2024
fe52343
feat: multiple senders infinite-proofs
MarcosNicolau Oct 8, 2024
0055d01
fix: deposit to aligned
MarcosNicolau Oct 9, 2024
b31a095
fix: burst_size makefile
MarcosNicolau Oct 9, 2024
220df4e
feat: generate and fund wallets
MarcosNicolau Oct 9, 2024
23e967b
feat: loading wallets form files
MarcosNicolau Oct 9, 2024
a54ea3c
chore: address clippy warnings
MarcosNicolau Oct 9, 2024
654c0ec
chore: update task sender targets
MarcosNicolau Oct 9, 2024
963fcc3
fix: hang connections
MarcosNicolau Oct 9, 2024
c4a6c33
feat: params for deposit and number of proofs
MarcosNicolau Oct 9, 2024
87fce78
refactor: store private key as a string
MarcosNicolau Oct 9, 2024
15ac8a7
feat: read/write wallets from one file
MarcosNicolau Oct 9, 2024
73a7d19
chore: task sender for holesky
MarcosNicolau Oct 9, 2024
45ee17b
refactor(task-sender): add subcommands structs
MarcosNicolau Oct 10, 2024
bb927bc
reafactor(task-sender): commands
MarcosNicolau Oct 10, 2024
7fbc7ec
feat: accept output dir in generate groth16 proofs
MarcosNicolau Oct 10, 2024
274629b
reafactor(task-sender): main program calls lib
MarcosNicolau Oct 10, 2024
d0e3794
refactor(task-sender): get generated verification data and logs
MarcosNicolau Oct 10, 2024
451ebc2
fix(task-sender): commdands arguments
MarcosNicolau Oct 10, 2024
a4f2f9f
chore: task sender update makefile
MarcosNicolau Oct 10, 2024
b11baae
fix: makefile
uri-99 Oct 21, 2024
30ab36e
feat: add simple readme of stress tester
uri-99 Oct 21, 2024
ff4ca6e
fix: on commands.rs
uri-99 Oct 21, 2024
de2cc98
refactor: add `send` to infinite_proofs
uri-99 Oct 21, 2024
e94ac7c
Merge remote-tracking branch 'origin/staging' into 1015-task-sender
uri-99 Oct 21, 2024
46a7b6e
fix: task sender file and nonce reading
uri-99 Oct 21, 2024
0b10cd5
fix: get proofs until batch_size is filled
uri-99 Oct 22, 2024
5940660
fix: stress tester funding wallets in devnet
uri-99 Oct 23, 2024
d6f4a95
fix: on task sender
uri-99 Oct 23, 2024
4458e1d
feat: add devnet private keys
uri-99 Oct 23, 2024
fe29225
fix: comment on readme
uri-99 Oct 23, 2024
e678783
chore: clippy and fmt
MarcosNicolau Oct 23, 2024
6b707bf
Merge remote-tracking branch 'origin/1314-fix-sender-receive-batchinc…
uri-99 Oct 24, 2024
4665a82
chore: cargo lock
uri-99 Oct 24, 2024
4784118
fix: separate anvil_start_with_more_prefunded
uri-99 Oct 25, 2024
2a3b46c
fix: task sender readme
uri-99 Oct 25, 2024
115950d
remove: senders to holesky
uri-99 Oct 25, 2024
c6fbc11
Merge branch '1314-fix-sender-receive-batchinclusiondata-or-createnew…
uri-99 Oct 25, 2024
b82ab64
Merge branch '1314-fix-sender-receive-batchinclusiondata-or-createnew…
uri-99 Oct 28, 2024
9643edc
fix: detail
uri-99 Oct 29, 2024
3266ade
fix: remove unpaying address from devnet wallets
uri-99 Oct 29, 2024
de91065
feat: start batcher without funding
uri-99 Oct 29, 2024
1469c7d
Merge branch '1314-fix-sender-receive-batchinclusiondata-or-createnew…
uri-99 Nov 4, 2024
bcb68f5
fix: details on fund_devnet and read_proofs
uri-99 Nov 4, 2024
5c1bead
Merge branch '1314-fix-sender-receive-batchinclusiondata-or-createnew…
uri-99 Nov 4, 2024
95592ee
refactor: make fund devnet target
uri-99 Nov 4, 2024
1026494
Merge branch '1314-fix-sender-receive-batchinclusiondata-or-createnew…
uri-99 Nov 4, 2024
a205f34
Merge branch '1314-fix-sender-receive-batchinclusiondata-or-createnew…
uri-99 Nov 5, 2024
ca51f3d
chore: details
uri-99 Nov 5, 2024
0ced4dc
chore: devnet wallets
uri-99 Nov 5, 2024
d944f4f
fix: use correct ethers version in sender
uri-99 Nov 5, 2024
397a4f7
fix: remove dead make target
uri-99 Nov 5, 2024
cc0f71a
remove: unused struct
uri-99 Nov 5, 2024
c8ea291
chore: cargo fmt in task-sender
uri-99 Nov 5, 2024
8a0aa67
chore: cargo clippy
uri-99 Nov 5, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -250,6 +250,19 @@ batcher/target/release/aligned:
RPC_URL=http://localhost:8545
NETWORK=devnet # devnet | holesky-stage | holesky

# Infinite stream of burst of 10 proofs
batcher_send_infinite_burst:
@cd batcher/aligned-task-sender && cargo run --release

# Infinite stream of one proof
batcher_send_infinite_stream:
@cd batcher/aligned-task-sender && cargo run --release -- --burst-size 1

# Infinite connections
# To test: `make batcher_test_connection NUM_SENDERS=10000`, with 0 proofs sent returns `Error 101` when tested locally
batcher_test_connections:
@cd batcher/aligned-task-sender && cargo run --release -- --num-senders $(NUM_SENDERS) --burst-size 1

batcher_send_sp1_task:
@echo "Sending SP1 fibonacci task to Batcher..."
@cd batcher/aligned/ && cargo run --release -- submit \
Expand Down
58 changes: 58 additions & 0 deletions batcher/Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 1 addition & 5 deletions batcher/Cargo.toml
Original file line number Diff line number Diff line change
@@ -1,7 +1,3 @@
[workspace]
members = [
"aligned-batcher",
"aligned-sdk",
"aligned"
]
members = ["aligned-batcher", "aligned-sdk", "aligned", "aligned-task-sender"]
resolver = "2"
35 changes: 35 additions & 0 deletions batcher/aligned-task-sender/Cargo.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@

[package]
name = "task-sender"
version = "0.1.0"
edition = "2021"

[dependencies]
serde = { version = "1.0.201", features = ["derive"] }
serde_json = "1.0.117"
futures-util = "0.3.30"
tokio = { version = "1.40.0", features = [
"io-std",
"time",
"macros",
"rt",
"rt-multi-thread",
"sync",
"process",
"fs",
] }
tokio-tungstenite = { version = "0.24.0", features = [
"rustls-tls-webpki-roots",
"native-tls",
] }
url = "2.5.0"
log = "0.4.21"
env_logger = "0.11.3"
clap = { version = "4.5.4", features = ["derive"] }
ethers = { tag = "v2.0.15-fix-reconnections", features = [
"ws",
"rustls",
], git = "https://github.com/yetanotherco/ethers-rs.git" }
aligned-sdk = { path = "../aligned-sdk" }
rpassword = "7.3.1"
sha3 = { version = "0.10.8" }
3 changes: 3 additions & 0 deletions batcher/aligned-task-sender/rust-toolchain
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[toolchain]
channel = "nightly-2024-04-17"
components = ["llvm-tools", "rustc-dev"]
Loading
Loading