Skip to content

Commit

Permalink
Add Continous Benchmarking to CI
Browse files Browse the repository at this point in the history
Summary:

This PR add continous profiling benchmark to CI, so we can track the performanc regression overtime.

Test Plan:
  • Loading branch information
duc-nx committed Aug 13, 2024
1 parent de9d945 commit a9ffc7d
Showing 1 changed file with 20 additions and 4 deletions.
24 changes: 20 additions & 4 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -74,7 +74,7 @@ jobs:

bench-riscv:
runs-on: ubuntu-latest
if: contains(github.event.pull_request.labels.*.name, 'benchmark')
if: contains(github.event.pull_request.labels.*.name, 'benchmark') || github.event_name == 'push'
steps:
- uses: actions/checkout@v4
- name: Install valgrind
Expand All @@ -86,16 +86,32 @@ jobs:
tr -d '"'
)
cargo install iai-callgrind-runner --version $version
- name: Run benchmarks
- uses: bencherdev/bencher@main
- name: Run benchmarks with Bencher
run: |
bencher run \
--project bench-risc-v-trace \
--token '${{ secrets.BENCHER_API_TOKEN }}' \
--branch '${{ github.head_ref || github.ref_name }}' \
--testbed ubuntu-latest \
--adapter rust_iai_callgrind \
--err \
cargo bench --bench riscv_machine
bench-nova-public-params:
runs-on: ubuntu-latest
if: contains(github.event.pull_request.labels.*.name, 'benchmark')
if: contains(github.event.pull_request.labels.*.name, 'benchmark') || github.event_name == 'push'
steps:
- uses: actions/checkout@v4
- name: Run benchmarks
- uses: bencherdev/bencher@main
- name: Run benchmarks with Bencher
run: |
bencher run \
--project bench-nova-public-parameter \
--token '${{ secrets.BENCHER_API_TOKEN }}' \
--branch '${{ github.head_ref || github.ref_name }}' \
--testbed ubuntu-latest \
--adapter rust_iai_callgrind \
--err \
cargo bench --bench nova_public_parameter_generation

0 comments on commit a9ffc7d

Please sign in to comment.