Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable GHA short benchmarks with frame-omni-bencher #5706

Closed
wants to merge 24 commits into from

Conversation

bkontur
Copy link
Contributor

@bkontur bkontur commented Sep 13, 2024

Continuation of: #5327
Depends on: #5704
Closes: #5704
Depends on: #5655

@bkontur bkontur added R0-silent Changes should not be mentioned in any release notes GHA-migration Temporary label for migrating CI to GHA labels Sep 13, 2024
@bkontur bkontur requested review from a team as code owners September 13, 2024 12:28
@bkontur bkontur added T12-benchmarks This PR/Issue is related to benchmarking and weights. and removed GHA-migration Temporary label for migrating CI to GHA labels Sep 13, 2024
@bkontur
Copy link
Contributor Author

bkontur commented Sep 13, 2024

@mordamax you can prepare clean up PR based on this PR - to remove all build-short-benchmark* and short-benchmarks.yml and stuff around you want to clean up.

Other words, when this PR is merged, it should be safe to remove all gitlab short benchmarking stuff.

@bkontur bkontur added the A4-needs-backport Pull request must be backported to all maintained releases. label Sep 13, 2024
Signed-off-by: Oliver Tale-Yazdi <[email protected]>
@paritytech-review-bot paritytech-review-bot bot requested a review from a team September 16, 2024 11:14
Signed-off-by: Oliver Tale-Yazdi <[email protected]>
Signed-off-by: Oliver Tale-Yazdi <[email protected]>
github-merge-queue bot pushed a commit that referenced this pull request Sep 22, 2024
It is a first step for switching to the `frame-omni-bencher` for CI.

This PR includes several changes related to generating chain specs plus:

- [x] pallet `assigned_slots` fix missing `#[serde(skip)]` for phantom
- [x] pallet `paras_inherent` benchmark fix - cherry-picked from
#5688
- [x] migrates `get_preset` to the relevant runtimes
- [x] fixes Rococo genesis presets - does not work
https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7317249
- [x] fixes Rococo benchmarks for CI 
- [x] migrate westend genesis
- [x] remove wococo stuff

Closes: #5680

## Follow-ups
- Fix for frame-omni-bencher
#5655
- Enable new short-benchmarking CI -
#5706
- Remove gitlab pipelines for short benchmarking
- refactor all Cumulus runtimes to use `get_preset` -
#5704
- #5705
- #5700
- [ ] Backport to the stable

---------

Co-authored-by: command-bot <>
Co-authored-by: ordian <[email protected]>
Base automatically changed from bko-get_preset-for-testnets to master September 22, 2024 17:04
@bkontur bkontur requested a review from a team as a code owner September 22, 2024 17:04
bkontur added a commit that referenced this pull request Sep 22, 2024
It is a first step for switching to the `frame-omni-bencher` for CI.

This PR includes several changes related to generating chain specs plus:

- [x] pallet `assigned_slots` fix missing `#[serde(skip)]` for phantom
- [x] pallet `paras_inherent` benchmark fix - cherry-picked from
#5688
- [x] migrates `get_preset` to the relevant runtimes
- [x] fixes Rococo genesis presets - does not work
https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7317249
- [x] fixes Rococo benchmarks for CI
- [x] migrate westend genesis
- [x] remove wococo stuff

Closes: #5680

- Fix for frame-omni-bencher
#5655
- Enable new short-benchmarking CI -
#5706
- Remove gitlab pipelines for short benchmarking
- refactor all Cumulus runtimes to use `get_preset` -
#5704
- #5705
- #5700
- [ ] Backport to the stable

---------

Co-authored-by: command-bot <>
Co-authored-by: ordian <[email protected]>
(cherry picked from commit 8735c66)
@bkontur bkontur changed the base branch from master to oty-fix-bench-runner September 22, 2024 18:01
@bkontur bkontur changed the base branch from oty-fix-bench-runner to oty-omni-bencher-fix September 22, 2024 18:02
@bkontur bkontur force-pushed the bko-enable-gha-short-benchmarks branch from c71e04c to 4fd7581 Compare September 22, 2024 18:18
Base automatically changed from oty-omni-bencher-fix to master September 22, 2024 23:03
@bkontur
Copy link
Contributor Author

bkontur commented Oct 9, 2024

fixed by: #5872

@bkontur bkontur closed this Oct 9, 2024
@bkontur bkontur deleted the bko-enable-gha-short-benchmarks branch October 9, 2024 07:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A4-needs-backport Pull request must be backported to all maintained releases. R0-silent Changes should not be mentioned in any release notes T12-benchmarks This PR/Issue is related to benchmarking and weights.
Projects
None yet
4 participants