E2E Tests parallel execution #2833
Conversation
CDimonaco
force-pushed
the
e2e_cypress_split
branch
3 times, most recently
from
cabbeac
to
70aa966
Compare
CDimonaco
changed the title
That's a good question! I observed an increase of speed of about 5 to 7 minutes, but this is just the first step, when we refactor the e2e tests, in order to make them less flaky and without some useless costly operations (mostly photofinish dump when not needed), this pr should make a lot more sense |
| id: prepare | ||
| uses: bahmutov/gh-build-matrix@main | ||
| with: | ||
| n: 4 |
There was a problem hiding this comment.
Can we have this 4 in some variable on top?
So we can change if needed, as it is used in 2 places
There was a problem hiding this comment.
Also: where does this number come from? Should it be the number of cores?
| steps: | ||
| - name: Create matrix ⊹ | ||
| id: prepare | ||
| uses: bahmutov/gh-build-matrix@main |
There was a problem hiding this comment.
question: As far as I get it, this action just provides a range for enumeration, right? Like you say 4 and it spits [1,2,3,4]
| SPLIT: ${{ strategy.job-total }} | ||
| SPLIT_INDEX: ${{ strategy.job-index }} |
There was a problem hiding this comment.
question: Where do those variables come out? Shouldn't be something like strategy.matrix... or prepare.output.matrix...?
balanza
force-pushed
the
e2e_cypress_split
branch
from
70aa966
to
1d1db69
Compare
There was a problem hiding this comment.
Thank you @CDimonaco, this PR is very valuable for me as it barely halves the CI execution time.
There are some unanswered questions in comments, besides that I think we should merge.
Description
This pr splits the cypress tests execution across multiple CI jobs, we use the
cypress-splitplugin.This PR does not fix any issue on flakiness or test logic, it just speeds up the execution of test pipeline.