-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Add SIG specific badges for e2e failures against merged PRs #62
Conversation
Signed-off-by: Brian Carey <[email protected]>
Signed-off-by: Brian Carey <[email protected]> fix: Update metrics package to use newer text format expfmt.FmtText is no longer exported in new prometheus/common modules[1] [1] prometheus/common@05d7387 Signed-off-by: Brian Carey <[email protected]>
… PRs Signed-off-by: Brian Carey <[email protected]>
Signed-off-by: Brian Carey <[email protected]>
Signed-off-by: Brian Carey <[email protected]>
Badges generated by running: ``` bazelisk run //cmd/stats -- --gh-token ${GH_TOKEN} --source kubevirt/kubevirt --path ${SRC}/ci-health/output/ --data-days 7 ``` Signed-off-by: Brian Carey <[email protected]>
6bd7208
to
4bb0503
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good overall 👍
I have a couple of nits and some questions - see inline.
} | ||
|
||
func getFailedJobsForLatestCommit(org string, repo string, prNumber string) (failedJobs []failedJob, err error) { | ||
prHistory := prHistoryURL(org, repo, prNumber) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is interesting - I have never thought about scraping the history page directly... I could imagine reusing that for metrics that we might want to shove into the prometheus.
👍
Signed-off-by: Brian Carey <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/approve
Thanks @brianmcarey !
@brianmcarey hm, I don't see the badges yet - I figure they will appear with the next run? |
What this PR does / why we need it:
These badges count the number of e2e lane failures per SIG against the last code push for all kubevirt/kubevirt merged PRs over the last 7 days.
These failures contribute directly to delays in merges and to the number of retests that occur in CI.
If a SIG is responsible for more then 20 of these failures, the badge will be marked as red. Yellow for failures above 1 and green for below that.
Badges from a recent manual run are included as part of this PR.
Which issue(s) this PR fixes (optional, in
fixes #<issue number>(, fixes #<issue_number>, ...)
format, will close the issue(s) when PR gets merged):Fixes #
Special notes for your reviewer:
/cc @dhiller @xpivarc
Checklist
This checklist is not enforcing, but it's a reminder of items that could be relevant to every PR.
Approvers are expected to review this list.
Release note: