Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add SIG specific badges for e2e failures against merged PRs #62

Merged
merged 7 commits into from
Jul 24, 2024

Conversation

brianmcarey
Copy link
Member

@brianmcarey brianmcarey commented Jul 19, 2024

What this PR does / why we need it:

These badges count the number of e2e lane failures per SIG against the last code push for all kubevirt/kubevirt merged PRs over the last 7 days.

These failures contribute directly to delays in merges and to the number of retests that occur in CI.

If a SIG is responsible for more then 20 of these failures, the badge will be marked as red. Yellow for failures above 1 and green for below that.

Badges from a recent manual run are included as part of this PR.

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #

Special notes for your reviewer:
/cc @dhiller @xpivarc

Checklist

This checklist is not enforcing, but it's a reminder of items that could be relevant to every PR.
Approvers are expected to review this list.

Release note:


Signed-off-by: Brian Carey <[email protected]>

fix: Update metrics package to use newer text format

expfmt.FmtText is no longer exported in new prometheus/common modules[1]

[1] prometheus/common@05d7387

Signed-off-by: Brian Carey <[email protected]>
@kubevirt-bot kubevirt-bot added the dco-signoff: yes Indicates the PR's author has DCO signed all their commits. label Jul 19, 2024
Badges generated by running:
```
bazelisk run //cmd/stats -- --gh-token ${GH_TOKEN} --source kubevirt/kubevirt --path ${SRC}/ci-health/output/ --data-days 7
```

Signed-off-by: Brian Carey <[email protected]>
Copy link
Contributor

@dhiller dhiller left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good overall 👍

I have a couple of nits and some questions - see inline.

output/kubevirt/kubevirt/sig-operator-retests.svg Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
pkg/constants/main.go Outdated Show resolved Hide resolved
pkg/output/output.go Outdated Show resolved Hide resolved
pkg/output/output.go Outdated Show resolved Hide resolved
}

func getFailedJobsForLatestCommit(org string, repo string, prNumber string) (failedJobs []failedJob, err error) {
prHistory := prHistoryURL(org, repo, prNumber)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is interesting - I have never thought about scraping the history page directly... I could imagine reusing that for metrics that we might want to shove into the prometheus.

👍

Copy link
Contributor

@dhiller dhiller left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/approve

Thanks @brianmcarey !

@dhiller dhiller merged commit 524929b into main Jul 24, 2024
2 checks passed
@dhiller
Copy link
Contributor

dhiller commented Jul 24, 2024

@brianmcarey hm, I don't see the badges yet - I figure they will appear with the next run?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dco-signoff: yes Indicates the PR's author has DCO signed all their commits. size/XXL
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants