Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

flakefinder: highlight tests with non-deterministic outcomes #3910

Open
dhiller opened this issue Jan 22, 2025 · 0 comments
Open

flakefinder: highlight tests with non-deterministic outcomes #3910

dhiller opened this issue Jan 22, 2025 · 0 comments
Labels
area/flakefinder Issues and PRs concerning FlakeFinder, a tool to find flaky tests kind/enhancement sig/ci Denotes an issue or PR as being related to sig-ci, marks changes to the CI system.

Comments

@dhiller
Copy link
Contributor

dhiller commented Jan 22, 2025

Is your feature request related to a problem? Please describe:
Flakefinder report currently shows all tests that were failing on any run. It doesn't highlight specifically a flaky run, which is two builds on the same commit id.

Image
Image

Describe the solution you'd like:
When the same test has non-deterministic outcomes on two builds for the same lane and commit id we want to highlight it in the report

Describe alternatives you've considered:

Additional context:

/sig ci
/area flakefinder

@kubevirt-bot kubevirt-bot added sig/ci Denotes an issue or PR as being related to sig-ci, marks changes to the CI system. area/flakefinder Issues and PRs concerning FlakeFinder, a tool to find flaky tests labels Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/flakefinder Issues and PRs concerning FlakeFinder, a tool to find flaky tests kind/enhancement sig/ci Denotes an issue or PR as being related to sig-ci, marks changes to the CI system.
Projects
None yet
Development

No branches or pull requests

2 participants