Aggregated Status

When viewing a collection of test results — whether for a day, a commit, a Pull Request, or a custom date range — Flakiness.io calculates a single Aggregated Status.

This status is determined by the “worst” individual result found within the collection, ensuring that critical issues are always surfaced. The aggregation follows this hierarchy:

1. 🔥 Regressed — at least one test has regressed.
2. ❌ Failed — no regressions found, but at least one test failed.
3. ⚠️ Flaked — the number of flaky tests exceeds your Acceptable Flakiness Ratio.
4. ✅ Passed — all tests passed, or the number of flaky tests is within the acceptable limit.
5. ∅ Skipped — all tests in the report were skipped.

Where It Appears

Aggregated Status is used throughout Flakiness.io:

• Each tile in the Test Health Calendar shows the Aggregated Status for that day
• Project badges reflect the latest Aggregated Status
• Pull Request checks report the Aggregated Status for the PR’s test results

Reports can be filtered by environment or narrowed down using FQL.