Overview
The Flakiness.io Analytics Platform aggregates test data across commits and environments to give your team a continuous view of test health. While the Test Report shows individual test runs, the platform tracks trends over time.
What You Get
Section titled “What You Get”- Pull Requests — detect test regressions in PRs and report status via GitHub checks
- Test Health Calendar — GitHub-style heatmap showing test health over time
- Access Control — role-based permissions for organizations and projects
- Project Badges — embeddable status badges for your README
- Acceptable Flakiness — configure your flakiness threshold and use flip rate to surface unreliable tests
- Notifications — daily Slack alerts when failures or regressions are detected
- Duration Trends — track how test execution time changes over time
- Data Retention — configure how long test data and attachments are stored
- Upload API — programmatic report uploading for custom integrations
How It Works
Section titled “How It Works”Configure your test runner reporter to auto-upload results to Flakiness.io (see Setup). The platform processes each report and builds a history of test results indexed by commit, environment, and timeline.
From there, the platform can:
- Detect regressions at the commit and pull request level
- Compute flip rate to quantify test flakiness
- Track statuses across days, commits, and timelines
- Generate reports covering any time range or environment combination
- Filter tests using FQL to find exactly what you’re looking for
Limitations
Section titled “Limitations”- Flakiness.io only supports https://github.com as a source of commit history.
Getting Started
Section titled “Getting Started”See Setup to create an organization, set up a project, and start uploading test results.