Changelog

Mar 16, 2026

Flakiness CLI v0.218+ introduces Agentic Workflows — AI coding agents can now query your test data, investigate flaky tests, and fix regressions autonomously.

Install a skill into your agent of choice:

flakiness skills install --agent <claude|codex|cursor>

Then just ask your agent to fix your tests:

• “Fix the failing tests in PR #42”
• “Find the most flaky tests in our project”
• “Which tests have been failing with timeout errors?”

Supports Claude Code, Codex, and Cursor. You can also set up a scheduled GitHub Actions cron job that automatically deflakes your test suite — no human intervention needed.

Full documentation: Agentic Workflows.

Mar 9, 2026

Initial release of the official Vitest reporter is now available: @flakiness/vitest.

Feb 24, 2026

• Projects can now configure Slack alerting via webhooks in their settings.
• pytest-flakiness now supports GitHub OIDC for uploads.

Feb 23, 2026

• Github OIDC is now supported for automation. @flakiness/playwright v1.1.0 is the first reporter to implement Github OIDC authentication. Configuration docs
• A richer view for the “Runs” page.
• Runs can now be deleted individually if needed.

Feb 20, 2026

• Runs page improvements: no more “unparsed runs”. If Flakiness.io cannot process a run, it now shows an alert icon with a suggestion to delete the malformed runs.
• Custom retention period for attachments can now be configured in the project’s usage page.

Feb 15, 2026

• Each Pull Request and commit now has a “run” button — a toggle that opens a dialog with all runs for the given commit or Pull Request.
• Runs are sortable by run ID, test outcomes, or start timestamp.