Overview
Flakiness.io Test Report is a framework-agnostic test reporting tool that turns test execution data into clear, interactive HTML reports. It works with popular testing frameworks across JavaScript, Python, Java, and more — helping teams visualize test runs, debug failures, and understand test suite health.
Test reports are built on three pieces:
-
Flakiness JSON — an open-source, language-agnostic JSON format designed for rich test reporting. Every report captures test results, attachments, environment details, and commit information in a single file.
-
Reporters — test runner integrations (for Playwright, Pytest, Vitest, JUnit, and others) that generate reports in the Flakiness JSON format automatically as part of your test run.
-
Report Viewer — a progressive web app that renders Flakiness JSON into a beautiful, interactive report. It runs entirely in your browser — no data is uploaded or sent anywhere.
Test Report Features
Section titled “Test Report Features”- Attachments, Traces & Logs — screenshots, videos, image diffs, Playwright traces, and terminal output
- Tags & Annotations — categorize tests and mark them with metadata like
@skip,@slow, or@owner - Errors — error messages, stack traces, and source code snippets
- Tests Waterfall & Telemetry — timeline of parallel test execution with CPU and memory overlay
Test Analytics
Section titled “Test Analytics”When your team needs analytics beyond individual test runs — regression detection, flakiness tracking, duration trends — you can configure your test runner reporter to upload reports to the Flakiness.io Analytics Platform. See Setup to create a project and start uploading.
When a report is linked to a Flakiness.io project, the Report Viewer shows local results
alongside cloud analytics history, giving you the full picture without leaving the viewer.
To enable this, configure the flakinessProject option in your test runner reporter to
point to your Flakiness.io project.