Reporting and Analytics
In the fast-paced world of software testing, insights are crucial for making informed decisions. Appvibe Test Management offers powerful reporting and analytics tools to help you visualize your testing progress, monitor test coverage, and ensure quality across your projects. This chapter covers how to generate reports, track test execution outcomes, and review traceability, giving your team the data they need to improve test coverage and resolve issues efficiently.
Test Execution Reports
Test execution reports are a key feature of Appvibe Test Management for monday.com, providing detailed insights into the results of your test cycles. These reports allow teams to track test progress, understand the quality of their system, and identify areas requiring further attention.
What is a Test Execution Report?
A Test Execution Report summarizes the outcomes of the test cases executed within a test cycle. These reports help you:
- Monitor the pass/fail status of test cases.
- Identify defects and blockers encountered during test execution.
- Assess overall test progress and quality.
Key Metrics in Test Execution Reports:
- Pass/Fail Rate: Shows the percentage of test cases that have passed or failed.
- Blocked Tests: Test cases that couldn’t be executed due to blockers, such as environmental issues or missing functionality.
- Test Completion: A summary of how many test cases have been executed out of the total planned cases.
- Defects Linked: Any defects reported during test execution are linked directly to the corresponding test cases.
Steps to Generate a Test Execution Report:
- Go to Your Test Management Board in monday.com.
- Select the Test Cycle you want to report on.
- Click the "Generate Report" button in the Test Cycle view.
- Customize the report by selecting filters such as date range, tester, or test cycle.
- Click "Generate", and the report will be created, showing a detailed breakdown of the test cases.
How to Use Test Execution Reports:
- Identify High-Risk Areas: Use reports to see which areas of your system are experiencing the most failures.
- Track Test Progress: Monitor how much of your testing has been completed and whether critical tests have passed.
- Review Defects: Identify which test cases have failed and the associated defects for follow-up action.
Exporting Test Execution Reports:
Reports can be exported as PDF or CSV files for sharing with stakeholders or for further analysis.
Traceability Reports
Traceability is essential in test management, ensuring that all requirements are tested and changes are fully accounted for. Appvibe Test Management provides Traceability Reports that map your test cases to specific requirements, helping you ensure that no functionality is left untested.
What is a Traceability Report?
A Traceability Report links your product’s requirements to the corresponding test cases. It helps ensure that all functionality has been tested and provides visibility into which requirements still need test cases or are untested.
Key Metrics in Traceability Reports:
- Requirement Coverage: Shows which product requirements are linked to test cases and whether they have passed, failed, or are pending execution.
- Unlinked Requirements: Identifies requirements that don’t have any associated test cases, signaling potential gaps in your testing.
- Defect Coverage: Tracks defects found during the testing of specific requirements, helping teams focus on areas of concern.
- Impact of Changes: Shows how changes in requirements have impacted the related test cases (e.g., if test cases were updated after the requirement changed).
Steps to Generate a Traceability Report:
- Go to Your Test Management Board in monday.com.
- Access the Traceability Dashboard within Appvibe.
- Select the requirements and test cycles you wish to report on.
- Click "Generate Traceability Report" to view the linked test cases, their statuses, and any associated defects.
How to Use Traceability Reports:
- Gap Analysis: Use the report to identify any product requirements that do not have test cases, ensuring full coverage before release.
- Monitor Impact of Changes: Track how changes in requirements affect test cases, ensuring test cases are updated and re-executed as needed.
- Coverage Confirmation: Verify that all critical functionality has been tested, preventing gaps in your testing process.
Exporting Traceability Reports:
You can export traceability reports as PDF or CSV files to share with stakeholders or to review offline.
Custom Dashboards and Analytics
Appvibe Test Management offers customizable dashboards, giving you real-time insights into your test progress, coverage, and overall product quality. These dashboards allow you to track the key metrics that matter most to your project, all in one convenient place.
What are Custom Dashboards?
Custom dashboards in Appvibe allow you to visualize your testing data with various widgets and charts. These dashboards help your team monitor test case execution, defect tracking, and overall progress at a glance.
Available Dashboard Widgets:
- Test Case Progress Widget: Displays the number of test cases by status (Passed, Failed, Blocked, In Progress), giving an overview of current testing efforts.
- Test Cycle Overview Widget: Tracks the overall completion rate of test cycles, showing how much of the cycle has been executed and the results of each test case.
- Defects by Priority Widget: Displays the number of defects found during testing, categorized by priority (Critical, High, Medium, Low).
- Pass/Fail Rate Widget: Shows the overall pass and fail rates for test cases across selected test cycles.
- Requirement Coverage Widget: Provides a visual representation of how many of your product requirements have been covered by test cases.
Steps to Create a Custom Dashboard:
- Go to the Dashboard Tab on your Test Management Board in monday.com.
- Click "Create New Dashboard" to start building your custom dashboard.
- Select the widgets you want to include based on the metrics you want to track (e.g., Test Case Progress, Defects by Priority).
- Customize each widget to display data from specific test cycles, testers, or sprints.
- Save the dashboard, and it will now display real-time test execution data, providing an up-to-date view of your testing progress.
How to Use Custom Dashboards:
- Monitor Real-Time Data: Dashboards provide real-time updates on your test cycles and test cases, allowing you to quickly identify issues or areas that require more attention.
- Use for Status Meetings: During sprint or release reviews, custom dashboards give a clear overview of test progress and help facilitate discussions around product quality.
- Analyze Defects: Track defects by priority to ensure high-priority issues are being addressed first and to prevent blockers from delaying releases.
Exporting Dashboards:
Dashboards can be exported as PDF files to share with your team or stakeholders for project updates or to track progress over time.