Integrate with Trello - Report Defects Directly from TestCaseLab

TestCaseLab offers three types of reports to analyze and share Test Run results. Reports can be accessed from the Test Run page and shared externally with stakeholders, even if they don’t have access to the Company Account.

Learn more about Test Runs here.

‍

1. General Report

Provides a high-level summary of the Test Run results.

Includes:

• Number of Test Cases Executed: Total count of test cases run.
• Number of Defects Reported: Issues identified during the Test Run.
• Test Run Assignees: List of users assigned to the Test Run.
• Pie Chart: Visual statistics based on test case result statuses (e.g., Passed, Failed, Blocked).
• Activity per User: Tracks contributions by each team member.
• List of Test Cases with Results: Detailed table showing the status of all test cases.

‍

2. Failed Test Cases and Defects Report

Focuses on problem areas by highlighting failed test cases and associated defects.

Includes:

• Pie Chart: Visual statistics on the number of failed test cases.
• Number of Defects: Total count of defects reported during the Test Run.
• Reporters List: Identifies users who reported defects.
• Failed Test Cases List: Table of test cases that failed.
• Defects List: Detailed information about reported defects.

‍

3. Comparison of Test Runs

Allows comparison of results across multiple Test Runs.

How to Generate:

• Select up to 4 Test Runs for comparison.
• Click the ‘Show Report’ button to generate the comparison.

Use Case: Ideal for identifying trends and analyzing progress, especially when comparing Test Runs based on the same Test Plan.

‍

What’s Next?

Generate the report type that aligns with your needs to gain insights into testing activities and outcomes. For additional assistance, check related guides or contact support—we’re here to help!

‍

Running tests ensures thorough execution and accurate tracking of your system's quality. Use this guide to effectively execute test cases, log results, and analyze outcomes.

Learn what is a Test Run here.

‍

1. Run Tests Using the Checklist

• Use the Test Cases List in the Test Run for quick execution:
  • Quick Pass: Click the ‘Quick Pass’ button to mark a test case as Passed.‍
  • Change Status: Use the dropdown menu to set the test case status to:‍
    • Not Tested (default).‍
    • Passed.‍
    • Failed.‍
    • Blocked

• For Failed or Blocked Tests:
  • A modal window appears when setting a test case to Failed or Blocked.
  • In the modal, you can:
    • Add comments for additional context.
    • Attach files such as screenshots or logs.
    • Report a Bug:
      • Automatically via integrated tools
      • Manually by adding a bug link.

Read more about Integrations here.

‍

2. Run Tests in the Test Case Detail

• Open Test Case Details to execute tests step-by-step:
  • Set individual step results as you work through the test case.
  • If any step is marked as Failed or Blocked, the system automatically updates the entire test case status accordingly.
  • Add comments, attachments, or report bugs directly within the details view

• Use the ‘Next’ button to move to the next Not Tested test case.

‍

3. Completing the Test Run

Once all test cases are executed, the Test Run status updates to Completed.

‍

4. View Test Run Reports

• After completion, a detailed Test Run Report is generated, including:
  • A summary of results (e.g., passed, failed, blocked cases).
  • Logs for each test case.
• Use the report to:
  • Analyze results.
  • Compare outcomes across up to 4 Test Runs to track progress and identify trends.

Read more about Reports here.

‍

What’s Next?

Running tests in TestCaseLab ensures accurate tracking and documentation of your testing process. For further assistance, check related guides or contact support—we’re here to help!

‍

Create a Test Run

Creating a Test Run helps organize and execute a specific set of test cases to meet your testing objectives. Follow this guide to set up a Test Run efficiently.

Learn what is a Test Run here.

‍

1. Create from the Test Plan’s Page

• Navigate to the Test Plan’s page and select the Test Plan you want to use.
• Click the ‘Create Test Run’ button.
• The Test Run will automatically include the test cases from the selected Test Plan, arranged in the same order defined in the plan’s Checklist.

‍

2. Create from the Test Runs Page

• Go to the Test Runs page.
• Click the ‘+ Test Run’ button to open the creation form.
• Fill out the following details:
  • Title: Enter a unique name for the Test Run.
  • Test Plans: Select one or more Test Plans to base the Test Run on.
  • Assignees: Choose the users responsible for executing the Test Run.

Note: Skip the ‘Test Plans’ field if you prefer to manually add test cases.

3. Manually Include Test Cases

If you skipped the Test Plans field during creation:

• Open the Test Run’s inner page.
• Click ‘Edit Run’ to access the test case selection interface.
• Use the checkboxes to select the test cases you want to include in the Test Run.

‍

4. Start Running

Once the Test Run is prepared and all desired test cases are included, start the execution process.

Learn more about running Test Runs here.

‍

Manage a Test Run

Managing a Test Run ensures your testing process stays organized and adaptable to your needs. Follow this guide to work efficiently with Test Runs.

‍

1. Test Run View Modes

Test cases in a Test Run can be displayed in two modes:

• Grouped-by-Suite View Mode:
  • Default view, grouping test cases by Suites.
  • Sorting is inherited from the Test Cases page and can only be updated by Project Administrators.

• Checklist View Mode:
  • Displays a flat list of test cases.
  • Test cases can be rearranged using drag&drop by any Project Member.
  • Ideal for customizing the order for convenient testing workflows

‍

2. Rearranging Test Cases

• Checklist View Mode:
  • Use drag-and-drop to reorder test cases for your preferred testing sequence.

Note: Changes in Checklist View Mode do not affect the order in the Grouped-by-Suite View Mode.

• Test Runs Created from Test Plans:
  • If the Test Run is based on a Test Plan, the test case order from the Test Plan is applied.

Note: Any changes made in the Test Run will not affect the Test Plan’s original order.

‍

3. Edit a Test Run

Use the ‘Edit Run’ modal to update Test Run details:

• Title: Modify the Test Run name.
• Assignees: Add or change the testers assigned to the Test Run.
• Include/Exclude Test Cases: Adjust the list of test cases in the Test Run.

Note: Newly added test cases in Checklist View Mode will appear at the bottom of the list.

‍

What’s Next?

Managing Test Runs effectively ensures smooth execution and adaptability for testing needs. For additional help, check related guides or contact support—we’re here to help!

‍