The TestCaseLab tool lets you run tests and report bugs right away to your favorite bug-tracking system. TestCaseLab integrates with the Mantis bug-tracking tool, so you can manage defects easily.
The following instructions will guide you through setting up the Mantis integration.
1. Generate API token
As a first step you should log in to your Mantis account.
Navigate to your Mantis account and click on your ‘Profile’ icon. Choose the ‘My account’ option from the menu.
Mantis - Go to My Account
From the ‘My account’ tab go to the ‘API tokens’ tab.
Mantis - Go to API Tokens
Fill in the ‘Token name’ field, and click on the 'Create API token' button. Copy your API token to the clipboard.
Mantis - Create API Token
2. Set up Connection
After that, you need to navigate to your TestCaseLab Company Account, click on the ‘Project Settings’ in the sidebar and go to the ‘Integrations’ tab.
Choose the Mantis tool from the list of Bug tracking tools.
Mantis Integration Form
Paste your API Key to the ‘API Key’ field.
Copy your Mantis URL, and paste it to the ‘URL’ field. Example: https://YOURNAME.mantishub.io/
Click on the 'Test connection' button, then choose your Project from the dropdown menu and confirm the action.
You can report your defects directly to Mantis from TestCaseLab once you receive the 'Connected' notification.
What’s Next?
If you have any questions, our support team is here to assist you!
TestCaseLab offers three types of reports to analyze and share Test Run results. Reports can be accessed from the Test Run page and shared externally with stakeholders, even if they don’t have access to the Company Account.
Provides a high-level summary of the Test Run results.
Includes:
Number of Test Cases Executed: Total count of test cases run.
Number of Defects Reported: Issues identified during the Test Run.
Test Run Assignees: List of users assigned to the Test Run.
Pie Chart: Visual statistics based on test case result statuses (e.g., Passed, Failed, Blocked).
Activity per User: Tracks contributions by each team member.
List of Test Cases with Results: Detailed table showing the status of all test cases.
General Report
2. Failed Test Cases and Defects Report
Focuses on problem areas by highlighting failed test cases and associated defects.
Includes:
Pie Chart: Visual statistics on the number of failed test cases.
Number of Defects: Total count of defects reported during the Test Run.
Reporters List: Identifies users who reported defects.
Failed Test Cases List: Table of test cases that failed.
Defects List: Detailed information about reported defects.
Failed Test Cases and Defects Report
3. Comparison of Test Runs
Allows comparison of results across multiple Test Runs.
How to Generate:
Select up to 4 Test Runs for comparison.
Click the ‘Show Report’ button to generate the comparison.
Use Case: Ideal for identifying trends and analyzing progress, especially when comparing Test Runs based on the same Test Plan.
Comparison of Test Runs Report
What’s Next?
Generate the report type that aligns with your needs to gain insights into testing activities and outcomes. For additional assistance, check related guides or contact support—we’re here to help!
Run Tests & Report Bugs - Ensure Quality Assurance
December 4, 2024
Running tests ensures thorough execution and accurate tracking of your system's quality. Use this guide to effectively execute test cases, log results, and analyze outcomes.
Running tests in TestCaseLab ensures accurate tracking and documentation of your testing process. For further assistance, check related guides or contact support—we’re here to help!
Create & Manage a Test Run - Execute Tests with Precision
December 4, 2024
Create a Test Run
Creating a Test Run helps organize and execute a specific set of test cases to meet your testing objectives. Follow this guide to set up a Test Run efficiently.
Managing a Test Run ensures your testing process stays organized and adaptable to your needs. Follow this guide to work efficiently with Test Runs.
1. Test Run View Modes
Test cases in a Test Run can be displayed in two modes:
Grouped-by-Suite View Mode:
Default view, grouping test cases by Suites.
Sorting is inherited from the Test Cases page and can only be updated by Project Administrators.
Grouped-by-Suite View Mode of Test Run
Checklist View Mode:
Displays a flat list of test cases.
Test cases can be rearranged using drag&drop by any Project Member.
Ideal for customizing the order for convenient testing workflows
Checklist View Mode of Test Run
2. Rearranging Test Cases
Checklist View Mode:
Use drag-and-drop to reorder test cases for your preferred testing sequence.
Note: Changes in Checklist View Mode do not affect the order in the Grouped-by-Suite View Mode.
Drag&Drop Test Cases in a Checklist View Mode
Test Runs Created from Test Plans:
If the Test Run is based on a Test Plan, the test case order from the Test Plan is applied.
Note: Any changes made in the Test Run will not affect the Test Plan’s original order.
3. Edit a Test Run
Use the ‘Edit Run’ modal to update Test Run details:
Title: Modify the Test Run name.
Assignees: Add or change the testers assigned to the Test Run.
Include/Exclude Test Cases: Adjust the list of test cases in the Test Run.
Note: Newly added test cases in Checklist View Mode will appear at the bottom of the list.
Edit Run Form
Edit Test Run title in-line
What’s Next?
Managing Test Runs effectively ensures smooth execution and adaptability for testing needs. For additional help, check related guides or contact support—we’re here to help!
.webp)
