Connect DevOps Test with Engineering Test Management (ETM) to accelerate the test cycle by automating test execution.

About the integrated IBM Test Management / Test Automation Solution

t_overview

IBM Engineering Test Management Overview

Product Name	Description	Additional Information
Engineering Test Management	ETM is a collaborative, web-based tool for planning, constructing, managing, and executing tests throughout the development lifecycle for test teams of all sizes. To learn more about Engineering Test Management	Overview

IBM DevOps Test Automation Overview

Product Name	Description	Additional Information
DevOps Test Hub	Test Hub, a web-based continuous testing platform, enables test teams to run a breadth of tests that includes API, functional, and performance tests as well as bringing together test data, test environments, and test runs and reports into a single, web-based browser for testers and non-testers.	Overview
DevOps Test UI	Test UI is an object-oriented automated testing tool that tests a wide range of desktop, Web, and mobile applications. Test UI provides automated testing capabilities for functional, regression, GUI, and data-driven testing.	Overview
DevOps Test Integrations and APIs	Test Integrations and APIs is an integration testing and virtualization tool that includes capabilities to automate and run tests earlier and more often to find problems sooner in the development cycle.	Overview
DevOps Test Performance	Test Performance is a scripting-free environment for automating load and scalability testing of web, ERP, and server-based software applications. Test Performance provides rich and customizable reporting to help you identify the presence and cause of system bottlenecks. It captures the network traffic that is rendered when the application under test interacts with a server. This network traffic is then emulated on multiple virtual users while you play back the test.	Overview
DevOps Test Embedded	Test Embedded is a complete test and runtime analysis tool set for systems development created in any cross-development environment. Test Embedded provides tools for automated component testing, code coverage, memory leak detection, performance profiling, and UML sequence diagram tracing.	Overview

Why integrate IBM DevOps Test Automation with IBM Engineering Test Management

While test automation is not a "silver bullet" replacement for all manual testing activities and is often misused as a means or reason to reduce the size of test teams, test automation does provide organizations with many benefits, including:

Value Proposition	Explanation
Saving organizations time and money	While not all tests should be automated or can be automated, automated testing reduces the cost of testing by reducing the expensive manual effort executing test scripts which are candidates for test automation.
Helping test teams increase test coverage	Freeing testers from having to execute test scripts manually by following a series of documented test steps allows them to focus on improving the overall test effort - identify missing test cases, focus on exploratory testing, improving test practices eliminating waste, etc...
Improving testing accuracy	Let's face it, people make mistakes. Automated testing is software designed to repeatedly and consistently execute a series of steps against the application under test over and over to verify functions and features.
Accelerating feedback on software quality	As automated testing is faster, can be run as part of a deployment process, and consistently executes to verify software quality, the results of those test executions can be immediately shared directly back to the development team providing continuous feedback on software quality.
Improving team morale	By allowing Testers to focus on improving the testing practice and providing Developers accelerated feedback on the software they are developing can only lead to improved morale.

About the learning environment

ETM Setup

In order to share details and experience hands on learning with how to configure and exercise the connection between ETM and DevOps Test UI, the JKE Banking (Quality Management) project was added to ELM as part of installing the Money that Matters sample application. In addition, to enable the Test Hub adapter in ETM, the DevOps Test Hub adapter files have been downloaded and installed ETM. For details on how to install the DevOps Test Hub adapter files in ETM, refer to the instructions available at the following URL : https://www.ibm.com/docs/en/devops-test-hub/11.0.6?topic=management-adding-adapter-files-engineering-test

DevOps Test UI Setup

As the scope of this exercise is to share details on how to integrate DevOps Test with ETM and not provide details on how to record and modify an automated test script, a Test UI project has been already created and an automated test script recorded. Details of the test script are as follows:
1. Launches the application under test in a browser.
2. Modifies several field on the UI to submit a donation to the charity of choosing.
3. Posts the donation.
4. Verifies the donation has been successfully submited.
5. Browser closes/ test ends.

Application Under Test (AUT) Setup

The "JKE Banking - Donations" demo application being subjected to test automation is a simple html file containing javascript. It is deployed as a docker container running on an nginx server to host the index.html file on port 81 (http://127.0.0.1:81) and starts up during boot of the RHEL OS.

Chrome/Firefox Browser Setup

Both browser applications have bookmarks available to conveniently access the Workbook, the ELM instance, and the JKE Banking - Donations demo application.

About this workbook

The scope of this workbook is to share details on how engineering teams can connect automated test scripts (authored in one of the many DevOps Test solutions) with test cases (managed in Engineering Test Management) for the purpose of automating test execution and delivering feedback on software quality to developers faster. And while the demo guide will share details on how to configure all the different adapter options, this exercise will focus on the end to end story involving DevOps Test UI and ETM as, once an adapter is configured, the process of adding a test script to an ETM test case is the same.

What this exercise does not cover is how to author automated tests in any of the DevOps Test Automation solutions or how to perform test management in ETM.

If you are interested in learning more about specific test management and/or test automation capabilities offered by IBM Software:
To learn more about test management capabilities offered by IBM visit IBM's ETM documentation webpage..
To learn more about test automation capabilities offered by IBM visit IBM's DevOps Test documentation webpage.

In this workbook, you will learn how to:
1. Configure Test Adapters creating a communication channel between ETM and DevOps Test.
2. Add a test script to an ETM test case and link to the DevOps Test script for test execution.
3. Execute the test from ETM by running the test case and observing the DevOps Test automated test playback against the application under test.
4. Review the test execution verdict and result file(s) returned to ETM from DevOps Test solution.

1. Configure Test Adapters creating a communication channel between ETM AND DevOps Test

There are 3 adapters available to execute automated tests linked to test cases managed in ETM. Which adapter to use depends on the test automation solution the automated test scripts were authored with.

1-1 Configuring the DevOps Test Hub adapter

The Test Hub adapter is used to create a connection between DevOps Test Hub and ETM. As this learning environment does not have a Test Hub instance installed and running, this section is informational sharing specifics on how to configure the adapter.

Step	Details	Additional Information
1	Log in to Test Hub.
2	Open the Test Project (e.g. JKEBanking) by clicking on the tile.
3	Click Manage > Integration from the left-hand navigation bar.
4	On the Integration page, click Add IBM ETM Adapter within the IBM Engineering Test Management (ETM) section.
5	Enter the ETM server URL, user name, and password. For the purpose of this exercise the following values were used: Server URL: https://ibmjazz.net:9443 Username: sysadmin Password: Passw0rd
6	Click Validate.
NOTE:	The Validate action connects to the ETM instances retrieving the available project areas to populate the Project area picklist.
7	Select JKE Banking (Quality Management) from the Project area list.
8	Provide a meaningful name for the adapter to be displayed in ETM on the adapter console.
9	Click Save when done.

1-2 Configuring the Test UI adapter

The Test UI adapter is used to create a connection between the Functional testing perspective in DevOps Test UI (formerly Rational Functional Tester) with ETM. While you will not be executing a functional test script, this section of the workbook shares details on how to configure the adapter, start the adapter, and confirm that the adapter is available in ETM.

Step	Details	Additional Information
1	Open a terminal session.
2	Navigate to the following folder within the DevOpsTest installation location: TestUI installation directory/FunctionalTester/RQMAdapter/ For this exercise, the installation folder is "/opt/IBM/DevOpsTest" cd /opt/IBM/DevOpsTest/FunctionalTester/RQMAdapter
3	As the superuser, execute the following command: sudo ./configureadapter sudo password is "Passw0rd" (Passw+zero+rd)
4	In the DevOpsTest UI Adapter user interface, enter the appropriate information for your ETM installation. For the purposes of this exercise, the following was used to establish a connection with ETM. Server URL: https://ibmjazz.net:9443/qm Authentication Type: Username and Password User ID: sysadmin Password: Passw0rd Project area: JKEBanking (Quality Management) - selected from the picklist Adapter Name: DTUI Adapter on rhserver
NOTE:	The Project area picklist is automatically populated upon supplying the URL, User ID, and Password values.
5	Click Start Adapter.
6	Click the Adapter Console tab to confirm a connection was made to ETM.
7	Launch a Browser and navigate to the JKE Banking (Quality Management) project in ETM. User ID: sysadmin Password: passw0rd
8	From the JKE Banking (Quality Management) project area, click Execution and select Adaptor Console from the list of options
9	Confirm that the DTUI Adapter on rhserver is listed and showing as Healthy
10	Return to the DevOps Test UI Adapter window on the Desktop, click Stop adapter, and close the adapter and terminal windows.
NOTE:	The test adapter configuration settings persist. Meaning, to start the adapter in the future, navigate to to the adapter installation folder and run sudo ./startadapter instead of ./configureadapter.

1-3 Configuring the Test Workbench adapter

The Test Workbench adapter is used to create a connection between the Test UI and/or the Performance testing perspectives in DevOps Test UI with ETM. This section of the workbook shares details on how to configure the adapter, start the adapter, and confirm that the adapter is available in ETM.

Step	Details	Additional Information
1	From the RHEL desktop, click Applications > DevOps Test > DevOps Test UI to launch the testing application.
2	Specify the Workspace and click Launch. For this exercise leave the workspace as is.
3	After DevOps Test UI has opened, click Window on the toolbar and select Preferences from the options presented.
4	On the Preferences window, select Engineering Test Management.
5	Enter your Server URL, Adapter Name, Project area, User ID and Password details on the Engineering Test Management Adapter window. For the purposes of this exercise the following values were used: Server URL: https://ibmjazz.net Adapter name: DevOpsTest Project area: JKE Banking (Quality Management) Authentication Type: Username and Password User ID: sysadmin Password: passw0rd Click Apply and Close when done.
NOTE:	When configuring this particular adapter, the Project area is not selected from a picklist. You must manually enter the Project area name exactly as it appears in ETM.
6	Locate the Engineering Test Management Adapter panel in the DevOps Test UI application. Typically located bottom right in DevOps Test UI.
NOTE:	The Engineering Test Management Adapter panel has been added in advance. But, to add the panel, click Window > Show View > Engineering Test Management Adapter
7	Working in the Engineering Test Management panel, activate the connection to ETM.
8	Confirm that the adapter successfully connected to ETM.

1-4 Configuring the Test Integrations & APIs and Test Embedded Adapters As these remaining two test automation solutions have not been installed/configured in the RHEL image, click on the following links to review how to integrate ETM with additional test automation solutions:

Configure and Run the DevOps Test Integrations & APIs adapter
Configure and Run the DevOps Test Embedded adapter

Congratulations on successfully configuring the DevOps Test Adapters for ETM to manage and automate testing.

2. Understanding the DevOps Test test script which will be executed from a test case in ETM.

t_script

Step	Details	Additional Information
1	Working in the DevOps UI Test application, double click the Donation test script if not already open in the Test Editor view.
2	In the View panel, click the SmartShot View to enable.
3	In the Test Contents view, fully expand the Test Resources and Launch application twistys.
4	Under the UI Test entry, click the RTW_WebUI_Browser_Selection="Chrome" line.
5	In the Variable Details view, note that this test is configured to start an instance of Chrome. However, this setting may be changed to start a different browser or the browser setting could be provided through a data source allowing the test to be executed against a variety of browser types.
6	Click through the various test script commands listed starting from Launch application: 127.0.0.1:81 and refer to the SmartShot View seeing how the application is being exercised by the test script. The first six steps are interacting with the application as a user would - clicking controls and entering data. The seventh step is verifying that the user was able to successfully send a donation of $100 CAD to the United Way organization.
NOTE:	This example was a very simple test. However, now that this user story can be verified automatically, it can now be added to Test Case 9: Donors Can Choose to Support an Organization in ETM, and can repeatedly be executed as part of future ETM test plans.

3. Create an ETM test script, import the DevOps Test script, and add to an ETM test case for test execution

NOTE: Before starting the exercise, be sure to start the DevOps Test UI adapter and confirm its availability on the ETM Adapter Console page.

Start adapter in DevOps Test UI
t_startAdapter

Verify adapter in ETM Adapter Console
t_adapterConsole

3-1 Create the ETM test script

Step	Details	Additional Information
1	Working in the JKE Banking (Quality Management) project in ETM, click Construction and create a new Test Script.
2	Enter a meaningful name for the new test script. e.g. AT - Donor can choose organization.
3	Click the Type drop down listbox and select DevOps Test Workbench from the options presented.
4	Set the test script action as Ready for review and assign to Sally.
5	In the Test Workbench script details section, enable Use test resources that are local to a test machine and click Select Adapter.
6	Select the test adapter which will be used to access the test script in DevOps Test UI. Click Next.
7	Enter the path to the DevOps Test UI workspace and project area within the workspace. /home/sysadmin/project/workspace/JKE_Banking Click Go.
NOTE:	Clicking Go makes a connection to the DevOps Test UI project area returning a list of available test scripts.
8	Select the test script to be imported from DevOps Test UI and click Finish.
9	Save the Test Script in ETM.
10	In the Action field, change the state to Approve and save the change.

3-2 Add new test script to ETM Test Case

Step	Details	Additional Information
1	Working in the JKE Banking (Quality Management) project in ETM, click Construction and Browse Test Cases.
2	Open Test Case 9:Donors Can Choose to Support an Organization
NOTE:	Remember when reviewing the automated test script steps in DevOps Test UI: 1. United Way was chosen by the user as the donation recipient. 2. The test script playback was in a Chrome browser.
3	Working in the Test Case Execution Records view of the Test Case, add a new Test Case Execution Record by clicking the Generate New Test Case Execution Record icon.
4	From the list of available Test Environments, select Chrome_DB2_Tomcat... and click Next.
NOTE:	For the purpose of this exercise, you will just reuse an existing environment. However, know that you could Generate a Test Environment as well.
5	Enable the Test Environment and click Next.
6	Select the Test Environment and click Generate Test Case Execution Records
7	Select the Test Scripts view of the Test Case and click the Add Test Scripts icon.
8	In the list of available Test Scripts, locate and select the Test Script created in the previous section - AT-Donor can choose organization. Click Add and Close.
9	Select the existing Manual test script and Remove.
10	Save the Test Case changes.

Congratulations on successfully adding the DevOps Test UI test script to ETM for automated testing.

4. Execute the test by ETM running the test case and observing the DevOps Test automated test playback

Step	Details	Additional Information
1	Continuing to work in the JKE Banking (Qualtiy Management) project and within the 9:Donors Can Choose to Support and Organization test case, click the Run Test Case icon.
2	Select Run from the options presented.
3	Select the appropriate Test Environment and click Finish.
NOTE:	When the test script starts to run, it is important to not interfere with the playback. DO NOT interact with the computer screen.
4	Automated test playback is complete when you see 100% in the Summary panel.

Congratulations on successfully executing the DevOps Test UI test script via an ETM test case to quickly verify the associated user story.

5. Review the test execution verdict and result file returned to ETM from DevOps Test solution

Step	Details	Additional Information
1	Remaining on the Donors Can Choose to Support an Organization Execution record, notice the Overall Verdict outcome.
2	Scroll down in the record to review the process summary table.
3	Scroll to top of page and click Show Result.
4	Review the Result Details. Actual Result: Passed Test Case: 9:Donors Can Choose to Support an Organization Test Script: 29:AT-Donor can choose Organization Test Case Execution Records: 55:Donors Can Choose to Support an Organization.
5	Scroll down to review the Result Details. Notice how the test execution reports from DevOps Test UI have been attached to the results record.
6	Click the Donation[dateTimeStamp].htm file to download saving in the Downloads folder.
7	Open File Manager from the RHEL desktop and navigate to the Downloads folder.
8	Double click the Donation[dateTimeStamp].htm file to open in a browser.
9	Review the Test Log details. Note the test script details in Verification point verdicts section.

Congratulations on completing the exercises configuring the DevOps Test adapters, adding an automated test to the JKE Banking (Quality Management) project, linking the test script to a test case, executing the test case, and reviewing the test execution results.

Software Installed for Enablement Exercises	Software Version	Access
DevOps Test UI	Version 2025.06 (11.0.5)	Software Start Menu
DevOps Test Performance	Version 2025.06 (11.0.5)	Software Start Menu
Engineering Lifecycle Management	v7.1 SR1	https://ibmjazz.net:9443