Uploaded on Feb 22, 2023
In 2018, when the Workload Automation test team began to prepare for the 9.5 release in March 2019, there was a complete redesign of the primary user interfaces. None of the existing test automation assets were usable, and the re-engineering efforts were significant. A new solution had to be found. Hence, HCL OneTest was selected for a pilot program due to its offering of a codeless solution with the added benefits of simple script maintenance and the ability to leverage API and database actions in test scripts. Read about the key findings, solutions, and advantages of the same in this document. Learn more about HCL OneTest, by this link: https://www.hcltechsw.com/onetest
Optimizing and Automating Complex Workloads for Greater IT Efficiency
OPTIMIZING AND
AUTOMATING
COMPLEX
WORKLOADS
FOR GREATER
IT EFFICIENCY
// C A S E S T U D Y
TABLE OF CONTENTS
2 // Introduction
3 // Challenge
4 // Strategy
5 // Key Findings
6 // Solution
7 // Benefits
8 // HCL OneTest Highlights
9 // About This Case Study
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
INTRODUCTION
The Workload Automation product Additionally, Workload Automation
enables more than 2,000 leading allows scheduling dependencies
organizations around the world to gain between disparate systems, and helps
complete visibility and control over increase availability due to its true fault-
attended and unattended workloads. tolerant architecture.
From a single point of control, it
supports multiple platforms, provides
advanced integration with enterprise
applications like SAP, Oracle, and
Salesforce, and offers more than 35 out-
of-the-box plugins, including plugins for
FTP and Hadoop activities.
//2
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
CHALLENGE
In 2018, the Workload Automation Therefore, a new solution had to be
test team began to prepare for the 9.5 found.
release in March 2019.
The team evaluated updates to their
This major release brought about a existing Selenium Robot framework
complete redesign of the primary user while also looking at Katalon and HCL
interfaces. Such radical change meant OneTest, primarily focusing on effort,
that none of the existing test automation ease of use and maintainability as the
assets were usable, and that the effort to success criteria.
re-engineer them was significant.
The re-factoring process for existing
scripts (based on manual interactions
with a browser) would have been
very time consuming, and since the
tests were coded, they were also
brittle. Additionally, the text-based
development environment was not very
intuitive for the testers, who adopted
the framework, and it was difficult to
document going forward.
SUCH RADICAL CHANGE MEANT THAT NONE OF THE EXISTING
TEST AUTOMATION ASSETS WERE USABLE, AND THE THAT THE
EFFORT TO RE-ENGINEER THEM WAS SIGNIFICANT.
//3
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
STRATEGY
The team was unhappy with its existing Support provided by the community
framework due to daily instabilities in and even third-party vendors, was not
execution, resulting in tests hanging or enough to satisfy the business-critical
producing false positive outcomes and requirement for the automation.
leading to significant manual effort post
execution. Hence, HCL OneTest was selected for
a pilot program due to its offering of
Also, the Selenium Robot framework a codeless solution with the added
was generally considered too brittle and benefits of simple script maintenance
a coded solution was not ideal for the and the ability to leverage API and
team. Katalon was carefully considered database actions in test scripts.
due to its strong out of the box
capabilities. However the team noticed
several problems when creating scripts,
while finding the maintenance effort to
be high.
SUPPORT PROVIDED BY THE COMMUNITY AND EVEN THIRD-
PARTY VENDORS, WAS NOT ENOUGH TO SATISFY THE BUSINESS-
CRITICAL REQUIREMENT FOR THE AUTOMATION.
//4
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
KEY FINDINGS
At the conclusion of the four-month • Intelligent object recognition
pilot program, the following were the during playback made scripts
key findings: resilient to changes and easy
to maintain
• HCL OneTest proved to be a
convincing solution, capable • The ability to re-use UI tests
not only of overcoming the during performance testing
limits of the previous leads to efficiencies in script
framework, but also adding creation and earlier results
significant value
• Tests can be built that
• Natural language scripts are combine the browser
auto-generated from interactions with steps to
recording sessions, and can be cleanup data and validate
augmented with additional data on the back-end systems
steps in the IDE while the providing richer and more
application is offline robust workflows
• Recording interactions with
the web page under test and
associating each action with a
navigable screenshot of the
page and DOM became
a natural and intuitive way of
working code-free
//5
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
SOLUTION
The team quickly created a modular Tests are executed as part of the build
framework of atomic UI actions, which pipeline through Jenkins and execute
were chained into Compound Tests to against four different environments in
form user workflows. parallel.
Each of these workflows validates a With one set of scripts, users can
range of functional and non-functional verify that the Workload Automation
outcomes including verification of the UI core application functions correctly
controls and values as well as verifying on Windows and Linux, as well as,
parameters that are only accessible via each of the four supported database
APIs and database queries. configurations: Oracle, DB2, Informix and
MSSQL.
The entire test set of 174 end-to-end
workflows (comprised hundreds of
test modules) is decoupled from the
test data which drives much of the
logic of the test. This meant some test
maintenance tasks are as simple as
editing a .CSV file.
TESTS ARE EXECUTED AS PART OF THE BUILD PIPELINE
THROUGH JENKINS AND EXECUTE AGAINST FOUR DIFFERENT
ENVIRONMENTS IN PARALLEL.
//6
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
BENEFITS
• Ported the entire Selenium test suite • Configured the entire test suite as
(which had taken several years to a Jenkins pipeline activity, exercising
create) all deployment configurations of the
application
• Created more than 600 test cases
to create a stable library of basic • Highlighted more than 70 defects
operations during the development cycle of
the Workload Automation product
• Gained confidence that new easily – approximately 5% of the total
maintainable tests can be built within defects found
hours (not days as before)
• Option to run containerized test
• Achieved a 35% increase in coverage engines simplifies CI/CD process
with new tests and the ability to
bridge front and back end
components of the application
THE BENEFITS WERE ACHIEVED IN LESS THAN FOUR MONTHS.
//7
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
HCL OneTest HIGHLIGHTS
• Script maintenance effort • Re-use of test assets increased due
conservatively calculated at 50% to to script modularity and
75% less than the other tools compatibility of across the different
evaluated test disciplines: UI, API and
Performance
• Test coverage increased by 35% due
to the ease of use and depth/ • “Beyond the Contract” support via
breadth of technology coverage HCL’s Client Advocacy Team
accelerated the project and provided
• Found 70 additional defects – 5% a direct channel to product
fewer for customers to find developers and product managers
//8
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
ABOUT THIS CASE STUDY
HCL OneTest provides UI, API, and For more information, visit
performance testing, as well as service hcltechsw.com/onetest.
virtualization and synthetic data
fabrication to support testers throughout Copyright ©2020. All rights reserved.
a project lifecycle. It features a script- No materials from this case study can
less, wizard-driven test authoring be duplicated, copied, republished or
environment and support for more than reused without the written permission
100 technologies and protocols. from HCL Software. The information
and insights contained in this case study
HCL OneTest belongs to the DevSecOps reflect research and observations made
product domain of HCL Software which by HCL Software.
is a division of HCL Technologies (HCL)
that operates its primary software
business. It develops, markets, sells
and supports more than 20 product
families in the areas of DevSecOps,
Automation, Digital Solutions, Data
Management, Marketing and Commerce,
and Mainframes.
//9
// C A S E S T U D Y
O P T I M I Z I N G A N D AU TO M AT I N G CO M P L E X WO R K LOA D S F O R G R E AT E R I T E F F I C I E N C Y
Comments