Department of Motor Vehicles
-Israeli Ministry of Transport
Expansion of Vehicle Registration Numbers
To keep pace with the rapid growth of vehicles appearing on the roads every year, the Israel Ministry of Transport (MOT) decided to expand vehicle registration numbers from 7 to 8 digits. After going through the requisite bid solicitation process MOT awarded the project to MOST Software Technologies (MOST).
MOT realized that this fundamental change in their application systems meant that a significant portion of MOT’s IBM Mainframe applications were going to undergo an update process. Translated into bits & bytes this meant touching something like 10,000 programs, some 350 database tables, hundreds of sequential files and modifying the many interfaces serving MOT’s ongoing communications with over 80 external agencies.
MOT recognized that key to a successful completion of this project would be the implementation of an automated testing process that would serve to validate all changes made to their vehicle related applications. Additionally MOT established the requirement for the testing environment and related QA procedures to ‘survive’ the project at hand and serve as MOT’s ongoing regression testing environment into the future.
In responding to MOT’s testing related requirements MOST faced the following challenges:
As of project ‘kick-off’, MOT had no formal testing environment, procedures or related application testing documentation
Much of the ‘testing knowhow’ related to Vehicle systems had exited the organization together with SME’s and application developers who had gone out on pension
The testers who would be part of the project team had zero mainframe knowledge
MOST identified two key components that would underpin the testing environment serving the project:
MF-Test – MOST’s IBM mainframe automated regression testing tool
HP- ALM – HPE’s application life cycle management tool with which some of the testers had had previous experience
MOST R&D developed an API to interface HP-ALM to MF-Test in order to facilitate:
application life cycle management via HP-ALM
documentation of all mainframe application testing scenarios using HP-ALM
dispatch and execution of all testing scenarios to the mainframe from within the HP-ALM environment
all mainframe testing results seamlessly exported from IBM mainframe back to HP-ALM
Reasons for choosing HP-ALM
The main reasons for MOST choosing HP-ALM included the following:
Ability to support, in a fast and efficient manner, all the life cycle management activities related to project application development and testing
Ease of integration within customers testing environment including IBM mainframe & open systems
Extending HP-ALM to control & manage MF-Test functionality
A single focal point to manage, audit and provide requisite project management support
The Setup Process
STP creation – A Software Test Plan was setup to cover the establishment of 500 on-line test scenarios covering 3,000 use cases for on-line together with 400 batch test scenarios.
Both the scope and content of the test scenarios was created by a team of 4 test leads together with key end users.
STD development – The Software Test Descriptions relevant to the STP were documented within HP-ALM. Applications were split into 20 sub-systems each with their own relevant test descriptions.
Test recording - The actual tests are recorded working off HP-ALM Test descriptions side by side with an MF Test workstation. The MF-Test workstation serves as the User Interface to the mainframe application and the recording device for purposes of documenting the relevant test scenario.
All tests executed are validated with respect to their outcome and became the baseline test scenarios for all future regression testing.
From this point on, all tester interfacing to the mainframe is via HP-ALM environment using a test scenario identifier common shared by both HP-ALM and MF Test.
Testing Status Monitoring
HP-ALM is used to track the status of all testing.
Defect management is handled by HP-ALM which serves as focal point for all relevant information pertaining to test status, test results.
MF Test functionality
MF Test serves to identify all key mainframe test scenario components to include:
Database tables and flat files
Relevant batch jobs
MF Test is responsible for setting up of the start test data and recording the resulting data at the end of each test execution.
Regression testing is performed by recording all test scenario outputs prior to making any application changes – the ‘before’ run. After having made requisite application changes, the ‘after’ test scenario is executed. Test result reports are generated based on comparison between the ‘before’ & ‘after’ test executions. All test results are exported to the HP-ALM environment.
Ongoing test execution
All testers work from within their own HP-ALM test environment and submit tests for execution from within the HP-ALM environment.
Tests can be initiated for immediate execution or for deferred overnight execution. All test results validation and reporting is viewed from within the HP-ALM environment. As such all ongoing interaction with the mainframe is via the HP-ALM environment.
Benefits to MOT
MOT has established a knowledgebase of testing scenarios to be used as an organizational resource to support ongoing application development independent of specific SME or application developer knowledge
MOT has a an automated system to perform regression testing that shortens the application delivery process
MOT has a structured QA process that increases quality of delivery and significantly reduces risk of failure in production environment
MOT has established a unified testing methodology and delivery process for both mainframe and open systems environments.
About MOST Software Technologies
MOST Technologies is a leading provider of automated legacy modernization and application remediation solutions that transform legacy applications to modern, functionally equivalent systems based on mainstream application infrastructure. MOST’s automated transformation technology, OnTarget, provides an integrated tool set to manage all aspects of the legacy modernization process.
Additionally MOST supports, develops and licenses MF-Test, a software product licensed by customers to manage IBM mainframe application regression testing.
MOST’s customers include organizations such as Aflac – American Family Insurance USA and Aflac Japan, Credit Suisse, Kawasaki Heavy Industries, Sunoco and similar organizations.