Mainframe test automation using MF-Test. DevOps for IBM Z Virtual Conference - Track B Max Moss - Thursday 27 th July

Transcription

1 Mainframe test automation using MF- DevOps for IBM Z Virtual Conference - Track B Max Moss - Thursday 27 th July 1

2 Agenda About MOST Mainframe testing current state of affairs & key MF- objectives MF- the product Demo Customer examples MF- & DevOps 2

3 About MOST We ve been delivering mainframe application transformation & support services for the past 20 years Our people always on the look out to automate using tools Enhance our existing tool set OnTarget Develop new tools MF- Work with partner tools Adding value to customers using mainframe Global presence - Americas, EMEA, Japan 3

4 Mainframe testing current state of affairs Same process & tools for last 30 years it just works so why change it. (Rosalind Radcliffe DOES London 2016) Lack of rigorous testing methodologies It s too costly to change current procedures Great advances in the shift left approach developer aids but what about the right side of the house High degree of dependency on individuals - the owner s of the apps know what/how to test their own applications 4

5 MF- objectives Improve testing quality Both end result and the testing process itself Assist customers to control testing Reduce costs associated with unmanaged and inefficient testing Make testing knowledge an organizational asset ing knowledge transfer from individuals to central repository Integrate testing into the bigger ALM picture Support for automated continuous delivery process Managing test data e.g. data synchronization activities between testers 5

6 New Requirements/Regulations MF ing -and the the bigger bigger picture picture Application A QA Application A New Business Capability Application B Plan Dev & Unit MF- Build Deploy Production Application B Application C Application C New Enterprise Release Application N Where MF- fits in Application N 6

7 Before vs After paradigm Application X Ver N Run Baseline s Results Results Results Before Development / Maintenance After Rerun s Results Results Results Not OK Compare OK Production Application X Ver N+1 7

8 MF- typical process Stage 1 Preparation Define test Scenarios Set up test data BEFORE run once Stage 2: Execute Before Run Load test data Execute/Record scenario Save Results Stage 3: Execute After Run Reload Data Execute/Replay scenario Save Results AFTER run many Stage 4: Automatic comparison Unload test data Compare results & report Record test history 8 8

9 MF- components MF- workstations Repository - definitions - results -Audit trail XCOM, FTP, FTP2 & SFTP 3270 emulation Mainframe REXX JCL 9

10 Batch test creation example MF- JCL Create test data Batch test Repository definition Library Before DB data DB2 Instance Prog Library After IBM z PDS JCL Build from JCL 10

11 Online test creation example Screen input Record input Record once - replay many times Create test data On-line test definition Repository DB data DB2 Instance CICS region Prog Library Before Library After IBM z 11

12 Demo 12

13 MF- used by Kawasaki Licensed by IBM for use on Kawasaki project IBM Project Manager - significant resource savings resulting from use of MF-. Activity Execution Results analysis Without MF- 60m per program 20m per program With MF- (actual) 30m per program Saving 50% 5m per program 75% Project savings resulting from use of MF-:- With respect to resources 4.5 man years Added value of improved quality of deliverables 13

14 Case study Large Japanese Insurance company One of the largest insurance companies in Japan Using MF- in TCOE ( Center Of Excellence) Used by both internal QA and external service providers 180+ testers trained to use MF- to date MF- helps customer to resolve issues relating to: Reduce cost of testing Improve time to market by reducing testing time Establish a focal point for testing knowledge within the organization Improve testing efficiency Control over SI testing procedures 14

15 Example of ALM integration MF- has been integrated with HPE-ALM API to HPE ALM 1. Create a list of tests in HPE to run under MF- 2. Run the tests from HPE within MF- 3. Get results from MF- back to ALM 4. Overall test management Coverage* Planned vs Actual* * From MOT ing status* Similarly MF- can integrated with relevant IBM components 15

16 Vision for integration with DevOps Key events the application life cycle Capture requirements Create test plans Design test scenarios Plan Code Develop/Update code Run unit test Deploy to test environment Setup test scenarios Prepare test data Deploy Quality Management Integration Functional Performance Acceptance results Quality of testing Issue reporting Optimize Manage progress Monitor Need for synchronization between all steps in the process 16

17 Vision for integration with DevOps Capture requirements Create test plans Design test scenarios Plan 1 Code Develop/Update code Run unit test MF- Deploy to test environment Setup test scenarios Prepare test data Deploy ADDI Quality Management Integration Functional Performance Acceptance Report results MF- 6 results Quality of testing Issue reporting Optimize Manage progress Monitor planning & Scenario design definition using ADDI automation using MF- results automatic feed to RDZ component efficiency via code coverage LE debug tool Monitor via dashboard & overall test management via RDZ

18 Code coverage example s : 385 Programs : % % 80 % 200 < 50 % 100% % % < 50 % Executed Program Name # of statements Yes No % CC # of s CCDBD001 1,254 1, CCDBD CCDBD DCDBD001 1, DCDBD MMSCD PROCEDURE DIVISION. * MAIN SECTION. OPEN INPUT WORK01 OUTPUT WORK02 REP01 DISPLAY 'MFTDRV01 STARTED' READ WORK01 AT END MOVE 1 TO WS-STATUS-IN END-READ PERFORM UNTIL WS-STATUS-IN = 1 WRITE FD-WORK02 FROM FD-WORK01 ADD 1 TO OUT-REC-COUNT INITIALIZE REPORT-RECORD MOVE LONG-BINARY OF FD-WORK01 TO RECORD-ID MOVE SHORT-TEXT OF FD-WORK01 TO REP-TITLE MOVE MEDIUM-TEXT OF FD-WORK01 TO DESC MOVE LONG-NUMERIC OF FD-WORK01 TO PERCENT ADD 1 TO LINE-COUNT CALL PROCESS-BEFORE-PRINT USING RECORD-ID PERCENT 18

19 Summary MF- provides robust mainframe industrial application test automation Comprehensive online & batch regression & integration testing Support for a variety of languages and databases Provides independent testing environment for each tester data management result comparison reports Significant cost saving and improve time to market Natural fit within DevOps world 19

20 Questions Contact us at sales@mosttechnologies.com - Call us at Thank you 20

21 Links to IBM Products RDZ ADDI LE Debug for IBM z