Managed Testing Services

Transcription

1 Managed Testing Services Technology and Innovation for Banking and Finance Conference Sydney 5th Dec 2006 Arun Kumar Singh GM TeS Wipro Technologies

2 Distributed Test Delivery Model Company XYZ Business unit A in geo A Business unit B in geo B bbusiness unit C in geo C Procurement/ Vendor selection Procurement/ vendor selection Procurement/ vendor selection Solution architecture Solution architecture Solution architecture Test strategy Test Plan Test Case Test strategy Test Plan Test Case Test strategy Test Plan Test Case Deployment/Exec Deployment/ Exec Deployment/Exec Dev/test/deploy environment Dev/test/deploy environment Dev/test/deploy environment 2

3 Challenges in Distributed Test Delivery Model 1. Consistent Processes across multiple delivery teams 2. Effective Utilisation of Resources - Tools, People, Test environment 3. Knowledge Ramp up and Retention 4. Continuous Measurement and Improvement 5. Ability to estimate Budget and costs accurately Key need : Increase Return on Investment 3

4 The Solution Managed Testing Services Company XYZ Business unit A in geo A Business unit B in geo B Business unit C in geo C Managed services Demand Management Demand consolidation & forecasting Benefits Standard engagement process Reduced cycle time Process Consulting QA Consulting/Best Practice Exchange Enterprise-wide common processes Improved maintainability Core Services PMO Manual Testing Automation Build Deploy Standardization of process / templates Compliance across Geos and Business Units Improved productivity Infrastructure consolidation Shared test environments Reduced Capex and Opex 4

5 Salient Features Total Cost of Ownership 1. Standardized processes & procedures for Testing 2. Focus on productivity aimed at continuous cost reduction 3. Increase efficiency / improvements by focusing on repeat projects in the specific areas of testing 4. Build assets to be reused across the enterprise 5. Drive standardization across the globally distributed businesses/functions of the customer 6. Leverage specialized knowledge gained from one/few business function(s) across the enterprise 5

6 Salient Features Operations Operational Issues 1. Optimize and manage the growth of testing efforts 2. Build and retain performance test skills 3. Build and retain automation skills 4. Consistencies in metric tracking across different engagements 5. Institutionalize Knowledge Management 6 Addresses the underlying need to build a model that can drive efficiency improvement across decentralized / wide spread businesses, through standardization of processes, re-use and specialization

7 Managed Testing Services Building Blocks Right Processes Right People Matured Processes Ensure Compliance Effective Utilization Accountability Measurements (Metrics) Standardize Training to Upgrade skills Shared Resource Model Center of Excellence Right Technology Right Delivery Ready to use Automation Frameworks Higher Tool Usage Tool based Test Management Optimized Test Infrastructure Appropriate Governance Model Optimize Cost by Best Shoring strategy Effective Reporting & Monitoring Effective Project Management 7

8 Right Processes The Software Test Diagnostic Model (STDM) framework looks at the following: Test Organization Test Environment Dev. Process Test Metrics Testing Process Test Engineering Test Execution Test Strategy & Planning Test Design Defect Reporting Data Analysis Test Tool Development Bug Verification Test Case Asset Management Release Management Change Management SE Tools and Automation 8

9 Right Technology Eg. Automation Architecture LOGICAL STRUCTURE Test Management system (eg Testdirector, Quality center) ENTERPRISE LAYER : ENTERPRISE WIDE REUSABLE COMPONENTS BEST PRACTICES & CODING STANDARDS AUTOMATION UTILITIES GLOBAL RESOURCES Key Highlights 1. Hybrid of Data driven, keyword & framework architecture 2. Enables reusability across different projects 3. Architecture independent of Tool 4. Results in Increased maturity of test model APPLICATION / MODULE LAYER : BUSINESS PROCESS COMPONENTS APPLICATION LEVEL RESOURCES Key Benefits CORE FUNCTIONS LAYER DATA FILES USER DEFINED KEY-WORDS MAINTENANCE MODEL FRAMEWORK LIBRARY 1. Reduced cost of Maintenance 2. Enhanced usability 3. Business process centric automation 4. Easily scalable 5. Reliable results 6. Reduced time to implement 9

10 Right people Project A Project B Project C Domain/Business Process Knowledge QA Consultants Manual Test Team Manual Test Team Manual Test Team Performance Test Team Automation Team 10

11 Right Delivery 1. Execution approach single-site or multi-site, Infrastructure needs single or multi-vendor etc 2. Team composition 3. Process model may need to customise depending on the specific project needs 4. Decision on tools, frameworks and solutions to be used 5. Agreement on SLAs and Metrics, Opportunities for Improvement 6. Overall Program Governance model 11

12 Case Study

13 Case Study Client profile An innovator in global finance, serves the financial needs of corporations, governments and municipalities, institutional clients, and high net- worth individuals worldwide. Challenges facing the client Wipro solution Results Lack of a common organizational wide platform to ensure QA of IT initiatives To streamline testing efforts within organization and establish a QA cell No automation framework Multiple QA vendors, unable to push SLA based approach Multiple testing tools resulting in minimum reusability across projects Implementation of centralized QA process using mercury testing tools. -- Improved Quality and performance of Applications. MTS Set up resulting in improved lead time in training, technical assistance & resolution of issues --- increased productivity and time to market. Mercury evaluated as the most preferred vendor Test automation has resulted in an effort reduction of close to 40% Wipro has automated close to 60% of the 40 applications Significant cost savings by operating in a predominantly offshore model 13

14 Case Study Benefits as shared by the customer Critical cash trade App. Critical Derivative App. (after 10 months) Metric Pre-QA Post QA Metric Pre-QA Post QA Developer Time Spent in Testing 60 hrs/release 20 hrs/release Developer Time Spent in Testing 20 hrs/release 10 hrs/release Developer Time Spent in Post-Release Troubleshooting 12 hrs/release 2 hrs/release Developer Time Spent in Post-Release Troubleshooting 10 hrs/release 4 hrs/release Post Production Patches/Code Rollbacks 12 1 Post Production Patches/Code Rollbacks 3 1 Number of Test Cases executed Number of Test Cases executed Percentage of Tests Automated 0 70% Percentage of Tests Automated 0 42% Average Support Calls 18hrs/week 25% drop Average Support Calls 12 hrs/week 41% drop 14

15 Wipro Testing Services: A Snapshot 9+ years of experience in independent testing services Clients Employees Largest offshore testing service provider in the world strong QA group today. 80%+ YOY growth for last 3 years Overall 15%+ sequential Q-on-Q growth in last 6 qtrs Revenues ($ Mn) End-to-end testing services offered for all industry verticals Strategic alliances with leading testing tools vendors Testing as Managed Services (TMS) for end-to-end testing ownership through our Global Delivery Model of onsite, offshore, near-shore and remote testing Ready-to-use point solutions, frameworks and industry specific Centers of Excellence (CoEs) 15

16 THANK YOU In God We Trust the Rest we Test Arun Kumar Singh General Manager TeS, Wipro Technologies 16