Building an Enterprise QA Centre of Excellence Best Practices Discussion 2015 IBM Corporation
Objectives Pleased to take this opportunity to present the Enterprise QACoE The objectives of the session are to: 1. Share our specialized Enterprise QA operations Best Practices 2. Framework to standing up a specialized Enterprise QACoE 2 2015 IBM Corporation
Quality Assurance Strategy extends the business value beyond traditional quality initiatives CIO CXOs Quality Next level in the progression Covers IT & Business Operations Focused on removing defects instead of identifying them : Progressed from project up to E2E Process Focused on Defect Identification SDLC Quality Less Early Reduce Defects Application E2E Process Enterprise Integrated Quality Operational Quality Process Categorize, Monitor, Improve Activity Project Task $M s opportunity 3 2015 IBM Corporation
Intake Intake Metrics and Reporting Metrics and Reporting Intake Metrics and Reporting There are many QACoE operating models, IBM believes a successful model needs to balance quality with testing Client/IBM Best Practices, Assets Business Goals, Standards Operations/ Infrastructure Services Quality Services Quality Competency Instill a culture of quality Community / Governance Measurement and Metrics Knowledge Operation Tools Environment Services Factories Virtual services Automation components as a Services Defect Analytics and Reduction Code Analysis and Reporting Performance Engineering Case Optimization QA Deployment Coaches Agile Mobile Delivery Portfolio 1 Portfolio 2 Portfolio 3 Capabilities Excellence in testing Delivery Requirements Verification Planning Design Requirements Verification Execution Delivery Operation Configuration Planning Automation Design Execution Data Requirements Verification Operation Performance Configuration Automation UAT Execution/Support Planning Design Execution Data Performance UAT Support Operation Configuration Automation Data Performance UAT Execution/Support 4 2015 IBM Corporation
QACoE QA Centre of Excellence (QACoE) will bring leading test practices for more efficient and cost effective testing Centrally organized and governed QA group Common approach to testing practices Common approach to test automation tools Provide the right testing skills at the right time Continuous improvement of testing quality Common approach to QA metrics 5 2015 IBM Corporation
QACoE will define the QA strategy and the direction for test delivery Build the foundation for the QA Center of Excellence (QACoE) Engagement Work Quality Assurance Center of Excellence Consistent Approach Roles and Responsibilities Methods, Tools, Techniques, Best Practices Continuous Process Improvement Services Delivery Program Risk Integrated QA Delivery Functional Automation, Regression Performance Multi-Platform for Culture of Metrics Enhance operational processes Productivity Capability Baselines CMMI Processes Learning from Projects Specialized skills Ongoing Training Tools R&D 6 2015 IBM Corporation
> QA and Center Of Excellence mandate should be aligned to the Enterprise Business Goals and Quality Objectives for highest ROI Delivery Excellence through a culmination of Standard Framework, Processes and Tools strengthened by a strong Governance mechanism and Industry Best Practices to provide a wide variety of Service Spectrum System / Development QA C e n t e r O f E x c e l l e n c e Service Spectrum System Integration testing Regression Automation UAT Infrastructure & Tools COE Tool Maintenance & Support Automation Tool Implementation Tool Provision > Planning & Estimation Data Program Center of Excellence Knowledge Metrics Defect > Process COE Process Maintenance Process Definition Metrics Program Induction Program and Process Training Continuous Process Improvement Best Practice Design & Build Execution & implementation Core Flexible resourcing Standard process & Frameworks Common Tools, Infrastructure & Automation Solution Accelerations/ Best practices Governance structure 7 2015 IBM Corporation
Enterprise Application Terminologies Assess - Planning Design Execution - Reporting Unit testing Systems integration Functional testing Regression testing Integration testing User acceptance System testing Operability testing Basis & Security testing Performance testing ABAP Code testing Volume testing Portal testing Load testing support processes Delivery Excellence Tools Rational Functional er, Rational ClearQuest Manager, Rational ClearCase, Winrunner,, Silk, QArun,, App Virtualization Usage & Procedure Logging [UPL], Business Process Change Analyzer [BPCA], Scope Optimization [TSO], Transaction Bill Of Materials [TBOMs], Component Based Automation [CBTA], Data Container [TDC] How are the tools used? Automation of Integration test cases, structured test case management, defect management, traceability metrics analytics, accurate usage depiction, test data collation and parameterization Roles manager architect Defect specialist tool specialist Metrics: Systems engineer Business and technical tester automation specialist Activities Review & Approve plan and test cases Execute Integration test cases as planned Verify test coverage by updating the Requirements Traceability and Verification Matrix Conduct defect analysis Complete a test report Performance engineer environment specialist Performance test specialist Cost and schedule variance, defect, productivity, efficiency and test coverage metrics When/ Where measured? Defect metrics and test case metrics will be measured during the execution. Improvement metrics will be measured after integration testing is complete. Measuring usage in Production to show actual business impact and mitigate risks possible 8 2015 IBM Corporation
Sample Proposed QACoE Organization Structure Program Control Office QACoE Champion QACoE Manager QACoE Metrics Architect Leads Business Leads Automation Type 1 Specialists Data Manager Data Analysts ers Business SMEs Automation Type 2 Specialists Infrastructure Prime Performance Engineers Service Virtualization Configurator Tool Specialist Environment Specialist Legend Client resource Vendor resource Client / Vendor resource 9 2015 IBM Corporation