Comprehensive QA testing for SAP and non-sap apps David Milette President and Managing Director, SQALogic

Comprehensive QA testing for SAP and non-sap apps David Milette President and Managing Director, SQALogic

KEY LEARNINGS How to assess your current state of QA and test automation readiness How to develop a plan that will optimize test automation, people, and processes What advanced QA tools can be used to add more value to your SDLC platform How to develop and maintain high levels of regression testing needed How to quantify the value of these solutions for your business

BEST PRACTICES Enable more people within your organization to create and maintain tests Leverage the people who know your end-toend business flows Create comprehensive, meaningful use tests that help you optimize quality and delivery

Polling Question 1 What are the top challenges you face in app delivery/testing? Keeping test cases and data up to date Understanding what to test Shortening test cycles to speed up releases Not enough resources (people and/or budget) Test tool application support

Top QA Challenges *TurnKey Survey, March 2015

The Release Cycle Faster release cycles shorten the gap between what the customer wants and how quickly you are able to deliver. Development Delivery Testing is typically the #1 time sink in the delivery process. Feedback

Usable Automated Tests (%) Automated Test Half-life 100 80 60 40 20 Initial test scripts Script effectiveness w/ each new release 0 1 2 3 4 5 6 7 Change Cycle

The Quality Trade-off TIME COST QUALITY This requires getting smart about what you test and how you execute your tests!

Assessing the Testing Landscape Identify the Necessary Testing Resources What skills does your team have? Can you hire more resources? Can you share/integrate roles & responsibilities? Assess Current Processes Are we able to do all the testing needed on time? What interaction does your testing team have with business analysts today? Do you fully understand what you should be testing? Evaluate Current Tests What do your current tests do? How are they written and do they cover what they should cover? How stable is your application? Assess Test Tools How and where do you organize your tests? Do you have an automated test tool? Do you use it? How often?

Organizing for Success Everyone on the team must be familiar with the release in a quality delivery model. Business Analyst App X Test Manager/Director Test Lead XYZ Division App X Test Architect App X... Developer App X Test Automation Engineer (TAE) App X

Test Architect Test Engineer Test Lead Business Engineer Day in the Life Test Planning Test Design Test Execution Document Functional / NFR / BPM Requirements Participate in Test Design Review Participate in Test Data Sheet Input Participates in Requirements Review Identifies / Mitigates Test Risks & Issues Coordinates Test Estimates Determines Component need / mods Assembles Test Scripts / Input Data Sheets Input Data / Coordinates with BA Monitor Test Execution Executes Test Scripts Report Test Progress / Defects Create / Retest Defects Creates Components SME for Project Implementation & Support Component Maintenance Documents Test Strategy & Standards Assists with Test Estimates Verifies Test Artifacts / Compliance Provides Test Direction to Tester

Comprehensive End-to-End Test Mgt Identification of high risk transactions Pinpoint available test assets & gaps Continuous testing Fully integrated with test management platform (SolMan, HP ALM) Change Mgt Test Mgt Test Execution Test Creation Data-driven workflows Test labs with guided manual testing Business critical processes Reusable content library Test automation tools

Impact-based Testing

What Should You Test? Regarding the application(s) under test, answer these questions: What areas of my application are most affected by change? What areas of my applications are most in use? What types of issues are escaping the testing process?

Defining What s At Risk Relationship to Change Usage

What Should You Test? Regarding the application(s) under test, answer these questions: What areas of my application are most affected by change? What areas of my applications are most in use? What types of issues are escaping the testing process? Which business processes cause the company to lose money? Which business processes cause the company to lose business? What are the processes that your business runs every day? Your tests should reflect a Meaningful Use of your System

Defining What s At Risk Relationship to Change Usage Risk Business Critical Objects

Pinpointing What s Most At Risk 3500 3000 2500 2000 1500 1000 500 0 1222 968 85% Reduction in Scope 1930 1302 156 323 Used Impacted Recommended Most-at-risk Custom Standard

Test Creation & Maintenance

Auto-create test assets As easy as clicking on your application screens Please note: - more details on this solution follow at the end of this presentation

Auto-create test assets Drag-and-drop assets together to create automated scenarios

Execute End-to-End Business Flows Requisition Requisition Summary Requisition Excel Workbook Status Date Range Test Scenario 1 Status Status Source Sourcing Delivery Test Scenario 2 Date Range Sourcing Delivery Related Related Docs Docs Details Te s t m o r e o f y o u r a p p l icurrency ccurrency a t i o n w i t h f e w e r s c e n a r i o s w i t h o u t w r i t i n g c o d e Related Docs Req Summary Source Details Currency Requisition Test datadriver Test Scenario 3 Test Scenario 4 Test Scenario

Identify and Update Tests Automatically Dramatically reduce your maintenance effort

Measuring Value

Value from Automation Tests Planned Tests Executed Percent Tests Executed Tests Passed Percent of Executed Tests Passed Percent of Executed Tests Failed Percent of Planned Tests Passed TOTAL 5514 5306 96.23% 5222 98.42% 1.58% 94.70% Automating business critical scenarios gives confidence in product quality Regression test sets build over each release With test automation you can measure the time to release savings With automation, you can free up experts for the most business critical tasks

Use Customer Feedback in the SDLC Process Measure escapes from each release Support Tickets User Forums Customer Satisfaction Survey Customer Advisory Boards

What This Means in Time/Cost Savings POC - 14 T-codes Traditional Script-based Testing Scriptless Testing Prep Libraries Re-useable Assets 28 Hrs Keywords Re-useable Assets 50 Hrs Creation 70 Scripts (3 Hrs per Script) 210 Hrs 14 Test Cases (1 Hr per Script) 14 Hrs Maintenance ~30% of Total Scripts ~21 Scripts 3 Hrs per Script 75 Hrs 5:1 ratio ~4 Scripts 4 Hrs Total Savings: 313 Hrs 68 Hrs

Quality and Value COST TIME QUALITY By combining the right mix of people, processes and technology to delivery higher value to your business!

Questions?

Thank You! To schedule a personal demo, contact: sales@sqalogic.ca For more information on TurnKey Solutions, visit: www.sqalogic.ca For news and updates, follow us on: Twitter: @SQALogic

About TurnKey Solutions Founded 1992, HP/Mercury technology partner since 1995, HP OEM Partner since 2012 Privately held, HQ in Denver, CO with offshore operations in India Global presence growing customer presence across all continents Our automated testing solutions are built exclusively on the industry leading HP ALM technology stack Scriptless automated testing enables broad use for hundreds of application types using a common set of tools, by business users, TCOE s and QA experts

Our Solutions Automate the Automation Automatically creates and maintains test automation Uses data-driven technology to enable users to create test flows covering all possible test scenarios Automatically identifies the changes in your applications and provides rapid, intelligent test case updates Fully leverages your current investment in HP automated testing platform. Existing test script libraries can continue to be used. Provides for a common set of tools to automate all applications.

TurnKey Solution Product Family Scriptless Testing Accelerator Packages An automated, programming free BPT Components generator that works with any application supported by QTP/UFT. A comprehensive library of prebuilt BPT components and test cases ready for fast and easy implementation. Impact-based Analysis Dynamic Impact Analysis and Testing Leveraging HP ALM.

TurnKey Accelerators The Accelerator Packages consist of pre-built, cfactory-based BPT components and critical business process test cases BPT Component Library BPT Based Test Case Library

TurnKey Accelerators Dramatically accelerates time to automation and ROI Traditional Test Automation Time to Value Accelerator Time to Value

cfactory - Data Driven Architecture cfactory s datadriver automatically builds a formatted Excel workbook

cfactory - Auto-updates Test Sets Dramatically Reduced Test Case Maintenance Effort

cfactory - Auto-maintenance View cfactory helps you see and understand the changes

TurnKey Delivers Exceptional Business Value Faster (Time) Enhances business agility with faster responsiveness to change Provides a faster time to value our automated test platform can often be implemented within 8-16 weeks Better (Quality) Expands your automated test coverage 100%-500% greater test coverage Deeper and broader application coverage Reduces errors from manual testing and programming Cheaper (Cost) Reverse the growing bite that testing takes out of your IT budget Reduce IT resource requirements e.g. one customer has 11,000 automated tests managed by 1 SQA tester Significantly reduces test maintenance which can represent up to 80% of project time