Welcome to the Testing Stream. Sponsored by:

Transcription

1 Welcome to the Testing Stream Sponsored by:

2 Test Automation at Richemont Dierk Hoeft Isabelle Bour Birmingham, November 2013

3 Agenda Test automation Context Objectives The Solution Our project Technical solution Night scheduling Benefits Questions

4 Context of the project Test Automation CONTEXT OF THE PROJECT

5 Richemont Organization

6 The Maisons

7 Use of SAP at Richemont Strategy Foundations Favor Integration and Use of SAP Components Avoid Interfaces and Replication whenever possible 4 Tier Landscape Central Master Data Management for Articles and other key master data objects Central Governance

8 Technical Context & Change Management Scope of applications SAP applications : ERP, Planning and WMS Web applications : Usage for B2E, B2B and B2C Java applications : POS System System frequently modified and extended Regular Bug Fixing -> daily risk Maintenance cycle -> every 15 days risk Additional Enrichments -> every 6 months risk Support Packages -> every year risk Yearly Upgrades -> every year risk

9 Objectives OBJECTIVES

10 Objectives of Test Automation Project Limit the risk of regressions, avoid impact on Operations Improve reliability of overall Solution Limit effort linked to manual Testing

11 The solution, the tools THE SOLUTION

12 Our Test Automation Project Proof Of Concept 3 machines Deployment 5 machines 70 hours of daily lights-out testing 2013 Industrialization 10 machines 140 hours of lights-out testing 2014 Next steps + 20 machines hours

13 How? 2 Tools : SAP Solution Manager for Test Management Worksoft Certify for Test script Solution Manager Test Management Test Plan Test Package Tester Assignment Test Configuration Certify Test script - Generation - Execution

14 How?

15 Test Management Approach Project Template Project Central documentation Test Plan Test Package Test Package Teams Business area Test plan Test Package n Manual Test cases n Automated Test cases Data set Upgrade, Roll out, Maintenance, Enhancement Projects Session of Tests IT tests, KU tests Test Configuration n Variants Tester

16 Test configuration 1 Automated Test cases Test Plan 1 script Steps of a process For example 30 materials Test Configuration Scenario Process Flow Where process is executed 1 System n Variants Data of automated test Test Data Container 1 Test Data Container n For example 20 customers

17 What do we test? HTML UI End to End processes Cross applications User simulation Data stored and managed in Solution Manager Script stored and managed in Certify SAPGUI HTML SAPGUI HTML Application Java

18 Where? Config. D Config. V Config P Dev QA PreP Prod SAP APO Dev ERP QA ERP Pre-Prod ERP Prod ERP SAP Portal D SAP Portal Q SAP Portal V SAP Portal P

19 When? For Regression Tests Every night Unattended tests 10 machines For Projects On demand Until success During the day Dedicated data / Variants

20 Infrastructure Central access to machines Scheduler Autotest Autotest Autotest Autotest Autotest Autotest Autotest Autotest _06 Autotest _01 Autotest _02

21 Test automation process Lights-out Testing 4 PM 8 AM Video - Log collectif depuis slm.avi Notification Test Plan Owner Test Package Owner Tester assigned Test Automation Team Other Teams Business Consultant Analysis Status Report Solution Manager & Certify Viewer Damaged Message Correction of Script Test Message Communication

22 Benefits BENEFITS

23 Test Types and Use of Test Automation (TA) Potential Saving of at least 2800 MDs / year Change Type Risk Manual Test Effort per Year Target TA Coverage in % Saving in FTE Bi-Weekly Maintenance Support Medium 2000 MDs 80 % 7.3 Bi-Annual Release Enrichment High 2400 MDs 30 % 3.3 Annual Upgrade Upgrade Very High 750 MDs 30 % 1 Projects Rollout Medium 2400 MDs 10 % 1.1

24 Benefits of Test Automation Risk Mitigation by Permanent Unintended Test Execution Issues are detected before they are reaching production Automation increases reliability Saving by Reduction of Manual Test Effort Increased Coverage of Complexity More Variants are possible Scenarios with very high complexity can be covered

25 Benefits of Test Automation Speed of Test Execution and Coverage Important for time critical Projects Schedule can be easily adjusted Improved Quality of Project Delivery Test Automation allows to efficiently prepare Test Phases Resources can focus on Manual testing of complex Flows, Training and Change Management

26 Questions? QUESTIONS, COMMENTS?