Test Management Leveraging SAP and HP solutions for effective testing SAP ITM - IT Management for Testing Ken Johnson SAP ITM VP Global COE
Legal disclaimer The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP. This presentation is not subject to your license agreement or any other service or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation and SAP's strategy and possible future developments, products and or platforms directions and functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this document is not a commitment, promise or legal obligation to deliver any material, code or functionality. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. This document is for informational purposes and may not be incorporated into a contract. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP s willful misconduct or gross negligence. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions. 2013 SAP AG. All rights reserved. 2
IT runs applications.lots of them Most enterprises run major software operations. wikis mobile apps ERP billing payments Embedded software PoS HR order entry inventory management supply chain website CRM 2013 SAP AG. All rights reserved. 3
And IT s success is dependent upon its agility wikis mobile apps Most enterprises run major software operations. ERP inventory management supply Business Agility Depends on Application Agility billing payments PoS HR (while reducing cost and risk) Embedded software order entry chain website CRM 2013 SAP AG. All rights reserved. 4
And when we don t get it just right.. Well, testing failures can get a lot of publicity.. Now, we can assume that before a very well known company released their latest map app they had tested it.. When consumers received it and tried to use the app they found flaws..overwhelming flaws in the output of the app.. Therefore we can assume poor testing contributed to the failure of this app and proper testing would have DISCOVERED these issues PRIOR to release 2013 SAP AG. All rights reserved. 5
Not upgrading In process of upgrading with Quality and Testing: representing a very relevant Area Major Cost and Time Factors During Upgrade or Implementation QA and Testing 75% 83% Change Mgmt. Planning Training and Doc. 16% 12% 30% Testing and coverage is the #1 stated pain point for all customers Over 86% of customers are concerned about risks due to lack of comprehensive testing 17% % Members Resource Mgmt. Complexity Project Schedule 7% 5% 0% Source: ASUG Test influence council member survey 2013 SAP AG. All rights reserved. 6 n=52 6 Complexity and timing are rated much lower compared to the rest
Testing impacting your overall IT Success Don t know what to test? Don t know how much to test? Manual testing Record / play-back expensive to maintain Scripting requires special skills Often fewer tests because of manual approach and related cost No assurance on coverage Maximize IT responsiveness to drive accelerated innovation Control and optimize IT costs Evaluate and control IT risk to ensure Business Continuity 2013 SAP AG. All rights reserved. 7
Effort Change is the only Constant Key Challenges when introducing a change to your landscape How to introduce technology change in timely and cost effective manner to support business needs? How to mitigate risks of technology changes to your business? How to keep TCO down and optimize resource utilization? New Processes Data Center Relocation. Consolidation. Upgrades Discrete Change Events New Implementation Support Pack Custom Dev. Transports Custom Dev. Custom Dev. Time Ongoing Change Events
How to Tackle these Challenges? Integrated Approach and Tools From complex ITM point solutions to an integrated approach to ITM Optimize Requirements Operate Design Optimize Design Build & Test Requirements Operate SAP ITM Build & Test Deploy Deploy Stand-alone, point solutions for different ITM phases with many system breaks Disparate and not consistent information for the entire lifecycle Hindering collaboration between phases and business and IT Gaps, disruptions through broken processes Proprietary, tool-centric approaches Integrated solution within and between all ITM phases High visibility and transparency Instant Collaboration between distributed IT (Dev./Ops.), business and partner teams Seamless and standardized end-to-end ITM processes based on best practices (e.g. ITIL) Holistic offering including support and services
Testing Architecture Leveraging SAP and HP solutions for effective testing New / Installed SAP Solution SAP Solution Update Business Blueprint Change Impact Analysis Test Planning Test System Setup Test Execution Change Deployment Solution Manager Business Blueprint Setup of business process hierarchy Business requirements Solution Manager Quality Center Test requirements Test planning Test Lab Quality Center Defect management SAP TAO Accelerated test case generation & maintenance Business Process Change Analyzer Identification of business processes affected by code / customizing changes SAP TDMS Setup of lean test systems Quality Center Business Process Testing Quick Test Pro LoadRunner Performance Tests 2013 SAP AG. All rights reserved. 10
SAP Quality Center by HP End-to-end quality management infrastructure The automated SAP Quality Center by HP gives you a disciplined approach to testing supported by tools and technologies that help quality teams organize their activities, automate where possible, and store and track results on a single platform. This allows you to diagnose problems before they occur. In a single Web-based console, you can see requirements management, test planning, building, scheduling, and execution, defect management, and project status analysis. 2013 SAP AG. All rights reserved. 11
SAP Test Acceleration and Optimization (TAO) 3 rd Generation Test Automation for a changed Environment SAP Test Acceleration and Optimization (TAO) software Changes the testing paradigm from manual testing to Testing by Composition and reduces costs and risks for testing after SAP solution updates As typical software changes affecting automated tests, e.g. customizing changes or custom code makes optional fields suddenly mandatory fields requires new mandatory fields, or even additional screens. Variant 1 Quotation Sales Order V1 C1 C2 C3 Delivery Goods Issue Billing X Test data Test execution fails Variant 2 Quotation Sales Order V2 C1 C2 C3 C4 Delivery Goods Issue Billing X Test data SAP TAO Test Components Customer benefit: SAP TAO provides accelerated repair functionality through rapid and semiautomated exchange of central test components 2013 SAP AG. All rights reserved. 12
SAP Solution Manager Adapter for SAP Quality Center by HP Goal Exchange of business processes, business requirements, test assets, incidents and test results between SAP Solution Manager and Quality Center SAP Solution Manager Adapter SAP Quality Center by HP Application Lifecycle Management capabilities to support configuration, operation and change of SAP-centric Solutions Outbound Business Blueprint Bus. Requirements Test Objects Documents Incidents/Defects Inbound Test Results Incidents / Defects Management of manual and automated functional tests based on business and test requirements 2013 SAP AG. All rights reserved. 13
SAP Solution Manager, Business Process Change Analyzer Business Scenario Order to Cash Quotation Sales Order Delivery Billing automated Test Case execute Process Step Sales Order Customer SAP Landscape (SAP ERP, ) create TBOM during test case execution Business Blueprint assign TBOM to Process Step Test Option Test Management Test Automation Tools 1 SAP Solution Manager Test Automation Framework HP QTP 2 SAP Quality Center SAP TAO, HP BPT, HP QTP 2013 SAP AG. All rights reserved. 14
SAP LoadRunner by HP Reduce risk of system failures at times of peak demand. LoadRunner offers rigorous load-testing functionalities that help organizations test softwaresupported processes before you go live or after an update and maximize the effectiveness of your enterprise software 2013 SAP AG. All rights reserved. 15
SAP Test Data Migration Server (TDMS) Set Up Test Landscapes Efficiently and Cost-effectively SAP Test Data Migration Server (TDMS) software can help to minimize infrastructure and maintenance expenses while maximizing the effectiveness and accuracy of your testing activities & development work The software can create small, easy-to-use test environments with consistent, relevant extracts of business data, and enables you to work on multiple IT projects in parallel PRD NetWeaver AS PRD Infrastructure QA TDMS NetWeaver AS NetWeaver AS Server QA Infrastructure DEV NetWeaver AS DEV Infrastructure 2013 SAP AG. All rights reserved. 16
Reducing defects and performance bottlenecks In short, we are now able to deliver high availability for our ERP applications, summarizes Michael Cooper, senior director of enterprise IT quality assurance for T-Mobile USA. 2013 SAP AG. All rights reserved. 17
Baker Hughes Achieves Huge Cost Savings, ROI, and Value by Automating Testing with SAP Software Company Baker Hughes Headquarters Houston, Texas Industry Oil and gas Products and Services Oilfield services Employees 57,100 Revenue US$19.8 billion Web Site www.bakerhughes.com The company s top objectives Provide a positive user experience globally, independent of location Ensure functional commitments of the application have been delivered Continuously improve quality and productivity while cutting time to market The resolution Established testing center of excellence in IT and strategic partnerships for delivery of testing services Implemented standardized testing processes, tools, and artifacts; established metrics and a continuous improvement program to prevent quality escapes Focused on high reuse and complex testing scenarios, taking a collaborative approach to involve all stakeholders including customers The key benefits Improved quality and reduced costs caused by poor quality Improved productivity and reduced cycle time Improved on-time delivery record Produced a superior user experience 25% Costs saved by resolving failures early 35% Less time required to plan and create test cases 60% Shorter testing cycle time Analyst studies have proven that defects are orders-of-magnitude cheaper to fix if caught early in the application lifecycle rather than late a big reason why the TCoE is saving us so much money. Faisal Asif, Director, Project Management Office, Testing Center of Excellence, Baker Hughes 2013 SAP AG. All rights reserved. CMP15871 (12/05) 18
Testing.. What is at stake? Your capability to deliver innovations to the business In time On budget With quality Ultimately, your reputation to deliver value to the enterprise 2013 SAP AG. All rights reserved. 19
Thank You!
The Oklahoma Publishing Company Hits the Mark with SAP testing solutions and services OPUBCO Communications Group Location: Oklahoma City, Oklahoma Industry: Media Products and Services: Multimedia Digital and Print Products Revenue: Private Employees: 1,300 Web Site: www.opubco.com SAP Solutions and Services: IS Media with SAP Testing: Quality Center, Load Runner, Accelerated Services. Implementation Partners: SAP Consulting with SAP Global Delivery, FocusFrame I cannot imagine trying to manage the defects, script testing or reports without this tool (Quality Center) has been invaluable to manage my team s progress Cyndi Mize Circulation Manager OPUBCO Communications Group Challenges and Opportunities Internal processes inefficiently executed across multiple legacy systems Push for new product development due to competitive environment Pressure to lower cost of ownership Existing software and hardware unsupported as of 2008 Objectives Improve processes and reduce costs Reduce risk current software and hardware unsupported Grow revenue increase circulation, improve cross and upsell, target advertisers Overall growth better position for growth through acquisition Implementation Highlights First implementation of full IS-Media solution in North America Quality Center kept 100+ project team members current on status of all testing activities and outstanding tasks Integration to existing, upgraded pagination system to automate information flow from CSR to the product printing Seamless cutover in a 24x7 environment for circulation, advertising and classifieds Why SAP Proven leadership and expertise in the Media industry SAP consultants seen as experts with SAP IS- Media solution Benefits The deployment and usage of the testing tool (Quality Center) streamlined the testing effort and provided real-time statistics to management Seamless information flow from advertising CSR to pagination for printing Lower IT risk through retirement of mainframe hardware and software applications Able to compress significant Service Pack upgrades into 4 weeks protecting go-live and creating a positive ROI 2013 SAP AG. All rights reserved. 22
SaraLee Reduces Risk After an Upgrade via SAP Test Acceleration and Optimization QUICK FACTS Sara Lee Corporation Location: Downers Grove, Illinois Industry: Consumer products Products: Coffee, meat, bakery goods Revenue: US$10.7 billion Employees: 33,000 Web Site: www.saralee.com SAP Solutions: SAP Test Acceleration and Optimization, SAP Solution Manager application management solution, SAP Quality Center application by HP, Implementation Partners: FocusFrame Inc. and Accenture With SAP Test Acceleration and Optimization, we ve reduced the number of issues found by our users after going live with an upgrade or software changes, which has boosted continuity and reduced risk. Joost Knoop Solution Architect Sara Lee Corporation Challenges and Opportunities Optimize core operations by upgrading to the latest version of the SAP ERP Application Ensure business continuity and meet quality objectives Perform sufficient functional and regression testing in tight time frame Objectives Reduce testing time and effort with automated testing solutions Find, fix, and centrally manager defects before software changes are used by the business Implementation Highlights Upgrade completed in 8 months across international IT landscape Partner built and maintained test scripts Why SAP Trusted solution provider Comprehensive test automation solution optimized for existing SAP Software landscape Benefits 80% reduction in the cost of comprehensive regression testing 90% decrease in the number of defects found by operations (after changes went into production) 70% reduction in test execution time Elimination of all critical defects before going into production More time and resources available to perform testing of 80% to 90% of critical functionality (up from 10%) and 80% of noncritical functionality 2013 SAP AG. All rights reserved. 23
CA uses SAP Test Acceleration and Optimization to Automate Endto-End Testing QUICK FACTS CA Location: Islandia, NY Industry: Application Software Products and Services: IT Management Software Revenue: 4.34B Employees: 13,700 Web Site: www.ca.com SAP Solutions and Services: SAP Quality Center by HP, SAP Test Acceleration and Optimization Implementation Partners: SAP Consulting, FocusFrame, Inc. In our organization, change is the only constant. I can t imagine how it would be feasible to maintain a complete E2E test bed without a robust tool like TAO and BPT to allow for quick mass modifications. Liza Galano Project Manager Challenges and Opportunities Need for regression testing around major releases or during the application of support packs Inadequate manual testing; processes not tested within project timeframes Prior automation approach of using recordand-play not scalable to changes Objectives Decrease costs of using contracted employees to do testing Decrease internal testing costs for the business users Reduce time of E2E test cycles Improve end user and customer satisfaction Increase accuracy and efficiency by reducing human factor and increasing automation Increase test coverage Implementation Highlights Automated 40 test cases during pilot Discovered that out of 1,231 test cases included in E2E, only 211 were unique After completion, 62 E2E test sets will be included in test bed against SAP ERP, SRM, and Portal for future releases Why SAP SAP TAO works with complete testing toolset (QC, BPT, QTP) that we already use Cost-effective solution Offers best of breed software Benefits Decreased external contractor costs Easier to maintain in a rapidly changing environment Relieved business users from out-ofscope testing duties Testing is more consistent, accurate and efficient Broadened testing scope and shortened testing cycles Allows for more frequent deployments CA 2013 SAP AG. All rights reserved. 24
ConAgra Foods leverages SAP Solution Manager, SAP Quality Center and Test Acceleration and Optimization ConAgra Foods QUICK FACTS Location: Omaha, Nebraska Industry: Consumer Foods Group Products and Services: Healthy Choice, Chef Boyardee, Egg Beaters, Hebrew National, Hunt s & Banquet and others. Revenue: US$11.6 billion Employees: 25,000 Web Site: www.conagrafoods.com SAP Solutions and Services: SAP ECC 6.0, SAP SCM, SAP SRM, SAP SEM, SAP NetWeaver BI, SAP Solution Manager, SAP TAO, SAP Quality Center Partner: SAP Consulting, FocusFrame By implementing SAP Solution Manager, HP Quality Center and the SAP Test Acceleration and Optimization application (TAO), we have increased our ability to complete Testing on-time and with much higher quality Kevin Needham Director Information Technology ConAgra Foods Challenges and Opportunities Testing was manual and labor intensive Conversion of critical business process manual test cases into automated scripts leveraging SAP Test Acceleration and Optimization Implement automation as efficiently as possible with a pre-selected group of teams to include P2P, OTC/OIR, RM, FI and ALM. Objectives Increase the quality of testing through automation of pre-existing test cases Decrease the amount of time and resources required for testing while increasing quality Implementation Highlights Implemented automation for parts of 3 super macro processes included in ConAgra s end-to -end integration test phase Increased the amount and quality of testing that could be completed within approved test cycle timeframes for unit, scenario and integration test phases Why SAP The SAP Test Acceleration and Optimization application allowed us to implement a test strategy that didn t require an overly technical team to automate critical business processes The SAP TAO allowed us to automated tests quickly and efficiently with less maintenance than standard record and playback automation Benefits Automated majority of End to End test cases Decreased test execution time for teams that have automated test scripts Automation has helped process teams to meet very aggressive schedules and produce quality releases using fewer resources Enhanced ability to implement quarterly releases and multiple plant rollouts with confidence, high quality and on-time 2013 SAP AG. All rights reserved. 25
Levi Strauss & Co. Goals Integration of Tools and Information Central Repository of Project Information Requirements Traceability and Scalability Comprehensive Testing Visibility of Scope Managing Change Reduce Risk Tight Timeline Collaboration between Business and IT Results A global leader in Jeanswear and Khaki wear Based in San Francisco, California, with approximately 14,000 employees world wide 2010 net revenue of $4.4 billion Products sold in 10 countries, in 55,000+ retail locations, in over 1,500 brand-dedicated stores Production in 55 countries with 750 contractor factories Implemented foundational technology / processes for global brand management Implemented globally aligned business processes for Finance/Controlling, Sales/Distribution, Production Planning and Procurement Implemented Global SAP (AFS) in 22 countries Development of 400 RICEF objects, including rebuilding of key processes as well as a huge technology uplift / infrastructure sizing Solution SAP Application Visualization by irise SAP Enterprise Modeling by IDS Scheer SAP Document Access by OpenText SAP Extended Diagnostics by CA Wily SAP Quality Center by HP premier Edition Integrate Performance Center, Dashboard Reporting, Integrate uperform, Integrate ITSM SAP TAO 2013 SAP AG. All rights reserved. 26
Linde Gas Goals Demonstrate new portal components is capable of handling anticipated loads Results National Grid is an international electricity and gas company, and one of the largest investor-owned companies in the world. Resulted in a 1,700% improvement system performance Afforded risk avoidance Solution SAP LoadRunner by HP 2013 SAP AG. All rights reserved. 27