A journey to testing excellence. October 2015

Transcription

1 A journey to testing excellence October 2015

2 International Paper Overview International Paper s vision is to be one of the best and most respected companies in the world. Our Key Drivers People Customers Operational Excellence Sustainability 2

3 A Global Leader in Packaging, Paper & Pulp 3

4 Global Business Overview 4

5 Recent Recognition! 5

6 Applications Services Profile 6

7 Background Business Demand Increase release frequency Increase test coverage Legacy Platforms Impending retirement of Lotus Notes Test management Document management Change requests Sustainability Re-usable test assets Real-time reporting Ease of use Governance 7

8 Delivery Acceleration Sustain Improvement Improve quality, efficiency, speed of business, and cost performance Improve processes in the areas of people, process and technology Business Demand Platform Capability Sustainability Governance Release Strategy Document Management Test Management Change Impact Analysis Automation Speed to Market Cost Savings 8

9 Test Management Overview Tool Description Capability Soldoc SAP Solution Documentation [Solution Manager] Document management HP ALM HP Application Lifecycle Management Test management HP UFT HP Unified Functional Testing Test automation tool SAP TAO SAP Test Accelerator and Optimizer Automation accelerator BPCA Business Process Change Analyzer [Solution Manager] Change impact analysis HP BPT HP Business Process Testing Test methodology Adapter HP Quality Center (QC) Solman Adapter ALM / Solman Integration HP QC SolMan Adapter Testers HP ALM v12.01 Release Mgmt Requirements Test Plan Test Lab Defect Mgmt HP UFT v12.02 GUI API HP BPT Functional Automation SAP TAO v3.05 Soldoc Solution Manager BPCA HP Load Runner Performance GUI: Graphical User Interface, automated testing API: Application Program Interface, automated testing 9

10 Delivery Sustain Acceleration Improvement Release Strategy Documentation Test Management Change Impact Analysis Automation 10

11 Alternate Release Strategy Monthly Releases Weekly off-release eliminated Automation used to support a 12.5 day regression test cycle for each release Exception process for priority moves and emergency break/fix Releases & cycles managed in HP ALM Daily Releases Emergency Unplanned Year-End HR Support Packs Weekly Releases Break-Fix Priority Move Technical Releases Tech Upgrades Monthly Outages Hardware / OS Maintenance Monthly Releases Enhancements 11

12 Delivery Sustain Acceleration Improvement Release Strategy Documentation Test Management Change Impact Analysis Automation 12

13 Solution Documentation in SAP Solution Manager Central, focused, up-to-date, and easy to understand process documentation Business process documentation Storage of technical objects Integration to HP ALM Process Steps Programs Configuration Requirements Process Models Functional Specs Design Docs Cutover & Conversion Solution Manager HP ALM Requirements Coverage 13

14 Solution Documentation Test requirements are documented within the solution Test requirements Transactions, configurations 3 level hierarchy Scenarios Processes Steps Test requirements automatically transfer to HP ALM 14

15 Delivery Sustain Acceleration Improvement Release Strategy Documentation Test Management Change Impact Analysis Automation 15

16 HP ALM Overview Quality management tool used to establish consistent, repeatable processes for managing requirements, tests, and business components SAP Application Lifecycle Management Solution Manager Business Blueprint Planned Functionality Changes Requirements Releases Test Plan Test Lab Defects Test requirements Releases & Cycles Releases Test scripts & components Test sets & execution Defect tracking & reporting Test Requirements Cycles Test Scripts Test Configurations Test Sets Solman / ALM Adapter Test Instances Test Runs 16

17 ALM Test Requirement Example Requirements in ALM Test scripts link to requirements for coverage Requirements pass when all linked test scripts pass Full requirements traceability for changes Test requirement transferred in from Solution Manager 17

18 ALM Reporting & Project Status Example of a project scheduled to be released in November Defect Tracking and Status Execution Progress Defect Opening Rate 18

19 Delivery Sustain Acceleration Improvement Release Strategy Documentation Test Management Change Impact Analysis Automation 19

20 Business Process Change Analyzer / Scope & Effort Analyzer Impact analysis of software changes on business processes Test scope optimization with reduced test scope and test effort Transparency about change impact of enhancement packs before physical installation Tailored impact analysis for custom code and modifications Custom Development by Impact Categories (targeted retrofit) Clones with changed SAP references Custom code using changed SAP functions Custom code using changed SAP references Custom code using obsolete SAP functions Clones with changed SAP original % test coverage reached Manual effort avoided Business Process Steps (nodes) impacted by change 20

21 Delivery Sustain Acceleration Improvement Release Strategy Documentation Test Management Change Impact Analysis Automation 21

22 Motivation for Automated Testing Manual Testing Pre-DASI Automated Testing Limited time results in insufficient coverage High risk of defects High cost in repetitive tasks Reliant on SME s who understand the business process, not always available or allocated for testing Faster, more frequent test execution Increased test coverage and accuracy Productivity gains through focus on value-add activities; increased test efficiency Pre-built test sets define steps and data upfront; quick on-boarding, reduced need to pull in business resources 22

23 Automation Usability Simple test execution for non-technical testers Rich and visual test logs to support validation Ease of use when combining manual and automated scripts together in test sets Limited developers to support a large deployment Test composition using pre-built components Data driven scripts; separation of data and test logic 23

24 Using Automation Across Environments Role based security for each test Scripts used across environments simply by changing the login

25 Automated Regression Testing Global Supply Chain critical business processes tested with each release 1,384 regression test scripts, 15 end-to-ends, 74% automated Execution in as little as 7 days (12.5 days allotted) Major functionality tested across all lines of business # End-to-End Business Process Test Sets Automated Manual Total 1 Domestic - MTO Rewind Rolls Domestic - MTO Skids Return Orders MTO_MTS_Rolls_Cartons or Skids Export - Port as Plant ZKE Consignment MTO Rolls Extruding - Enhance DPR - Riegelwood to Prosperity - MTO Rolls Extruding - Third Stage Rewinding at Texarkana Export - Port as Plant - Riegelwood MTS Bale Pulp (Containerized Shipments) MTO Outsourcing Rewinder Bundled Rolls - Mill to Outsourcer to Customer Domestic MTS Replenishment Case to Box Plant Manual VMI Sales Orders MTS Replenishment (Skids_Cartons) from Mill to RDC to Customer Replenish MTS to DC using PReqs and receipt Replenish Outsourcing MTS Pallets - (Mill to Outsourcer to RDC) QTA Rolls Domestic - MTO Trade Sales (ZTRD) Mill to Customer MTS Replenishment (Rolls) at Mill Shipping to Customer

26 Considerations Technical Infrastructure Support and compatibility for all applications Vendor collaboration Server sizing Licensing End User Evaluation Internal users (domestic, regional, remote, etc.) External access required (consultants, third-party vendors) Localization requirements (multi-language support) Training Decentralized internal training program End-user documentation readily available 26

27 Next Steps Continue implementation rollout to additional teams and regions Increase use of native ALM reporting and dashboards Refine Solution Documentation to improve change impact analysis Increase automation footprint 27

28 Q & A 28