Europe s Premier Software Testing Event Stockholmsmässan, Sweden Testing For Real, Testing For Now A Visual Approach to Risk-Based Integration Testing Neil Pandit, Sopra Group, UK WWW.EUROSTARCONFERENCES.COM
A Visual Approach to Risk Based Integration Testing Neil Pandit npandit@uk.sopragroup.com +44 (0) 121 506 9180, +44(0) 7917 655939 T A L E N T E D T O G E T H E R Unissons nos Talents 2
Agenda What is Risk Based Testing? Misconceptions and problems with RBT Heatmaps A potential solution Considerations and Challenges Other uses of Heatmaps Summary 3
What is Risk Based Testing? Business Requirements Technical Architecture Functional Specification Technical Design Component Specification Component Integration Component Testing Integration Testing Acceptance Testing 4
Misconceptions and Problems with RBT Misconceptions Variety of interpretations on objective of RBT RBT can be independent of order of software delivery No high severity defects will be found in later phases Problems Obtaining objective risk assessment of multiple integrated systems Focus tends to be on systems and not interfaces Reporting does not focus on risks mitigated but on numbers of scripts executed 5
Heatmaps what are they? Heatmaps represent information visually using colours Weather forecasts, stocks and shares, swine flu infections 6
Heatmaps How to use them in Integration testing Broker Sales Creation MQ Intranet Internet Manager Policy and Client Converter Marketing Customer Database Client Printing & Distribution Policy Printing Policy Management 7
Heatmaps Prioritisation of Technical Risk Broker Sales Technical risk Creation MQ Intranet Internet Manager Policy and Client Converter Marketing Customer Database Client Printing & Distribution RBT Priority Critical High Policy Printing Policy Management Medium Low 8
Heatmaps Prioritisation of Business Processes Critical Business Processes Broker Sales Creation MQ Intranet Internet Manager Policy and Client Converter Marketing Customer Database Client Printing & Distribution RBT Priority Critical High Policy Printing Policy Management Medium Low 9
Heatmaps Prioritisation of Business Impact Business Impact Broker Sales Creation MQ Intranet Internet Manager Policy and Client Converter Marketing Customer Database Client Printing & Distribution RBT Priority Critical High Policy Printing Policy Management Medium Low 10
Heatmaps Mapping of Technical Risk & Business Impact Business Impact Critical High 2 1 Medium Low 4 3 Low Medium High Critical Technical Risk 11
Heatmaps Combined Mapping of Technical Risk & Business Impact Broker Sales Creation MQ Intranet Internet Manager Policy and Client Converter Marketing Customer Database Client Printing & Distribution RBT Priority Critical Policy Printing Policy Management High Medium Low 12
Heatmap Benefits? Highlights the RBT approach visually Provides ease of understanding for all Stakeholders Incorporates technical risk into test design Provides Risk Based reporting against specific interfaces & systems Ability to agree coverage levels for each risk priority 13
Considerations and Challenges Obtaining full buy in and getting Subject Matter Experts away from their day jobs Understanding impact of IT driven processes Agreeing organisational business impact Ensuring use of up to date system architecture diagrams Lack of availability of fully integrated test environments 14
Other uses of Heatmaps Can be applied to prioritise Testing Prioritisation of defect fixing Regression Testing prioritisation Reassessing RBT for Incremental developments 15
Summary RBT - different things to different people More effective focus of Integration testing effort Heatmaps - a visual approach Combines technical risk with business impact Ensures common understanding Needs full buy in! 16
Questions? 17
Thankyou 18