World Quality Report

Transcription

1 World Quality Report Fifth Edition Mark Buenen Capgemini TLI Testing

2 Report Demographics A Capgemini, Sogeti & HP Publication Global trends in the Testing & Quality Assurance space Fifth edition to be released in September, 2012 Analysis based on 1,500 phone interviews Only companies with 1,000 or more employees participated in survey. Respondents are a controlled mix of CIOs, VP Applications, IT Directors and QA/Testing Managers. Vertical and country controls were also used to shape the targeting of the study to enable us to have sufficient data for sturdy analysis levels along those controls Sample characteristics kept similar for year-onyear statistical comparisons 2

3 World Quality Report : Interviews by Region WQR based on 1,500 telephone interviews across 25 countries. Each structured interview lasts minutes Interviewees asked up to 42 multiple choice questions depending on job function In WQR report, data combined with quotes / open ended responses from 20 in-depth interviews 3

4 World Quality Report : Interviews by Job Title Sample: companies and other organizations with more than 1,000 employees. 34% of interviews were conducted with CIOs, 26% with IT directors Survey sample size and composition designed to be similar to last year s survey to allow for data trending 4

5 World Quality Report : Interviews by Sector 5

6 Key research topics QA Budgets Transforming the Test Organization Mobile Testing Cloud Computing and Testing Testing in Agile Development Test Infrastucture and Test Data management 6

7 QA Budgets: Continued Growth, Shifting Priorities 7

8 Continued Growth of QA Budgets from 2012 Through 2015 The average spending on Testing within IT budgets is increasing 8

9 QA budgets are still largely spent on infrastructure 9

10 The share of transformational projects continues to grow Testing of existing applications can be performed more efficiently and at lower costs using automation tools and reusable assets 10

11 Transforming the Testing Organization 11

12 Rapid rise of the Test Centers of Excellence 12

13 Adoption of Managed Testing Services is on the rise whilst number of in-house testing practice decreases DATA POINT: 46% of executives interviewed choose to outsource at some part of their testing. Of these, - 57% of them cited cost reduction as the main reason - 50% from being able to free up internal resources to focus on core business functions. 13

14 QA organizations are still mostly capturing IT based, reactive performance metrics 14

15 Mobile Testing: A Shift from Tools to Methods 15

16 Organizations across all sectors show considerable increase in mobile testing. More than half Organizations of all organizations across all interviewed sectors show (55%) have now test mobile applications considerable compared increase to in an mobile industry test average of 31% in last year s ing research. 16

17 The barriers to successful mobile testing have shifted from tools to methods 17

18 Organizations focus their testing efforts on mobile apps performance, security and functionality 18

19 Cloud: Taking a Considered Approach 19

20 Cloud adoption is slower in the near term, but poised for future growth 32% of applications are expected to be tested in the Cloud in

21 Performance testing ranked highest when validating SaaS applications Growing demand for testing of Software as A Service applications 21

22 Testing application migration to the Cloud Organizations prioritizing data security requirements and risks 22

23 Testing in the Agile Development Environment 23

24 Most organizations don t have a specific approach to testing agile projects They are adapting testing methodologies based on waterfall development models 24

25 Most of the executives cite a lack of an adequate agile testing approach as a major concern 25

26 Test Infrastructure and Data Management: Building Environments to Ensure Quality 26

27 Majority of organizations maintain and use a permanent testing environment 27

28 More than half of organizations state having to maintain multiple test environments as a significant challenge 28

29 Organizations still find it challenging to control and retain test data 29

30 Fitting in test environment management 30

31 World Quality Report : Recommendations Improve reporting of business-oriented metrics to demonstrate the value of QA Key metrics with baseline Establish a specialized function for mobile testing Methods, Skills & Tools Make greater use of the Cloud for testing Software testing as a service, tools Establish test environment and test data management practices Test environment mgmt office Integrate testing into agile projects Secure coexistence of methods rather than competition 31

32 You can now benchmark your own organisation against WQR findings mywqr2013 Available to download from the App Store Requires ios 6.1 onwards, compatible with ipad Provides a subset of questions from the research carried out for World Quality Report which you can answer then see how your responses compare to the global survey results 32

33 Thanks for your time! Insert contact picture Mark Buenen VP Business Development Capgemini TLI Testing Me and my colleagues looks forward to discuss testing further with you here today or in a near future. Thank you! 33