The World Quality Report How does your organization compare against today s trends in software quality and testing?

Transcription

1 The How does your organization compare against today s trends in software quality and testing?

2 Speaker Mattias Bergströmner - Global Service Line Testing - Subject Matter Expert Testing - Strategic Sales & Delivery mattias.bergstromner@sogeti.se 2

3 Agenda Report Demographics Key Findings Industry Perspectives Testing Tools and Technology Skills and Test Organization Testing Outsourcing Trends Virtualization and Testing on the Cloud Leveraging Agile Methodologies The State of Quality What next? 3

4 This presentation Take off Go directly to ft Hope you are well seated Enjoy and relax. 4

5 5

6 Report Demographics

7 World Quality Report profile - geography Europe 30% North America 52% Asia 9% CXOs, IT directors, QA Mgrs and engineers at various companies around the world. Rest of the World 9% 7

8 World Quality Report profile size of the company 40% 38% 35% 30% 27% 25% 20% 17% 18% 15% 10% 5% 0% Enterprise Large Mid size Small * * Over * Below 1000* *employees 8

9 -2011 Key Findings

10 Highlights and Key Trends Economic Impact Most companies had to reduce their IT spend, but 71% are still investing in new application development projects 50% indicate resource cuts and heavier project loads have forced their project teams to take on more work Methodology 70% admit to following specific ALM (Application Lifecycle Management) methodology 82% follow testing processes consistently for more than half of their projects Skills QA organizations increasingly require well-rounded resource skill sets; testing, development & methodologies = greater convergence 11

11 Highlights and Key Trends Agile Agile delivery methods continue to gain popularity; 60%+ leverage agile, although mostly experimentally and gradually, with time to market & quality benefits Outsourcing Nearly 50% outsource application development and testing irrespective of methodology used, and plan to increase offshore resources in the coming year. The biggest growth is seen in Europe. Virtualization and the Cloud Nearly 75% starting to leverage deployment of some applications on the Cloud - cost reduction and agile are main reasons 12

12 Industry Perspectives

13 Industry notes: Consumer Products and Retail CPR companies place greater premium on aligning business and IT priorities, but there is significant disconnect between business and QA groups in sector 63% of survey responses feel that business thinks role of QA is to execute scripts, even though execution accounts for only a fraction (20-25%) of QA activities. CPR respondent say 67% of their testers have little CPR domain expertise, lower than other sectors Despite downturn, CPR sector is increasing investment in IT and new application development Almost half are leveraging outsourced resources for testing I don t get no RESPECT! 14

14 Industry notes: Distribution/Logistics Heavy reliance on IT systems for core functions but no standardized ERP solution a lot of systems requiring effort to maintain and difficult to integrate in acquisition/ merger Still supporting ever-expanding datacenters and aging infrastructure 70% of Distributions/Logistics respondents turning to agile development to help build new SOA platforms All claim to be using integrated automation tools to support agile initiatives, but number of initiatives remains small (less than 25%) Some are starting to bring their applications to the cloud 15

15 Industry notes: Financial Services Application performance testing considered a requirement in this sector; accuracy and precision are essential given multi-trillion $ transactions Still feeling the impact of the recession and increasing regulation Banks existing distribution and legacy systems not set up to support changing customer banking behavior patterns with heavy reliance on web-based services and transactions 64% of respondents have reduced IT investments due to the economic conditions But 80% say they are still investing in new application developments projects 66% are leveraging Agile in their ALM Nearly 70% are using outsourcing services for testing, with increasing reliance I m repaying the bailout money from my phone 16

16 Industry notes: High Tech It s better to be first than to be better - quality often takes second place to time to market Quality = usability, design and positive user experience Sector achieves higher quality with limited resources through efficiency and innovation 80% use Agile; of those 30% use Agile for over 50% of their application development Among the first to embrace the Cloud to optimize IT infrastructure They plan to test 25%+ of applications on the Cloud Outsourcing is not preferred route as app development core to the business QA is integral to app delivery process: 76% understand that primary function of QA is not simply execution of test scripts Iphone came first! Droid is faster! 17

17 Industry notes: Public Sector IT budgets shrinking, public scrutiny and regulation forcing sector to take more strategic and ROI-approach to IT investment Cloud coming to the fore; all government sector respondents confirm they intend to move some applications to the cloud in next 3 years Quality is very important due to downstream consequences of poorly performing applications Most have well-defined ALM methodology + highest number of responses for following a standard methodology such as TMap But slow to adopt Agile. 69% respondents do not use agile Sector traditionally not used outsourcing and offshoring; 32% use QA outsourcing and 21% plan to increase their use Yes we can??? 18

18 Industry notes: Telecommunications IT is second largest capital expense with investment in self-service online applications for customer interaction Sector continues to invest heavily in new IT projects 76% in new application development Looking to consolidate, centralize and simplify strategic IT systems standardizing on a single streamlined system 69% - greatest challenge is capturing business requirements and managing change Quality is more than functionality its about the user experience. 40% are increasing their outsourcing and want more specialist services eg SAP Forefront of adopting virtualization all are planning to test applications in the Cloud, + 31% indicate they expect to test over half of their applications in the Cloud 19

19 Testing Tools and Technology The Role of Automation The Case for Return on Investment

20 Leverage of automation technology across ALM Test Cases Defect Management Requirements Use Case Business Flow Modeling Business IP Domain Mgmt All of the Above 21

21 Need for Automation Investment 25% 23% 20% 20% 20% 19% 15% 14% 10% 5% 0% 1% 3% Requirements Test Management & Execution Defect Management Environments & Data Management Business Flow Modeling Testing Through the Cloud None; we have all that we need 22

22 How much ROI are you getting from Investments? 100% Up to 80% Up to 50% Less than 25% None Can't Quantify 23

23 Skills and Test Organization Domain knowledge and Skills

24 Does QA need to have domain knowledge? NA EU ASIA ROW Very little Few years relevant industry domain knowledge Experts in our industry domain Doing more with less is here to stay. 25

25 Most important skills when hiring QA Development skills (C++, Java, etc.) Scripting skills (Perl, Python, etc.) Database skills Mainframe skills Networking skills Security skills Business Knowledge QA skills 27

26 Testing Outsourcing Trends

27 Do you outsource QA? NA EU ASIA ROW Yes No 29

28 Where do you prefer to outsource QA? Contractors Co-located India Nearshore South America/Latin America Eastern Europe South East Asia China Africa 30

29 Virtualization and Testing on the Cloud

30 What percentage of applications are virtualized? 33

31 Top Cloud migration challenges We have issues but we do not know the reasons We have not seen any issues Infrastructure performance problems Application functionality issues Security and vulnerability problems Application performance issues 34

32 How are you leveraging cloud in testing? We do not leverage virtualization /cloud in our testing efforts We leverage cloud services to generate traffic for our performance testing efforts We use testing tools hosted in the cloud We set up test environments using cloud services 35

33 Leveraging Agile Methodologies

34 Do you leverage Agile methods in application delivery? Yes No 38

35 What is the biggest challenge working with offshore resources for Agile delivery? 40

36 The State of Quality Year on Year improvement The Role of processes and frameworks

37 Overall is Quality getting better? (Last two years) Yes No 42

38 Which Test Methodologies are used? 43

39 What Next?

40 What next? Investment shift to requirements visualization, business flow modeling and test environment and data management Increased demand for testers with strong technical skills and relevant domain and business knowledge Agile delivery methods will enable businesses to focus on projects that bring fast ROI Hosting applications on a cloud will help reduce infrastructure costs, increase agility and capacity planning Trend for increased outsourcing remains, provided vendors offer more specialized value-added services and assets and industry skills Speak to us about participating in our WQR survey mattias.bergstromner@sogeti.se 46

41 For more information Download the World Quality Report at Sogeti/publications Or contact Mattias Bergströmner

42 Thank you!