The -2011 How does your organization compare against today s trends in software quality and testing?
Speaker Mattias Bergströmner - Global Service Line Testing - Subject Matter Expert Testing - Strategic Sales & Delivery +46 730 88 40 26 + 46 853 68 40 26 mattias.bergstromner@sogeti.se 2
Agenda Report Demographics Key Findings Industry Perspectives Testing Tools and Technology Skills and Test Organization Testing Outsourcing Trends Virtualization and Testing on the Cloud Leveraging Agile Methodologies The State of Quality What next? 3
This presentation Take off Go directly to10 000 ft Hope you are well seated Enjoy and relax. 4
5
Report Demographics
World Quality Report profile - geography Europe 30% North America 52% Asia 9% 30 000 CXOs, IT directors, QA Mgrs and engineers at various companies around the world. Rest of the World 9% 7
World Quality Report profile size of the company 40% 38% 35% 30% 27% 25% 20% 17% 18% 15% 10% 5% 0% Enterprise Large Mid size Small 5000 20 000* 1000 4999* Over 20 000* Below 1000* *employees 8
-2011 Key Findings
Highlights and Key Trends Economic Impact Most companies had to reduce their IT spend, but 71% are still investing in new application development projects 50% indicate resource cuts and heavier project loads have forced their project teams to take on more work Methodology 70% admit to following specific ALM (Application Lifecycle Management) methodology 82% follow testing processes consistently for more than half of their projects Skills QA organizations increasingly require well-rounded resource skill sets; testing, development & methodologies = greater convergence 11
Highlights and Key Trends Agile Agile delivery methods continue to gain popularity; 60%+ leverage agile, although mostly experimentally and gradually, with time to market & quality benefits Outsourcing Nearly 50% outsource application development and testing irrespective of methodology used, and plan to increase offshore resources in the coming year. The biggest growth is seen in Europe. Virtualization and the Cloud Nearly 75% starting to leverage deployment of some applications on the Cloud - cost reduction and agile are main reasons 12
Industry Perspectives
Industry notes: Consumer Products and Retail CPR companies place greater premium on aligning business and IT priorities, but there is significant disconnect between business and QA groups in sector 63% of survey responses feel that business thinks role of QA is to execute scripts, even though execution accounts for only a fraction (20-25%) of QA activities. CPR respondent say 67% of their testers have little CPR domain expertise, lower than other sectors Despite downturn, CPR sector is increasing investment in IT and new application development Almost half are leveraging outsourced resources for testing I don t get no RESPECT! 14
Industry notes: Distribution/Logistics Heavy reliance on IT systems for core functions but no standardized ERP solution a lot of systems requiring effort to maintain and difficult to integrate in acquisition/ merger Still supporting ever-expanding datacenters and aging infrastructure 70% of Distributions/Logistics respondents turning to agile development to help build new SOA platforms All claim to be using integrated automation tools to support agile initiatives, but number of initiatives remains small (less than 25%) Some are starting to bring their applications to the cloud 15
Industry notes: Financial Services Application performance testing considered a requirement in this sector; accuracy and precision are essential given multi-trillion $ transactions Still feeling the impact of the recession and increasing regulation Banks existing distribution and legacy systems not set up to support changing customer banking behavior patterns with heavy reliance on web-based services and transactions 64% of respondents have reduced IT investments due to the economic conditions But 80% say they are still investing in new application developments projects 66% are leveraging Agile in their ALM Nearly 70% are using outsourcing services for testing, with increasing reliance I m repaying the bailout money from my phone 16
Industry notes: High Tech It s better to be first than to be better - quality often takes second place to time to market Quality = usability, design and positive user experience Sector achieves higher quality with limited resources through efficiency and innovation 80% use Agile; of those 30% use Agile for over 50% of their application development Among the first to embrace the Cloud to optimize IT infrastructure They plan to test 25%+ of applications on the Cloud Outsourcing is not preferred route as app development core to the business QA is integral to app delivery process: 76% understand that primary function of QA is not simply execution of test scripts Iphone came first! Droid is faster! 17
Industry notes: Public Sector IT budgets shrinking, public scrutiny and regulation forcing sector to take more strategic and ROI-approach to IT investment Cloud coming to the fore; all government sector respondents confirm they intend to move some applications to the cloud in next 3 years Quality is very important due to downstream consequences of poorly performing applications Most have well-defined ALM methodology + highest number of responses for following a standard methodology such as TMap But slow to adopt Agile. 69% respondents do not use agile Sector traditionally not used outsourcing and offshoring; 32% use QA outsourcing and 21% plan to increase their use Yes we can??? 18
Industry notes: Telecommunications IT is second largest capital expense with investment in self-service online applications for customer interaction Sector continues to invest heavily in new IT projects 76% in new application development Looking to consolidate, centralize and simplify strategic IT systems standardizing on a single streamlined system 69% - greatest challenge is capturing business requirements and managing change Quality is more than functionality its about the user experience. 40% are increasing their outsourcing and want more specialist services eg SAP Forefront of adopting virtualization all are planning to test applications in the Cloud, + 31% indicate they expect to test over half of their applications in the Cloud 19
Testing Tools and Technology The Role of Automation The Case for Return on Investment
Leverage of automation technology across ALM Test Cases Defect Management Requirements Use Case Business Flow Modeling Business IP Domain Mgmt All of the Above 21
Need for Automation Investment 25% 23% 20% 20% 20% 19% 15% 14% 10% 5% 0% 1% 3% Requirements Test Management & Execution Defect Management Environments & Data Management Business Flow Modeling Testing Through the Cloud None; we have all that we need 22
How much ROI are you getting from Investments? 100% Up to 80% Up to 50% Less than 25% None Can't Quantify 23
Skills and Test Organization Domain knowledge and Skills
Does QA need to have domain knowledge? NA EU ASIA ROW Very little Few years relevant industry domain knowledge Experts in our industry domain Doing more with less is here to stay. 25
Most important skills when hiring QA Development skills (C++, Java, etc.) Scripting skills (Perl, Python, etc.) Database skills Mainframe skills Networking skills Security skills Business Knowledge QA skills 27
Testing Outsourcing Trends
Do you outsource QA? NA EU ASIA ROW Yes No 29
Where do you prefer to outsource QA? Contractors Co-located India Nearshore South America/Latin America Eastern Europe South East Asia China Africa 30
Virtualization and Testing on the Cloud
What percentage of applications are virtualized? 33
Top Cloud migration challenges We have issues but we do not know the reasons We have not seen any issues Infrastructure performance problems Application functionality issues Security and vulnerability problems Application performance issues 34
How are you leveraging cloud in testing? We do not leverage virtualization /cloud in our testing efforts We leverage cloud services to generate traffic for our performance testing efforts We use testing tools hosted in the cloud We set up test environments using cloud services 35
Leveraging Agile Methodologies
Do you leverage Agile methods in application delivery? Yes No 38
What is the biggest challenge working with offshore resources for Agile delivery? 40
The State of Quality Year on Year improvement The Role of processes and frameworks
Overall is Quality getting better? (Last two years) Yes No 42
Which Test Methodologies are used? 43
What Next?
What next? Investment shift to requirements visualization, business flow modeling and test environment and data management Increased demand for testers with strong technical skills and relevant domain and business knowledge Agile delivery methods will enable businesses to focus on projects that bring fast ROI Hosting applications on a cloud will help reduce infrastructure costs, increase agility and capacity planning Trend for increased outsourcing remains, provided vendors offer more specialized value-added services and assets and industry skills Speak to us about participating in our 2011-12 WQR survey mattias.bergstromner@sogeti.se 46
For more information Download the World Quality Report at www.capgemini.com/wqr2010-11 www.sogeti.com/curious-about- Sogeti/publications Or contact Mattias Bergströmner +46 730 88 40 26 +46 853 68 40 26 mattias.bergstromner@sogeti.se 47
Thank you!