Contents Intelliware Development Inc.

Transcription

1 2

2 Contents Executive Summary 4 Purpose & Methodology 6 Respondents 9 Company Size 10 Job Role 11 Industry 11 Organizational Experience with Agile 12 Geography 12 Findings 13 The Agile Capability Gap 14 The Benefits of Agile 17 The Barriers to Agile 22 The Role of Experience 26 The Influence of Job Role on Agile 29 Lean Startup Driving Agile 30 Agile Segments 33 Conclusion 35 Appendix 37 Definitions of Statistical Terms 38 Factor Analysis Table Benefits 38 Factor Analysis Table Barriers 39 Agile Perceptions By Experience 39 About Intelliware Intelliware Development Inc. 3

3 Executive Summary

4 Executive Summary A gile software development has been around for over a decade. While many now consider it to be a mainstream approach, there is a need for deeper understanding about how best to make it work for organizations. To gain a deeper understanding of the key drivers of success, challenges and relationships that various factors play in the successful adoption of Agile, Intelliware designed a survey on the state of Agile adoption in organizations today. We surveyed 117 individuals representing a broad range of industries, job roles, company sizes, and experience with Agile. Given our local presence in Toronto, Canada, the majority of our respondents approximately 85% - were in Canada. There are several key findings from this survey: The ability to adapt to changing priorities is the most common benefit of Agile. Close collaboration leads to more adaptive organizations. There is a significant positive correlation between the Agile benefits of greater collaboration and ability to adapt to changing priorities with an organization s success with Agile. Organizations want to adopt Agile, but often aren t having a great deal of success. There s a significant gap between the importance organizations place on Agile and their capability with it. Augmenting your existing team by hiring full-time staff with Agile is only part of the equation. Agile experience alone cannot be relied on, as we found that experience drives Agile capability but only to a limited extent. Lip-service doesn t work. Approach using Agile elements in a non-agile framework was the most frequently selected barrier in our survey; 24% of respondents stated this as the lone barrier that is inhibiting further adoption of Agile. Lean Startup is driving Agile adoption, but it s mostly with organizations that have been practicing Agile for some time Intelliware Development Inc. 5

5 Purpose & Methodolgy

6 Purpose & Methodology Purpose A gile software development practices are becoming increasingly prevalent these days. Articles and blogs abound discussing the pros and cons of this approach to software development. In fact, now the term Agile is being attached to all sorts of other business processes, ranging from business strategy to marketing*. To gain a deeper understanding of the key drivers of success, challenges, and relationships that various factors play in the successful adoption of Agile, Intelliware designed a survey on the state of Agile adoption in organizations today. Methodology This survey and corresponding analysis is intended to provide a general benchmark of the state of Agile adoption. We asked 6 broad questions: How long has your organization been using Agile software development methodologies? How important are Agile practices to your overall business strategy? How would you rate your organization s Agile capabilities? What benefits of Agile practices are important to your organization? What is inhibiting further adoption of Agile practices in your organization? 2014 Intelliware Development Inc. 7

7 Purpose & Methodology How much influence have Lean Startup concepts influenced your organization s desire to adopt Agile development practices? The survey was short enough to help generate a sufficient number of survey responses but long enough to capture enough data that would allow for a meaningful analysis. These questions provide the opportunity for us to get a better understanding of the business drivers, capabilities and challenges companies are facing in their adoption and use of Agile practices. We also included a question on Lean Startup, since this method is gaining traction as a viable alternative to traditional product development and employs several Agile practices. To add to the analysis, we wanted to learn more about the companies represented by the survey respondents. We researched the respondents companies to identify company size and industry. Company size was categorized by number of staff: Small-to-medium sized businesses (SMBs) = <100, Midmarket = and Enterprise = While we saw some variance by industry and company size, our sample size was not large enough to report conclusive findings based on these variables. Throughout the report, we refer to several statistical techniques. For definitions of these techniques, please see the Appendix. * Books such as Lean Marketing for Startups: Agile Product Development, Business Model Design, Web Analytics, and Other Keys to Rapid Growth by Sean Ellis and Marketing Agencies that tout Lean or Agile Marketing practices are appearing more frequently than ever before Intelliware Development Inc. 8

8 Respondents

9

10

11

12 Findings

13 Findings B ased on the results, there is a gap between organizational capability with Agile and the importance of Agile to those companies. In general, people do not believe that their Agile capabilities are on par with Agile s importance to their organization. We believe that importance can be seen as a proxy for expected results from Agile. Therefore, this could also have been interpreted as the gap between the desired outcome from Agile practices and the ability to achieve this outcome. The following pages provide an overview of this gap as well as an exploration of the influences of organizational capability based on these 5 variables: Benefits of Agile Barriers to Agile Practice Makes Perfect? The Role of Experience The Influence of Job Role on Agile Agile Segments - Two Groups 2014 Intelliware Development Inc. 14

14 The Agile Capability Gap

15

16 The Benefits of Agile

17

18

19 The Benefits of Agile Consequently, we grouped these benefits together to create related factors, or broader categories of benefits. Using factor analysis, we found that the benefits listed in our survey could be loosely grouped into the following three factors: Software quality Speed and agility Resources: saving time and money Software quality includes four variables (or benefits): better fit of features of product needs, reduced risk, greater collaboration, and ability to adapt to changing priorities. Speed and agility includes time to market and ability to adapt. Resources include lower costs and faster time to market, which could be interpreted as saving staff time as well as satisfying the market with releasing products faster. These three factors show the true breadth of Agile benefits: effectiveness (software quality), efficiency (speed and agility) and money (resources).*** Greater Collaboration has a 0.30 correlation and significance with Agile importance and has a 0.35 correlation and significance with Agile capability. The ability to adapt to changing priorities has a 0.35 correlation and significance with Agile importance and has a 0.31 correlation and significance with Agile capability. **Statistically significant at the 0.05 level, i.e. p<.05. ***To see the factor scores, see the Appendix Intelliware Development Inc. 20

20 The Barriers to Agile

21

22 The Barriers to Agile correlated with both the perceived importance of, and capability with, Agile.* In other words, those who see management as a barrier to further Agile adoption in their organization are more likely to say that their organization places lower importance on Agile and are less capable with Agile relative to their peers. This is an unsurprising yet interesting finding because it shows how critical it is to have management support for Agile. A grassroots Agile effort may be the easiest way to implement Agile in an organization but it is by no means guarantees success if management isn t involved. The barrier of approach using Agile elements in a non- Agile framework is noteworthy. Interestingly, while it was the most frequently selected barrier in our survey (46% of respondents), it is the only barrier that does not have any significant correlation (p<0.05) with another barrier. Sixty three percent of those who selected approach as a barrier selected two or fewer barriers that are inhibiting further adoption of Agile practices at their organization, with 24% selecting approach alone. In other words, there are many people who find that their organization s approach to Agile is the only or just one of a few barriers they face to improve Agile adoption. Using factor analysis again, we found that the barriers listed in this survey could be loosely grouped into the following two factors: 1. Practice barriers 2. Environmental barriers 2014 Intelliware Development Inc. 23

23 The Barriers to Agile Practice barriers include only two important variables (or barriers): approach and culture. Environmental Barriers include four important variables: staff, office layout, management, and culture. In essence, what s getting in the way of Agile adoption appears to be either the environment in which one is trying to be Agile or the approach that one is taking with Agile.** Management not supportive of Agile has a correlation and significance with Agile importance and has a correlation and significance with Agile capability. **To see the factor scores, see the Appendix Intelliware Development Inc. 24

24 Does Practice Make Perfect? The Role of Experience

25

26 The Role of Experience While greater experience with Agile generally leads to better Agile capabilities, the rate of improvement is underwhelming. One might expect capability to increase more steadily with experience. It seems as though organizations cannot rely on Agile experience alone to improve their capabilities. One theory is this is due to the common barriers to Agile, such as culture, approach, and staff (as described in Barriers to Agile section). Regarding the perceived importance of Agile, the good news is that experience and average perceived importance are positively correlated. That is, the greater one s experience with Agile, the more important it becomes. The bad news is that the rate of growth is rather slow only about 7 percent per year after the first year with Agile. This may be due to the results or challenges from gaining experience with Agile. It s worth noting that this finding is based on the respondents perceptions. Consequently, it is possible that organizations are improving their capability at a steady and greater rate but are overestimating their organization s Agile capabilities when new to Agile and are underestimating it once they are experienced. It is also possible that there is more than meets the eye with Agile and that those who are new to it underestimate what it entails Intelliware Development Inc. 27

27 The Influence of Job Role on Agile

28

29 Lean Startup: Driving Agile Adoptions Further, Not Encouraging New Adoptions

30 Lean Startup F or those who are unfamiliar with Lean Startup, it is a method for developing businesses and products and is primarily adopted for software development. Its central tenet is validated learning, which is a process to get end-user customer feedback and then iterate accordingly. The Lean Startup movement and Agile are viewed as complementary. The Lean Startup concept of validated learning goes well with the Agile principles of regularly reflecting on how to become more effective and of welcoming change. Both Agile and Lean Startup use iterative processes, from development to product releases. Given these similarities, we were curious to understand how much influence Lean Startup concepts are having on the organizational desire to adopt Agile development practices. We found that Lean Startup is influencing Agile adoptions, but to a limited and specific extent. When we asked survey respondents how much influence, on a scale of 1 to 10 with 10 being the highest, Lean Startup concepts have had on their organization s desire to adopt Agile development practices, the median response was 4 and the most common response was a 1. However, despite this minimal impact, when we considered experience with Agile, the effect of Lean Startup on Agile became more evident. Experience with Agile is positively correlated with the perceived influence Lean Startup is having on Agile adoption. This implies that those who have been Agile for longer are more likely to belong to an organization whose Agile adoption rate is influenced by the Lean Startup concept. Figure 4 illustrates that for every experience category, the longer one has practiced Agile, the higher the level of influence that Lean Startup tends to have on their organization s Agile adoption Intelliware Development Inc. 31

31

32 Agile Segments Two Groups

33 Agile Segments W e explored whether there are any natural groups of people with similarities related to Agile. Using cluster analysis, we determined that while there were no tightly-knit clusters in our sample, there were two loosely-connected groups that can be described as follows: The Veterans: Those who consider Agile to be among the top priorities for their organization, are very good with Agile, and are influenced by Lean Startup The Rookies: Those who consider Agile as only having moderate importance to their organization, are subpar at it, and are not influenced by Lean Startup The Veterans: Experience: about 3 years Importance of Agile: 9 of 10 Capability with Agile: 7 of 10 Influence of Lean Startup on Agile: 6 of 10 Believe Agile helps their organization have greater collaboration Do not believe staff or company culture are inhibiting Agile adoption The Rookies: Experience: about 1.5 years Importance of Agile: 5 of 10 Capability with Agile: 4 of 10 Influence of Lean Startup on Agile: 2 of 10 Do not believe Agile helps their organization have greater collaboration Believe both staff and company culture are inhibiting Agile adoption 2014 Intelliware Development Inc. 34

34 Conclusion

35 Conclusion T he response data from this survey reveals several insights into the adoption of Agile in today s organization. There are two main areas that should be considered by anyone in an organization that is Agile or is considering this approach: 1. Agile is enabling a more adaptive organization, and, 2. Despite a will to be Agile, there is a gap between good intentions and actual capability. Organizations are recognizing the imperative to be nimble and action-oriented in order to manage changing priorities. The results of this survey indicate that Agile is a key enabler for this: from the ability to adapt to changing priorities to greater collaboration, organizations are coming more adaptive because of Agile. Although Agile is helping companies become more adaptive, the Agile capability gap needs to be addressed. Organizations are headed in the right direction in terms of placing strategic value on Agile. Now they need to address their actual ability to implement and maintain a high-performing Agile culture. Hiring experienced Agile practitioners is only part of the solution. Other aspects of the organization must be addressed, most importantly, meaningful support from the top not only in embracing the idea, but also by removing the barriers that inhibit Agile and creating an environment that supports Agile Intelliware Development Inc. 36

36 Appendix

37 Appendix Definitions of Statistical Terms Correlation: A statistical measure that indicates the extent to which two or more variables fluctuate together. A positive correlation means that the variables tend to be either large or small together. For example, education and income are positively correlated. A negative correlation means that as the value of one variable increases, the other(s) decrease(s). For example, TV viewing and grades (for students) are negatively correlated. Correlation ranges from +1 between (perfect correlation) to 1 (perfect negative correlation). Statistically significant: The probability that an effect is not likely due to just chance alone. P-values are often coupled to a significance or alpha (α) level, which is also set ahead of time, usually at 0.05 (5%), as they are in this report. Factor Analysis: a statistical method used to describe variability among observed, correlated variables in terms of a potentially lower number of unobserved variables called factors. It helps identify groups of related items (called factors). For example, in a decathlon, each athlete competes in 10 events, but several of them can be thought of as "speed" events, while others can be thought of as "strength" events, etc. Thus, a competitor's 10 event scores might be thought of as largely dependent on a smaller set of 3 or 4 types of athletic ability. Cluster Analysis: the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters) Intelliware Development Inc. 38

38

39

40