Agile Methods for Accelerating Value from Business Intelligence and Data Warehousing: An Inside Look at Trends and Best Practices

Size: px
Start display at page:

Download "Agile Methods for Accelerating Value from Business Intelligence and Data Warehousing: An Inside Look at Trends and Best Practices"

Transcription

1 Agile Methods for Accelerating Value from Business Intelligence and Data Warehousing: An Inside Look at Trends and Best Practices Presented by David Stodder, Ralph Hughes, and Paul Kautza August 13, 2012

2 Today s Speakers David Stodder Director of Research, TDWI Paul Kautza Director of Education TDWI Ralph Hughes Chief Systems Architect, Ceregenics, Inc 2

3 Agenda Opening Remarks About Agile Development Discussion of Ceregenics/TDWI Survey Results Discussion About Agile - How to get started? - What s the next step? - Working with non-agile parts of organization Your Questions Conclusion 3

4 Focus on Upcoming Educational Opportunities TDWI World Conference Agile BI: Responding Rapidly to Business Needs Boston, September 16 21, 2012 Keynote Session with Ralph Hughes, Ceregenics, and David Stodder, TDWI Boston, September 20, 2012 tdwi.org/bos2012 Register by August 24 and save up to $300; use priority code BOS53

5 Agile Development Techniques and Disciplines Long popular in many areas of application development Growing adoption as common engineering approach for business intelligence and data warehousing projects Aligned with goals for making BI/DW development more focused on delivering business value sooner Emphasis on early and frequent delivery of working software and greater stakeholder collaboration About improving programmer productivity, delivery quality, and project risk attributes Planning for what you know today and being prepared to adjust in the face of change and uncertainty

6 Agile Adoption Research Survey Title: Adoption of Agile Methods Among Business Intelligence and Data Warehousing Development Teams Research study conducted jointly by Ceregenics, Inc., led by Chief Systems Architect Ralph Hughes, and TDWI, led by David Stodder, Director of Research for Business Intelligence Conducted in May and June, total participants; 299 finished surveys (75.7%)

7 About Our Survey Participants Copyright 2012 TDWI & Ceregenics, Inc.

8 Participants BI/DW Specialties Copyright 2012 TDWI & Ceregenics, Inc.

9 Participants: Size of Organization Copyright 2012 TDWI & Ceregenics, Inc.

10 Participants: Size of BI/DW Organization Copyright 2012 TDWI & Ceregenics, Inc.

11 Participants: Years of Experience Copyright 2012 TDWI & Ceregenics, Inc.

12 Experience with Agile Techniques Copyright 2012 TDWI & Ceregenics, Inc.

13 Discussion Question How do you get started with Agile? What are common mistakes to avoid? 13

14 Number of Current Agile Projects Copyright 2012 TDWI & Ceregenics, Inc.

15 Success Rate for Agile Projects for Co-located or for Near Location? 40% 35% 30% 25% 20% 15% 10% 5% 0% Copyright 2012 TDWI & Ceregenics, Inc. 0% - 20% 20% - 40% 40% - 60% 60% - 80% 80% - 100% Co / Near Location Far Location

16 What Has Been Agile s Impact? 70% 60% 50% 40% 30% 20% 10% 0% Productivity Quality Stakeholder satisfaction Much Better Somewhat Better No change Somewhat Worse Much Worse Costs Copyright 2012 TDWI & Ceregenics, Inc.

17 Discussion Questions How do you get started with Agile? What are common mistakes to avoid? You ve made a good start with Agile: What s the next step? 17

18 Primary Agile Method for BI/DW Scrum (with or without Lean Feature-driven Hybrid of Scrum and Rational or Open Unified Kanban Extreme programming (XP) Dynamic systems Too many influences to Can't say 0% 10% 20% 30% 40% Copyright 2012 TDWI & Ceregenics, Inc.

19 Percentage Projects w/significant ETL/DI 40.00% 35.00% 30.00% 25.00% 20.00% 15.00% 10.00% 5.00% 0.00% Copyright 2012 TDWI & Ceregenics, Inc.

20 Iteration Length for Data Integration Projects <= 1 week 2 weeks 3 weeks 4 weeks 5 8 weeks > 8 weeks Don't iterate Copyright 2012 TDWI & Ceregenics, Inc. No DI DI

21 Project Support Tools Used Project management tools Issue tracking software Defect tracking software Electronic user story Electronic task board Other electronic support Manual artifacts only 0% 10% 20% 30% 40% 50% 60% Copyright 2012 TDWI & Ceregenics, Inc.

22 Culture: Still a Major Challenge The culture of my organization is a bad fit for agile : 36% agree with this statement We can't easily get access to our business stakeholders : 38% agree with this statement Management in my organization will not support agile : 23% agree, but 36% strongly disagree with this statement The developers in my organization will not support agile : 21% agree, but 38% strongly disagree with this statement

23 Discussion Questions How do you get started with Agile? What are common mistakes to avoid? You ve made a good start with Agile: What s the next step? How does an Agile BI and data warehousing team work with non-agile parts of the organization? 23

24 World Conference Program View David Stodder Director of Research, TDWI Paul Kautza Director of Education TDWI Ralph Hughes Chief Systems Architect, Ceregenics, Inc 24

25 A Framework For Agile BI Agile DW Design & Development Agile Analytics Agile BI Organizations Agile DW Infrastructure

26 Q&A: Your Questions! David Stodder Director of Research, TDWI Paul Kautza Director of Education TDWI Ralph Hughes Chief Systems Architect, Ceregenics, Inc 26

27 Join Us In Boston September 16-21, 2012 tdwi.org/bos2012