Pro Application Lifecycle Management with Visual Studio 2012

Transcription

1 Pro Application Lifecycle Management with Visual Studio 2012 Second Edition Joachim Rossberg Mathias Olausson

2 Pro Application Lifecycle Management with Visual Studio 2012 Copyright 2012 by Joachim Rossberg and Mathias Olausson This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher s location, in its current version, and permission for use must always be obtained from Springer. Permissions for use may be obtained through RightsLink at the Copyright Clearance Center. Violations are liable to prosecution under the respective Copyright Law. ISBN ISBN (ebook) Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein. President and Publisher: Paul Manning Lead Editor: Tom Welsh Technical Reviewers: Jakob Ehn, Todd Meister, Gregg Boer, and Anutthara Bharadwaj Editorial Board: Steve Anglin, Ewan Buckingham, Gary Cornell, Louise Corrigan, Morgan Ertel, Jonathan Gennick, Jonathan Hassell, Robert Hutchinson, Michelle Lowman, James Markham, Matthew Moodie, Jeff Olson, Jeffrey Pepper, Douglas Pundick, Ben Renow-Clarke, Dominic Shakeshaft, Gwenan Spearing, Matt Wade, Tom Welsh Coordinating Editors: Corbin Collins and Mark Powers Copy Editors: Linda Seifert, Pat Morris, and Brendan Frost Compositor: SPi Global Indexer: SPi Global Artist: SPi Global Cover Designer: Anna Ishchenko Distributed to the book trade worldwide by Springer Science+Business Media New York, 233 Spring Street, 6th Floor, New York, NY Phone SPRINGER, fax (201) , orders-ny@springer-sbm.com, or visit For information on translations, please rights@apress.com, or visit Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use. ebook versions and licenses are also available for most titles. For more information, reference our Special Bulk Sales ebook Licensing web page at Any source code or other supplementary materials referenced by the author in this text is available to readers at For detailed information about how to locate your book s source code, go to

3 To Eddie and Amelie Joachim Rossberg To Susanne, Linn and Linus. Mathias Olausson

4 Contents at a Glance About the Authors... xxvii About the Technical Reviewers... xxix Acknowledgments... xxxi Introduction... xxxiii Part 1: Application Lifecycle Management... 1 Chapter 1: Why Application Lifecycle Management Matters...3 Chapter 2: Introduction to Application Lifecycle Management...21 Chapter 3: Development Processes and Frameworks...37 Chapter 4: ALM Assessments...61 Chapter 5: ALM Using TFS...75 Part 2: Planning (Agile Project Management) Chapter 6: Introduction to Agile...91 Chapter 7: Work Item Tracking and Process Customization Chapter 8: Agile Project Management With TFS Chapter 9: Metrics and ALM Assessment for Agile Project Management Part 3: Analysis, Modeling, and Design (Architecture) Chapter 10: Prototyping Using Storyboarding and Feedback Tracking Chapter 11: Top Down Design Studies (UML) v

5 AT A GLANCE Chapter 12: Using Architecture Explorer Chapter 13: Using Layer Diagrams Chapter 14: Metrics and ALM Assessment for Architecture, Analysis and Design Part 4: Building (Developer Practices) Chapter 15: Version Control Chapter 16: Unit Testing Chapter 17: Code Quality Chapter 18: Performance and Profiling Chapter 19: Metrics and ALM Assessment for Developer Practices Part 5: Validating (Software Testing) Chapter 20: Overview of Software Testing Chapter 21: Manual Testing Chapter 22: Automated Testing Chapter 23: Visual Studio Lab Management Chapter 24: Metrics and ALM Assessment for Software Testing Part 6: Releasing Chapter 25: Continuous Delivery Chapter 26: Build Automation Chapter 27: Deployment Chapter 28: Release Management Chapter 29: Metrics and ALM Assessment Part 7: Team Foundation Server Chapter 30: Architecture and Implementation Planning Chapter 31: TFS Installation, Upgrade, and Administration vi

6 AT A GLANCE Chapter 32: TFS Reporting Chapter 33: Working in Heterogeneous Environments Chapter 34: TFS In The Cloud Index vii

7 Contents About the Authors... xxvii About the Technical Reviewers... xxix Acknowledgments... xxxi Introduction... xxxiii Part 1: Application Lifecycle Management... 1 Chapter 1: Why Application Lifecycle Management Matters...3 Understanding the Cornerstones of Business...4 Processes...4 Business Rules...5 Information...5 Understanding the Need for Business Software...5 Today s Business Environment and the Problems We Face...6 Project Health Today: Three Criteria for Success...7 Factors Influencing Projects and Their Success...9 Project Success in Research...12 The Standish Group...12 Robert C. Glass...13 Size and Volatility Survey...13 Conclusions...16 IT Budget Spending...17 Development vs. Operations...17 Factors Influencing IT Spending...18 Summary...20 ix

8 Chapter 2: Introduction to Application Lifecycle Management...21 Roles in the ALM Process...21 Four Ways of Looking at Application Lifecycle Management...23 The SDLC View...24 The Service Management or Operations View...25 The Application Portfolio Management View...25 The Unified View...26 Three Pillars of Application Lifecycle Management...26 Traceability of Relationships Between Artifacts...27 Automation of High-Level Processes...27 Visibility into the Progress of Development Efforts...28 A Brief History of ALM Tools...28 Application Lifecycle Management Application Lifecycle Management Application Lifecycle Management ALM and PPM...35 Summary...36 Chapter 3: Development Processes and Frameworks...37 The Waterfall Model...37 Spiral Model...40 Rational Unified Process (RUP)...41 The Principles of RUP...42 The RUP Lifecycle...43 Disciplines...46 Manifesto for Agile Software Development...49 Extreme Programming (XP)...51 Scrum...51 Empirical Process Control...53 Complexity in Projects...53 x

9 What Scrum Is...54 The Roles in Scrum...55 The Scrum Process...57 Capability Maturity Model Integration (CMMI)...59 Summary...60 Chapter 4: ALM Assessments...61 Microsoft Application Platform Optimization (APO) Model...62 Infrastructure Optimization Model...62 Business Productivity Infrastructure Model...62 Application Platform Capability Assessment...66 Summary...74 Chapter 5: ALM Using TFS...75 Application Lifecycle Management Overview...75 Team Foundation Server Overview...76 Team Foundation Server...76 Process Template...77 Visual Studio 2012 Editions...78 Web Access...79 Microsoft Office...80 Integrated Development Environment (IDE) Integration...80 Traceability...80 The TFS Work Item Tracking System...80 Visibility...84 Collaboration...86 Work Items for Collaboration...86 The Gap Between IT and Business...86 Use of One Tool/Role Based...87 Extensibility...87 Summary...88 xi

10 Part 2: Planning (Agile Project Management) Chapter 6: Introduction to Agile...91 xii The Scrum Process...91 Roles in Scrum...92 Product Owner...92 Scrum Master...93 The Development Team...94 Definition of Done...94 Agile Requirements and Estimation...95 Requirements...95 Estimation...96 Backlog...98 Summary...99 Chapter 7: Work Item Tracking and Process Customization Traceability The TFS Work Item Tracking System Work Items The Work Item Form Work Item Traceability Work Item Queries Conclusions on the Work Item Tracking System Process Customization Modifying the Process Template Common Adaptations of the Process Template Web Access Customization Using WITAdmin to Change the Web Access UI Changing the Product Backlog Add Dialog Changing the Columns in the Product Backlog List Adding States to the Board Summary...125

11 Chapter 8: Agile Project Management With TFS Case Study Company Background The Pilot Project Scrum TFS Template Work Items TFS Web Access and Portal Reports and Queries Project Startup Phase PO Sets Off to Work Building the Initial Team Requirements Building the Backlog and Prioritizing It Definition of Done Estimation Risk Assessment Grooming the Backlog Building the Team Initial Velocity Release Planning Estimated Time Plan Estimated Project Cost Running the Project During the Sprint(s) Summary Chapter 9: Metrics and ALM Assessment for Agile Project Management Metrics Standard Reports Scrum MSF for Agile MSF for CMMI xiii

12 xiv Custom Reporting Data Warehouse Model Assessment Questions Summary Part 3: Analysis, Modeling, and Design (Architecture) Chapter 10: Prototyping Using Storyboarding and Feedback Tracking PowerPoint Storyboarding How to Do It When to Use Storyboarding Feedback Tracking Using Microsoft Feedback Client Summary Chapter 11: Top Down Design Studies (UML) UML Basics UML Support in Visual Studio Activity Diagram Use Cases and Use Case Diagrams Sequence Diagrams Class Diagrams Component Diagrams Integration with TFS Summary Chapter 12: Using Architecture Explorer Architecture Explorer Dependency Graphs Analyze and Explore Code Using Architecture Explorer Summary Chapter 13: Using Layer Diagrams Patterns Using Layer Diagrams...210

13 Creating a Layer Diagram Mapping Code to Layers Viewing Dependencies using Layer Explorer Sharing Models Layer Validation Manually Validate Layer Validate in local build Validate in TFS Build Creating an Architecture Template Summary Chapter 14: Metrics and ALM Assessment for Architecture, Analysis and Design Metrics Standard Reports Assessment Summary Part 4: Building (Developer Practices) Chapter 15: Version Control Getting Started with Source Control Using the Team Explorer Workspaces Configuring a Workspace Using the Source Control Explorer Committing Work Working with Committed Code Enforcing Development Practices with Check-in Policies Putting Work Aside Conflict Resolution Comparing Changes Working with Concurrent Changes xv

14 xvi Working with My Work Summary Chapter 16: Unit Testing What Is Test Driven Development? Principles for Unit Testing Working with Mock Objects Separation of Concerns (Object Factories) Inversion of Control (Dependency Injection) Visual Studio Unit Tests Elements of a Unit Test Test Calling Order Assertions Creating a Unit Test Context for the Test Run Test Explorer Running Tests Working with Code Coverage Adding Code Coverage to a Project Configuring Code Coverage for a Build Definition Data-Driven Automated Tests Working with External Files Managing Test Dependencies Working with Other Test Frameworks Implementing Mock Objects Summary Chapter 17: Code Quality Code Analysis Creating Custom Rule Sets Integrating Code Analysis with TFS Builds Code Analysis Check-in Policy...277

15 Code Metrics Code Clones Code Review Summary Chapter 18: Performance and Profiling Profiling Overview Profiling In Visual Studio Setting Up Profiling Running a Profiling Session Examining the Results IntelliTrace Working with IntelliTrace Using IntelliTrace in Production PreEmptive Analytics Installing PreEmptive Analytics Configuring Your Team Projects for PreEmptive Analytics Adding Exception Reporting to a.net Application Examining Incidents in Team Foundation Server Summary Chapter 19: Metrics and ALM Assessment for Developer Practices Metrics Code coverage Code metrics Compiler warnings Code analysis warnings Standard Reports Custom Reporting Data Warehouse Model Assessment Summary xvii

16 Part 5: Validating (Software Testing) Chapter 20: Overview of Software Testing Agile Testing Defining Tests Acceptance Criteria Planning Test Specification and Test Matrix Evolving Tests Strategy for Automated Testing Platform Support for Testing Practices Summary Chapter 21: Manual Testing About Microsoft Test Manager Connecting Microsoft Test Manager to TFS Planning the Tests What Is a Test Plan? Moving On Designing Test Cases What Is a Test Case? Creating Test Cases Moving On Running Tests Filtering Test Runs Working with the Test Runner Analyze Test Runs Running Exploratory Tests Test Settings Integration with Builds Reporting Bugs and Validating Fixes Creating a Bug xviii

17 Verifying Bugs Fast-Forward Playback Summary Chapter 22: Automated Testing Working with Automated Tests Supported Test Types Creating a Test Environment Traceability Automating Test Cases Using Coded UI Tests Coded UI Tests UI Test Architecture Supported Platforms Elements of a Coded UI Test Using the Coded UI Test Builder Validation Using the UI Map Editor Data-Driven Automated Tests Using Unit Tests as Automated Tests Running Automated Tests Running Automated Tests from MTM Running Automated Tests from TFS Build Running Automated Tests from the Command Line Performance Testing the Application Creating Load Test Scenarios Using Web Performance Tests Setting Up a Load Test Running a Load Test Summary Chapter 23: Visual Studio Lab Management Architecture Capabilities xix

18 xx Components Architecture Setting Up Visual Studio Lab Management for Kangreen Environments Designing Environments Working with Standard Environments SCVMM Environments What About Support for VMware? Test Settings for Lab Environments Creating Environments for Kangreen Cloning Environments Using Lab Management for Manual Testing Selecting an Environment to Use Connecting to an Environment for Testing Automated Testing and Lab Management Running Automated Tests from MTM Running Automated Tests as Part of a Build Running Automated Tests from the Command-line Summary Chapter 24: Metrics and ALM Assessment for Software Testing Metrics Standard Reports Bug Status Report Reactivations Report Bug Trend Report Test Case Readiness Report Test Plan Progress Report Custom Reporting Data Warehouse Model Assessment Summary...421

19 Part 6: Releasing Chapter 25: Continuous Delivery Continuous Integration Why Should We Implement Continuous Integration? Components in Continuous Integration Continuous Delivery The null Release Cycle Release Management Summary Chapter 26: Build Automation TFS Build Architecture Installing the Build Service Installing the Build Controller Installing the Build Agent Creating an Automated Build Running a Build Using the Build Explorer Using the Web Access to Manage Builds Implementing Continuous Integration Cloning a Build Gated Check-in Builds Running a Private Build Configuring Builds Required Parameters Basic Parameters Advanced Parameters Customizing Builds Built-in Build Activities TFS Build Extensions Creating a Build Process Template for Assembly Versioning xxi

20 Logging In the Build Process Extending Builds Creating a Solution for Developing Build Extensions Implementing an XAML Activity to Execute a Remote Command Implementing a Code Activity Build on Team Foundation Service Feedback Build Notifications Team Explorer and Web Access Favorites Summary Chapter 27: Deployment Designing a Deployment Solution Deployment to Windows Azure Running Automated Tests as Part of the Build Running Tests on the Build Server Running Tests on a Test Environment Fail a Build on Test Failure Implementing the Build-Deploy-Test Workflow Implementing a BDT Workflow Designing the BDT Workflow Implementing the BDT Process Running the BDT Workflow Customizing the Lab Build Template Summary Chapter 28: Release Management Release Management Agile Release Planning Release Management in Visual Studio Release Notes Release Notes in Visual Studio xxii

21 Versioning Versioning Requirements Versioning Code Versioning Test Cases Versioning Builds Summary Chapter 29: Metrics and ALM Assessment Metrics Standard Reports Custom Reporting Data Warehouse Model Assessment Summary Part 7: Team Foundation Server Chapter 30: Architecture and Implementation Planning TFS Architecture Logical Application Tier Logical Data Tier Team Foundation Client Tier Optional Components on Separate Servers Team Foundation Build Team Foundation Server Proxy Planning the Implementation Physical Server Location to Host Our TFS Tiers Ports and Network Protocols System Requirements Service Accounts Simple Implementation Medium Implementation Complex Implementation xxiii

22 Previous Version of TFS Already Deployed Summary Chapter 31: TFS Installation, Upgrade, and Administration Installation Options Basic Advanced Application-Tier Upgrading from Earlier TFS Versions Team Foundation Server Administration Adding TFS Collections After Installation Attaching a TFS database Enabling Web Features Enabling Alerts Summary Chapter 32: TFS Reporting Architecture Data Sources for Reporting Warehouse Adapters Relational Data Warehouse Data Models Analysis Services OLAP Cube Setting Up Access to Report Data Monitoring the TFS Data Warehouse Creating Reports Work Item Queries Excel Reports SQL Server Report Builder SQL Server Report Designer Summary xxiv

23 Chapter 33: Working in Heterogeneous Environments What is Team Explorer Everywhere? A Little Bit about Licensing Features Available in Team Explorer Everywhere Installation in Eclipse Connect to TFS Using TEE from Eclipse Ant and Maven 2 Build Improvements Summary Chapter 34: TFS In The Cloud Windows Azure Overview Compute Storage Fabric The Azure Platform TFS on Azure Getting Started Documentation and Help Services Offered With TFS in the Cloud Source Control Work-item tracking Process Templates Testing Hosted Build Service What about Reporting? Benefits of TFS in the Cloud Concerns with TFS in the Cloud Summary Index xxv

24 About the Authors Joachim Rossberg has worked as an information technology consultant since He is primarily a Scrum Master and Product Owner but has an extensive history as a system developer/ designer. He has demonstrated his technical background with various achievements over the years: MCSD, MCDBA, MCSA, and MCSE. His specialties include project management, Scrum, development processes, and Visual Studio. Joachim is now working for Knowit System Development in Gothenburg, Sweden. Mathias Olausson is the ALM practice lead for Transcendent Group, specializing in software craftsmanship and application lifecycle management. With over 15 years of experience as a software consultant and trainer, he has worked in numerous projects and organizations, which has been very valuable when using Visual Studio as a tool for improving the way we build software. Olausson has been a Microsoft Visual Studio ALM MVP for four years. He is also active as a Visual Studio ALM Ranger, most recently in the role of project lead for the Visual Studio Lab Management Guide project. Olausson is a frequent speaker on Visual Studio and Team Foundation Server at conferences and industry events and blogs at xxvii

25 About the Technical Reviewers Jakob Ehn is a current Microsoft Visual Studio ALM Most Valuable Professional (MVP) and also a Visual Studio ALM Ranger. Jakob has 15 years of experience in the IT industry, and currently works as a solution architect at Inmeta Crayon ASA, specializing in Visual Studio ALM. He actively participates in the MSDN forums, and contributes to different open source projects, such as the Community TFS Build Extensions and the Community TFS Build Manager. Todd Meister has been working in the IT industry for over 15 years. He s been a Technical Editor on over 75 titles, ranging from SQL Server to the.net Framework. Besides technical editing titles, he is the Senior IT Architect at Ball State University in Muncie, Indiana. He lives in central Indiana with his wife, Kimberly, and their five skilled children. xxix

26 ABOUT THE TECHNICAL REVIEWERS Gregg Boer is a Principal Program Manager at Microsoft with 25 years of experience in software. Over his career, Gregg has worked as a Project Manager, Program Manager, Requirements Lead, Software Engineer, Analyst, QA Lead, and Software Designer. Most of his experience is focused on leading small to medium software development teams (10 15 people). Over the years Gregg believes he has made many mistakes, learned many lessons, and worked with many smart people to develop great software. He loves the software industry, and considers himself a lucky man to have been a part of it for so long. Gregg joined Microsoft in 2005 because he believed in the vision of Team Foundation Server. He truly believes that the right set of collaborative tools could help make the lives of software engineers better. Most recently at Microsoft, Gregg is working on the team developing a set of world-class Agile Tools built on top of the TFS Platform. Anutthara Bharadwaj is Group Program Manager in the Visual Studio ALM group at Microsoft Corporation. Anu has enjoyed building and breaking software in the various roles she has worked in through her nine-year Microsoft stint, shipping multiple versions of Visual Studio ALM. Anu has worked on some cool tools with Exploratory Testing as a central theme and has three patents from her research work in this area. Anu is passionate about software development and testing and has spoken at conferences worldwide. She blogs at and tweets at xxx

27 Acknowledgments I would like to thank all the people that helped us write this book. Unfortunately, I do not have room to mention each one of you, but to some I want to give special thanks. First of all I am thankful that Mathias wanted to co-author this book. Your expertise is invaluable and the book is so much better than I could ever hope for. Mark Powers at Apress. Thanks for pushing us forward the entire journey. It was a pleasure working with you on this. Anutthara Bharadwaj, Gregg Boer, Todd Meister, and Jakob Ehn, our great technical reviewers. Thanks for coming with great input and feedback that helped improve the book. Sam Guckenheimer at Microsoft. Thanks for getting us in contact with great technical reviewers. Per Wallentin, Fredrik Abrahamsson, and Martin Skarp at Knowit Sweden. Thanks for all support. Urban Bäckemo at Knowit System Development. Thanks for feedback and inspiration to the agile parts. All you other great people at Apress. Thanks! Thanks as well to my family that put up with me during writing. And last but not least. Thanks to all you readers out there. If it wasn t for you we would not be doing this. Joachim Rossberg I would like to thank my co-author Joachim for taking me on this journey. It s been an exciting project and a pleasure to work with you. We ve talked about writing a book many times and I m really happy we finally got the first one out! Thanks to everyone at Apress, it s been great working with all of you. A special thanks to our editors Mark Powers and Tom Welsh for keeping us on track. Your knowledge and advice has been invaluable. I would also like to thank our technical reviewers Anutthara Bharadwaj, Gregg Boer, Todd Meister and Jakob Ehn for their feedback and ideas, which helped us shape this book. Jakob, you have been the primary reviewer for the chapters I contributed, and I m very thankful for your thorough readings and great feedback. I owe you one! Thanks to Magnus Timner, Gustav Sjöberg, and the rest of the ALM team at Transcendent Group for your feedback and support. I m fortunate to have such competent colleagues to discuss thingswith! Finally, thanks to my family for your love and understanding throughout this project. Mathias Olausson xxxi

28 Introduction You can have the best coders in the world working in your teams, but if your project management isn t up to scratch, your project is almost certain to be delayed, to come in over budget, and in some cases, to fail entirely. By taking precise control of your application development process, you can make changes, both large and small, throughout your project s life cycle that will lead to better-quality, finished products that are consistently delivered on time and within budget. Application lifecycle management (ALM) is an area of rapidly growing interest within the development community. Because its techniques allow you to deal with the process of developing applications across many areas of responsibility and across many different disciplines, its effects on your project can be wide-ranging and pronounced. It is a project management tool that has practical implications for the whole team from architects to designers, from developers to testers. Who This Book Is For This book is for anyone interested in improving the development efforts in their organizations. It doesn t matter if you are a manager, developer, tester, Scrum Master, or anything else. You can all benefit from what you will learn here. The Application Lifecycle Management process includes anyone involved in the lifecycle of an application, and Team Foundation Server 2012 and Visual Studio 2012 have something for each and every one of you. Maybe the most important lesson is that you are all working on the same team, and you are all responsible for the outcome of your development process. This realization cannot come from a tool like Team Foundation Server or Visual Studio. It is something that you need to figure out all by yourself. How This Book Is Structured This book is split into seven parts that will show you how you can use Visual Studio and Team Foundation Server (TFS) 2012 to implement an Application Lifecycle Management (ALM) process in your organization. Part I explains what Application Lifecycle Management is and what problems it aims to solve. We also cover different project management processes and frameworks so that you can select the most appropriate for your organization. Part II focuses on agile project management and how Visual Studio and Team Foundation Server 2012 can help by supporting an agile project management approach. Part III discusses the architecture features of Visual Studio and Team Foundation Server There are several tools available that can help developers and architects in their daily work. Part IV covers the developer tools of Visual Studio and TFS Here you see how these tools integrate with an overall ALM process that enables you to gain better control of development efforts. Part V shows the testing features of Visual Studio and TFS It is intended for developers and testers alike. Part VI describes how to create an effective build and release process. Part VII focuses on Team foundation Server and covers its architecture and its extensibility, and not only on the Windows platform. xxxiii

29 INTRODUCTION Contacting the Authors Should you have any questions or comments or spot a mistake you think we should know about you can contact the authors at Rossberg@gmail.com or mathias@olausson.net. xxxiv