David Klavon Director of Rational Requirements and Quality Management Products
Quality Management Providing Collaborative Lifecycle Quality Management
What s going on? 40% of unplanned downtime is caused by software application failures, costing over $100k per hour. 86% of IT projects experience performance problems when first put into production. 80% of business applications are not tested properly before being released into production. 50% of applications put into production are later rolled back due to not meeting quality goals.
The Cost of Quality Software related downtimes are costing the industry nearly $300 Billion dollars annually. Source: InformationWeek, May 2007
What is causing this? Competition is forcing faster delivery schedules Pressures to dramatically reduce IT costs Geographically distributed teams are creating new gaps Solutions are becoming much more complex More expensive to simulate test environments Less and less source code is built in-house and well understood Defects are still being found too late in the development cycle
So what can be done? 1. 2. 3. 4. 5. Understand the entire application quality lifecycle Examine the source of your defects as well as how to remove them Enable Team Collaboration and best practices So that handoff problems are minimized and experience is leveraged Increment and automate as much as possible Break projects into milestones and automate repetitive tasks Govern with your business goals in focus State your quality goals early and govern with them everyday Expand your scope of quality beyond code defects How will the quality of the application will be viewed?
Start at the beginning. The majority of the problems are coming from bad requirements and design. Where Injected Requirements and Design 65% Code and Test 20% Requirement Composer User Acceptance Test 10% Production Where Found 4% 17% Quality Manager 60% 21% And they are found too late in the application lifecycle.
The Application Quality Lifecycle Requirements Product Mgt/Analyst Development Architect/Developer Verification Test Practitioner/Tester Show me when the project meets my exit criteria and is ready to ship. Production Production/Deployment Mgr Show me the linkage of the test cases to the requirements in the project. Requirement Management Requirement Definition Show me what changed in the last build so that I know what function is now available to test. Design /Model Build Defects Test Plan Test Cases Test Results Identify the best test cases to automate in my organization. Service Levels Final Image APARs RFEs Product Limitations Iteration 1 Iteration 2 Iteration N Use the information that was learned in the project test to help my users (usage notes, etc).
How can Rational products help?
The Application Quality Lifecycle Total LifeCycle Quality View Quality Manager Requirements Product Mgt/Analyst Requirement Reviews Use Case Reviews Storyboard Reviews Model Reviews UI Reviews Etc. Development Architect/Developer Code Reviews Unit Testing Component Testing Build Static Scans Build Verification Test Etc. Verification Test Practitioner/Tester Function Test Case Reviews Tester Manual Testing Function Testing Service Service Testing Tester Integration Testing Performance Performance Testing Tester Production Production/Deployment Mgr Requisite Pro Software Analyzer Test Lab Manager Requirement Composer Team Concert AppScan Tester Edition The Jazz Platform
Requirement Composer Rational Requirements Composer Business Objectives Business Processes Storyboards & Sketches Rich text Requirements Collaboration Infrastructure Elicit, capture, elaborate, review and discuss requirements using a variety of techniques and notations Use Cases Prototypes Text to visual transformation Rich text Use cases Sketches and storyboards Business processes Industry & Domain Models Requirements Management Search, filter on attributes Traceability between related artifacts Impact & Coverage analysis
Quality Manager Rational Quality Manager Central hub for business-driven quality Collaborate across the test lifecycle 100% web access and Web 2.0 style interaction Team interaction and visibility on progress Dynamically prioritize and filter risk information by role Test traceability linked to business requirements Automate labor-intensive test planning tasks Test Case prioritization to ensure maximum productivity Manage and provision virtual and physical test lab assets IBM Rational Quality Manager Use an open, extensible test platform Reuses existing, homegrown, and other vendor test assets Embedded Manual Testing with data assist and asset reuse via keywords Govern with immediate access to quality metrics Customizable process based on Industry best practices ( MCIF ) Traceability and history across test assets maintained Automated data gathering and pattern analysis CONTINUOUS test plan participate AUTOMATED context GOVERNANCE use case distributed access dashboards synchronize EASY HANDOFF trace LAB UTILIZATION functional PERFORMANCE security compliance
Rational Quality Manager Features Providing full control, execution, and governance to improve the quality of your software. Work Item collaboration across roles (both automatic and manual) Test Plan/Case Versioning Integrated Test Plan data Full feature Manual Tester in QM Dynamic linkages to requirements and defects Open Test Framework with published schema and APIs Process Enactment that can be customer customized Management and execution of testing tools Customized dashboards for each user
New! Rational Quality Manager Requirements Management IBM Collaborative Application Lifecycle Management Rational Quality Manager Quality Dashboard Test Management Defect Management Create Plan Build Tests Manage Test Lab Execute Tests Report Results Best Practice Processes JAZZ TEAM SERVER Functional Testing Performance Testing Open Lifecycle Service Integrations Web Service Quality Code Quality Security and Compliance
Quality Governance Customized dashboards for each user User customized layout and content DRAFT
Customizable Test Plans Adaptive and automated test plan management Customizable Test Plan sections can be assigned to individual user roles. Rich test plan captures dynamic data, synchronizes team efforts Testing tasks can be assigned to owners and tracked via the test plan Every changing requirements and test cases are captured in live documentation
Collaboration Work Items Task management for individuals and teams Individual Task List Team event log Visualize commitments to reduce rework Know what others are doing Know what others expect from you Track tasks assigned to each team member Monitor team events Event logs update automatically as activities occur
Reviews and Approvals Stakeholders remain actively engaged throughout the quality lifecycle Artifact Reviews and Approvals Review and approval of artifacts Complete artifact versioning Web Based Acceptance Testing
Integrated Manual Test Execution and Results all from the new web console Manual Test Execution Manual test author and execute Step by step capture and execution of manual tests Rich defect capture during execution, including screenshot and attachments Data Assist during Test Execution Leverage Keywords for test reuse and modularity
Automatic Test Coverage Computing configurations for your test Configuration Awareness Plan for test execution across all of your target environments Rational Quality Manager will determine most efficient execution path for optimal coverage
Test Case Management Determining the impact to test cases The test cases should be automatically marked to indicate their validity and blocked status. Project Requirements Project Test Cases Project Defects 1 2 1 2 3 4 3 4 5 6 5 6 7 8 7 8 9 10 9 10
Test Automation Products Additional updates to the portfolio in 8.0 Function Tester Rational Functional Tester 8.0 Image Comparator Additional Environment Support (GEF, Net 3.0, SAP GUI 7.1, Dojo 1.0.2 support Web Execution and results through RQM Service Tester Performance Tester Rational Service Tester 8.0 Auto-Creation of test assets Publish/Find in UDDI & WSRR repository Web Execution and results through RQM Rational Performance Tester 8.0 Usability improvements via Eclipse Clean Look Additional Environment Support (SAP) Kerberos security support IPV6 support Web Execution and results through RQM
Where are you today? Where do you want to be? Level 0 No documented quality processes. Very little testing is done, if at all. No recognition of the need for QA. Most teams are at Level 1 or 2 today. Level 1 Testing is mostly manual. No linkage to requirements or defect impact. No Test Lab management. Traceability is low. Level 2 Good QA practices, but done on an individual team level. Linkage to requirements and defect impact. Automation is started. No structured Test Lab management. Level 3 Centralized QA practices are documented and followed. Automation is very high. Build verification is automatic and thorough. Effective use of test lab management. Strong governance reporting. Level 4 Clear project QA goals are centrally documented. Automation is very high. Linkage to requirements and defect impact. Excellent use of test lab management. Strong governance reporting. Quality expanded to security, compliance, etc. Agnostic Awareness Practiced Compliant Thought Leader
Quality Management Summary Understand the entire application quality lifecycle Enable Team Collaboration and best practices Increment and automate as much as possible Govern with your business goals in focus Expand your scope of quality beyond code defects
Get started today. Visit us online today!!! Get Started Today with Rational Quality Manager Open Beta www14.software.ibm.com/iwm/web/cc/e arlyprograms/rational/qmopen/ Come blog with us www.qualitymanager.wordpress.com
THANK YOU