Risk-Based Testing: Analysis and Strategy. Presented at Quality Assurance Institute QUEST Conference Chicago, Ill., 2009
|
|
- Benjamin Hunt
- 6 years ago
- Views:
Transcription
1 Risk-Based Testing: Analysis and Strategy Presented at Quality Assurance Institute QUEST Conference Chicago, Ill., 2009 Clyneice Chaney, CMQ/OE, PMP April 21, 2009
2 Workshop Outline Part I Risk Management and Testing Risk-Based Testing Process Identification Analysis Part II Risk-Based Testing Process Response Planning Test Scoping and Coverage Test Process Managing and Reporting From the Risk Perspective 2
3 Pressured Testers? When and why should we stop testing? How much testing is enough? When is the product good enough for release? How good is our testing anyway? 3
4 Risk Management and Testing Risk Identification Test Risk Checklist Catalogs Test Scoping Risk Analysis Risk Mitigation Risk Resolution and Monitor Risk Matrix Risk Plan Test Plan/ Strategy Testing, Reviews, Metrics, Reports Test Process Identification 4 Figure: Risk Based E-Business Testing: Gerrard & Thompson
5 Risk-Based Test Process Answers: When to Stop? Typical All planned tests completed All incidents raised resolved All defects fixed and retested All regression test run without failure Risk-based What are the risks of stopping NOW? What are the benefits of stopping NOW? Have sufficient benefits been delivered? What evidence to I have to support the release decision? Are product risks and failure points resolved?
6 Categorizing Software and Risk Process Risks Testing process Development process Project processes Project Risks Late tester involvement Mandated dates Product Risks Platform Component Integration Infrastructure Usability 6
7 Risk-Based Test Process Risk Identification Risk Analysis Risk Response Test Scoping Test Process Definition Consult business and technical staff Prepare a draft registrar of risks Discuss risks Assign probability and consequences Calculate exposure Formulate test objectives and test techniques Document dependencies, requirements, times scales Assign test effectiveness score Nominate responsibilities Agree on scope of risks to be addressed Agree on responsibility and budget Agree on quality criteria Draft test process Complete test-stage definitions 7 Figure: Risk Based E-Business Testing: Gerrard & Thompson
8 Risk Identification Risk Identification Consult business and technical staff Prepare a draft list of risks 8
9 Risk Identification Modes Risk workshops Individualized risk identification 9
10 Using Checklists/Catalogues Project-based checklists Quality-centric checklists Product-based checklists 10
11 Probability of Failure: Generic Product Risk Checklist Potential risk (High, Medium, Low, Not Applicable [N/A]) Module A Module B Module C Module D 1. Heavily used module High -5 N/A -0 Medium-3 High Very complex module High -5 High -5 Low Modules fixed or updated often Low -1 Low -1 Low -1 Low High availability functions N/A -0 N/A -0 N/A -0 N/A Functions requiring consistent performance levels Medium-3 N/A -0 Low -1 Medium-3 6. Functions using new tools & languages N/A -0 N/A -0 N/A -0 N/A Functions with many interfaces N/A -0 N/A -0 Low -1 Medium-3 8.Developed by inexperienced developers N/A -0 N/A -0 N/A -0 N/A Developed with inadequate user involvement High -5 High -5 High -5 High Developed by large development teams High -5 High -5 High -5 High Completely new functions High -5 N/A -0 N/A -0 High Developed under extreme time pressure Medium-3 Low -1 Low -1 High Functions with large # defects in previous versions Medium-3 Low -1 Medium-3 High Most important function to stakeholders N/A -0 N/A -0 Low -1 High -5 Risk Score
12 Project Risk Analysis (Test) Risk Factor N A Probability Impact (HML) Mitigation Low Medium High What is development relationship to testing? Supportive Uninvolved Adversarial Is the test schedule timeconstrained? Based on estimated Mandated, but flexible with date Mandated, little or no flexibility with date NA = not applicable H = high M = medium L = low
13 Quality Risks Checklist Quality Expectations Scale: Relative importance Module A Module B Module C Module D 1. Capability: Can it perform required features High -5 N/A -0 Medium-3 High Reliability: Will it work and resist failures in required situations High -5 High -5 Low Usability: How easy is it for real users? Low -1 Low -1 Low -1 Low Performance: How speedy and responsive is it? N/A -0 N/A -0 N/A -0 N/A Installability: How easily can it be installed? Medi-3 N/A -0 Low -1 Medium-3 6. Compatibility: How well does it work with external components? N/A -0 N/A -0 N/A -0 N/A Supportability: How economical will it be to provide support? N/A -0 N/A -0 Low -1 Medium-3 8. Testability: How effectively can it be tested? High -5 N/A -0 Medium-3 High Maintainability: How economical is it to support? High -5 High -5 Low -1 Medium Portability: How economical to port or reuse? Low -1 Low -1 Low -1 Low Localizability: How economical to utilize in another language? N/A -0 N/A -0 N/A -0 N/A -0 N/A = not applicable
14 Product-Based Risk Approaches Inside-out study product and ask questions Outside-in begin with set of potential risks as in a checklist 14
15 Inside-out: Questions What if the function fails? Can function ever be invoked at the wrong time? What error checking is where? What is the biggest load a process can handle? Can any components be tampered with or influenced by other processes? Study the product and ask repeatedly: What could go wrong here? Vulnerabilities: What weakness or possible failures are there in this component? Threats: What inputs or situations could there be that might exploit a vulnerability and trigger a failure in this component? Victims: Who or what could be impacted by potential failures and how badly? 15
16 Outside-in What components have these kinds of risk? Begin with set of potential risks Begin with risk checklists Quality criteria Generic risks Risk catalogs Easier than inside-out 16
17 Documenting Product Risks ID Risk Data Conversion 01 Converting Social Security number to non-privacy field may cause records to be lost Integration 04 Records created in scanning must be successfully accepted by workflow engine
18 Risk Identification and Outcome Product Risks Process Risks Project Risks Module A: very complex High usability requirement Security for Module A critical Defect tracking process absent Configuration management issue Turnover in software developers Must be completed by conference 18
19 Risk Analysis Risk Analysis Discuss risks Assign probability and consequences Calculate exposure 19
20 Group the lists by similarity Risk Analysis Delegate the risk Accept the risk as valid Investigate the risk further Analysis For each item on the list: Determine its testability 20
21 Impact Risk Analysis Risk Consequences Consequence Description Score Critical Business objective can t be 5 accomplished High Business objective will be undermined 4 Moderate Business objective will be affected 3 Low Business objective will be affected slightly 2 Negligible There will be no noticeable effect 1 21
22 Probability Risk Analysis Assessing Probability Probability Description Score Almost certainly, highly likely Probable, likely, we believe We doubt, improbable, better than 3 even Unlikely, probably not Highly unlikely, chances are slight 1 22
23 Risk Analysis Exposure = Probability X Consequence 23
24 Documenting Risks ID Risk Probability Consequence Exposure Data Conversion 01 Converting Social Security number to non-privacy field may cause records to be lost Integration 04 Records created in scanning must be successfully accepted by workflow engine
25 Part 1 Summary Describe the relationship of software and risk and the rise of risk-based testing. Describe why standard project risk management is inadequate for testers. Define the three highlevel categories of risks. Describe risk analysis in the risk-based testing process. Describe the three components of risk analysis. Describe a rating scheme for calculating risk exposure.
26 Risk Response Risk Response Identify and document strategies for process and project risks Formulate test objectives and test techniques for product risks Document dependencies, requirements, times scales Assign test effectiveness score Identify role responsibility 26
27 Project and Process Risk Response Planning Preemptive Measures (preventative) Reactive (risk reduction) 27
28 Product Risk Response Risk Response Identify and document strategies for process and project risks Formulate test objectives and test techniques for product risks Document dependencies, requirements, times scales Assign test effectiveness score Identify role responsibility 28
29 Test Strategies Finding the answers to: How Find Critical Prob Test What Areas? Why? Techniques & Tools Types Test? When? 29
30 Developing a Risk based Test Strategy 30
31 Quality Expectations Business Benefit Uncertainty Find Problem Most Rework Find Problems Early Risk-based Testing Goal Find Important Problems 31
32 Getting to a Risk-based Test Strategy Step 1 Review product risks Review quality requirements Step 2 Identify what to test and how much Step 3 Determine types of test to use and when Step 4 Determine test techniques used 32
33 Deciding on Test Techniques Considerations Quality characteristics Area of application Extent of formality Use of resources Required knowledge skill 33
34 Good Test Strategies Diversified Based on Maturity Characteristics Riskfocused Productspecific Practical 34
35 Test Strategy ID Prob Co n Converting Social Security number to non-privacy field may cause records to be lost Integration Records created in scanning must be successfully accepted by workflow engine Ex Objective Test Types/ Phase Verify traceability of Social Security number to all customer records Integration: Functional Unit Test: Functional Role Test Dev 35
36 Failure Mode: Test Process Worksheet Column # Column Heading Column description Test Process Worksheet Stage 1 Risk (failure mode) Brief description of risk Create in identification 2 Benefits threatened Business benefit threatened Create in identification 3 Probability Likelihood of system failure Create in analysis 4 Consequence Impact of failure Create in analysis 5 Exposure Calculate column 3X4 Create in analysis 6 Test effectiveness Confidence in ability address risk Create in risk response 7 Test priority num Calculate column 3, 4, 6 Create in risk response 8 Test objective Objective used to address risk Create in risk response 9 Test technique Test technique method used Create in risk response 10 Dependencies Tester assumptions Create in risk response 11 Effort Effort required to test Create in risk response 12 Timescale Elapsed time required to test Create in risk response 13 Test stage A, B, etc Group responsible for test activity Create in risk response
37 Test Scoping Test Scoping Agree scope of risks to be addressed Agree on responsibility and budget Agree on quality criteria 37
38 Determining Scope Evaluate the risk and associated test objectives Evaluate generic test objectives Utilize quality requirements Determine testing scope with stakeholder and team 38
39 Risk-Based Test Objectives ID Risk Test Objective Technique 01 Links to other on-site objects don t work 04 Links to server-based functionality don t work Verify links to on-site objects load correctly Verify following: Correct component referenced Data passed to component correctly Link checking Transaction verification 06 Middleware, connectively or custom-built, components fail when used extensively Demonstrate that integrated components do not fail with repeated user or use over extended period time Transaction link testing 39
40 Generic Test Objectives ID Test Objective Typical Test Activity 01 Demonstrate component meets requirements Component testing 02 Demonstrate component ready for reuse in subsystem Component testing 03 Demonstrate integrated components work together Integration testing 04 Demonstrate system meets functional requirements Functional testing 05 Demonstrate meeting nonfunctional requirements Nonfunctional testing 06 Demonstrate meeting regulatory requirements System/acceptance testing 07 Demonstrate meeting contractual requirements Contract acceptance 08 Validate system meets business or user requirements User acceptance testing 09 Demonstrate system, processes, and people meet business requirements User acceptance testing 40 Reprinted from Risk Based ebusiness Testing
41 Test Process Test Process Definition Draft test process Complete test activities definitions 41
42 Test Process Determination: Can the Strategy Be Implemented? Evaluate test strategy in light of resources and tools Identify training needs to support strategy Are all tools/products in place to support? Are any new tools/products needed? Does the strategy make use of available resources? Is everything in the strategy necessary? 42
43 Finalizing Test Strategy in Test Plan Entrance/exit criteria for phases Test data needed Environment needed 43
44 Test Activity Template Test Phase/Activity Description: Object Under Test: {Enter testing activity such as unit, system, acceptance}. Test Objective: Number of Test Planned: Entry Criteria: Exit Criteria: Environment: Risk Analysis: Risk Strategy: Execution: Management: Sign Off 44 Reprinted from Gerrard & Thompson Risk Based ebusiness Test Strategy
45 Master Test Plan I. Introduction A. Purpose and scope of document B. Purpose and scope of the project II. Risk analysis A. Summarize risk process utilized B. Summarize project constraints and or contingencies C. Summarize project assumptions D. Summarize project, process, and product risks III. Quality standard A. Summarize agreed upon quality criteria B. Summarize identified and agreed upon critical success factors 45
46 Risk Resolution and Monitoring Process Risks Testing process Development process Project processes Project Risks Late tester involvement Mandated dates Product Risks Platform Component Integration Infrastructure Usability 46
47 System RISK DASHBOARD Friday April 6, 2007 Dashboard High Risk Table Risk The system Modernization may require the collection of additional data points from licensees The system Modernization may result in changes to the way licensees connect and provide data to the XXX system. Status Impact Probability Ranking Priority High High Current schedule is based on timely identification, selection, and acquisition of Software and Hardware The system will not have full failover and redundancy (Release 2) at the time of deployment since the failover requires the deployment of PI collectors at each data collection site. If failure occurs, full failover may not take place until sites have implemented the proper interface technologies. Currently PI user interface does not satisfy all 508 requirements (a failure to meet NRC requirements) for prototype and may not be ready for accelerated release schedule. As written, some requirements may not be fully testable Coordination of production hardware installation within NRC may be difficult CTF may not be available or have space when the system is ready for security testing, and the schedule does not have much slack built into it for delays caused by the CTF High High High High High High The complexity of the system and the requirements for a full-c&a may prevent the receipt of an ATO prior to the current operational date of early September 2007 Relocation of Region 4 Office site (August/September time frame mentioned) may cause problems with the backup configuration. (Release 1) Screen requirements have not been fully developed or agreed to. The volume of support material, and the amount of time that will be (and have been) required to complete the support material has placed a strain on the budget. Software selected is not currently 508 compliant. If software remains out of compliance when it is required to go into production then it will violate government regulations. If prototype equipment does not arrive in time for the development of the prototype dayto-day schedule slippage will occur High High High High High High Open vs. Closed Risks Key On Hold or waiting clarification Currently being mitigated Volatile or currently un-mitigated
48 Managing Test Project Risks Develop a workable schedule with frequent milestones to use in tracking the testing project Aggressively fight slippage Predict and track the likely causes of delay Aggressively manage defect aging Have an early warning process to identify test bottlenecks and resolve them quickly Measure how time is being used Be proactive, not passive 48
49 Risk- and Benefit-based Reporting Base reports on the number of risks mitigated or addressed Use metrics to track progress Base reports on number of benefits/critical success factors attained 49
50 Risk-to-Benefit Reporting Risks Benefit 1 Benefit 2 Goals 1 Goals 2 1. Interfaces: Open X X X 2. Security: Closed X X 3. Usability: Open X 4. Performance: X Open 5. Load: Closed X X X
51 Summary Risk-Based Test Process Risk Identification Risk Analysis Risk Response Test Scoping Test Process Definition Consult business and technical staff Prepare a draft registrar of risks Discuss risks Assign probability and consequences Calculate exposure Formulate test objectives and test techniques Document dependencies, requirements, times scales Assign test effectiveness score Nominate responsibilities Agree on scope of risks to be addressed Agree on responsibility and budget Agree on quality criteria Draft test process Complete test-stage definitions 51 Figure: Risk Based E-Business Testing: Gerrard & Thompson
52 References Risk Based e-business Test Strategy. Paul Gerrad, Neil Thompson. Artech House. Boston2002. Manage and Strengthen Testing: Speeding the Software Delivery Process, Part 1. Ross Collard Conduct Early and Streamlined Testing: Speeding the Software Delivery Process, Part 2. Ross Collard Manage the Risks and the Process: Speeding the Software Delivery Process, Part 3. Ross Collard Troubleshooting Risk based Testing. James Bach Satisfice, Inc. 52
Introducing Risk Based Testing to Organizations
Introducing Risk Based Testing to Organizations Abridged Version Dr. Rajesh Subramanyan Software Engineering Siemens Corporate Research Princeton NJ. Rajesh.subramanyan@siemens.com Outline Topics Introduction
More informationINF 3121 Software Testing - Lecture 05. Test Management
INF 3121 Software Testing - Lecture 05 Test Management 1. Test organization (20 min) (25 min) (15 min) (10 min) (10 min) (10 min) INF3121 / 23.02.2016 / Raluca Florea 1 1. Test organization (20 min) LO:
More informationWORK PLAN AND IV&V METHODOLOGY Information Technology - Independent Verification and Validation RFP No IVV-B
1. Work Plan & IV&V Methodology 1.1 Compass Solutions IV&V Approach The Compass Solutions Independent Verification and Validation approach is based on the Enterprise Performance Life Cycle (EPLC) framework
More informationQUALITY ASSURANCE PLAN OKLAHOMA DEPARTMENT OF HUMAN SERVICES ENTERPRISE SYSTEM (MOSAIC PROJECT)
QUALITY ASSURANCE PLAN OKLAHOMA DEPARTMENT OF HUMAN SERVICES ENTERPRISE SYSTEM (MOSAIC PROJECT) MOSAIC Quality Assurance Plan v04.02 Prepared by: Approved by: QUALITY ASSURANCE PLAN APPROVALS QA/QC Program
More informationTest Workflow. Michael Fourman Cs2 Software Engineering
Test Workflow Michael Fourman Introduction Verify the result from implementation by testing each build Plan the tests in each iteration Integration tests for every build within the iteration System tests
More informationThis document describes the overall software development process of microcontroller software during all phases of the Company Name product life cycle.
Maturity Process Owner Check Release Description Valid Name / Department Name / Department Name / Department Detailed procedure for software development Title: Software Development Procedure Purpose: This
More informationWork Plan and IV&V Methodology
Work Plan and IV&V Methodology Technology initiatives and programs should engage with an IV&V process at the project planning phase in order to receive an unbiased, impartial view into the project planning,
More informationREQUIREMENT DRIVEN TESTING. Test Strategy for. Project name. Prepared by <author name> [Pick the date]
REQUIREMENT DRIVEN TESTING Test Strategy for Project name Prepared by [Pick the date] [Type the abstract of the document here. The abstract is typically a short summary of the contents of
More informationSoftware Quality Engineering Courses Offered by The Westfall Team
Building Skills is a 3-day course that is a subset of our course. The course is designed to provide a fundamental knowledge base and practical skills for anyone interested in implementing or improving
More informationCMMI-DEV V1.3 CMMI for Development Version 1.3 Quick Reference Guide
processlabs CMMI-DEV V1.3 CMMI for Development Version 1.3 Quick Reference Guide CMMI-DEV V1.3 Process Areas Alphabetically by Process Area Acronym processlabs CAR - Causal Analysis and Resolution...
More informationSoftware Quality Engineering Courses Offered by The Westfall Team
Courses is a 2-day course that is a subset of our course. The course is designed to provide an overview of techniques and practices. This course starts with an overview of software quality engineering
More informationSOLUTION BRIEF RSA ARCHER PUBLIC SECTOR SOLUTIONS
RSA ARCHER PUBLIC SECTOR SOLUTIONS INTRODUCTION Federal information assurance (IA) professionals face many challenges. A barrage of new requirements and threats, a need for better risk insight, silos imposed
More informationBiometrics Enterprise Architecture Systems Engineering Management Plan (BMEA SEMP)
Biometrics Enterprise Architecture Systems Engineering Management Plan (BMEA SEMP) Version 1.0 Prepared by: Date: November 24, 2009 Revision History Purpose Revision Date Level 11/17/2009 First Draft 1.0
More informationSoftware Quality. Unit 6: System Quality Requirements
Software Quality Unit 6: System Quality Requirements System Requirements Best products, from users point of view, are those which have been developed considering organizational needs, and how product is
More informationPART THREE: Work Plan and IV&V Methodology (RFP 5.3.3)
PART THREE: Work Plan and IV&V Methodology (RFP 5.3.3) 3.1 IV&V Methodology and Work Plan 3.1.1 NTT DATA IV&V Framework We believe that successful IV&V is more than just verification that the processes
More informationAdvantages and Disadvantages of. Independent Tests. Advantages. Disadvantages
8.0 Test Management Outline 8.1 Test organisation 8.2 Test planning and estimation 8.3 Test program monitoring and control 8.4 Configuration management 8.5 Risk and testing 8.6 Summary Independent Testing
More informationThis resource is associated with the following paper: Assessing the maturity of software testing services using CMMI-SVC: an industrial case study
RESOURCE: MATURITY LEVELS OF THE CUSTOMIZED CMMI-SVC FOR TESTING SERVICES AND THEIR PROCESS AREAS This resource is associated with the following paper: Assessing the maturity of software testing services
More informationRisk Based Testing. -Why we need RBT? -Types of risks -Managing risks -Methods of evaluation & risk analysis -Costs and benefits
Risk Based Testing -Why we need RBT? -Types of risks -Managing risks -Methods of evaluation & risk analysis -Costs and benefits Ladislau Szilagyi www.euroqst.ro Definitions (ISTQB glossary) Risk = a factor
More informationReport of the Reliability Improvement Working Group (RIWG) Volume II - Appendices
Report of the Reliability Improvement Working Group (RIWG) Volume II - Appendices Appendix 1 Formulate Programs with a RAM Growth Program II-1 1.1 Reliability Improvement Policy II-3 1.2 Sample Reliability
More information3 PART THREE: WORK PLAN AND IV&V METHODOLOGY (SECTION 5.3.3)
3 PART THREE: WORK PLAN AND IV&V METHODOLOGY (SECTION 5.3.3) Emagine IT s approach to Independent Verification and Validation (IV&V) has been shaped over the years by hands-on experience and contributions
More informationContractual Aspects of Testing Some Basic Guidelines CONTENTS
CONTENTS 1 Introduction... 1 1.1 Background... 1 1.2 Structure... 1 1.3 Some Conventions... 1 1.4 Feedback... 1 2 Test Schedule List of Contents... 2 3 Testing Deliverables... 3 4 Coverage Guidance...
More information1.0 PART THREE: Work Plan and IV&V Methodology
1.0 PART THREE: Work Plan and IV&V Methodology 1.1 Multi-Faceted IV&V Methodology Large, complex projects demand attentive and experienced IV&V and project management support to meet expectations. Monitoring
More informationChapter 5 Part Test progress monitoring and control. 4. Configuration management. 5. Risk and testing. 6. Incident management
INF 3121 Software Testing Test progress monitoring and Chapter 5 Part 2 3.3 Test Test progress monitoring and LO: Recall common metrics used tor test preparation and execution LO: Explain and compare metrics
More informationTesting 2. Testing: Agenda. for Systems Validation. Testing for Systems Validation CONCEPT HEIDELBERG
CONCEPT HEIDELBERG GMP Compliance for January 16-17, 2003 at Istanbul, Turkey Testing for Systems Validation Dr.-Ing. Guenter Generlich guenter@generlich.de Testing 1 Testing: Agenda Techniques Principles
More informationPassit4Sure.OG Questions. TOGAF 9 Combined Part 1 and Part 2
Passit4Sure.OG0-093.221Questions Number: OG0-093 Passing Score: 800 Time Limit: 120 min File Version: 7.1 TOGAF 9 Combined Part 1 and Part 2 One of the great thing about pass4sure is that is saves our
More informationHow To Evolve a Context-Driven Test Plan
How To Evolve a Context-Driven Test Plan This guide will assist you with your test planning. Remember, the real test plan is the set of ideas that actually guides your testing. We ve designed the guide
More informationRequirements Verification and Validation
SEG3101 (Fall 2010) Requirements Verification and Validation SE502: Software Requirements Engineering 1 Table of Contents Introduction to Requirements Verification and Validation Requirements Verification
More informationPROJECT SCOPE STATEMENT
PROJECT SCOPE STATEMENT Note: Any work not explicitly included in the Project Scope Statement is implicitly excluded from the project. Project Name: Prepared by: Airline Reservation Kiosk for Connected
More informationSoftware Project & Risk Management Courses Offered by The Westfall Team
Software Project & Risk Management is a 5-day course designed to provide a knowledge base and practical skills for anyone interested in implementing or improving Software Project and Risk Management techniques
More informationChapter 4 Software Process and Project Metrics
Chapter 4 Software Process and Project Metrics 1 Measurement & Metrics... collecting metrics is too hard... it's too time-consuming... it's too political... it won't prove anything... Anything that you
More informationTest Management: Part II. Software Testing: INF3121 / INF4121
Test Management: Part II Software Testing: INF3121 / INF4121 Summary: Week 7 Test organisation Independence Tasks of the test leader and testers Test planning and estimation Activities Entry and exit criteria
More informationQuantifying the Value of Investments in Micro Focus Quality Center Solutions
Dynamic Value Brief Application Delivery Management Quantifying the Value of Investments in Micro Focus Quality Center Solutions Manage software testing and IT quality management with consistent processes
More informationLarge Federal Agency Leverages IV&V to Achieve Quality Delivery for Critical Modernization Initiative
Large Federal Agency Leverages IV&V to Achieve Quality Delivery for Critical Modernization Initiative Capgemini Government Solutions provides Independent Verification and Validation (IV&V) services to
More informationCHAPTER 2: IMPLEMENTATION PHASES AND OFFERINGS
CHAPTER 2: IMPLEMENTATION PHASES AND OFFERINGS Objectives Introduction The objectives are: Describe the purpose of the phase planning activity, preconditions, and deliverables in the implementation methodology.
More informationTesting. CxOne Standard
Testing CxOne Standard CxStand_Testing.doc November 3, 2002 Advancing the Art and Science of Commercial Software Engineering Contents 1 INTRODUCTION... 1 1.1 OVERVIEW... 1 1.2 GOALS... 1 1.3 BACKGROUND...
More informationM3 Playbook Guidance. 1.1 Establish Initial Customer PMO and Processes. Human Resources (HR)/Staffing Plan
M3 Playbook Guidance Phase 1: Readiness This guidance is intended for use by organizations to confirm and validate that their plans are comprehensive and have adequate level of detail for proper migration
More informationProject Manager s Roadmap We re all smarter together
Version 7.0a Project Manager s Roadmap We re all smarter together Think Top Down! Methodology Checklists Define Plan Execute Close Conflict Resolution Modes Contract Outsource Management Mentoring References
More informationCapability Maturity Model the most extensively used model in the software establishments
International Journal of Scientific and Research Publications, Volume 6, Issue 5, May 2016 710 Capability Maturity Model the most extensively used model in the software establishments Ajith Sundaram Assistant
More informationISTQB Sample Question Paper Dump #11
ISTQB Sample Question Paper Dump #11 1. Which of the following is true a. Testing is the same as quality assurance b. Testing is a part of quality assurance c. Testing is not a part of quality assurance
More informationProject Procedures 1.0 PURPOSE 2.0 SCOPE 3.0 REFERENCES. No.: P /21/2012 PAGE 1 OF 13 BASIS OF OPERATION
Project Procedures BASIS OF OPERATION 09/21/2012 PAGE 1 OF 13 1.0 PURPOSE The purpose of this procedure is to establish the basis of operations that ensures that Project activities, including engineering,
More informationREQUIREMENTS DOCUMENTATION
REQUIREMENTS DOCUMENTATION Project Title: Date Prepared: Stakeholder Requirement Category Priority Acceptance Criteria REQUIREMENTS DOCUMENTATION Project Title: Date Prepared: Stakeholder Requirement Category
More informationThoughts about modelbased test management. Matti Vuori
Thoughts about modelbased test management Matti Vuori 7.4.2016 Contents 1/2 Introduction 4 Areas of traditional test management 5 Test monitoring and control re ISO 29119 6 Linked to other activities 7
More informationSOFTWARE QUALITY ASSURANCE (SQA) Chapter 1
Contents Definition of quality The importance of Quality QA vs QC QA at each phase of SDLC The SQA function Objectives of SQA The benefits of SQA function SQA Roles & Responsibilities Management involvement
More informationContents About This Guide... 5 Upgrade Overview... 5 Examining Your Upgrade Criteria... 7 Upgrade Best Practices... 8
P6 EPPM Upgrade Best Practices Guide 16 R2 September 2016 Contents About This Guide... 5 Upgrade Overview... 5 Upgrade Process... 5 Assessing the Technical Environment... 6 Preparing for the Upgrade...
More informationProject Management Professionals
A COLLECTION OF INTERVIEW QUESTIONS FOR Project Management Professionals When interviewing a Project Manager, it s important to set up the discussion for the first couple of minutes in an open dialogue.
More informationSurviving the Top Ten Challenges of Software Testing
Surviving the Top Ten Challenges of Software Testing: A Closer Look at Understanding Software Testing Randy Rice, CQA, CSTE Rice Consulting Services, Inc. 405-692-7331 http://www.riceconsulting.com rcs@telepath.com
More informationCMMI-SVC V1.3 CMMI for Services Version 1.3 Quick Reference Guide
processlabs CMMI-SVC V1.3 CMMI for Services Version 1.3 Quick Reference Guide CMMI-SVC V1.3 Process Areas Alphabetically by Process Area Acronym processlabs CAM - Capacity and Availability Management...
More informationRational Software White Paper TP 174
Reaching CMM Levels 2 and 3 with the Rational Unified Process Rational Software White Paper TP 174 Table of Contents Abstract... 1 Introduction... 1 Level 2, Repeatable... 2 Requirements Management...
More informationT Software Testing and Quality Assurance Test Planning
T-76.5613 Software Testing and Quality Assurance 10.10.2007 Test Planning Juha Itkonen Outline Test planning, purpose and usage of a test plan Topics of test planning Exercise References: IEEE Std 829-1998,
More informationInformation Technology Independent Verification and Validation
Florida Department of Management Services Information Technology Independent Verification and Validation RFP No. Work Plan and Methodology ; 2:30 PM EST 2150 River Plaza Drive Suite 380 Sacramento California
More informationISTQB CTFL BH QuestionsAnswers with Explanation
ISTQB CTFL BH0-10 - QuestionsAnswers with Explanation For Software Testing Articles Visit @ http://softwaretestinghelp.com Join the Best Software Testing Training Course @ http://softwaretestinghelp.org
More informationCMMI for Services Quick Reference
CAPACITY AND AVAILABILITY MANAGEMENT PROJECT & WORK MGMT (ML3) The purpose of Capacity and Availability Management (CAM) is to ensure effective service system performance and ensure that resources are
More information0 Introduction Test strategy A Test Strategy for single high-level test B Combined testing strategy for high-level tests...
TPI Automotive Test Process Improvement Version: 1.01 Author: Sogeti Deutschland GmbH Datum: 29.12.2004 Sogeti Deutschland GmbH. Version 1.01 29.12.04-1 - 0 Introduction... 5 1 Test strategy...10 1.A Test
More informationTechnical Integration Testing Requirements. Trusted Digital Identity Framework August 2018, version 1.0
Technical Integration Testing Requirements Trusted Digital Identity Framework August 2018, version 1.0 Digital Transformation Agency This work is copyright. Apart from any use as permitted under the Copyright
More informationSources of Schedule Risk
Sources of Schedule Risk Schedule risks are second most numerous in the PERIL database after scope risks, representing almost a third of the records. They fall into three categories: delays, estimates,
More informationAppendix C: MS Project Software Development Plan and Excel Budget.
1. Introduction. Appendix C: MS Project Software Development Plan and Excel Budget. Project: PickUp Game App The Project plan for this Application consist of 76 days; In this plan is defined how long each
More informationEngineering. CMMI for Development V.1.2 Module 3. M03/Engineering/v1.2
Engineering CMMI for Development V.1.2 Module 3 M03/Engineering/v1.2 Agenda Global scope RD Development REQM Management TS Technical Solution PI Product Integration VER Verification VAL Validation SE Process
More informationUPGRADE CONSIDERATIONS Appian Platform
UPGRADE CONSIDERATIONS Appian Platform ArchiTECH Solutions LLC 7700 Leesburg Pike #204 www.architechsolutions.com 703-972-9155 atsdelivery@architechsolutions.com TABLE OF CONTENTS Introduction... 3 Upgrade
More informationRequirement Management in Testing
Requirement Management in Testing Anindita Sarkar Project Manager Infosys Technologies Limited, Bangalore Abstract: This paper discusses the issues we have faced in our testing projects in managing requirements,
More informationRequirements Engineering
Requirements Engineering Professor Ray Welland Department of Computing Science University of Glasgow E-mail: ray@dcs.gla.ac.uk The Importance of Requirements Identifying (some) requirements is the starting
More informationCMMI for Acquisition Quick Reference
AGREEMENT MANAGEMENT PROJECT MANAGEMENT (ML2) The purpose of Agreement Management (AM) is to ensure that the supplier and the acquirer perform according to the terms of the supplier agreement. SG 1 The
More informationSOFTWARE DEVELOPMENT STANDARD
SFTWARE DEVELPMENT STANDARD Mar. 23, 2016 Japan Aerospace Exploration Agency The official version of this standard is written in Japanese. This English version is issued for convenience of English speakers.
More informationIndependent Verification and Validation (IV&V)
Independent Verification and Validation (IV&V) 12 th Annual NDIA CMMI Conference November 2012 - Denver, CO The MITRE Corporation The author s affiliation with The MITRE Corporation is provided for identification
More informationDesign Planning. 1. Rationale 2. Iteration Planning 3. Risk Analysis 4. Quality Planning 5. Example. Iteration N
Design Planning 1. Rationale 2. Iteration Planning 3. Risk Analysis 4. Quality Planning 5. Example Initial risks Initial project scope Define iteration to address the highest risks Revise project plan
More informationProject Planning and Management (PPM) V2.0. WBS Dictionary
Project Planning and Management (PPM) V2.0 WBS Dictionary Software as a Service (SaaS) Version 1.0 August 2014 1 Table of Contents PPM V2.0 Work Breakdown Structure (WBS) Dictionary 1 Project Type: Software
More informationISTQB Certified Tester. Foundation Level. Sample Exam 1
ISTQB Certified Tester Foundation Level Version 2015 American Software Testing Qualifications Board Copyright Notice This document may be copied in its entirety, or extracts made, if the source is acknowledged.
More informationReference B Project Management Requirements
Reference B State of Alaska TABLE OF CONTENTS 1... 2 1.1 Project Life Cycle Methodology... 2 1.2 Preliminary Project Management Narrative and Work Plan... 2 2 Master Project Management Plan and Master
More informationConsistency in Quality Assessments
Consistency in Quality Assessments Debra Perry Harris Corporation November 18, 2009 NDIA CMMI Conference - 1 Providing Value To Our Customers Aviation electronics Communications and information networks
More informationSoftware Engineering (CSC 4350/6350) Rao Casturi
Software Engineering (CSC 4350/6350) Rao Casturi Recap What is software engineering? Modeling Problem solving Knowledge acquisition Rational Managing Software development Communication Rational Management
More informationWhite paper. Taking the pain out of data migrations
White paper Taking the pain out of data migrations Table of contents: Data migration is risky...1 Mastering the data migration...2 Plan, plan, and plan some more...2 Assess the landscape...2 Design, build,
More information7. Model based software architecture
UNIT - III Model based software architectures: A Management perspective and technical perspective. Work Flows of the process: Software process workflows, Iteration workflows. Check Points of The process
More informationCMMI V2.0 MODEL AT-A-GLANCE. Including the following views: Development Services Supplier Management. CMMI V2.0 outline BOOKLET FOR print.
CMMI V.0 MODEL AT-A-GLANCE Including the following views: Development Services Supplier Management CMMI V.0 outline BOOKLET FOR print.indd CMMI V.0 An Integrated Product Suite Designed to meet the challenges
More informationAgenda. Introduction. The Impact of Requirement Issues on Testing. Introduction. What are common requirements issues? What is the impact on testing?
The Impact of Requirement Issues on Testing Presented by Kirsten Kiefer, Software Education Associates Ltd Agenda Introduction What are common requirements issues? What is the impact on testing? What can
More informationOverview: Status Reports/Dashboards provide program leadership and governance with updates on program progress, and strategic program risks/issues.
M3 Playbook Guidance Phase 4: Migration This guidance is intended for use by organizations to confirm and validate that their plans are comprehensive and have adequate level of detail for proper migration
More informationManaging a Project and Keeping Sane While Wrestling Elegantly With PMBOK, Scrum and CMMI (Together or Any Combination)
Managing a Project and Keeping Sane While Wrestling Elegantly With PMBOK, Scrum and CMMI (Together or Any Combination) Neil Potter The Process Group neil@processgroup.com 1 Agenda Summary of PMBOK, CMMI
More informationDesign of an Integrated Model for Development of Business and Enterprise Systems
International Journal of Research Studies in Computer Science and Engineering (IJRSCSE) Volume 2, Issue 5, May 2015, PP 50-57 ISSN 2349-4840 (Print) & ISSN 2349-4859 (Online) www.arcjournals.org Design
More informationarxiv: v1 [cs.se] 4 Apr 2017
Checklists to Support Test Charter Design in Exploratory Testing Ahmad Nauman Ghazi, Ratna Pranathi Garigapati, and Kai Petersen arxiv:1704.00988v1 [cs.se] 4 Apr 2017 Blekinge Institute of Technology,
More information1. Can you explain the PDCA cycle and where testing fits in?
1. Can you explain the PDCA cycle and where testing fits in? Software testing is an important part of the software development process. In normal software development there are four important steps, also
More informationRisk Management. Andrea Polini. Software Project Management MSc in Computer Science University of Camerino A.Y. 2016/2017
Risk Management Andrea Polini Software Project Management MSc in Computer Science University of Camerino A.Y. 2016/2017 Andrea Polini Risk Management SPM A.Y. 2016/2017 1 / 31 Risks First, risk concerns
More informationTesting Masters Technologies
1. How will you receive the project requirements? A. The finalized SRS will be placed in a project repository; we will access it from there 2. What will you do with SRS? A. SRS stands for software requirement
More informationAGENCY FOR STATE TECHNOLOGY
AGENCY FOR STATE TECHNOLOGY PROJECT RISK & COMPLEXITY ASSESSMENT TOOL Risk & Complexity Assessment Model for State Information Technology Projects Purpose: In order to determine the level of risk associated
More informationChapter 6. Software Quality Management & Estimation
Chapter 6 Software Quality Management & Estimation What is Quality Management Also called software quality assurance (SQA) s/w quality:- It is defined as the degree to which a system, components, or process
More informationversion NDIA CMMI Conf 3.5 SE Tutorial RE - 1
Requirements Engineering SE Tutorial RE - 1 What Are Requirements? Customer s needs, expectations, and measures of effectiveness Items that are necessary, needed, or demanded Implicit or explicit criteria
More informationISTQB-Level1 ASTQB. American Software Testing Qualifications Board Level 1
ASTQB ISTQB-Level1 American Software Testing Qualifications Board Level 1 Download Full Version : https://killexams.com/pass4sure/exam-detail/istqb-level1 QUESTION: 46 Comparing TMMi and TPI, which is
More informationHow Can I Better Manage My Software Assets And Mitigate The Risk Of Compliance Audits?
SOLUTION BRIEF CA SERVICE MANAGEMENT - SOFTWARE ASSET MANAGEMENT How Can I Better Manage My Software Assets And Mitigate The Risk Of Compliance Audits? SOLUTION BRIEF CA DATABASE MANAGEMENT FOR DB2 FOR
More information2014 Integrated Internal Control Plan. FRCC Compliance Workshop May 13-15, 2014
2014 Integrated Internal Control Plan FRCC Compliance Workshop Contents Definitions Integrated Components of COSO Internal Control Framework The COSO Internal Control Framework and Seminole Control Environment
More informationSoftware product quality assurance
Software product quality assurance by-john R. RYAN Texas Instruments, Inc. Austin, Texas ABSTRACT Providing clear objectives, guidelines, and requirements in an environment conducive to high productivity
More informationHow mature is my test organization: STDM, an assessment tool
How mature is my test organization: STDM, an assessment tool Bonney Joseph, (Bonney.joseph@wipro.com) Nikhil Gupta, (Nikhil.gupta@wipro.com) Abstract Software ing thought of as a support function until
More informationRequirements Engineering: Part I. Software Requirements & Project Management CITS3220
Requirements Engineering: Part I Software Requirements & Project Management CITS3220 The Problems of Requirements What goal(s) are we trying to satisfy? How do we identify the scope and properties of the
More informationCSE 435 Software Engineering. Sept 14, 2015
CSE 435 Software Engineering Sept 14, 2015 What is Software Engineering Where Does the Software Engineer Fit In? Computer science: focusing on computer hardware, compilers, operating systems, and programming
More informationTop 10 Signs You're Ready (or Not)
Top 10 Signs You're Ready (or Not) For an Appraisal Gary Natwick Harris Corporation Gary Natwick - 1 Government Communications Systems Division DoD s Strategic and Business Development CMMI Technology
More informationModule: Building the Cloud Infrastructure
Upon completion of this module, you should be able to: Describe the cloud computing reference model Describe the deployment options and solutions for building a cloud infrastructure Describe various factors
More informationImproving Process Utilization with Tools
NDIA 11 th Annual Systems Engineering Conference Improving Process Utilization with Tools October 22, 2008 Frank Salvatore High Performance Technologies, inc. 3159 Schrader Road Dover NJ, 07801 (973) 442-6436
More informationGary Natwick Harris Corporation
Automated Monitoring of Compliance Gary Natwick Harris Corporation Gary Natwick - 1 Government Communications Systems Division DoD Programs Strategic Management and Business Development CMMI Technology
More informationProactively Managing ERP Risks. January 7, 2010
Proactively Managing ERP Risks January 7, 2010 0 Introductions and Objectives Establish a structured model to demonstrate the variety of risks associated with an ERP environment Discuss control areas that
More informationEvaluation & Decision Guides
SURGERY STRATEGIC CLINICAL NETWORK EVIDENCE DECISION SUPPORT PROGRAM Evaluation & Decision Guides 2014 Revision (v3) New ideas & Improvements Department of Surgery Evidence Decision Support Program Resource
More informationProject Remedies Solution Set s Ability to Transform your IT Organization. A Selection of Use Cases from Project Remedies Inc.
Project Remedies Solution Set s Ability to Transform your IT Organization A Selection of Use Cases from Project Remedies Inc. August 2016 Project Remedies Solution Set s Ability to Transform an IT Organization
More informationTest Management Test Planning - Test Plan is a document that is the point of reference based on which testing is carried out within the QA team.
Test Management Test Planning - Test Plan is a document that is the point of reference based on which testing is carried out within the QA team. - It is also a document we share with the Business Analysts,
More informationLIFE CYCLE ASSET MANAGEMENT. Project Reviews. Good Practice Guide GPG-FM-015. March 1996
LIFE YLE Good Practice Guide ASSET MANAGEMENT Project Reviews March 1996 Department of Energy Office of Field Management Office of Project and Fixed Asset Management ontents 1. INTRODUTION...1 2. PROJET
More informationAdapting software project estimation to the reality of changing development technologies
Adapting software project estimation to the reality of changing development technologies Introduction Estimating software projects where significant amounts of new technology are being used is a difficult
More information