STP 2013 Improve Testing Process with TPI Next

Transcription

1 STP 2013 Improve Testing Process with TPI Next Samir Nandi - Siemens Technologies & Services Pvt. Ltd. 43, Shantipally, E.M. Bypass Rashbehari Connector Kolkata-42

2 Abstract: Testing world has changed. Managing a test project and a test team is getting difficult day by day. There are multiple challenges respect to Cost, Time, Efficiency etc. Many testing projects recognize that improving the test process is essential for ensuring the quality of the system being tested and business process itself but remain unsure of the steps required to make this improvement. This paper will give a roadmap in improving testing process with TPI Next and discussed on following topics on its unique implementation technique: Why Test Process Improvement Model is Required General Process Improvement Model & detail on TPI Next Implementation Technique of TPI Next Key Findings from TPI Next Evaluation Investment & Return in implementation of TPI Next Ease of Implementation Why Test Process Improvement Model Testing world has changed. Managing a test project and a test team is getting difficult day by day. There are multiple challenges for a testing team, few of the challenges are: Testing is Uncontrollable Testing Costs too Much Testing Takes too much time Testing is Inefficient, Defects left No Standard process to follow No Benchmark to Compare No Established Goal Critical Success Factors are not identified Many testing projects recognize that improving the test process is essential for ensuring the quality of the system being tested and business process itself but remain unsure of the steps required to make this improvement. Fortunately, there are various testing process improvement frameworks from Industry best practices to apply. Before getting into TPI Next, lets review the general process improvement model. A general process improvement looks like below depicted in Figure 1: Goal & Scope Required a Reference Model from Industry Best Practice Execute Assessment (Current Situation) Perform Evaluation Continuous Improvement Define Improvement Actions Formulate Plan Implement Improvement Actions Figure1- General Process Improvement Model

3 First assess the current situation / process. Based on current assessment define improvement actions. Formulate a plan to implement improvement action items. Implement action items based on the priority. At logical point or after predefined period again evaluate the process to check where it stands. This is a continuous improvement model. For this process to be successful there is a requirement to set up a goal as well as scope for the improvement. To set up a goal/scope, a reference model is required which will help to measure current situation and take the process to the next level as required by the business process. TPI Next: One of the best test process improvement models is TPI Next developed by Sogeti. Figure 2 shows the basic elements of TPI Next and its structure. TPI Next supports stepwise process improvement & Business Driven Test Management Approach. TPI Next is based on 16 Key Areas of Testing, which falls under 3 cornerstones of Testing, Stakeholder Relations, Test Management & Test Profession. To evaluate the test process, each 16 key areas is assigned a particular level. So-called checkpoints are used to determine the strengths and weakness of a test process. At each level improvement suggestions are given to help to reach the next higher level. Along with continues improvement, this can be adjusted against the changing business requirement or priority. Process Driven Business Driven Continuous Improvement Figure 2- TPI Next

4 Implementation Technique of TPI Next Implementing TPI Next in a testing project is very easy. Figure 3 depicts the summary of implementation technique. Download TPI Next Tool - Free Identify Assessor Interviewing Identified Team Members Filled up TPI Next Tool for the Checklist Generate Test Maturity Matrix & Action Items Close Action Items & Go for Next Nevel Apply Critical Testing Process Figure 3- Implementation of TPI Next Following are the steps to be followed in implementing TPI Next for any project: 1. TPI Next Tool can be downloaded freely from website of Sogeti. 2. Create awareness among team, which will motivate the entire team to participate actively in this improvement process. 3. Identify assessors from team itself, preferably Test Leads for the team. 4. Determine the target area of consideration and approach. 5. Identify Action Items & Prioritize them 6. Implement the improvement actions from the assessment. 7. Evaluate again and go for next level This process can be further improved by embedding this with Critical testing process & Lean process. Figure 4 shows TPI Next maturity metrics & its levels. Apply in Any S/W Development Life Cycles Optimum Continuous Improvement Efficient Initial Controlled Improve this With Critical Testing Process Figure 4- TPI Next Metrics Please find the attached below blank tool for quick reference which is downloaded from : Blank_TPI_NEXT_tool _v2.1_0_keyprocessa

5 Key benefits of applying TPI Next Below are the key benefits of applying TPI Next in Testing Project. 1. This is a continuous improvement framework 2. It suggests improvement & come out with action items 3. Graphical Representation to set up a goal and work on action items 4. TPI Checklist for all the Key areas are easy to understand 5. Fast Assessment 6. Independent from other methods or models 7. Align with business drivers. Translate business goals into test goals with prioritization. 8. Leverage Best Practices from industry 9. Fit test process improvement to overall software development process improvement 10. TPI Next tool is free to download and ready to use. TPI Next offers a specific, balanced and correlated improvement path for Testing Projects. This model also provides a better understanding of the correlation between test process and adjacent processes. It will help discussing and addressing issues for improving the overall software process. Implementing TPI Next for all the testing projects of CTDC will give a huge return in short as well as long run. Key Findings from TPI Next Evaluation

6 There are good numbers of key findings after implementing TPI Next in one of the Testing projects. Findings are from all key areas of testing. Figure 4 highlighted few of the items. Key areas and action items are prioritized based on business requirement of the project. It helped in formulating Test Policy & Test Strategy which are part of major cornerstone of testing i.e. Stakeholder Relations. This involves all stakeholders to come into an agreement on scope of Quality attributes which will be part of the testing. From next cornerstone of testing i.e. Test Management, streamlined metrics & estimation areas. Immense helped found from Test Profession area, where major action items are identified from the area of Test Case Design. A roadmap needs to be created in implementing these actions items, where priority & target date needs to be set based on business requirement. Findings from Few Key Testing Areas Formulating Test Policy Feature Test Strategy SP Test Strategy Evaluating Test Process on regular basis Test Organization Test Strategy Test Process Management Risk is Part Of Reporting Reporting Recommendation is Part Of Reporting Checklist Where No Test Cases Can Be Designed Formal Test Design Techniques Test Design Checklist to Review TPs Figure 4- Key Findings of TPI Next Investment & Return in implementation of TPI Next Investment: TPI Next tool is free to download Assessor from the Team, preferably Test Leads / Test Manager 5 Working Days Return: Escaped Defects reduced significantly Schedule Slippage reduced to almost 0% Formulating Test Policy & Test Strategy Pin Point Where the Real troubles, - Reduced RCA cost Self motivated Team to improve current practices Improving overall testing process. Working towards Achieving Optimum Level Customer Satisfaction is getting improved

7 Ease of Implementation TPI Next can be implemented for any testing project / process in all testing phases. Below are the key benefits in implementing TPI Next: Tool to be downloaded from website of Sogeti ( Need MS Office (Excel) Checklist are easy to understand Graphical Representation to set up a goal Easy to implement compare to other Testing Process Assessment can be done by Experienced Testers Can Be implemented along with Lean Approach Can be Implemented for all types of Testing Projects / Testing Process Hope TPI Next will help in setting up a goal and achieving identified goals for a testing project in turn for a business. It generates a force to reach the Goal faster, by creating business ideas with team members involvement. Let s conclude this with below notes from Earl Nightingale. People with Goals succeed because they know where they are Going... It's as simple as that. - Earl Nightingale

8 Reference Materials Author s biography Samir Nandi is working as a Test Manger of a Project which covers entire testing life cycle / phases. He is having approx 13 years of Software Development & Testing Experience, worked in Healthcare, Finance & Network Domain. He is certified as ISTQB Advanced Test Manager, also gives training to ISTQB aspirants. He is having experience in implementing TPI Next in multiple projects. This idea has been presented as part of organization initiative Idea Exchange program, which has been awarded & appreciated from all levels. He has taken initiative in formulating Testing Principal & Testing Strategy for the current organization / project. He is leading a strong testing team which supports testing requirements of Scrum testing to System Testing.